2024-02-15T22:20:46.364 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T22:20:46.365 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769 --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769/orig.config.yaml 2024-02-15T22:20:46.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T22:20:46.505 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769 branch: wip-batrick-testing-20240215.160715 description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7561769' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240215.160715 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f78a58c0ffd401d1493058a1022c35f011d65275 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f78a58c0ffd401d1493058a1022c35f011d65275 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240215.160715 sha1: f78a58c0ffd401d1493058a1022c35f011d65275 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3196 sha1: f78a58c0ffd401d1493058a1022c35f011d65275 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: wip-batrick-testing-20240215.160715 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f78a58c0ffd401d1493058a1022c35f011d65275/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f78a58c0ffd401d1493058a1022c35f011d65275 targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZvemMzOsX48Newb3UwATb2/jHFjFwknbtdZimpUHyZr9KLbv/6vEsX9gXjiGA/aoTnQ3DQrB/IZweXX2Kc8ck= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPoZPPqXbBoINHdvuMRBlSWQndJ+f0c64JZ/5fc6/PbosatwPRrtWOGVI+CV19fJB2jMVSXvi74Dpt+BPPNso4s= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_21:23:20 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-15T22:20:46.505 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f78a58c0ffd401d1493058a1022c35f011d65275/qa; will attempt to use it 2024-02-15T22:20:46.506 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f78a58c0ffd401d1493058a1022c35f011d65275/qa/tasks 2024-02-15T22:20:46.506 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-15T22:20:46.507 INFO:teuthology.task.internal:Checking packages... 2024-02-15T22:20:46.531 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f78a58c0ffd401d1493058a1022c35f011d65275' 2024-02-15T22:20:46.531 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:20:46.531 INFO:teuthology.packaging:ref: None 2024-02-15T22:20:46.531 INFO:teuthology.packaging:tag: None 2024-02-15T22:20:46.531 INFO:teuthology.packaging:branch: wip-batrick-testing-20240215.160715 2024-02-15T22:20:46.531 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:20:46.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240215.160715 2024-02-15T22:20:46.747 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1450.gf78a58c0 2024-02-15T22:20:46.748 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-15T22:20:46.755 INFO:teuthology.task.internal:no buildpackages task found 2024-02-15T22:20:46.756 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-15T22:20:46.762 INFO:teuthology.task.internal:Saving configuration 2024-02-15T22:20:46.783 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-15T22:20:46.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T22:20:46.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:15:55.520213', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZvemMzOsX48Newb3UwATb2/jHFjFwknbtdZimpUHyZr9KLbv/6vEsX9gXjiGA/aoTnQ3DQrB/IZweXX2Kc8ck='} 2024-02-15T22:20:46.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:15:55.521827', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPoZPPqXbBoINHdvuMRBlSWQndJ+f0c64JZ/5fc6/PbosatwPRrtWOGVI+CV19fJB2jMVSXvi74Dpt+BPPNso4s='} 2024-02-15T22:20:46.840 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-15T22:20:46.846 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-15T22:20:46.846 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-15T22:20:46.846 INFO:teuthology.run_tasks:Running task console_log... 2024-02-15T22:20:46.920 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d3f2440d0>, signals=[15]) 2024-02-15T22:20:46.920 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-15T22:20:46.926 INFO:teuthology.task.internal:Opening connections... 2024-02-15T22:20:46.926 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:20:46.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:20:47.033 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-02-15T22:20:47.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:20:47.118 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-15T22:20:47.124 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-02-15T22:20:47.141 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-02-15T22:20:47.142 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-02-15T22:20:47.198 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T22:20:47.199 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-02-15T22:20:47.199 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T22:20:47.199 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T22:20:47.199 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T22:20:47.199 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-02-15T22:20:47.217 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-02-15T22:20:47.234 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-02-15T22:20:47.234 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-02-15T22:20:47.290 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T22:20:47.291 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T22:20:47.292 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-02-15T22:20:47.308 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-15T22:20:47.318 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-15T22:20:47.323 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-15T22:20:47.324 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-02-15T22:20:47.326 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-02-15T22:20:47.345 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-15T22:20:47.351 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-15T22:20:47.351 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-02-15T22:20:47.381 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-02-15T22:20:47.421 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-15T22:20:47.474 INFO:teuthology.run_tasks:Running task kernel... 2024-02-15T22:20:47.488 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-15T22:20:47.489 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-15T22:20:47.489 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T22:20:47.489 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T22:20:47.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:20:47.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:20:47.505 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-02-15T22:20:47.505 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-02-15T22:20:47.561 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-361.el9.x86_64 2024-02-15T22:20:47.561 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-361.el9.x86_64 2024-02-15T22:20:47.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-02-15T22:20:47.562 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-361.el9.x86_64 2024-02-15T22:20:47.562 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.14.0-361.el9.x86_64 2024-02-15T22:20:47.563 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-02-15T22:20:49.828 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-02-15T22:20:49.890 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.7 MB 00:00 2024-02-15T22:20:51.245 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-9 - BaseOS 7.6 MB/s | 2.0 MB 00:00 2024-02-15T22:20:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2024-02-15T22:20:52.319 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-02-15T22:20:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-02-15T22:20:54.415 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-02-15T22:20:55.495 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 19 MB 00:02 2024-02-15T22:20:58.673 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.1 MB 00:00 2024-02-15T22:21:00.099 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2024-02-15T22:21:00.934 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 29 MB/s | 20 MB 00:00 2024-02-15T22:21:01.161 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.1 MB 00:01 2024-02-15T22:21:02.662 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2024-02-15T22:21:05.900 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-02-15T22:21:08.148 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T22:21:08.148 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T22:21:08.260 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T22:21:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T22:21:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T22:21:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:21:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:21:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:21:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-02-15T22:21:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:21:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 100 M 2024-02-15T22:21:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 123 M 2024-02-15T22:21:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:21:08.626 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 17 MB/s | 6.1 MB 00:00 2024-02-15T22:21:09.109 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 25 MB/s | 21 MB 00:00 2024-02-15T22:21:09.726 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 31 MB/s | 33 MB 00:01 2024-02-15T22:21:10.160 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 21 MB/s | 39 MB 00:01 2024-02-15T22:21:10.163 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:21:10.163 INFO:teuthology.orchestra.run.smithi082.stdout:Total 53 MB/s | 100 MB 00:01 2024-02-15T22:21:10.163 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:21:10.528 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:21:10.528 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:21:11.620 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:21:11.620 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:21:11.832 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 20 MB 00:09 2024-02-15T22:21:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:21:14.727 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:21:14.859 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:21:16.831 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-02-15T22:21:17.583 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:21:17.754 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:21:19.285 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T22:21:19.285 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T22:21:19.378 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:21:19.384 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:21:19.384 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:21:19.384 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:21:19.384 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout:Install 4 Packages 2024-02-15T22:21:19.385 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:21:19.386 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 100 M 2024-02-15T22:21:19.386 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 123 M 2024-02-15T22:21:19.386 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:21:19.771 INFO:teuthology.orchestra.run.smithi033.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 16 MB/s | 6.1 MB 00:00 2024-02-15T22:21:20.222 INFO:teuthology.orchestra.run.smithi033.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 25 MB/s | 21 MB 00:00 2024-02-15T22:21:20.955 INFO:teuthology.orchestra.run.smithi033.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 25 MB/s | 39 MB 00:01 2024-02-15T22:21:21.305 INFO:teuthology.orchestra.run.smithi033.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 22 MB/s | 33 MB 00:01 2024-02-15T22:21:21.309 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:21:21.309 INFO:teuthology.orchestra.run.smithi033.stdout:Total 52 MB/s | 100 MB 00:01 2024-02-15T22:21:21.309 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:21:21.771 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:21:21.771 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:21:22.473 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:21:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:22.813 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:21:22.814 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:21:25.345 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:21:26.022 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:21:26.147 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:21:27.355 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:29.036 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:21:29.208 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:21:34.277 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:21:34.388 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:39.490 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:56.586 INFO:teuthology.orchestra.run.smithi082.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-15T22:21:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:21:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:21:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:21:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:21:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:21:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:21:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:21:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-15T22:21:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-15T22:21:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-15T22:21:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-15T22:21:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:21:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:21:58.002 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:21:58.175 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:21:58.175 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:21:58.175 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-15T22:21:58.175 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T22:21:58.176 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T22:21:58.176 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-15T22:21:58.176 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T22:21:58.176 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:21:58.284 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:21:58.284 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:21:58.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-02-15T22:21:58.318 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-02-15T22:21:58.318 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-02-15T22:21:58.318 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-02-15T22:21:58.318 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-02-15T22:21:58.318 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-02-15T22:21:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:21:58.320 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T22:21:58.320 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T22:21:58.320 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T22:21:58.320 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-02-15T22:21:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:21:58.320 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T22:21:58.321 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T22:21:58.321 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 5.14.0-421.el9.x86_64 2024-02-15T22:21:58.321 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T22:21:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-02-15T22:22:00.355 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-15T22:22:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-02-15T22:22:00.377 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-02-15T22:22:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.nmcFlpcHNJ 2024-02-15T22:22:00.392 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nmcFlpcHNJ 2024-02-15T22:22:00.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.nmcFlpcHNJ 2024-02-15T22:22:00.592 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.nmcFlpcHNJ is 6KB 2024-02-15T22:22:00.640 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.nmcFlpcHNJ 2024-02-15T22:22:00.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T22:22:00.719 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-15T22:22:00.719 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-15T22:22:00.719 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-15T22:22:00.719 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-15T22:22:00.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-15T22:22:00.874 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-02-15T22:22:10.026 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:22:10.026 INFO:teuthology.orchestra.run.smithi033.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-15T22:22:10.026 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:22:10.099 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:22:10.465 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:22:10.466 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:22:10.466 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:22:10.466 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:22:10.901 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:22:11.464 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:22:11.641 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:22:11.642 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:22:11.642 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-15T22:22:11.642 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T22:22:11.642 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T22:22:11.643 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-15T22:22:11.643 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T22:22:11.643 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:22:11.755 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:22:11.755 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:22:11.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.06 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 68.el9 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Group : Unspecified 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 8264254 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-15T22:22:11.793 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : builder@centos.org 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:22:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T22:22:11.795 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T22:22:11.795 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 5.14.0-421.el9.x86_64 2024-02-15T22:22:11.795 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T22:22:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-02-15T22:22:13.704 INFO:teuthology.orchestra.run.smithi033.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-15T22:22:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-02-15T22:22:13.743 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-02-15T22:22:13.759 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.0xFxgpd61R 2024-02-15T22:22:13.759 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0xFxgpd61R 2024-02-15T22:22:13.833 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.0xFxgpd61R 2024-02-15T22:22:13.976 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.0xFxgpd61R is 6KB 2024-02-15T22:22:14.027 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.0xFxgpd61R 2024-02-15T22:22:14.042 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T22:22:14.110 INFO:teuthology.orchestra.run.smithi033.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-15T22:22:14.110 INFO:teuthology.orchestra.run.smithi033.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-15T22:22:14.110 INFO:teuthology.orchestra.run.smithi033.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-15T22:22:14.110 INFO:teuthology.orchestra.run.smithi033.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-15T22:22:14.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-15T22:22:14.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-02-15T22:22:30.891 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-15T22:22:30.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-15T22:22:30.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:22:44.272 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-15T22:22:44.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T22:22:44.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:23:30.942 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T22:23:39.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-15T22:23:39.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:23:40.443 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-02-15T22:23:40.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-15T22:23:40.837 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-421.el9.x86_64"... 2024-02-15T22:23:40.837 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-02-15T22:23:40.851 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-421.el9.x86_64 2024-02-15T22:23:40.852 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-15T22:23:40.852 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T22:23:40.852 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T22:23:41.853 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-15T22:23:41.854 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T22:23:41.918 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-02-15T22:23:41.963 DEBUG:teuthology.parallel:result is None 2024-02-15T22:23:44.275 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T22:23:53.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T22:23:53.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:23:53.698 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-02-15T22:23:54.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T22:23:54.088 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-421.el9.x86_64"... 2024-02-15T22:23:54.088 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-02-15T22:23:54.104 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-421.el9.x86_64 2024-02-15T22:23:54.104 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-15T22:23:54.104 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T22:23:54.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T22:23:55.105 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-15T22:23:55.106 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T22:23:55.179 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2024-02-15T22:23:55.233 DEBUG:teuthology.parallel:result is None 2024-02-15T22:23:55.233 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-15T22:23:55.240 INFO:teuthology.task.internal:Creating test directory... 2024-02-15T22:23:55.240 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T22:23:55.243 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T22:23:55.261 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-15T22:23:55.274 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-15T22:23:55.283 INFO:teuthology.task.internal:Creating archive directory... 2024-02-15T22:23:55.283 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T22:23:55.300 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T22:23:55.355 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-15T22:23:55.362 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-15T22:23:55.363 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T22:23:55.373 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T22:23:55.409 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:23:55.415 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:23:55.423 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:23:55.429 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:23:55.431 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-15T22:23:55.438 INFO:teuthology.task.internal:Configuring sudo... 2024-02-15T22:23:55.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T22:23:55.467 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T22:23:55.501 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-15T22:23:55.511 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-15T22:23:55.511 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T22:23:55.537 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T22:23:55.558 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:23:55.635 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:23:55.691 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:23:55.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:23:55.815 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:23:55.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T22:23:55.882 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:23:55.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:23:55.979 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:23:56.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:23:56.111 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:23:56.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T22:23:56.181 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-02-15T22:23:56.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-02-15T22:23:56.224 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:23:56.289 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:23:56.653 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-15T22:23:56.663 INFO:teuthology.task.internal:Starting timer... 2024-02-15T22:23:56.663 INFO:teuthology.run_tasks:Running task pcp... 2024-02-15T22:23:56.681 INFO:teuthology.run_tasks:Running task selinux... 2024-02-15T22:23:56.696 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-15T22:23:56.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-02-15T22:23:56.741 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-02-15T22:23:56.743 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-02-15T22:23:56.790 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-02-15T22:23:56.792 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-15T22:23:56.793 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-02-15T22:23:56.818 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-02-15T22:23:56.819 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-02-15T22:23:56.839 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-02-15T22:23:56.840 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive'} 2024-02-15T22:23:56.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:23:56.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:23:56.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:23:56.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:23:56.917 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-15T22:23:56.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-02-15T22:23:56.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-02-15T22:23:56.999 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-15T22:23:57.011 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-15T22:23:57.018 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-15T22:23:57.185 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-15T22:23:57.201 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-15T22:23:57.202 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-15T22:28:08.034 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2024-02-15T22:28:08.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T22:28:08.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:28:08.135 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-02-15T22:28:08.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T22:28:08.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-15T22:28:08.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:28:08.308 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-02-15T22:28:08.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-15T22:28:08.388 INFO:teuthology.run_tasks:Running task clock... 2024-02-15T22:28:08.402 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-15T22:28:08.402 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T22:28:08.403 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:28:08.405 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T22:28:08.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:28:08.436 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T22:28:08.454 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T22:28:08.460 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T22:28:08.478 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T22:28:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-02-15T22:28:08.498 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-02-15T22:28:08.507 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-02-15T22:28:08.514 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T22:28:08.521 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-02-15T22:28:08.530 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T22:28:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T22:28:08.554 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T22:28:08.582 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:28:08.586 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:28:08.586 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-02-15T22:28:08.586 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.586 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.586 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.586 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:28:08.609 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-02-15T22:28:08.609 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.609 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.609 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.609 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:28:08.610 INFO:teuthology.run_tasks:Running task install... 2024-02-15T22:28:08.619 DEBUG:teuthology.task.install:project ceph 2024-02-15T22:28:08.619 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'}} 2024-02-15T22:28:08.619 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-15T22:28:08.619 INFO:teuthology.task.install:Using flavor: default 2024-02-15T22:28:08.625 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-15T22:28:08.625 INFO:teuthology.task.install:extra packages: [] 2024-02-15T22:28:08.625 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': None, 'wait_for_package': False} 2024-02-15T22:28:08.626 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:28:08.626 INFO:teuthology.packaging:ref: None 2024-02-15T22:28:08.626 INFO:teuthology.packaging:tag: None 2024-02-15T22:28:08.626 INFO:teuthology.packaging:branch: quincy 2024-02-15T22:28:08.626 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:28:08.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-15T22:28:08.628 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': None, 'wait_for_package': False} 2024-02-15T22:28:08.629 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:28:08.629 INFO:teuthology.packaging:ref: None 2024-02-15T22:28:08.629 INFO:teuthology.packaging:tag: None 2024-02-15T22:28:08.629 INFO:teuthology.packaging:branch: quincy 2024-02-15T22:28:08.629 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:28:08.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-15T22:28:08.839 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/ 2024-02-15T22:28:08.840 INFO:teuthology.task.install.rpm:Package version is 17.2.7-509.g9aa52330 2024-02-15T22:28:08.855 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/ 2024-02-15T22:28:08.855 INFO:teuthology.task.install.rpm:Package version is 17.2.7-509.g9aa52330 2024-02-15T22:28:08.959 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T22:28:08.959 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:28:08.959 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T22:28:08.987 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T22:28:08.987 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:28:08.988 INFO:teuthology.packaging:ref: None 2024-02-15T22:28:08.988 INFO:teuthology.packaging:tag: None 2024-02-15T22:28:08.988 INFO:teuthology.packaging:branch: quincy 2024-02-15T22:28:08.988 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:28:08.988 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T22:28:09.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T22:28:09.067 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/9aa523302d708a6b7b80d8bdd462ebc306fb50d2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T22:28:09.067 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:28:09.067 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T22:28:09.097 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T22:28:09.097 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:28:09.097 INFO:teuthology.packaging:ref: None 2024-02-15T22:28:09.097 INFO:teuthology.packaging:tag: None 2024-02-15T22:28:09.098 INFO:teuthology.packaging:branch: quincy 2024-02-15T22:28:09.098 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:28:09.098 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T22:28:09.138 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T22:28:09.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T22:28:09.204 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-02-15T22:28:09.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-02-15T22:28:09.249 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T22:28:09.315 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-02-15T22:28:09.317 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-02-15T22:28:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:74 files removed 2024-02-15T22:28:09.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw 2024-02-15T22:28:09.565 INFO:teuthology.orchestra.run.smithi033.stdout:74 files removed 2024-02-15T22:28:09.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw 2024-02-15T22:28:10.144 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 221 kB/s | 77 kB 00:00 2024-02-15T22:28:10.340 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 182 kB/s | 77 kB 00:00 2024-02-15T22:28:10.595 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 23 kB/s | 9.1 kB 00:00 2024-02-15T22:28:10.773 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 24 kB/s | 9.1 kB 00:00 2024-02-15T22:28:11.012 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 4.7 kB/s | 1.8 kB 00:00 2024-02-15T22:28:11.183 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 4.8 kB/s | 1.8 kB 00:00 2024-02-15T22:28:11.489 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-02-15T22:28:11.685 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-02-15T22:28:12.973 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-02-15T22:28:13.152 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-02-15T22:28:14.305 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.0 MB 00:00 2024-02-15T22:28:16.308 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-02-15T22:28:21.198 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.1 MB 00:01 2024-02-15T22:28:22.890 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2024-02-15T22:28:22.975 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 863 kB/s | 8.0 MB 00:09 2024-02-15T22:28:23.783 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 27 MB/s | 20 MB 00:00 2024-02-15T22:28:24.760 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-02-15T22:28:28.691 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-15T22:28:29.627 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.1 MB 00:01 2024-02-15T22:28:31.350 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:28:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:28:31.361 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:28:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:28:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:28:31.361 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:17.2.7-509.g9aa52330.el9 ceph 14 M 2024-02-15T22:28:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 3.1 M 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 2.9 M 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:17.2.7-509.g9aa52330.el9 ceph 5.0 M 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:17.2.7-509.g9aa52330.el9 ceph 23 M 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:17.2.7-509.g9aa52330.el9 ceph 25 k 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 635 k 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 458 k 2024-02-15T22:28:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 4.9 M 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:17.2.7-509.g9aa52330.el9 ceph 45 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:17.2.7-509.g9aa52330.el9 ceph 116 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:17.2.7-509.g9aa52330.el9 ceph 156 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:17.2.7-509.g9aa52330.el9 ceph 320 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:17.2.7-509.g9aa52330.el9 ceph 292 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:17.2.7-509.g9aa52330.el9 ceph 99 k 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:28:31.363 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:28:31.364 INFO:teuthology.orchestra.run.smithi082.stdout:Install 22 Packages 2024-02-15T22:28:31.364 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 2 Packages 2024-02-15T22:28:31.364 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:31.364 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 58 M 2024-02-15T22:28:31.364 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:28:31.419 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 15 kB 00:00 2024-02-15T22:28:32.729 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2024-02-15T22:28:32.942 INFO:teuthology.orchestra.run.smithi082.stdout:(1/24): ceph-radosgw-17.2.7-509.g9aa52330.el9.x 9.8 MB/s | 14 MB 00:01 2024-02-15T22:28:32.975 INFO:teuthology.orchestra.run.smithi082.stdout:(2/24): ceph-selinux-17.2.7-509.g9aa52330.el9.x 761 kB/s | 25 kB 00:00 2024-02-15T22:28:33.051 INFO:teuthology.orchestra.run.smithi082.stdout:(3/24): libcephfs2-17.2.7-509.g9aa52330.el9.x86 8.3 MB/s | 635 kB 00:00 2024-02-15T22:28:33.118 INFO:teuthology.orchestra.run.smithi082.stdout:(4/24): ceph-base-17.2.7-509.g9aa52330.el9.x86_ 3.1 MB/s | 5.0 MB 00:01 2024-02-15T22:28:33.151 INFO:teuthology.orchestra.run.smithi082.stdout:(5/24): libradosstriper1-17.2.7-509.g9aa52330.e 4.5 MB/s | 458 kB 00:00 2024-02-15T22:28:33.201 INFO:teuthology.orchestra.run.smithi082.stdout:(6/24): python3-ceph-argparse-17.2.7-509.g9aa52 905 kB/s | 45 kB 00:00 2024-02-15T22:28:33.301 INFO:teuthology.orchestra.run.smithi082.stdout:(7/24): python3-ceph-common-17.2.7-509.g9aa5233 1.1 MB/s | 116 kB 00:00 2024-02-15T22:28:33.377 INFO:teuthology.orchestra.run.smithi082.stdout:(8/24): python3-cephfs-17.2.7-509.g9aa52330.el9 2.0 MB/s | 156 kB 00:00 2024-02-15T22:28:33.469 INFO:teuthology.orchestra.run.smithi082.stdout:(9/24): librgw2-17.2.7-509.g9aa52330.el9.x86_64 14 MB/s | 4.9 MB 00:00 2024-02-15T22:28:33.502 INFO:teuthology.orchestra.run.smithi082.stdout:(10/24): python3-rados-17.2.7-509.g9aa52330.el9 2.5 MB/s | 320 kB 00:00 2024-02-15T22:28:33.536 INFO:teuthology.orchestra.run.smithi082.stdout:(11/24): python3-rbd-17.2.7-509.g9aa52330.el9.x 4.3 MB/s | 292 kB 00:00 2024-02-15T22:28:33.561 INFO:teuthology.orchestra.run.smithi082.stdout:(12/24): python3-rgw-17.2.7-509.g9aa52330.el9.x 1.7 MB/s | 99 kB 00:00 2024-02-15T22:28:33.703 INFO:teuthology.orchestra.run.smithi082.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 375 kB/s | 44 kB 00:00 2024-02-15T22:28:33.737 INFO:teuthology.orchestra.run.smithi082.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 793 kB/s | 159 kB 00:00 2024-02-15T22:28:34.012 INFO:teuthology.orchestra.run.smithi082.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 661 kB 00:00 2024-02-15T22:28:34.104 INFO:teuthology.orchestra.run.smithi082.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 770 kB/s | 282 kB 00:00 2024-02-15T22:28:34.121 INFO:teuthology.orchestra.run.smithi082.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 379 kB/s | 41 kB 00:00 2024-02-15T22:28:34.513 INFO:teuthology.orchestra.run.smithi082.stdout:(18/24): ceph-common-17.2.7-509.g9aa52330.el9.x 7.5 MB/s | 23 MB 00:03 2024-02-15T22:28:34.763 INFO:teuthology.orchestra.run.smithi082.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 76 kB/s | 49 kB 00:00 2024-02-15T22:28:34.821 INFO:teuthology.orchestra.run.smithi082.stdout:(20/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 431 kB/s | 309 kB 00:00 2024-02-15T22:28:34.964 INFO:teuthology.orchestra.run.smithi082.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 150 kB/s | 67 kB 00:00 2024-02-15T22:28:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:(22/24): librbd1-17.2.7-509.g9aa52330.el9.x86_6 12 MB/s | 2.9 MB 00:00 2024-02-15T22:28:35.239 INFO:teuthology.orchestra.run.smithi082.stdout:(23/24): thrift-0.15.0-2.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-02-15T22:28:35.456 INFO:teuthology.orchestra.run.smithi082.stdout:(24/24): librados2-17.2.7-509.g9aa52330.el9.x86 4.9 MB/s | 3.1 MB 00:00 2024-02-15T22:28:35.463 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:28:35.464 INFO:teuthology.orchestra.run.smithi082.stdout:Total 14 MB/s | 58 MB 00:04 2024-02-15T22:28:35.464 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:28:35.496 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:28:35.496 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:28:35.962 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:28:35.962 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:28:37.211 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:28:37.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-15T22:28:37.633 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:17.2.7-509.g9aa52330.el9.x86_64 2/26 2024-02-15T22:28:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:17.2.7-509.g9aa52330.el9.x86_64 2/26 2024-02-15T22:28:37.729 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-15T22:28:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 3/26 2024-02-15T22:28:37.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 4/26 2024-02-15T22:28:37.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 4/26 2024-02-15T22:28:37.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-15T22:28:38.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-15T22:28:38.460 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-15T22:28:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 8/26 2024-02-15T22:28:38.540 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 8/26 2024-02-15T22:28:38.570 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-15T22:28:38.613 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:17.2.7-509.g9aa52330.el9.x 10/26 2024-02-15T22:28:38.652 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 11/26 2024-02-15T22:28:38.711 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 12/26 2024-02-15T22:28:38.740 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 13/26 2024-02-15T22:28:38.788 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 13/26 2024-02-15T22:28:38.827 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-15T22:28:38.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-15T22:28:38.888 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-15T22:28:39.192 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-15T22:28:39.226 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 18/26 2024-02-15T22:28:39.298 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 18/26 2024-02-15T22:28:39.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 19/26 2024-02-15T22:28:39.404 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:17.2.7-509.g9aa52330.el9.x86 20/26 2024-02-15T22:28:40.499 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:28:40.513 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:28:40.513 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:28:40.513 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:28:40.513 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:28:40.513 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:17.2.7-509.g9aa52330.el9 ceph 14 M 2024-02-15T22:28:40.513 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 3.1 M 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 2.9 M 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:17.2.7-509.g9aa52330.el9 ceph 5.0 M 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:17.2.7-509.g9aa52330.el9 ceph 23 M 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:17.2.7-509.g9aa52330.el9 ceph 25 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 635 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 458 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-15T22:28:40.514 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:17.2.7-509.g9aa52330.el9 ceph 4.9 M 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:17.2.7-509.g9aa52330.el9 ceph 45 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:17.2.7-509.g9aa52330.el9 ceph 116 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:17.2.7-509.g9aa52330.el9 ceph 156 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:17.2.7-509.g9aa52330.el9 ceph 320 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:17.2.7-509.g9aa52330.el9 ceph 292 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:17.2.7-509.g9aa52330.el9 ceph 99 k 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:28:40.515 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:28:40.516 INFO:teuthology.orchestra.run.smithi033.stdout:Install 22 Packages 2024-02-15T22:28:40.516 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 2 Packages 2024-02-15T22:28:40.516 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:28:40.516 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 58 M 2024-02-15T22:28:40.516 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:28:41.306 INFO:teuthology.orchestra.run.smithi033.stdout:(1/24): ceph-base-17.2.7-509.g9aa52330.el9.x86_ 6.8 MB/s | 5.0 MB 00:00 2024-02-15T22:28:41.364 INFO:teuthology.orchestra.run.smithi033.stdout:(2/24): ceph-selinux-17.2.7-509.g9aa52330.el9.x 433 kB/s | 25 kB 00:00 2024-02-15T22:28:41.464 INFO:teuthology.orchestra.run.smithi033.stdout:(3/24): libcephfs2-17.2.7-509.g9aa52330.el9.x86 6.2 MB/s | 635 kB 00:00 2024-02-15T22:28:41.556 INFO:teuthology.orchestra.run.smithi033.stdout:(4/24): libradosstriper1-17.2.7-509.g9aa52330.e 4.9 MB/s | 458 kB 00:00 2024-02-15T22:28:41.852 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 21/26 2024-02-15T22:28:41.892 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 21/26 2024-02-15T22:28:42.065 INFO:teuthology.orchestra.run.smithi033.stdout:(5/24): librgw2-17.2.7-509.g9aa52330.el9.x86_64 9.6 MB/s | 4.9 MB 00:00 2024-02-15T22:28:42.132 INFO:teuthology.orchestra.run.smithi033.stdout:(6/24): python3-ceph-argparse-17.2.7-509.g9aa52 680 kB/s | 45 kB 00:00 2024-02-15T22:28:42.224 INFO:teuthology.orchestra.run.smithi033.stdout:(7/24): python3-ceph-common-17.2.7-509.g9aa5233 1.2 MB/s | 116 kB 00:00 2024-02-15T22:28:42.332 INFO:teuthology.orchestra.run.smithi033.stdout:(8/24): python3-cephfs-17.2.7-509.g9aa52330.el9 1.4 MB/s | 156 kB 00:00 2024-02-15T22:28:42.421 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 21/26 2024-02-15T22:28:42.449 INFO:teuthology.orchestra.run.smithi033.stdout:(9/24): python3-rados-17.2.7-509.g9aa52330.el9. 2.7 MB/s | 320 kB 00:00 2024-02-15T22:28:42.453 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 22/26 2024-02-15T22:28:42.546 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 22/26 2024-02-15T22:28:42.546 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-15T22:28:42.546 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-15T22:28:42.546 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:42.574 INFO:teuthology.orchestra.run.smithi033.stdout:(10/24): python3-rbd-17.2.7-509.g9aa52330.el9.x 2.3 MB/s | 292 kB 00:00 2024-02-15T22:28:42.579 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 23/26 2024-02-15T22:28:42.683 INFO:teuthology.orchestra.run.smithi033.stdout:(11/24): python3-rgw-17.2.7-509.g9aa52330.el9.x 918 kB/s | 99 kB 00:00 2024-02-15T22:28:43.034 INFO:teuthology.orchestra.run.smithi033.stdout:(12/24): ceph-common-17.2.7-509.g9aa52330.el9.x 9.1 MB/s | 23 MB 00:02 2024-02-15T22:28:43.059 INFO:teuthology.orchestra.run.smithi033.stdout:(13/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 424 kB/s | 159 kB 00:00 2024-02-15T22:28:43.226 INFO:teuthology.orchestra.run.smithi033.stdout:(14/24): ceph-radosgw-17.2.7-509.g9aa52330.el9. 5.3 MB/s | 14 MB 00:02 2024-02-15T22:28:43.251 INFO:teuthology.orchestra.run.smithi033.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 204 kB/s | 44 kB 00:00 2024-02-15T22:28:43.368 INFO:teuthology.orchestra.run.smithi033.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 661 kB 00:00 2024-02-15T22:28:43.418 INFO:teuthology.orchestra.run.smithi033.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 282 kB 00:00 2024-02-15T22:28:43.443 INFO:teuthology.orchestra.run.smithi033.stdout:(18/24): python3-prettytable-0.7.2-27.el9.noarc 214 kB/s | 41 kB 00:00 2024-02-15T22:28:43.819 INFO:teuthology.orchestra.run.smithi033.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 129 kB/s | 49 kB 00:00 2024-02-15T22:28:43.844 INFO:teuthology.orchestra.run.smithi033.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 168 kB/s | 67 kB 00:00 2024-02-15T22:28:43.978 INFO:teuthology.orchestra.run.smithi033.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 507 kB/s | 309 kB 00:00 2024-02-15T22:28:44.270 INFO:teuthology.orchestra.run.smithi033.stdout:(22/24): librados2-17.2.7-509.g9aa52330.el9.x86 7.2 MB/s | 3.1 MB 00:00 2024-02-15T22:28:44.353 INFO:teuthology.orchestra.run.smithi033.stdout:(23/24): librbd1-17.2.7-509.g9aa52330.el9.x86_6 7.8 MB/s | 2.9 MB 00:00 2024-02-15T22:28:44.537 INFO:teuthology.orchestra.run.smithi033.stdout:(24/24): thrift-0.15.0-2.el9.x86_64.rpm 2.2 MB/s | 1.6 MB 00:00 2024-02-15T22:28:44.540 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:28:44.540 INFO:teuthology.orchestra.run.smithi033.stdout:Total 14 MB/s | 58 MB 00:04 2024-02-15T22:28:44.540 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:28:44.577 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:28:44.577 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:28:45.061 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:28:45.061 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:28:46.447 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:28:46.844 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-15T22:28:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:17.2.7-509.g9aa52330.el9.x86_64 2/26 2024-02-15T22:28:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:17.2.7-509.g9aa52330.el9.x86_64 2/26 2024-02-15T22:28:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 3/26 2024-02-15T22:28:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 4/26 2024-02-15T22:28:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 4/26 2024-02-15T22:28:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-15T22:28:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-15T22:28:47.710 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-15T22:28:47.735 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 8/26 2024-02-15T22:28:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 8/26 2024-02-15T22:28:47.827 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-15T22:28:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:17.2.7-509.g9aa52330.el9.x 10/26 2024-02-15T22:28:47.912 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 11/26 2024-02-15T22:28:47.971 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 12/26 2024-02-15T22:28:47.996 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 13/26 2024-02-15T22:28:48.045 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 13/26 2024-02-15T22:28:48.085 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-15T22:28:48.121 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-15T22:28:48.154 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-15T22:28:48.463 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-15T22:28:48.492 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 18/26 2024-02-15T22:28:48.583 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 18/26 2024-02-15T22:28:48.656 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 19/26 2024-02-15T22:28:48.687 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:17.2.7-509.g9aa52330.el9.x86 20/26 2024-02-15T22:28:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 21/26 2024-02-15T22:28:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 21/26 2024-02-15T22:28:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 21/26 2024-02-15T22:28:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 22/26 2024-02-15T22:28:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 22/26 2024-02-15T22:28:51.859 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-15T22:28:51.859 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-15T22:28:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:28:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 23/26 2024-02-15T22:28:52.117 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 23/26 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-02-15T22:28:52.118 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:53.378 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 24/26 2024-02-15T22:28:53.438 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 24/26 2024-02-15T22:28:53.438 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:28:53.438 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-15T22:28:53.438 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:28:53.438 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:28:53.439 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:53.440 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-15T22:28:53.515 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-15T22:28:53.515 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-15T22:28:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-15T22:28:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 1/26 2024-02-15T22:28:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 2/26 2024-02-15T22:28:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 3/26 2024-02-15T22:28:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 4/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 5/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 6/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 7/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:17.2.7-509.g9aa52330.el9.x 8/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:17.2.7-509.g9aa52330.el9.x86 9/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 10/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 11/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 12/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 13/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-15T22:28:54.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-15T22:28:54.791 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-15T22:28:54.791 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-15T22:28:54.791 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-15T22:28:54.791 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-15T22:28:54.791 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:17.2.7-509.g9aa52330.el9.x86_64 23/26 2024-02-15T22:28:54.791 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-15T22:28:54.791 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 25/26 2024-02-15T22:28:55.820 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-15T22:28:55.820 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-15T22:28:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-15T22:28:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:55.823 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:28:56.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-test 2024-02-15T22:28:56.747 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:28 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:17.2.7-509.g9aa52330.el9 ceph 48 M 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-15T22:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:17.2.7-509.g9aa52330.el9 ceph 162 k 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout:Install 6 Packages 2024-02-15T22:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 49 M 2024-02-15T22:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 196 M 2024-02-15T22:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 300 kB 00:00 2024-02-15T22:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-02-15T22:28:57.160 INFO:teuthology.orchestra.run.smithi082.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-02-15T22:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-02-15T22:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:(5/6): libcephsqlite-17.2.7-509.g9aa52330.el9.x 447 kB/s | 162 kB 00:00 2024-02-15T22:28:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:(6/6): ceph-test-17.2.7-509.g9aa52330.el9.x86_6 21 MB/s | 48 MB 00:02 2024-02-15T22:28:59.263 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:28:59.264 INFO:teuthology.orchestra.run.smithi082.stdout:Total 21 MB/s | 49 MB 00:02 2024-02-15T22:28:59.264 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:28:59.283 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:28:59.283 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:28:59.673 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:28:59.673 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:00.264 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:00.343 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-15T22:29:00.376 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-15T22:29:00.426 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-15T22:29:00.469 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-15T22:29:00.496 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 5/6 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 23/26 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-02-15T22:29:01.744 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:03.049 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 24/26 2024-02-15T22:29:03.126 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 24/26 2024-02-15T22:29:03.126 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:03.126 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-15T22:29:03.126 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:29:03.126 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:29:03.126 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:03.128 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-15T22:29:03.218 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-15T22:29:03.218 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-15T22:29:04.520 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-15T22:29:04.520 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 1/26 2024-02-15T22:29:04.520 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 2/26 2024-02-15T22:29:04.520 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 3/26 2024-02-15T22:29:04.520 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 4/26 2024-02-15T22:29:04.520 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 5/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 6/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 7/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:17.2.7-509.g9aa52330.el9.x 8/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:17.2.7-509.g9aa52330.el9.x86 9/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 10/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 11/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 12/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 13/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-15T22:29:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-15T22:29:04.522 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-15T22:29:04.522 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-15T22:29:04.522 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-15T22:29:04.522 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:17.2.7-509.g9aa52330.el9.x86_64 23/26 2024-02-15T22:29:04.522 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-15T22:29:04.522 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 25/26 2024-02-15T22:29:04.927 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 5/6 2024-02-15T22:29:05.003 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 6/6 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-15T22:29:05.448 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:05.450 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-15T22:29:05.450 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:05.450 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:05.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-test 2024-02-15T22:29:06.351 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:29 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:06.530 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:06.531 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:06.531 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:29:06.531 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:06.531 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:06.531 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:17.2.7-509.g9aa52330.el9 ceph 48 M 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:17.2.7-509.g9aa52330.el9 ceph 162 k 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2024-02-15T22:29:06.532 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:06.533 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 49 M 2024-02-15T22:29:06.533 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 196 M 2024-02-15T22:29:06.533 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:06.700 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 300 kB 00:00 2024-02-15T22:29:06.743 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-15T22:29:06.793 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): libcephsqlite-17.2.7-509.g9aa52330.el9.x 625 kB/s | 162 kB 00:00 2024-02-15T22:29:06.818 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-02-15T22:29:06.852 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-02-15T22:29:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 6/6 2024-02-15T22:29:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 1/6 2024-02-15T22:29:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 2/6 2024-02-15T22:29:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-15T22:29:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-15T22:29:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-15T22:29:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-15T22:29:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:07.632 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-16.el9.x86_64 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:07.633 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:07.965 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph 2024-02-15T22:29:08.547 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:40 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:08.713 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================== 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================== 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:17.2.7-509.g9aa52330.el9 ceph 6.5 k 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:17.2.7-509.g9aa52330.el9 ceph 2.1 M 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:17.2.7-509.g9aa52330.el9 ceph 1.4 M 2024-02-15T22:29:08.716 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 239 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:17.2.7-509.g9aa52330.el9 ceph 3.7 M 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:17.2.7-509.g9aa52330.el9 ceph 15 M 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-15T22:29:08.717 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-15T22:29:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================== 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout:Install 33 Packages 2024-02-15T22:29:08.719 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:08.720 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 27 M 2024-02-15T22:29:08.720 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 99 M 2024-02-15T22:29:08.720 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:08.972 INFO:teuthology.orchestra.run.smithi082.stdout:(1/33): ceph-17.2.7-509.g9aa52330.el9.x86_64.rp 31 kB/s | 6.5 kB 00:00 2024-02-15T22:29:09.135 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): ceph-test-17.2.7-509.g9aa52330.el9.x86_6 18 MB/s | 48 MB 00:02 2024-02-15T22:29:09.138 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:09.139 INFO:teuthology.orchestra.run.smithi033.stdout:Total 19 MB/s | 49 MB 00:02 2024-02-15T22:29:09.139 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:09.160 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:09.160 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:09.314 INFO:teuthology.orchestra.run.smithi082.stdout:(2/33): ceph-mds-17.2.7-509.g9aa52330.el9.x86_6 3.8 MB/s | 2.1 MB 00:00 2024-02-15T22:29:09.356 INFO:teuthology.orchestra.run.smithi082.stdout:(3/33): ceph-mgr-17.2.7-509.g9aa52330.el9.x86_6 2.4 MB/s | 1.4 MB 00:00 2024-02-15T22:29:09.456 INFO:teuthology.orchestra.run.smithi082.stdout:(4/33): ceph-mgr-modules-core-17.2.7-509.g9aa52 2.3 MB/s | 239 kB 00:00 2024-02-15T22:29:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:09.581 INFO:teuthology.orchestra.run.smithi082.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2024-02-15T22:29:09.640 INFO:teuthology.orchestra.run.smithi082.stdout:(6/33): ceph-mon-17.2.7-509.g9aa52330.el9.x86_6 5.5 MB/s | 3.7 MB 00:00 2024-02-15T22:29:09.665 INFO:teuthology.orchestra.run.smithi082.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 379 kB/s | 32 kB 00:00 2024-02-15T22:29:09.690 INFO:teuthology.orchestra.run.smithi082.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 945 kB/s | 47 kB 00:00 2024-02-15T22:29:09.716 INFO:teuthology.orchestra.run.smithi082.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 768 kB/s | 39 kB 00:00 2024-02-15T22:29:09.741 INFO:teuthology.orchestra.run.smithi082.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-15T22:29:09.800 INFO:teuthology.orchestra.run.smithi082.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2024-02-15T22:29:09.825 INFO:teuthology.orchestra.run.smithi082.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-02-15T22:29:09.867 INFO:teuthology.orchestra.run.smithi082.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 1.8 MB/s | 124 kB 00:00 2024-02-15T22:29:09.892 INFO:teuthology.orchestra.run.smithi082.stdout:(14/33): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 113 kB 00:00 2024-02-15T22:29:09.942 INFO:teuthology.orchestra.run.smithi082.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.4 MB/s | 187 kB 00:00 2024-02-15T22:29:10.159 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:10.218 INFO:teuthology.orchestra.run.smithi082.stdout:(16/33): ceph-osd-17.2.7-509.g9aa52330.el9.x86_ 17 MB/s | 15 MB 00:00 2024-02-15T22:29:10.235 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-15T22:29:10.268 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-15T22:29:10.313 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-15T22:29:10.353 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-15T22:29:10.387 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 5/6 2024-02-15T22:29:10.435 INFO:teuthology.orchestra.run.smithi082.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 80 kB/s | 43 kB 00:00 2024-02-15T22:29:10.576 INFO:teuthology.orchestra.run.smithi082.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 271 kB/s | 172 kB 00:00 2024-02-15T22:29:10.777 INFO:teuthology.orchestra.run.smithi082.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 644 kB/s | 358 kB 00:00 2024-02-15T22:29:10.802 INFO:teuthology.orchestra.run.smithi082.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 29 kB/s | 11 kB 00:00 2024-02-15T22:29:10.827 INFO:teuthology.orchestra.run.smithi082.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 70 kB/s | 18 kB 00:00 2024-02-15T22:29:10.852 INFO:teuthology.orchestra.run.smithi082.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 308 kB/s | 23 kB 00:00 2024-02-15T22:29:10.903 INFO:teuthology.orchestra.run.smithi082.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 259 kB/s | 19 kB 00:00 2024-02-15T22:29:10.919 INFO:teuthology.orchestra.run.smithi082.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 214 kB/s | 20 kB 00:00 2024-02-15T22:29:10.937 INFO:teuthology.orchestra.run.smithi082.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-02-15T22:29:10.995 INFO:teuthology.orchestra.run.smithi082.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 857 kB/s | 79 kB 00:00 2024-02-15T22:29:11.179 INFO:teuthology.orchestra.run.smithi082.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-02-15T22:29:11.204 INFO:teuthology.orchestra.run.smithi082.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 61 kB/s | 16 kB 00:00 2024-02-15T22:29:11.229 INFO:teuthology.orchestra.run.smithi082.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 384 kB/s | 90 kB 00:00 2024-02-15T22:29:11.255 INFO:teuthology.orchestra.run.smithi082.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 475 kB/s | 36 kB 00:00 2024-02-15T22:29:11.397 INFO:teuthology.orchestra.run.smithi082.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-02-15T22:29:11.580 INFO:teuthology.orchestra.run.smithi082.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.2 MB/s | 427 kB 00:00 2024-02-15T22:29:11.605 INFO:teuthology.orchestra.run.smithi082.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 57 kB/s | 20 kB 00:00 2024-02-15T22:29:11.611 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:11.611 INFO:teuthology.orchestra.run.smithi082.stdout:Total 9.2 MB/s | 27 MB 00:02 2024-02-15T22:29:11.612 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:11.649 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:11.650 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:13.221 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:13.291 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-15T22:29:13.315 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-15T22:29:13.348 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-15T22:29:13.438 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-15T22:29:13.508 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-15T22:29:13.559 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-15T22:29:13.637 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-15T22:29:13.684 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-15T22:29:13.723 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-15T22:29:13.771 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-15T22:29:13.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-15T22:29:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-15T22:29:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-15T22:29:14.116 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-15T22:29:14.151 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-15T22:29:14.181 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-15T22:29:14.257 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-15T22:29:14.291 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:29:14.325 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-15T22:29:14.365 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-15T22:29:14.400 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-15T22:29:14.435 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-15T22:29:14.530 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-15T22:29:14.574 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-15T22:29:14.645 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-15T22:29:14.781 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-15T22:29:14.906 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:29:15.023 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 5/6 2024-02-15T22:29:15.079 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-509.g9aa52330.el9.n 28/33 2024-02-15T22:29:15.102 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 6/6 2024-02-15T22:29:15.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 29/33 2024-02-15T22:29:15.129 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 29/33 2024-02-15T22:29:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-15T22:29:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:29:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:29:15.130 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:16.464 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 30/33 2024-02-15T22:29:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 30/33 2024-02-15T22:29:16.490 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:16.490 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-15T22:29:16.490 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:29:16.490 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:29:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:16.882 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 31/33 2024-02-15T22:29:16.906 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 31/33 2024-02-15T22:29:16.907 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:16.907 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-15T22:29:16.907 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:29:16.907 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:29:16.907 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 32/33 2024-02-15T22:29:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 32/33 2024-02-15T22:29:17.140 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:17.140 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-15T22:29:17.140 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:29:17.140 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:29:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:17.206 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:17.2.7-509.g9aa52330.el9.x86_64 33/33 2024-02-15T22:29:17.394 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 6/6 2024-02-15T22:29:17.394 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 1/6 2024-02-15T22:29:17.394 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 2/6 2024-02-15T22:29:17.394 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-15T22:29:17.394 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-15T22:29:17.395 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-15T22:29:17.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: jq-1.6-16.el9.x86_64 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:17.785 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:18.049 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph 2024-02-15T22:29:18.646 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:41 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:18.823 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:18.826 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================== 2024-02-15T22:29:18.826 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:29:18.826 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================== 2024-02-15T22:29:18.826 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:18.826 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:17.2.7-509.g9aa52330.el9 ceph 6.5 k 2024-02-15T22:29:18.826 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:29:18.827 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:17.2.7-509.g9aa52330.el9 ceph 2.1 M 2024-02-15T22:29:18.827 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:17.2.7-509.g9aa52330.el9 ceph 1.4 M 2024-02-15T22:29:18.827 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 239 k 2024-02-15T22:29:18.827 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:17.2.7-509.g9aa52330.el9 ceph 3.7 M 2024-02-15T22:29:18.827 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:17.2.7-509.g9aa52330.el9 ceph 15 M 2024-02-15T22:29:18.827 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-15T22:29:18.827 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-15T22:29:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-15T22:29:18.829 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-15T22:29:18.830 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-15T22:29:18.830 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:18.830 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:18.830 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================== 2024-02-15T22:29:18.830 INFO:teuthology.orchestra.run.smithi033.stdout:Install 33 Packages 2024-02-15T22:29:18.830 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:18.831 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 27 M 2024-02-15T22:29:18.831 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 99 M 2024-02-15T22:29:18.831 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:18.970 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-2:17.2.7-509.g9aa52330.el9.x86_64 33/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:17.2.7-509.g9aa52330.el9.x86_64 1/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 2/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 3/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 4/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 5/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-509.g9aa52330.el9.n 6/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-15T22:29:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-15T22:29:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-15T22:29:18.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-15T22:29:18.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-15T22:29:18.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-15T22:29:18.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:29:18.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-15T22:29:18.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-15T22:29:18.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-15T22:29:18.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-15T22:29:18.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-15T22:29:19.477 INFO:teuthology.orchestra.run.smithi033.stdout:(1/33): ceph-17.2.7-509.g9aa52330.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2024-02-15T22:29:19.610 INFO:teuthology.orchestra.run.smithi033.stdout:(2/33): ceph-mds-17.2.7-509.g9aa52330.el9.x86_6 5.2 MB/s | 2.1 MB 00:00 2024-02-15T22:29:19.643 INFO:teuthology.orchestra.run.smithi033.stdout:(3/33): ceph-mgr-17.2.7-509.g9aa52330.el9.x86_6 3.3 MB/s | 1.4 MB 00:00 2024-02-15T22:29:19.744 INFO:teuthology.orchestra.run.smithi033.stdout:(4/33): ceph-mgr-modules-core-17.2.7-509.g9aa52 2.3 MB/s | 239 kB 00:00 2024-02-15T22:29:19.853 INFO:teuthology.orchestra.run.smithi033.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-15T22:29:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-15T22:29:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-15T22:29:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-15T22:29:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-15T22:29:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:19.870 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:19.878 INFO:teuthology.orchestra.run.smithi033.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2024-02-15T22:29:19.903 INFO:teuthology.orchestra.run.smithi033.stdout:(7/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2024-02-15T22:29:19.928 INFO:teuthology.orchestra.run.smithi033.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2024-02-15T22:29:19.978 INFO:teuthology.orchestra.run.smithi033.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-15T22:29:20.046 INFO:teuthology.orchestra.run.smithi033.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 17 MB/s | 1.1 MB 00:00 2024-02-15T22:29:20.079 INFO:teuthology.orchestra.run.smithi033.stdout:(11/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-02-15T22:29:20.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-base 2024-02-15T22:29:20.113 INFO:teuthology.orchestra.run.smithi033.stdout:(12/33): python3-pycparser-2.20-6.el9.noarch.rp 3.7 MB/s | 124 kB 00:00 2024-02-15T22:29:20.146 INFO:teuthology.orchestra.run.smithi033.stdout:(13/33): python3-requests-2.25.1-8.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2024-02-15T22:29:20.180 INFO:teuthology.orchestra.run.smithi033.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2024-02-15T22:29:20.339 INFO:teuthology.orchestra.run.smithi033.stdout:(15/33): ceph-osd-17.2.7-509.g9aa52330.el9.x86_ 21 MB/s | 15 MB 00:00 2024-02-15T22:29:20.497 INFO:teuthology.orchestra.run.smithi033.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 137 kB/s | 43 kB 00:00 2024-02-15T22:29:20.639 INFO:teuthology.orchestra.run.smithi033.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 573 kB/s | 172 kB 00:00 2024-02-15T22:29:20.682 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:52 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:20.706 INFO:teuthology.orchestra.run.smithi033.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-02-15T22:29:20.731 INFO:teuthology.orchestra.run.smithi033.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-02-15T22:29:20.782 INFO:teuthology.orchestra.run.smithi033.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2024-02-15T22:29:20.797 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:29:20.807 INFO:teuthology.orchestra.run.smithi033.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 306 kB/s | 23 kB 00:00 2024-02-15T22:29:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:20.848 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:29:20.848 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:20.849 INFO:teuthology.orchestra.run.smithi033.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 291 kB/s | 19 kB 00:00 2024-02-15T22:29:20.874 INFO:teuthology.orchestra.run.smithi033.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 294 kB/s | 20 kB 00:00 2024-02-15T22:29:20.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install cephadm 2024-02-15T22:29:20.916 INFO:teuthology.orchestra.run.smithi033.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 693 kB/s | 46 kB 00:00 2024-02-15T22:29:20.942 INFO:teuthology.orchestra.run.smithi033.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-02-15T22:29:21.009 INFO:teuthology.orchestra.run.smithi033.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-02-15T22:29:21.026 INFO:teuthology.orchestra.run.smithi033.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-02-15T22:29:21.076 INFO:teuthology.orchestra.run.smithi033.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-02-15T22:29:21.093 INFO:teuthology.orchestra.run.smithi033.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 535 kB/s | 36 kB 00:00 2024-02-15T22:29:21.143 INFO:teuthology.orchestra.run.smithi033.stdout:(30/33): ceph-mon-17.2.7-509.g9aa52330.el9.x86_ 2.2 MB/s | 3.7 MB 00:01 2024-02-15T22:29:21.160 INFO:teuthology.orchestra.run.smithi033.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-02-15T22:29:21.218 INFO:teuthology.orchestra.run.smithi033.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-02-15T22:29:21.302 INFO:teuthology.orchestra.run.smithi033.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 126 kB/s | 20 kB 00:00 2024-02-15T22:29:21.306 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:21.306 INFO:teuthology.orchestra.run.smithi033.stdout:Total 11 MB/s | 27 MB 00:02 2024-02-15T22:29:21.306 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:21.348 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:21.348 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:21.481 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:53 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:21.646 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 80 k 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 80 k 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 364 k 2024-02-15T22:29:21.647 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:21.687 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:21.687 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:21.956 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm-17.2.7-509.g9aa52330.el9.noarch.rpm 261 kB/s | 80 kB 00:00 2024-02-15T22:29:21.957 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:21.957 INFO:teuthology.orchestra.run.smithi082.stdout:Total 260 kB/s | 80 kB 00:00 2024-02-15T22:29:21.957 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:21.962 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:21.962 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:21.964 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:21.964 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:22.045 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:22.411 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:22.502 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:22.901 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:22.922 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:22.972 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-15T22:29:23.004 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-15T22:29:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-15T22:29:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-15T22:29:23.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:23.197 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:23.197 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:23.197 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:23.197 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:23.197 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-15T22:29:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-15T22:29:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-15T22:29:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-15T22:29:23.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T22:29:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-15T22:29:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-15T22:29:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-15T22:29:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-15T22:29:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-15T22:29:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-15T22:29:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-15T22:29:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-15T22:29:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-15T22:29:24.001 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:56 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:29:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-15T22:29:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-15T22:29:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-15T22:29:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-15T22:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-02-15T22:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-509.g9aa52330.el9 ceph 137 k 2024-02-15T22:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-02-15T22:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 137 k 2024-02-15T22:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 379 k 2024-02-15T22:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-15T22:29:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-15T22:29:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-15T22:29:24.398 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-immutable-object-cache-17.2.7-509.g9aa5233 604 kB/s | 137 kB 00:00 2024-02-15T22:29:24.399 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:24.399 INFO:teuthology.orchestra.run.smithi082.stdout:Total 601 kB/s | 137 kB 00:00 2024-02-15T22:29:24.399 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:24.457 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:24.458 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-15T22:29:24.611 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:24.644 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:29:24.683 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.e 1/1 2024-02-15T22:29:24.707 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.e 1/1 2024-02-15T22:29:24.707 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:24.707 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-15T22:29:24.707 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-509.g9aa52330.el9.n 28/33 2024-02-15T22:29:24.825 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 29/33 2024-02-15T22:29:24.850 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 29/33 2024-02-15T22:29:24.850 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:24.850 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-15T22:29:24.850 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:29:24.850 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:29:24.850 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:25.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.e 1/1 2024-02-15T22:29:25.845 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:25.845 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:25.845 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:25.846 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:25.846 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:26.077 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr 2024-02-15T22:29:26.251 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 30/33 2024-02-15T22:29:26.276 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 30/33 2024-02-15T22:29:26.276 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:26.276 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-15T22:29:26.276 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:29:26.276 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:29:26.276 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:26.659 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:58 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:26.668 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 31/33 2024-02-15T22:29:26.691 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 31/33 2024-02-15T22:29:26.691 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:26.691 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-15T22:29:26.691 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:29:26.691 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:29:26.691 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:26.773 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:29:26.824 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:26.825 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:29:26.825 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:26.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T22:29:26.902 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 32/33 2024-02-15T22:29:26.924 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 32/33 2024-02-15T22:29:26.924 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:26.924 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-15T22:29:26.924 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:29:26.924 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:29:26.925 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:26.994 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:17.2.7-509.g9aa52330.el9.x86_64 33/33 2024-02-15T22:29:27.461 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:59 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:27.627 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 1.7 M 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 23 k 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 15 k 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-02-15T22:29:27.628 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-15T22:29:27.629 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:27.629 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:27.629 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:27.629 INFO:teuthology.orchestra.run.smithi082.stdout:Install 7 Packages 2024-02-15T22:29:27.629 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:27.629 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 2.0 M 2024-02-15T22:29:27.630 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 8.1 M 2024-02-15T22:29:27.630 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:(1/7): ceph-grafana-dashboards-17.2.7-509.g9aa5 124 kB/s | 23 kB 00:00 2024-02-15T22:29:27.977 INFO:teuthology.orchestra.run.smithi082.stdout:(2/7): ceph-prometheus-alerts-17.2.7-509.g9aa52 71 kB/s | 15 kB 00:00 2024-02-15T22:29:28.211 INFO:teuthology.orchestra.run.smithi082.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 36 kB/s | 9.0 kB 00:00 2024-02-15T22:29:28.269 INFO:teuthology.orchestra.run.smithi082.stdout:(4/7): ceph-mgr-dashboard-17.2.7-509.g9aa52330. 3.4 MB/s | 1.7 MB 00:00 2024-02-15T22:29:28.361 INFO:teuthology.orchestra.run.smithi082.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 106 kB/s | 41 kB 00:00 2024-02-15T22:29:28.378 INFO:teuthology.orchestra.run.smithi082.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 184 kB/s | 31 kB 00:00 2024-02-15T22:29:28.658 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-2:17.2.7-509.g9aa52330.el9.x86_64 33/33 2024-02-15T22:29:28.658 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:17.2.7-509.g9aa52330.el9.x86_64 1/33 2024-02-15T22:29:28.658 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 2/33 2024-02-15T22:29:28.658 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 3/33 2024-02-15T22:29:28.658 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 4/33 2024-02-15T22:29:28.658 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 5/33 2024-02-15T22:29:28.658 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-509.g9aa52330.el9.n 6/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-15T22:29:28.659 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-15T22:29:28.660 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-15T22:29:28.660 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-15T22:29:28.660 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-15T22:29:28.660 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-15T22:29:28.661 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-15T22:29:28.661 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:29:28.661 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-15T22:29:28.661 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-15T22:29:28.661 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-15T22:29:28.661 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-15T22:29:28.661 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-15T22:29:28.687 INFO:teuthology.orchestra.run.smithi082.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 452 kB/s | 188 kB 00:00 2024-02-15T22:29:28.688 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:28.689 INFO:teuthology.orchestra.run.smithi082.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2024-02-15T22:29:28.689 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:28.697 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:28.697 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:28.765 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:28.765 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:29.059 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:29.130 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-15T22:29:29.164 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-15T22:29:29.226 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-15T22:29:29.259 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-15T22:29:29.288 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-509.g9aa52330.el9.no 5/7 2024-02-15T22:29:29.516 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-509.g9aa52330.el9.n 6/7 2024-02-15T22:29:29.540 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 7/7 2024-02-15T22:29:29.557 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-15T22:29:29.557 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:29.557 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:29.557 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:29.557 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:29.557 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:29.557 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-15T22:29:29.558 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-15T22:29:29.559 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-15T22:29:29.560 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-15T22:29:29.560 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-15T22:29:29.560 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-15T22:29:29.560 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-15T22:29:29.560 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:29.560 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:29.883 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-base 2024-02-15T22:29:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 7/7 2024-02-15T22:29:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-509.g9aa52330.el9.n 1/7 2024-02-15T22:29:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 2/7 2024-02-15T22:29:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-509.g9aa52330.el9.no 3/7 2024-02-15T22:29:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-15T22:29:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-15T22:29:30.068 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-15T22:29:30.404 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-15T22:29:30.404 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:30.404 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:30.404 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:30.405 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:30.469 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:53 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:30.586 INFO:teuthology.orchestra.run.smithi033.stdout:Package ceph-base-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:29:30.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T22:29:30.639 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:30.641 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:29:30.641 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:30.700 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install cephadm 2024-02-15T22:29:31.193 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:03 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:31.283 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:54 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:31.360 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================== 2024-02-15T22:29:31.361 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:29:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================== 2024-02-15T22:29:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:31.361 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 7.4 M 2024-02-15T22:29:31.361 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:31.362 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:31.363 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================== 2024-02-15T22:29:31.363 INFO:teuthology.orchestra.run.smithi082.stdout:Install 12 Packages 2024-02-15T22:29:31.363 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:31.363 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 37 M 2024-02-15T22:29:31.363 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 209 M 2024-02-15T22:29:31.364 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:31.453 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 80 k 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 80 k 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 364 k 2024-02-15T22:29:31.454 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:31.635 INFO:teuthology.orchestra.run.smithi082.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 214 kB/s | 32 kB 00:00 2024-02-15T22:29:31.669 INFO:teuthology.orchestra.run.smithi082.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 518 kB/s | 17 kB 00:00 2024-02-15T22:29:31.702 INFO:teuthology.orchestra.run.smithi082.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-02-15T22:29:31.793 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm-17.2.7-509.g9aa52330.el9.noarch.rpm 238 kB/s | 80 kB 00:00 2024-02-15T22:29:31.793 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:31.793 INFO:teuthology.orchestra.run.smithi033.stdout:Total 237 kB/s | 80 kB 00:00 2024-02-15T22:29:31.793 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:31.799 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:31.799 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:31.801 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:31.801 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:31.884 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:31.886 INFO:teuthology.orchestra.run.smithi082.stdout:(4/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2024-02-15T22:29:32.053 INFO:teuthology.orchestra.run.smithi082.stdout:(5/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-02-15T22:29:32.120 INFO:teuthology.orchestra.run.smithi082.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.7 MB/s | 3.0 MB 00:00 2024-02-15T22:29:32.145 INFO:teuthology.orchestra.run.smithi082.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 217 kB 00:00 2024-02-15T22:29:32.290 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 802 kB 00:00 2024-02-15T22:29:32.390 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:32.496 INFO:teuthology.orchestra.run.smithi082.stdout:(9/12): ceph-mgr-diskprediction-local-17.2.7-50 7.3 MB/s | 7.4 MB 00:01 2024-02-15T22:29:32.655 INFO:teuthology.orchestra.run.smithi082.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-02-15T22:29:32.680 INFO:teuthology.orchestra.run.smithi082.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 557 kB/s | 194 kB 00:00 2024-02-15T22:29:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:32.805 INFO:teuthology.orchestra.run.smithi082.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 798 kB/s | 245 kB 00:00 2024-02-15T22:29:32.808 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:32.808 INFO:teuthology.orchestra.run.smithi082.stdout:Total 26 MB/s | 37 MB 00:01 2024-02-15T22:29:32.827 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:33.045 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/1 2024-02-15T22:29:33.045 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:33.045 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:33.045 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:33.045 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:33.046 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:33.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T22:29:33.281 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:33.281 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:33.804 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:56 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:33.977 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repo Size 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-509.g9aa52330.el9 ceph 137 k 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 137 k 2024-02-15T22:29:33.978 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 379 k 2024-02-15T22:29:33.979 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:33.987 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:34.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-15T22:29:34.101 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-15T22:29:34.193 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:29:34.206 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-immutable-object-cache-17.2.7-509.g9aa5233 603 kB/s | 137 kB 00:00 2024-02-15T22:29:34.206 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:34.207 INFO:teuthology.orchestra.run.smithi033.stdout:Total 600 kB/s | 137 kB 00:00 2024-02-15T22:29:34.207 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:34.215 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:34.215 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:34.237 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-15T22:29:34.268 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:34.269 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:34.414 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:29:34.420 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:34.444 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:29:34.490 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.e 1/1 2024-02-15T22:29:34.514 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.e 1/1 2024-02-15T22:29:34.514 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:29:34.514 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-15T22:29:34.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:34.520 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-15T22:29:35.177 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-15T22:29:35.281 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-15T22:29:35.495 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.e 1/1 2024-02-15T22:29:35.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:35.496 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:35.496 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:35.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:35.496 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:35.714 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr 2024-02-15T22:29:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:59 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:36.418 INFO:teuthology.orchestra.run.smithi033.stdout:Package ceph-mgr-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:29:36.472 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:36.473 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:29:36.473 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:36.512 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-15T22:29:36.539 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T22:29:37.115 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:00 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:37.289 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:37.290 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:37.290 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:29:37.290 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:37.290 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:37.290 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 1.7 M 2024-02-15T22:29:37.290 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:29:37.290 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 23 k 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 15 k 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout:Install 7 Packages 2024-02-15T22:29:37.291 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:37.292 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 2.0 M 2024-02-15T22:29:37.292 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 8.1 M 2024-02-15T22:29:37.292 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:37.534 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-15T22:29:37.569 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa523 12/12 2024-02-15T22:29:37.643 INFO:teuthology.orchestra.run.smithi033.stdout:(1/7): ceph-grafana-dashboards-17.2.7-509.g9aa5 119 kB/s | 23 kB 00:00 2024-02-15T22:29:37.660 INFO:teuthology.orchestra.run.smithi033.stdout:(2/7): ceph-prometheus-alerts-17.2.7-509.g9aa52 69 kB/s | 15 kB 00:00 2024-02-15T22:29:37.835 INFO:teuthology.orchestra.run.smithi033.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 47 kB/s | 9.0 kB 00:00 2024-02-15T22:29:37.961 INFO:teuthology.orchestra.run.smithi033.stdout:(4/7): ceph-mgr-dashboard-17.2.7-509.g9aa52330. 3.3 MB/s | 1.7 MB 00:00 2024-02-15T22:29:37.986 INFO:teuthology.orchestra.run.smithi033.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 126 kB/s | 41 kB 00:00 2024-02-15T22:29:38.011 INFO:teuthology.orchestra.run.smithi033.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 175 kB/s | 31 kB 00:00 2024-02-15T22:29:38.211 INFO:teuthology.orchestra.run.smithi033.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 753 kB/s | 188 kB 00:00 2024-02-15T22:29:38.213 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:38.214 INFO:teuthology.orchestra.run.smithi033.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2024-02-15T22:29:38.214 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:38.223 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:38.223 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:38.298 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:38.298 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:38.741 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:38.804 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-15T22:29:38.839 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-15T22:29:38.886 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-15T22:29:38.916 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-15T22:29:38.945 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-509.g9aa52330.el9.no 5/7 2024-02-15T22:29:39.187 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-509.g9aa52330.el9.n 6/7 2024-02-15T22:29:39.224 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 7/7 2024-02-15T22:29:39.754 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 7/7 2024-02-15T22:29:39.754 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-509.g9aa52330.el9.n 1/7 2024-02-15T22:29:39.754 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 2/7 2024-02-15T22:29:39.755 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-509.g9aa52330.el9.no 3/7 2024-02-15T22:29:39.755 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-15T22:29:39.755 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-15T22:29:39.755 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-15T22:29:40.037 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa523 12/12 2024-02-15T22:29:40.037 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa523 1/12 2024-02-15T22:29:40.037 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-15T22:29:40.038 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-15T22:29:40.096 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-15T22:29:40.096 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:40.096 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:40.096 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:40.097 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:40.297 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-15T22:29:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-15T22:29:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-15T22:29:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-15T22:29:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-15T22:29:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-15T22:29:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:40.540 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:40.876 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:03 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:40.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-rook 2024-02-15T22:29:41.051 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:41.052 INFO:teuthology.orchestra.run.smithi033.stdout:=========================================================================================== 2024-02-15T22:29:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:29:41.052 INFO:teuthology.orchestra.run.smithi033.stdout:=========================================================================================== 2024-02-15T22:29:41.052 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 7.4 M 2024-02-15T22:29:41.084 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:29:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-15T22:29:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-15T22:29:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout:=========================================================================================== 2024-02-15T22:29:41.085 INFO:teuthology.orchestra.run.smithi033.stdout:Install 12 Packages 2024-02-15T22:29:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:41.087 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 37 M 2024-02-15T22:29:41.087 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 209 M 2024-02-15T22:29:41.087 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:41.235 INFO:teuthology.orchestra.run.smithi033.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 232 kB/s | 32 kB 00:00 2024-02-15T22:29:41.260 INFO:teuthology.orchestra.run.smithi033.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 726 kB/s | 17 kB 00:00 2024-02-15T22:29:41.285 INFO:teuthology.orchestra.run.smithi033.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2024-02-15T22:29:41.444 INFO:teuthology.orchestra.run.smithi033.stdout:(4/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2024-02-15T22:29:41.502 INFO:teuthology.orchestra.run.smithi033.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.4 MB/s | 3.0 MB 00:00 2024-02-15T22:29:41.535 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:13 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:41.586 INFO:teuthology.orchestra.run.smithi033.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-02-15T22:29:41.612 INFO:teuthology.orchestra.run.smithi033.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 217 kB 00:00 2024-02-15T22:29:41.706 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:41.707 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-02-15T22:29:41.707 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:29:41.707 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-02-15T22:29:41.707 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:41.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 47 k 2024-02-15T22:29:41.707 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-15T22:29:41.708 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-15T22:29:41.709 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-15T22:29:41.709 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:41.709 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:41.709 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-02-15T22:29:41.709 INFO:teuthology.orchestra.run.smithi082.stdout:Install 13 Packages 2024-02-15T22:29:41.709 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:41.710 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 2.0 M 2024-02-15T22:29:41.710 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 26 M 2024-02-15T22:29:41.710 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:41.728 INFO:teuthology.orchestra.run.smithi033.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 6.9 MB/s | 802 kB 00:00 2024-02-15T22:29:41.912 INFO:teuthology.orchestra.run.smithi033.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-02-15T22:29:41.937 INFO:teuthology.orchestra.run.smithi033.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 942 kB/s | 194 kB 00:00 2024-02-15T22:29:42.203 INFO:teuthology.orchestra.run.smithi082.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 158 kB/s | 24 kB 00:00 2024-02-15T22:29:42.219 INFO:teuthology.orchestra.run.smithi082.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 106 kB/s | 18 kB 00:00 2024-02-15T22:29:42.328 INFO:teuthology.orchestra.run.smithi082.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 132 kB 00:00 2024-02-15T22:29:42.395 INFO:teuthology.orchestra.run.smithi082.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.0 MB/s | 174 kB 00:00 2024-02-15T22:29:42.487 INFO:teuthology.orchestra.run.smithi082.stdout:(5/13): ceph-mgr-rook-17.2.7-509.g9aa52330.el9. 108 kB/s | 47 kB 00:00 2024-02-15T22:29:42.512 INFO:teuthology.orchestra.run.smithi082.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 211 kB 00:00 2024-02-15T22:29:42.529 INFO:teuthology.orchestra.run.smithi082.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 319 kB/s | 43 kB 00:00 2024-02-15T22:29:42.646 INFO:teuthology.orchestra.run.smithi033.stdout:(11/12): ceph-mgr-diskprediction-local-17.2.7-5 4.8 MB/s | 7.4 MB 00:01 2024-02-15T22:29:42.813 INFO:teuthology.orchestra.run.smithi082.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 53 kB/s | 15 kB 00:00 2024-02-15T22:29:42.946 INFO:teuthology.orchestra.run.smithi082.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 70 kB/s | 32 kB 00:00 2024-02-15T22:29:43.122 INFO:teuthology.orchestra.run.smithi082.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 342 kB/s | 203 kB 00:00 2024-02-15T22:29:43.139 INFO:teuthology.orchestra.run.smithi082.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 307 kB/s | 59 kB 00:00 2024-02-15T22:29:43.264 INFO:teuthology.orchestra.run.smithi082.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 632 kB/s | 90 kB 00:00 2024-02-15T22:29:43.364 INFO:teuthology.orchestra.run.smithi082.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-02-15T22:29:43.368 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:43.368 INFO:teuthology.orchestra.run.smithi082.stdout:Total 1.2 MB/s | 2.0 MB 00:01 2024-02-15T22:29:43.369 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:43.371 INFO:teuthology.orchestra.run.smithi033.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 168 kB/s | 245 kB 00:01 2024-02-15T22:29:43.374 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:43.374 INFO:teuthology.orchestra.run.smithi033.stdout:Total 16 MB/s | 37 MB 00:02 2024-02-15T22:29:43.382 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:43.382 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:43.395 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:43.422 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:43.423 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:43.482 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:43.482 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:43.879 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:43.880 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-15T22:29:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-15T22:29:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-15T22:29:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-15T22:29:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-15T22:29:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-15T22:29:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-15T22:29:44.595 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-15T22:29:44.681 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-15T22:29:44.708 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-15T22:29:44.806 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:29:44.853 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-15T22:29:45.037 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:29:45.069 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:29:45.147 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-15T22:29:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-15T22:29:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-15T22:29:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-15T22:29:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-15T22:29:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 13/13 2024-02-15T22:29:45.851 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-15T22:29:45.961 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 13/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 1/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-15T22:29:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-15T22:29:46.304 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-15T22:29:46.686 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-15T22:29:46.687 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-15T22:29:46.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-15T22:29:46.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-15T22:29:46.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-15T22:29:46.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-15T22:29:46.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-15T22:29:46.688 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:46.688 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:46.925 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T22:29:47.294 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-15T22:29:47.506 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:19 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:47.671 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 121 k 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-15T22:29:47.672 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout:Install 6 Packages 2024-02-15T22:29:47.673 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:47.674 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 6.8 M 2024-02-15T22:29:47.674 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 33 M 2024-02-15T22:29:47.674 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:47.883 INFO:teuthology.orchestra.run.smithi082.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 227 kB 00:00 2024-02-15T22:29:47.974 INFO:teuthology.orchestra.run.smithi082.stdout:(2/6): ceph-mgr-cephadm-17.2.7-509.g9aa52330.el 474 kB/s | 121 kB 00:00 2024-02-15T22:29:48.050 INFO:teuthology.orchestra.run.smithi082.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2024-02-15T22:29:48.371 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-15T22:29:48.393 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa523 12/12 2024-02-15T22:29:49.075 INFO:teuthology.orchestra.run.smithi082.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 52 kB/s | 58 kB 00:01 2024-02-15T22:29:49.125 INFO:teuthology.orchestra.run.smithi082.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 47 kB/s | 51 kB 00:01 2024-02-15T22:29:49.650 INFO:teuthology.orchestra.run.smithi082.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 310 kB/s | 548 kB 00:01 2024-02-15T22:29:49.655 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:49.656 INFO:teuthology.orchestra.run.smithi082.stdout:Total 3.4 MB/s | 6.8 MB 00:01 2024-02-15T22:29:49.656 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:49.666 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:49.666 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:49.760 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:49.761 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:50.060 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-15T22:29:50.277 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-15T22:29:50.783 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-15T22:29:50.828 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa523 12/12 2024-02-15T22:29:50.828 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa523 1/12 2024-02-15T22:29:50.828 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-15T22:29:50.828 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:29:50.828 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-15T22:29:50.829 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:29:50.829 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:29:50.829 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-15T22:29:50.829 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-15T22:29:50.829 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-15T22:29:50.829 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-15T22:29:50.829 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-15T22:29:50.863 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-15T22:29:50.918 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-15T22:29:50.948 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 6/6 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-15T22:29:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:51.233 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:51.573 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-rook 2024-02-15T22:29:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 6/6 2024-02-15T22:29:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/6 2024-02-15T22:29:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-15T22:29:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-15T22:29:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-15T22:29:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-15T22:29:52.107 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-15T22:29:52.107 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:52.107 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:52.107 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:52.107 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-15T22:29:52.107 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-15T22:29:52.108 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-15T22:29:52.108 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-15T22:29:52.108 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-15T22:29:52.108 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:52.108 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:52.158 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:15 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:52.333 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 47 k 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-15T22:29:52.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout:Install 13 Packages 2024-02-15T22:29:52.335 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:52.336 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 2.0 M 2024-02-15T22:29:52.336 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 26 M 2024-02-15T22:29:52.336 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:52.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-fuse 2024-02-15T22:29:52.577 INFO:teuthology.orchestra.run.smithi033.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 143 kB/s | 24 kB 00:00 2024-02-15T22:29:52.602 INFO:teuthology.orchestra.run.smithi033.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 92 kB/s | 18 kB 00:00 2024-02-15T22:29:52.769 INFO:teuthology.orchestra.run.smithi033.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 917 kB/s | 174 kB 00:00 2024-02-15T22:29:52.836 INFO:teuthology.orchestra.run.smithi033.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 566 kB/s | 132 kB 00:00 2024-02-15T22:29:52.869 INFO:teuthology.orchestra.run.smithi033.stdout:(5/13): ceph-mgr-rook-17.2.7-509.g9aa52330.el9. 102 kB/s | 47 kB 00:00 2024-02-15T22:29:52.944 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:24 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:52.961 INFO:teuthology.orchestra.run.smithi033.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 211 kB 00:00 2024-02-15T22:29:52.986 INFO:teuthology.orchestra.run.smithi033.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 284 kB/s | 43 kB 00:00 2024-02-15T22:29:53.109 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:17.2.7-509.g9aa52330.el9 ceph 811 k 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-15T22:29:53.110 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:53.111 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:53.111 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:53.111 INFO:teuthology.orchestra.run.smithi082.stdout:Install 2 Packages 2024-02-15T22:29:53.111 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:53.111 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 890 k 2024-02-15T22:29:53.112 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 2.6 M 2024-02-15T22:29:53.112 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:53.212 INFO:teuthology.orchestra.run.smithi033.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 94 kB/s | 32 kB 00:00 2024-02-15T22:29:53.229 INFO:teuthology.orchestra.run.smithi033.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 56 kB/s | 15 kB 00:00 2024-02-15T22:29:53.261 INFO:teuthology.orchestra.run.smithi082.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 527 kB/s | 79 kB 00:00 2024-02-15T22:29:53.412 INFO:teuthology.orchestra.run.smithi033.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 476 kB/s | 203 kB 00:00 2024-02-15T22:29:53.437 INFO:teuthology.orchestra.run.smithi033.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 283 kB/s | 59 kB 00:00 2024-02-15T22:29:53.461 INFO:teuthology.orchestra.run.smithi082.stdout:(2/2): ceph-fuse-17.2.7-509.g9aa52330.el9.x86_6 2.3 MB/s | 811 kB 00:00 2024-02-15T22:29:53.462 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:53.462 INFO:teuthology.orchestra.run.smithi082.stdout:Total 2.5 MB/s | 890 kB 00:00 2024-02-15T22:29:53.463 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:53.482 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:53.482 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:53.546 INFO:teuthology.orchestra.run.smithi033.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 672 kB/s | 90 kB 00:00 2024-02-15T22:29:53.557 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:53.558 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:53.663 INFO:teuthology.orchestra.run.smithi033.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.3 MB/s | 1.0 MB 00:00 2024-02-15T22:29:53.665 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:53.665 INFO:teuthology.orchestra.run.smithi033.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2024-02-15T22:29:53.666 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:53.682 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:53.682 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:53.792 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:53.792 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:53.881 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-15T22:29:53.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 2/2 2024-02-15T22:29:54.319 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-15T22:29:54.557 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-15T22:29:54.613 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-15T22:29:54.649 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-15T22:29:54.662 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 2/2 2024-02-15T22:29:54.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/2 2024-02-15T22:29:54.691 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-15T22:29:54.788 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-15T22:29:54.898 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-15T22:29:54.951 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-15T22:29:55.000 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-15T22:29:55.000 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:55.000 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:55.000 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-15T22:29:55.000 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:55.000 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:55.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados-devel 2024-02-15T22:29:55.716 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-15T22:29:55.781 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-15T22:29:55.815 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-15T22:29:55.861 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-15T22:29:55.884 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 13/13 2024-02-15T22:29:55.889 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:27 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:56.054 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:17.2.7-509.g9aa52330.el9 ceph 126 k 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 126 k 2024-02-15T22:29:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 448 k 2024-02-15T22:29:56.056 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:56.266 INFO:teuthology.orchestra.run.smithi082.stdout:librados-devel-17.2.7-509.g9aa52330.el9.x86_64. 601 kB/s | 126 kB 00:00 2024-02-15T22:29:56.267 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:56.267 INFO:teuthology.orchestra.run.smithi082.stdout:Total 597 kB/s | 126 kB 00:00 2024-02-15T22:29:56.267 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:56.272 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:56.272 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:56.326 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:56.326 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:29:56.674 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 13/13 2024-02-15T22:29:56.674 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 1/13 2024-02-15T22:29:56.674 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-15T22:29:56.674 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-15T22:29:56.674 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-15T22:29:56.674 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-15T22:29:56.675 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-15T22:29:56.675 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-15T22:29:56.675 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-15T22:29:56.675 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-15T22:29:56.675 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-15T22:29:56.675 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-15T22:29:56.675 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-15T22:29:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:29:57.169 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-15T22:29:57.169 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:57.169 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:29:57.169 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:29:57.169 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-15T22:29:57.169 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:57.170 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:29:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:29:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:57.348 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:29:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:29:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:57.349 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:57.397 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T22:29:57.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs2 2024-02-15T22:29:57.984 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:20 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:29:58.157 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:17.2.7-509.g9aa52330.el9 ceph-noarch 121 k 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-15T22:29:58.159 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 6.8 M 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 33 M 2024-02-15T22:29:58.160 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:29:58.161 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:30 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:58.281 INFO:teuthology.orchestra.run.smithi082.stdout:Package libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:29:58.331 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:58.332 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:29:58.333 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:29:58.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs-devel 2024-02-15T22:29:58.414 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.2 MB/s | 227 kB 00:00 2024-02-15T22:29:58.481 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): ceph-mgr-cephadm-17.2.7-509.g9aa52330.el 495 kB/s | 121 kB 00:00 2024-02-15T22:29:58.573 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2024-02-15T22:29:58.840 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 162 kB/s | 58 kB 00:00 2024-02-15T22:29:58.924 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 145 kB/s | 51 kB 00:00 2024-02-15T22:29:58.975 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:30 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:29:59.032 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 887 kB/s | 548 kB 00:00 2024-02-15T22:29:59.034 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:59.035 INFO:teuthology.orchestra.run.smithi033.stdout:Total 7.7 MB/s | 6.8 MB 00:00 2024-02-15T22:29:59.035 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:29:59.044 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:29:59.044 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:29:59.138 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:29:59.138 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:29:59.142 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:29:59.142 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:17.2.7-509.g9aa52330.el9 ceph 25 k 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-02-15T22:29:59.143 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:29:59.144 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 25 k 2024-02-15T22:29:59.144 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 110 k 2024-02-15T22:29:59.144 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:29:59.380 INFO:teuthology.orchestra.run.smithi082.stdout:libcephfs-devel-17.2.7-509.g9aa52330.el9.x86_64 106 kB/s | 25 kB 00:00 2024-02-15T22:29:59.380 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:59.380 INFO:teuthology.orchestra.run.smithi082.stdout:Total 105 kB/s | 25 kB 00:00 2024-02-15T22:29:59.381 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:29:59.384 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:29:59.384 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:29:59.385 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:29:59.386 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:29:59.437 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:29:59.472 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:29:59.568 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:29:59.612 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-15T22:29:59.659 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-15T22:29:59.951 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:00.229 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:00.229 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:30:00.229 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:00.230 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:00.241 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-15T22:30:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-15T22:30:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-15T22:30:00.411 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados2 2024-02-15T22:30:00.421 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 6/6 2024-02-15T22:30:00.985 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:32 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:01.149 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:01.149 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:30:01.150 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:01.174 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 6/6 2024-02-15T22:30:01.175 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 1/6 2024-02-15T22:30:01.175 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-15T22:30:01.175 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-15T22:30:01.175 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-15T22:30:01.175 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-15T22:30:01.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librbd1 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:17.2.7-509.g9aa52330.el9.noarch 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-15T22:30:01.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-15T22:30:01.493 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-15T22:30:01.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:01.493 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:01.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-fuse 2024-02-15T22:30:01.794 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:33 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:01.907 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:01.958 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:01.959 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:30:01.959 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:02.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rados 2024-02-15T22:30:02.342 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:25 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:02.513 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:17.2.7-509.g9aa52330.el9 ceph 811 k 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:02.514 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:30:02.515 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:02.515 INFO:teuthology.orchestra.run.smithi033.stdout:Install 2 Packages 2024-02-15T22:30:02.515 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:02.515 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 890 k 2024-02-15T22:30:02.515 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 2.6 M 2024-02-15T22:30:02.515 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:30:02.602 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:34 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:02.634 INFO:teuthology.orchestra.run.smithi033.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 665 kB/s | 79 kB 00:00 2024-02-15T22:30:02.715 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:02.769 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:02.770 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:30:02.770 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:02.832 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rgw 2024-02-15T22:30:02.835 INFO:teuthology.orchestra.run.smithi033.stdout:(2/2): ceph-fuse-17.2.7-509.g9aa52330.el9.x86_6 2.5 MB/s | 811 kB 00:00 2024-02-15T22:30:02.835 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:02.836 INFO:teuthology.orchestra.run.smithi033.stdout:Total 2.7 MB/s | 890 kB 00:00 2024-02-15T22:30:02.836 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:30:02.856 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:30:02.857 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:30:02.934 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:30:02.934 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:30:03.116 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:30:03.241 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-15T22:30:03.320 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 2/2 2024-02-15T22:30:03.408 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:35 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:03.523 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:03.576 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:03.577 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:30:03.577 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:03.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-cephfs 2024-02-15T22:30:04.062 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 2/2 2024-02-15T22:30:04.063 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/2 2024-02-15T22:30:04.216 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:36 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:04.329 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:04.367 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-15T22:30:04.367 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:04.367 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:30:04.367 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-15T22:30:04.367 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:04.367 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:04.381 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:04.382 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:30:04.382 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:04.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rbd 2024-02-15T22:30:04.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librados-devel 2024-02-15T22:30:05.020 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:37 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:05.133 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:05.186 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:05.187 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-02-15T22:30:05.188 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:05.232 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:28 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:05.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-fuse 2024-02-15T22:30:05.406 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:05.406 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:05.406 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repo Size 2024-02-15T22:30:05.406 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:05.406 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:17.2.7-509.g9aa52330.el9 ceph 126 k 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 126 k 2024-02-15T22:30:05.407 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 448 k 2024-02-15T22:30:05.408 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:30:05.638 INFO:teuthology.orchestra.run.smithi033.stdout:librados-devel-17.2.7-509.g9aa52330.el9.x86_64. 549 kB/s | 126 kB 00:00 2024-02-15T22:30:05.639 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:05.639 INFO:teuthology.orchestra.run.smithi033.stdout:Total 545 kB/s | 126 kB 00:00 2024-02-15T22:30:05.639 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:30:05.645 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:30:05.645 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:30:05.702 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:30:05.703 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:30:05.816 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:37 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:05.855 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:30:05.963 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:05.980 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:17.2.7-509.g9aa52330.el9 ceph 82 k 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-02-15T22:30:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:05.982 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 82 k 2024-02-15T22:30:05.982 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 222 k 2024-02-15T22:30:05.982 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:30:06.324 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-fuse-17.2.7-509.g9aa52330.el9.x86_64.rpm 238 kB/s | 82 kB 00:00 2024-02-15T22:30:06.324 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:06.325 INFO:teuthology.orchestra.run.smithi082.stdout:Total 238 kB/s | 82 kB 00:00 2024-02-15T22:30:06.325 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:30:06.331 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:30:06.331 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:30:06.387 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:30:06.387 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:30:06.404 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:06.526 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:30:06.638 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:06.709 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:06.709 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:06.709 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:30:06.709 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:06.709 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:06.710 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:06.934 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install libcephfs2 2024-02-15T22:30:07.044 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:07.356 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:30:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:07.356 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:07.524 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:30 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:07.601 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-mirror 2024-02-15T22:30:07.642 INFO:teuthology.orchestra.run.smithi033.stdout:Package libcephfs2-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:07.697 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:07.699 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:30:07.699 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:07.765 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install libcephfs-devel 2024-02-15T22:30:08.187 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:40 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:08.349 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:31 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:08.359 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:08.359 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-02-15T22:30:08.359 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:08.359 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:30:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:17.2.7-509.g9aa52330.el9 ceph 2.9 M 2024-02-15T22:30:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:08.360 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:30:08.360 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:08.360 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-02-15T22:30:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:08.360 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 2.9 M 2024-02-15T22:30:08.360 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 12 M 2024-02-15T22:30:08.361 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:30:08.520 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repo Size 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:17.2.7-509.g9aa52330.el9 ceph 25 k 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:08.521 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 25 k 2024-02-15T22:30:08.522 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 110 k 2024-02-15T22:30:08.522 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:30:08.683 INFO:teuthology.orchestra.run.smithi033.stdout:libcephfs-devel-17.2.7-509.g9aa52330.el9.x86_64 155 kB/s | 25 kB 00:00 2024-02-15T22:30:08.684 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:08.684 INFO:teuthology.orchestra.run.smithi033.stdout:Total 153 kB/s | 25 kB 00:00 2024-02-15T22:30:08.684 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:30:08.687 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:30:08.688 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:30:08.689 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:30:08.689 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:30:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:30:08.803 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-mirror-17.2.7-509.g9aa52330.el9.x86_64.rpm 6.6 MB/s | 2.9 MB 00:00 2024-02-15T22:30:08.803 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:08.804 INFO:teuthology.orchestra.run.smithi082.stdout:Total 6.6 MB/s | 2.9 MB 00:00 2024-02-15T22:30:08.804 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:30:08.812 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:30:08.812 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:30:08.884 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:30:08.884 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:30:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:09.262 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:09.292 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:30:09.353 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:09.377 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:09.377 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:30:09.377 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-15T22:30:09.377 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:30:09.377 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:30:09.378 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:09.539 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:09.539 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:30:09.540 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:09.540 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:09.856 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librados2 2024-02-15T22:30:10.445 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:33 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:10.494 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:10.494 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:10.494 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:30:10.495 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:10.495 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:10.495 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:10.562 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:10.617 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:10.618 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:30:10.618 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:10.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librbd1 2024-02-15T22:30:10.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-nbd 2024-02-15T22:30:11.271 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:34 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:11.303 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:43 ago on Thu 15 Feb 2024 10:28:28 PM UTC. 2024-02-15T22:30:11.390 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:11.446 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:11.447 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:30:11.447 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:11.469 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:17.2.7-509.g9aa52330.el9 ceph 165 k 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 165 k 2024-02-15T22:30:11.470 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 477 k 2024-02-15T22:30:11.471 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-02-15T22:30:11.515 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rados 2024-02-15T22:30:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-nbd-17.2.7-509.g9aa52330.el9.x86_64.rpm 724 kB/s | 165 kB 00:00 2024-02-15T22:30:11.699 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:11.699 INFO:teuthology.orchestra.run.smithi082.stdout:Total 720 kB/s | 165 kB 00:00 2024-02-15T22:30:11.699 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-02-15T22:30:11.706 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-02-15T22:30:11.706 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-02-15T22:30:11.761 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-02-15T22:30:11.762 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-02-15T22:30:11.913 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-02-15T22:30:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:12.096 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:35 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:12.214 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rados-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:12.269 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:12.270 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:30:12.270 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:12.334 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rgw 2024-02-15T22:30:12.495 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:12.794 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:12.794 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:12.794 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-02-15T22:30:12.794 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:12.794 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:30:12.794 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-02-15T22:30:12.917 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:35 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:13.020 DEBUG:teuthology.parallel:result is None 2024-02-15T22:30:13.035 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rgw-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:13.090 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:13.091 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:30:13.091 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:13.152 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-cephfs 2024-02-15T22:30:13.741 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:36 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:13.859 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-cephfs-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:13.914 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:13.916 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:30:13.916 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:13.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rbd 2024-02-15T22:30:14.567 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:37 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:14.685 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rbd-2:17.2.7-509.g9aa52330.el9.x86_64 is already installed. 2024-02-15T22:30:14.741 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:14.742 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T22:30:14.742 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:14.805 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-fuse 2024-02-15T22:30:15.393 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:38 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:15.567 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T22:30:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:17.2.7-509.g9aa52330.el9 ceph 82 k 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 82 k 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 222 k 2024-02-15T22:30:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:30:15.794 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-fuse-17.2.7-509.g9aa52330.el9.x86_64.rpm 360 kB/s | 82 kB 00:00 2024-02-15T22:30:15.795 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:15.795 INFO:teuthology.orchestra.run.smithi033.stdout:Total 358 kB/s | 82 kB 00:00 2024-02-15T22:30:15.795 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:30:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:30:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:30:15.858 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:30:15.859 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:30:15.997 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:30:16.103 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:16.512 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:16.825 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:16.825 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:16.825 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:30:16.825 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:16.825 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:16.825 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:17.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-mirror 2024-02-15T22:30:17.626 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:40 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:17.800 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:17.800 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repo Size 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:17.2.7-509.g9aa52330.el9 ceph 2.9 M 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T22:30:17.801 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:17.802 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 2.9 M 2024-02-15T22:30:17.802 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 12 M 2024-02-15T22:30:17.802 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:30:18.541 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-mirror-17.2.7-509.g9aa52330.el9.x86_64.rpm 4.0 MB/s | 2.9 MB 00:00 2024-02-15T22:30:18.542 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:18.542 INFO:teuthology.orchestra.run.smithi033.stdout:Total 4.0 MB/s | 2.9 MB 00:00 2024-02-15T22:30:18.542 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:30:18.552 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:30:18.552 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:30:18.627 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:30:18.628 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:30:19.065 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:30:19.117 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:19.142 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:19.142 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:30:19.142 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-15T22:30:19.142 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:30:19.142 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:30:19.142 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:20.279 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:20.279 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:20.279 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:30:20.279 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:20.280 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:20.280 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:20.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-nbd 2024-02-15T22:30:21.097 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:44 ago on Thu 15 Feb 2024 10:28:37 PM UTC. 2024-02-15T22:30:21.270 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T22:30:21.271 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T22:30:21.271 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:21.271 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T22:30:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:17.2.7-509.g9aa52330.el9 ceph 165 k 2024-02-15T22:30:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:21.272 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T22:30:21.272 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T22:30:21.272 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T22:30:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:21.272 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 165 k 2024-02-15T22:30:21.272 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 477 k 2024-02-15T22:30:21.272 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T22:30:21.911 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-nbd-17.2.7-509.g9aa52330.el9.x86_64.rpm 258 kB/s | 165 kB 00:00 2024-02-15T22:30:21.912 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:21.912 INFO:teuthology.orchestra.run.smithi033.stdout:Total 257 kB/s | 165 kB 00:00 2024-02-15T22:30:21.912 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T22:30:21.921 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T22:30:21.921 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T22:30:21.979 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T22:30:21.979 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T22:30:22.131 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T22:30:22.236 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:22.642 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 1/1 2024-02-15T22:30:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:22.999 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T22:30:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:17.2.7-509.g9aa52330.el9.x86_64 2024-02-15T22:30:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:30:23.000 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T22:30:23.248 DEBUG:teuthology.parallel:result is None 2024-02-15T22:30:23.249 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:30:23.249 INFO:teuthology.packaging:ref: None 2024-02-15T22:30:23.249 INFO:teuthology.packaging:tag: None 2024-02-15T22:30:23.249 INFO:teuthology.packaging:branch: quincy 2024-02-15T22:30:23.249 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:30:23.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-15T22:30:23.458 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T22:30:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:17.2.7-509.g9aa52330.el9 2024-02-15T22:30:23.478 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-509.g9aa52330.el9 2024-02-15T22:30:23.479 INFO:teuthology.task.install:The correct ceph version 17.2.7-509.g9aa52330 is installed. 2024-02-15T22:30:23.480 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:30:23.480 INFO:teuthology.packaging:ref: None 2024-02-15T22:30:23.481 INFO:teuthology.packaging:tag: None 2024-02-15T22:30:23.481 INFO:teuthology.packaging:branch: quincy 2024-02-15T22:30:23.481 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:30:23.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-15T22:30:23.691 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T22:30:23.716 INFO:teuthology.orchestra.run.smithi082.stdout:17.2.7-509.g9aa52330.el9 2024-02-15T22:30:23.716 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-509.g9aa52330.el9 2024-02-15T22:30:23.716 INFO:teuthology.task.install:The correct ceph version 17.2.7-509.g9aa52330 is installed. 2024-02-15T22:30:23.718 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-15T22:30:23.718 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:30:23.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T22:30:23.746 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:30:23.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T22:30:23.788 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-15T22:30:23.788 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:30:23.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T22:30:23.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T22:30:23.903 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:30:23.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T22:30:23.933 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T22:30:24.005 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-15T22:30:24.005 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:30:24.005 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T22:30:24.032 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T22:30:24.099 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:30:24.099 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T22:30:24.143 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T22:30:24.213 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-15T22:30:24.214 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:30:24.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T22:30:24.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T22:30:24.308 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:30:24.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T22:30:24.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T22:30:24.405 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:30:24.416 INFO:teuthology.task.print:**** done install task... 2024-02-15T22:30:24.416 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-15T22:30:24.524 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-15T22:30:24.524 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-02-15T22:30:24.524 INFO:tasks.cephadm:Cluster fsid is cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:30:24.525 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-15T22:30:24.525 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-15T22:30:24.525 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi033': '172.21.15.33', 'mon.smithi082': '172.21.15.82'} 2024-02-15T22:30:24.525 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-15T22:30:24.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2024-02-15T22:30:24.552 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-02-15T22:30:24.580 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-02-15T22:30:24.580 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T22:30:24.824 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 15 22:30 /home/ubuntu/cephtest/cephadm 2024-02-15T22:30:24.824 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T22:30:25.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 15 22:30 /home/ubuntu/cephtest/cephadm 2024-02-15T22:30:25.065 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T22:30:25.081 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T22:30:25.105 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-02-15T22:30:25.105 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-15T22:30:25.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-15T22:30:25.988 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-15T22:30:25.990 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-15T22:30:55.607 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:30:55.607 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)", 2024-02-15T22:30:55.607 INFO:teuthology.orchestra.run.smithi033.stdout: "image_id": "61c0ec9cd187a60f1c3860d9838bf0b7e967bed32184f9229a434ef00a483d52", 2024-02-15T22:30:55.607 INFO:teuthology.orchestra.run.smithi033.stdout: "repo_digests": [ 2024-02-15T22:30:55.607 INFO:teuthology.orchestra.run.smithi033.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85" 2024-02-15T22:30:55.608 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-02-15T22:30:55.608 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:30:58.911 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-02-15T22:30:58.911 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)", 2024-02-15T22:30:58.911 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "61c0ec9cd187a60f1c3860d9838bf0b7e967bed32184f9229a434ef00a483d52", 2024-02-15T22:30:58.911 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-02-15T22:30:58.911 INFO:teuthology.orchestra.run.smithi082.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85" 2024-02-15T22:30:58.911 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-02-15T22:30:58.911 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-02-15T22:30:58.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2024-02-15T22:30:58.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-02-15T22:30:58.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2024-02-15T22:30:59.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-02-15T22:30:59.062 INFO:tasks.cephadm:Writing seed config... 2024-02-15T22:30:59.063 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-15T22:30:59.064 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-15T22:30:59.065 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-15T22:30:59.066 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-15T22:30:59.066 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-15T22:30:59.066 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-15T22:30:59.066 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-15T22:30:59.066 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-15T22:30:59.066 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-15T22:30:59.066 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-15T22:30:59.067 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:30:59.067 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-15T22:30:59.093 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = cfc49586-cc51-11ee-95ba-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-15T22:30:59.093 DEBUG:teuthology.orchestra.run.smithi033:mon.smithi033> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service 2024-02-15T22:30:59.135 INFO:tasks.cephadm:Bootstrapping... 2024-02-15T22:30:59.135 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid cfc49586-cc51-11ee-95ba-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.33 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:30:59.349 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:30:59.350 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'cfc49586-cc51-11ee-95ba-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.33', '--skip-admin-label'] 2024-02-15T22:30:59.374 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-15T22:30:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-15T22:30:59.375 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying podman|docker is present... 2024-02-15T22:30:59.398 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-15T22:30:59.398 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying lvm2 is present... 2024-02-15T22:30:59.398 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying time synchronization is in place... 2024-02-15T22:30:59.406 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-15T22:30:59.406 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T22:30:59.412 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-15T22:30:59.412 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-02-15T22:30:59.418 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-02-15T22:30:59.424 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-02-15T22:30:59.424 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-02-15T22:30:59.424 INFO:teuthology.orchestra.run.smithi033.stdout:Repeating the final host check... 2024-02-15T22:30:59.448 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-15T22:30:59.448 INFO:teuthology.orchestra.run.smithi033.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-15T22:30:59.448 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl is present 2024-02-15T22:30:59.448 INFO:teuthology.orchestra.run.smithi033.stdout:lvcreate is present 2024-02-15T22:30:59.454 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-15T22:30:59.454 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T22:30:59.460 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-15T22:30:59.460 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-02-15T22:30:59.466 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-02-15T22:30:59.473 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-02-15T22:30:59.473 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-02-15T22:30:59.473 INFO:teuthology.orchestra.run.smithi033.stdout:Host looks OK 2024-02-15T22:30:59.473 INFO:teuthology.orchestra.run.smithi033.stdout:Cluster fsid: cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:30:59.473 INFO:teuthology.orchestra.run.smithi033.stdout:Acquiring lock 140170918102688 on /run/cephadm/cfc49586-cc51-11ee-95ba-87774f69a715.lock 2024-02-15T22:30:59.473 INFO:teuthology.orchestra.run.smithi033.stdout:Lock 140170918102688 acquired on /run/cephadm/cfc49586-cc51-11ee-95ba-87774f69a715.lock 2024-02-15T22:30:59.473 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 3300 ... 2024-02-15T22:30:59.474 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 6789 ... 2024-02-15T22:30:59.474 INFO:teuthology.orchestra.run.smithi033.stdout:Base mon IP(s) is [172.21.15.33:3300, 172.21.15.33:6789], mon addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-02-15T22:30:59.477 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.33 metric 100 2024-02-15T22:30:59.477 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 metric 100 2024-02-15T22:30:59.480 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-15T22:30:59.480 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-02-15T22:30:59.480 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-02-15T22:30:59.482 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-15T22:30:59.482 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-15T22:30:59.482 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-15T22:30:59.482 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-15T22:30:59.483 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2024-02-15T22:30:59.483 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-15T22:30:59.483 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-02-15T22:30:59.483 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-02-15T22:30:59.483 INFO:teuthology.orchestra.run.smithi033.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-15T22:30:59.484 INFO:teuthology.orchestra.run.smithi033.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-15T22:30:59.485 INFO:teuthology.orchestra.run.smithi033.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-15T22:30:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 61c0ec9cd187a60f1c3860d9838bf0b7e967bed32184f9229a434ef00a483d52 2024-02-15T22:30:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-15T22:30:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Getting image source signatures 2024-02-15T22:30:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:01ccf74ca3d9104c1ad955164ace8888773761115b8c97ebca5eb2ae6cd95b62 2024-02-15T22:30:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:58df4e03ba066accf3a7e07426bab5f1c867e27a139801c642bdafb42b9a2d9a 2024-02-15T22:30:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying config sha256:61c0ec9cd187a60f1c3860d9838bf0b7e967bed32184f9229a434ef00a483d52 2024-02-15T22:30:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-15T22:31:00.836 INFO:teuthology.orchestra.run.smithi033.stdout:ceph: stdout ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable) 2024-02-15T22:31:00.837 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph version: ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable) 2024-02-15T22:31:00.837 INFO:teuthology.orchestra.run.smithi033.stdout:Extracting ceph user uid/gid from container image... 2024-02-15T22:31:01.700 INFO:teuthology.orchestra.run.smithi033.stdout:stat: stdout 167 167 2024-02-15T22:31:01.700 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial keys... 2024-02-15T22:31:02.590 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQClkM5lyLEQOxAANc52pmsxG/N//pNHx1lNOA== 2024-02-15T22:31:03.521 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCmkM5lg/cQNxAAJo0O27gtqCUiHGDBkS9YRw== 2024-02-15T22:31:04.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCnkM5lhhNtMRAA7Wtq1AmxLBUb39QKhvhbQQ== 2024-02-15T22:31:04.410 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial monmap... 2024-02-15T22:31:05.525 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T22:31:05.525 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-02-15T22:31:05.525 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:05.525 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T22:31:05.525 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool for smithi033 [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T22:31:05.525 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = octopus 2024-02-15T22:31:05.525 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: set fsid to cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:05.526 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T22:31:05.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:31:05.526 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mon... 2024-02-15T22:31:06.314 INFO:teuthology.orchestra.run.smithi033.stdout:create mon.smithi033 on 2024-02-15T22:31:06.510 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-15T22:31:06.646 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-15T22:31:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-cfc49586-cc51-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-cfc49586-cc51-11ee-95ba-87774f69a715.target. 2024-02-15T22:31:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-cfc49586-cc51-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-cfc49586-cc51-11ee-95ba-87774f69a715.target. 2024-02-15T22:31:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T22:31:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service: Unit ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service not loaded. 2024-02-15T22:31:07.105 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cfc49586-cc51-11ee-95ba-87774f69a715.target.wants/ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service → /etc/systemd/system/ceph-cfc49586-cc51-11ee-95ba-87774f69a715@.service. 2024-02-15T22:31:07.587 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:31:07.588 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-02-15T22:31:07.596 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:31:07.596 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-02-15T22:31:07.596 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-02-15T22:31:07.596 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-02-15T22:31:07.597 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon to start... 2024-02-15T22:31:07.597 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon... 2024-02-15T22:31:07.715 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:07 smithi033 ceph-mon[28654]: mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2024-02-15T22:31:08.702 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:08 smithi033 ceph-mon[28654]: mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2024-02-15T22:31:08.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:08 smithi033 ceph-mon[28654]: monmap e1: 1 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:31:08.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:08 smithi033 ceph-mon[28654]: fsmap 2024-02-15T22:31:08.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:08 smithi033 ceph-mon[28654]: osdmap e1: 0 total, 0 up, 0 in 2024-02-15T22:31:08.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:08 smithi033 ceph-mon[28654]: mgrmap e1: no daemons active 2024-02-15T22:31:08.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:08 smithi033 ceph-mon[28654]: from='client.? 172.21.15.33:0/1756512757' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-15T22:31:08.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout cluster: 2024-02-15T22:31:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout id: cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-15T22:31:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout services: 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi033 (age 0.525581s) 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout data: 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pgs: 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.023+0000 7f12f8066700 1 Processor -- start 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.023+0000 7f12f8066700 1 -- start start 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.023+0000 7f12f8066700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.023+0000 7f12f8066700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f01058c0 con 0x7f12f0076c20 2024-02-15T22:31:08.711 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.024+0000 7f12f5e02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.024+0000 7f12f5e02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52780/0 (socket says 172.21.15.33:52780) 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.024+0000 7f12f5e02700 1 -- 172.21.15.33:0/161256088 learned_addr learned my addr 172.21.15.33:0/161256088 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.024+0000 7f12f5e02700 1 -- 172.21.15.33:0/161256088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0105a00 con 0x7f12f0076c20 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.024+0000 7f12f5e02700 1 --2- 172.21.15.33:0/161256088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0105380 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0098e0 tx=0x7f12ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd55320a533fac87 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f4e00700 1 -- 172.21.15.33:0/161256088 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12ec00b860 con 0x7f12f0076c20 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f4e00700 1 -- 172.21.15.33:0/161256088 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec00b9c0 con 0x7f12f0076c20 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f4e00700 1 -- 172.21.15.33:0/161256088 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12ec00bc90 con 0x7f12f0076c20 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f8066700 1 -- 172.21.15.33:0/161256088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 msgr2=0x7f12f0105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f8066700 1 --2- 172.21.15.33:0/161256088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0105380 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0098e0 tx=0x7f12ec009250 comp rx=0 tx=0).stop 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f8066700 1 -- 172.21.15.33:0/161256088 shutdown_connections 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f8066700 1 --2- 172.21.15.33:0/161256088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0105380 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f8066700 1 -- 172.21.15.33:0/161256088 >> 172.21.15.33:0/161256088 conn(0x7f12f00fcdd0 msgr2=0x7f12f00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.025+0000 7f12f8066700 1 -- 172.21.15.33:0/161256088 shutdown_connections 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f8066700 1 -- 172.21.15.33:0/161256088 wait complete. 2024-02-15T22:31:08.712 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f8066700 1 Processor -- start 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f8066700 1 -- start start 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f8066700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f8066700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0111310 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f5e02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f5e02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52782/0 (socket says 172.21.15.33:52782) 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.026+0000 7f12f5e02700 1 -- 172.21.15.33:0/1756512757 learned_addr learned my addr 172.21.15.33:0/1756512757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12f5e02700 1 -- 172.21.15.33:0/1756512757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0094f0 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12f5e02700 1 --2- 172.21.15.33:0/1756512757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0110dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009290 tx=0x7f12ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12e67fc700 1 -- 172.21.15.33:0/1756512757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12ec01c5c0 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12e67fc700 1 -- 172.21.15.33:0/1756512757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec01c740 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0111510 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12e67fc700 1 -- 172.21.15.33:0/1756512757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12ec01ca50 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f0112100 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12e67fc700 1 -- 172.21.15.33:0/1756512757 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f12ec01a450 con 0x7f12f0076c20 2024-02-15T22:31:08.713 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.027+0000 7f12e67fc700 1 -- 172.21.15.33:0/1756512757 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f12ec02e790 con 0x7f12f0076c20 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.028+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f005f5c0 con 0x7f12f0076c20 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.032+0000 7f12e67fc700 1 -- 172.21.15.33:0/1756512757 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f12ec01ce30 con 0x7f12f0076c20 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.103+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f12f004bed0 con 0x7f12f0076c20 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.104+0000 7f12e67fc700 1 -- 172.21.15.33:0/1756512757 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f12ec01a840 con 0x7f12f0076c20 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.105+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 msgr2=0x7f12f0110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.105+0000 7f12f8066700 1 --2- 172.21.15.33:0/1756512757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0110dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009290 tx=0x7f12ec016000 comp rx=0 tx=0).stop 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.105+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 shutdown_connections 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.105+0000 7f12f8066700 1 --2- 172.21.15.33:0/1756512757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f0076c20 0x7f12f0110dd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.105+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 >> 172.21.15.33:0/1756512757 conn(0x7f12f00fcdd0 msgr2=0x7f12f00fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.105+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 shutdown_connections 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:08.105+0000 7f12f8066700 1 -- 172.21.15.33:0/1756512757 wait complete. 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:mon is available 2024-02-15T22:31:08.714 INFO:teuthology.orchestra.run.smithi033.stdout:Assimilating anything we can from ceph.conf... 2024-02-15T22:31:12.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:11 smithi033 ceph-mon[28654]: from='client.? 172.21.15.33:0/3855499294' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-15T22:31:12.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:11 smithi033 ceph-mon[28654]: from='client.? 172.21.15.33:0/3855499294' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-15T22:31:17.720 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:17.720 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-02-15T22:31:17.720 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:17.720 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-02-15T22:31:17.720 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-15T22:31:17.720 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-15T22:31:17.720 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.673+0000 7f715f0c2700 1 Processor -- start 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715f0c2700 1 -- start start 2024-02-15T22:31:17.721 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715f0c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158107760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715f0c2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7158103150 con 0x7f7158076c40 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715ce5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158107760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715ce5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158107760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52786/0 (socket says 172.21.15.33:52786) 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715ce5e700 1 -- 172.21.15.33:0/2174260976 learned_addr learned my addr 172.21.15.33:0/2174260976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715ce5e700 1 -- 172.21.15.33:0/2174260976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158107ca0 con 0x7f7158076c40 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.674+0000 7f715ce5e700 1 --2- 172.21.15.33:0/2174260976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158107760 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f714c0098e0 tx=0x7f714c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659d7974f4adab4c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f71577fe700 1 -- 172.21.15.33:0/2174260976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c00b860 con 0x7f7158076c40 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f71577fe700 1 -- 172.21.15.33:0/2174260976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c00b9c0 con 0x7f7158076c40 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f71577fe700 1 -- 172.21.15.33:0/2174260976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c00bc90 con 0x7f7158076c40 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f715f0c2700 1 -- 172.21.15.33:0/2174260976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 msgr2=0x7f7158107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f715f0c2700 1 --2- 172.21.15.33:0/2174260976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158107760 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f714c0098e0 tx=0x7f714c009250 comp rx=0 tx=0).stop 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f715f0c2700 1 -- 172.21.15.33:0/2174260976 shutdown_connections 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f715f0c2700 1 --2- 172.21.15.33:0/2174260976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158107760 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:17.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f715f0c2700 1 -- 172.21.15.33:0/2174260976 >> 172.21.15.33:0/2174260976 conn(0x7f71580fcdd0 msgr2=0x7f71580ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f715f0c2700 1 -- 172.21.15.33:0/2174260976 shutdown_connections 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.675+0000 7f715f0c2700 1 -- 172.21.15.33:0/2174260976 wait complete. 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.676+0000 7f715f0c2700 1 Processor -- start 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.676+0000 7f715f0c2700 1 -- start start 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.676+0000 7f715f0c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.676+0000 7f715f0c2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7158113450 con 0x7f7158076c40 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.676+0000 7f715ce5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.676+0000 7f715ce5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158112f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52792/0 (socket says 172.21.15.33:52792) 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.676+0000 7f715ce5e700 1 -- 172.21.15.33:0/3855499294 learned_addr learned my addr 172.21.15.33:0/3855499294 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f715ce5e700 1 -- 172.21.15.33:0/3855499294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0094f0 con 0x7f7158076c40 2024-02-15T22:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f715ce5e700 1 --2- 172.21.15.33:0/3855499294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158112f10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f714c003080 tx=0x7f714c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c01c5c0 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c01c720 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7158113650 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c01ca30 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71581142f0 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f714c01a450 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.677+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f714c02e790 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.678+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715805f5c0 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.680+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f714c01a890 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.751+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f7158108080 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.754+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f714c02ee80 con 0x7f7158076c40 2024-02-15T22:31:17.724 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.754+0000 7f71557fa700 1 -- 172.21.15.33:0/3855499294 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f7158108080 con 0x7f7158076c40 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.755+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 msgr2=0x7f7158112f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.755+0000 7f715f0c2700 1 --2- 172.21.15.33:0/3855499294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158112f10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f714c003080 tx=0x7f714c016000 comp rx=0 tx=0).stop 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.755+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 shutdown_connections 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.755+0000 7f715f0c2700 1 --2- 172.21.15.33:0/3855499294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7158076c40 0x7f7158112f10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.755+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 >> 172.21.15.33:0/3855499294 conn(0x7f71580fcdd0 msgr2=0x7f71580fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.755+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 shutdown_connections 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:11.755+0000 7f715f0c2700 1 -- 172.21.15.33:0/3855499294 wait complete. 2024-02-15T22:31:17.725 INFO:teuthology.orchestra.run.smithi033.stdout:Generating new minimal ceph.conf... 2024-02-15T22:31:21.018 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:20 smithi033 ceph-mon[28654]: from='client.? 172.21.15.33:0/140641952' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.655+0000 7f89e2877700 1 Processor -- start 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.655+0000 7f89e2877700 1 -- start start 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89e2877700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc0771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89e2877700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0790d0 con 0x7f89dc078cc0 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc0771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc0771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60486/0 (socket says 172.21.15.33:60486) 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89dbfff700 1 -- 172.21.15.33:0/1310340270 learned_addr learned my addr 172.21.15.33:0/1310340270 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89dbfff700 1 -- 172.21.15.33:0/1310340270 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc077710 con 0x7f89dc078cc0 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89dbfff700 1 --2- 172.21.15.33:0/1310340270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc0771d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0098e0 tx=0x7f89cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbaae62eb356c7d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:21.209 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89daffd700 1 -- 172.21.15.33:0/1310340270 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89cc00b860 con 0x7f89dc078cc0 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.656+0000 7f89daffd700 1 -- 172.21.15.33:0/1310340270 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f89cc00be50 con 0x7f89dc078cc0 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89daffd700 1 -- 172.21.15.33:0/1310340270 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89cc010380 con 0x7f89dc078cc0 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89e2877700 1 -- 172.21.15.33:0/1310340270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 msgr2=0x7f89dc0771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89e2877700 1 --2- 172.21.15.33:0/1310340270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc0771d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0098e0 tx=0x7f89cc009250 comp rx=0 tx=0).stop 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89e2877700 1 -- 172.21.15.33:0/1310340270 shutdown_connections 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89e2877700 1 --2- 172.21.15.33:0/1310340270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc0771d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89e2877700 1 -- 172.21.15.33:0/1310340270 >> 172.21.15.33:0/1310340270 conn(0x7f89dc0fded0 msgr2=0x7f89dc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89e2877700 1 -- 172.21.15.33:0/1310340270 shutdown_connections 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.657+0000 7f89e2877700 1 -- 172.21.15.33:0/1310340270 wait complete. 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89e2877700 1 Processor -- start 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89e2877700 1 -- start start 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89e2877700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89e2877700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc113cc0 con 0x7f89dc078cc0 2024-02-15T22:31:21.210 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60488/0 (socket says 172.21.15.33:60488) 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89dbfff700 1 -- 172.21.15.33:0/140641952 learned_addr learned my addr 172.21.15.33:0/140641952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.658+0000 7f89dbfff700 1 -- 172.21.15.33:0/140641952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0094f0 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89dbfff700 1 --2- 172.21.15.33:0/140641952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc113780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f89cc013030 tx=0x7f89cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89d8ff9700 1 -- 172.21.15.33:0/140641952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89cc010760 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89d8ff9700 1 -- 172.21.15.33:0/140641952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f89cc010d50 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc113ec0 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89d8ff9700 1 -- 172.21.15.33:0/140641952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89cc01ae60 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc114b60 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89d8ff9700 1 -- 172.21.15.33:0/140641952 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f89cc0198e0 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.659+0000 7f89d8ff9700 1 -- 172.21.15.33:0/140641952 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f89cc024b30 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.660+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc05f5c0 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.662+0000 7f89d8ff9700 1 -- 172.21.15.33:0/140641952 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f89cc029060 con 0x7f89dc078cc0 2024-02-15T22:31:21.211 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.732+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f89dc108a50 con 0x7f89dc078cc0 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.732+0000 7f89d8ff9700 1 -- 172.21.15.33:0/140641952 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f89cc01a460 con 0x7f89dc078cc0 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.733+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 msgr2=0x7f89dc113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.733+0000 7f89e2877700 1 --2- 172.21.15.33:0/140641952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc113780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f89cc013030 tx=0x7f89cc009250 comp rx=0 tx=0).stop 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.733+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 shutdown_connections 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.733+0000 7f89e2877700 1 --2- 172.21.15.33:0/140641952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89dc078cc0 0x7f89dc113780 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.733+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 >> 172.21.15.33:0/140641952 conn(0x7f89dc0fded0 msgr2=0x7f89dc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.733+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 shutdown_connections 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:20.733+0000 7f89e2877700 1 -- 172.21.15.33:0/140641952 wait complete. 2024-02-15T22:31:21.212 INFO:teuthology.orchestra.run.smithi033.stdout:Restarting the monitor... 2024-02-15T22:31:21.268 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:21 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:31:21.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:21 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[28647]: 2024-02-15T22:31:21.464+0000 7f2961241700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:31:21.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:21 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[28647]: 2024-02-15T22:31:21.464+0000 7f2961241700 -1 mon.smithi033@0(leader) e1 *** Got Signal Terminated *** 2024-02-15T22:31:22.018 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:21 smithi033 podman[28906]: 2024-02-15 22:31:21.730371276 +0000 UTC m=+0.358470158 container died 6cb9bf367209d981bc0b909687f37b1dda757eac53c87fc3850b89e82fcd6760 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, RELEASE=quincy-9aa5233, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-15T22:31:22.345 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 podman[28906]: 2024-02-15 22:31:22.039121406 +0000 UTC m=+0.667220288 container cleanup 6cb9bf367209d981bc0b909687f37b1dda757eac53c87fc3850b89e82fcd6760 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=quincy-9aa5233, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:31:22.345 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 bash[28906]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033 2024-02-15T22:31:22.345 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 podman[28920]: 2024-02-15 22:31:22.240081525 +0000 UTC m=+0.508321098 container remove 6cb9bf367209d981bc0b909687f37b1dda757eac53c87fc3850b89e82fcd6760 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=quincy-9aa5233, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2) 2024-02-15T22:31:22.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service: Deactivated successfully. 2024-02-15T22:31:22.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 systemd[1]: Stopped Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:31:22.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 systemd[1]: Starting Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:31:22.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 podman[29014]: 2024-02-15 22:31:22.566043623 +0000 UTC m=+0.103224383 container create 4e26ff0fda2f16d8bb34064628641095a2fe9f464a732173627e0d2aad555c2e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, RELEASE=quincy-9aa5233, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-15T22:31:22.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 podman[29014]: 2024-02-15 22:31:22.479987637 +0000 UTC m=+0.017168417 image pull 61c0ec9cd187a60f1c3860d9838bf0b7e967bed32184f9229a434ef00a483d52 quay.ceph.io/ceph-ci/ceph:quincy 2024-02-15T22:31:22.820 INFO:teuthology.orchestra.run.smithi033.stdout:Setting mon public_network to 172.21.0.0/20 2024-02-15T22:31:23.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 podman[29014]: 2024-02-15 22:31:22.743605662 +0000 UTC m=+0.280786423 container init 4e26ff0fda2f16d8bb34064628641095a2fe9f464a732173627e0d2aad555c2e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.2, RELEASE=quincy-9aa5233, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-15T22:31:23.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 podman[29014]: 2024-02-15 22:31:22.746376623 +0000 UTC m=+0.283557381 container start 4e26ff0fda2f16d8bb34064628641095a2fe9f464a732173627e0d2aad555c2e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=quincy-9aa5233, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_CLEAN=True, io.buildah.version=1.33.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-15T22:31:23.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: set uid:gid to 167:167 (ceph:ceph) 2024-02-15T22:31:23.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable), process ceph-mon, pid 2 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: pidfile_write: ignore empty --pid-file 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: load: jerasure load: lrc 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: RocksDB version: 6.15.5 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Compile date Feb 13 2024 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: DB SUMMARY 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: DB Session ID: Y32WOML7UQN9QW3S7WRZ 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: CURRENT file: CURRENT 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: IDENTITY file: IDENTITY 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 1, files: 000008.sst 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 000010.log size: 98280 ; 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.error_if_exists: 0 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.create_if_missing: 0 2024-02-15T22:31:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.paranoid_checks: 1 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.env: 0x557463f9ea80 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.fs: Posix File System 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.info_log: 0x55746657dcc0 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_file_opening_threads: 16 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.statistics: (nil) 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.use_fsync: 0 2024-02-15T22:31:23.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_log_file_size: 0 2024-02-15T22:31:23.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T22:31:23.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.keep_log_file_num: 1000 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.recycle_log_file_num: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.allow_fallocate: 1 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.allow_mmap_reads: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.allow_mmap_writes: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.use_direct_reads: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.create_missing_column_families: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.db_log_dir: 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi033/store.db 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T22:31:23.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.advise_random_on_open: 1 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.db_write_buffer_size: 0 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.write_buffer_manager: 0x5574672f2b40 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.rate_limiter: (nil) 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.wal_recovery_mode: 2 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.enable_thread_tracking: 0 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.enable_pipelined_write: 0 2024-02-15T22:31:23.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.unordered_write: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.row_cache: None 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.wal_filter: None 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.allow_ingest_behind: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.preserve_deletes: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.two_write_queues: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.manual_wal_flush: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.atomic_flush: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T22:31:23.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.log_readahead_size: 0 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.best_efforts_recovery: 0 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.allow_data_in_errors: 0 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.db_host_id: __hostname__ 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_background_jobs: 2 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_background_compactions: -1 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_subcompactions: 1 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T22:31:23.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_total_wal_size: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_open_files: -1 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bytes_per_sync: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_readahead_size: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_background_flushes: -1 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Compression algorithms supported: 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kZSTD supported: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kXpressCompression supported: 0 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kLZ4HCCompression supported: 1 2024-02-15T22:31:23.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kZlibCompression supported: 1 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kSnappyCompression supported: 1 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kLZ4Compression supported: 1 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: kBZip2Compression supported: 0 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000009 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.merge_operator: 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_filter: None 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_filter_factory: None 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.sst_partitioner_factory: None 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5574665d2f58) 2024-02-15T22:31:23.028 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: cache_index_and_filter_blocks: 1 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: pin_top_level_index_and_filter: 1 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_type: 0 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_block_index_type: 0 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_shortening: 1 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: hash_index_allow_collision: 1 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: checksum: 1 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: no_block_cache: 0 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache: 0x557466605090 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_name: BinnedLRUCache 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_options: 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: capacity : 536870912 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: num_shard_bits : 4 2024-02-15T22:31:23.029 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: strict_capacity_limit : 0 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: high_pri_pool_ratio: 0.000 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_compressed: (nil) 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: persistent_cache: (nil) 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_size: 4096 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_size_deviation: 10 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_restart_interval: 16 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_block_restart_interval: 1 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: metadata_block_size: 4096 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: partition_filters: 0 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: use_delta_encoding: 1 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: whole_key_filtering: 1 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: verify_compression: 0 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: read_amp_bytes_per_bit: 0 2024-02-15T22:31:23.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: format_version: 4 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: enable_index_compression: 1 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_align: 0 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.write_buffer_size: 33554432 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_write_buffer_number: 2 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression: NoCompression 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression: Disabled 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.prefix_extractor: nullptr 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.num_levels: 7 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T22:31:23.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression_opts.level: 32767 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression_opts.strategy: 0 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compression_opts.enabled: false 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T22:31:23.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.target_file_size_base: 67108864 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.arena_block_size: 4194304 2024-02-15T22:31:23.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.disable_auto_compactions: 0 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.table_properties_collectors: 2024-02-15T22:31:23.034 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.inplace_update_support: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.bloom_locality: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.max_successive_merges: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.paranoid_file_checks: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.force_consistency_checks: 1 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.report_bg_io_stats: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.ttl: 2592000 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.enable_blob_files: false 2024-02-15T22:31:23.035 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.min_blob_size: 0 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.blob_file_size: 268435456 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036282771205, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036282772057, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93065, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91160, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13388, "raw_average_key_size": 49, "raw_value_size": 83848, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 271, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708036282, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "9917deb4-26b1-47a3-a35e-c0b7e69ecf40", "db_session_id": "Y32WOML7UQN9QW3S7WRZ"}} 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036282772464, "job": 1, "event": "recovery_finished"} 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi033/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-15T22:31:23.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x557466599180 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: DB pointer 0x55746666e000 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** DB Stats ** 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:31:23.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L0 2/0 92.68 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.4 0.00 0.00 1 0.001 0 0 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Sum 2/0 92.68 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.4 0.00 0.00 1 0.001 0 0 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.4 0.00 0.00 1 0.001 0 0 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.4 0.00 0.00 1 0.001 0 0 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:31:23.038 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative compaction: 0.00 GB write, 28.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval compaction: 0.00 GB write, 28.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L0 2/0 92.68 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.4 0.00 0.00 1 0.001 0 0 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Sum 2/0 92.68 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.4 0.00 0.00 1 0.001 0 0 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2024-02-15T22:31:23.039 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.4 0.00 0.00 1 0.001 0 0 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative compaction: 0.00 GB write, 28.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: starting mon.smithi033 rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi033 fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???) e1 preinit fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:23.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???).mds e1 new map 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???).mds e1 print_map 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: e1 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: legacy client fscid: -1 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: No filesystems configured 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-15T22:31:23.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 bash[29014]: 4e26ff0fda2f16d8bb34064628641095a2fe9f464a732173627e0d2aad555c2e 2024-02-15T22:31:23.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 systemd[1]: Started Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:31:23.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2024-02-15T22:31:23.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: monmap e1: 1 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:31:23.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: fsmap 2024-02-15T22:31:23.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: osdmap e1: 0 total, 0 up, 0 in 2024-02-15T22:31:23.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:22 smithi033 ceph-mon[29033]: mgrmap e1: no daemons active 2024-02-15T22:31:23.857 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.297+0000 7fb98b5f9700 1 Processor -- start 2024-02-15T22:31:23.857 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.297+0000 7fb98b5f9700 1 -- start start 2024-02-15T22:31:23.857 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.297+0000 7fb98b5f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:23.857 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.297+0000 7fb98b5f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9841030c0 con 0x7fb984102770 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.297+0000 7fb989395700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.297+0000 7fb989395700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60490/0 (socket says 172.21.15.33:60490) 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.297+0000 7fb989395700 1 -- 172.21.15.33:0/1887121417 learned_addr learned my addr 172.21.15.33:0/1887121417 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.298+0000 7fb989395700 1 -- 172.21.15.33:0/1887121417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb984103200 con 0x7fb984102770 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.298+0000 7fb989395700 1 --2- 172.21.15.33:0/1887121417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984102b80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb9800098e0 tx=0x7fb980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55078f9772ab661c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.298+0000 7fb97bfff700 1 -- 172.21.15.33:0/1887121417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb98000b860 con 0x7fb984102770 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.298+0000 7fb97bfff700 1 -- 172.21.15.33:0/1887121417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb98000be50 con 0x7fb984102770 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.298+0000 7fb97bfff700 1 -- 172.21.15.33:0/1887121417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb980010380 con 0x7fb984102770 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.298+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1887121417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 msgr2=0x7fb984102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.298+0000 7fb98b5f9700 1 --2- 172.21.15.33:0/1887121417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984102b80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb9800098e0 tx=0x7fb980009250 comp rx=0 tx=0).stop 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1887121417 shutdown_connections 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 --2- 172.21.15.33:0/1887121417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984102b80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:23.858 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1887121417 >> 172.21.15.33:0/1887121417 conn(0x7fb9840fded0 msgr2=0x7fb984100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1887121417 shutdown_connections 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1887121417 wait complete. 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 Processor -- start 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 -- start start 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb98b5f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb984111ad0 con 0x7fb984102770 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb989395700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb989395700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60498/0 (socket says 172.21.15.33:60498) 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.299+0000 7fb989395700 1 -- 172.21.15.33:0/1154673760 learned_addr learned my addr 172.21.15.33:0/1154673760 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb989395700 1 -- 172.21.15.33:0/1154673760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800094f0 con 0x7fb984102770 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb989395700 1 --2- 172.21.15.33:0/1154673760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984111590 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb980000c00 tx=0x7fb980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb979ffb700 1 -- 172.21.15.33:0/1154673760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9800107c0 con 0x7fb984102770 2024-02-15T22:31:23.859 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb979ffb700 1 -- 172.21.15.33:0/1154673760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb980010db0 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb984111cd0 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb979ffb700 1 -- 172.21.15.33:0/1154673760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb98001ad00 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb984112970 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb979ffb700 1 -- 172.21.15.33:0/1154673760 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb980024440 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.300+0000 7fb979ffb700 1 -- 172.21.15.33:0/1154673760 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb980019710 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.301+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98405f5c0 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.303+0000 7fb979ffb700 1 -- 172.21.15.33:0/1154673760 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb98001a530 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.372+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fb9841045e0 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.374+0000 7fb979ffb700 1 -- 172.21.15.33:0/1154673760 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb980010920 con 0x7fb984102770 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.375+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 msgr2=0x7fb984111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.375+0000 7fb98b5f9700 1 --2- 172.21.15.33:0/1154673760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984111590 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb980000c00 tx=0x7fb980009250 comp rx=0 tx=0).stop 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.375+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 shutdown_connections 2024-02-15T22:31:23.860 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.375+0000 7fb98b5f9700 1 --2- 172.21.15.33:0/1154673760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb984102770 0x7fb984111590 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:23.861 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.375+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 >> 172.21.15.33:0/1154673760 conn(0x7fb9840fded0 msgr2=0x7fb9840ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:23.861 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.375+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 shutdown_connections 2024-02-15T22:31:23.861 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:23.375+0000 7fb98b5f9700 1 -- 172.21.15.33:0/1154673760 wait complete. 2024-02-15T22:31:23.861 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-15T22:31:23.861 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:31:23.861 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mgr... 2024-02-15T22:31:23.861 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 9283 ... 2024-02-15T22:31:24.036 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mgr.smithi033.swohxi 2024-02-15T22:31:24.037 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mgr.smithi033.swohxi.service: Unit ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mgr.smithi033.swohxi.service not loaded. 2024-02-15T22:31:24.187 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cfc49586-cc51-11ee-95ba-87774f69a715.target.wants/ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mgr.smithi033.swohxi.service → /etc/systemd/system/ceph-cfc49586-cc51-11ee-95ba-87774f69a715@.service. 2024-02-15T22:31:24.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:24 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1154673760' entity='client.admin' 2024-02-15T22:31:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:31:24.734 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-02-15T22:31:24.741 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:31:24.741 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-02-15T22:31:24.741 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-02-15T22:31:24.741 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-02-15T22:31:24.750 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:31:24.750 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-02-15T22:31:24.757 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:31:24.757 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-02-15T22:31:24.757 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-02-15T22:31:24.757 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-15T22:31:24.757 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr to start... 2024-02-15T22:31:24.758 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr... 2024-02-15T22:31:25.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:25 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1792610068' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T22:31:28.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "cfc49586-cc51-11ee-95ba-87774f69a715", 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "smithi033" 2024-02-15T22:31:28.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-15T22:31:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-15T22:31:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-02-15T22:31:07.592404+0000", 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.163+0000 7f235b54c700 1 Processor -- start 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.164+0000 7f235b54c700 1 -- start start 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.164+0000 7f235b54c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354104230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.164+0000 7f235b54c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354104770 con 0x7f2354103e20 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.164+0000 7f23592e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354104230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.164+0000 7f23592e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354104230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60530/0 (socket says 172.21.15.33:60530) 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.164+0000 7f23592e8700 1 -- 172.21.15.33:0/3416472775 learned_addr learned my addr 172.21.15.33:0/3416472775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.164+0000 7f23592e8700 1 -- 172.21.15.33:0/3416472775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23541048b0 con 0x7f2354103e20 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.165+0000 7f23592e8700 1 --2- 172.21.15.33:0/3416472775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354104230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f23500098e0 tx=0x7f2350009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe05b21657cad4b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.165+0000 7f2347fff700 1 -- 172.21.15.33:0/3416472775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f235000b860 con 0x7f2354103e20 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.165+0000 7f2347fff700 1 -- 172.21.15.33:0/3416472775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f235000be50 con 0x7f2354103e20 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.165+0000 7f2347fff700 1 -- 172.21.15.33:0/3416472775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2350010380 con 0x7f2354103e20 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 -- 172.21.15.33:0/3416472775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 msgr2=0x7f2354104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 --2- 172.21.15.33:0/3416472775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354104230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f23500098e0 tx=0x7f2350009250 comp rx=0 tx=0).stop 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 -- 172.21.15.33:0/3416472775 shutdown_connections 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 --2- 172.21.15.33:0/3416472775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354104230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 -- 172.21.15.33:0/3416472775 >> 172.21.15.33:0/3416472775 conn(0x7f23540fc580 msgr2=0x7f23540fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 -- 172.21.15.33:0/3416472775 shutdown_connections 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 -- 172.21.15.33:0/3416472775 wait complete. 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 Processor -- start 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.166+0000 7f235b54c700 1 -- start start 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f235b54c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354111570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f235b54c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354111ab0 con 0x7f2354103e20 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f23592e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354111570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f23592e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354111570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60536/0 (socket says 172.21.15.33:60536) 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f23592e8700 1 -- 172.21.15.33:0/1792610068 learned_addr learned my addr 172.21.15.33:0/1792610068 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f23592e8700 1 -- 172.21.15.33:0/1792610068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500094f0 con 0x7f2354103e20 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f23592e8700 1 --2- 172.21.15.33:0/1792610068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354111570 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2350000c00 tx=0x7f2350009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f2345ffb700 1 -- 172.21.15.33:0/1792610068 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23500107c0 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f2345ffb700 1 -- 172.21.15.33:0/1792610068 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2350010db0 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f2345ffb700 1 -- 172.21.15.33:0/1792610068 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f235001ad00 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.167+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2354111cb0 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.168+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2354112950 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.168+0000 7f2345ffb700 1 -- 172.21.15.33:0/1792610068 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2350024440 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.168+0000 7f2345ffb700 1 -- 172.21.15.33:0/1792610068 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2350019710 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.168+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235405f5c0 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.171+0000 7f2345ffb700 1 -- 172.21.15.33:0/1792610068 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f235001a530 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.243+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2354101320 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.244+0000 7f2345ffb700 1 -- 172.21.15.33:0/1792610068 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f2350010920 con 0x7f2354103e20 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.245+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 msgr2=0x7f2354111570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.245+0000 7f235b54c700 1 --2- 172.21.15.33:0/1792610068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354111570 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2350000c00 tx=0x7f2350009250 comp rx=0 tx=0).stop 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.245+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 shutdown_connections 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.245+0000 7f235b54c700 1 --2- 172.21.15.33:0/1792610068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2354103e20 0x7f2354111570 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.245+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 >> 172.21.15.33:0/1792610068 conn(0x7f23540fc580 msgr2=0x7f23540fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.245+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 shutdown_connections 2024-02-15T22:31:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:25.245+0000 7f235b54c700 1 -- 172.21.15.33:0/1792610068 wait complete. 2024-02-15T22:31:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (1/15)... 2024-02-15T22:31:30.768 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:30 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3715937265' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T22:31:31.094 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:31.097 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:31:31.097 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "cfc49586-cc51-11ee-95ba-87774f69a715", 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-02-15T22:31:31.098 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "smithi033" 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-15T22:31:31.099 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-15T22:31:31.100 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-15T22:31:31.108 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-15T22:31:31.109 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-02-15T22:31:07.592404+0000", 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.476+0000 7fd5f7a0f700 1 Processor -- start 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.477+0000 7fd5f7a0f700 1 -- start start 2024-02-15T22:31:31.110 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.477+0000 7fd5f7a0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.477+0000 7fd5f7a0f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01058a0 con 0x7fd5f00714a0 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.477+0000 7fd5f57ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.477+0000 7fd5f57ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41156/0 (socket says 172.21.15.33:41156) 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.477+0000 7fd5f57ab700 1 -- 172.21.15.33:0/4136275925 learned_addr learned my addr 172.21.15.33:0/4136275925 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.478+0000 7fd5f57ab700 1 -- 172.21.15.33:0/4136275925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f01059e0 con 0x7fd5f00714a0 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.478+0000 7fd5f57ab700 1 --2- 172.21.15.33:0/4136275925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0105360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0098e0 tx=0x7fd5ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84aa84bb1b3862ae server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.478+0000 7fd5e7fff700 1 -- 172.21.15.33:0/4136275925 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5ec00b860 con 0x7fd5f00714a0 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.478+0000 7fd5e7fff700 1 -- 172.21.15.33:0/4136275925 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd5ec00be50 con 0x7fd5f00714a0 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.478+0000 7fd5e7fff700 1 -- 172.21.15.33:0/4136275925 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5ec010380 con 0x7fd5f00714a0 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/4136275925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 msgr2=0x7fd5f0105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 --2- 172.21.15.33:0/4136275925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0105360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0098e0 tx=0x7fd5ec009250 comp rx=0 tx=0).stop 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/4136275925 shutdown_connections 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 --2- 172.21.15.33:0/4136275925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0105360 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/4136275925 >> 172.21.15.33:0/4136275925 conn(0x7fd5f00fcdd0 msgr2=0x7fd5f00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:31.111 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/4136275925 shutdown_connections 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/4136275925 wait complete. 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 Processor -- start 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 -- start start 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.479+0000 7fd5f7a0f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0101260 con 0x7fd5f00714a0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5f57ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5f57ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41172/0 (socket says 172.21.15.33:41172) 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5f57ab700 1 -- 172.21.15.33:0/3715937265 learned_addr learned my addr 172.21.15.33:0/3715937265 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5f57ab700 1 -- 172.21.15.33:0/3715937265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec0094f0 con 0x7fd5f00714a0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5f57ab700 1 --2- 172.21.15.33:0/3715937265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0102de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec003080 tx=0x7fd5ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5e5ffb700 1 -- 172.21.15.33:0/3715937265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5ec010760 con 0x7fd5f00714a0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5e5ffb700 1 -- 172.21.15.33:0/3715937265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd5ec010d50 con 0x7fd5f00714a0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5e5ffb700 1 -- 172.21.15.33:0/3715937265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5ec01ace0 con 0x7fd5f00714a0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.480+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f0101460 con 0x7fd5f00714a0 2024-02-15T22:31:31.112 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.481+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f01018f0 con 0x7fd5f00714a0 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.481+0000 7fd5e5ffb700 1 -- 172.21.15.33:0/3715937265 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd5ec02e6c0 con 0x7fd5f00714a0 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.481+0000 7fd5e5ffb700 1 -- 172.21.15.33:0/3715937265 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd5ec024860 con 0x7fd5f00714a0 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.481+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f010b640 con 0x7fd5f00714a0 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.484+0000 7fd5e5ffb700 1 -- 172.21.15.33:0/3715937265 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd5ec029070 con 0x7fd5f00714a0 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.556+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd5f010b060 con 0x7fd5f00714a0 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.556+0000 7fd5e5ffb700 1 -- 172.21.15.33:0/3715937265 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fd5ec0108c0 con 0x7fd5f00714a0 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.558+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 msgr2=0x7fd5f0102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.558+0000 7fd5f7a0f700 1 --2- 172.21.15.33:0/3715937265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0102de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec003080 tx=0x7fd5ec009250 comp rx=0 tx=0).stop 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.558+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 shutdown_connections 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.558+0000 7fd5f7a0f700 1 --2- 172.21.15.33:0/3715937265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f00714a0 0x7fd5f0102de0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.558+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 >> 172.21.15.33:0/3715937265 conn(0x7fd5f00fcdd0 msgr2=0x7fd5f00fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.558+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 shutdown_connections 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:30.558+0000 7fd5f7a0f700 1 -- 172.21.15.33:0/3715937265 wait complete. 2024-02-15T22:31:31.113 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (2/15)... 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: Activating manager daemon smithi033.swohxi 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: mgrmap e2: smithi033.swohxi(active, starting, since 0.00283604s) 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:31:32.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:31:32.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:31:32.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:32.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:32.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:31 smithi033 ceph-mon[29033]: from='mgr.14100 172.21.15.33:0/503728130' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:33.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:33 smithi033 ceph-mon[29033]: mgrmap e3: smithi033.swohxi(active, since 1.00651s) 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "cfc49586-cc51-11ee-95ba-87774f69a715", 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-15T22:31:34.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "smithi033" 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-15T22:31:34.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-15T22:31:34.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-15T22:31:34.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-15T22:31:34.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:34.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:31:34.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-02-15T22:31:07.592404+0000", 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.743+0000 7ff4ff131700 1 Processor -- start 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.743+0000 7ff4ff131700 1 -- start start 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.743+0000 7ff4ff131700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.743+0000 7ff4ff131700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8105960 con 0x7ff4f8076b80 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4fcecd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4fcecd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41268/0 (socket says 172.21.15.33:41268) 2024-02-15T22:31:34.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4fcecd700 1 -- 172.21.15.33:0/3299558288 learned_addr learned my addr 172.21.15.33:0/3299558288 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4fcecd700 1 -- 172.21.15.33:0/3299558288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8105aa0 con 0x7ff4f8076b80 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4fcecd700 1 --2- 172.21.15.33:0/3299558288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8105420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80098e0 tx=0x7ff4e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db96c01f9de9eb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4f77fe700 1 -- 172.21.15.33:0/3299558288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4e800b860 con 0x7ff4f8076b80 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4f77fe700 1 -- 172.21.15.33:0/3299558288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff4e800be50 con 0x7ff4f8076b80 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.744+0000 7ff4f77fe700 1 -- 172.21.15.33:0/3299558288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4e8010380 con 0x7ff4f8076b80 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 -- 172.21.15.33:0/3299558288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 msgr2=0x7ff4f8105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 --2- 172.21.15.33:0/3299558288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8105420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80098e0 tx=0x7ff4e8009250 comp rx=0 tx=0).stop 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 -- 172.21.15.33:0/3299558288 shutdown_connections 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 --2- 172.21.15.33:0/3299558288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8105420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 -- 172.21.15.33:0/3299558288 >> 172.21.15.33:0/3299558288 conn(0x7ff4f80fcdd0 msgr2=0x7ff4f80ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 -- 172.21.15.33:0/3299558288 shutdown_connections 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 -- 172.21.15.33:0/3299558288 wait complete. 2024-02-15T22:31:34.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.745+0000 7ff4ff131700 1 Processor -- start 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4ff131700 1 -- start start 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4ff131700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8111580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4ff131700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8111ac0 con 0x7ff4f8076b80 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4fcecd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4fcecd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8111580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41272/0 (socket says 172.21.15.33:41272) 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4fcecd700 1 -- 172.21.15.33:0/3805126935 learned_addr learned my addr 172.21.15.33:0/3805126935 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4fcecd700 1 -- 172.21.15.33:0/3805126935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80094f0 con 0x7ff4f8076b80 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.746+0000 7ff4fcecd700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8111580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8006b00 tx=0x7ff4e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.747+0000 7ff4f57fa700 1 -- 172.21.15.33:0/3805126935 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4e80107c0 con 0x7ff4f8076b80 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.747+0000 7ff4f57fa700 1 -- 172.21.15.33:0/3805126935 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff4e8010db0 con 0x7ff4f8076b80 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.747+0000 7ff4f57fa700 1 -- 172.21.15.33:0/3805126935 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4e801acf0 con 0x7ff4f8076b80 2024-02-15T22:31:34.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.747+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f8111cc0 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.747+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f8112960 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.748+0000 7ff4f57fa700 1 -- 172.21.15.33:0/3805126935 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 3) v1 ==== 43251+0+0 (secure 0 0 0) 0x7ff4e80193c0 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.748+0000 7ff4f57fa700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7ff4e0036660 0x7ff4e0038b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.748+0000 7ff4f57fa700 1 -- 172.21.15.33:0/3805126935 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff4e804a300 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.748+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f805f5c0 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.748+0000 7ff4f7fff700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7ff4e0036660 0x7ff4e0038b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.748+0000 7ff4f7fff700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7ff4e0036660 0x7ff4e0038b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009990 tx=0x7ff4ec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:33.753+0000 7ff4f57fa700 1 -- 172.21.15.33:0/3805126935 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff4e801a530 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.019+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff4f8113370 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.020+0000 7ff4f57fa700 1 -- 172.21.15.33:0/3805126935 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7ff4e8023b90 con 0x7ff4f8076b80 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7ff4e0036660 msgr2=0x7ff4e0038b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7ff4e0036660 0x7ff4e0038b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009990 tx=0x7ff4ec006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 msgr2=0x7ff4f8111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:34.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8111580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8006b00 tx=0x7ff4e8009250 comp rx=0 tx=0).stop 2024-02-15T22:31:34.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 shutdown_connections 2024-02-15T22:31:34.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7ff4e0036660 0x7ff4e0038b10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:34.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 --2- 172.21.15.33:0/3805126935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8076b80 0x7ff4f8111580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:34.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 >> 172.21.15.33:0/3805126935 conn(0x7ff4f80fcdd0 msgr2=0x7ff4f80fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:34.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 shutdown_connections 2024-02-15T22:31:34.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.022+0000 7ff4ff131700 1 -- 172.21.15.33:0/3805126935 wait complete. 2024-02-15T22:31:34.554 INFO:teuthology.orchestra.run.smithi033.stdout:mgr is available 2024-02-15T22:31:34.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:34 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3805126935' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T22:31:35.722 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:35 smithi033 ceph-mon[29033]: mgrmap e4: smithi033.swohxi(active, since 3s) 2024-02-15T22:31:35.722 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:35 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/79805379' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-15T22:31:35.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860b1a2700 1 Processor -- start 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860b1a2700 1 -- start start 2024-02-15T22:31:35.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860b1a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604102980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860b1a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604102ec0 con 0x7f8604102570 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860a1a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860a1a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41278/0 (socket says 172.21.15.33:41278) 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860a1a0700 1 -- 172.21.15.33:0/1864925189 learned_addr learned my addr 172.21.15.33:0/1864925189 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.958+0000 7f860a1a0700 1 -- 172.21.15.33:0/1864925189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604103000 con 0x7f8604102570 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860a1a0700 1 --2- 172.21.15.33:0/1864925189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604102980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f86000098e0 tx=0x7f8600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31501b883f6adb7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860919e700 1 -- 172.21.15.33:0/1864925189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f860000b860 con 0x7f8604102570 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860919e700 1 -- 172.21.15.33:0/1864925189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f860000be50 con 0x7f8604102570 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860919e700 1 -- 172.21.15.33:0/1864925189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8600010380 con 0x7f8604102570 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860b1a2700 1 -- 172.21.15.33:0/1864925189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 msgr2=0x7f8604102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860b1a2700 1 --2- 172.21.15.33:0/1864925189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604102980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f86000098e0 tx=0x7f8600009250 comp rx=0 tx=0).stop 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860b1a2700 1 -- 172.21.15.33:0/1864925189 shutdown_connections 2024-02-15T22:31:35.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860b1a2700 1 --2- 172.21.15.33:0/1864925189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604102980 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860b1a2700 1 -- 172.21.15.33:0/1864925189 >> 172.21.15.33:0/1864925189 conn(0x7f86040fdcf0 msgr2=0x7f8604100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860b1a2700 1 -- 172.21.15.33:0/1864925189 shutdown_connections 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.959+0000 7f860b1a2700 1 -- 172.21.15.33:0/1864925189 wait complete. 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860b1a2700 1 Processor -- start 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860b1a2700 1 -- start start 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860b1a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860b1a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604077190 con 0x7f8604102570 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860a1a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860a1a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41292/0 (socket says 172.21.15.33:41292) 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860a1a0700 1 -- 172.21.15.33:0/79805379 learned_addr learned my addr 172.21.15.33:0/79805379 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.960+0000 7f860a1a0700 1 -- 172.21.15.33:0/79805379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000094f0 con 0x7f8604102570 2024-02-15T22:31:35.735 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.961+0000 7f860a1a0700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604078d10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f860000b440 tx=0x7f8600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.961+0000 7f85faffd700 1 -- 172.21.15.33:0/79805379 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8600010760 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.961+0000 7f85faffd700 1 -- 172.21.15.33:0/79805379 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8600010d50 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.961+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604077390 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.961+0000 7f85faffd700 1 -- 172.21.15.33:0/79805379 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f860001adc0 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.961+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8604077820 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.962+0000 7f85faffd700 1 -- 172.21.15.33:0/79805379 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f86000108c0 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.962+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860410b4b0 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.962+0000 7f85faffd700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7f85f0036720 0x7f85f0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.962+0000 7f85faffd700 1 -- 172.21.15.33:0/79805379 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8600049f80 con 0x7f8604102570 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.962+0000 7f860999f700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7f85f0036720 0x7f85f0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.962+0000 7f860999f700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7f85f0036720 0x7f85f0038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009990 tx=0x7f85f4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:35.736 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:34.967+0000 7f85faffd700 1 -- 172.21.15.33:0/79805379 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8600022300 con 0x7f8604102570 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.156+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f8604104480 con 0x7f8604102570 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.157+0000 7f85faffd700 1 -- 172.21.15.33:0/79805379 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f8600022300 con 0x7f8604102570 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7f85f0036720 msgr2=0x7f85f0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7f85f0036720 0x7f85f0038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009990 tx=0x7f85f4006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 msgr2=0x7f8604078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604078d10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f860000b440 tx=0x7f8600009250 comp rx=0 tx=0).stop 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 shutdown_connections 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7f85f0036720 0x7f85f0038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 --2- 172.21.15.33:0/79805379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8604102570 0x7f8604078d10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 >> 172.21.15.33:0/79805379 conn(0x7f86040fdcf0 msgr2=0x7f86040ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 shutdown_connections 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:35.159+0000 7f860b1a2700 1 -- 172.21.15.33:0/79805379 wait complete. 2024-02-15T22:31:35.737 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling cephadm module... 2024-02-15T22:31:36.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:36 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2082412444' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.131+0000 7fa820bdd700 1 Processor -- start 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.131+0000 7fa820bdd700 1 -- start start 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa820bdd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa820bdd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c105960 con 0x7fa81c076b80 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41298/0 (socket says 172.21.15.33:41298) 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa81a59c700 1 -- 172.21.15.33:0/3883443811 learned_addr learned my addr 172.21.15.33:0/3883443811 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa81a59c700 1 -- 172.21.15.33:0/3883443811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c105aa0 con 0x7fa81c076b80 2024-02-15T22:31:37.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa81a59c700 1 --2- 172.21.15.33:0/3883443811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c105420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0098e0 tx=0x7fa80c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9119b2c717ebe2e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.132+0000 7fa81959a700 1 -- 172.21.15.33:0/3883443811 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa80c00b860 con 0x7fa81c076b80 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa81959a700 1 -- 172.21.15.33:0/3883443811 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa80c00be50 con 0x7fa81c076b80 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa81959a700 1 -- 172.21.15.33:0/3883443811 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa80c010380 con 0x7fa81c076b80 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa820bdd700 1 -- 172.21.15.33:0/3883443811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 msgr2=0x7fa81c105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa820bdd700 1 --2- 172.21.15.33:0/3883443811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c105420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0098e0 tx=0x7fa80c009250 comp rx=0 tx=0).stop 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa820bdd700 1 -- 172.21.15.33:0/3883443811 shutdown_connections 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa820bdd700 1 --2- 172.21.15.33:0/3883443811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c105420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa820bdd700 1 -- 172.21.15.33:0/3883443811 >> 172.21.15.33:0/3883443811 conn(0x7fa81c0fcdd0 msgr2=0x7fa81c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa820bdd700 1 -- 172.21.15.33:0/3883443811 shutdown_connections 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.133+0000 7fa820bdd700 1 -- 172.21.15.33:0/3883443811 wait complete. 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa820bdd700 1 Processor -- start 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa820bdd700 1 -- start start 2024-02-15T22:31:37.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa820bdd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c111830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa820bdd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c111d70 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c111830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c111830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41306/0 (socket says 172.21.15.33:41306) 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa81a59c700 1 -- 172.21.15.33:0/2082412444 learned_addr learned my addr 172.21.15.33:0/2082412444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.134+0000 7fa81a59c700 1 -- 172.21.15.33:0/2082412444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c0094f0 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.135+0000 7fa81a59c700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c111830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa80c006d40 tx=0x7fa80c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.135+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa80c010760 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.135+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa80c010d50 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.135+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c111f70 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.135+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa80c024d20 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.135+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c112c10 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.135+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fa80c02e440 con 0x7fa81c076b80 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.136+0000 7fa80affd700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa804036790 0x7fa804038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:37.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.136+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa80c04a900 con 0x7fa81c076b80 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.136+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c05f5c0 con 0x7fa81c076b80 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.136+0000 7fa819d9b700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa804036790 0x7fa804038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.136+0000 7fa819d9b700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa804036790 0x7fa804038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa810009990 tx=0x7fa810006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.140+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa80c018940 con 0x7fa81c076b80 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.389+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa81c04bed0 con 0x7fa81c076b80 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.441+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa80c01a430 con 0x7fa81c076b80 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.443+0000 7fa80affd700 1 -- 172.21.15.33:0/2082412444 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa80c019940 con 0x7fa81c076b80 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa804036790 msgr2=0x7fa804038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa804036790 0x7fa804038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa810009990 tx=0x7fa810006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 msgr2=0x7fa81c111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c111830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa80c006d40 tx=0x7fa80c009250 comp rx=0 tx=0).stop 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 shutdown_connections 2024-02-15T22:31:37.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa804036790 0x7fa804038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:37.033 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 --2- 172.21.15.33:0/2082412444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa81c076b80 0x7fa81c111830 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:37.033 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 >> 172.21.15.33:0/2082412444 conn(0x7fa81c0fcdd0 msgr2=0x7fa81c0ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:37.033 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 shutdown_connections 2024-02-15T22:31:37.033 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:36.446+0000 7fa820bdd700 1 -- 172.21.15.33:0/2082412444 wait complete. 2024-02-15T22:31:37.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:37 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2082412444' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-15T22:31:37.694 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:37 smithi033 ceph-mon[29033]: mgrmap e5: smithi033.swohxi(active, since 5s) 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "smithi033.swohxi", 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.486+0000 7fa7d5cd3700 1 Processor -- start 2024-02-15T22:31:38.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7d5cd3700 1 -- start start 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7d5cd3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7d5cd3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01030c0 con 0x7fa7d0102770 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39272/0 (socket says 172.21.15.33:39272) 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7cf7fe700 1 -- 172.21.15.33:0/3611054552 learned_addr learned my addr 172.21.15.33:0/3611054552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7cf7fe700 1 -- 172.21.15.33:0/3611054552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0103200 con 0x7fa7d0102770 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.487+0000 7fa7cf7fe700 1 --2- 172.21.15.33:0/3611054552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0102b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728f7e008af66b66 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7ce7fc700 1 -- 172.21.15.33:0/3611054552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7c000b860 con 0x7fa7d0102770 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7ce7fc700 1 -- 172.21.15.33:0/3611054552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa7c000be50 con 0x7fa7d0102770 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7ce7fc700 1 -- 172.21.15.33:0/3611054552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7c0010380 con 0x7fa7d0102770 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/3611054552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 msgr2=0x7fa7d0102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7d5cd3700 1 --2- 172.21.15.33:0/3611054552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0102b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c0009250 comp rx=0 tx=0).stop 2024-02-15T22:31:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/3611054552 shutdown_connections 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7d5cd3700 1 --2- 172.21.15.33:0/3611054552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0102b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/3611054552 >> 172.21.15.33:0/3611054552 conn(0x7fa7d00fded0 msgr2=0x7fa7d0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/3611054552 shutdown_connections 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.488+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/3611054552 wait complete. 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.489+0000 7fa7d5cd3700 1 Processor -- start 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.489+0000 7fa7d5cd3700 1 -- start start 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.489+0000 7fa7d5cd3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.489+0000 7fa7d5cd3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0076080 con 0x7fa7d0102770 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.489+0000 7fa7cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.489+0000 7fa7cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39282/0 (socket says 172.21.15.33:39282) 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.489+0000 7fa7cf7fe700 1 -- 172.21.15.33:0/2492235314 learned_addr learned my addr 172.21.15.33:0/2492235314 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.490+0000 7fa7cf7fe700 1 -- 172.21.15.33:0/2492235314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c00094f0 con 0x7fa7d0102770 2024-02-15T22:31:38.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.490+0000 7fa7cf7fe700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0077c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000b440 tx=0x7fa7c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.490+0000 7fa7b7fff700 1 -- 172.21.15.33:0/2492235314 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7c0010760 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.490+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d0076280 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.490+0000 7fa7b7fff700 1 -- 172.21.15.33:0/2492235314 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa7c0010d50 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.490+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d0076710 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.490+0000 7fa7b7fff700 1 -- 172.21.15.33:0/2492235314 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7c0024d80 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.491+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d010b670 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.491+0000 7fa7b7fff700 1 -- 172.21.15.33:0/2492235314 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa7c00108c0 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.491+0000 7fa7b7fff700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 0x7fa7b8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.492+0000 7fa7b7fff700 1 -- 172.21.15.33:0/2492235314 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa7c004a580 con 0x7fa7d0102770 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.492+0000 7fa7ceffd700 1 -- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 msgr2=0x7fa7b8038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2250238044 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.492+0000 7fa7ceffd700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 0x7fa7b8038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:31:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.496+0000 7fa7b7fff700 1 -- 172.21.15.33:0/2492235314 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa7c002d3f0 con 0x7fa7d0102770 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.693+0000 7fa7ceffd700 1 -- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 msgr2=0x7fa7b8038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2250238044 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.693+0000 7fa7ceffd700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 0x7fa7b8038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.741+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa7d0064ad0 con 0x7fa7d0102770 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.741+0000 7fa7b7fff700 1 -- 172.21.15.33:0/2492235314 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa7c0022340 con 0x7fa7d0102770 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.743+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 msgr2=0x7fa7b8038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.743+0000 7fa7d5cd3700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 0x7fa7b8038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.743+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 msgr2=0x7fa7d0077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.743+0000 7fa7d5cd3700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0077c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000b440 tx=0x7fa7c0009250 comp rx=0 tx=0).stop 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.743+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 shutdown_connections 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.743+0000 7fa7d5cd3700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fa7b80367e0 0x7fa7b8038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.744+0000 7fa7d5cd3700 1 --2- 172.21.15.33:0/2492235314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7d0102770 0x7fa7d0077c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.744+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 >> 172.21.15.33:0/2492235314 conn(0x7fa7d00fded0 msgr2=0x7fa7d00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.744+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 shutdown_connections 2024-02-15T22:31:38.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:37.744+0000 7fa7d5cd3700 1 -- 172.21.15.33:0/2492235314 wait complete. 2024-02-15T22:31:38.352 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-02-15T22:31:38.352 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 5... 2024-02-15T22:31:38.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:38 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2492235314' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T22:31:44.075 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: Active manager daemon smithi033.swohxi restarted 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: Activating manager daemon smithi033.swohxi 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: osdmap e2: 0 total, 0 up, 0 in 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: mgrmap e6: smithi033.swohxi(active, starting, since 0.00325722s) 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: Found migration_current of "None". Setting to last migration. 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:44.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:31:44.077 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:31:44.077 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:31:44.077 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:31:44.077 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:43 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:31:44.671 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:31:44.671 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-15T22:31:44.671 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-15T22:31:44.671 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.778+0000 7fd76e139700 1 Processor -- start 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.778+0000 7fd76e139700 1 -- start start 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.778+0000 7fd76e139700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.778+0000 7fd76e139700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681058a0 con 0x7fd768076c40 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39292/0 (socket says 172.21.15.33:39292) 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7677fe700 1 -- 172.21.15.33:0/255930507 learned_addr learned my addr 172.21.15.33:0/255930507 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7677fe700 1 -- 172.21.15.33:0/255930507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7681059e0 con 0x7fd768076c40 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7677fe700 1 --2- 172.21.15.33:0/255930507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768105360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd7580098e0 tx=0x7fd758009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa775d835b5e0e8f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7667fc700 1 -- 172.21.15.33:0/255930507 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd75800b860 con 0x7fd768076c40 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7667fc700 1 -- 172.21.15.33:0/255930507 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd75800be50 con 0x7fd768076c40 2024-02-15T22:31:44.672 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.779+0000 7fd7667fc700 1 -- 172.21.15.33:0/255930507 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd758010380 con 0x7fd768076c40 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.780+0000 7fd76e139700 1 -- 172.21.15.33:0/255930507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 msgr2=0x7fd768105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.780+0000 7fd76e139700 1 --2- 172.21.15.33:0/255930507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768105360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd7580098e0 tx=0x7fd758009250 comp rx=0 tx=0).stop 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.780+0000 7fd76e139700 1 -- 172.21.15.33:0/255930507 shutdown_connections 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.780+0000 7fd76e139700 1 --2- 172.21.15.33:0/255930507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768105360 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.780+0000 7fd76e139700 1 -- 172.21.15.33:0/255930507 >> 172.21.15.33:0/255930507 conn(0x7fd7680fcdd0 msgr2=0x7fd7680ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.780+0000 7fd76e139700 1 -- 172.21.15.33:0/255930507 shutdown_connections 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.780+0000 7fd76e139700 1 -- 172.21.15.33:0/255930507 wait complete. 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd76e139700 1 Processor -- start 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd76e139700 1 -- start start 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd76e139700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768117b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd76e139700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681180c0 con 0x7fd768076c40 2024-02-15T22:31:44.673 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd7677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768117b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd7677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768117b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39298/0 (socket says 172.21.15.33:39298) 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd7677fe700 1 -- 172.21.15.33:0/2960100098 learned_addr learned my addr 172.21.15.33:0/2960100098 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.781+0000 7fd7677fe700 1 -- 172.21.15.33:0/2960100098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580094f0 con 0x7fd768076c40 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.782+0000 7fd7677fe700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768117b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd758006b00 tx=0x7fd758009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.782+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7580107c0 con 0x7fd768076c40 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.782+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd758010db0 con 0x7fd768076c40 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.782+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7681182c0 con 0x7fd768076c40 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.782+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd75801acf0 con 0x7fd768076c40 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.782+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd768118f60 con 0x7fd768076c40 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.783+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fd7580193c0 con 0x7fd768076c40 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.783+0000 7fd75ffff700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:44.674 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.783+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 --> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd754039350 con 0x7fd754036790 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.783+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd75804a600 con 0x7fd768076c40 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.783+0000 7fd766ffd700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 msgr2=0x7fd754038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2250238044 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.783+0000 7fd766ffd700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.984+0000 7fd766ffd700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 msgr2=0x7fd754038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2250238044 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:38.984+0000 7fd766ffd700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:39.385+0000 7fd766ffd700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 msgr2=0x7fd754038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2250238044 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:39.385+0000 7fd766ffd700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:40.186+0000 7fd766ffd700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 msgr2=0x7fd754038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2250238044 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:40.186+0000 7fd766ffd700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:41.787+0000 7fd766ffd700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 msgr2=0x7fd754038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2250238044 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:41.787+0000 7fd766ffd700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:43.073+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7fd7580198a0 con 0x7fd768076c40 2024-02-15T22:31:44.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:43.073+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 msgr2=0x7fd754038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:43.073+0000 7fd75ffff700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.075+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7fd75804bff0 con 0x7fd768076c40 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.075+0000 7fd75ffff700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd754039fc0 0x7fd75403c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.075+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd754039350 con 0x7fd754039fc0 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.075+0000 7fd766ffd700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd754039fc0 0x7fd75403c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.076+0000 7fd766ffd700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd754039fc0 0x7fd75403c3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd7500039d0 tx=0x7fd750009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.077+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fd754039350 con 0x7fd754039fc0 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd768118750 con 0x7fd754039fc0 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd75ffff700 1 -- 172.21.15.33:0/2960100098 <== mgr.14118 v2:172.21.15.33:6800/2457159302 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd768118750 con 0x7fd754039fc0 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd754039fc0 msgr2=0x7fd75403c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd754039fc0 0x7fd75403c3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd7500039d0 tx=0x7fd750009350 comp rx=0 tx=0).stop 2024-02-15T22:31:44.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 msgr2=0x7fd768117b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768117b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd758006b00 tx=0x7fd758009250 comp rx=0 tx=0).stop 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 shutdown_connections 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd754039fc0 0x7fd75403c3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd768076c40 0x7fd768117b80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 --2- 172.21.15.33:0/2960100098 >> [v2:172.21.15.33:6800/2250238044,v1:172.21.15.33:6801/2250238044] conn(0x7fd754036790 0x7fd754038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.083+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 >> 172.21.15.33:0/2960100098 conn(0x7fd7680fcdd0 msgr2=0x7fd7680fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.084+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 shutdown_connections 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:44.084+0000 7fd76e139700 1 -- 172.21.15.33:0/2960100098 wait complete. 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 5 is available 2024-02-15T22:31:44.677 INFO:teuthology.orchestra.run.smithi033.stdout:Setting orchestrator backend to cephadm... 2024-02-15T22:31:45.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T22:31:45.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: mgrmap e7: smithi033.swohxi(active, since 1.00502s) 2024-02-15T22:31:45.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T22:31:45.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: [15/Feb/2024:22:31:44] ENGINE Bus STARTING 2024-02-15T22:31:45.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: [15/Feb/2024:22:31:44] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:31:45.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: [15/Feb/2024:22:31:44] ENGINE Bus STARTED 2024-02-15T22:31:45.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:45.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:45 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.032+0000 7f3209945700 1 Processor -- start 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.032+0000 7f3209945700 1 -- start start 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3209945700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3209945700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32041058c0 con 0x7f3204076c20 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3202ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3202ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39370/0 (socket says 172.21.15.33:39370) 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3202ffd700 1 -- 172.21.15.33:0/556066352 learned_addr learned my addr 172.21.15.33:0/556066352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:45.826 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3202ffd700 1 -- 172.21.15.33:0/556066352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204105a00 con 0x7f3204076c20 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3202ffd700 1 --2- 172.21.15.33:0/556066352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204105380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31f40098e0 tx=0x7f31f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4aeb29f000e1f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3201ffb700 1 -- 172.21.15.33:0/556066352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31f400b860 con 0x7f3204076c20 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3201ffb700 1 -- 172.21.15.33:0/556066352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f31f400be50 con 0x7f3204076c20 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.033+0000 7f3201ffb700 1 -- 172.21.15.33:0/556066352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31f4010380 con 0x7f3204076c20 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.034+0000 7f3209945700 1 -- 172.21.15.33:0/556066352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 msgr2=0x7f3204105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.034+0000 7f3209945700 1 --2- 172.21.15.33:0/556066352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204105380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31f40098e0 tx=0x7f31f4009250 comp rx=0 tx=0).stop 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.034+0000 7f3209945700 1 -- 172.21.15.33:0/556066352 shutdown_connections 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.034+0000 7f3209945700 1 --2- 172.21.15.33:0/556066352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204105380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.034+0000 7f3209945700 1 -- 172.21.15.33:0/556066352 >> 172.21.15.33:0/556066352 conn(0x7f32040fcdd0 msgr2=0x7f32040ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.034+0000 7f3209945700 1 -- 172.21.15.33:0/556066352 shutdown_connections 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.034+0000 7f3209945700 1 -- 172.21.15.33:0/556066352 wait complete. 2024-02-15T22:31:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3209945700 1 Processor -- start 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3209945700 1 -- start start 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3209945700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3209945700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204101280 con 0x7f3204076c20 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3202ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3202ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204102e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39378/0 (socket says 172.21.15.33:39378) 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3202ffd700 1 -- 172.21.15.33:0/3239959138 learned_addr learned my addr 172.21.15.33:0/3239959138 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3202ffd700 1 -- 172.21.15.33:0/3239959138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40094f0 con 0x7f3204076c20 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.035+0000 7f3202ffd700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204102e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006d40 tx=0x7f31f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.036+0000 7f31eb7fe700 1 -- 172.21.15.33:0/3239959138 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31f4010760 con 0x7f3204076c20 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.036+0000 7f31eb7fe700 1 -- 172.21.15.33:0/3239959138 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f31f4010d50 con 0x7f3204076c20 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.036+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3204101480 con 0x7f3204076c20 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.036+0000 7f31eb7fe700 1 -- 172.21.15.33:0/3239959138 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31f4024d20 con 0x7f3204076c20 2024-02-15T22:31:45.828 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.036+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3204101910 con 0x7f3204076c20 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.036+0000 7f31eb7fe700 1 -- 172.21.15.33:0/3239959138 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7f31f402e440 con 0x7f3204076c20 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.037+0000 7f31eb7fe700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f31ec0366b0 0x7f31ec038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.037+0000 7f31eb7fe700 1 -- 172.21.15.33:0/3239959138 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f31f404a5c0 con 0x7f3204076c20 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.037+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320410b640 con 0x7f3204076c20 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.037+0000 7f32027fc700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f31ec0366b0 0x7f31ec038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.037+0000 7f32027fc700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f31ec0366b0 0x7f31ec038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009990 tx=0x7f31f8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.042+0000 7f31eb7fe700 1 -- 172.21.15.33:0/3239959138 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f31f4018940 con 0x7f3204076c20 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.246+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f3204106810 con 0x7f31ec0366b0 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.252+0000 7f31eb7fe700 1 -- 172.21.15.33:0/3239959138 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3204106810 con 0x7f31ec0366b0 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f31ec0366b0 msgr2=0x7f31ec038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f31ec0366b0 0x7f31ec038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009990 tx=0x7f31f8006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 msgr2=0x7f3204102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204102e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006d40 tx=0x7f31f4009250 comp rx=0 tx=0).stop 2024-02-15T22:31:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 shutdown_connections 2024-02-15T22:31:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f31ec0366b0 0x7f31ec038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 --2- 172.21.15.33:0/3239959138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3204076c20 0x7f3204102e00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 >> 172.21.15.33:0/3239959138 conn(0x7f32040fcdd0 msgr2=0x7f32040fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.254+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 shutdown_connections 2024-02-15T22:31:45.830 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:45.255+0000 7f3209945700 1 -- 172.21.15.33:0/3239959138 wait complete. 2024-02-15T22:31:46.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:46 smithi033 ceph-mon[29033]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:46.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:46 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:46.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:46 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:31:46.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:46 smithi033 ceph-mon[29033]: mgrmap e8: smithi033.swohxi(active, since 3s) 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3b02934700 1 Processor -- start 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3b02934700 1 -- start start 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3b02934700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3b02934700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1030c0 con 0x7f3afc102770 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3afbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3afbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39388/0 (socket says 172.21.15.33:39388) 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3afbfff700 1 -- 172.21.15.33:0/1159928166 learned_addr learned my addr 172.21.15.33:0/1159928166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:47.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3afbfff700 1 -- 172.21.15.33:0/1159928166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc103200 con 0x7f3afc102770 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.267+0000 7f3afbfff700 1 --2- 172.21.15.33:0/1159928166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc102b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0098e0 tx=0x7f3aec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfec68acf3e99b10 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3afaffd700 1 -- 172.21.15.33:0/1159928166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3aec00b860 con 0x7f3afc102770 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3afaffd700 1 -- 172.21.15.33:0/1159928166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3aec00be50 con 0x7f3afc102770 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3afaffd700 1 -- 172.21.15.33:0/1159928166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3aec010380 con 0x7f3afc102770 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3b02934700 1 -- 172.21.15.33:0/1159928166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 msgr2=0x7f3afc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3b02934700 1 --2- 172.21.15.33:0/1159928166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc102b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0098e0 tx=0x7f3aec009250 comp rx=0 tx=0).stop 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3b02934700 1 -- 172.21.15.33:0/1159928166 shutdown_connections 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3b02934700 1 --2- 172.21.15.33:0/1159928166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc102b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3b02934700 1 -- 172.21.15.33:0/1159928166 >> 172.21.15.33:0/1159928166 conn(0x7f3afc0fded0 msgr2=0x7f3afc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3b02934700 1 -- 172.21.15.33:0/1159928166 shutdown_connections 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.268+0000 7f3b02934700 1 -- 172.21.15.33:0/1159928166 wait complete. 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.269+0000 7f3b02934700 1 Processor -- start 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.269+0000 7f3b02934700 1 -- start start 2024-02-15T22:31:47.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.269+0000 7f3b02934700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.269+0000 7f3b02934700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc111aa0 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.269+0000 7f3afbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.269+0000 7f3afbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39394/0 (socket says 172.21.15.33:39394) 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.269+0000 7f3afbfff700 1 -- 172.21.15.33:0/557152090 learned_addr learned my addr 172.21.15.33:0/557152090 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.270+0000 7f3afbfff700 1 -- 172.21.15.33:0/557152090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec0094f0 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.270+0000 7f3afbfff700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc111560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3aec000c00 tx=0x7f3aec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.270+0000 7f3af8ff9700 1 -- 172.21.15.33:0/557152090 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3aec0107c0 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.270+0000 7f3af8ff9700 1 -- 172.21.15.33:0/557152090 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3aec010db0 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.270+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc111ca0 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.270+0000 7f3af8ff9700 1 -- 172.21.15.33:0/557152090 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3aec01ad00 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.270+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc112940 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.271+0000 7f3af8ff9700 1 -- 172.21.15.33:0/557152090 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f3aec0193c0 con 0x7f3afc102770 2024-02-15T22:31:47.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.271+0000 7f3af8ff9700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f3ae4036790 0x7f3ae4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.271+0000 7f3af8ff9700 1 -- 172.21.15.33:0/557152090 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3aec04a6b0 con 0x7f3afc102770 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.271+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc05f5c0 con 0x7f3afc102770 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.271+0000 7f3afb7fe700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f3ae4036790 0x7f3ae4038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.271+0000 7f3afb7fe700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f3ae4036790 0x7f3ae4038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009990 tx=0x7f3af0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.276+0000 7f3af8ff9700 1 -- 172.21.15.33:0/557152090 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3aec0196c0 con 0x7f3afc102770 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.467+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f3afc100190 con 0x7f3ae4036790 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.468+0000 7f3af8ff9700 1 -- 172.21.15.33:0/557152090 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f3afc100190 con 0x7f3ae4036790 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f3ae4036790 msgr2=0x7f3ae4038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f3ae4036790 0x7f3ae4038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009990 tx=0x7f3af0006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 msgr2=0x7f3afc111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc111560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3aec000c00 tx=0x7f3aec009250 comp rx=0 tx=0).stop 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 shutdown_connections 2024-02-15T22:31:47.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f3ae4036790 0x7f3ae4038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:47.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 --2- 172.21.15.33:0/557152090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3afc102770 0x7f3afc111560 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:47.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 >> 172.21.15.33:0/557152090 conn(0x7f3afc0fded0 msgr2=0x7f3afc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:47.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 shutdown_connections 2024-02-15T22:31:47.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:46.470+0000 7f3b02934700 1 -- 172.21.15.33:0/557152090 wait complete. 2024-02-15T22:31:47.078 INFO:teuthology.orchestra.run.smithi033.stdout:Generating ssh key... 2024-02-15T22:31:47.477 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:47 smithi033 ceph-mon[29033]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:48.964 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f8dcec700 1 Processor -- start 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f8dcec700 1 -- start start 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f8dcec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f88077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f8dcec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88079110 con 0x7f2f88078d00 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f88077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f88077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55336/0 (socket says 172.21.15.33:55336) 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f877fe700 1 -- 172.21.15.33:0/975491381 learned_addr learned my addr 172.21.15.33:0/975491381 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.497+0000 7f2f877fe700 1 -- 172.21.15.33:0/975491381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88077750 con 0x7f2f88078d00 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f877fe700 1 --2- 172.21.15.33:0/975491381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f88077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f780098e0 tx=0x7f2f78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccf2a80d6a642a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f867fc700 1 -- 172.21.15.33:0/975491381 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f7800b860 con 0x7f2f88078d00 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f867fc700 1 -- 172.21.15.33:0/975491381 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2f7800be50 con 0x7f2f88078d00 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f867fc700 1 -- 172.21.15.33:0/975491381 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f78010380 con 0x7f2f88078d00 2024-02-15T22:31:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f8dcec700 1 -- 172.21.15.33:0/975491381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 msgr2=0x7f2f88077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f8dcec700 1 --2- 172.21.15.33:0/975491381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f88077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f780098e0 tx=0x7f2f78009250 comp rx=0 tx=0).stop 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f8dcec700 1 -- 172.21.15.33:0/975491381 shutdown_connections 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f8dcec700 1 --2- 172.21.15.33:0/975491381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f88077210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f8dcec700 1 -- 172.21.15.33:0/975491381 >> 172.21.15.33:0/975491381 conn(0x7f2f880fded0 msgr2=0x7f2f88100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.498+0000 7f2f8dcec700 1 -- 172.21.15.33:0/975491381 shutdown_connections 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.499+0000 7f2f8dcec700 1 -- 172.21.15.33:0/975491381 wait complete. 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.499+0000 7f2f8dcec700 1 Processor -- start 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.499+0000 7f2f8dcec700 1 -- start start 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.499+0000 7f2f8dcec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f881137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.499+0000 7f2f8dcec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88113d00 con 0x7f2f88078d00 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f881137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f881137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55344/0 (socket says 172.21.15.33:55344) 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f877fe700 1 -- 172.21.15.33:0/1562879058 learned_addr learned my addr 172.21.15.33:0/1562879058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f877fe700 1 -- 172.21.15.33:0/1562879058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780094f0 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f877fe700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f881137c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2f78003050 tx=0x7f2f78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f6ffff700 1 -- 172.21.15.33:0/1562879058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f78010760 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f6ffff700 1 -- 172.21.15.33:0/1562879058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2f78010d50 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f6ffff700 1 -- 172.21.15.33:0/1562879058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f7801ae20 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88113f00 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.500+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f88114ba0 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.501+0000 7f2f6ffff700 1 -- 172.21.15.33:0/1562879058 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f2f7802e440 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.501+0000 7f2f6ffff700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f2f700367e0 0x7f2f70038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.501+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8805f5c0 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.501+0000 7f2f6ffff700 1 -- 172.21.15.33:0/1562879058 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2f7804a5f0 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.501+0000 7f2f86ffd700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f2f700367e0 0x7f2f70038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.502+0000 7f2f86ffd700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f2f700367e0 0x7f2f70038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009990 tx=0x7f2f7c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.506+0000 7f2f6ffff700 1 -- 172.21.15.33:0/1562879058 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2f78018940 con 0x7f2f88078d00 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:47.699+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f88100210 con 0x7f2f700367e0 2024-02-15T22:31:48.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.357+0000 7f2f6ffff700 1 -- 172.21.15.33:0/1562879058 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2f88100210 con 0x7f2f700367e0 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f2f700367e0 msgr2=0x7f2f70038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f2f700367e0 0x7f2f70038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009990 tx=0x7f2f7c006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 msgr2=0x7f2f881137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f881137c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2f78003050 tx=0x7f2f78009250 comp rx=0 tx=0).stop 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 shutdown_connections 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f2f700367e0 0x7f2f70038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 --2- 172.21.15.33:0/1562879058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88078d00 0x7f2f881137c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 >> 172.21.15.33:0/1562879058 conn(0x7f2f880fded0 msgr2=0x7f2f880ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 shutdown_connections 2024-02-15T22:31:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:48.359+0000 7f2f8dcec700 1 -- 172.21.15.33:0/1562879058 wait complete. 2024-02-15T22:31:49.618 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:49 smithi033 ceph-mon[29033]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:49.618 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:49 smithi033 ceph-mon[29033]: Generating ssh key... 2024-02-15T22:31:49.618 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:49 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:49.618 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:49 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc/u5FMq0Ef6PX8z3NetgUr2lHTizD+9SEUbXfevmo3xpFYnBuw6ElUcIDx5vw4FP3GxUPS/1Ac/THx3kM41DvkRFRlKsy5COcKi1kF1EpGCpKs8E4WjV2oT/73pdIDvSC1lf8aom0xUrIXEfNTMk+eb6v+HGkid1wXuC+nUDItJp8agTSfvhMzdNO8TPnzMqmWcfX4+r2i/J6MPYOqmy5aOPB6QMm4xz49djS5HXgk/v0j67O7AqdBOisHQEKIu57MiR9s0i5+52So7hECQhqhWgTkEBb3+Z1U2QCEDxZDHC3ekLhgnBtrYm+ob22dORXAYW2XmbUE1I3/Lj4V0pvfdSpO+yayTRzhqDqf3e8VAJ2nn3ly/OYcnqR9gt9XCzHh4VhtQxH/jJM2YZw9MaWpohFmivfhCrj6R4qTgRVs8ANpZcwIGqmzZ+yZQWMzKOQQMPWVm/uae76PS+EsZTnCeneOekNW8sYUpxt5LqxG7wzmS/tdOcDsfF5lYemVhE= ceph-cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.411+0000 7f71f01f8700 1 Processor -- start 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.411+0000 7f71f01f8700 1 -- start start 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.411+0000 7f71f01f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e81077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.411+0000 7f71f01f8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e8103190 con 0x7f71e8076c00 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71edf94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e81077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71edf94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e81077a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55356/0 (socket says 172.21.15.33:55356) 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71edf94700 1 -- 172.21.15.33:0/4210556553 learned_addr learned my addr 172.21.15.33:0/4210556553 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:50.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71edf94700 1 -- 172.21.15.33:0/4210556553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8107ce0 con 0x7f71e8076c00 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71edf94700 1 --2- 172.21.15.33:0/4210556553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e81077a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71e00098e0 tx=0x7f71e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef736ebd4930269 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71ecf92700 1 -- 172.21.15.33:0/4210556553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71e000b860 con 0x7f71e8076c00 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71ecf92700 1 -- 172.21.15.33:0/4210556553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f71e000be50 con 0x7f71e8076c00 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.412+0000 7f71ecf92700 1 -- 172.21.15.33:0/4210556553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71e0010380 con 0x7f71e8076c00 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 -- 172.21.15.33:0/4210556553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 msgr2=0x7f71e81077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 --2- 172.21.15.33:0/4210556553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e81077a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71e00098e0 tx=0x7f71e0009250 comp rx=0 tx=0).stop 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 -- 172.21.15.33:0/4210556553 shutdown_connections 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 --2- 172.21.15.33:0/4210556553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e81077a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 -- 172.21.15.33:0/4210556553 >> 172.21.15.33:0/4210556553 conn(0x7f71e80fcdd0 msgr2=0x7f71e80ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 -- 172.21.15.33:0/4210556553 shutdown_connections 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 -- 172.21.15.33:0/4210556553 wait complete. 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 Processor -- start 2024-02-15T22:31:50.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.413+0000 7f71f01f8700 1 -- start start 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71f01f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e8113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71f01f8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e8113c60 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71edf94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e8113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71edf94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e8113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55372/0 (socket says 172.21.15.33:55372) 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71edf94700 1 -- 172.21.15.33:0/1777154840 learned_addr learned my addr 172.21.15.33:0/1777154840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71edf94700 1 -- 172.21.15.33:0/1777154840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00094f0 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71edf94700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e8113720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71e0006d40 tx=0x7f71e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71e67fc700 1 -- 172.21.15.33:0/1777154840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71e0010760 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e8113e60 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71e67fc700 1 -- 172.21.15.33:0/1777154840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f71e0010d50 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71e67fc700 1 -- 172.21.15.33:0/1777154840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71e0024d20 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.414+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e8114b00 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.415+0000 7f71e67fc700 1 -- 172.21.15.33:0/1777154840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f71e00108c0 con 0x7f71e8076c00 2024-02-15T22:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.415+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e805f5c0 con 0x7f71e8076c00 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.415+0000 7f71e67fc700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f71d0036790 0x7f71d0038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.415+0000 7f71e67fc700 1 -- 172.21.15.33:0/1777154840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f71e004a7c0 con 0x7f71e8076c00 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.416+0000 7f71ed793700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f71d0036790 0x7f71d0038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.416+0000 7f71ed793700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f71d0036790 0x7f71d0038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009990 tx=0x7f71dc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.420+0000 7f71e67fc700 1 -- 172.21.15.33:0/1777154840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f71e0023390 con 0x7f71e8076c00 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.618+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f71e80fe2e0 con 0x7f71d0036790 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.619+0000 7f71e67fc700 1 -- 172.21.15.33:0/1777154840 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f71e80fe2e0 con 0x7f71d0036790 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.620+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f71d0036790 msgr2=0x7f71d0038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f71d0036790 0x7f71d0038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009990 tx=0x7f71dc006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 msgr2=0x7f71e8113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e8113720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71e0006d40 tx=0x7f71e0009250 comp rx=0 tx=0).stop 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 shutdown_connections 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f71d0036790 0x7f71d0038c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:50.182 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 --2- 172.21.15.33:0/1777154840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8076c00 0x7f71e8113720 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:50.183 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 >> 172.21.15.33:0/1777154840 conn(0x7f71e80fcdd0 msgr2=0x7f71e80fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:50.183 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 shutdown_connections 2024-02-15T22:31:50.183 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:49.621+0000 7f71f01f8700 1 -- 172.21.15.33:0/1777154840 wait complete. 2024-02-15T22:31:50.183 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-15T22:31:50.183 INFO:teuthology.orchestra.run.smithi033.stdout:Adding key to root@localhost authorized_keys... 2024-02-15T22:31:50.183 INFO:teuthology.orchestra.run.smithi033.stdout:Adding host smithi033... 2024-02-15T22:31:50.768 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:50 smithi033 ceph-mon[29033]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:51.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:51 smithi033 ceph-mon[29033]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:51.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:51 smithi033 ceph-mon[29033]: Deploying cephadm binary to smithi033 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Added host 'smithi033' with addr '172.21.15.33' 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e90bb700 1 Processor -- start 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e90bb700 1 -- start start 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e90bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e4105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e90bb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41058c0 con 0x7fa0e4076c20 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e4105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e4105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55384/0 (socket says 172.21.15.33:55384) 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e2d9d700 1 -- 172.21.15.33:0/1605048191 learned_addr learned my addr 172.21.15.33:0/1605048191 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e2d9d700 1 -- 172.21.15.33:0/1605048191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4105a00 con 0x7fa0e4076c20 2024-02-15T22:31:53.463 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e2d9d700 1 --2- 172.21.15.33:0/1605048191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e4105380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40098e0 tx=0x7fa0d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e91ce42d2b44627 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.582+0000 7fa0e1d9b700 1 -- 172.21.15.33:0/1605048191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0d400b860 con 0x7fa0e4076c20 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e1d9b700 1 -- 172.21.15.33:0/1605048191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa0d400be50 con 0x7fa0e4076c20 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e1d9b700 1 -- 172.21.15.33:0/1605048191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0d4010380 con 0x7fa0e4076c20 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e90bb700 1 -- 172.21.15.33:0/1605048191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 msgr2=0x7fa0e4105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e90bb700 1 --2- 172.21.15.33:0/1605048191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e4105380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40098e0 tx=0x7fa0d4009250 comp rx=0 tx=0).stop 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e90bb700 1 -- 172.21.15.33:0/1605048191 shutdown_connections 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e90bb700 1 --2- 172.21.15.33:0/1605048191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e4105380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e90bb700 1 -- 172.21.15.33:0/1605048191 >> 172.21.15.33:0/1605048191 conn(0x7fa0e40fcdd0 msgr2=0x7fa0e40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e90bb700 1 -- 172.21.15.33:0/1605048191 shutdown_connections 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.583+0000 7fa0e90bb700 1 -- 172.21.15.33:0/1605048191 wait complete. 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e90bb700 1 Processor -- start 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e90bb700 1 -- start start 2024-02-15T22:31:53.464 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e90bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e41115a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e90bb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4111ae0 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e41115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e41115a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55400/0 (socket says 172.21.15.33:55400) 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e2d9d700 1 -- 172.21.15.33:0/2646331791 learned_addr learned my addr 172.21.15.33:0/2646331791 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e2d9d700 1 -- 172.21.15.33:0/2646331791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40094f0 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.584+0000 7fa0e2d9d700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e41115a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4003050 tx=0x7fa0d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.585+0000 7fa0cb7fe700 1 -- 172.21.15.33:0/2646331791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0d4010760 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.585+0000 7fa0cb7fe700 1 -- 172.21.15.33:0/2646331791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa0d4010d50 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.585+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e4111ce0 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.585+0000 7fa0cb7fe700 1 -- 172.21.15.33:0/2646331791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0d401ae20 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.585+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e4112980 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.585+0000 7fa0cb7fe700 1 -- 172.21.15.33:0/2646331791 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa0d40108c0 con 0x7fa0e4076c20 2024-02-15T22:31:53.465 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.586+0000 7fa0cb7fe700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fa0cc036770 0x7fa0cc038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.586+0000 7fa0cb7fe700 1 -- 172.21.15.33:0/2646331791 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa0d404a4f0 con 0x7fa0e4076c20 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.586+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e405f5c0 con 0x7fa0e4076c20 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.586+0000 7fa0e259c700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fa0cc036770 0x7fa0cc038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.586+0000 7fa0e259c700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fa0cc036770 0x7fa0cc038c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009990 tx=0x7fa0d8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.591+0000 7fa0cb7fe700 1 -- 172.21.15.33:0/2646331791 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa0d402e440 con 0x7fa0e4076c20 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:50.789+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0e40ff130 con 0x7fa0cc036770 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.873+0000 7fa0cb7fe700 1 -- 172.21.15.33:0/2646331791 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fa0e40ff130 con 0x7fa0cc036770 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fa0cc036770 msgr2=0x7fa0cc038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fa0cc036770 0x7fa0cc038c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009990 tx=0x7fa0d8006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 msgr2=0x7fa0e41115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e41115a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4003050 tx=0x7fa0d4009250 comp rx=0 tx=0).stop 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 shutdown_connections 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fa0cc036770 0x7fa0cc038c20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:53.466 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 --2- 172.21.15.33:0/2646331791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e4076c20 0x7fa0e41115a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:53.467 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 >> 172.21.15.33:0/2646331791 conn(0x7fa0e40fcdd0 msgr2=0x7fa0e40fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:53.467 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 shutdown_connections 2024-02-15T22:31:53.467 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:52.876+0000 7fa0e90bb700 1 -- 172.21.15.33:0/2646331791 wait complete. 2024-02-15T22:31:53.467 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying mon service with default placement... 2024-02-15T22:31:54.086 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:53 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:54.086 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:53 smithi033 ceph-mon[29033]: Added host smithi033 2024-02-15T22:31:54.086 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:53 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:31:54.657 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-15T22:31:54.657 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.874+0000 7ff19e4f7700 1 Processor -- start 2024-02-15T22:31:54.657 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.874+0000 7ff19e4f7700 1 -- start start 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff19e4f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff19e4f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981030c0 con 0x7ff198102770 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff197fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff197fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55402/0 (socket says 172.21.15.33:55402) 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff197fff700 1 -- 172.21.15.33:0/2299444486 learned_addr learned my addr 172.21.15.33:0/2299444486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff197fff700 1 -- 172.21.15.33:0/2299444486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198103200 con 0x7ff198102770 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff197fff700 1 --2- 172.21.15.33:0/2299444486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1880098e0 tx=0x7ff188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cbf64ef802f92a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff196ffd700 1 -- 172.21.15.33:0/2299444486 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff18800b860 con 0x7ff198102770 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff196ffd700 1 -- 172.21.15.33:0/2299444486 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff18800be50 con 0x7ff198102770 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.875+0000 7ff196ffd700 1 -- 172.21.15.33:0/2299444486 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff188010380 con 0x7ff198102770 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.876+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2299444486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 msgr2=0x7ff198102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:54.658 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.876+0000 7ff19e4f7700 1 --2- 172.21.15.33:0/2299444486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1880098e0 tx=0x7ff188009250 comp rx=0 tx=0).stop 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.876+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2299444486 shutdown_connections 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.876+0000 7ff19e4f7700 1 --2- 172.21.15.33:0/2299444486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198102b80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.876+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2299444486 >> 172.21.15.33:0/2299444486 conn(0x7ff1980fded0 msgr2=0x7ff198100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.876+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2299444486 shutdown_connections 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.876+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2299444486 wait complete. 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff19e4f7700 1 Processor -- start 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff19e4f7700 1 -- start start 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff19e4f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198111500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff19e4f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198111a40 con 0x7ff198102770 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff197fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198111500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff197fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198111500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55418/0 (socket says 172.21.15.33:55418) 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff197fff700 1 -- 172.21.15.33:0/2962545481 learned_addr learned my addr 172.21.15.33:0/2962545481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff197fff700 1 -- 172.21.15.33:0/2962545481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880094f0 con 0x7ff198102770 2024-02-15T22:31:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.877+0000 7ff197fff700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198111500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff18800b440 tx=0x7ff188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.878+0000 7ff194ff9700 1 -- 172.21.15.33:0/2962545481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1880107c0 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.878+0000 7ff194ff9700 1 -- 172.21.15.33:0/2962545481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff188010db0 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.878+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff198111c40 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.878+0000 7ff194ff9700 1 -- 172.21.15.33:0/2962545481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff18801ada0 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.878+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1981128e0 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.878+0000 7ff194ff9700 1 -- 172.21.15.33:0/2962545481 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ff18802e440 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.879+0000 7ff194ff9700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7ff1800367e0 0x7ff180038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.879+0000 7ff194ff9700 1 -- 172.21.15.33:0/2962545481 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff18804ae10 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.879+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19805f5c0 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.879+0000 7ff1977fe700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7ff1800367e0 0x7ff180038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.879+0000 7ff1977fe700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7ff1800367e0 0x7ff180038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009990 tx=0x7ff18c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:53.884+0000 7ff194ff9700 1 -- 172.21.15.33:0/2962545481 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff188010920 con 0x7ff198102770 2024-02-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.086+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1980ff380 con 0x7ff1800367e0 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.091+0000 7ff194ff9700 1 -- 172.21.15.33:0/2962545481 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff1980ff380 con 0x7ff1800367e0 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7ff1800367e0 msgr2=0x7ff180038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7ff1800367e0 0x7ff180038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009990 tx=0x7ff18c006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 msgr2=0x7ff198111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198111500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff18800b440 tx=0x7ff188009250 comp rx=0 tx=0).stop 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 shutdown_connections 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7ff1800367e0 0x7ff180038c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 --2- 172.21.15.33:0/2962545481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff198102770 0x7ff198111500 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 >> 172.21.15.33:0/2962545481 conn(0x7ff1980fded0 msgr2=0x7ff1980fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 shutdown_connections 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:54.093+0000 7ff19e4f7700 1 -- 172.21.15.33:0/2962545481 wait complete. 2024-02-15T22:31:54.661 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying mgr service with default placement... 2024-02-15T22:31:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:55 smithi033 ceph-mon[29033]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:55 smithi033 ceph-mon[29033]: Saving service mon spec with placement count:5 2024-02-15T22:31:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:55 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:56.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:56 smithi033 ceph-mon[29033]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:56.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:56 smithi033 ceph-mon[29033]: Saving service mgr spec with placement count:2 2024-02-15T22:31:56.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:56 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:56.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:56 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:56.579 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-15T22:31:56.579 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.332+0000 7f45ad3f3700 1 Processor -- start 2024-02-15T22:31:56.579 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45ad3f3700 1 -- start start 2024-02-15T22:31:56.579 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45ad3f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45ad3f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8101fc0 con 0x7f45a8101670 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55434/0 (socket says 172.21.15.33:55434) 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45a6ffd700 1 -- 172.21.15.33:0/3734268769 learned_addr learned my addr 172.21.15.33:0/3734268769 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45a6ffd700 1 -- 172.21.15.33:0/3734268769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8102100 con 0x7f45a8101670 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.333+0000 7f45a6ffd700 1 --2- 172.21.15.33:0/3734268769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8101a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45980098e0 tx=0x7f4598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686198881d81a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45a5ffb700 1 -- 172.21.15.33:0/3734268769 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f459800b860 con 0x7f45a8101670 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45a5ffb700 1 -- 172.21.15.33:0/3734268769 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f459800be50 con 0x7f45a8101670 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45a5ffb700 1 -- 172.21.15.33:0/3734268769 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4598010380 con 0x7f45a8101670 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45ad3f3700 1 -- 172.21.15.33:0/3734268769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 msgr2=0x7f45a8101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45ad3f3700 1 --2- 172.21.15.33:0/3734268769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8101a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45980098e0 tx=0x7f4598009250 comp rx=0 tx=0).stop 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45ad3f3700 1 -- 172.21.15.33:0/3734268769 shutdown_connections 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45ad3f3700 1 --2- 172.21.15.33:0/3734268769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8101a80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:56.580 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.334+0000 7f45ad3f3700 1 -- 172.21.15.33:0/3734268769 >> 172.21.15.33:0/3734268769 conn(0x7f45a80fcdd0 msgr2=0x7f45a80ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.335+0000 7f45ad3f3700 1 -- 172.21.15.33:0/3734268769 shutdown_connections 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.335+0000 7f45ad3f3700 1 -- 172.21.15.33:0/3734268769 wait complete. 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.335+0000 7f45ad3f3700 1 Processor -- start 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.335+0000 7f45ad3f3700 1 -- start start 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.335+0000 7f45ad3f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.335+0000 7f45ad3f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8076bf0 con 0x7f45a8101670 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.335+0000 7f45a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f45a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8114530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55440/0 (socket says 172.21.15.33:55440) 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f45a6ffd700 1 -- 172.21.15.33:0/158608543 learned_addr learned my addr 172.21.15.33:0/158608543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f45a6ffd700 1 -- 172.21.15.33:0/158608543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45980094f0 con 0x7f45a8101670 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f45a6ffd700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8114530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f459800b440 tx=0x7f4598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f458f7fe700 1 -- 172.21.15.33:0/158608543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4598010760 con 0x7f45a8101670 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a8076df0 con 0x7f45a8101670 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f458f7fe700 1 -- 172.21.15.33:0/158608543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4598010d50 con 0x7f45a8101670 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f458f7fe700 1 -- 172.21.15.33:0/158608543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4598010600 con 0x7f45a8101670 2024-02-15T22:31:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.336+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a8114c30 con 0x7f45a8101670 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.337+0000 7f458f7fe700 1 -- 172.21.15.33:0/158608543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f45980193c0 con 0x7f45a8101670 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.337+0000 7f458f7fe700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f4590036830 0x7f4590038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.337+0000 7f458f7fe700 1 -- 172.21.15.33:0/158608543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f459804a3f0 con 0x7f45a8101670 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.337+0000 7f45a67fc700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f4590036830 0x7f4590038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.337+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a810a570 con 0x7f45a8101670 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.338+0000 7f45a67fc700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f4590036830 0x7f4590038ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f459c009990 tx=0x7f459c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.342+0000 7f458f7fe700 1 -- 172.21.15.33:0/158608543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4598022930 con 0x7f45a8101670 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.546+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f45a81034e0 con 0x7f4590036830 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.551+0000 7f458f7fe700 1 -- 172.21.15.33:0/158608543 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f45a81034e0 con 0x7f4590036830 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f4590036830 msgr2=0x7f4590038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f4590036830 0x7f4590038ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f459c009990 tx=0x7f459c006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 msgr2=0x7f45a8114530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8114530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f459800b440 tx=0x7f4598009250 comp rx=0 tx=0).stop 2024-02-15T22:31:56.582 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 shutdown_connections 2024-02-15T22:31:56.583 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f4590036830 0x7f4590038ce0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:56.583 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 --2- 172.21.15.33:0/158608543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45a8101670 0x7f45a8114530 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:56.583 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 >> 172.21.15.33:0/158608543 conn(0x7f45a80fcdd0 msgr2=0x7f45a80fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:56.583 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 shutdown_connections 2024-02-15T22:31:56.583 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:55.553+0000 7f45ad3f3700 1 -- 172.21.15.33:0/158608543 wait complete. 2024-02-15T22:31:56.583 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying crash service with default placement... 2024-02-15T22:31:58.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:57 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:58.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:57 smithi033 ceph-mon[29033]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:31:58.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:57 smithi033 ceph-mon[29033]: Saving service crash spec with placement * 2024-02-15T22:31:58.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:57 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.021+0000 7fd55f74e700 1 Processor -- start 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.021+0000 7fd55f74e700 1 -- start start 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.021+0000 7fd55f74e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.021+0000 7fd55f74e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581030d0 con 0x7fd558102780 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd55d4ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd55d4ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56440/0 (socket says 172.21.15.33:56440) 2024-02-15T22:31:58.123 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd55d4ea700 1 -- 172.21.15.33:0/3544013569 learned_addr learned my addr 172.21.15.33:0/3544013569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd55d4ea700 1 -- 172.21.15.33:0/3544013569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558103210 con 0x7fd558102780 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd55d4ea700 1 --2- 172.21.15.33:0/3544013569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558102b90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5540098e0 tx=0x7fd554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbc16e9ec1bd3a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd54ffff700 1 -- 172.21.15.33:0/3544013569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd55400b860 con 0x7fd558102780 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd54ffff700 1 -- 172.21.15.33:0/3544013569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd55400be90 con 0x7fd558102780 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.022+0000 7fd54ffff700 1 -- 172.21.15.33:0/3544013569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5540103c0 con 0x7fd558102780 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 -- 172.21.15.33:0/3544013569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 msgr2=0x7fd558102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 --2- 172.21.15.33:0/3544013569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558102b90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5540098e0 tx=0x7fd554009250 comp rx=0 tx=0).stop 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 -- 172.21.15.33:0/3544013569 shutdown_connections 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 --2- 172.21.15.33:0/3544013569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558102b90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 -- 172.21.15.33:0/3544013569 >> 172.21.15.33:0/3544013569 conn(0x7fd5580fdf00 msgr2=0x7fd558100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 -- 172.21.15.33:0/3544013569 shutdown_connections 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 -- 172.21.15.33:0/3544013569 wait complete. 2024-02-15T22:31:58.124 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 Processor -- start 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.023+0000 7fd55f74e700 1 -- start start 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55f74e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55f74e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558111ad0 con 0x7fd558102780 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55d4ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55d4ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56450/0 (socket says 172.21.15.33:56450) 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55d4ea700 1 -- 172.21.15.33:0/812988710 learned_addr learned my addr 172.21.15.33:0/812988710 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55d4ea700 1 -- 172.21.15.33:0/812988710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540094f0 con 0x7fd558102780 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55d4ea700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558111590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5540090b0 tx=0x7fd554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd54dffb700 1 -- 172.21.15.33:0/812988710 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd554010840 con 0x7fd558102780 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd54dffb700 1 -- 172.21.15.33:0/812988710 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd554010e70 con 0x7fd558102780 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd54dffb700 1 -- 172.21.15.33:0/812988710 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd554024e40 con 0x7fd558102780 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.024+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd558111cd0 con 0x7fd558102780 2024-02-15T22:31:58.125 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.025+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd558112970 con 0x7fd558102780 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.025+0000 7fd54dffb700 1 -- 172.21.15.33:0/812988710 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fd554024430 con 0x7fd558102780 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.025+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55805f5c0 con 0x7fd558102780 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.025+0000 7fd54dffb700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd544036790 0x7fd544038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.026+0000 7fd54dffb700 1 -- 172.21.15.33:0/812988710 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd55404a760 con 0x7fd558102780 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.026+0000 7fd55cce9700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd544036790 0x7fd544038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.026+0000 7fd55cce9700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd544036790 0x7fd544038c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd548009990 tx=0x7fd548006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.030+0000 7fd54dffb700 1 -- 172.21.15.33:0/812988710 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd55402c930 con 0x7fd558102780 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.265+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5581001b0 con 0x7fd544036790 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.270+0000 7fd54dffb700 1 -- 172.21.15.33:0/812988710 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd5581001b0 con 0x7fd544036790 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd544036790 msgr2=0x7fd544038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd544036790 0x7fd544038c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd548009990 tx=0x7fd548006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 msgr2=0x7fd558111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558111590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5540090b0 tx=0x7fd554009250 comp rx=0 tx=0).stop 2024-02-15T22:31:58.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 shutdown_connections 2024-02-15T22:31:58.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fd544036790 0x7fd544038c40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:58.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 --2- 172.21.15.33:0/812988710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd558102780 0x7fd558111590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:58.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 >> 172.21.15.33:0/812988710 conn(0x7fd5580fdf00 msgr2=0x7fd5580ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:58.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 shutdown_connections 2024-02-15T22:31:58.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:57.272+0000 7fd55f74e700 1 -- 172.21.15.33:0/812988710 wait complete. 2024-02-15T22:31:58.127 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying prometheus service with default placement... 2024-02-15T22:31:59.364 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-15T22:31:59.364 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.521+0000 7f0322b59700 1 Processor -- start 2024-02-15T22:31:59.364 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.521+0000 7f0322b59700 1 -- start start 2024-02-15T22:31:59.364 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.521+0000 7f0322b59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:59.364 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.521+0000 7f0322b59700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c1030c0 con 0x7f031c102770 2024-02-15T22:31:59.364 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.521+0000 7f03208f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.521+0000 7f03208f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56460/0 (socket says 172.21.15.33:56460) 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.521+0000 7f03208f5700 1 -- 172.21.15.33:0/937367559 learned_addr learned my addr 172.21.15.33:0/937367559 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.522+0000 7f03208f5700 1 -- 172.21.15.33:0/937367559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c103200 con 0x7f031c102770 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.522+0000 7f03208f5700 1 --2- 172.21.15.33:0/937367559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c102b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f030c0098e0 tx=0x7f030c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1857e0e7017d9265 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.522+0000 7f031b7fe700 1 -- 172.21.15.33:0/937367559 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f030c00b860 con 0x7f031c102770 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.522+0000 7f031b7fe700 1 -- 172.21.15.33:0/937367559 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030c00be90 con 0x7f031c102770 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.522+0000 7f031b7fe700 1 -- 172.21.15.33:0/937367559 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f030c0103c0 con 0x7f031c102770 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 -- 172.21.15.33:0/937367559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 msgr2=0x7f031c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 --2- 172.21.15.33:0/937367559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c102b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f030c0098e0 tx=0x7f030c009250 comp rx=0 tx=0).stop 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 -- 172.21.15.33:0/937367559 shutdown_connections 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 --2- 172.21.15.33:0/937367559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c102b80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:59.365 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 -- 172.21.15.33:0/937367559 >> 172.21.15.33:0/937367559 conn(0x7f031c0fded0 msgr2=0x7f031c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 -- 172.21.15.33:0/937367559 shutdown_connections 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 -- 172.21.15.33:0/937367559 wait complete. 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 Processor -- start 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.523+0000 7f0322b59700 1 -- start start 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f0322b59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c1115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f0322b59700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c111af0 con 0x7f031c102770 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03208f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c1115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03208f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c1115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56470/0 (socket says 172.21.15.33:56470) 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03208f5700 1 -- 172.21.15.33:0/2360700834 learned_addr learned my addr 172.21.15.33:0/2360700834 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03208f5700 1 -- 172.21.15.33:0/2360700834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c0094f0 con 0x7f031c102770 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03208f5700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c1115b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f030c011680 tx=0x7f030c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03197fa700 1 -- 172.21.15.33:0/2360700834 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f030c010890 con 0x7f031c102770 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c111cf0 con 0x7f031c102770 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03197fa700 1 -- 172.21.15.33:0/2360700834 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030c010ec0 con 0x7f031c102770 2024-02-15T22:31:59.366 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f03197fa700 1 -- 172.21.15.33:0/2360700834 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f030c0243f0 con 0x7f031c102770 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.524+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c112990 con 0x7f031c102770 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.525+0000 7f03197fa700 1 -- 172.21.15.33:0/2360700834 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f030c01a8c0 con 0x7f031c102770 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.525+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031c05f5c0 con 0x7f031c102770 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.525+0000 7f03197fa700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f0304036790 0x7f0304038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.525+0000 7f03197fa700 1 -- 172.21.15.33:0/2360700834 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f030c04a260 con 0x7f031c102770 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.526+0000 7f031bfff700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f0304036790 0x7f0304038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.526+0000 7f031bfff700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f0304036790 0x7f0304038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0310009990 tx=0x7f0310006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.530+0000 7f03197fa700 1 -- 172.21.15.33:0/2360700834 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f030c02b8e0 con 0x7f031c102770 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.735+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f031c1001b0 con 0x7f0304036790 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.739+0000 7f03197fa700 1 -- 172.21.15.33:0/2360700834 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f031c1001b0 con 0x7f0304036790 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f0304036790 msgr2=0x7f0304038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f0304036790 0x7f0304038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0310009990 tx=0x7f0310006e40 comp rx=0 tx=0).stop 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 msgr2=0x7f031c1115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c1115b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f030c011680 tx=0x7f030c009250 comp rx=0 tx=0).stop 2024-02-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 shutdown_connections 2024-02-15T22:31:59.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f0304036790 0x7f0304038c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:59.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 --2- 172.21.15.33:0/2360700834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f031c102770 0x7f031c1115b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:31:59.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 >> 172.21.15.33:0/2360700834 conn(0x7f031c0fded0 msgr2=0x7f031c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:31:59.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 shutdown_connections 2024-02-15T22:31:59.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:58.741+0000 7f0322b59700 1 -- 172.21.15.33:0/2360700834 wait complete. 2024-02-15T22:31:59.368 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying grafana service with default placement... 2024-02-15T22:32:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:59 smithi033 ceph-mon[29033]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:59 smithi033 ceph-mon[29033]: Saving service prometheus spec with placement count:1 2024-02-15T22:32:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:31:59 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:00.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.809+0000 7f45da733700 1 Processor -- start 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.809+0000 7f45da733700 1 -- start start 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.809+0000 7f45da733700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d40771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.809+0000 7f45da733700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40790b0 con 0x7f45d4078ca0 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.809+0000 7f45d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d40771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.809+0000 7f45d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d40771b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56474/0 (socket says 172.21.15.33:56474) 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.809+0000 7f45d3fff700 1 -- 172.21.15.33:0/150673230 learned_addr learned my addr 172.21.15.33:0/150673230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.810+0000 7f45d3fff700 1 -- 172.21.15.33:0/150673230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40776f0 con 0x7f45d4078ca0 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.810+0000 7f45d3fff700 1 --2- 172.21.15.33:0/150673230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d40771b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45c40098e0 tx=0x7f45c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68965e712dccd330 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.810+0000 7f45d2ffd700 1 -- 172.21.15.33:0/150673230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45c400b860 con 0x7f45d4078ca0 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.810+0000 7f45d2ffd700 1 -- 172.21.15.33:0/150673230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45c400be90 con 0x7f45d4078ca0 2024-02-15T22:32:00.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.810+0000 7f45d2ffd700 1 -- 172.21.15.33:0/150673230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45c40103c0 con 0x7f45d4078ca0 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 -- 172.21.15.33:0/150673230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 msgr2=0x7f45d40771b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 --2- 172.21.15.33:0/150673230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d40771b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45c40098e0 tx=0x7f45c4009250 comp rx=0 tx=0).stop 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 -- 172.21.15.33:0/150673230 shutdown_connections 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 --2- 172.21.15.33:0/150673230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d40771b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 -- 172.21.15.33:0/150673230 >> 172.21.15.33:0/150673230 conn(0x7f45d40fded0 msgr2=0x7f45d4100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 -- 172.21.15.33:0/150673230 shutdown_connections 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 -- 172.21.15.33:0/150673230 wait complete. 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.811+0000 7f45da733700 1 Processor -- start 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45da733700 1 -- start start 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45da733700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d4113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45da733700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4113cb0 con 0x7f45d4078ca0 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d4113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d4113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56488/0 (socket says 172.21.15.33:56488) 2024-02-15T22:32:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45d3fff700 1 -- 172.21.15.33:0/3746738404 learned_addr learned my addr 172.21.15.33:0/3746738404 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45d3fff700 1 -- 172.21.15.33:0/3746738404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40094f0 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45d3fff700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d4113770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45c4003080 tx=0x7f45c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.812+0000 7f45d0ff9700 1 -- 172.21.15.33:0/3746738404 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45c4011920 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.813+0000 7f45d0ff9700 1 -- 172.21.15.33:0/3746738404 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45c4010d60 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.813+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d4113eb0 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.813+0000 7f45d0ff9700 1 -- 172.21.15.33:0/3746738404 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45c40243f0 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.813+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d4114b50 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.813+0000 7f45d0ff9700 1 -- 172.21.15.33:0/3746738404 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f45c402d3f0 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.813+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d405f5c0 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.814+0000 7f45d0ff9700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f45bc036790 0x7f45bc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.814+0000 7f45d0ff9700 1 -- 172.21.15.33:0/3746738404 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f45c404a4c0 con 0x7f45d4078ca0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.814+0000 7f45d37fe700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f45bc036790 0x7f45bc038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.814+0000 7f45d37fe700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f45bc036790 0x7f45bc038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009990 tx=0x7f45c8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:31:59.818+0000 7f45d0ff9700 1 -- 172.21.15.33:0/3746738404 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f45c402b8e0 con 0x7f45d4078ca0 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.031+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f45d4100190 con 0x7f45bc036790 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.036+0000 7f45d0ff9700 1 -- 172.21.15.33:0/3746738404 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f45d4100190 con 0x7f45bc036790 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.038+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f45bc036790 msgr2=0x7f45bc038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.038+0000 7f45da733700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f45bc036790 0x7f45bc038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009990 tx=0x7f45c8006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.038+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 msgr2=0x7f45d4113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.038+0000 7f45da733700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d4113770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45c4003080 tx=0x7f45c4009250 comp rx=0 tx=0).stop 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.039+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 shutdown_connections 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.039+0000 7f45da733700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f45bc036790 0x7f45bc038c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.039+0000 7f45da733700 1 --2- 172.21.15.33:0/3746738404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d4078ca0 0x7f45d4113770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.039+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 >> 172.21.15.33:0/3746738404 conn(0x7f45d40fded0 msgr2=0x7f45d40ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.039+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 shutdown_connections 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:00.039+0000 7f45da733700 1 -- 172.21.15.33:0/3746738404 wait complete. 2024-02-15T22:32:00.700 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying node-exporter service with default placement... 2024-02-15T22:32:01.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:00 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:01.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:00 smithi033 ceph-mon[29033]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:01.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:00 smithi033 ceph-mon[29033]: Saving service grafana spec with placement count:1 2024-02-15T22:32:01.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:00 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:01.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:00 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:01.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-15T22:32:01.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.157+0000 7fb2a7b56700 1 Processor -- start 2024-02-15T22:32:01.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.157+0000 7fb2a7b56700 1 -- start start 2024-02-15T22:32:01.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.157+0000 7fb2a7b56700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:01.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.157+0000 7fb2a7b56700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a01030c0 con 0x7fb2a0102770 2024-02-15T22:32:01.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.157+0000 7fb2a58f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.157+0000 7fb2a58f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56504/0 (socket says 172.21.15.33:56504) 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.157+0000 7fb2a58f2700 1 -- 172.21.15.33:0/3356411096 learned_addr learned my addr 172.21.15.33:0/3356411096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.158+0000 7fb2a58f2700 1 -- 172.21.15.33:0/3356411096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0103200 con 0x7fb2a0102770 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.158+0000 7fb2a58f2700 1 --2- 172.21.15.33:0/3356411096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0102b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0098e0 tx=0x7fb29c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98093d542d105f6c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.158+0000 7fb2a48f0700 1 -- 172.21.15.33:0/3356411096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb29c00b860 con 0x7fb2a0102770 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.158+0000 7fb2a48f0700 1 -- 172.21.15.33:0/3356411096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb29c00be90 con 0x7fb2a0102770 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.158+0000 7fb2a48f0700 1 -- 172.21.15.33:0/3356411096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb29c0103c0 con 0x7fb2a0102770 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.158+0000 7fb2a7b56700 1 -- 172.21.15.33:0/3356411096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 msgr2=0x7fb2a0102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.158+0000 7fb2a7b56700 1 --2- 172.21.15.33:0/3356411096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0102b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0098e0 tx=0x7fb29c009250 comp rx=0 tx=0).stop 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 -- 172.21.15.33:0/3356411096 shutdown_connections 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 --2- 172.21.15.33:0/3356411096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0102b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 -- 172.21.15.33:0/3356411096 >> 172.21.15.33:0/3356411096 conn(0x7fb2a00fded0 msgr2=0x7fb2a0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 -- 172.21.15.33:0/3356411096 shutdown_connections 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 -- 172.21.15.33:0/3356411096 wait complete. 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 Processor -- start 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 -- start start 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a7b56700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0077190 con 0x7fb2a0102770 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a58f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a58f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56510/0 (socket says 172.21.15.33:56510) 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.159+0000 7fb2a58f2700 1 -- 172.21.15.33:0/596967746 learned_addr learned my addr 172.21.15.33:0/596967746 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.160+0000 7fb2a58f2700 1 -- 172.21.15.33:0/596967746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0094f0 con 0x7fb2a0102770 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.160+0000 7fb2a58f2700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0078d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0090b0 tx=0x7fb29c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.160+0000 7fb2967fc700 1 -- 172.21.15.33:0/596967746 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb29c010840 con 0x7fb2a0102770 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.160+0000 7fb2967fc700 1 -- 172.21.15.33:0/596967746 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb29c010e70 con 0x7fb2a0102770 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.160+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a0077390 con 0x7fb2a0102770 2024-02-15T22:32:01.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.160+0000 7fb2967fc700 1 -- 172.21.15.33:0/596967746 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb29c024e40 con 0x7fb2a0102770 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.160+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a0077820 con 0x7fb2a0102770 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.161+0000 7fb2967fc700 1 -- 172.21.15.33:0/596967746 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fb29c01a510 con 0x7fb2a0102770 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.161+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a004bed0 con 0x7fb2a0102770 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.161+0000 7fb2967fc700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fb28c036740 0x7fb28c038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.161+0000 7fb2967fc700 1 -- 172.21.15.33:0/596967746 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb29c04a9d0 con 0x7fb2a0102770 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.161+0000 7fb2a50f1700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fb28c036740 0x7fb28c038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.162+0000 7fb2a50f1700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fb28c036740 0x7fb28c038bf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb290009990 tx=0x7fb290006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.166+0000 7fb2967fc700 1 -- 172.21.15.33:0/596967746 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb29c0109a0 con 0x7fb2a0102770 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.383+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2a0078060 con 0x7fb28c036740 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.387+0000 7fb2967fc700 1 -- 172.21.15.33:0/596967746 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb2a0078060 con 0x7fb28c036740 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.389+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fb28c036740 msgr2=0x7fb28c038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.389+0000 7fb2a7b56700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fb28c036740 0x7fb28c038bf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb290009990 tx=0x7fb290006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.389+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 msgr2=0x7fb2a0078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.389+0000 7fb2a7b56700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0078d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0090b0 tx=0x7fb29c009250 comp rx=0 tx=0).stop 2024-02-15T22:32:01.951 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.390+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 shutdown_connections 2024-02-15T22:32:01.951 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.390+0000 7fb2a7b56700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fb28c036740 0x7fb28c038bf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:01.951 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.390+0000 7fb2a7b56700 1 --2- 172.21.15.33:0/596967746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a0102770 0x7fb2a0078d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:01.951 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.390+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 >> 172.21.15.33:0/596967746 conn(0x7fb2a00fded0 msgr2=0x7fb2a00ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:01.951 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.390+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 shutdown_connections 2024-02-15T22:32:01.951 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:01.390+0000 7fb2a7b56700 1 -- 172.21.15.33:0/596967746 wait complete. 2024-02-15T22:32:01.951 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying alertmanager service with default placement... 2024-02-15T22:32:02.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:02 smithi033 ceph-mon[29033]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:02.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:02 smithi033 ceph-mon[29033]: Saving service node-exporter spec with placement * 2024-02-15T22:32:02.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:02 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.775+0000 7f9c021fc700 1 Processor -- start 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.775+0000 7f9c021fc700 1 -- start start 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.775+0000 7f9c021fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.775+0000 7f9c021fc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc1058c0 con 0x7f9bfc071480 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.776+0000 7f9bfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.776+0000 7f9bfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56522/0 (socket says 172.21.15.33:56522) 2024-02-15T22:32:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.776+0000 7f9bfb7fe700 1 -- 172.21.15.33:0/572535960 learned_addr learned my addr 172.21.15.33:0/572535960 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.776+0000 7f9bfb7fe700 1 -- 172.21.15.33:0/572535960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc105a00 con 0x7f9bfc071480 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.776+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/572535960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc105380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098e0 tx=0x7f9bec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d8dee2a0c004a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.776+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/572535960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec00b860 con 0x7f9bfc071480 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/572535960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bec00be90 con 0x7f9bfc071480 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/572535960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec0103c0 con 0x7f9bfc071480 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9c021fc700 1 -- 172.21.15.33:0/572535960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 msgr2=0x7f9bfc105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9c021fc700 1 --2- 172.21.15.33:0/572535960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc105380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098e0 tx=0x7f9bec009250 comp rx=0 tx=0).stop 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9c021fc700 1 -- 172.21.15.33:0/572535960 shutdown_connections 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9c021fc700 1 --2- 172.21.15.33:0/572535960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc105380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9c021fc700 1 -- 172.21.15.33:0/572535960 >> 172.21.15.33:0/572535960 conn(0x7f9bfc0fcdd0 msgr2=0x7f9bfc0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9c021fc700 1 -- 172.21.15.33:0/572535960 shutdown_connections 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.777+0000 7f9c021fc700 1 -- 172.21.15.33:0/572535960 wait complete. 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.778+0000 7f9c021fc700 1 Processor -- start 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.778+0000 7f9c021fc700 1 -- start start 2024-02-15T22:32:03.760 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.778+0000 7f9c021fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc1115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.778+0000 7f9c021fc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc111af0 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.778+0000 7f9bfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc1115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.778+0000 7f9bfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc1115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56530/0 (socket says 172.21.15.33:56530) 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.778+0000 7f9bfb7fe700 1 -- 172.21.15.33:0/2175040188 learned_addr learned my addr 172.21.15.33:0/2175040188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.779+0000 7f9bfb7fe700 1 -- 172.21.15.33:0/2175040188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0094f0 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.779+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc1115b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bec006d40 tx=0x7f9bec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.779+0000 7f9be3fff700 1 -- 172.21.15.33:0/2175040188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec010840 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.779+0000 7f9be3fff700 1 -- 172.21.15.33:0/2175040188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bec010e70 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.779+0000 7f9be3fff700 1 -- 172.21.15.33:0/2175040188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec024ea0 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.779+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc111cf0 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.779+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc112990 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.780+0000 7f9be3fff700 1 -- 172.21.15.33:0/2175040188 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f9bec024780 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.780+0000 7f9be3fff700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f9be4036740 0x7f9be4038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.780+0000 7f9be3fff700 1 -- 172.21.15.33:0/2175040188 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9bec04a6c0 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.780+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc05f5c0 con 0x7f9bfc071480 2024-02-15T22:32:03.761 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.780+0000 7f9bfaffd700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f9be4036740 0x7f9be4038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.780+0000 7f9bfaffd700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f9be4036740 0x7f9be4038bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009990 tx=0x7f9bf0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.785+0000 7f9be3fff700 1 -- 172.21.15.33:0/2175040188 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9bec02c930 con 0x7f9bfc071480 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.990+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bfc0ff0d0 con 0x7f9be4036740 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.997+0000 7f9be3fff700 1 -- 172.21.15.33:0/2175040188 <== mgr.14118 v2:172.21.15.33:6800/2457159302 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f9bfc0ff0d0 con 0x7f9be4036740 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.998+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f9be4036740 msgr2=0x7f9be4038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.998+0000 7f9c021fc700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f9be4036740 0x7f9be4038bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009990 tx=0x7f9bf0006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 msgr2=0x7f9bfc1115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc1115b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bec006d40 tx=0x7f9bec009250 comp rx=0 tx=0).stop 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 shutdown_connections 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f9be4036740 0x7f9be4038bf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 --2- 172.21.15.33:0/2175040188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc071480 0x7f9bfc1115b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 >> 172.21.15.33:0/2175040188 conn(0x7f9bfc0fcdd0 msgr2=0x7f9bfc0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 shutdown_connections 2024-02-15T22:32:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:02.999+0000 7f9c021fc700 1 -- 172.21.15.33:0/2175040188 wait complete. 2024-02-15T22:32:04.146 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:03 smithi033 ceph-mon[29033]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:04.146 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:03 smithi033 ceph-mon[29033]: Saving service alertmanager spec with placement count:1 2024-02-15T22:32:04.146 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:03 smithi033 ceph-mon[29033]: from='mgr.14118 172.21.15.33:0/2419609181' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:04.146 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:03 smithi033 ceph-mon[29033]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:04.999 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.197+0000 7fee61c77700 1 Processor -- start 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.197+0000 7fee61c77700 1 -- start start 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.197+0000 7fee61c77700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c104250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.197+0000 7fee61c77700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c104790 con 0x7fee5c103e40 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.197+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.197+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56532/0 (socket says 172.21.15.33:56532) 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.197+0000 7fee5b7fe700 1 -- 172.21.15.33:0/1281466442 learned_addr learned my addr 172.21.15.33:0/1281466442 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.198+0000 7fee5b7fe700 1 -- 172.21.15.33:0/1281466442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c1048d0 con 0x7fee5c103e40 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.198+0000 7fee5b7fe700 1 --2- 172.21.15.33:0/1281466442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c104250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0098e0 tx=0x7fee4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e211a8266243ad8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.198+0000 7fee5affd700 1 -- 172.21.15.33:0/1281466442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee4c00b860 con 0x7fee5c103e40 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.198+0000 7fee5affd700 1 -- 172.21.15.33:0/1281466442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee4c00be90 con 0x7fee5c103e40 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.198+0000 7fee5affd700 1 -- 172.21.15.33:0/1281466442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee4c0103c0 con 0x7fee5c103e40 2024-02-15T22:32:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 -- 172.21.15.33:0/1281466442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 msgr2=0x7fee5c104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:05.003 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 --2- 172.21.15.33:0/1281466442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c104250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0098e0 tx=0x7fee4c009250 comp rx=0 tx=0).stop 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 -- 172.21.15.33:0/1281466442 shutdown_connections 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 --2- 172.21.15.33:0/1281466442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c104250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 -- 172.21.15.33:0/1281466442 >> 172.21.15.33:0/1281466442 conn(0x7fee5c0fc580 msgr2=0x7fee5c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 -- 172.21.15.33:0/1281466442 shutdown_connections 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 -- 172.21.15.33:0/1281466442 wait complete. 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 Processor -- start 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 -- start start 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c111840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.199+0000 7fee61c77700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c111d80 con 0x7fee5c103e40 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c111840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:05.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c111840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56536/0 (socket says 172.21.15.33:56536) 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee5b7fe700 1 -- 172.21.15.33:0/2745176063 learned_addr learned my addr 172.21.15.33:0/2745176063 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee5b7fe700 1 -- 172.21.15.33:0/2745176063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0094f0 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee5b7fe700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c111840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee4c011650 tx=0x7fee4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee58ff9700 1 -- 172.21.15.33:0/2745176063 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee4c010890 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee58ff9700 1 -- 172.21.15.33:0/2745176063 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee4c010ec0 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c111f80 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee58ff9700 1 -- 172.21.15.33:0/2745176063 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee4c01a430 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.200+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c112c20 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.201+0000 7fee58ff9700 1 -- 172.21.15.33:0/2745176063 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fee4c0109f0 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.201+0000 7fee58ff9700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fee48036790 0x7fee48038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.201+0000 7fee58ff9700 1 -- 172.21.15.33:0/2745176063 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fee4c04a4a0 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.201+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c05f5c0 con 0x7fee5c103e40 2024-02-15T22:32:05.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.201+0000 7fee53fff700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fee48036790 0x7fee48038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.202+0000 7fee53fff700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fee48036790 0x7fee48038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee44009990 tx=0x7fee44006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.206+0000 7fee58ff9700 1 -- 172.21.15.33:0/2745176063 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fee4c0247a0 con 0x7fee5c103e40 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.396+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fee5c1013e0 con 0x7fee5c103e40 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.401+0000 7fee58ff9700 1 -- 172.21.15.33:0/2745176063 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fee4c022330 con 0x7fee5c103e40 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.403+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fee48036790 msgr2=0x7fee48038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.403+0000 7fee61c77700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fee48036790 0x7fee48038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee44009990 tx=0x7fee44006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.403+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 msgr2=0x7fee5c111840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.403+0000 7fee61c77700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c111840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee4c011650 tx=0x7fee4c009250 comp rx=0 tx=0).stop 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.404+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 shutdown_connections 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.404+0000 7fee61c77700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fee48036790 0x7fee48038c40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.404+0000 7fee61c77700 1 --2- 172.21.15.33:0/2745176063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee5c103e40 0x7fee5c111840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.404+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 >> 172.21.15.33:0/2745176063 conn(0x7fee5c0fc580 msgr2=0x7fee5c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.404+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 shutdown_connections 2024-02-15T22:32:05.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:04.404+0000 7fee61c77700 1 -- 172.21.15.33:0/2745176063 wait complete. 2024-02-15T22:32:05.608 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:05 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2745176063' entity='client.admin' 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.405+0000 7fc64a9df700 1 Processor -- start 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.405+0000 7fc64a9df700 1 -- start start 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.406+0000 7fc64a9df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.406+0000 7fc64a9df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6441058a0 con 0x7fc6440714a0 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.406+0000 7fc643fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.406+0000 7fc643fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56542/0 (socket says 172.21.15.33:56542) 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.406+0000 7fc643fff700 1 -- 172.21.15.33:0/3680052716 learned_addr learned my addr 172.21.15.33:0/3680052716 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:06.189 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.406+0000 7fc643fff700 1 -- 172.21.15.33:0/3680052716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6441059e0 con 0x7fc6440714a0 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.406+0000 7fc643fff700 1 --2- 172.21.15.33:0/3680052716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644105360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6340098e0 tx=0x7fc634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cddb3844b0b6db server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.407+0000 7fc642ffd700 1 -- 172.21.15.33:0/3680052716 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc63400b860 con 0x7fc6440714a0 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.407+0000 7fc642ffd700 1 -- 172.21.15.33:0/3680052716 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc63400be90 con 0x7fc6440714a0 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.407+0000 7fc642ffd700 1 -- 172.21.15.33:0/3680052716 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6340103c0 con 0x7fc6440714a0 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.408+0000 7fc64a9df700 1 -- 172.21.15.33:0/3680052716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 msgr2=0x7fc644105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.408+0000 7fc64a9df700 1 --2- 172.21.15.33:0/3680052716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644105360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6340098e0 tx=0x7fc634009250 comp rx=0 tx=0).stop 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.408+0000 7fc64a9df700 1 -- 172.21.15.33:0/3680052716 shutdown_connections 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.408+0000 7fc64a9df700 1 --2- 172.21.15.33:0/3680052716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644105360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.408+0000 7fc64a9df700 1 -- 172.21.15.33:0/3680052716 >> 172.21.15.33:0/3680052716 conn(0x7fc6440fcdd0 msgr2=0x7fc6440ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.408+0000 7fc64a9df700 1 -- 172.21.15.33:0/3680052716 shutdown_connections 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.408+0000 7fc64a9df700 1 -- 172.21.15.33:0/3680052716 wait complete. 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc64a9df700 1 Processor -- start 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc64a9df700 1 -- start start 2024-02-15T22:32:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc64a9df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc64a9df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc644101260 con 0x7fc6440714a0 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc643fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc643fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56550/0 (socket says 172.21.15.33:56550) 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc643fff700 1 -- 172.21.15.33:0/264236130 learned_addr learned my addr 172.21.15.33:0/264236130 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.409+0000 7fc643fff700 1 -- 172.21.15.33:0/264236130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340094f0 con 0x7fc6440714a0 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.410+0000 7fc643fff700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644102de0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc6340094c0 tx=0x7fc634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.410+0000 7fc640ff9700 1 -- 172.21.15.33:0/264236130 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc634010890 con 0x7fc6440714a0 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.410+0000 7fc640ff9700 1 -- 172.21.15.33:0/264236130 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc634010ec0 con 0x7fc6440714a0 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.410+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc644101460 con 0x7fc6440714a0 2024-02-15T22:32:06.191 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.410+0000 7fc640ff9700 1 -- 172.21.15.33:0/264236130 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6340243f0 con 0x7fc6440714a0 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.410+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6441018f0 con 0x7fc6440714a0 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.411+0000 7fc640ff9700 1 -- 172.21.15.33:0/264236130 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fc63402d3f0 con 0x7fc6440714a0 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.411+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64404bed0 con 0x7fc6440714a0 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.411+0000 7fc640ff9700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc62c036790 0x7fc62c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.411+0000 7fc640ff9700 1 -- 172.21.15.33:0/264236130 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc63404a3b0 con 0x7fc6440714a0 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.411+0000 7fc6437fe700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc62c036790 0x7fc62c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.412+0000 7fc6437fe700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc62c036790 0x7fc62c038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc638009990 tx=0x7fc638006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:06.192 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.416+0000 7fc640ff9700 1 -- 172.21.15.33:0/264236130 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc63402b8e0 con 0x7fc6440714a0 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.608+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc644101e30 con 0x7fc6440714a0 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.613+0000 7fc640ff9700 1 -- 172.21.15.33:0/264236130 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc63402b2f0 con 0x7fc6440714a0 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc62c036790 msgr2=0x7fc62c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc62c036790 0x7fc62c038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc638009990 tx=0x7fc638006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 msgr2=0x7fc644102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644102de0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc6340094c0 tx=0x7fc634009250 comp rx=0 tx=0).stop 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 shutdown_connections 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc62c036790 0x7fc62c038c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 --2- 172.21.15.33:0/264236130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6440714a0 0x7fc644102de0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 >> 172.21.15.33:0/264236130 conn(0x7fc6440fcdd0 msgr2=0x7fc6440fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 shutdown_connections 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:05.615+0000 7fc64a9df700 1 -- 172.21.15.33:0/264236130 wait complete. 2024-02-15T22:32:06.193 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling the dashboard module... 2024-02-15T22:32:06.509 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:06 smithi033 ceph-mon[29033]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:06.509 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:06 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/264236130' entity='client.admin' 2024-02-15T22:32:07.721 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:07 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2782139070' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-15T22:32:07.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.614+0000 7f43f0baa700 1 Processor -- start 2024-02-15T22:32:07.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.614+0000 7f43f0baa700 1 -- start start 2024-02-15T22:32:07.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.614+0000 7f43f0baa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:07.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43f0baa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec101fc0 con 0x7f43ec101670 2024-02-15T22:32:07.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43ea59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43ea59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53270/0 (socket says 172.21.15.33:53270) 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43ea59c700 1 -- 172.21.15.33:0/3250109973 learned_addr learned my addr 172.21.15.33:0/3250109973 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43ea59c700 1 -- 172.21.15.33:0/3250109973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec102100 con 0x7f43ec101670 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43ea59c700 1 --2- 172.21.15.33:0/3250109973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec101a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00bb80 tx=0x7f43dc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecfd083ffc79c7a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43e959a700 1 -- 172.21.15.33:0/3250109973 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43dc00dd00 con 0x7f43ec101670 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43e959a700 1 -- 172.21.15.33:0/3250109973 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43dc00de60 con 0x7f43ec101670 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.615+0000 7f43e959a700 1 -- 172.21.15.33:0/3250109973 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43dc018920 con 0x7f43ec101670 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.616+0000 7f43f0baa700 1 -- 172.21.15.33:0/3250109973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 msgr2=0x7f43ec101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.616+0000 7f43f0baa700 1 --2- 172.21.15.33:0/3250109973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec101a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00bb80 tx=0x7f43dc00b4f0 comp rx=0 tx=0).stop 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.616+0000 7f43f0baa700 1 -- 172.21.15.33:0/3250109973 shutdown_connections 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.616+0000 7f43f0baa700 1 --2- 172.21.15.33:0/3250109973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec101a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.616+0000 7f43f0baa700 1 -- 172.21.15.33:0/3250109973 >> 172.21.15.33:0/3250109973 conn(0x7f43ec0fcdd0 msgr2=0x7f43ec0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:07.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.616+0000 7f43f0baa700 1 -- 172.21.15.33:0/3250109973 shutdown_connections 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.616+0000 7f43f0baa700 1 -- 172.21.15.33:0/3250109973 wait complete. 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43f0baa700 1 Processor -- start 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43f0baa700 1 -- start start 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43f0baa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec10f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43f0baa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec10fb40 con 0x7f43ec101670 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43ea59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec10f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43ea59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec10f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53286/0 (socket says 172.21.15.33:53286) 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43ea59c700 1 -- 172.21.15.33:0/2782139070 learned_addr learned my addr 172.21.15.33:0/2782139070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43ea59c700 1 -- 172.21.15.33:0/2782139070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc00b790 con 0x7f43ec101670 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43ea59c700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec10f600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0106a0 tx=0x7f43dc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.617+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43dc010b40 con 0x7f43ec101670 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.618+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43dc01d050 con 0x7f43ec101670 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.618+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec10fd40 con 0x7f43ec101670 2024-02-15T22:32:07.990 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.618+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43dc022590 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.618+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec1109e0 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.618+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f43dc0226f0 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.618+0000 7f43daffd700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f43d40367e0 0x7f43d4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.619+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f43dc014070 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.618+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec05f5c0 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.619+0000 7f43e9d9b700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f43d40367e0 0x7f43d4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.619+0000 7f43e9d9b700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f43d40367e0 0x7f43d4038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009990 tx=0x7f43e0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.623+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f43dc00ebb0 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:06.869+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f43ec04bed0 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.411+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f43dc010ca0 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.413+0000 7f43daffd700 1 -- 172.21.15.33:0/2782139070 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f43dc0216f0 con 0x7f43ec101670 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f43d40367e0 msgr2=0x7f43d4038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:07.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f43d40367e0 0x7f43d4038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009990 tx=0x7f43e0006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 msgr2=0x7f43ec10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec10f600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0106a0 tx=0x7f43dc00b4f0 comp rx=0 tx=0).stop 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 shutdown_connections 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f43d40367e0 0x7f43d4038c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 --2- 172.21.15.33:0/2782139070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ec101670 0x7f43ec10f600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 >> 172.21.15.33:0/2782139070 conn(0x7f43ec0fcdd0 msgr2=0x7f43ec1063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 shutdown_connections 2024-02-15T22:32:07.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:07.415+0000 7f43f0baa700 1 -- 172.21.15.33:0/2782139070 wait complete. 2024-02-15T22:32:08.718 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:08 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2782139070' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-15T22:32:08.718 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:08 smithi033 ceph-mon[29033]: mgrmap e9: smithi033.swohxi(active, since 24s) 2024-02-15T22:32:09.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:32:09.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-15T22:32:09.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "smithi033.swohxi", 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.558+0000 7f163a356700 1 Processor -- start 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.558+0000 7f163a356700 1 -- start start 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.558+0000 7f163a356700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.558+0000 7f163a356700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16341030c0 con 0x7f1634102770 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.558+0000 7f1633fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.558+0000 7f1633fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53322/0 (socket says 172.21.15.33:53322) 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.558+0000 7f1633fff700 1 -- 172.21.15.33:0/853300509 learned_addr learned my addr 172.21.15.33:0/853300509 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.559+0000 7f1633fff700 1 -- 172.21.15.33:0/853300509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634103200 con 0x7f1634102770 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.559+0000 7f1633fff700 1 --2- 172.21.15.33:0/853300509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634102b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16240098e0 tx=0x7f1624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324d6191a34c5f74 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.559+0000 7f1632ffd700 1 -- 172.21.15.33:0/853300509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f162400b860 con 0x7f1634102770 2024-02-15T22:32:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.559+0000 7f1632ffd700 1 -- 172.21.15.33:0/853300509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f162400be90 con 0x7f1634102770 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.559+0000 7f1632ffd700 1 -- 172.21.15.33:0/853300509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16240103c0 con 0x7f1634102770 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 -- 172.21.15.33:0/853300509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 msgr2=0x7f1634102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 --2- 172.21.15.33:0/853300509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634102b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16240098e0 tx=0x7f1624009250 comp rx=0 tx=0).stop 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 -- 172.21.15.33:0/853300509 shutdown_connections 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 --2- 172.21.15.33:0/853300509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634102b80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 -- 172.21.15.33:0/853300509 >> 172.21.15.33:0/853300509 conn(0x7f16340fded0 msgr2=0x7f1634100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 -- 172.21.15.33:0/853300509 shutdown_connections 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 -- 172.21.15.33:0/853300509 wait complete. 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.560+0000 7f163a356700 1 Processor -- start 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f163a356700 1 -- start start 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f163a356700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634111540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f163a356700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1634111a80 con 0x7f1634102770 2024-02-15T22:32:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f1633fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634111540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f1633fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634111540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53324/0 (socket says 172.21.15.33:53324) 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f1633fff700 1 -- 172.21.15.33:0/593834063 learned_addr learned my addr 172.21.15.33:0/593834063 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f1633fff700 1 -- 172.21.15.33:0/593834063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240094f0 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f1633fff700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634111540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1624006b00 tx=0x7f1624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.561+0000 7f1630ff9700 1 -- 172.21.15.33:0/593834063 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16240109a0 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.562+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1634111c80 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.562+0000 7f1630ff9700 1 -- 172.21.15.33:0/593834063 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f162401a430 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.562+0000 7f1630ff9700 1 -- 172.21.15.33:0/593834063 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16240245b0 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.562+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1634112920 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.562+0000 7f1630ff9700 1 -- 172.21.15.33:0/593834063 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f1624024830 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.563+0000 7f1630ff9700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 0x7f1620038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.563+0000 7f1630ff9700 1 -- 172.21.15.33:0/593834063 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f162404f600 con 0x7f1634102770 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.563+0000 7f16337fe700 1 -- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 msgr2=0x7f1620038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2457159302 2024-02-15T22:32:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.563+0000 7f16337fe700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 0x7f1620038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.563+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163405f5c0 con 0x7f1634102770 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.568+0000 7f1630ff9700 1 -- 172.21.15.33:0/593834063 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1624021d00 con 0x7f1634102770 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.764+0000 7f16337fe700 1 -- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 msgr2=0x7f1620038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2457159302 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.764+0000 7f16337fe700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 0x7f1620038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.814+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f1634112b60 con 0x7f1634102770 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.815+0000 7f1630ff9700 1 -- 172.21.15.33:0/593834063 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f16240212a0 con 0x7f1634102770 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 msgr2=0x7f1620038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 0x7f1620038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 msgr2=0x7f1634111540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634111540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1624006b00 tx=0x7f1624009250 comp rx=0 tx=0).stop 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 shutdown_connections 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7f1620036830 0x7f1620038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:09.542 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 --2- 172.21.15.33:0/593834063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1634102770 0x7f1634111540 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:09.543 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 >> 172.21.15.33:0/593834063 conn(0x7f16340fded0 msgr2=0x7f16340fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:09.543 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 shutdown_connections 2024-02-15T22:32:09.543 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:08.817+0000 7f163a356700 1 -- 172.21.15.33:0/593834063 wait complete. 2024-02-15T22:32:09.543 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-02-15T22:32:09.543 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 9... 2024-02-15T22:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:09 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/593834063' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: Active manager daemon smithi033.swohxi restarted 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: Activating manager daemon smithi033.swohxi 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: osdmap e3: 0 total, 0 up, 0 in 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: mgrmap e10: smithi033.swohxi(active, starting, since 0.00335149s) 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:32:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:32:14.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:32:14.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:32:14.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:32:14.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:14 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:32:15.443 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:15 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:32:15.443 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:15 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:32:15.443 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:15 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:15.443 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:15 smithi033 ceph-mon[29033]: mgrmap e11: smithi033.swohxi(active, since 1.0058s) 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.005+0000 7fc90d4ec700 1 Processor -- start 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc90d4ec700 1 -- start start 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc90d4ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9080771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc90d4ec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9080790b0 con 0x7fc908078ca0 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc906ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9080771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:15.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc906ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9080771b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53334/0 (socket says 172.21.15.33:53334) 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc906ffd700 1 -- 172.21.15.33:0/438494852 learned_addr learned my addr 172.21.15.33:0/438494852 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc906ffd700 1 -- 172.21.15.33:0/438494852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9080776f0 con 0x7fc908078ca0 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc906ffd700 1 --2- 172.21.15.33:0/438494852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9080771b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80098e0 tx=0x7fc8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90484e8eb550509 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc905ffb700 1 -- 172.21.15.33:0/438494852 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8f800b860 con 0x7fc908078ca0 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc905ffb700 1 -- 172.21.15.33:0/438494852 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8f800be90 con 0x7fc908078ca0 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.006+0000 7fc905ffb700 1 -- 172.21.15.33:0/438494852 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8f80103c0 con 0x7fc908078ca0 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.007+0000 7fc90d4ec700 1 -- 172.21.15.33:0/438494852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 msgr2=0x7fc9080771b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.007+0000 7fc90d4ec700 1 --2- 172.21.15.33:0/438494852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9080771b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80098e0 tx=0x7fc8f8009250 comp rx=0 tx=0).stop 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.007+0000 7fc90d4ec700 1 -- 172.21.15.33:0/438494852 shutdown_connections 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.007+0000 7fc90d4ec700 1 --2- 172.21.15.33:0/438494852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9080771b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.007+0000 7fc90d4ec700 1 -- 172.21.15.33:0/438494852 >> 172.21.15.33:0/438494852 conn(0x7fc9080fdf00 msgr2=0x7fc908100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.007+0000 7fc90d4ec700 1 -- 172.21.15.33:0/438494852 shutdown_connections 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.007+0000 7fc90d4ec700 1 -- 172.21.15.33:0/438494852 wait complete. 2024-02-15T22:32:15.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc90d4ec700 1 Processor -- start 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc90d4ec700 1 -- start start 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc90d4ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9081137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc90d4ec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908113d10 con 0x7fc908078ca0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc906ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9081137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc906ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9081137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53336/0 (socket says 172.21.15.33:53336) 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc906ffd700 1 -- 172.21.15.33:0/891447881 learned_addr learned my addr 172.21.15.33:0/891447881 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.008+0000 7fc906ffd700 1 -- 172.21.15.33:0/891447881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80094f0 con 0x7fc908078ca0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.009+0000 7fc906ffd700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9081137d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80094c0 tx=0x7fc8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.009+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8f8010890 con 0x7fc908078ca0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.009+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc908113f10 con 0x7fc908078ca0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.009+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8f8010ec0 con 0x7fc908078ca0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.009+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8f80243f0 con 0x7fc908078ca0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.009+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc908114bb0 con 0x7fc908078ca0 2024-02-15T22:32:15.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.010+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fc8f802d3f0 con 0x7fc908078ca0 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.010+0000 7fc8ff7fe700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.010+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 --> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8f40393f0 con 0x7fc8f4036830 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.010+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc8f804a290 con 0x7fc908078ca0 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.010+0000 7fc9067fc700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 msgr2=0x7fc8f4038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2457159302 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.010+0000 7fc9067fc700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.211+0000 7fc9067fc700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 msgr2=0x7fc8f4038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2457159302 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.211+0000 7fc9067fc700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.612+0000 7fc9067fc700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 msgr2=0x7fc8f4038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2457159302 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:10.612+0000 7fc9067fc700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:11.413+0000 7fc9067fc700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 msgr2=0x7fc8f4038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2457159302 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:11.413+0000 7fc9067fc700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:13.014+0000 7fc9067fc700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 msgr2=0x7fc8f4038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2457159302 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:13.014+0000 7fc9067fc700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-15T22:32:15.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:14.165+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7fc8f801a7e0 con 0x7fc908078ca0 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:14.165+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 msgr2=0x7fc8f4038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:14.165+0000 7fc8ff7fe700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.167+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7fc8f8023d90 con 0x7fc908078ca0 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.167+0000 7fc8ff7fe700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fc8f403a070 0x7fc8f403c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.167+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8f40393f0 con 0x7fc8f403a070 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.167+0000 7fc9067fc700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fc8f403a070 0x7fc8f403c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.168+0000 7fc9067fc700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fc8f403a070 0x7fc8f403c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00039d0 tx=0x7fc8f0009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.168+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mgr.14160 v2:172.21.15.33:6800/3209613080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fc8f40393f0 con 0x7fc8f403a070 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.174+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc9081143a0 con 0x7fc8f403a070 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc8ff7fe700 1 -- 172.21.15.33:0/891447881 <== mgr.14160 v2:172.21.15.33:6800/3209613080 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fc9081143a0 con 0x7fc8f403a070 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fc8f403a070 msgr2=0x7fc8f403c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fc8f403a070 0x7fc8f403c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00039d0 tx=0x7fc8f0009350 comp rx=0 tx=0).stop 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 msgr2=0x7fc9081137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9081137d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80094c0 tx=0x7fc8f8009250 comp rx=0 tx=0).stop 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 shutdown_connections 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fc8f403a070 0x7fc8f403c450 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc908078ca0 0x7fc9081137d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 --2- 172.21.15.33:0/891447881 >> [v2:172.21.15.33:6800/2457159302,v1:172.21.15.33:6801/2457159302] conn(0x7fc8f4036830 0x7fc8f4038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 >> 172.21.15.33:0/891447881 conn(0x7fc9080fdf00 msgr2=0x7fc9080ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 shutdown_connections 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:15.175+0000 7fc90d4ec700 1 -- 172.21.15.33:0/891447881 wait complete. 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 9 is available 2024-02-15T22:32:15.989 INFO:teuthology.orchestra.run.smithi033.stdout:Generating a dashboard self-signed certificate... 2024-02-15T22:32:16.377 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:16 smithi033 ceph-mon[29033]: [15/Feb/2024:22:32:14] ENGINE Bus STARTING 2024-02-15T22:32:16.377 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:16 smithi033 ceph-mon[29033]: [15/Feb/2024:22:32:14] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:32:16.377 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:16 smithi033 ceph-mon[29033]: [15/Feb/2024:22:32:14] ENGINE Bus STARTED 2024-02-15T22:32:16.377 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:16 smithi033 ceph-mon[29033]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T22:32:16.377 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:16 smithi033 ceph-mon[29033]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T22:32:16.378 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:16 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:17.346 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64cedec700 1 Processor -- start 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64cedec700 1 -- start start 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64cedec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8104190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64cedec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c81046d0 con 0x7f64c8103d80 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64ccb88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64ccb88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8104190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52050/0 (socket says 172.21.15.33:52050) 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64ccb88700 1 -- 172.21.15.33:0/346010479 learned_addr learned my addr 172.21.15.33:0/346010479 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.474+0000 7f64ccb88700 1 -- 172.21.15.33:0/346010479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8104810 con 0x7f64c8103d80 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64ccb88700 1 --2- 172.21.15.33:0/346010479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8104190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0098e0 tx=0x7f64bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da971cd6838c6b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64c77fe700 1 -- 172.21.15.33:0/346010479 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64bc00b860 con 0x7f64c8103d80 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64c77fe700 1 -- 172.21.15.33:0/346010479 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64bc00be90 con 0x7f64c8103d80 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64c77fe700 1 -- 172.21.15.33:0/346010479 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64bc0103c0 con 0x7f64c8103d80 2024-02-15T22:32:17.347 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64cedec700 1 -- 172.21.15.33:0/346010479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 msgr2=0x7f64c8104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64cedec700 1 --2- 172.21.15.33:0/346010479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8104190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0098e0 tx=0x7f64bc009250 comp rx=0 tx=0).stop 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64cedec700 1 -- 172.21.15.33:0/346010479 shutdown_connections 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64cedec700 1 --2- 172.21.15.33:0/346010479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8104190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64cedec700 1 -- 172.21.15.33:0/346010479 >> 172.21.15.33:0/346010479 conn(0x7f64c80fc580 msgr2=0x7f64c80fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64cedec700 1 -- 172.21.15.33:0/346010479 shutdown_connections 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.475+0000 7f64cedec700 1 -- 172.21.15.33:0/346010479 wait complete. 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64cedec700 1 Processor -- start 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64cedec700 1 -- start start 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64cedec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8111870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64cedec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8111db0 con 0x7f64c8103d80 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64ccb88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8111870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64ccb88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8111870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52066/0 (socket says 172.21.15.33:52066) 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64ccb88700 1 -- 172.21.15.33:0/4201427501 learned_addr learned my addr 172.21.15.33:0/4201427501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.476+0000 7f64ccb88700 1 -- 172.21.15.33:0/4201427501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0094f0 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.477+0000 7f64ccb88700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8111870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64bc006b00 tx=0x7f64bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.477+0000 7f64c57fa700 1 -- 172.21.15.33:0/4201427501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64bc0109a0 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.477+0000 7f64c57fa700 1 -- 172.21.15.33:0/4201427501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64bc01a430 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.477+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c8111fb0 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.477+0000 7f64c57fa700 1 -- 172.21.15.33:0/4201427501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64bc0245b0 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.477+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c8112c50 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.478+0000 7f64c57fa700 1 -- 172.21.15.33:0/4201427501 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7f64bc024830 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.478+0000 7f64c57fa700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f64b80366b0 0x7f64b8038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.478+0000 7f64c57fa700 1 -- 172.21.15.33:0/4201427501 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f64bc04a850 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.478+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c805f5c0 con 0x7f64c8103d80 2024-02-15T22:32:17.349 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.478+0000 7f64c7fff700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f64b80366b0 0x7f64b8038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.478+0000 7f64c7fff700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f64b80366b0 0x7f64b8038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009990 tx=0x7f64b4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.483+0000 7f64c57fa700 1 -- 172.21.15.33:0/4201427501 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f64bc0189a0 con 0x7f64c8103d80 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.684+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f64c80008d0 con 0x7f64b80366b0 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.766+0000 7f64c57fa700 1 -- 172.21.15.33:0/4201427501 <== mgr.14160 v2:172.21.15.33:6800/3209613080 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f64c80008d0 con 0x7f64b80366b0 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.768+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f64b80366b0 msgr2=0x7f64b8038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.768+0000 7f64cedec700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f64b80366b0 0x7f64b8038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009990 tx=0x7f64b4006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.768+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 msgr2=0x7f64c8111870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.768+0000 7f64cedec700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8111870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64bc006b00 tx=0x7f64bc009250 comp rx=0 tx=0).stop 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.768+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 shutdown_connections 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.769+0000 7f64cedec700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f64b80366b0 0x7f64b8038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.769+0000 7f64cedec700 1 --2- 172.21.15.33:0/4201427501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64c8103d80 0x7f64c8111870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.769+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 >> 172.21.15.33:0/4201427501 conn(0x7f64c80fc580 msgr2=0x7f64c80fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.769+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 shutdown_connections 2024-02-15T22:32:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:16.769+0000 7f64cedec700 1 -- 172.21.15.33:0/4201427501 wait complete. 2024-02-15T22:32:17.351 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial admin user... 2024-02-15T22:32:18.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:17 smithi033 ceph-mon[29033]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:18.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:17 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:18.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:17 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:18.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:17 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:18.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:17 smithi033 ceph-mon[29033]: mgrmap e12: smithi033.swohxi(active, since 2s) 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$2lC6c8qOD2uY4.ye3QWdgODeToBx3higmFsERVkCGHrNQIQ8LpibC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708036338, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.807+0000 7f29c71e9700 1 Processor -- start 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.807+0000 7f29c71e9700 1 -- start start 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.807+0000 7f29c71e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c00771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.807+0000 7f29c71e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00790f0 con 0x7f29c0078ce0 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.807+0000 7f29c4f85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c00771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.807+0000 7f29c4f85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c00771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52070/0 (socket says 172.21.15.33:52070) 2024-02-15T22:32:18.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.807+0000 7f29c4f85700 1 -- 172.21.15.33:0/2776308509 learned_addr learned my addr 172.21.15.33:0/2776308509 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.808+0000 7f29c4f85700 1 -- 172.21.15.33:0/2776308509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0077730 con 0x7f29c0078ce0 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.808+0000 7f29c4f85700 1 --2- 172.21.15.33:0/2776308509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c00771f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098e0 tx=0x7f29b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8816393a35b78fe6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.808+0000 7f29bf7fe700 1 -- 172.21.15.33:0/2776308509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29b400b860 con 0x7f29c0078ce0 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.808+0000 7f29bf7fe700 1 -- 172.21.15.33:0/2776308509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29b400be90 con 0x7f29c0078ce0 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.808+0000 7f29bf7fe700 1 -- 172.21.15.33:0/2776308509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29b40103c0 con 0x7f29c0078ce0 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 -- 172.21.15.33:0/2776308509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 msgr2=0x7f29c00771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 --2- 172.21.15.33:0/2776308509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c00771f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098e0 tx=0x7f29b4009250 comp rx=0 tx=0).stop 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 -- 172.21.15.33:0/2776308509 shutdown_connections 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 --2- 172.21.15.33:0/2776308509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c00771f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 -- 172.21.15.33:0/2776308509 >> 172.21.15.33:0/2776308509 conn(0x7f29c00fdf00 msgr2=0x7f29c0100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 -- 172.21.15.33:0/2776308509 shutdown_connections 2024-02-15T22:32:18.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 -- 172.21.15.33:0/2776308509 wait complete. 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 Processor -- start 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.809+0000 7f29c71e9700 1 -- start start 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.810+0000 7f29c71e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c01137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.810+0000 7f29c71e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0113d20 con 0x7f29c0078ce0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.810+0000 7f29c4f85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c01137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.810+0000 7f29c4f85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c01137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52072/0 (socket says 172.21.15.33:52072) 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.810+0000 7f29c4f85700 1 -- 172.21.15.33:0/4175882160 learned_addr learned my addr 172.21.15.33:0/4175882160 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.810+0000 7f29c4f85700 1 -- 172.21.15.33:0/4175882160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094f0 con 0x7f29c0078ce0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.810+0000 7f29c4f85700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c01137e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29b40094c0 tx=0x7f29b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.811+0000 7f29bd7fa700 1 -- 172.21.15.33:0/4175882160 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29b4010890 con 0x7f29c0078ce0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.811+0000 7f29bd7fa700 1 -- 172.21.15.33:0/4175882160 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29b4010ec0 con 0x7f29c0078ce0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.811+0000 7f29bd7fa700 1 -- 172.21.15.33:0/4175882160 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29b40243f0 con 0x7f29c0078ce0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.811+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c0113f20 con 0x7f29c0078ce0 2024-02-15T22:32:18.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.811+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c0114bc0 con 0x7f29c0078ce0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.812+0000 7f29bd7fa700 1 -- 172.21.15.33:0/4175882160 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f29b402d3f0 con 0x7f29c0078ce0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.812+0000 7f29bd7fa700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f29b00367e0 0x7f29b0038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.812+0000 7f29bd7fa700 1 -- 172.21.15.33:0/4175882160 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f29b401a7e0 con 0x7f29c0078ce0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.812+0000 7f29bffff700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f29b00367e0 0x7f29b0038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.812+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c005f5c0 con 0x7f29c0078ce0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.813+0000 7f29bffff700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f29b00367e0 0x7f29b0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009990 tx=0x7f29ac006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:17.817+0000 7f29bd7fa700 1 -- 172.21.15.33:0/4175882160 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f29b4019700 con 0x7f29c0078ce0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.033+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f29c004bed0 con 0x7f29b00367e0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.279+0000 7f29bd7fa700 1 -- 172.21.15.33:0/4175882160 <== mgr.14160 v2:172.21.15.33:6800/3209613080 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f29c004bed0 con 0x7f29b00367e0 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f29b00367e0 msgr2=0x7f29b0038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f29b00367e0 0x7f29b0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009990 tx=0x7f29ac006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 msgr2=0x7f29c01137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:18.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c01137e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29b40094c0 tx=0x7f29b4009250 comp rx=0 tx=0).stop 2024-02-15T22:32:18.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 shutdown_connections 2024-02-15T22:32:18.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f29b00367e0 0x7f29b0038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:18.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 --2- 172.21.15.33:0/4175882160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c0078ce0 0x7f29c01137e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:18.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 >> 172.21.15.33:0/4175882160 conn(0x7f29c00fdf00 msgr2=0x7f29c00ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:18.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 shutdown_connections 2024-02-15T22:32:18.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:18.281+0000 7f29c71e9700 1 -- 172.21.15.33:0/4175882160 wait complete. 2024-02-15T22:32:18.912 INFO:teuthology.orchestra.run.smithi033.stdout:Fetching dashboard port number... 2024-02-15T22:32:19.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:19 smithi033 ceph-mon[29033]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:19.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:19 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:20.359 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:20 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/912611286' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 8443 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.312+0000 7f6b1d648700 1 Processor -- start 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.312+0000 7f6b1d648700 1 -- start start 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.312+0000 7f6b1d648700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.312+0000 7f6b1d648700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181030c0 con 0x7f6b18102770 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52074/0 (socket says 172.21.15.33:52074) 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b16ffd700 1 -- 172.21.15.33:0/2636341764 learned_addr learned my addr 172.21.15.33:0/2636341764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b16ffd700 1 -- 172.21.15.33:0/2636341764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18103200 con 0x7f6b18102770 2024-02-15T22:32:20.368 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b16ffd700 1 --2- 172.21.15.33:0/2636341764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18102b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b080098e0 tx=0x7f6b08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8fb8c76d1e8d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b15ffb700 1 -- 172.21.15.33:0/2636341764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b0800b860 con 0x7f6b18102770 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b15ffb700 1 -- 172.21.15.33:0/2636341764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b0800be90 con 0x7f6b18102770 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.313+0000 7f6b15ffb700 1 -- 172.21.15.33:0/2636341764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b080103c0 con 0x7f6b18102770 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.314+0000 7f6b1d648700 1 -- 172.21.15.33:0/2636341764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 msgr2=0x7f6b18102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.314+0000 7f6b1d648700 1 --2- 172.21.15.33:0/2636341764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18102b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b080098e0 tx=0x7f6b08009250 comp rx=0 tx=0).stop 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.314+0000 7f6b1d648700 1 -- 172.21.15.33:0/2636341764 shutdown_connections 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.314+0000 7f6b1d648700 1 --2- 172.21.15.33:0/2636341764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18102b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.314+0000 7f6b1d648700 1 -- 172.21.15.33:0/2636341764 >> 172.21.15.33:0/2636341764 conn(0x7f6b180fded0 msgr2=0x7f6b18100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.314+0000 7f6b1d648700 1 -- 172.21.15.33:0/2636341764 shutdown_connections 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.314+0000 7f6b1d648700 1 -- 172.21.15.33:0/2636341764 wait complete. 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b1d648700 1 Processor -- start 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b1d648700 1 -- start start 2024-02-15T22:32:20.369 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b1d648700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b1d648700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18111aa0 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52082/0 (socket says 172.21.15.33:52082) 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b16ffd700 1 -- 172.21.15.33:0/912611286 learned_addr learned my addr 172.21.15.33:0/912611286 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.315+0000 7f6b16ffd700 1 -- 172.21.15.33:0/912611286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080094f0 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.316+0000 7f6b16ffd700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18111560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b08011650 tx=0x7f6b08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.316+0000 7f6b0f7fe700 1 -- 172.21.15.33:0/912611286 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b08010890 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.316+0000 7f6b0f7fe700 1 -- 172.21.15.33:0/912611286 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b08010ec0 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.316+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b18111ca0 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.316+0000 7f6b0f7fe700 1 -- 172.21.15.33:0/912611286 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b080243f0 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.316+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18112940 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.317+0000 7f6b0f7fe700 1 -- 172.21.15.33:0/912611286 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f6b08024620 con 0x7f6b18102770 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.317+0000 7f6b0f7fe700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f6b04036830 0x7f6b04038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:20.370 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.317+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1805f5c0 con 0x7f6b18102770 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.317+0000 7f6b0f7fe700 1 -- 172.21.15.33:0/912611286 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6b0804b840 con 0x7f6b18102770 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.317+0000 7f6b167fc700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f6b04036830 0x7f6b04038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.317+0000 7f6b167fc700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f6b04036830 0x7f6b04038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009990 tx=0x7f6b00006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.322+0000 7f6b0f7fe700 1 -- 172.21.15.33:0/912611286 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6b0802e440 con 0x7f6b18102770 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.527+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f6b1804bed0 con 0x7f6b18102770 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.527+0000 7f6b0f7fe700 1 -- 172.21.15.33:0/912611286 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f6b08049030 con 0x7f6b18102770 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f6b04036830 msgr2=0x7f6b04038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f6b04036830 0x7f6b04038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009990 tx=0x7f6b00006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 msgr2=0x7f6b18111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18111560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b08011650 tx=0x7f6b08009250 comp rx=0 tx=0).stop 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 shutdown_connections 2024-02-15T22:32:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f6b04036830 0x7f6b04038ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:20.372 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 --2- 172.21.15.33:0/912611286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b18102770 0x7f6b18111560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:20.372 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 >> 172.21.15.33:0/912611286 conn(0x7f6b180fded0 msgr2=0x7f6b180fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:20.372 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 shutdown_connections 2024-02-15T22:32:20.372 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:19.529+0000 7f6b1d648700 1 -- 172.21.15.33:0/912611286 wait complete. 2024-02-15T22:32:20.376 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:32:20.376 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-02-15T22:32:20.384 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:32:20.384 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-02-15T22:32:20.384 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-02-15T22:32:20.384 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-15T22:32:20.386 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph Dashboard is now available at: 2024-02-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: URL: https://smithi033.front.sepia.ceph.com:8443/ 2024-02-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: User: admin 2024-02-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: Password: t7nw4pw39f 2024-02-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi033.stdout:Saving cluster configuration to /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config directory 2024-02-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling autotune for osd_memory_target 2024-02-15T22:32:21.606 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:21 smithi033 ceph-mon[29033]: mgrmap e13: smithi033.swohxi(active, since 6s) 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.812+0000 7efdb0367700 1 Processor -- start 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.812+0000 7efdb0367700 1 -- start start 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.812+0000 7efdb0367700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda80771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.812+0000 7efdb0367700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80790b0 con 0x7efda8078ca0 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.812+0000 7efdae103700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda80771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.812+0000 7efdae103700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda80771b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52096/0 (socket says 172.21.15.33:52096) 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.812+0000 7efdae103700 1 -- 172.21.15.33:0/3073124752 learned_addr learned my addr 172.21.15.33:0/3073124752 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.813+0000 7efdae103700 1 -- 172.21.15.33:0/3073124752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80776f0 con 0x7efda8078ca0 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.813+0000 7efdae103700 1 --2- 172.21.15.33:0/3073124752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda80771b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efda00098e0 tx=0x7efda0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286a93bc38689519 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.813+0000 7efdad101700 1 -- 172.21.15.33:0/3073124752 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efda000b860 con 0x7efda8078ca0 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.813+0000 7efdad101700 1 -- 172.21.15.33:0/3073124752 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efda000be90 con 0x7efda8078ca0 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.813+0000 7efdad101700 1 -- 172.21.15.33:0/3073124752 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efda00103c0 con 0x7efda8078ca0 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 -- 172.21.15.33:0/3073124752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 msgr2=0x7efda80771b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 --2- 172.21.15.33:0/3073124752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda80771b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efda00098e0 tx=0x7efda0009250 comp rx=0 tx=0).stop 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 -- 172.21.15.33:0/3073124752 shutdown_connections 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 --2- 172.21.15.33:0/3073124752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda80771b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 -- 172.21.15.33:0/3073124752 >> 172.21.15.33:0/3073124752 conn(0x7efda80fdf00 msgr2=0x7efda8100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 -- 172.21.15.33:0/3073124752 shutdown_connections 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 -- 172.21.15.33:0/3073124752 wait complete. 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 Processor -- start 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.814+0000 7efdb0367700 1 -- start start 2024-02-15T22:32:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdb0367700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda81137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdb0367700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8113d10 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdae103700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda81137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdae103700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda81137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52098/0 (socket says 172.21.15.33:52098) 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdae103700 1 -- 172.21.15.33:0/2820135051 learned_addr learned my addr 172.21.15.33:0/2820135051 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdae103700 1 -- 172.21.15.33:0/2820135051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda00094f0 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdae103700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda81137d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efda0006d40 tx=0x7efda0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efda6ffd700 1 -- 172.21.15.33:0/2820135051 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efda0010840 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efda6ffd700 1 -- 172.21.15.33:0/2820135051 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efda0010e70 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda8113f10 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efda6ffd700 1 -- 172.21.15.33:0/2820135051 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efda0024ea0 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.815+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda8114bb0 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.816+0000 7efda6ffd700 1 -- 172.21.15.33:0/2820135051 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7efda00109a0 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.816+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda805f5c0 con 0x7efda8078ca0 2024-02-15T22:32:21.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.816+0000 7efda6ffd700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7efd90036880 0x7efd90038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.816+0000 7efda6ffd700 1 -- 172.21.15.33:0/2820135051 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efda004a870 con 0x7efda8078ca0 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.816+0000 7efdad902700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7efd90036880 0x7efd90038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.817+0000 7efdad902700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7efd90036880 0x7efd90038d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009990 tx=0x7efd9c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:20.821+0000 7efda6ffd700 1 -- 172.21.15.33:0/2820135051 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efda002e440 con 0x7efda8078ca0 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.013+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7efda804bed0 con 0x7efda8078ca0 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.014+0000 7efda6ffd700 1 -- 172.21.15.33:0/2820135051 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7efda002c340 con 0x7efda8078ca0 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7efd90036880 msgr2=0x7efd90038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7efd90036880 0x7efd90038d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009990 tx=0x7efd9c006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 msgr2=0x7efda81137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda81137d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efda0006d40 tx=0x7efda0009250 comp rx=0 tx=0).stop 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 shutdown_connections 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7efd90036880 0x7efd90038d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 --2- 172.21.15.33:0/2820135051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efda8078ca0 0x7efda81137d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 >> 172.21.15.33:0/2820135051 conn(0x7efda80fdf00 msgr2=0x7efda80ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:21.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 shutdown_connections 2024-02-15T22:32:21.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:21.016+0000 7efdb0367700 1 -- 172.21.15.33:0/2820135051 wait complete. 2024-02-15T22:32:22.964 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.066+0000 7ff47fb54700 1 Processor -- start 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.066+0000 7ff47fb54700 1 -- start start 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.066+0000 7ff47fb54700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4780771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.066+0000 7ff47fb54700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780790d0 con 0x7ff478078cc0 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.066+0000 7ff47d8f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4780771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.066+0000 7ff47d8f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4780771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52114/0 (socket says 172.21.15.33:52114) 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.066+0000 7ff47d8f0700 1 -- 172.21.15.33:0/1525291936 learned_addr learned my addr 172.21.15.33:0/1525291936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.067+0000 7ff47d8f0700 1 -- 172.21.15.33:0/1525291936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478077710 con 0x7ff478078cc0 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.067+0000 7ff47d8f0700 1 --2- 172.21.15.33:0/1525291936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4780771d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098e0 tx=0x7ff474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dbd96e9bd2cbba server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.067+0000 7ff47c8ee700 1 -- 172.21.15.33:0/1525291936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff47400b860 con 0x7ff478078cc0 2024-02-15T22:32:22.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.067+0000 7ff47c8ee700 1 -- 172.21.15.33:0/1525291936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff47400be90 con 0x7ff478078cc0 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.067+0000 7ff47c8ee700 1 -- 172.21.15.33:0/1525291936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4740103c0 con 0x7ff478078cc0 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 -- 172.21.15.33:0/1525291936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 msgr2=0x7ff4780771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 --2- 172.21.15.33:0/1525291936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4780771d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098e0 tx=0x7ff474009250 comp rx=0 tx=0).stop 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 -- 172.21.15.33:0/1525291936 shutdown_connections 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 --2- 172.21.15.33:0/1525291936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4780771d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 -- 172.21.15.33:0/1525291936 >> 172.21.15.33:0/1525291936 conn(0x7ff4780fded0 msgr2=0x7ff478100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 -- 172.21.15.33:0/1525291936 shutdown_connections 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 -- 172.21.15.33:0/1525291936 wait complete. 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 Processor -- start 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 -- start start 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4781137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:22.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47fb54700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478113cf0 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47d8f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4781137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.068+0000 7ff47d8f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4781137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52124/0 (socket says 172.21.15.33:52124) 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff47d8f0700 1 -- 172.21.15.33:0/400962648 learned_addr learned my addr 172.21.15.33:0/400962648 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff47d8f0700 1 -- 172.21.15.33:0/400962648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740094f0 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff47d8f0700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4781137b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4740090b0 tx=0x7ff474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff46e7fc700 1 -- 172.21.15.33:0/400962648 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4740118f0 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff46e7fc700 1 -- 172.21.15.33:0/400962648 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff474010d10 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff478113ef0 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff46e7fc700 1 -- 172.21.15.33:0/400962648 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff474024e70 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.069+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff478114b90 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.070+0000 7ff46e7fc700 1 -- 172.21.15.33:0/400962648 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7ff474010840 con 0x7ff478078cc0 2024-02-15T22:32:22.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.070+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47805f5c0 con 0x7ff478078cc0 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.070+0000 7ff46e7fc700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff464036880 0x7ff464038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.070+0000 7ff46e7fc700 1 -- 172.21.15.33:0/400962648 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff47404a690 con 0x7ff478078cc0 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.070+0000 7ff47d0ef700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff464036880 0x7ff464038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.071+0000 7ff47d0ef700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff464036880 0x7ff464038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff468009990 tx=0x7ff468006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.075+0000 7ff46e7fc700 1 -- 172.21.15.33:0/400962648 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff474010e80 con 0x7ff478078cc0 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.372+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7ff47804bed0 con 0x7ff478078cc0 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.374+0000 7ff46e7fc700 1 -- 172.21.15.33:0/400962648 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7ff474022340 con 0x7ff478078cc0 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff464036880 msgr2=0x7ff464038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff464036880 0x7ff464038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff468009990 tx=0x7ff468006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 msgr2=0x7ff4781137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4781137b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4740090b0 tx=0x7ff474009250 comp rx=0 tx=0).stop 2024-02-15T22:32:22.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 shutdown_connections 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff464036880 0x7ff464038d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 --2- 172.21.15.33:0/400962648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff478078cc0 0x7ff4781137b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 >> 172.21.15.33:0/400962648 conn(0x7ff4780fded0 msgr2=0x7ff4780ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 shutdown_connections 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-02-15T22:32:22.376+0000 7ff47fb54700 1 -- 172.21.15.33:0/400962648 wait complete. 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout:Or, if you are only running a single cluster on this host: 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.969 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout: ceph telemetry on 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout:For more information see: 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:22.970 INFO:teuthology.orchestra.run.smithi033.stdout:Bootstrap complete. 2024-02-15T22:32:23.009 INFO:tasks.cephadm:Fetching config... 2024-02-15T22:32:23.009 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:32:23.009 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-15T22:32:23.026 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-15T22:32:23.026 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:32:23.026 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-15T22:32:23.081 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-15T22:32:23.081 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:32:23.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/keyring of=/dev/stdout 2024-02-15T22:32:23.149 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-15T22:32:23.149 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:32:23.149 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-15T22:32:23.204 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-15T22:32:23.204 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc/u5FMq0Ef6PX8z3NetgUr2lHTizD+9SEUbXfevmo3xpFYnBuw6ElUcIDx5vw4FP3GxUPS/1Ac/THx3kM41DvkRFRlKsy5COcKi1kF1EpGCpKs8E4WjV2oT/73pdIDvSC1lf8aom0xUrIXEfNTMk+eb6v+HGkid1wXuC+nUDItJp8agTSfvhMzdNO8TPnzMqmWcfX4+r2i/J6MPYOqmy5aOPB6QMm4xz49djS5HXgk/v0j67O7AqdBOisHQEKIu57MiR9s0i5+52So7hECQhqhWgTkEBb3+Z1U2QCEDxZDHC3ekLhgnBtrYm+ob22dORXAYW2XmbUE1I3/Lj4V0pvfdSpO+yayTRzhqDqf3e8VAJ2nn3ly/OYcnqR9gt9XCzHh4VhtQxH/jJM2YZw9MaWpohFmivfhCrj6R4qTgRVs8ANpZcwIGqmzZ+yZQWMzKOQQMPWVm/uae76PS+EsZTnCeneOekNW8sYUpxt5LqxG7wzmS/tdOcDsfF5lYemVhE= ceph-cfc49586-cc51-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T22:32:23.282 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc/u5FMq0Ef6PX8z3NetgUr2lHTizD+9SEUbXfevmo3xpFYnBuw6ElUcIDx5vw4FP3GxUPS/1Ac/THx3kM41DvkRFRlKsy5COcKi1kF1EpGCpKs8E4WjV2oT/73pdIDvSC1lf8aom0xUrIXEfNTMk+eb6v+HGkid1wXuC+nUDItJp8agTSfvhMzdNO8TPnzMqmWcfX4+r2i/J6MPYOqmy5aOPB6QMm4xz49djS5HXgk/v0j67O7AqdBOisHQEKIu57MiR9s0i5+52So7hECQhqhWgTkEBb3+Z1U2QCEDxZDHC3ekLhgnBtrYm+ob22dORXAYW2XmbUE1I3/Lj4V0pvfdSpO+yayTRzhqDqf3e8VAJ2nn3ly/OYcnqR9gt9XCzHh4VhtQxH/jJM2YZw9MaWpohFmivfhCrj6R4qTgRVs8ANpZcwIGqmzZ+yZQWMzKOQQMPWVm/uae76PS+EsZTnCeneOekNW8sYUpxt5LqxG7wzmS/tdOcDsfF5lYemVhE= ceph-cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:32:23.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc/u5FMq0Ef6PX8z3NetgUr2lHTizD+9SEUbXfevmo3xpFYnBuw6ElUcIDx5vw4FP3GxUPS/1Ac/THx3kM41DvkRFRlKsy5COcKi1kF1EpGCpKs8E4WjV2oT/73pdIDvSC1lf8aom0xUrIXEfNTMk+eb6v+HGkid1wXuC+nUDItJp8agTSfvhMzdNO8TPnzMqmWcfX4+r2i/J6MPYOqmy5aOPB6QMm4xz49djS5HXgk/v0j67O7AqdBOisHQEKIu57MiR9s0i5+52So7hECQhqhWgTkEBb3+Z1U2QCEDxZDHC3ekLhgnBtrYm+ob22dORXAYW2XmbUE1I3/Lj4V0pvfdSpO+yayTRzhqDqf3e8VAJ2nn3ly/OYcnqR9gt9XCzHh4VhtQxH/jJM2YZw9MaWpohFmivfhCrj6R4qTgRVs8ANpZcwIGqmzZ+yZQWMzKOQQMPWVm/uae76PS+EsZTnCeneOekNW8sYUpxt5LqxG7wzmS/tdOcDsfF5lYemVhE= ceph-cfc49586-cc51-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T22:32:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc/u5FMq0Ef6PX8z3NetgUr2lHTizD+9SEUbXfevmo3xpFYnBuw6ElUcIDx5vw4FP3GxUPS/1Ac/THx3kM41DvkRFRlKsy5COcKi1kF1EpGCpKs8E4WjV2oT/73pdIDvSC1lf8aom0xUrIXEfNTMk+eb6v+HGkid1wXuC+nUDItJp8agTSfvhMzdNO8TPnzMqmWcfX4+r2i/J6MPYOqmy5aOPB6QMm4xz49djS5HXgk/v0j67O7AqdBOisHQEKIu57MiR9s0i5+52So7hECQhqhWgTkEBb3+Z1U2QCEDxZDHC3ekLhgnBtrYm+ob22dORXAYW2XmbUE1I3/Lj4V0pvfdSpO+yayTRzhqDqf3e8VAJ2nn3ly/OYcnqR9gt9XCzHh4VhtQxH/jJM2YZw9MaWpohFmivfhCrj6R4qTgRVs8ANpZcwIGqmzZ+yZQWMzKOQQMPWVm/uae76PS+EsZTnCeneOekNW8sYUpxt5LqxG7wzmS/tdOcDsfF5lYemVhE= ceph-cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:32:23.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-15T22:32:23.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:23 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/400962648' entity='client.admin' 2024-02-15T22:32:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:32:26.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:25 smithi033 ceph-mon[29033]: Deploying daemon crash.smithi033 on smithi033 2024-02-15T22:32:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.186+0000 7f80e1dc4700 1 -- 172.21.15.33:0/3990514268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 msgr2=0x7f80dc0fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.186+0000 7f80e1dc4700 1 --2- 172.21.15.33:0/3990514268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc0fbed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f80d00048c0 tx=0x7f80d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.186+0000 7f80e1dc4700 1 -- 172.21.15.33:0/3990514268 shutdown_connections 2024-02-15T22:32:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.186+0000 7f80e1dc4700 1 --2- 172.21.15.33:0/3990514268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc0fbed0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.186+0000 7f80e1dc4700 1 -- 172.21.15.33:0/3990514268 >> 172.21.15.33:0/3990514268 conn(0x7f80dc0f71a0 msgr2=0x7f80dc0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.186+0000 7f80e1dc4700 1 -- 172.21.15.33:0/3990514268 shutdown_connections 2024-02-15T22:32:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.186+0000 7f80e1dc4700 1 -- 172.21.15.33:0/3990514268 wait complete. 2024-02-15T22:32:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.187+0000 7f80e1dc4700 1 Processor -- start 2024-02-15T22:32:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.187+0000 7f80e1dc4700 1 -- start start 2024-02-15T22:32:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.187+0000 7f80e1dc4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc10fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.187+0000 7f80e1dc4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0665f0 con 0x7f80dc0fbac0 2024-02-15T22:32:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.187+0000 7f80db7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc10fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80db7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc10fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52132/0 (socket says 172.21.15.33:52132) 2024-02-15T22:32:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80db7fe700 1 -- 172.21.15.33:0/372794326 learned_addr learned my addr 172.21.15.33:0/372794326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80db7fe700 1 -- 172.21.15.33:0/372794326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0005040 con 0x7f80dc0fbac0 2024-02-15T22:32:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80db7fe700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc10fbe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009680 tx=0x7f80d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80c3fff700 1 -- 172.21.15.33:0/372794326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80d000bed0 con 0x7f80dc0fbac0 2024-02-15T22:32:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80c3fff700 1 -- 172.21.15.33:0/372794326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80d000b5c0 con 0x7f80dc0fbac0 2024-02-15T22:32:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc0667f0 con 0x7f80dc0fbac0 2024-02-15T22:32:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80c3fff700 1 -- 172.21.15.33:0/372794326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80d001c5b0 con 0x7f80dc0fbac0 2024-02-15T22:32:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.188+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc110360 con 0x7f80dc0fbac0 2024-02-15T22:32:26.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.189+0000 7f80c3fff700 1 -- 172.21.15.33:0/372794326 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f80d001c820 con 0x7f80dc0fbac0 2024-02-15T22:32:26.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.189+0000 7f80c3fff700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f80c4036820 0x7f80c4038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:26.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.189+0000 7f80c3fff700 1 -- 172.21.15.33:0/372794326 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f80d0049dc0 con 0x7f80dc0fbac0 2024-02-15T22:32:26.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.189+0000 7f80daffd700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f80c4036820 0x7f80c4038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:26.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.189+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc105890 con 0x7f80dc0fbac0 2024-02-15T22:32:26.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.190+0000 7f80daffd700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f80c4036820 0x7f80c4038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009990 tx=0x7f80cc006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:26.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.195+0000 7f80c3fff700 1 -- 172.21.15.33:0/372794326 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f80d0011db0 con 0x7f80dc0fbac0 2024-02-15T22:32:26.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.388+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f80dc101880 con 0x7f80dc0fbac0 2024-02-15T22:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.393+0000 7f80c3fff700 1 -- 172.21.15.33:0/372794326 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f80d0023990 con 0x7f80dc0fbac0 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f80c4036820 msgr2=0x7f80c4038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f80c4036820 0x7f80c4038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009990 tx=0x7f80cc006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 msgr2=0x7f80dc10fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc10fbe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009680 tx=0x7f80d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 shutdown_connections 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f80c4036820 0x7f80c4038cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 --2- 172.21.15.33:0/372794326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80dc0fbac0 0x7f80dc10fbe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 >> 172.21.15.33:0/372794326 conn(0x7f80dc0f71a0 msgr2=0x7f80dc0f7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 shutdown_connections 2024-02-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:26.395+0000 7f80e1dc4700 1 -- 172.21.15.33:0/372794326 wait complete. 2024-02-15T22:32:26.961 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-15T22:32:26.961 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-15T22:32:27.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:27 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/372794326' entity='client.admin' 2024-02-15T22:32:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:32:30.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.287+0000 7ff9d94c8700 1 -- 172.21.15.33:0/1360110135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 msgr2=0x7ff9d40fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:30.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.287+0000 7ff9d94c8700 1 --2- 172.21.15.33:0/1360110135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d40fb290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40048c0 tx=0x7ff9c4009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.287+0000 7ff9d94c8700 1 -- 172.21.15.33:0/1360110135 shutdown_connections 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.287+0000 7ff9d94c8700 1 --2- 172.21.15.33:0/1360110135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d40fb290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.287+0000 7ff9d94c8700 1 -- 172.21.15.33:0/1360110135 >> 172.21.15.33:0/1360110135 conn(0x7ff9d40f6920 msgr2=0x7ff9d40f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.287+0000 7ff9d94c8700 1 -- 172.21.15.33:0/1360110135 shutdown_connections 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.287+0000 7ff9d94c8700 1 -- 172.21.15.33:0/1360110135 wait complete. 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.288+0000 7ff9d94c8700 1 Processor -- start 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.288+0000 7ff9d94c8700 1 -- start start 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.288+0000 7ff9d94c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.288+0000 7ff9d94c8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d410d400 con 0x7ff9d40fae80 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9d2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9d2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38300/0 (socket says 172.21.15.33:38300) 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9d2ffd700 1 -- 172.21.15.33:0/3446364811 learned_addr learned my addr 172.21.15.33:0/3446364811 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9d2ffd700 1 -- 172.21.15.33:0/3446364811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4005040 con 0x7ff9d40fae80 2024-02-15T22:32:30.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9d2ffd700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d410cec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009040 tx=0x7ff9c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9bb7fe700 1 -- 172.21.15.33:0/3446364811 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9c400bed0 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9bb7fe700 1 -- 172.21.15.33:0/3446364811 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9c400b5c0 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d410d600 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9bb7fe700 1 -- 172.21.15.33:0/3446364811 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9c401c5b0 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.289+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d410e1c0 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.290+0000 7ff9bb7fe700 1 -- 172.21.15.33:0/3446364811 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7ff9c401c7e0 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.290+0000 7ff9bb7fe700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff9bc0368c0 0x7ff9bc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.290+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d405f5c0 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.290+0000 7ff9bb7fe700 1 -- 172.21.15.33:0/3446364811 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff9c4049bb0 con 0x7ff9d40fae80 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.290+0000 7ff9d27fc700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff9bc0368c0 0x7ff9bc038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.291+0000 7ff9d27fc700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff9bc0368c0 0x7ff9bc038d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009990 tx=0x7ff9c8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:30.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.295+0000 7ff9bb7fe700 1 -- 172.21.15.33:0/3446364811 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff9c4023300 con 0x7ff9d40fae80 2024-02-15T22:32:30.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.493+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d410ef00 con 0x7ff9bc0368c0 2024-02-15T22:32:30.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.496+0000 7ff9bb7fe700 1 -- 172.21.15.33:0/3446364811 <== mgr.14160 v2:172.21.15.33:6800/3209613080 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff9d410ef00 con 0x7ff9bc0368c0 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff9bc0368c0 msgr2=0x7ff9bc038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff9bc0368c0 0x7ff9bc038d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009990 tx=0x7ff9c8006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 msgr2=0x7ff9d410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d410cec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009040 tx=0x7ff9c4009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 shutdown_connections 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7ff9bc0368c0 0x7ff9bc038d70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 --2- 172.21.15.33:0/3446364811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9d40fae80 0x7ff9d410cec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 >> 172.21.15.33:0/3446364811 conn(0x7ff9d40f6920 msgr2=0x7ff9d40f7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 shutdown_connections 2024-02-15T22:32:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:30.498+0000 7ff9d94c8700 1 -- 172.21.15.33:0/3446364811 wait complete. 2024-02-15T22:32:31.354 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi082 2024-02-15T22:32:31.354 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:32:31.354 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.conf 2024-02-15T22:32:31.373 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:32:31.373 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:32:31.430 INFO:tasks.cephadm:Adding host smithi082 to orchestrator... 2024-02-15T22:32:31.430 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch host add smithi082 2024-02-15T22:32:31.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:31 smithi033 ceph-mon[29033]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:31.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:31 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:31.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:31 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:31.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:31 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:31.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:31 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:31.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:31 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:31.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:31 smithi033 ceph-mon[29033]: Deploying daemon node-exporter.smithi033 on smithi033 2024-02-15T22:32:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:32:33.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 -- 172.21.15.33:0/4009167048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 msgr2=0x7fa1d40fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:33.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 --2- 172.21.15.33:0/4009167048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d40fbee0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40048c0 tx=0x7fa1c4009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 -- 172.21.15.33:0/4009167048 shutdown_connections 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 --2- 172.21.15.33:0/4009167048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d40fbee0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 -- 172.21.15.33:0/4009167048 >> 172.21.15.33:0/4009167048 conn(0x7fa1d40f7190 msgr2=0x7fa1d40f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 -- 172.21.15.33:0/4009167048 shutdown_connections 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 -- 172.21.15.33:0/4009167048 wait complete. 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.390+0000 7fa1da753700 1 Processor -- start 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1da753700 1 -- start start 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1da753700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1da753700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4065d80 con 0x7fa1d40fbad0 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d410fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38324/0 (socket says 172.21.15.33:38324) 2024-02-15T22:32:33.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1d3fff700 1 -- 172.21.15.33:0/2180402337 learned_addr learned my addr 172.21.15.33:0/2180402337 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1d3fff700 1 -- 172.21.15.33:0/2180402337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4005040 con 0x7fa1d40fbad0 2024-02-15T22:32:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1d3fff700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d410fbb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009680 tx=0x7fa1c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.391+0000 7fa1d0ff9700 1 -- 172.21.15.33:0/2180402337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1c400bed0 con 0x7fa1d40fbad0 2024-02-15T22:32:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.392+0000 7fa1d0ff9700 1 -- 172.21.15.33:0/2180402337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1c400b5c0 con 0x7fa1d40fbad0 2024-02-15T22:32:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.392+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d4065f80 con 0x7fa1d40fbad0 2024-02-15T22:32:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.392+0000 7fa1d0ff9700 1 -- 172.21.15.33:0/2180402337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1c401c5b0 con 0x7fa1d40fbad0 2024-02-15T22:32:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.392+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d4110330 con 0x7fa1d40fbad0 2024-02-15T22:32:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.392+0000 7fa1d0ff9700 1 -- 172.21.15.33:0/2180402337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7fa1c401c7d0 con 0x7fa1d40fbad0 2024-02-15T22:32:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.392+0000 7fa1d0ff9700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fa1bc036870 0x7fa1bc038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.393+0000 7fa1d0ff9700 1 -- 172.21.15.33:0/2180402337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa1c4013a80 con 0x7fa1d40fbad0 2024-02-15T22:32:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.393+0000 7fa1d37fe700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fa1bc036870 0x7fa1bc038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.393+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d41058a0 con 0x7fa1d40fbad0 2024-02-15T22:32:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.393+0000 7fa1d37fe700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fa1bc036870 0x7fa1bc038d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009990 tx=0x7fa1c8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.398+0000 7fa1d0ff9700 1 -- 172.21.15.33:0/2180402337 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa1c4023300 con 0x7fa1d40fbad0 2024-02-15T22:32:33.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:33.597+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1d402b310 con 0x7fa1bc036870 2024-02-15T22:32:35.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:35 smithi033 ceph-mon[29033]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:35.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:35 smithi033 ceph-mon[29033]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:35.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:35 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:35.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:35 smithi033 ceph-mon[29033]: Deploying cephadm binary to smithi082 2024-02-15T22:32:35.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.684+0000 7fa1d0ff9700 1 -- 172.21.15.33:0/2180402337 <== mgr.14160 v2:172.21.15.33:6800/3209613080 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fa1d402b310 con 0x7fa1bc036870 2024-02-15T22:32:35.686 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi082' with addr '172.21.15.82' 2024-02-15T22:32:35.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fa1bc036870 msgr2=0x7fa1bc038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:35.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fa1bc036870 0x7fa1bc038d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009990 tx=0x7fa1c8006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:35.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 msgr2=0x7fa1d410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:35.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d410fbb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009680 tx=0x7fa1c4009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:35.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 shutdown_connections 2024-02-15T22:32:35.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fa1bc036870 0x7fa1bc038d20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:35.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 --2- 172.21.15.33:0/2180402337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1d40fbad0 0x7fa1d410fbb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:35.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 >> 172.21.15.33:0/2180402337 conn(0x7fa1d40f7190 msgr2=0x7fa1d40f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:35.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 shutdown_connections 2024-02-15T22:32:35.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:35.686+0000 7fa1da753700 1 -- 172.21.15.33:0/2180402337 wait complete. 2024-02-15T22:32:36.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch host ls --format=json 2024-02-15T22:32:36.609 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:32:37.009 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:37.009 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: Added host smithi082 2024-02-15T22:32:37.009 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:37.009 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:37.009 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:37.009 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:37.009 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: Deploying daemon alertmanager.smithi033 on smithi033 2024-02-15T22:32:37.010 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:36 smithi033 ceph-mon[29033]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 -- 172.21.15.33:0/2281937059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 msgr2=0x7f655c0ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 --2- 172.21.15.33:0/2281937059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0ffae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65580048c0 tx=0x7f6558009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 -- 172.21.15.33:0/2281937059 shutdown_connections 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 --2- 172.21.15.33:0/2281937059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0ffae0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 -- 172.21.15.33:0/2281937059 >> 172.21.15.33:0/2281937059 conn(0x7f655c0f71a0 msgr2=0x7f655c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 -- 172.21.15.33:0/2281937059 shutdown_connections 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 -- 172.21.15.33:0/2281937059 wait complete. 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 Processor -- start 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 -- start start 2024-02-15T22:32:38.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.558+0000 7f6564586700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0fb610 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6562322700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6562322700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58074/0 (socket says 172.21.15.33:58074) 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6562322700 1 -- 172.21.15.33:0/3065888494 learned_addr learned my addr 172.21.15.33:0/3065888494 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6562322700 1 -- 172.21.15.33:0/3065888494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6558005040 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6562322700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0fd190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6558009680 tx=0x7f6558009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6552ffd700 1 -- 172.21.15.33:0/3065888494 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f655800b5c0 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6552ffd700 1 -- 172.21.15.33:0/3065888494 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6558004e60 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c0fb810 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6552ffd700 1 -- 172.21.15.33:0/3065888494 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f655801c590 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.559+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c0fbd00 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.560+0000 7f6552ffd700 1 -- 172.21.15.33:0/3065888494 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f6558013a80 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.560+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c106990 con 0x7f655c0fd700 2024-02-15T22:32:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.560+0000 7f6552ffd700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f65480368c0 0x7f6548038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:38.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.560+0000 7f6552ffd700 1 -- 172.21.15.33:0/3065888494 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6558049ac0 con 0x7f655c0fd700 2024-02-15T22:32:38.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.560+0000 7f6561b21700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f65480368c0 0x7f6548038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:38.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.561+0000 7f6561b21700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f65480368c0 0x7f6548038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f654c009990 tx=0x7f654c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:38.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.565+0000 7f6552ffd700 1 -- 172.21.15.33:0/3065888494 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f655804be60 con 0x7f655c0fd700 2024-02-15T22:32:38.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.766+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f655c02b310 con 0x7f65480368c0 2024-02-15T22:32:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.767+0000 7f6552ffd700 1 -- 172.21.15.33:0/3065888494 <== mgr.14160 v2:172.21.15.33:6800/3209613080 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f655c02b310 con 0x7f65480368c0 2024-02-15T22:32:38.768 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:32:38.768 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}] 2024-02-15T22:32:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f65480368c0 msgr2=0x7f6548038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f65480368c0 0x7f6548038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f654c009990 tx=0x7f654c006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 msgr2=0x7f655c0fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0fd190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6558009680 tx=0x7f6558009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 shutdown_connections 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f65480368c0 0x7f6548038d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 --2- 172.21.15.33:0/3065888494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f655c0fd700 0x7f655c0fd190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 >> 172.21.15.33:0/3065888494 conn(0x7f655c0f71a0 msgr2=0x7f655c0f7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 shutdown_connections 2024-02-15T22:32:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:38.769+0000 7f6564586700 1 -- 172.21.15.33:0/3065888494 wait complete. 2024-02-15T22:32:39.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:38 smithi033 ceph-mon[29033]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:39.851 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-15T22:32:39.851 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd crush tunables default 2024-02-15T22:32:40.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:40 smithi033 ceph-mon[29033]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:32:40.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:40 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:40.671 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:32:41.511 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:41 smithi033 ceph-mon[29033]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:43.335 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:43 smithi033 ceph-mon[29033]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 -- 172.21.15.33:0/1931573624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 msgr2=0x7f14d40ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 --2- 172.21.15.33:0/1931573624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d40ffaf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009c60 tx=0x7f14c4004d10 comp rx=0 tx=0).stop 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 -- 172.21.15.33:0/1931573624 shutdown_connections 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 --2- 172.21.15.33:0/1931573624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d40ffaf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 -- 172.21.15.33:0/1931573624 >> 172.21.15.33:0/1931573624 conn(0x7f14d40f7190 msgr2=0x7f14d40f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 -- 172.21.15.33:0/1931573624 shutdown_connections 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 -- 172.21.15.33:0/1931573624 wait complete. 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 Processor -- start 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.378+0000 7f14d9541700 1 -- start start 2024-02-15T22:32:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14d9541700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d410cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14d9541700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d410d3e0 con 0x7f14d40fd710 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14d2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d410cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14d2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d410cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58104/0 (socket says 172.21.15.33:58104) 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14d2ffd700 1 -- 172.21.15.33:0/1991734079 learned_addr learned my addr 172.21.15.33:0/1991734079 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14d2ffd700 1 -- 172.21.15.33:0/1991734079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4009940 con 0x7f14d40fd710 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14d2ffd700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d410cea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14c4004e60 tx=0x7f14c4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.379+0000 7f14cb7fe700 1 -- 172.21.15.33:0/1991734079 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14c401d440 con 0x7f14d40fd710 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.380+0000 7f14cb7fe700 1 -- 172.21.15.33:0/1991734079 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14c401da70 con 0x7f14d40fd710 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.380+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d410d5e0 con 0x7f14d40fd710 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.380+0000 7f14cb7fe700 1 -- 172.21.15.33:0/1991734079 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14c4012aa0 con 0x7f14d40fd710 2024-02-15T22:32:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.380+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d410e280 con 0x7f14d40fd710 2024-02-15T22:32:45.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.380+0000 7f14cb7fe700 1 -- 172.21.15.33:0/1991734079 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f14c4019040 con 0x7f14d40fd710 2024-02-15T22:32:45.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.381+0000 7f14cb7fe700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f14c00368c0 0x7f14c0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:45.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.381+0000 7f14cb7fe700 1 -- 172.21.15.33:0/1991734079 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f14c404a210 con 0x7f14d40fd710 2024-02-15T22:32:45.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.381+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d405f5c0 con 0x7f14d40fd710 2024-02-15T22:32:45.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.381+0000 7f14d27fc700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f14c00368c0 0x7f14c0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:45.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.381+0000 7f14d27fc700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f14c00368c0 0x7f14c0038d70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009990 tx=0x7f14bc006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:45.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.386+0000 7f14cb7fe700 1 -- 172.21.15.33:0/1991734079 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f14c4017080 con 0x7f14d40fd710 2024-02-15T22:32:45.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:45 smithi033 ceph-mon[29033]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:45.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:45.588+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f14d410ecd0 con 0x7f14d40fd710 2024-02-15T22:32:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.231+0000 7f14cb7fe700 1 -- 172.21.15.33:0/1991734079 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f14c4021020 con 0x7f14d40fd710 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f14c00368c0 msgr2=0x7f14c0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f14c00368c0 0x7f14c0038d70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009990 tx=0x7f14bc006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 msgr2=0x7f14d410cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d410cea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14c4004e60 tx=0x7f14c4004d10 comp rx=0 tx=0).stop 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 shutdown_connections 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f14c00368c0 0x7f14c0038d70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 --2- 172.21.15.33:0/1991734079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14d40fd710 0x7f14d410cea0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 >> 172.21.15.33:0/1991734079 conn(0x7f14d40f7190 msgr2=0x7f14d40f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 shutdown_connections 2024-02-15T22:32:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:32:46.234+0000 7f14d9541700 1 -- 172.21.15.33:0/1991734079 wait complete. 2024-02-15T22:32:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1991734079' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:46.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T22:32:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:46 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:46.897 INFO:tasks.cephadm:Adding mon.smithi033 on smithi033 2024-02-15T22:32:46.898 INFO:tasks.cephadm:Adding mon.smithi082 on smithi082 2024-02-15T22:32:46.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch apply mon '2;smithi033:172.21.15.33=smithi033;smithi082:172.21.15.82=smithi082' 2024-02-15T22:32:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:47.190 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:47.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:47 smithi033 ceph-mon[29033]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:47.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:47 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T22:32:47.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:47 smithi033 ceph-mon[29033]: Deploying daemon grafana.smithi033 on smithi033 2024-02-15T22:32:47.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:47 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1991734079' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-15T22:32:47.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:47 smithi033 ceph-mon[29033]: osdmap e4: 0 total, 0 up, 0 in 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 -- 172.21.15.82:0/1642036882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 msgr2=0x7f9b8c0fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 --2- 172.21.15.82:0/1642036882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c0fcfe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0048c0 tx=0x7f9b7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 -- 172.21.15.82:0/1642036882 shutdown_connections 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 --2- 172.21.15.82:0/1642036882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c0fcfe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 -- 172.21.15.82:0/1642036882 >> 172.21.15.82:0/1642036882 conn(0x7f9b8c0f8290 msgr2=0x7f9b8c0fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 -- 172.21.15.82:0/1642036882 shutdown_connections 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 -- 172.21.15.82:0/1642036882 wait complete. 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.807+0000 7f9b923f1700 1 Processor -- start 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b923f1700 1 -- start start 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b923f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c10cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b923f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c10d430 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c10cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c10cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:55678/0 (socket says 172.21.15.82:55678) 2024-02-15T22:32:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b8bfff700 1 -- 172.21.15.82:0/2175232981 learned_addr learned my addr 172.21.15.82:0/2175232981 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:32:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b8bfff700 1 -- 172.21.15.82:0/2175232981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c005040 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.808+0000 7f9b8bfff700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c10cef0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009680 tx=0x7f9b7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.809+0000 7f9b897fa700 1 -- 172.21.15.82:0/2175232981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b7c00bed0 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.809+0000 7f9b897fa700 1 -- 172.21.15.82:0/2175232981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b7c00b5c0 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.809+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c10d630 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.809+0000 7f9b897fa700 1 -- 172.21.15.82:0/2175232981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b7c01c5b0 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.809+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c10e2d0 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.810+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c05f5c0 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.810+0000 7f9b897fa700 1 -- 172.21.15.82:0/2175232981 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f9b7c004d30 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.810+0000 7f9b897fa700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9b78036820 0x7f9b78038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.810+0000 7f9b897fa700 1 -- 172.21.15.82:0/2175232981 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9b7c049ab0 con 0x7f9b8c0fcbd0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.810+0000 7f9b83fff700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9b78036820 0x7f9b78038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.811+0000 7f9b83fff700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9b78036820 0x7f9b78038cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009990 tx=0x7f9b74006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:48.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:48.815+0000 7f9b897fa700 1 -- 172.21.15.82:0/2175232981 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9b7c011940 con 0x7f9b8c0fcbd0 2024-02-15T22:32:49.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.006+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 --> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi033:172.21.15.33=smithi033;smithi082:172.21.15.82=smithi082", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b8c10ee90 con 0x7f9b78036820 2024-02-15T22:32:49.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.013+0000 7f9b897fa700 1 -- 172.21.15.82:0/2175232981 <== mgr.14160 v2:172.21.15.33:6800/3209613080 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9b8c10ee90 con 0x7f9b78036820 2024-02-15T22:32:49.013 INFO:teuthology.orchestra.run.smithi082.stdout:Scheduled mon update... 2024-02-15T22:32:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9b78036820 msgr2=0x7f9b78038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9b78036820 0x7f9b78038cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009990 tx=0x7f9b74006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 msgr2=0x7f9b8c10cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c10cef0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009680 tx=0x7f9b7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:49.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 shutdown_connections 2024-02-15T22:32:49.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9b78036820 0x7f9b78038cd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:49.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 --2- 172.21.15.82:0/2175232981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c0fcbd0 0x7f9b8c10cef0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:49.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 >> 172.21.15.82:0/2175232981 conn(0x7f9b8c0f8290 msgr2=0x7f9b8c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:49.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 shutdown_connections 2024-02-15T22:32:49.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:49.015+0000 7f9b923f1700 1 -- 172.21.15.82:0/2175232981 wait complete. 2024-02-15T22:32:49.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:48 smithi033 ceph-mon[29033]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:49.642 DEBUG:teuthology.orchestra.run.smithi082:mon.smithi082> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi082.service 2024-02-15T22:32:49.645 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:32:49.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:32:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:49.965 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:50.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:50 smithi033 ceph-mon[29033]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi033:172.21.15.33=smithi033;smithi082:172.21.15.82=smithi082", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:32:50.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:50 smithi033 ceph-mon[29033]: Saving service mon spec with placement smithi033:172.21.15.33=smithi033;smithi082:172.21.15.82=smithi082;count:2 2024-02-15T22:32:50.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:50 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:50.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:50 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:32:51.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:51 smithi033 ceph-mon[29033]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 -- 172.21.15.82:0/1984542248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 msgr2=0x7fb9500fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 --2- 172.21.15.82:0/1984542248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb9500fb2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9400048c0 tx=0x7fb940009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 -- 172.21.15.82:0/1984542248 shutdown_connections 2024-02-15T22:32:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 --2- 172.21.15.82:0/1984542248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb9500fb2b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 -- 172.21.15.82:0/1984542248 >> 172.21.15.82:0/1984542248 conn(0x7fb9500f6920 msgr2=0x7fb9500f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 -- 172.21.15.82:0/1984542248 shutdown_connections 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 -- 172.21.15.82:0/1984542248 wait complete. 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.425+0000 7fb956170700 1 Processor -- start 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb956170700 1 -- start start 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb956170700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb95010cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb956170700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95010d420 con 0x7fb9500faea0 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb94f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb95010cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb94f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb95010cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:55704/0 (socket says 172.21.15.82:55704) 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb94f7fe700 1 -- 172.21.15.82:0/2998733929 learned_addr learned my addr 172.21.15.82:0/2998733929 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb94f7fe700 1 -- 172.21.15.82:0/2998733929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940005040 con 0x7fb9500faea0 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb94f7fe700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb95010cee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb940009330 tx=0x7fb940009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.426+0000 7fb937fff700 1 -- 172.21.15.82:0/2998733929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb940004e60 con 0x7fb9500faea0 2024-02-15T22:32:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.427+0000 7fb937fff700 1 -- 172.21.15.82:0/2998733929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9400096b0 con 0x7fb9500faea0 2024-02-15T22:32:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.427+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95010d620 con 0x7fb9500faea0 2024-02-15T22:32:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.427+0000 7fb937fff700 1 -- 172.21.15.82:0/2998733929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94001c5b0 con 0x7fb9500faea0 2024-02-15T22:32:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.427+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95010e2c0 con 0x7fb9500faea0 2024-02-15T22:32:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.427+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95005f5c0 con 0x7fb9500faea0 2024-02-15T22:32:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.427+0000 7fb937fff700 1 -- 172.21.15.82:0/2998733929 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7fb940013980 con 0x7fb9500faea0 2024-02-15T22:32:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.428+0000 7fb937fff700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fb938036870 0x7fb938038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.428+0000 7fb937fff700 1 -- 172.21.15.82:0/2998733929 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb940049b50 con 0x7fb9500faea0 2024-02-15T22:32:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.428+0000 7fb94effd700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fb938036870 0x7fb938038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.428+0000 7fb94effd700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fb938036870 0x7fb938038d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb944009990 tx=0x7fb944006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.433+0000 7fb937fff700 1 -- 172.21.15.82:0/2998733929 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb940011550 con 0x7fb9500faea0 2024-02-15T22:32:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.688+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb95010ee10 con 0x7fb9500faea0 2024-02-15T22:32:51.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.689+0000 7fb937fff700 1 -- 172.21.15.82:0/2998733929 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb940011370 con 0x7fb9500faea0 2024-02-15T22:32:51.689 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:32:51.689 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:32:51.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fb938036870 msgr2=0x7fb938038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:51.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fb938036870 0x7fb938038d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb944009990 tx=0x7fb944006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:51.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 msgr2=0x7fb95010cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:51.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb95010cee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb940009330 tx=0x7fb940009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:51.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 shutdown_connections 2024-02-15T22:32:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fb938036870 0x7fb938038d20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 --2- 172.21.15.82:0/2998733929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9500faea0 0x7fb95010cee0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 >> 172.21.15.82:0/2998733929 conn(0x7fb9500f6920 msgr2=0x7fb9500f76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 shutdown_connections 2024-02-15T22:32:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:51.691+0000 7fb956170700 1 -- 172.21.15.82:0/2998733929 wait complete. 2024-02-15T22:32:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:32:52.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:52 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2998733929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:32:53.231 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:32:53.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:32:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:53.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:53 smithi033 ceph-mon[29033]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:53.537 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.070+0000 7f1d87082700 1 -- 172.21.15.82:0/2983949236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 msgr2=0x7f1d80070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.070+0000 7f1d87082700 1 --2- 172.21.15.82:0/2983949236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d80070380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1d740048c0 tx=0x7f1d74009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.070+0000 7f1d87082700 1 -- 172.21.15.82:0/2983949236 shutdown_connections 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.070+0000 7f1d87082700 1 --2- 172.21.15.82:0/2983949236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d80070380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.070+0000 7f1d87082700 1 -- 172.21.15.82:0/2983949236 >> 172.21.15.82:0/2983949236 conn(0x7f1d800f82a0 msgr2=0x7f1d800fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.070+0000 7f1d87082700 1 -- 172.21.15.82:0/2983949236 shutdown_connections 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.070+0000 7f1d87082700 1 -- 172.21.15.82:0/2983949236 wait complete. 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d87082700 1 Processor -- start 2024-02-15T22:32:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d87082700 1 -- start start 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d87082700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d8010f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d87082700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8010f5c0 con 0x7f1d80071f10 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d84e1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d8010f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d84e1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d8010f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:40722/0 (socket says 172.21.15.82:40722) 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d84e1e700 1 -- 172.21.15.82:0/1271666776 learned_addr learned my addr 172.21.15.82:0/1271666776 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.071+0000 7f1d84e1e700 1 -- 172.21.15.82:0/1271666776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74005040 con 0x7f1d80071f10 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.072+0000 7f1d84e1e700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d8010f080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009680 tx=0x7f1d74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.072+0000 7f1d7d7fa700 1 -- 172.21.15.82:0/1271666776 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d7400b5c0 con 0x7f1d80071f10 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.072+0000 7f1d7d7fa700 1 -- 172.21.15.82:0/1271666776 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d74004e60 con 0x7f1d80071f10 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.072+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8010f7c0 con 0x7f1d80071f10 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.072+0000 7f1d7d7fa700 1 -- 172.21.15.82:0/1271666776 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d7401c590 con 0x7f1d80071f10 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.072+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d80110460 con 0x7f1d80071f10 2024-02-15T22:32:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.073+0000 7f1d7d7fa700 1 -- 172.21.15.82:0/1271666776 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f1d74013420 con 0x7f1d80071f10 2024-02-15T22:32:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.073+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8005f5c0 con 0x7f1d80071f10 2024-02-15T22:32:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.073+0000 7f1d7d7fa700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f1d70036870 0x7f1d70038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.073+0000 7f1d7d7fa700 1 -- 172.21.15.82:0/1271666776 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1d74049bb0 con 0x7f1d80071f10 2024-02-15T22:32:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.073+0000 7f1d7ffff700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f1d70036870 0x7f1d70038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.073+0000 7f1d7ffff700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f1d70036870 0x7f1d70038d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009990 tx=0x7f1d6c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:55.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.078+0000 7f1d7d7fa700 1 -- 172.21.15.82:0/1271666776 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1d74025400 con 0x7f1d80071f10 2024-02-15T22:32:55.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.332+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1d80110fb0 con 0x7f1d80071f10 2024-02-15T22:32:55.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.333+0000 7f1d7d7fa700 1 -- 172.21.15.82:0/1271666776 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1d74011370 con 0x7f1d80071f10 2024-02-15T22:32:55.333 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:32:55.333 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:32:55.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f1d70036870 msgr2=0x7f1d70038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:55.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f1d70036870 0x7f1d70038d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009990 tx=0x7f1d6c006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:55.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 msgr2=0x7f1d8010f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:55.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d8010f080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009680 tx=0x7f1d74009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:55.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 shutdown_connections 2024-02-15T22:32:55.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f1d70036870 0x7f1d70038d20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:55.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 --2- 172.21.15.82:0/1271666776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d80071f10 0x7f1d8010f080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:55.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 >> 172.21.15.82:0/1271666776 conn(0x7f1d800f82a0 msgr2=0x7f1d800f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:55.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 shutdown_connections 2024-02-15T22:32:55.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:55.335+0000 7f1d87082700 1 -- 172.21.15.82:0/1271666776 wait complete. 2024-02-15T22:32:55.336 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:32:55.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:55 smithi033 ceph-mon[29033]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:56.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:56 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/1271666776' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:32:56.908 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:32:56.908 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:32:57.153 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:57.201 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:32:57.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:57 smithi033 ceph-mon[29033]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:32:58.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.552+0000 7f00f1903700 1 -- 172.21.15.82:0/89636480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 msgr2=0x7f00ec0fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:58.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.552+0000 7f00f1903700 1 --2- 172.21.15.82:0/89636480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec0fbed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0048c0 tx=0x7f00dc009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:58.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.552+0000 7f00f1903700 1 -- 172.21.15.82:0/89636480 shutdown_connections 2024-02-15T22:32:58.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.552+0000 7f00f1903700 1 --2- 172.21.15.82:0/89636480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec0fbed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:58.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.552+0000 7f00f1903700 1 -- 172.21.15.82:0/89636480 >> 172.21.15.82:0/89636480 conn(0x7f00ec0f71a0 msgr2=0x7f00ec0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:58.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.552+0000 7f00f1903700 1 -- 172.21.15.82:0/89636480 shutdown_connections 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.552+0000 7f00f1903700 1 -- 172.21.15.82:0/89636480 wait complete. 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00f1903700 1 Processor -- start 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00f1903700 1 -- start start 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00f1903700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec103dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00f1903700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec102240 con 0x7f00ec0fbac0 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec103dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec103dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:40730/0 (socket says 172.21.15.82:40730) 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00eaffd700 1 -- 172.21.15.82:0/3377566674 learned_addr learned my addr 172.21.15.82:0/3377566674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00eaffd700 1 -- 172.21.15.82:0/3377566674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc005040 con 0x7f00ec0fbac0 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.553+0000 7f00eaffd700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec103dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009680 tx=0x7f00dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.554+0000 7f00d37fe700 1 -- 172.21.15.82:0/3377566674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00dc00bed0 con 0x7f00ec0fbac0 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.554+0000 7f00d37fe700 1 -- 172.21.15.82:0/3377566674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00dc00b5c0 con 0x7f00ec0fbac0 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.554+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec102440 con 0x7f00ec0fbac0 2024-02-15T22:32:58.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.554+0000 7f00d37fe700 1 -- 172.21.15.82:0/3377566674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00dc01c5b0 con 0x7f00ec0fbac0 2024-02-15T22:32:58.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.554+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec102930 con 0x7f00ec0fbac0 2024-02-15T22:32:58.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.554+0000 7f00d37fe700 1 -- 172.21.15.82:0/3377566674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f00dc01c820 con 0x7f00ec0fbac0 2024-02-15T22:32:58.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.554+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec04bed0 con 0x7f00ec0fbac0 2024-02-15T22:32:58.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.555+0000 7f00d37fe700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f00d4036820 0x7f00d4038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:32:58.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.555+0000 7f00d37fe700 1 -- 172.21.15.82:0/3377566674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f00dc049c50 con 0x7f00ec0fbac0 2024-02-15T22:32:58.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.555+0000 7f00ea7fc700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f00d4036820 0x7f00d4038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:32:58.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.555+0000 7f00ea7fc700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f00d4036820 0x7f00d4038cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009990 tx=0x7f00e0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:32:58.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.559+0000 7f00d37fe700 1 -- 172.21.15.82:0/3377566674 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f00dc011550 con 0x7f00ec0fbac0 2024-02-15T22:32:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.814+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f00ec103040 con 0x7f00ec0fbac0 2024-02-15T22:32:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.814+0000 7f00d37fe700 1 -- 172.21.15.82:0/3377566674 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f00dc011370 con 0x7f00ec0fbac0 2024-02-15T22:32:58.815 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:32:58.815 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:32:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f00d4036820 msgr2=0x7f00d4038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f00d4036820 0x7f00d4038cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009990 tx=0x7f00e0006e40 comp rx=0 tx=0).stop 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 msgr2=0x7f00ec103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec103dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009680 tx=0x7f00dc009e30 comp rx=0 tx=0).stop 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 shutdown_connections 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f00d4036820 0x7f00d4038cd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 --2- 172.21.15.82:0/3377566674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ec0fbac0 0x7f00ec103dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 >> 172.21.15.82:0/3377566674 conn(0x7f00ec0f71a0 msgr2=0x7f00ec0f7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 shutdown_connections 2024-02-15T22:32:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:32:58.816+0000 7f00f1903700 1 -- 172.21.15.82:0/3377566674 wait complete. 2024-02-15T22:32:58.818 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:32:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:58 smithi033 ceph-mon[29033]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:00.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:32:59 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/3377566674' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:00.395 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:00.395 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:01.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:00 smithi033 ceph-mon[29033]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 -- 172.21.15.82:0/4049762210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 msgr2=0x7f9bec0fcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 --2- 172.21.15.82:0/4049762210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec0fcfc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0048c0 tx=0x7f9bdc009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 -- 172.21.15.82:0/4049762210 shutdown_connections 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 --2- 172.21.15.82:0/4049762210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec0fcfc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 -- 172.21.15.82:0/4049762210 >> 172.21.15.82:0/4049762210 conn(0x7f9bec0f8330 msgr2=0x7f9bec0fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 -- 172.21.15.82:0/4049762210 shutdown_connections 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 -- 172.21.15.82:0/4049762210 wait complete. 2024-02-15T22:33:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.134+0000 7f9bf21a8700 1 Processor -- start 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9bf21a8700 1 -- start start 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9bf21a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9bf21a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0702e0 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9beb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9beb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:54982/0 (socket says 172.21.15.82:54982) 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9beb7fe700 1 -- 172.21.15.82:0/3029314863 learned_addr learned my addr 172.21.15.82:0/3029314863 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9beb7fe700 1 -- 172.21.15.82:0/3029314863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc005040 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9beb7fe700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec071e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009680 tx=0x7f9bdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.135+0000 7f9be8ff9700 1 -- 172.21.15.82:0/3029314863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bdc00b5c0 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.136+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0704e0 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.136+0000 7f9be8ff9700 1 -- 172.21.15.82:0/3029314863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bdc004e60 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.136+0000 7f9be8ff9700 1 -- 172.21.15.82:0/3029314863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bdc01c590 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.136+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0709d0 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.136+0000 7f9be8ff9700 1 -- 172.21.15.82:0/3029314863 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f9bdc01c830 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.137+0000 7f9be8ff9700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9bd8036870 0x7f9bd8038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.137+0000 7f9be8ff9700 1 -- 172.21.15.82:0/3029314863 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9bdc049c80 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.137+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec106900 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.137+0000 7f9be3fff700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9bd8036870 0x7f9bd8038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.137+0000 7f9be3fff700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9bd8036870 0x7f9bd8038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009990 tx=0x7f9bd4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:02.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.142+0000 7f9be8ff9700 1 -- 172.21.15.82:0/3029314863 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9bdc011550 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.398+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9bec106320 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.399+0000 7f9be8ff9700 1 -- 172.21.15.82:0/3029314863 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9bdc034090 con 0x7f9bec0fcbb0 2024-02-15T22:33:02.399 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:02.399 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9bd8036870 msgr2=0x7f9bd8038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9bd8036870 0x7f9bd8038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009990 tx=0x7f9bd4006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 msgr2=0x7f9bec071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec071e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009680 tx=0x7f9bdc009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 shutdown_connections 2024-02-15T22:33:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f9bd8036870 0x7f9bd8038d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 --2- 172.21.15.82:0/3029314863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bec0fcbb0 0x7f9bec071e60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 >> 172.21.15.82:0/3029314863 conn(0x7f9bec0f8330 msgr2=0x7f9bec0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 shutdown_connections 2024-02-15T22:33:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:02.401+0000 7f9bf21a8700 1 -- 172.21.15.82:0/3029314863 wait complete. 2024-02-15T22:33:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:03.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:03 smithi033 ceph-mon[29033]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:03.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:03 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/3029314863' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:03.964 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:03.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:04.211 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:04.257 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:05.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:05 smithi033 ceph-mon[29033]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.794+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3572246949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 msgr2=0x7f5e580ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.794+0000 7f5e5e37b700 1 --2- 172.21.15.82:0/3572246949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580ffaf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e400048c0 tx=0x7f5e40009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.794+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3572246949 shutdown_connections 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.794+0000 7f5e5e37b700 1 --2- 172.21.15.82:0/3572246949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580ffaf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.794+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3572246949 >> 172.21.15.82:0/3572246949 conn(0x7f5e580f7190 msgr2=0x7f5e580f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.794+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3572246949 shutdown_connections 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.794+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3572246949 wait complete. 2024-02-15T22:33:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e5e37b700 1 Processor -- start 2024-02-15T22:33:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e5e37b700 1 -- start start 2024-02-15T22:33:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e5e37b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e5e37b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580fb620 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580fd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:54996/0 (socket says 172.21.15.82:54996) 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e57fff700 1 -- 172.21.15.82:0/3371833172 learned_addr learned my addr 172.21.15.82:0/3371833172 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.795+0000 7f5e57fff700 1 -- 172.21.15.82:0/3371833172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40005040 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.796+0000 7f5e57fff700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580fd1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009680 tx=0x7f5e40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.796+0000 7f5e54ff9700 1 -- 172.21.15.82:0/3371833172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e4000b5c0 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.796+0000 7f5e54ff9700 1 -- 172.21.15.82:0/3371833172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e40004e60 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.796+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e580fb820 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.796+0000 7f5e54ff9700 1 -- 172.21.15.82:0/3371833172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e4001c590 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.796+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e580fbd10 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.797+0000 7f5e54ff9700 1 -- 172.21.15.82:0/3371833172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f5e4001c810 con 0x7f5e580fd710 2024-02-15T22:33:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.797+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e581069a0 con 0x7f5e580fd710 2024-02-15T22:33:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.797+0000 7f5e54ff9700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f5e44036870 0x7f5e44038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.797+0000 7f5e54ff9700 1 -- 172.21.15.82:0/3371833172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5e40049cb0 con 0x7f5e580fd710 2024-02-15T22:33:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.797+0000 7f5e577fe700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f5e44036870 0x7f5e44038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.797+0000 7f5e577fe700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f5e44036870 0x7f5e44038d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009990 tx=0x7f5e48006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:05.802+0000 7f5e54ff9700 1 -- 172.21.15.82:0/3371833172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5e40011550 con 0x7f5e580fd710 2024-02-15T22:33:06.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.058+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5e5804bed0 con 0x7f5e580fd710 2024-02-15T22:33:06.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.059+0000 7f5e54ff9700 1 -- 172.21.15.82:0/3371833172 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5e40011370 con 0x7f5e580fd710 2024-02-15T22:33:06.059 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:06.059 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f5e44036870 msgr2=0x7f5e44038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f5e44036870 0x7f5e44038d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009990 tx=0x7f5e48006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 msgr2=0x7f5e580fd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580fd1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009680 tx=0x7f5e40009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 shutdown_connections 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f5e44036870 0x7f5e44038d20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 --2- 172.21.15.82:0/3371833172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e580fd710 0x7f5e580fd1a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.060+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 >> 172.21.15.82:0/3371833172 conn(0x7f5e580f7190 msgr2=0x7f5e580f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.061+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 shutdown_connections 2024-02-15T22:33:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:06.061+0000 7f5e5e37b700 1 -- 172.21.15.82:0/3371833172 wait complete. 2024-02-15T22:33:06.062 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:06.393 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:06 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/3371833172' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:07 smithi033 ceph-mon[29033]: Deploying daemon prometheus.smithi033 on smithi033 2024-02-15T22:33:07.685 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:07.686 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:07.934 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:07.981 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:09.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:08 smithi033 ceph-mon[29033]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:09.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 -- 172.21.15.82:0/1500168335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 msgr2=0x7f57f00fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 --2- 172.21.15.82:0/1500168335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f00fbed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f57e00048c0 tx=0x7f57e0009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 -- 172.21.15.82:0/1500168335 shutdown_connections 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 --2- 172.21.15.82:0/1500168335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f00fbed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 -- 172.21.15.82:0/1500168335 >> 172.21.15.82:0/1500168335 conn(0x7f57f00f71a0 msgr2=0x7f57f00f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 -- 172.21.15.82:0/1500168335 shutdown_connections 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 -- 172.21.15.82:0/1500168335 wait complete. 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 Processor -- start 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.315+0000 7f57f61b5700 1 -- start start 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57f61b5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f010fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57f61b5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0066830 con 0x7f57f00fbac0 2024-02-15T22:33:09.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f010fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:09.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f010fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:55012/0 (socket says 172.21.15.82:55012) 2024-02-15T22:33:09.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ef7fe700 1 -- 172.21.15.82:0/4019080957 learned_addr learned my addr 172.21.15.82:0/4019080957 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:09.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ef7fe700 1 -- 172.21.15.82:0/4019080957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e0005040 con 0x7f57f00fbac0 2024-02-15T22:33:09.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ef7fe700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f010fb90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009680 tx=0x7f57e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ecff9700 1 -- 172.21.15.82:0/4019080957 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e000bed0 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ecff9700 1 -- 172.21.15.82:0/4019080957 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57e000b5c0 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f0066a30 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57ecff9700 1 -- 172.21.15.82:0/4019080957 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e001c5b0 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.316+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f0110310 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.317+0000 7f57ecff9700 1 -- 172.21.15.82:0/4019080957 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f57e001c820 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.317+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f0105890 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.317+0000 7f57ecff9700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f57dc036820 0x7f57dc038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.317+0000 7f57ecff9700 1 -- 172.21.15.82:0/4019080957 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f57e0049ca0 con 0x7f57f00fbac0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.317+0000 7f57e6ffd700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f57dc036820 0x7f57dc038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:09.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.318+0000 7f57e6ffd700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f57dc036820 0x7f57dc038cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009990 tx=0x7f57d8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.322+0000 7f57ecff9700 1 -- 172.21.15.82:0/4019080957 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f57e0011550 con 0x7f57f00fbac0 2024-02-15T22:33:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.574+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f57f004bed0 con 0x7f57f00fbac0 2024-02-15T22:33:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.574+0000 7f57ecff9700 1 -- 172.21.15.82:0/4019080957 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f57e0004d30 con 0x7f57f00fbac0 2024-02-15T22:33:09.575 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:09.575 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f57dc036820 msgr2=0x7f57dc038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f57dc036820 0x7f57dc038cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009990 tx=0x7f57d8006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 msgr2=0x7f57f010fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f010fb90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009680 tx=0x7f57e0009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 shutdown_connections 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f57dc036820 0x7f57dc038cd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 --2- 172.21.15.82:0/4019080957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f00fbac0 0x7f57f010fb90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 >> 172.21.15.82:0/4019080957 conn(0x7f57f00f71a0 msgr2=0x7f57f00f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 shutdown_connections 2024-02-15T22:33:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:09.576+0000 7f57f61b5700 1 -- 172.21.15.82:0/4019080957 wait complete. 2024-02-15T22:33:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:10 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:10 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/4019080957' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:11.138 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:11.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:11.387 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:11.433 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:11.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:11 smithi033 ceph-mon[29033]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.782+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/1813832303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 msgr2=0x7f7e440fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.782+0000 7f7e4b6ab700 1 --2- 172.21.15.82:0/1813832303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fb2b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7e340048c0 tx=0x7f7e34009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.782+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/1813832303 shutdown_connections 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.782+0000 7f7e4b6ab700 1 --2- 172.21.15.82:0/1813832303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fb2b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.782+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/1813832303 >> 172.21.15.82:0/1813832303 conn(0x7f7e440f6920 msgr2=0x7f7e440f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.782+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/1813832303 shutdown_connections 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.782+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/1813832303 wait complete. 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.783+0000 7f7e4b6ab700 1 Processor -- start 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.783+0000 7f7e4b6ab700 1 -- start start 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.783+0000 7f7e4b6ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.783+0000 7f7e4b6ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440fbe40 con 0x7f7e440faea0 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.783+0000 7f7e49447700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.783+0000 7f7e49447700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:42716/0 (socket says 172.21.15.82:42716) 2024-02-15T22:33:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.783+0000 7f7e49447700 1 -- 172.21.15.82:0/2539275295 learned_addr learned my addr 172.21.15.82:0/2539275295 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.784+0000 7f7e49447700 1 -- 172.21.15.82:0/2539275295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34005040 con 0x7f7e440faea0 2024-02-15T22:33:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.784+0000 7f7e49447700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fd9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009330 tx=0x7f7e34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.784+0000 7f7e39ffb700 1 -- 172.21.15.82:0/2539275295 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e34004e60 con 0x7f7e440faea0 2024-02-15T22:33:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.784+0000 7f7e39ffb700 1 -- 172.21.15.82:0/2539275295 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e340096b0 con 0x7f7e440faea0 2024-02-15T22:33:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.784+0000 7f7e39ffb700 1 -- 172.21.15.82:0/2539275295 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e3401c5b0 con 0x7f7e440faea0 2024-02-15T22:33:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.784+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e440fc040 con 0x7f7e440faea0 2024-02-15T22:33:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.784+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e440fc530 con 0x7f7e440faea0 2024-02-15T22:33:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.785+0000 7f7e39ffb700 1 -- 172.21.15.82:0/2539275295 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f7e34013980 con 0x7f7e440faea0 2024-02-15T22:33:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.785+0000 7f7e39ffb700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f7e30036870 0x7f7e30038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.785+0000 7f7e39ffb700 1 -- 172.21.15.82:0/2539275295 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7e34049c10 con 0x7f7e440faea0 2024-02-15T22:33:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.785+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e44106950 con 0x7f7e440faea0 2024-02-15T22:33:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.785+0000 7f7e48c46700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f7e30036870 0x7f7e30038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.786+0000 7f7e48c46700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f7e30036870 0x7f7e30038d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009990 tx=0x7f7e40006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:12.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:12.791+0000 7f7e39ffb700 1 -- 172.21.15.82:0/2539275295 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7e34011550 con 0x7f7e440faea0 2024-02-15T22:33:13.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.044+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7e4402b2a0 con 0x7f7e440faea0 2024-02-15T22:33:13.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.045+0000 7f7e39ffb700 1 -- 172.21.15.82:0/2539275295 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7e34034090 con 0x7f7e440faea0 2024-02-15T22:33:13.046 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:13.046 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f7e30036870 msgr2=0x7f7e30038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f7e30036870 0x7f7e30038d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009990 tx=0x7f7e40006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 msgr2=0x7f7e440fd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fd9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009330 tx=0x7f7e34009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:13.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 shutdown_connections 2024-02-15T22:33:13.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f7e30036870 0x7f7e30038d20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:13.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 --2- 172.21.15.82:0/2539275295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e440faea0 0x7f7e440fd9c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:13.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 >> 172.21.15.82:0/2539275295 conn(0x7f7e440f6920 msgr2=0x7f7e440f76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:13.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 shutdown_connections 2024-02-15T22:33:13.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:13.047+0000 7f7e4b6ab700 1 -- 172.21.15.82:0/2539275295 wait complete. 2024-02-15T22:33:13.048 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:13.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:13 smithi033 ceph-mon[29033]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:13.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:13 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2539275295' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:14.573 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:14.573 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:14.867 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:15.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:15 smithi033 ceph-mon[29033]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:16.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 -- 172.21.15.82:0/2962279635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 msgr2=0x7f596c0fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:16.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 --2- 172.21.15.82:0/2962279635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c0fb0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59600048c0 tx=0x7f5960009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:16.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 -- 172.21.15.82:0/2962279635 shutdown_connections 2024-02-15T22:33:16.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 --2- 172.21.15.82:0/2962279635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c0fb0d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:16.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 -- 172.21.15.82:0/2962279635 >> 172.21.15.82:0/2962279635 conn(0x7f596c0f6740 msgr2=0x7f596c0f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:16.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 -- 172.21.15.82:0/2962279635 shutdown_connections 2024-02-15T22:33:16.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 -- 172.21.15.82:0/2962279635 wait complete. 2024-02-15T22:33:16.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 Processor -- start 2024-02-15T22:33:16.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.128+0000 7f5971b9d700 1 -- start start 2024-02-15T22:33:16.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.129+0000 7f5971b9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c10cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:16.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.129+0000 7f5971b9d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c10d2b0 con 0x7f596c0facc0 2024-02-15T22:33:16.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.129+0000 7f5970b9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c10cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:16.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.129+0000 7f5970b9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c10cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:42734/0 (socket says 172.21.15.82:42734) 2024-02-15T22:33:16.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.129+0000 7f5970b9b700 1 -- 172.21.15.82:0/4227743677 learned_addr learned my addr 172.21.15.82:0/4227743677 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:16.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.129+0000 7f5970b9b700 1 -- 172.21.15.82:0/4227743677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960005040 con 0x7f596c0facc0 2024-02-15T22:33:16.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.130+0000 7f5970b9b700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c10cd70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5960009040 tx=0x7f5960009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:16.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.130+0000 7f59697fa700 1 -- 172.21.15.82:0/4227743677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f596000bed0 con 0x7f596c0facc0 2024-02-15T22:33:16.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.130+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c10d4b0 con 0x7f596c0facc0 2024-02-15T22:33:16.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.130+0000 7f59697fa700 1 -- 172.21.15.82:0/4227743677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f596000b5c0 con 0x7f596c0facc0 2024-02-15T22:33:16.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.130+0000 7f59697fa700 1 -- 172.21.15.82:0/4227743677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f596001c5b0 con 0x7f596c0facc0 2024-02-15T22:33:16.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.130+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c10e070 con 0x7f596c0facc0 2024-02-15T22:33:16.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.131+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c05f5c0 con 0x7f596c0facc0 2024-02-15T22:33:16.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.131+0000 7f59697fa700 1 -- 172.21.15.82:0/4227743677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f5960004d90 con 0x7f596c0facc0 2024-02-15T22:33:16.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.131+0000 7f59697fa700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f595c036870 0x7f595c038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:16.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.131+0000 7f59697fa700 1 -- 172.21.15.82:0/4227743677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5960049a70 con 0x7f596c0facc0 2024-02-15T22:33:16.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.131+0000 7f596bfff700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f595c036870 0x7f595c038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:16.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.132+0000 7f596bfff700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f595c036870 0x7f595c038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5958009990 tx=0x7f5958006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:16.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.137+0000 7f59697fa700 1 -- 172.21.15.82:0/4227743677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f59600234e0 con 0x7f596c0facc0 2024-02-15T22:33:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.395+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f596c04bed0 con 0x7f596c0facc0 2024-02-15T22:33:16.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.396+0000 7f59697fa700 1 -- 172.21.15.82:0/4227743677 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5960023300 con 0x7f596c0facc0 2024-02-15T22:33:16.396 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:16.396 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:16.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f595c036870 msgr2=0x7f595c038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:16.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f595c036870 0x7f595c038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5958009990 tx=0x7f5958006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:16.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 msgr2=0x7f596c10cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:16.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c10cd70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5960009040 tx=0x7f5960009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 shutdown_connections 2024-02-15T22:33:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f595c036870 0x7f595c038d20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 --2- 172.21.15.82:0/4227743677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596c0facc0 0x7f596c10cd70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 >> 172.21.15.82:0/4227743677 conn(0x7f596c0f6740 msgr2=0x7f596c0f75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 shutdown_connections 2024-02-15T22:33:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:16.399+0000 7f5971b9d700 1 -- 172.21.15.82:0/4227743677 wait complete. 2024-02-15T22:33:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:17.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:17 smithi033 ceph-mon[29033]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:17.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:17 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/4227743677' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:17.887 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:17.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:18.135 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:18.182 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:19.081 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:18 smithi033 ceph-mon[29033]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:19.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 -- 172.21.15.82:0/4138281623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 msgr2=0x7f8f880fc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:19.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 --2- 172.21.15.82:0/4138281623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f880fc360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0048c0 tx=0x7f8f7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:19.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 -- 172.21.15.82:0/4138281623 shutdown_connections 2024-02-15T22:33:19.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 --2- 172.21.15.82:0/4138281623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f880fc360 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:19.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 -- 172.21.15.82:0/4138281623 >> 172.21.15.82:0/4138281623 conn(0x7f8f880f6920 msgr2=0x7f8f880f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 -- 172.21.15.82:0/4138281623 shutdown_connections 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 -- 172.21.15.82:0/4138281623 wait complete. 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.664+0000 7f8f8f090700 1 Processor -- start 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.665+0000 7f8f8f090700 1 -- start start 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.665+0000 7f8f8f090700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f88113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.665+0000 7f8f8f090700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88113a70 con 0x7f8f880fbf50 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.665+0000 7f8f8ce2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f88113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.665+0000 7f8f8ce2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f88113530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:42742/0 (socket says 172.21.15.82:42742) 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.665+0000 7f8f8ce2c700 1 -- 172.21.15.82:0/3798987668 learned_addr learned my addr 172.21.15.82:0/3798987668 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.665+0000 7f8f8ce2c700 1 -- 172.21.15.82:0/3798987668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c005040 con 0x7f8f880fbf50 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.666+0000 7f8f8ce2c700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f88113530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009300 tx=0x7f8f7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.666+0000 7f8f857fa700 1 -- 172.21.15.82:0/3798987668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f7c004e60 con 0x7f8f880fbf50 2024-02-15T22:33:19.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.666+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f88113c70 con 0x7f8f880fbf50 2024-02-15T22:33:19.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.666+0000 7f8f857fa700 1 -- 172.21.15.82:0/3798987668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f7c009680 con 0x7f8f880fbf50 2024-02-15T22:33:19.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.666+0000 7f8f857fa700 1 -- 172.21.15.82:0/3798987668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f7c01c5b0 con 0x7f8f880fbf50 2024-02-15T22:33:19.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.666+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f88114910 con 0x7f8f880fbf50 2024-02-15T22:33:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.667+0000 7f8f857fa700 1 -- 172.21.15.82:0/3798987668 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f8f7c01c870 con 0x7f8f880fbf50 2024-02-15T22:33:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.667+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8805f5c0 con 0x7f8f880fbf50 2024-02-15T22:33:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.667+0000 7f8f857fa700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8f78036870 0x7f8f78038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.667+0000 7f8f857fa700 1 -- 172.21.15.82:0/3798987668 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8f7c049c50 con 0x7f8f880fbf50 2024-02-15T22:33:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.667+0000 7f8f87fff700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8f78036870 0x7f8f78038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.667+0000 7f8f87fff700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8f78036870 0x7f8f78038d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009990 tx=0x7f8f74006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.672+0000 7f8f857fa700 1 -- 172.21.15.82:0/3798987668 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8f7c011550 con 0x7f8f880fbf50 2024-02-15T22:33:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.929+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8f88115460 con 0x7f8f880fbf50 2024-02-15T22:33:19.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.930+0000 7f8f857fa700 1 -- 172.21.15.82:0/3798987668 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8f7c011370 con 0x7f8f880fbf50 2024-02-15T22:33:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:19.929 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8f78036870 msgr2=0x7f8f78038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8f78036870 0x7f8f78038d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009990 tx=0x7f8f74006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 msgr2=0x7f8f88113530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f88113530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009300 tx=0x7f8f7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 shutdown_connections 2024-02-15T22:33:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8f78036870 0x7f8f78038d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 --2- 172.21.15.82:0/3798987668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880fbf50 0x7f8f88113530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:19.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 >> 172.21.15.82:0/3798987668 conn(0x7f8f880f6920 msgr2=0x7f8f880fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:19.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 shutdown_connections 2024-02-15T22:33:19.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:19.932+0000 7f8f8f090700 1 -- 172.21.15.82:0/3798987668 wait complete. 2024-02-15T22:33:19.932 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:20.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:19 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/3798987668' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:21.167 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:20 smithi033 ceph-mon[29033]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:21.541 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:21.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:21.789 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.295+0000 7f8241276700 1 -- 172.21.15.82:0/3331519216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 msgr2=0x7f823c0fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.295+0000 7f8241276700 1 --2- 172.21.15.82:0/3331519216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c0fcfe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8234009c60 tx=0x7f8234004d10 comp rx=0 tx=0).stop 2024-02-15T22:33:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.295+0000 7f8241276700 1 -- 172.21.15.82:0/3331519216 shutdown_connections 2024-02-15T22:33:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.295+0000 7f8241276700 1 --2- 172.21.15.82:0/3331519216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c0fcfe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.295+0000 7f8241276700 1 -- 172.21.15.82:0/3331519216 >> 172.21.15.82:0/3331519216 conn(0x7f823c0f8270 msgr2=0x7f823c0fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.295+0000 7f8241276700 1 -- 172.21.15.82:0/3331519216 shutdown_connections 2024-02-15T22:33:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.295+0000 7f8241276700 1 -- 172.21.15.82:0/3331519216 wait complete. 2024-02-15T22:33:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.296+0000 7f8241276700 1 Processor -- start 2024-02-15T22:33:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.296+0000 7f8241276700 1 -- start start 2024-02-15T22:33:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.296+0000 7f8241276700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c10cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.296+0000 7f8241276700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c10d4a0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.296+0000 7f823affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c10cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.296+0000 7f823affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c10cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:47524/0 (socket says 172.21.15.82:47524) 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.296+0000 7f823affd700 1 -- 172.21.15.82:0/677288943 learned_addr learned my addr 172.21.15.82:0/677288943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.297+0000 7f823affd700 1 -- 172.21.15.82:0/677288943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8234009940 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.297+0000 7f823affd700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c10cf60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8234015040 tx=0x7f8234004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.297+0000 7f82237fe700 1 -- 172.21.15.82:0/677288943 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8234007c80 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.297+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c10d6a0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.297+0000 7f82237fe700 1 -- 172.21.15.82:0/677288943 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f823401d910 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.297+0000 7f82237fe700 1 -- 172.21.15.82:0/677288943 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82340129f0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.297+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c10e2f0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.298+0000 7f82237fe700 1 -- 172.21.15.82:0/677288943 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f8234019040 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.298+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c05f5c0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.298+0000 7f82237fe700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8224036870 0x7f8224038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:23.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.298+0000 7f82237fe700 1 -- 172.21.15.82:0/677288943 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f823404a4e0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.298+0000 7f823a7fc700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8224036870 0x7f8224038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:23.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.299+0000 7f823a7fc700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8224036870 0x7f8224038d20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8230009990 tx=0x7f8230006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:23.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.303+0000 7f82237fe700 1 -- 172.21.15.82:0/677288943 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f823402e8f0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:23 smithi033 ceph-mon[29033]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:23.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.557+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f823c10ede0 con 0x7f823c0fcbd0 2024-02-15T22:33:23.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.558+0000 7f82237fe700 1 -- 172.21.15.82:0/677288943 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8234017030 con 0x7f823c0fcbd0 2024-02-15T22:33:23.557 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.559+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8224036870 msgr2=0x7f8224038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.559+0000 7f8241276700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8224036870 0x7f8224038d20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8230009990 tx=0x7f8230006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.559+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 msgr2=0x7f823c10cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.559+0000 7f8241276700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c10cf60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8234015040 tx=0x7f8234004d10 comp rx=0 tx=0).stop 2024-02-15T22:33:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.560+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 shutdown_connections 2024-02-15T22:33:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.560+0000 7f8241276700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7f8224036870 0x7f8224038d20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.560+0000 7f8241276700 1 --2- 172.21.15.82:0/677288943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f823c0fcbd0 0x7f823c10cf60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.560+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 >> 172.21.15.82:0/677288943 conn(0x7f823c0f8270 msgr2=0x7f823c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.560+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 shutdown_connections 2024-02-15T22:33:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:23.560+0000 7f8241276700 1 -- 172.21.15.82:0/677288943 wait complete. 2024-02-15T22:33:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:24.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:24 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/677288943' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:24.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:24 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:24.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:24 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:24.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:24 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:24.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:24 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-15T22:33:25.100 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:25.101 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:25.361 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:25.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:25 smithi033 ceph-mon[29033]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:25.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:25.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:25 smithi033 ceph-mon[29033]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-15T22:33:25.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:25 smithi033 ceph-mon[29033]: mgrmap e14: smithi033.swohxi(active, since 70s) 2024-02-15T22:33:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.728+0000 7feab6aef700 1 -- 172.21.15.82:0/4146537486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 msgr2=0x7feab00fcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.728+0000 7feab6aef700 1 --2- 172.21.15.82:0/4146537486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab00fcfc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feaa40048c0 tx=0x7feaa4009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 -- 172.21.15.82:0/4146537486 shutdown_connections 2024-02-15T22:33:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 --2- 172.21.15.82:0/4146537486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab00fcfc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 -- 172.21.15.82:0/4146537486 >> 172.21.15.82:0/4146537486 conn(0x7feab00f8330 msgr2=0x7feab00fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 -- 172.21.15.82:0/4146537486 shutdown_connections 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 -- 172.21.15.82:0/4146537486 wait complete. 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 Processor -- start 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 -- start start 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab010cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.729+0000 7feab6aef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab010d400 con 0x7feab00fcbb0 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feab488b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab010cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feab488b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab010cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:47548/0 (socket says 172.21.15.82:47548) 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feab488b700 1 -- 172.21.15.82:0/2967353604 learned_addr learned my addr 172.21.15.82:0/2967353604 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feab488b700 1 -- 172.21.15.82:0/2967353604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4005040 con 0x7feab00fcbb0 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feab488b700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab010cec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009680 tx=0x7feaa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feaad7fa700 1 -- 172.21.15.82:0/2967353604 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feaa400b5c0 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feaad7fa700 1 -- 172.21.15.82:0/2967353604 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feaa4004e60 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feaad7fa700 1 -- 172.21.15.82:0/2967353604 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feaa401c590 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab010d600 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.730+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab010e2a0 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.731+0000 7feaad7fa700 1 -- 172.21.15.82:0/2967353604 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 14) v1 ==== 43438+0+0 (secure 0 0 0) 0x7feaa4013420 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.731+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab005f5c0 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.731+0000 7feaad7fa700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 0x7feaa0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.731+0000 7feaad7fa700 1 -- 172.21.15.82:0/2967353604 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7feaa4049c20 con 0x7feab00fcbb0 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.731+0000 7feaaffff700 1 -- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 msgr2=0x7feaa0038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3209613080 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.731+0000 7feaaffff700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 0x7feaa0038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:33:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.736+0000 7feaad7fa700 1 -- 172.21.15.82:0/2967353604 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7feaa4011370 con 0x7feab00fcbb0 2024-02-15T22:33:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.932+0000 7feaaffff700 1 -- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 msgr2=0x7feaa0038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3209613080 2024-02-15T22:33:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.932+0000 7feaaffff700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 0x7feaa0038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:33:26.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.989+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feab010edf0 con 0x7feab00fcbb0 2024-02-15T22:33:26.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.990+0000 7feaad7fa700 1 -- 172.21.15.82:0/2967353604 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7feaa4011370 con 0x7feab00fcbb0 2024-02-15T22:33:26.990 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 msgr2=0x7feaa0038dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:33:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 0x7feaa0038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 msgr2=0x7feab010cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab010cec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009680 tx=0x7feaa4009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 shutdown_connections 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7feaa0036910 0x7feaa0038dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 --2- 172.21.15.82:0/2967353604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab00fcbb0 0x7feab010cec0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 >> 172.21.15.82:0/2967353604 conn(0x7feab00f8330 msgr2=0x7feab00f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 shutdown_connections 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:26.992+0000 7feab6aef700 1 -- 172.21.15.82:0/2967353604 wait complete. 2024-02-15T22:33:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:27.311 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:27 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2967353604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:28.486 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:28.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:28.735 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:28.779 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.200+0000 7fecf567a700 1 -- 172.21.15.82:0/1437087406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 msgr2=0x7fecf00fd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.200+0000 7fecf567a700 1 --2- 172.21.15.82:0/1437087406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf00fd550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fece0009c60 tx=0x7fece0004d10 comp rx=0 tx=0).stop 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.200+0000 7fecf567a700 1 -- 172.21.15.82:0/1437087406 shutdown_connections 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.200+0000 7fecf567a700 1 --2- 172.21.15.82:0/1437087406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf00fd550 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.200+0000 7fecf567a700 1 -- 172.21.15.82:0/1437087406 >> 172.21.15.82:0/1437087406 conn(0x7fecf00f6920 msgr2=0x7fecf00f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.200+0000 7fecf567a700 1 -- 172.21.15.82:0/1437087406 shutdown_connections 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.200+0000 7fecf567a700 1 -- 172.21.15.82:0/1437087406 wait complete. 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7fecf567a700 1 Processor -- start 2024-02-15T22:33:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7fecf567a700 1 -- start start 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7fecf567a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7fecf567a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00fb940 con 0x7fecf00fd140 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7feceeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7feceeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf010fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:47564/0 (socket says 172.21.15.82:47564) 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7feceeffd700 1 -- 172.21.15.82:0/4078978973 learned_addr learned my addr 172.21.15.82:0/4078978973 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7feceeffd700 1 -- 172.21.15.82:0/4078978973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0009940 con 0x7fecf00fd140 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7feceeffd700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf010fbc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fece0004e60 tx=0x7fece0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.201+0000 7fece77fe700 1 -- 172.21.15.82:0/4078978973 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fece001d440 con 0x7fecf00fd140 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.202+0000 7fece77fe700 1 -- 172.21.15.82:0/4078978973 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fece001da70 con 0x7fecf00fd140 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.202+0000 7fece77fe700 1 -- 172.21.15.82:0/4078978973 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fece0012aa0 con 0x7fecf00fd140 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.202+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf00fbb40 con 0x7fecf00fd140 2024-02-15T22:33:30.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.202+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf0110340 con 0x7fecf00fd140 2024-02-15T22:33:30.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.202+0000 7fece77fe700 1 -- 172.21.15.82:0/4078978973 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 14) v1 ==== 43438+0+0 (secure 0 0 0) 0x7fece0019040 con 0x7fecf00fd140 2024-02-15T22:33:30.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.202+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0105930 con 0x7fecf00fd140 2024-02-15T22:33:30.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.202+0000 7fece77fe700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 0x7fecdc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:30.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.203+0000 7fece77fe700 1 -- 172.21.15.82:0/4078978973 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fece004a360 con 0x7fecf00fd140 2024-02-15T22:33:30.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.203+0000 7fecee7fc700 1 -- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 msgr2=0x7fecdc038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3209613080 2024-02-15T22:33:30.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.203+0000 7fecee7fc700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 0x7fecdc038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:33:30.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.208+0000 7fece77fe700 1 -- 172.21.15.82:0/4078978973 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fece0012410 con 0x7fecf00fd140 2024-02-15T22:33:30.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.404+0000 7fecee7fc700 1 -- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 msgr2=0x7fecdc038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3209613080 2024-02-15T22:33:30.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.404+0000 7fecee7fc700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 0x7fecdc038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:33:30.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.464+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fecf004bed0 con 0x7fecf00fd140 2024-02-15T22:33:30.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.464+0000 7fece77fe700 1 -- 172.21.15.82:0/4078978973 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fece0017020 con 0x7fecf00fd140 2024-02-15T22:33:30.465 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:30.465 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 msgr2=0x7fecdc038dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 0x7fecdc038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 msgr2=0x7fecf010fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf010fbc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fece0004e60 tx=0x7fece0004d10 comp rx=0 tx=0).stop 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 shutdown_connections 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:6800/3209613080,v1:172.21.15.33:6801/3209613080] conn(0x7fecdc036910 0x7fecdc038dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 --2- 172.21.15.82:0/4078978973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecf00fd140 0x7fecf010fbc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 >> 172.21.15.82:0/4078978973 conn(0x7fecf00f6920 msgr2=0x7fecf00f7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.466+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 shutdown_connections 2024-02-15T22:33:30.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:30.467+0000 7fecf567a700 1 -- 172.21.15.82:0/4078978973 wait complete. 2024-02-15T22:33:30.468 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:30.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:30 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/4078978973' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:32.057 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:32.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:32.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: Active manager daemon smithi033.swohxi restarted 2024-02-15T22:33:32.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: Activating manager daemon smithi033.swohxi 2024-02-15T22:33:32.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: osdmap e5: 0 total, 0 up, 0 in 2024-02-15T22:33:32.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: mgrmap e15: smithi033.swohxi(active, starting, since 0.00295841s) 2024-02-15T22:33:32.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:33:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:33.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:33:33.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:33:33.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:33:33.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:33.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:33.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:32 smithi033 ceph-mon[29033]: mgrmap e16: smithi033.swohxi(active, since 1.00578s) 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.836+0000 7fa957c09700 1 -- 172.21.15.82:0/379233795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 msgr2=0x7fa9500fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.836+0000 7fa957c09700 1 --2- 172.21.15.82:0/379233795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa9500fbee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0048c0 tx=0x7fa94c009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.836+0000 7fa957c09700 1 -- 172.21.15.82:0/379233795 shutdown_connections 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.836+0000 7fa957c09700 1 --2- 172.21.15.82:0/379233795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa9500fbee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.836+0000 7fa957c09700 1 -- 172.21.15.82:0/379233795 >> 172.21.15.82:0/379233795 conn(0x7fa9500f7190 msgr2=0x7fa9500f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.836+0000 7fa957c09700 1 -- 172.21.15.82:0/379233795 shutdown_connections 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.836+0000 7fa957c09700 1 -- 172.21.15.82:0/379233795 wait complete. 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.837+0000 7fa957c09700 1 Processor -- start 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.837+0000 7fa957c09700 1 -- start start 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.837+0000 7fa957c09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa95010fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.837+0000 7fa957c09700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa950065d60 con 0x7fa9500fbad0 2024-02-15T22:33:33.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.837+0000 7fa9559a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa95010fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.837+0000 7fa9559a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa95010fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:57664/0 (socket says 172.21.15.82:57664) 2024-02-15T22:33:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.837+0000 7fa9559a5700 1 -- 172.21.15.82:0/3321215831 learned_addr learned my addr 172.21.15.82:0/3321215831 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.838+0000 7fa9559a5700 1 -- 172.21.15.82:0/3321215831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c005040 con 0x7fa9500fbad0 2024-02-15T22:33:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.838+0000 7fa9559a5700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa95010fbd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009680 tx=0x7fa94c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.838+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa94c00bed0 con 0x7fa9500fbad0 2024-02-15T22:33:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.838+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa950065f60 con 0x7fa9500fbad0 2024-02-15T22:33:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.838+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa94c00b5c0 con 0x7fa9500fbad0 2024-02-15T22:33:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.838+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa94c01c5b0 con 0x7fa9500fbad0 2024-02-15T22:33:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.838+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa950110350 con 0x7fa9500fbad0 2024-02-15T22:33:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.839+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 43289+0+0 (secure 0 0 0) 0x7fa94c013420 con 0x7fa9500fbad0 2024-02-15T22:33:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.839+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9501058a0 con 0x7fa9500fbad0 2024-02-15T22:33:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.839+0000 7fa9467fc700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa93c0366b0 0x7fa93c038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.839+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa94c049940 con 0x7fa9500fbad0 2024-02-15T22:33:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.839+0000 7fa9551a4700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa93c0366b0 0x7fa93c038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.840+0000 7fa9551a4700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa93c0366b0 0x7fa93c038b60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa940009990 tx=0x7fa940006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:33.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.844+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa94c025400 con 0x7fa9500fbad0 2024-02-15T22:33:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:33.906+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7fa94c013a80 con 0x7fa9500fbad0 2024-02-15T22:33:34.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.113+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa95004bed0 con 0x7fa9500fbad0 2024-02-15T22:33:34.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.114+0000 7fa9467fc700 1 -- 172.21.15.82:0/3321215831 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa94c023300 con 0x7fa9500fbad0 2024-02-15T22:33:34.115 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:34.115 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa93c0366b0 msgr2=0x7fa93c038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa93c0366b0 0x7fa93c038b60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa940009990 tx=0x7fa940006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 msgr2=0x7fa95010fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa95010fbd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009680 tx=0x7fa94c009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 shutdown_connections 2024-02-15T22:33:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa93c0366b0 0x7fa93c038b60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 --2- 172.21.15.82:0/3321215831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9500fbad0 0x7fa95010fbd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 >> 172.21.15.82:0/3321215831 conn(0x7fa9500f7190 msgr2=0x7fa9500f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 shutdown_connections 2024-02-15T22:33:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:34.117+0000 7fa957c09700 1 -- 172.21.15.82:0/3321215831 wait complete. 2024-02-15T22:33:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:34.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:33 smithi033 ceph-mon[29033]: [15/Feb/2024:22:33:32] ENGINE Bus STARTING 2024-02-15T22:33:34.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:33 smithi033 ceph-mon[29033]: [15/Feb/2024:22:33:32] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:33:34.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:33 smithi033 ceph-mon[29033]: [15/Feb/2024:22:33:32] ENGINE Bus STARTED 2024-02-15T22:33:35.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:34 smithi033 ceph-mon[29033]: mgrmap e17: smithi033.swohxi(active, since 2s) 2024-02-15T22:33:35.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:34 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:35.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:34 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/3321215831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:35.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:34 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:35.703 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:35.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:36.498 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:33:37.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:37.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:37.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:37.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:37.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:33:38.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.909+0000 7f995e111700 1 -- 172.21.15.82:0/1174809327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 msgr2=0x7f9958101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.909+0000 7f995e111700 1 --2- 172.21.15.82:0/1174809327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f9958101fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99480048c0 tx=0x7f9948009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.909+0000 7f995e111700 1 -- 172.21.15.82:0/1174809327 shutdown_connections 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.909+0000 7f995e111700 1 --2- 172.21.15.82:0/1174809327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f9958101fa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.909+0000 7f995e111700 1 -- 172.21.15.82:0/1174809327 >> 172.21.15.82:0/1174809327 conn(0x7f99580720e0 msgr2=0x7f99580724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.909+0000 7f995e111700 1 -- 172.21.15.82:0/1174809327 shutdown_connections 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.909+0000 7f995e111700 1 -- 172.21.15.82:0/1174809327 wait complete. 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f995e111700 1 Processor -- start 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f995e111700 1 -- start start 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f995e111700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f995810e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f995e111700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995810e610 con 0x7f9958101bd0 2024-02-15T22:33:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f99577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f995810e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f99577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f995810e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:57692/0 (socket says 172.21.15.82:57692) 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f99577fe700 1 -- 172.21.15.82:0/3198702519 learned_addr learned my addr 172.21.15.82:0/3198702519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.910+0000 7f99577fe700 1 -- 172.21.15.82:0/3198702519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948005040 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.911+0000 7f99577fe700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f995810e0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9948009b80 tx=0x7f9948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.911+0000 7f993ffff700 1 -- 172.21.15.82:0/3198702519 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f994800be50 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.911+0000 7f993ffff700 1 -- 172.21.15.82:0/3198702519 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9948009620 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.911+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995810e810 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.911+0000 7f993ffff700 1 -- 172.21.15.82:0/3198702519 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f994801c5b0 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.911+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995810ec80 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.912+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9958100ec0 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.912+0000 7f993ffff700 1 -- 172.21.15.82:0/3198702519 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f994801c710 con 0x7f9958101bd0 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.912+0000 7f993ffff700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f99400369b0 0x7f9940038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.912+0000 7f993ffff700 1 -- 172.21.15.82:0/3198702519 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9948049b20 con 0x7f9958101bd0 2024-02-15T22:33:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.912+0000 7f9956ffd700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f99400369b0 0x7f9940038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.913+0000 7f9956ffd700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f99400369b0 0x7f9940038e60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f994c009990 tx=0x7f994c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:38.917+0000 7f993ffff700 1 -- 172.21.15.82:0/3198702519 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9948025400 con 0x7f9958101bd0 2024-02-15T22:33:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.186+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f995804bed0 con 0x7f9958101bd0 2024-02-15T22:33:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.187+0000 7f993ffff700 1 -- 172.21.15.82:0/3198702519 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9948011b60 con 0x7f9958101bd0 2024-02-15T22:33:39.187 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:39.188 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.189+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f99400369b0 msgr2=0x7f9940038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.189+0000 7f995e111700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f99400369b0 0x7f9940038e60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f994c009990 tx=0x7f994c006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.189+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 msgr2=0x7f995810e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.189+0000 7f995e111700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f995810e0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9948009b80 tx=0x7f9948009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.190+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 shutdown_connections 2024-02-15T22:33:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.190+0000 7f995e111700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f99400369b0 0x7f9940038e60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.190+0000 7f995e111700 1 --2- 172.21.15.82:0/3198702519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9958101bd0 0x7f995810e0d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:39.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.190+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 >> 172.21.15.82:0/3198702519 conn(0x7f99580720e0 msgr2=0x7f99580f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:39.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.190+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 shutdown_connections 2024-02-15T22:33:39.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:39.190+0000 7f995e111700 1 -- 172.21.15.82:0/3198702519 wait complete. 2024-02-15T22:33:39.191 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:39.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:39.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:33:39.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T22:33:39.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:40.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:39 smithi033 ceph-mon[29033]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:33:40.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:39 smithi033 ceph-mon[29033]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:33:40.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:39 smithi033 ceph-mon[29033]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:33:40.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:39 smithi033 ceph-mon[29033]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:33:40.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:39 smithi033 ceph-mon[29033]: Deploying daemon crash.smithi082 on smithi082 2024-02-15T22:33:40.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:39 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/3198702519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:41.315 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:41.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:43.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:43.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:43.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:43.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:43.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:42 smithi033 ceph-mon[29033]: Deploying daemon node-exporter.smithi082 on smithi082 2024-02-15T22:33:43.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.462+0000 7f1294553700 1 -- 172.21.15.82:0/3571244521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 msgr2=0x7f128c0fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.462+0000 7f1294553700 1 --2- 172.21.15.82:0/3571244521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c0fe020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12880048c0 tx=0x7f1288009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.462+0000 7f1294553700 1 -- 172.21.15.82:0/3571244521 shutdown_connections 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.462+0000 7f1294553700 1 --2- 172.21.15.82:0/3571244521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c0fe020 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.462+0000 7f1294553700 1 -- 172.21.15.82:0/3571244521 >> 172.21.15.82:0/3571244521 conn(0x7f128c072850 msgr2=0x7f128c072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.462+0000 7f1294553700 1 -- 172.21.15.82:0/3571244521 shutdown_connections 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.462+0000 7f1294553700 1 -- 172.21.15.82:0/3571244521 wait complete. 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f1294553700 1 Processor -- start 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f1294553700 1 -- start start 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f1294553700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f1294553700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c113500 con 0x7f128c0fdc50 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f12922ef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f12922ef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:51516/0 (socket says 172.21.15.82:51516) 2024-02-15T22:33:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f12922ef700 1 -- 172.21.15.82:0/893871745 learned_addr learned my addr 172.21.15.82:0/893871745 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:43.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.463+0000 7f12922ef700 1 -- 172.21.15.82:0/893871745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288005040 con 0x7f128c0fdc50 2024-02-15T22:33:43.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.464+0000 7f12922ef700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c112fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1288009300 tx=0x7f1288009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:43.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.464+0000 7f1282ffd700 1 -- 172.21.15.82:0/893871745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1288004e60 con 0x7f128c0fdc50 2024-02-15T22:33:43.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.464+0000 7f1282ffd700 1 -- 172.21.15.82:0/893871745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1288013420 con 0x7f128c0fdc50 2024-02-15T22:33:43.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.464+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c113700 con 0x7f128c0fdc50 2024-02-15T22:33:43.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.464+0000 7f1282ffd700 1 -- 172.21.15.82:0/893871745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f128801c5b0 con 0x7f128c0fdc50 2024-02-15T22:33:43.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.464+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c113b70 con 0x7f128c0fdc50 2024-02-15T22:33:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.465+0000 7f1282ffd700 1 -- 172.21.15.82:0/893871745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f1288009600 con 0x7f128c0fdc50 2024-02-15T22:33:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.465+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c05f5c0 con 0x7f128c0fdc50 2024-02-15T22:33:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.465+0000 7f1282ffd700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1278036960 0x7f1278038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.465+0000 7f1282ffd700 1 -- 172.21.15.82:0/893871745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1288049b80 con 0x7f128c0fdc50 2024-02-15T22:33:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.465+0000 7f1291aee700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1278036960 0x7f1278038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.465+0000 7f1291aee700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1278036960 0x7f1278038e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f127c009990 tx=0x7f127c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.470+0000 7f1282ffd700 1 -- 172.21.15.82:0/893871745 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1288025400 con 0x7f128c0fdc50 2024-02-15T22:33:43.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.751+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f128c106f30 con 0x7f128c0fdc50 2024-02-15T22:33:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:43.754 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:43.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.752+0000 7f1282ffd700 1 -- 172.21.15.82:0/893871745 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1288011370 con 0x7f128c0fdc50 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.755+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1278036960 msgr2=0x7f1278038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.755+0000 7f1294553700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1278036960 0x7f1278038e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f127c009990 tx=0x7f127c006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.755+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 msgr2=0x7f128c112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.755+0000 7f1294553700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c112fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1288009300 tx=0x7f1288009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.755+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 shutdown_connections 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.755+0000 7f1294553700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1278036960 0x7f1278038e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.756+0000 7f1294553700 1 --2- 172.21.15.82:0/893871745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f128c0fdc50 0x7f128c112fc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:43.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.756+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 >> 172.21.15.82:0/893871745 conn(0x7f128c072850 msgr2=0x7f128c101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:43.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.756+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 shutdown_connections 2024-02-15T22:33:43.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:43.756+0000 7f1294553700 1 -- 172.21.15.82:0/893871745 wait complete. 2024-02-15T22:33:43.757 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:44.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:43 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/893871745' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:45.299 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:45.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:45.557 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.079+0000 7f2b098f0700 1 -- 172.21.15.82:0/3892895698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 msgr2=0x7f2b04101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.079+0000 7f2b098f0700 1 --2- 172.21.15.82:0/3892895698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04101ed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2af40048c0 tx=0x7f2af4009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.079+0000 7f2b098f0700 1 -- 172.21.15.82:0/3892895698 shutdown_connections 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.079+0000 7f2b098f0700 1 --2- 172.21.15.82:0/3892895698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04101ed0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.079+0000 7f2b098f0700 1 -- 172.21.15.82:0/3892895698 >> 172.21.15.82:0/3892895698 conn(0x7f2b040720e0 msgr2=0x7f2b040724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.079+0000 7f2b098f0700 1 -- 172.21.15.82:0/3892895698 shutdown_connections 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.079+0000 7f2b098f0700 1 -- 172.21.15.82:0/3892895698 wait complete. 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b098f0700 1 Processor -- start 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b098f0700 1 -- start start 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b098f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04119640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b098f0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04119b80 con 0x7f2b04101b00 2024-02-15T22:33:48.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04119640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04119640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:51536/0 (socket says 172.21.15.82:51536) 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b02ffd700 1 -- 172.21.15.82:0/2344375487 learned_addr learned my addr 172.21.15.82:0/2344375487 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.080+0000 7f2b02ffd700 1 -- 172.21.15.82:0/2344375487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4005040 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.081+0000 7f2b02ffd700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04119640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009b80 tx=0x7f2af4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.081+0000 7f2aeb7fe700 1 -- 172.21.15.82:0/2344375487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af400be50 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.081+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b04119d80 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.081+0000 7f2aeb7fe700 1 -- 172.21.15.82:0/2344375487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2af4009620 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.081+0000 7f2aeb7fe700 1 -- 172.21.15.82:0/2344375487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af4025560 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.081+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0411a1f0 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.082+0000 7f2aeb7fe700 1 -- 172.21.15.82:0/2344375487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f2af4013420 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.082+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0405f5c0 con 0x7f2b04101b00 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.082+0000 7f2aeb7fe700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2aec036960 0x7f2aec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:48.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.082+0000 7f2aeb7fe700 1 -- 172.21.15.82:0/2344375487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2af4049bf0 con 0x7f2b04101b00 2024-02-15T22:33:48.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.082+0000 7f2b027fc700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2aec036960 0x7f2aec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:48.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.082+0000 7f2b027fc700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2aec036960 0x7f2aec038e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009990 tx=0x7f2af8006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:48.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.087+0000 7f2aeb7fe700 1 -- 172.21.15.82:0/2344375487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2af40119c0 con 0x7f2b04101b00 2024-02-15T22:33:48.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:48.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:33:48.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.348+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2b04114cf0 con 0x7f2b04101b00 2024-02-15T22:33:48.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.348+0000 7f2aeb7fe700 1 -- 172.21.15.82:0/2344375487 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2af4011370 con 0x7f2b04101b00 2024-02-15T22:33:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:48.349 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:48.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2aec036960 msgr2=0x7f2aec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:48.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2aec036960 0x7f2aec038e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009990 tx=0x7f2af8006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:48.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 msgr2=0x7f2b04119640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:48.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04119640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009b80 tx=0x7f2af4009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:48.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 shutdown_connections 2024-02-15T22:33:48.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2aec036960 0x7f2aec038e10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:48.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 --2- 172.21.15.82:0/2344375487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b04101b00 0x7f2b04119640 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:48.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 >> 172.21.15.82:0/2344375487 conn(0x7f2b040720e0 msgr2=0x7f2b0410b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:48.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 shutdown_connections 2024-02-15T22:33:48.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:48.350+0000 7f2b098f0700 1 -- 172.21.15.82:0/2344375487 wait complete. 2024-02-15T22:33:48.353 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:49.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:48 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2344375487' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:50.400 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:50.401 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:50.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:50 smithi033 ceph-mon[29033]: Deploying daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:33:50.661 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.226+0000 7ffbb115a700 1 -- 172.21.15.82:0/1088459678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 msgr2=0x7ffbac0fe000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.226+0000 7ffbb115a700 1 --2- 172.21.15.82:0/1088459678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac0fe000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffba00048c0 tx=0x7ffba0009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.226+0000 7ffbb115a700 1 -- 172.21.15.82:0/1088459678 shutdown_connections 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.226+0000 7ffbb115a700 1 --2- 172.21.15.82:0/1088459678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac0fe000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.226+0000 7ffbb115a700 1 -- 172.21.15.82:0/1088459678 >> 172.21.15.82:0/1088459678 conn(0x7ffbac0f7660 msgr2=0x7ffbac0f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.226+0000 7ffbb115a700 1 -- 172.21.15.82:0/1088459678 shutdown_connections 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.226+0000 7ffbb115a700 1 -- 172.21.15.82:0/1088459678 wait complete. 2024-02-15T22:33:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.227+0000 7ffbb115a700 1 Processor -- start 2024-02-15T22:33:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.227+0000 7ffbb115a700 1 -- start start 2024-02-15T22:33:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.227+0000 7ffbb115a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.227+0000 7ffbb115a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac113520 con 0x7ffbac0fdc30 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.227+0000 7ffbaad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.227+0000 7ffbaad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:36886/0 (socket says 172.21.15.82:36886) 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.227+0000 7ffbaad9d700 1 -- 172.21.15.82:0/387151526 learned_addr learned my addr 172.21.15.82:0/387151526 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.228+0000 7ffbaad9d700 1 -- 172.21.15.82:0/387151526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0005040 con 0x7ffbac0fdc30 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.228+0000 7ffbaad9d700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac112fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009300 tx=0x7ffba0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.228+0000 7ffb937fe700 1 -- 172.21.15.82:0/387151526 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffba0004e60 con 0x7ffbac0fdc30 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.228+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac113720 con 0x7ffbac0fdc30 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.228+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac113b90 con 0x7ffbac0fdc30 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.228+0000 7ffb937fe700 1 -- 172.21.15.82:0/387151526 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffba0013420 con 0x7ffbac0fdc30 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.228+0000 7ffb937fe700 1 -- 172.21.15.82:0/387151526 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffba000e040 con 0x7ffbac0fdc30 2024-02-15T22:33:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.229+0000 7ffb937fe700 1 -- 172.21.15.82:0/387151526 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7ffba0025400 con 0x7ffbac0fdc30 2024-02-15T22:33:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.229+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb980052e0 con 0x7ffbac0fdc30 2024-02-15T22:33:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.229+0000 7ffb937fe700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ffb94036990 0x7ffb94038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.230+0000 7ffb937fe700 1 -- 172.21.15.82:0/387151526 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ffba0013a90 con 0x7ffbac0fdc30 2024-02-15T22:33:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.230+0000 7ffbaa59c700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ffb94036990 0x7ffb94038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.230+0000 7ffbaa59c700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ffb94036990 0x7ffb94038e40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009990 tx=0x7ffb9c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:52.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.235+0000 7ffb937fe700 1 -- 172.21.15.82:0/387151526 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ffba0011960 con 0x7ffbac0fdc30 2024-02-15T22:33:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.514+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffb98005590 con 0x7ffbac0fdc30 2024-02-15T22:33:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.515+0000 7ffb937fe700 1 -- 172.21.15.82:0/387151526 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ffba0023560 con 0x7ffbac0fdc30 2024-02-15T22:33:52.516 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ffb94036990 msgr2=0x7ffb94038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ffb94036990 0x7ffb94038e40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009990 tx=0x7ffb9c006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 msgr2=0x7ffbac112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac112fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009300 tx=0x7ffba0009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 shutdown_connections 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ffb94036990 0x7ffb94038e40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 --2- 172.21.15.82:0/387151526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbac0fdc30 0x7ffbac112fe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 >> 172.21.15.82:0/387151526 conn(0x7ffbac0f7660 msgr2=0x7ffbac101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 shutdown_connections 2024-02-15T22:33:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:52.517+0000 7ffbb115a700 1 -- 172.21.15.82:0/387151526 wait complete. 2024-02-15T22:33:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/387151526' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:53.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:53.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:33:53.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:54.251 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:54.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:54.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:53 smithi033 ceph-mon[29033]: Deploying daemon mon.smithi082 on smithi082 2024-02-15T22:33:55.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:54 smithi033 ceph-mon[29033]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:55.452 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:57.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:56 smithi033 ceph-mon[29033]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.497+0000 7f327635c700 1 -- 172.21.15.82:0/2723913229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 msgr2=0x7f32700fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.497+0000 7f327635c700 1 --2- 172.21.15.82:0/2723913229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fe020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f32600048c0 tx=0x7f3260009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:57.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.497+0000 7f327635c700 1 -- 172.21.15.82:0/2723913229 shutdown_connections 2024-02-15T22:33:57.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.497+0000 7f327635c700 1 --2- 172.21.15.82:0/2723913229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fe020 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:57.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.497+0000 7f327635c700 1 -- 172.21.15.82:0/2723913229 >> 172.21.15.82:0/2723913229 conn(0x7f3270072850 msgr2=0x7f3270072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:57.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.497+0000 7f327635c700 1 -- 172.21.15.82:0/2723913229 shutdown_connections 2024-02-15T22:33:57.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.497+0000 7f327635c700 1 -- 172.21.15.82:0/2723913229 wait complete. 2024-02-15T22:33:57.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.498+0000 7f327635c700 1 Processor -- start 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.498+0000 7f327635c700 1 -- start start 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.498+0000 7f327635c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.498+0000 7f327635c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3270110dd0 con 0x7f32700fdc50 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.499+0000 7f326ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.499+0000 7f326ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.82:36906/0 (socket says 172.21.15.82:36906) 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.499+0000 7f326ffff700 1 -- 172.21.15.82:0/1638620999 learned_addr learned my addr 172.21.15.82:0/1638620999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.499+0000 7f326ffff700 1 -- 172.21.15.82:0/1638620999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260005040 con 0x7f32700fdc50 2024-02-15T22:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.499+0000 7f326ffff700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fba80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3260009330 tx=0x7f3260009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.499+0000 7f326cff9700 1 -- 172.21.15.82:0/1638620999 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f326000be50 con 0x7f32700fdc50 2024-02-15T22:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.500+0000 7f326cff9700 1 -- 172.21.15.82:0/1638620999 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3260009630 con 0x7f32700fdc50 2024-02-15T22:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.500+0000 7f326cff9700 1 -- 172.21.15.82:0/1638620999 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f326001c3f0 con 0x7f32700fdc50 2024-02-15T22:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.500+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3270110fd0 con 0x7f32700fdc50 2024-02-15T22:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.500+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32700fc1e0 con 0x7f32700fdc50 2024-02-15T22:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.500+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32701042f0 con 0x7f32700fdc50 2024-02-15T22:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.501+0000 7f326cff9700 1 -- 172.21.15.82:0/1638620999 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f326001c6b0 con 0x7f32700fdc50 2024-02-15T22:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.501+0000 7f326cff9700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3258036960 0x7f3258038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.501+0000 7f326cff9700 1 -- 172.21.15.82:0/1638620999 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3260049ab0 con 0x7f32700fdc50 2024-02-15T22:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.501+0000 7f326f7fe700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3258036960 0x7f3258038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.502+0000 7f326f7fe700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3258036960 0x7f3258038e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3264009990 tx=0x7f3264006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:33:57.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.506+0000 7f326cff9700 1 -- 172.21.15.82:0/1638620999 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3260025400 con 0x7f32700fdc50 2024-02-15T22:33:57.677 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 podman[37097]: 2024-02-15 22:33:57.617516369 +0000 UTC m=+0.131327202 container create 6540eb082c8bccfe6b0c546161e065d31f806cc35a024cf947fcbbea33897038 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, RELEASE=quincy-9aa5233, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131) 2024-02-15T22:33:57.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.796+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f32700fd1c0 con 0x7f32700fdc50 2024-02-15T22:33:57.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.797+0000 7f326cff9700 1 -- 172.21.15.82:0/1638620999 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3260025400 con 0x7f32700fdc50 2024-02-15T22:33:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:33:57.798 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:31:04.857772Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:33:57.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3258036960 msgr2=0x7f3258038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3258036960 0x7f3258038e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3264009990 tx=0x7f3264006e40 comp rx=0 tx=0).stop 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 msgr2=0x7f32700fba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fba80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3260009330 tx=0x7f3260009e30 comp rx=0 tx=0).stop 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 shutdown_connections 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3258036960 0x7f3258038e10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 --2- 172.21.15.82:0/1638620999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32700fdc50 0x7f32700fba80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 >> 172.21.15.82:0/1638620999 conn(0x7f3270072850 msgr2=0x7f3270101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 shutdown_connections 2024-02-15T22:33:57.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:33:57.799+0000 7f327635c700 1 -- 172.21.15.82:0/1638620999 wait complete. 2024-02-15T22:33:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-02-15T22:33:57.937 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 podman[37097]: 2024-02-15 22:33:57.87047323 +0000 UTC m=+0.384284015 container init 6540eb082c8bccfe6b0c546161e065d31f806cc35a024cf947fcbbea33897038 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, ceph=True, RELEASE=quincy-9aa5233, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=) 2024-02-15T22:33:57.937 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 podman[37097]: 2024-02-15 22:33:57.874073775 +0000 UTC m=+0.387884566 container start 6540eb082c8bccfe6b0c546161e065d31f806cc35a024cf947fcbbea33897038 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-9aa5233, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=) 2024-02-15T22:33:57.937 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: set uid:gid to 167:167 (ceph:ceph) 2024-02-15T22:33:57.937 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable), process ceph-mon, pid 2 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pidfile_write: ignore empty --pid-file 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: load: jerasure load: lrc 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: RocksDB version: 6.15.5 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Compile date Feb 13 2024 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: DB SUMMARY 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: DB Session ID: EYGNR88R0UPYQHNZHNOH 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: CURRENT file: CURRENT 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: IDENTITY file: IDENTITY 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi082/store.db dir, Total Num: 0, files: 2024-02-15T22:33:57.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi082/store.db: 000004.log size: 511 ; 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.error_if_exists: 0 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.create_if_missing: 0 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.paranoid_checks: 1 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.env: 0x55d2348efa80 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.fs: Posix File System 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.info_log: 0x55d23605dcc0 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_file_opening_threads: 16 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.statistics: (nil) 2024-02-15T22:33:57.939 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.use_fsync: 0 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_log_file_size: 0 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.keep_log_file_num: 1000 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.recycle_log_file_num: 0 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.allow_fallocate: 1 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.allow_mmap_reads: 0 2024-02-15T22:33:57.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.allow_mmap_writes: 0 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.use_direct_reads: 0 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.create_missing_column_families: 0 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.db_log_dir: 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi082/store.db 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.advise_random_on_open: 1 2024-02-15T22:33:57.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.db_write_buffer_size: 0 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.write_buffer_manager: 0x55d236dd2b40 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.rate_limiter: (nil) 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.wal_recovery_mode: 2 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.enable_thread_tracking: 0 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.enable_pipelined_write: 0 2024-02-15T22:33:57.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.unordered_write: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.row_cache: None 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.wal_filter: None 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.allow_ingest_behind: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.preserve_deletes: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.two_write_queues: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.manual_wal_flush: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.atomic_flush: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T22:33:57.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.log_readahead_size: 0 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.best_efforts_recovery: 0 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.allow_data_in_errors: 0 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.db_host_id: __hostname__ 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_background_jobs: 2 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_background_compactions: -1 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_subcompactions: 1 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T22:33:57.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_total_wal_size: 0 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_open_files: -1 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bytes_per_sync: 0 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_readahead_size: 0 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_background_flushes: -1 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Compression algorithms supported: 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T22:33:57.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kZSTD supported: 0 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kXpressCompression supported: 0 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kLZ4HCCompression supported: 1 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kZlibCompression supported: 1 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kSnappyCompression supported: 1 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kLZ4Compression supported: 1 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: kBZip2Compression supported: 0 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000003 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.merge_operator: 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_filter: None 2024-02-15T22:33:57.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_filter_factory: None 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.sst_partitioner_factory: None 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d2360b2f58) 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_type: 0 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_index_type: 0 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_shortening: 1 2024-02-15T22:33:57.948 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: hash_index_allow_collision: 1 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: checksum: 1 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: no_block_cache: 0 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache: 0x55d2360e5090 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_options: 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: capacity : 536870912 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_shard_bits : 4 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: strict_capacity_limit : 0 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_compressed: (nil) 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: persistent_cache: (nil) 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size: 4096 2024-02-15T22:33:57.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size_deviation: 10 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_restart_interval: 16 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_block_restart_interval: 1 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_block_size: 4096 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: partition_filters: 0 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: use_delta_encoding: 1 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: whole_key_filtering: 1 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: verify_compression: 0 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: format_version: 4 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_index_compression: 1 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_align: 0 2024-02-15T22:33:57.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.write_buffer_size: 33554432 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_write_buffer_number: 2 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression: NoCompression 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression: Disabled 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.prefix_extractor: nullptr 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.num_levels: 7 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T22:33:57.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression_opts.level: 32767 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression_opts.strategy: 0 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compression_opts.enabled: false 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.target_file_size_base: 67108864 2024-02-15T22:33:57.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T22:33:57.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.arena_block_size: 4194304 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.disable_auto_compactions: 0 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T22:33:57.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.table_properties_collectors: 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.inplace_update_support: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.bloom_locality: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.max_successive_merges: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.paranoid_file_checks: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.force_consistency_checks: 1 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.report_bg_io_stats: 0 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.ttl: 2592000 2024-02-15T22:33:57.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.enable_blob_files: false 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.min_blob_size: 0 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.blob_file_size: 268435456 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036437899841, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036437900142, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708036437, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "b45157d8-910a-4e18-8792-146f50c9d510", "db_session_id": "EYGNR88R0UPYQHNZHNOH"}} 2024-02-15T22:33:57.956 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036437900452, "job": 1, "event": "recovery_finished"} 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi082/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55d236079180 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: DB pointer 0x55d23614e000 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** DB Stats ** 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T22:33:57.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T22:33:57.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-15T22:33:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:33:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082 does not exist in monmap, will attempt to join an existing cluster 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: using public_addr v2:172.21.15.82:0/0 -> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: starting mon.smithi082 rank -1 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi082 fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(???) e0 preinit fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).mds e1 new map 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).mds e1 print_map 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: e1 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: legacy client fscid: -1 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: No filesystems configured 2024-02-15T22:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-15T22:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-15T22:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-15T22:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-15T22:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-15T22:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-15T22:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1991734079' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-15T22:33:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Deploying daemon grafana.smithi033 on smithi033 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1991734079' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: osdmap e4: 0 total, 0 up, 0 in 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi033:172.21.15.33=smithi033;smithi082:172.21.15.82=smithi082", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:33:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Saving service mon spec with placement smithi033:172.21.15.33=smithi033;smithi082:172.21.15.82=smithi082;count:2 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2998733929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/1271666776' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/3377566674' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/3029314863' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/3371833172' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Deploying daemon prometheus.smithi033 on smithi033 2024-02-15T22:33:57.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/4019080957' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2539275295' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/4227743677' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/3798987668' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/677288943' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14160 172.21.15.33:0/3995150395' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mgrmap e14: smithi033.swohxi(active, since 70s) 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2967353604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/4078978973' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Active manager daemon smithi033.swohxi restarted 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Activating manager daemon smithi033.swohxi 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: osdmap e5: 0 total, 0 up, 0 in 2024-02-15T22:33:57.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mgrmap e15: smithi033.swohxi(active, starting, since 0.00295841s) 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mgrmap e16: smithi033.swohxi(active, since 1.00578s) 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: [15/Feb/2024:22:33:32] ENGINE Bus STARTING 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: [15/Feb/2024:22:33:32] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: [15/Feb/2024:22:33:32] ENGINE Bus STARTED 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mgrmap e17: smithi033.swohxi(active, since 2s) 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/3321215831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.971 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Deploying daemon crash.smithi082 on smithi082 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/3198702519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.972 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Deploying daemon node-exporter.smithi082 on smithi082 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/893871745' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2344375487' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.973 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Deploying daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/387151526' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:33:57.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: Deploying daemon mon.smithi082 on smithi082 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/1638620999' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 ceph-mon[37153]: mon.smithi082@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 bash[37097]: 6540eb082c8bccfe6b0c546161e065d31f806cc35a024cf947fcbbea33897038 2024-02-15T22:33:57.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:33:57 smithi082 systemd[1]: Started Ceph mon.smithi082 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:33:58.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:57 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:33:58.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:33:57 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/1638620999' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:33:59.542 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:33:59.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:33:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:34:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:34:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: mon.smithi033 calling monitor election 2024-02-15T22:34:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: mon.smithi082 calling monitor election 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: mon.smithi033 is new leader, mons smithi033,smithi082 in quorum (ranks 0,1) 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:34:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: fsmap 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: osdmap e5: 0 total, 0 up, 0 in 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: mgrmap e17: smithi033.swohxi(active, since 31s) 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: overall HEALTH_OK 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:03.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: mon.smithi033 calling monitor election 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: mon.smithi082 calling monitor election 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:03.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: mon.smithi033 is new leader, mons smithi033,smithi082 in quorum (ranks 0,1) 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: fsmap 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: osdmap e5: 0 total, 0 up, 0 in 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: mgrmap e17: smithi033.swohxi(active, since 31s) 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: overall HEALTH_OK 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/3554110584' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:04.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:04 smithi082 ceph-mon[37153]: mgrmap e18: smithi033.swohxi(active, since 31s), standbys: smithi082.mjhlse 2024-02-15T22:34:04.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:34:04.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:04.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:04.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:04.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:34:04.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:04.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.386+0000 7fe2e69f4700 1 -- 172.21.15.82:0/4148301649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 msgr2=0x7fe2c80055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:04.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.386+0000 7fe2e69f4700 1 --2- 172.21.15.82:0/4148301649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 0x7fe2c80055d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0007ea0 tx=0x7fe2d000b040 comp rx=0 tx=0).stop 2024-02-15T22:34:04.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.386+0000 7fe2e69f4700 1 -- 172.21.15.82:0/4148301649 shutdown_connections 2024-02-15T22:34:04.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.386+0000 7fe2e69f4700 1 --2- 172.21.15.82:0/4148301649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 0x7fe2c80055d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.386+0000 7fe2e69f4700 1 -- 172.21.15.82:0/4148301649 >> 172.21.15.82:0/4148301649 conn(0x7fe2e00f7740 msgr2=0x7fe2e00f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.386+0000 7fe2e69f4700 1 -- 172.21.15.82:0/4148301649 shutdown_connections 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.386+0000 7fe2e69f4700 1 -- 172.21.15.82:0/4148301649 wait complete. 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.387+0000 7fe2e69f4700 1 Processor -- start 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.387+0000 7fe2e69f4700 1 -- start start 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.387+0000 7fe2e69f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 0x7fe2e00fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.387+0000 7fe2e69f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 0x7fe2e00fe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.387+0000 7fe2e69f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e01192b0 con 0x7fe2e0101b70 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.387+0000 7fe2e69f4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e01193f0 con 0x7fe2e00fdd30 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2df7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 0x7fe2e00fe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 0x7fe2e00fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2df7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 0x7fe2e00fe1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58888/0 (socket says 172.21.15.82:58888) 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2df7fe700 1 -- 172.21.15.82:0/2168937141 learned_addr learned my addr 172.21.15.82:0/2168937141 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:34:04.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2df7fe700 1 -- 172.21.15.82:0/2168937141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 msgr2=0x7fe2e00fe1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2df7fe700 1 -- 172.21.15.82:0/2168937141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 msgr2=0x7fe2e00fe1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2df7fe700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 0x7fe2e00fe1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2df7fe700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 0x7fe2e00fe1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dffff700 1 -- 172.21.15.82:0/2168937141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 msgr2=0x7fe2e00fe1a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dffff700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 0x7fe2e00fe1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dffff700 1 -- 172.21.15.82:0/2168937141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0005040 con 0x7fe2e0101b70 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dffff700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 0x7fe2e00fd7f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009ce0 tx=0x7fe2d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dcff9700 1 -- 172.21.15.82:0/2168937141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d001b030 con 0x7fe2e0101b70 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dcff9700 1 -- 172.21.15.82:0/2168937141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2d0009890 con 0x7fe2e0101b70 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2dcff9700 1 -- 172.21.15.82:0/2168937141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d0015600 con 0x7fe2e0101b70 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e01195f0 con 0x7fe2e0101b70 2024-02-15T22:34:04.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.388+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e0119b80 con 0x7fe2e0101b70 2024-02-15T22:34:04.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.389+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e0107790 con 0x7fe2e0101b70 2024-02-15T22:34:04.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.390+0000 7fe2dcff9700 1 -- 172.21.15.82:0/2168937141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7fe2d00209f0 con 0x7fe2e0101b70 2024-02-15T22:34:04.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.390+0000 7fe2dcff9700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe2cc069360 0x7fe2cc06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:04.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.390+0000 7fe2dcff9700 1 -- 172.21.15.82:0/2168937141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe2d0087f30 con 0x7fe2e0101b70 2024-02-15T22:34:04.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.390+0000 7fe2df7fe700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe2cc069360 0x7fe2cc06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:04.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.391+0000 7fe2df7fe700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe2cc069360 0x7fe2cc06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4006fd0 tx=0x7fe2d4008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:04.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.395+0000 7fe2dcff9700 1 -- 172.21.15.82:0/2168937141 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe2d0055260 con 0x7fe2e0101b70 2024-02-15T22:34:04.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:04 smithi033 ceph-mon[29033]: mgrmap e18: smithi033.swohxi(active, since 31s), standbys: smithi082.mjhlse 2024-02-15T22:34:04.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:34:04.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:04.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:04.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:04.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:34:04.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:34:04.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.657+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe2e00fef30 con 0x7fe2e0101b70 2024-02-15T22:34:04.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.657+0000 7fe2dcff9700 1 -- 172.21.15.82:0/2168937141 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7fe2d0058880 con 0x7fe2e0101b70 2024-02-15T22:34:04.658 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-02-15T22:34:04.658 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","modified":"2024-02-15T22:33:57.925843Z","created":"2024-02-15T22:31:04.857772Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-15T22:34:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.659+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe2cc069360 msgr2=0x7fe2cc06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.659+0000 7fe2e69f4700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe2cc069360 0x7fe2cc06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4006fd0 tx=0x7fe2d4008040 comp rx=0 tx=0).stop 2024-02-15T22:34:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.659+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 msgr2=0x7fe2e00fd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.659+0000 7fe2e69f4700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 0x7fe2e00fd7f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009ce0 tx=0x7fe2d000b040 comp rx=0 tx=0).stop 2024-02-15T22:34:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.660+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 shutdown_connections 2024-02-15T22:34:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.660+0000 7fe2e69f4700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe2cc069360 0x7fe2cc06b810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.660+0000 7fe2e69f4700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e0101b70 0x7fe2e00fd7f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:04.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.660+0000 7fe2e69f4700 1 --2- 172.21.15.82:0/2168937141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2e00fdd30 0x7fe2e00fe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:04.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.660+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 >> 172.21.15.82:0/2168937141 conn(0x7fe2e00f7740 msgr2=0x7fe2e00ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:34:04.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.660+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 shutdown_connections 2024-02-15T22:34:04.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:34:04.660+0000 7fe2e69f4700 1 -- 172.21.15.82:0/2168937141 wait complete. 2024-02-15T22:34:04.661 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 2 2024-02-15T22:34:05.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:05 smithi082 ceph-mon[37153]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:05.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:05 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2168937141' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:34:05.247 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-15T22:34:05.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph config generate-minimal-conf 2024-02-15T22:34:05.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:05 smithi033 ceph-mon[29033]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:05.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:05 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2168937141' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:34:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:34:06.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:06.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:34:06.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:34:06.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:34:06.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: Reconfiguring mon.smithi033 (unknown last config time)... 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:06 smithi082 ceph-mon[37153]: Reconfiguring daemon mon.smithi033 on smithi033 2024-02-15T22:34:06.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:06.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:34:06.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:34:06.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:34:06.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: Reconfiguring mon.smithi033 (unknown last config time)... 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:06.727 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:06 smithi033 ceph-mon[29033]: Reconfiguring daemon mon.smithi033 on smithi033 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 -- 172.21.15.33:0/3803114724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 msgr2=0x7f6110103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 --2- 172.21.15.33:0/3803114724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f6110103040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f610c0048c0 tx=0x7f610c009e30 comp rx=0 tx=0).stop 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 -- 172.21.15.33:0/3803114724 shutdown_connections 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 --2- 172.21.15.33:0/3803114724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f6110103040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 -- 172.21.15.33:0/3803114724 >> 172.21.15.33:0/3803114724 conn(0x7f61100720e0 msgr2=0x7f61100724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 -- 172.21.15.33:0/3803114724 shutdown_connections 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 -- 172.21.15.33:0/3803114724 wait complete. 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 Processor -- start 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.994+0000 7f611736a700 1 -- start start 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f611736a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f61100fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f611736a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61100fc830 0x7f61100fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f611736a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110119450 con 0x7f6110102c70 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f611736a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110119590 con 0x7f61100fc830 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6115106700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f61100fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6115106700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f61100fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50166/0 (socket says 172.21.15.33:50166) 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6115106700 1 -- 172.21.15.33:0/2803391731 learned_addr learned my addr 172.21.15.33:0/2803391731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6115106700 1 -- 172.21.15.33:0/2803391731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61100fc830 msgr2=0x7f61100fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6115106700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61100fc830 0x7f61100fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6115106700 1 -- 172.21.15.33:0/2803391731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c005040 con 0x7f6110102c70 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6115106700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f61100fc2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f610c00b870 tx=0x7f610c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6105ffb700 1 -- 172.21.15.33:0/2803391731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610c00e040 con 0x7f6110102c70 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6105ffb700 1 -- 172.21.15.33:0/2803391731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f610c009660 con 0x7f6110102c70 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61101197c0 con 0x7f6110102c70 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.995+0000 7f6105ffb700 1 -- 172.21.15.33:0/2803391731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610c01c630 con 0x7f6110102c70 2024-02-15T22:34:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.996+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6110119d00 con 0x7f6110102c70 2024-02-15T22:34:07.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.997+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611005f5c0 con 0x7f6110102c70 2024-02-15T22:34:07.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.997+0000 7f6105ffb700 1 -- 172.21.15.33:0/2803391731 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7f610c0097d0 con 0x7f6110102c70 2024-02-15T22:34:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.997+0000 7f6105ffb700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f60fc069440 0x7f60fc06b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.998+0000 7f6105ffb700 1 -- 172.21.15.33:0/2803391731 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f610c086e00 con 0x7f6110102c70 2024-02-15T22:34:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.998+0000 7f6114905700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f60fc069440 0x7f60fc06b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:07.998+0000 7f6114905700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f60fc069440 0x7f60fc06b8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6100009930 tx=0x7f6100006de0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.002+0000 7f6105ffb700 1 -- 172.21.15.33:0/2803391731 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f610c0542a0 con 0x7f6110102c70 2024-02-15T22:34:08.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.196+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f61100fda60 con 0x7f6110102c70 2024-02-15T22:34:08.197 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:07 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:08.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.196+0000 7f6105ffb700 1 -- 172.21.15.33:0/2803391731 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7f610c0210f0 con 0x7f6110102c70 2024-02-15T22:34:08.197 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:34:08.197 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-02-15T22:34:08.197 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:34:08.197 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f60fc069440 msgr2=0x7f60fc06b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f60fc069440 0x7f60fc06b8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6100009930 tx=0x7f6100006de0 comp rx=0 tx=0).stop 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 msgr2=0x7f61100fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f61100fc2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f610c00b870 tx=0x7f610c009e30 comp rx=0 tx=0).stop 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 shutdown_connections 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f60fc069440 0x7f60fc06b8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6110102c70 0x7f61100fc2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 --2- 172.21.15.33:0/2803391731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61100fc830 0x7f61100fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.198+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 >> 172.21.15.33:0/2803391731 conn(0x7f61100720e0 msgr2=0x7f6110104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:34:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.199+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 shutdown_connections 2024-02-15T22:34:08.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:08.199+0000 7f611736a700 1 -- 172.21.15.33:0/2803391731 wait complete. 2024-02-15T22:34:08.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:07 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:08.935 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-15T22:34:08.936 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:34:08.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T22:34:08.967 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:34:08.967 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:34:09.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:08 smithi033 ceph-mon[29033]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:09.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:08 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2803391731' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:09.037 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:34:09.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T22:34:09.071 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:34:09.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:34:09.142 INFO:tasks.cephadm:Deploying OSDs... 2024-02-15T22:34:09.143 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:34:09.143 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T22:34:09.158 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T22:34:09.158 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-02-15T22:34:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 22:33:23.497278413 +0000 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 22:27:45.579611148 +0000 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 22:27:45.579611148 +0000 2024-02-15T22:34:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-02-15 22:27:45.579611148 +0000 2024-02-15T22:34:09.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T22:34:09.280 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T22:34:09.280 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T22:34:09.280 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000259731 s, 2.0 MB/s 2024-02-15T22:34:09.281 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T22:34:09.338 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-02-15T22:34:09.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:08 smithi082 ceph-mon[37153]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:09.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:08 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2803391731' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 22:33:23.498278398 +0000 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 22:27:45.929605929 +0000 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 22:27:45.929605929 +0000 2024-02-15T22:34:09.395 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-02-15 22:27:45.929605929 +0000 2024-02-15T22:34:09.396 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T22:34:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T22:34:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T22:34:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000245755 s, 2.1 MB/s 2024-02-15T22:34:09.470 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T22:34:09.528 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-02-15T22:34:09.582 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T22:34:09.582 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:09.582 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-02-15T22:34:09.582 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:09.583 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:09.583 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 22:33:23.498278398 +0000 2024-02-15T22:34:09.583 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 22:27:46.262600963 +0000 2024-02-15T22:34:09.583 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 22:27:46.262600963 +0000 2024-02-15T22:34:09.583 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-02-15 22:27:46.262600963 +0000 2024-02-15T22:34:09.583 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T22:34:09.649 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T22:34:09.649 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T22:34:09.649 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00022763 s, 2.2 MB/s 2024-02-15T22:34:09.650 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T22:34:09.706 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-02-15T22:34:09.761 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T22:34:09.761 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:09.761 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-15T22:34:09.761 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:09.762 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:09.762 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 22:33:23.498278398 +0000 2024-02-15T22:34:09.762 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 22:27:46.604595863 +0000 2024-02-15T22:34:09.762 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 22:27:46.604595863 +0000 2024-02-15T22:34:09.762 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-02-15 22:27:46.604595863 +0000 2024-02-15T22:34:09.762 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T22:34:09.830 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T22:34:09.830 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T22:34:09.830 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000184514 s, 2.8 MB/s 2024-02-15T22:34:09.832 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T22:34:09.886 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:34:09.887 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T22:34:09.905 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T22:34:09.905 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-02-15T22:34:09.963 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T22:34:09.963 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:09.963 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-15T22:34:09.963 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:09.963 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:09.964 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-02-15 22:33:56.693461089 +0000 2024-02-15T22:34:09.964 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-02-15 22:27:42.919315277 +0000 2024-02-15T22:34:09.964 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-02-15 22:27:42.919315277 +0000 2024-02-15T22:34:09.964 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-02-15 22:27:42.919315277 +0000 2024-02-15T22:34:09.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T22:34:10.032 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-02-15T22:34:10.032 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-02-15T22:34:10.032 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000302548 s, 1.7 MB/s 2024-02-15T22:34:10.034 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T22:34:10.092 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-02-15 22:33:56.694461070 +0000 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-02-15 22:27:43.265308214 +0000 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-02-15 22:27:43.265308214 +0000 2024-02-15T22:34:10.150 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-02-15 22:27:43.265308214 +0000 2024-02-15T22:34:10.151 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T22:34:10.217 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-02-15T22:34:10.218 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-02-15T22:34:10.218 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000198575 s, 2.6 MB/s 2024-02-15T22:34:10.219 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T22:34:10.276 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-02-15 22:33:56.694461070 +0000 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-02-15 22:27:43.595301477 +0000 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-02-15 22:27:43.595301477 +0000 2024-02-15T22:34:10.332 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-02-15 22:27:43.595301477 +0000 2024-02-15T22:34:10.333 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T22:34:10.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:10.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:10.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:10 smithi082 ceph-mon[37153]: Reconfiguring mgr.smithi033.swohxi (unknown last config time)... 2024-02-15T22:34:10.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:34:10.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:34:10.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:10.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:10 smithi082 ceph-mon[37153]: Reconfiguring daemon mgr.smithi033.swohxi on smithi033 2024-02-15T22:34:10.400 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-02-15T22:34:10.400 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-02-15T22:34:10.400 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000211116 s, 2.4 MB/s 2024-02-15T22:34:10.401 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T22:34:10.459 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-02-15 22:33:56.694461070 +0000 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-02-15 22:27:43.931294618 +0000 2024-02-15T22:34:10.515 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-02-15 22:27:43.931294618 +0000 2024-02-15T22:34:10.516 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-02-15 22:27:43.931294618 +0000 2024-02-15T22:34:10.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T22:34:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:10 smithi033 ceph-mon[29033]: Reconfiguring mgr.smithi033.swohxi (unknown last config time)... 2024-02-15T22:34:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:34:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:34:10.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:10.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:10 smithi033 ceph-mon[29033]: Reconfiguring daemon mgr.smithi033.swohxi on smithi033 2024-02-15T22:34:10.581 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-02-15T22:34:10.581 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-02-15T22:34:10.581 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000187151 s, 2.7 MB/s 2024-02-15T22:34:10.582 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T22:34:10.639 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2024-02-15T22:34:10.639 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T22:34:10.915 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:34:11.378 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:11 smithi033 ceph-mon[29033]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:11.378 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:11 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:11.378 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:11 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:11.378 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:11 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:34:11.378 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:11 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:11.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:11 smithi082 ceph-mon[37153]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:11.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:11 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:11.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:11 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:11.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:11 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:34:11.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:11 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:12.312 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:12 smithi033 ceph-mon[29033]: Reconfiguring crash.smithi033 (monmap changed)... 2024-02-15T22:34:12.313 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:12 smithi033 ceph-mon[29033]: Reconfiguring daemon crash.smithi033 on smithi033 2024-02-15T22:34:12.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:12 smithi082 ceph-mon[37153]: Reconfiguring crash.smithi033 (monmap changed)... 2024-02-15T22:34:12.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:12 smithi082 ceph-mon[37153]: Reconfiguring daemon crash.smithi033 on smithi033 2024-02-15T22:34:13.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:13 smithi033 ceph-mon[29033]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:13.386 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T22:34:13.386 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T22:34:13.386 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-02-15T22:34:13.387 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-02-15T22:34:13.387 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111726 s, 939 MB/s 2024-02-15T22:34:13.387 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-02-15T22:34:13.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:13 smithi082 ceph-mon[37153]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:14.126 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2024-02-15T22:34:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:14 smithi033 ceph-mon[29033]: Reconfiguring alertmanager.smithi033 (dependencies changed)... 2024-02-15T22:34:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:14 smithi033 ceph-mon[29033]: Reconfiguring daemon alertmanager.smithi033 on smithi033 2024-02-15T22:34:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:14 smithi033 ceph-mon[29033]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:14.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:14.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:14.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:14 smithi082 ceph-mon[37153]: Reconfiguring alertmanager.smithi033 (dependencies changed)... 2024-02-15T22:34:14.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:14 smithi082 ceph-mon[37153]: Reconfiguring daemon alertmanager.smithi033 on smithi033 2024-02-15T22:34:14.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:14 smithi082 ceph-mon[37153]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:34:17.202 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:16 smithi033 ceph-mon[29033]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:17.203 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:16 smithi082 ceph-mon[37153]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:19.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:18 smithi082 ceph-mon[37153]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:19.148 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:18 smithi033 ceph-mon[29033]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 -- 172.21.15.33:0/935391246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fbe40 msgr2=0x7fb4600fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 --2- 172.21.15.33:0/935391246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fbe40 0x7fb4600fc250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb450004940 tx=0x7fb450009e30 comp rx=0 tx=0).stop 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 -- 172.21.15.33:0/935391246 shutdown_connections 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 --2- 172.21.15.33:0/935391246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4600fcfb0 0x7fb4600fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 --2- 172.21.15.33:0/935391246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fbe40 0x7fb4600fc250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 -- 172.21.15.33:0/935391246 >> 172.21.15.33:0/935391246 conn(0x7fb4600f74e0 msgr2=0x7fb4600f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 -- 172.21.15.33:0/935391246 shutdown_connections 2024-02-15T22:34:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.164+0000 7fb464df3700 1 -- 172.21.15.33:0/935391246 wait complete. 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb464df3700 1 Processor -- start 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb464df3700 1 -- start start 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb464df3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4600fbe40 0x7fb460110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb464df3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fcfb0 0x7fb460112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb464df3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460066480 con 0x7fb4600fcfb0 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb464df3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600665c0 con 0x7fb4600fbe40 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb45dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fcfb0 0x7fb460112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb45dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fcfb0 0x7fb460112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53348/0 (socket says 172.21.15.33:53348) 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb45dd9b700 1 -- 172.21.15.33:0/2745797621 learned_addr learned my addr 172.21.15.33:0/2745797621 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb45e59c700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4600fbe40 0x7fb460110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb45dd9b700 1 -- 172.21.15.33:0/2745797621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4600fbe40 msgr2=0x7fb460110690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb45dd9b700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4600fbe40 0x7fb460110690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.165+0000 7fb45dd9b700 1 -- 172.21.15.33:0/2745797621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450005040 con 0x7fb4600fcfb0 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.166+0000 7fb45dd9b700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fcfb0 0x7fb460112be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb454002a50 tx=0x7fb4540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.166+0000 7fb44effd700 1 -- 172.21.15.33:0/2745797621 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb454007cc0 con 0x7fb4600fcfb0 2024-02-15T22:34:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.166+0000 7fb44effd700 1 -- 172.21.15.33:0/2745797621 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb45400f040 con 0x7fb4600fcfb0 2024-02-15T22:34:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.166+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb460113240 con 0x7fb4600fcfb0 2024-02-15T22:34:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.166+0000 7fb44effd700 1 -- 172.21.15.33:0/2745797621 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45400da70 con 0x7fb4600fcfb0 2024-02-15T22:34:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.166+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb460113730 con 0x7fb4600fcfb0 2024-02-15T22:34:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.167+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46004bed0 con 0x7fb4600fcfb0 2024-02-15T22:34:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.167+0000 7fb44effd700 1 -- 172.21.15.33:0/2745797621 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7fb45400dc10 con 0x7fb4600fcfb0 2024-02-15T22:34:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.168+0000 7fb44effd700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb448069210 0x7fb44806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.168+0000 7fb45e59c700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb448069210 0x7fb44806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.168+0000 7fb44effd700 1 -- 172.21.15.33:0/2745797621 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb454085710 con 0x7fb4600fcfb0 2024-02-15T22:34:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.168+0000 7fb45e59c700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb448069210 0x7fb44806b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb450004890 tx=0x7fb450009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.172+0000 7fb44effd700 1 -- 172.21.15.33:0/2745797621 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb454052aa0 con 0x7fb4600fcfb0 2024-02-15T22:34:19.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:19.399+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb460101990 con 0x7fb448069210 2024-02-15T22:34:19.933 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:19 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:34:19.933 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:19 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:34:19.933 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:19 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:20.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:19 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:34:20.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:19 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:34:20.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:19 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:21.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:21 smithi033 ceph-mon[29033]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:34:21.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:21 smithi033 ceph-mon[29033]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:21.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:21 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:21.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:21 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:21.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:21 smithi033 ceph-mon[29033]: Reconfiguring grafana.smithi033 (dependencies changed)... 2024-02-15T22:34:21.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:21 smithi033 ceph-mon[29033]: Reconfiguring daemon grafana.smithi033 on smithi033 2024-02-15T22:34:21.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:21 smithi082 ceph-mon[37153]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:34:21.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:21 smithi082 ceph-mon[37153]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:21.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:21 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:21.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:21 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:21.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:21 smithi082 ceph-mon[37153]: Reconfiguring grafana.smithi033 (dependencies changed)... 2024-02-15T22:34:21.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:21 smithi082 ceph-mon[37153]: Reconfiguring daemon grafana.smithi033 on smithi033 2024-02-15T22:34:23.425 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:23 smithi082 ceph-mon[37153]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:23.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:23 smithi033 ceph-mon[29033]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:25.335 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:25 smithi033 ceph-mon[29033]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:25.606 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:25 smithi082 ceph-mon[37153]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:26.429 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:26 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:26.429 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:26 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:26.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:26 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:26.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:26 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:27.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T22:34:27.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T22:34:27.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:27.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1973571987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "630ee5c8-c8e3-4190-878c-82aa86eb7366"}]: dispatch 2024-02-15T22:34:27.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1973571987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "630ee5c8-c8e3-4190-878c-82aa86eb7366"}]': finished 2024-02-15T22:34:27.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: osdmap e6: 1 total, 0 up, 1 in 2024-02-15T22:34:27.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:27.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:27 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1237951946' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:34:27.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T22:34:27.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T22:34:27.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:27.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1973571987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "630ee5c8-c8e3-4190-878c-82aa86eb7366"}]: dispatch 2024-02-15T22:34:27.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1973571987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "630ee5c8-c8e3-4190-878c-82aa86eb7366"}]': finished 2024-02-15T22:34:27.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: osdmap e6: 1 total, 0 up, 1 in 2024-02-15T22:34:27.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:27.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:27 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1237951946' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:34:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:28 smithi082 ceph-mon[37153]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:29.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:28 smithi033 ceph-mon[29033]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:30.957 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:30 smithi033 ceph-mon[29033]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:30 smithi082 ceph-mon[37153]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:32.157 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:32.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:31 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:33.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:32 smithi033 ceph-mon[29033]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:33.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:32 smithi082 ceph-mon[37153]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:35.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:34 smithi033 ceph-mon[29033]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:35.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:34 smithi082 ceph-mon[37153]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:37.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:37 smithi082 ceph-mon[37153]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:37.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:37.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:37.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:37 smithi082 ceph-mon[37153]: Reconfiguring crash.smithi082 (monmap changed)... 2024-02-15T22:34:37.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:34:37.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:37.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:37 smithi082 ceph-mon[37153]: Reconfiguring daemon crash.smithi082 on smithi082 2024-02-15T22:34:37.403 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:37 smithi033 ceph-mon[29033]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:37.404 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:37.404 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:37.404 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:37 smithi033 ceph-mon[29033]: Reconfiguring crash.smithi082 (monmap changed)... 2024-02-15T22:34:37.404 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:34:37.404 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:37.404 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:37 smithi033 ceph-mon[29033]: Reconfiguring daemon crash.smithi082 on smithi082 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: Deploying daemon osd.0 on smithi033 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: Reconfiguring mgr.smithi082.mjhlse (monmap changed)... 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: Reconfiguring daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:34:38.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:38 smithi033 ceph-mon[29033]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:38.807 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: Deploying daemon osd.0 on smithi033 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: Reconfiguring mgr.smithi082.mjhlse (monmap changed)... 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: Reconfiguring daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:34:38.808 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:38 smithi082 ceph-mon[37153]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:40.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:39 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:40.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:39 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:40.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:39 smithi082 ceph-mon[37153]: Reconfiguring mon.smithi082 (monmap changed)... 2024-02-15T22:34:40.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:39 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:34:40.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:39 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:34:40.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:39 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:40.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:39 smithi082 ceph-mon[37153]: Reconfiguring daemon mon.smithi082 on smithi082 2024-02-15T22:34:40.124 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:39 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:40.124 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:39 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:40.124 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:39 smithi033 ceph-mon[29033]: Reconfiguring mon.smithi082 (monmap changed)... 2024-02-15T22:34:40.124 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:39 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:34:40.124 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:39 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:34:40.124 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:39 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:40.124 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:39 smithi033 ceph-mon[29033]: Reconfiguring daemon mon.smithi082 on smithi082 2024-02-15T22:34:41.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:41.483 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.483 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.483 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:34:41.483 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:34:41.483 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:34:41.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:34:41.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:34:41.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:34:41.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:41.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:34:42.236 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:34:42.237 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:34:42.237 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:34:42.237 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:34:42.237 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:34:42.237 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:34:42.237 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:42.237 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:34:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:34:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:34:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:34:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:34:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:34:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:42 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:43.363 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:43 smithi033 ceph-mon[29033]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:43.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:43 smithi082 ceph-mon[37153]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:44.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:44.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:44.547 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:44.547 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:45.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:45 smithi033 ceph-mon[29033]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:45.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:45 smithi082 ceph-mon[37153]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:46.481 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:46 smithi033 ceph-mon[29033]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:46.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:46 smithi082 ceph-mon[37153]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:47.367 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:47.367 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:47 smithi033 ceph-mon[29033]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:34:47.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.425+0000 7fb44effd700 1 -- 172.21.15.33:0/2745797621 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb460101990 con 0x7fb448069210 2024-02-15T22:34:47.426 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2024-02-15T22:34:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb448069210 msgr2=0x7fb44806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb448069210 0x7fb44806b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb450004890 tx=0x7fb450009e30 comp rx=0 tx=0).stop 2024-02-15T22:34:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fcfb0 msgr2=0x7fb460112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fcfb0 0x7fb460112be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb454002a50 tx=0x7fb4540046b0 comp rx=0 tx=0).stop 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 shutdown_connections 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb448069210 0x7fb44806b6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4600fbe40 0x7fb460110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 --2- 172.21.15.33:0/2745797621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600fcfb0 0x7fb460112be0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 >> 172.21.15.33:0/2745797621 conn(0x7fb4600f74e0 msgr2=0x7fb460100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 shutdown_connections 2024-02-15T22:34:47.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:47.427+0000 7fb464df3700 1 -- 172.21.15.33:0/2745797621 wait complete. 2024-02-15T22:34:47.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:34:47.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:47 smithi082 ceph-mon[37153]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:34:48.054 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.0.service 2024-02-15T22:34:48.057 INFO:tasks.cephadm:Deploying osd.1 on smithi033 with /dev/vg_nvme/lv_3... 2024-02-15T22:34:48.057 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T22:34:48.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-mon[29033]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:34:48.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-mon[29033]: osdmap e7: 1 total, 0 up, 1 in 2024-02-15T22:34:48.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:48.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-mon[29033]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:34:48.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:48.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:48.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-mon[29033]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:48.540 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[47705]: 2024-02-15T22:34:48.281+0000 7fa304677700 -1 osd.0 0 waiting for initial osdmap 2024-02-15T22:34:48.540 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:34:48 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[47705]: 2024-02-15T22:34:48.285+0000 7fa2fd46e700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:34:48.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:48 smithi082 ceph-mon[37153]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:34:48.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:48 smithi082 ceph-mon[37153]: osdmap e7: 1 total, 0 up, 1 in 2024-02-15T22:34:48.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:48 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:48.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:48 smithi082 ceph-mon[37153]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:34:48.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:48 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:48.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:48 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:48.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:48 smithi082 ceph-mon[37153]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:48.759 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:34:49.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:49 smithi033 ceph-mon[29033]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T22:34:49.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:49 smithi033 ceph-mon[29033]: osdmap e8: 1 total, 0 up, 1 in 2024-02-15T22:34:49.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:49 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:49.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:49 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:49.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:49 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:49.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:49 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:49.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:49 smithi082 ceph-mon[37153]: from='osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T22:34:49.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:49 smithi082 ceph-mon[37153]: osdmap e8: 1 total, 0 up, 1 in 2024-02-15T22:34:49.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:49 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:49.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:49 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:49.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:49 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:49.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:49 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:50.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:50 smithi033 ceph-mon[29033]: purged_snaps scrub starts 2024-02-15T22:34:50.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:50 smithi033 ceph-mon[29033]: purged_snaps scrub ok 2024-02-15T22:34:50.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:50 smithi033 ceph-mon[29033]: osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] boot 2024-02-15T22:34:50.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:50 smithi033 ceph-mon[29033]: osdmap e9: 1 total, 1 up, 1 in 2024-02-15T22:34:50.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:50.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:50 smithi033 ceph-mon[29033]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:50.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:50 smithi082 ceph-mon[37153]: purged_snaps scrub starts 2024-02-15T22:34:50.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:50 smithi082 ceph-mon[37153]: purged_snaps scrub ok 2024-02-15T22:34:50.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:50 smithi082 ceph-mon[37153]: osd.0 [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] boot 2024-02-15T22:34:50.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:50 smithi082 ceph-mon[37153]: osdmap e9: 1 total, 1 up, 1 in 2024-02-15T22:34:50.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:50 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:34:50.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:50 smithi082 ceph-mon[37153]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:34:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T22:34:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T22:34:50.656 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-02-15T22:34:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-02-15T22:34:50.656 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0130892 s, 801 MB/s 2024-02-15T22:34:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-02-15T22:34:51.543 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:51 smithi033 ceph-mon[29033]: osdmap e10: 1 total, 1 up, 1 in 2024-02-15T22:34:51.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2024-02-15T22:34:51.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:51 smithi082 ceph-mon[37153]: osdmap e10: 1 total, 1 up, 1 in 2024-02-15T22:34:52.029 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:34:52.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:52 smithi033 ceph-mon[29033]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:34:52.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:52 smithi082 ceph-mon[37153]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 -- 172.21.15.33:0/892247380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 msgr2=0x7f3c6c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 --2- 172.21.15.33:0/892247380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 0x7f3c6c102780 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3c60004940 tx=0x7f3c60009e30 comp rx=0 tx=0).stop 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 -- 172.21.15.33:0/892247380 shutdown_connections 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 --2- 172.21.15.33:0/892247380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 0x7f3c6c102780 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 --2- 172.21.15.33:0/892247380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 0x7f3c6c0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 -- 172.21.15.33:0/892247380 >> 172.21.15.33:0/892247380 conn(0x7f3c6c0f74e0 msgr2=0x7f3c6c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 -- 172.21.15.33:0/892247380 shutdown_connections 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.686+0000 7f3c70980700 1 -- 172.21.15.33:0/892247380 wait complete. 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c70980700 1 Processor -- start 2024-02-15T22:34:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c70980700 1 -- start start 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c70980700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 0x7f3c6c0fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c70980700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 0x7f3c6c0fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c70980700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0fbf90 con 0x7f3c6c0fda80 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c70980700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0fc100 con 0x7f3c6c1003a0 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c6a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 0x7f3c6c0fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c6a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 0x7f3c6c0fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54702/0 (socket says 172.21.15.33:54702) 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c6a59c700 1 -- 172.21.15.33:0/2667446027 learned_addr learned my addr 172.21.15.33:0/2667446027 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.687+0000 7f3c69d9b700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 0x7f3c6c0fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c6a59c700 1 -- 172.21.15.33:0/2667446027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 msgr2=0x7f3c6c0fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c6a59c700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 0x7f3c6c0fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c6a59c700 1 -- 172.21.15.33:0/2667446027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c005040 con 0x7f3c6c0fda80 2024-02-15T22:34:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c6a59c700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 0x7f3c6c0fd510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0096d0 tx=0x7f3c5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c5affd700 1 -- 172.21.15.33:0/2667446027 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5c00e840 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c5affd700 1 -- 172.21.15.33:0/2667446027 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c5c00f040 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c60005040 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c5affd700 1 -- 172.21.15.33:0/2667446027 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5c013dc0 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.688+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c0fc730 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.689+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c04bed0 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.689+0000 7f3c5affd700 1 -- 172.21.15.33:0/2667446027 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7f3c5c01c410 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.690+0000 7f3c5affd700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3c54069210 0x7f3c5406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.690+0000 7f3c5affd700 1 -- 172.21.15.33:0/2667446027 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f3c5c086060 con 0x7f3c6c0fda80 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.690+0000 7f3c69d9b700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3c54069210 0x7f3c5406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:34:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.691+0000 7f3c69d9b700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3c54069210 0x7f3c5406b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009b30 tx=0x7f3c60009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:34:54.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.695+0000 7f3c5affd700 1 -- 172.21.15.33:0/2667446027 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3c5c056ca0 con 0x7f3c6c0fda80 2024-02-15T22:34:54.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:34:54.896+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c6c101000 con 0x7f3c54069210 2024-02-15T22:34:55.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: Detected new or changed devices on smithi033 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi033 to 12869M 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:34:55.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:34:55.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: Detected new or changed devices on smithi033 2024-02-15T22:34:55.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:34:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi033 to 12869M 2024-02-15T22:34:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:34:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:34:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:34:55.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:55 smithi033 ceph-mon[29033]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:34:55.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:55 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:34:55.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:55 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:34:55.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:55 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:55.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:55 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:55.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:55 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:56.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:55 smithi082 ceph-mon[37153]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:34:56.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:55 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:34:56.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:55 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:34:56.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:55 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:34:56.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:55 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:56.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:55 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:34:57.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:56 smithi033 ceph-mon[29033]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:34:57.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:56 smithi082 ceph-mon[37153]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:34:59.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:58 smithi082 ceph-mon[37153]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:34:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:58 smithi033 ceph-mon[29033]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:59 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3906297737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9edc1e24-0b17-4e9a-ac42-18decf1d9c14"}]: dispatch 2024-02-15T22:35:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:59 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3906297737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9edc1e24-0b17-4e9a-ac42-18decf1d9c14"}]': finished 2024-02-15T22:35:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:59 smithi033 ceph-mon[29033]: osdmap e11: 2 total, 1 up, 2 in 2024-02-15T22:35:00.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:59 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:00.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:34:59 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1677212918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:35:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:59 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3906297737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9edc1e24-0b17-4e9a-ac42-18decf1d9c14"}]: dispatch 2024-02-15T22:35:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:59 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3906297737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9edc1e24-0b17-4e9a-ac42-18decf1d9c14"}]': finished 2024-02-15T22:35:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:59 smithi082 ceph-mon[37153]: osdmap e11: 2 total, 1 up, 2 in 2024-02-15T22:35:00.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:59 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:00.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:34:59 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1677212918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:35:01.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:00 smithi033 ceph-mon[29033]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:01.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:00 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:01.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:00 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:01.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:00 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:01.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:00 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:01.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:00 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:00 smithi082 ceph-mon[37153]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:00 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:00 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:00 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:00 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:00 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:02.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:02.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:03.156 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:02 smithi033 ceph-mon[29033]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:02 smithi082 ceph-mon[37153]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:05.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:04 smithi033 ceph-mon[29033]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:05.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:04 smithi082 ceph-mon[37153]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:07.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:06 smithi033 ceph-mon[29033]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:07.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:35:07.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:06 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:07.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:06 smithi033 ceph-mon[29033]: Deploying daemon osd.1 on smithi033 2024-02-15T22:35:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:06 smithi082 ceph-mon[37153]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:35:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:06 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:06 smithi082 ceph-mon[37153]: Deploying daemon osd.1 on smithi033 2024-02-15T22:35:09.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:08 smithi033 ceph-mon[29033]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:09.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:08 smithi082 ceph-mon[37153]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:11.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:10 smithi033 ceph-mon[29033]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:11.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:10 smithi082 ceph-mon[37153]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:12.602 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:12 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:12.602 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:12 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:12.602 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:12 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:12.602 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:12 smithi082 ceph-mon[37153]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:12.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:12 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:12.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:12 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:12.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:12 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:12.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:12 smithi033 ceph-mon[29033]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:14.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:14.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:14.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:14.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:15.336 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:15 smithi033 ceph-mon[29033]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:15.407 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 1 on host 'smithi033' 2024-02-15T22:35:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.406+0000 7f3c5affd700 1 -- 172.21.15.33:0/2667446027 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3c6c101000 con 0x7f3c54069210 2024-02-15T22:35:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3c54069210 msgr2=0x7f3c5406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3c54069210 0x7f3c5406b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009b30 tx=0x7f3c60009e30 comp rx=0 tx=0).stop 2024-02-15T22:35:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 msgr2=0x7f3c6c0fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 0x7f3c6c0fd510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0096d0 tx=0x7f3c5c009e30 comp rx=0 tx=0).stop 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 shutdown_connections 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3c54069210 0x7f3c5406b6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0fda80 0x7f3c6c0fd510 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 --2- 172.21.15.33:0/2667446027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c6c1003a0 0x7f3c6c0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 >> 172.21.15.33:0/2667446027 conn(0x7f3c6c0f74e0 msgr2=0x7f3c6c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 shutdown_connections 2024-02-15T22:35:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:15.409+0000 7f3c70980700 1 -- 172.21.15.33:0/2667446027 wait complete. 2024-02-15T22:35:15.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:15 smithi082 ceph-mon[37153]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:16.310 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:16 smithi033 ceph-mon[29033]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:35:16.310 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:16.310 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:16.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:16 smithi082 ceph-mon[37153]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:35:16.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:16.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:16.655 DEBUG:teuthology.orchestra.run.smithi033:osd.1> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.1.service 2024-02-15T22:35:16.658 INFO:tasks.cephadm:Deploying osd.2 on smithi033 with /dev/vg_nvme/lv_2... 2024-02-15T22:35:16.658 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T22:35:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:35:17.520 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[55034]: 2024-02-15T22:35:17.171+0000 7f11ed3f1700 -1 osd.1 0 waiting for initial osdmap 2024-02-15T22:35:17.520 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[55034]: 2024-02-15T22:35:17.174+0000 7f11e81ec700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:35:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-mon[29033]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-mon[29033]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:35:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-mon[29033]: osdmap e12: 2 total, 1 up, 2 in 2024-02-15T22:35:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-mon[29033]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:35:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:17 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:17.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:17 smithi082 ceph-mon[37153]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:17.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:17 smithi082 ceph-mon[37153]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:35:17.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:17 smithi082 ceph-mon[37153]: osdmap e12: 2 total, 1 up, 2 in 2024-02-15T22:35:17.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:17 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:17.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:17 smithi082 ceph-mon[37153]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:35:17.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:17 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:18.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:18 smithi033 ceph-mon[29033]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T22:35:18.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:18 smithi033 ceph-mon[29033]: osdmap e13: 2 total, 1 up, 2 in 2024-02-15T22:35:18.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:18 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:18.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:18 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:18.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:18 smithi082 ceph-mon[37153]: from='osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T22:35:18.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:18 smithi082 ceph-mon[37153]: osdmap e13: 2 total, 1 up, 2 in 2024-02-15T22:35:18.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:18 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:18.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:18 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:19.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:19 smithi033 ceph-mon[29033]: purged_snaps scrub starts 2024-02-15T22:35:19.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:19 smithi033 ceph-mon[29033]: purged_snaps scrub ok 2024-02-15T22:35:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:19 smithi033 ceph-mon[29033]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:19 smithi033 ceph-mon[29033]: osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] boot 2024-02-15T22:35:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:19 smithi033 ceph-mon[29033]: osdmap e14: 2 total, 2 up, 2 in 2024-02-15T22:35:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:19 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:19.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:19 smithi082 ceph-mon[37153]: purged_snaps scrub starts 2024-02-15T22:35:19.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:19 smithi082 ceph-mon[37153]: purged_snaps scrub ok 2024-02-15T22:35:19.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:19 smithi082 ceph-mon[37153]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:35:19.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:19 smithi082 ceph-mon[37153]: osd.1 [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] boot 2024-02-15T22:35:19.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:19 smithi082 ceph-mon[37153]: osdmap e14: 2 total, 2 up, 2 in 2024-02-15T22:35:19.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:19 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:35:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T22:35:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T22:35:20.133 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-02-15T22:35:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-02-15T22:35:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133558 s, 785 MB/s 2024-02-15T22:35:20.134 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-02-15T22:35:20.384 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:20 smithi033 ceph-mon[29033]: osdmap e15: 2 total, 2 up, 2 in 2024-02-15T22:35:20.385 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:20 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:20.385 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:20 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:20.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:20 smithi082 ceph-mon[37153]: osdmap e15: 2 total, 2 up, 2 in 2024-02-15T22:35:20.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:20 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:20.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:20 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:21.359 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:21 smithi033 ceph-mon[29033]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:21.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:21 smithi082 ceph-mon[37153]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:21.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2024-02-15T22:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:35:23.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:23 smithi033 ceph-mon[29033]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:23.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:23 smithi082 ceph-mon[37153]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 -- 172.21.15.33:0/230467167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 msgr2=0x7f801c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 --2- 172.21.15.33:0/230467167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c0fe550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8008004940 tx=0x7f8008009e30 comp rx=0 tx=0).stop 2024-02-15T22:35:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 -- 172.21.15.33:0/230467167 shutdown_connections 2024-02-15T22:35:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 --2- 172.21.15.33:0/230467167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c0fe550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 --2- 172.21.15.33:0/230467167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f801c0fcef0 0x7f801c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 -- 172.21.15.33:0/230467167 >> 172.21.15.33:0/230467167 conn(0x7f801c0f8620 msgr2=0x7f801c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 -- 172.21.15.33:0/230467167 shutdown_connections 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.639+0000 7f8022ae0700 1 -- 172.21.15.33:0/230467167 wait complete. 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f8022ae0700 1 Processor -- start 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f8022ae0700 1 -- start start 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f8022ae0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f801c0fcef0 0x7f801c10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f8022ae0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f8022ae0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c10e4b0 con 0x7f801c0fe0e0 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f8022ae0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c10ed50 con 0x7f801c0fcef0 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f801bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:35:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f801bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c10deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39040/0 (socket says 172.21.15.33:39040) 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f801bfff700 1 -- 172.21.15.33:0/2621661369 learned_addr learned my addr 172.21.15.33:0/2621661369 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f802087c700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f801c0fcef0 0x7f801c10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f801bfff700 1 -- 172.21.15.33:0/2621661369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f801c0fcef0 msgr2=0x7f801c10d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f801bfff700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f801c0fcef0 0x7f801c10d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f801bfff700 1 -- 172.21.15.33:0/2621661369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008005040 con 0x7f801c0fe0e0 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.640+0000 7f802087c700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f801c0fcef0 0x7f801c10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.641+0000 7f801bfff700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c10deb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f80080093b0 tx=0x7f8008009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.641+0000 7f80197fa700 1 -- 172.21.15.33:0/2621661369 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f800800e040 con 0x7f801c0fe0e0 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.641+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c10efd0 con 0x7f801c0fe0e0 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.641+0000 7f80197fa700 1 -- 172.21.15.33:0/2621661369 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f800800bcc0 con 0x7f801c0fe0e0 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.641+0000 7f80197fa700 1 -- 172.21.15.33:0/2621661369 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f800801c630 con 0x7f801c0fe0e0 2024-02-15T22:35:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.641+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c10f510 con 0x7f801c0fe0e0 2024-02-15T22:35:24.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.642+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c04bed0 con 0x7f801c0fe0e0 2024-02-15T22:35:24.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.642+0000 7f80197fa700 1 -- 172.21.15.33:0/2621661369 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7f80080139f0 con 0x7f801c0fe0e0 2024-02-15T22:35:24.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.643+0000 7f80197fa700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f800c069210 0x7f800c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:35:24.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.643+0000 7f80197fa700 1 -- 172.21.15.33:0/2621661369 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f8008087890 con 0x7f801c0fe0e0 2024-02-15T22:35:24.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.643+0000 7f802087c700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f800c069210 0x7f800c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:35:24.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.643+0000 7f802087c700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f800c069210 0x7f800c06b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8010007fd0 tx=0x7f8010009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:35:24.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.647+0000 7f80197fa700 1 -- 172.21.15.33:0/2621661369 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8008058320 con 0x7f801c0fe0e0 2024-02-15T22:35:24.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:24.859+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f801c10f9d0 con 0x7f800c069210 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: Detected new or changed devices on smithi033 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi033 to 6434M 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:24.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:24.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:24.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:24 smithi082 ceph-mon[37153]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:24.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: Detected new or changed devices on smithi033 2024-02-15T22:35:24.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:24.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:24.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi033 to 6434M 2024-02-15T22:35:24.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:24.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:24.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:24.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:24.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:24 smithi033 ceph-mon[29033]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:25.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:25 smithi033 ceph-mon[29033]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:35:25.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:25 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:35:25.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:25 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:35:25.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:25 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:26.056 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:25 smithi082 ceph-mon[37153]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:35:26.056 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:25 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:35:26.056 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:25 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:35:26.057 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:25 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:26.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:26 smithi033 ceph-mon[29033]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:27.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:26 smithi082 ceph-mon[37153]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:29.013 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:28 smithi033 ceph-mon[29033]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:29.013 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:28 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1755594319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eaa0a666-819e-4268-a788-e2ab2b12dd55"}]: dispatch 2024-02-15T22:35:29.013 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:28 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1755594319' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eaa0a666-819e-4268-a788-e2ab2b12dd55"}]': finished 2024-02-15T22:35:29.013 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:28 smithi033 ceph-mon[29033]: osdmap e16: 3 total, 2 up, 3 in 2024-02-15T22:35:29.013 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:28 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:28 smithi082 ceph-mon[37153]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:28 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1755594319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eaa0a666-819e-4268-a788-e2ab2b12dd55"}]: dispatch 2024-02-15T22:35:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:28 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1755594319' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eaa0a666-819e-4268-a788-e2ab2b12dd55"}]': finished 2024-02-15T22:35:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:28 smithi082 ceph-mon[37153]: osdmap e16: 3 total, 2 up, 3 in 2024-02-15T22:35:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:28 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:30.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:29 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1052835410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:35:30.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:29 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1052835410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:35:31.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:30 smithi033 ceph-mon[29033]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:30 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:30 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:30 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:30 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:30 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:30 smithi082 ceph-mon[37153]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:30 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:30 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:30 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:30 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:30 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:32.267 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:32.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:31 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:33.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:32 smithi033 ceph-mon[29033]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:33.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:32 smithi082 ceph-mon[37153]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:35.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:34 smithi033 ceph-mon[29033]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:35.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:34 smithi082 ceph-mon[37153]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:36.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:35:36.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:36.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:35:36.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:37.080 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:36 smithi033 ceph-mon[29033]: Deploying daemon osd.2 on smithi033 2024-02-15T22:35:37.081 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:36 smithi033 ceph-mon[29033]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:37.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:36 smithi082 ceph-mon[37153]: Deploying daemon osd.2 on smithi033 2024-02-15T22:35:37.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:36 smithi082 ceph-mon[37153]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:39.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:38 smithi033 ceph-mon[29033]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:39.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:38 smithi082 ceph-mon[37153]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:41.014 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:40 smithi033 ceph-mon[29033]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:41.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:40 smithi082 ceph-mon[37153]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:42.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:42 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:42.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:42 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:42.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:42 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:42.504 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:42.504 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:42.504 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:42 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:43.343 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:43 smithi033 ceph-mon[29033]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:43.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:43 smithi082 ceph-mon[37153]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:43.963 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 2 on host 'smithi033' 2024-02-15T22:35:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.962+0000 7f80197fa700 1 -- 172.21.15.33:0/2621661369 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f801c10f9d0 con 0x7f800c069210 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.964+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f800c069210 msgr2=0x7f800c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.964+0000 7f8022ae0700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f800c069210 0x7f800c06b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8010007fd0 tx=0x7f8010009040 comp rx=0 tx=0).stop 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.964+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 msgr2=0x7f801c10deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.964+0000 7f8022ae0700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c10deb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f80080093b0 tx=0x7f8008009e30 comp rx=0 tx=0).stop 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.965+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 shutdown_connections 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.965+0000 7f8022ae0700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f800c069210 0x7f800c06b6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.965+0000 7f8022ae0700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f801c0fcef0 0x7f801c10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.965+0000 7f8022ae0700 1 --2- 172.21.15.33:0/2621661369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f801c0fe0e0 0x7f801c10deb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.965+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 >> 172.21.15.33:0/2621661369 conn(0x7f801c0f8620 msgr2=0x7f801c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:35:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.965+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 shutdown_connections 2024-02-15T22:35:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:35:43.965+0000 7f8022ae0700 1 -- 172.21.15.33:0/2621661369 wait complete. 2024-02-15T22:35:44.609 DEBUG:teuthology.orchestra.run.smithi033:osd.2> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.2.service 2024-02-15T22:35:44.612 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_4... 2024-02-15T22:35:44.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T22:35:44.871 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:35:45.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:44 smithi033 ceph-mon[29033]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:45.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:45.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:45.256 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:44 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[62848]: 2024-02-15T22:35:44.971+0000 7f0a0bc20540 -1 osd.2 0 log_to_monitors true 2024-02-15T22:35:45.260 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:44 smithi082 ceph-mon[37153]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:45.261 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:45.261 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:46.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:45 smithi082 ceph-mon[37153]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:35:46.175 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:45 smithi033 ceph-mon[29033]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:35:46.710 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T22:35:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T22:35:46.711 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-02-15T22:35:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-02-15T22:35:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114233 s, 918 MB/s 2024-02-15T22:35:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-02-15T22:35:47.269 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[62848]: 2024-02-15T22:35:46.948+0000 7f0a023f2700 -1 osd.2 0 waiting for initial osdmap 2024-02-15T22:35:47.270 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[62848]: 2024-02-15T22:35:46.952+0000 7f09fc9ec700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:35:47.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-mon[29033]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:47.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-mon[29033]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:35:47.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-mon[29033]: osdmap e17: 3 total, 2 up, 3 in 2024-02-15T22:35:47.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:47.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-mon[29033]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:35:47.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:46 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:47.303 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:46 smithi082 ceph-mon[37153]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:47.303 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:46 smithi082 ceph-mon[37153]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:35:47.303 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:46 smithi082 ceph-mon[37153]: osdmap e17: 3 total, 2 up, 3 in 2024-02-15T22:35:47.304 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:46 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:47.304 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:46 smithi082 ceph-mon[37153]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:35:47.304 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:46 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:35:47.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-02-15T22:35:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:35:48.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:47 smithi033 ceph-mon[29033]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T22:35:48.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:47 smithi033 ceph-mon[29033]: osdmap e18: 3 total, 2 up, 3 in 2024-02-15T22:35:48.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:48.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:48.276 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:47 smithi082 ceph-mon[37153]: from='osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T22:35:48.276 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:47 smithi082 ceph-mon[37153]: osdmap e18: 3 total, 2 up, 3 in 2024-02-15T22:35:48.276 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:48.276 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:49.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 -- 172.21.15.82:0/3525162413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fbe80 msgr2=0x7efca80fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:49.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 --2- 172.21.15.82:0/3525162413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fbe80 0x7efca80fc290 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efc98004940 tx=0x7efc98009e30 comp rx=0 tx=0).stop 2024-02-15T22:35:49.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 -- 172.21.15.82:0/3525162413 shutdown_connections 2024-02-15T22:35:49.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 --2- 172.21.15.82:0/3525162413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efca80fd080 0x7efca80fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:49.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 --2- 172.21.15.82:0/3525162413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fbe80 0x7efca80fc290 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:49.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 -- 172.21.15.82:0/3525162413 >> 172.21.15.82:0/3525162413 conn(0x7efca80f7590 msgr2=0x7efca80f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:35:49.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 -- 172.21.15.82:0/3525162413 shutdown_connections 2024-02-15T22:35:49.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.054+0000 7efcae736700 1 -- 172.21.15.82:0/3525162413 wait complete. 2024-02-15T22:35:49.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efcae736700 1 Processor -- start 2024-02-15T22:35:49.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efcae736700 1 -- start start 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efcae736700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efca80fbe80 0x7efca810c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efcae736700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fd080 0x7efca810cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efcae736700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca810d380 con 0x7efca80fbe80 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efcae736700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca810dc20 con 0x7efca80fd080 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efca77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fd080 0x7efca810cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efca77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fd080 0x7efca810cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43646/0 (socket says 172.21.15.82:43646) 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.055+0000 7efca77fe700 1 -- 172.21.15.82:0/3335100619 learned_addr learned my addr 172.21.15.82:0/3335100619 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca7fff700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efca80fbe80 0x7efca810c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca77fe700 1 -- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efca80fbe80 msgr2=0x7efca810c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca77fe700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efca80fbe80 0x7efca810c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca77fe700 1 -- 172.21.15.82:0/3335100619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98005040 con 0x7efca80fd080 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca77fe700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fd080 0x7efca810cd80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00eb70 tx=0x7efc9c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9c007cc0 con 0x7efca80fd080 2024-02-15T22:35:49.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca810dea0 con 0x7efca80fd080 2024-02-15T22:35:49.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc9c00f040 con 0x7efca80fd080 2024-02-15T22:35:49.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9c00ca90 con 0x7efca80fd080 2024-02-15T22:35:49.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.056+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca810e3e0 con 0x7efca80fd080 2024-02-15T22:35:49.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.057+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca804bed0 con 0x7efca80fd080 2024-02-15T22:35:49.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.058+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7efc9c00cbf0 con 0x7efca80fd080 2024-02-15T22:35:49.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.058+0000 7efca4ff9700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efc90069210 0x7efc9006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:35:49.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.058+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2842+0+0 (secure 0 0 0) 0x7efc9c086210 con 0x7efca80fd080 2024-02-15T22:35:49.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.058+0000 7efca7fff700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efc90069210 0x7efc9006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:35:49.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.059+0000 7efca7fff700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efc90069210 0x7efc9006b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc98000c00 tx=0x7efc98009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:35:49.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.062+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efc9c056a70 con 0x7efca80fd080 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: purged_snaps scrub starts 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: purged_snaps scrub ok 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] boot 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: osdmap e19: 3 total, 3 up, 3 in 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:49.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:48 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:49.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:49.251+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7efca810e7f0 con 0x7efc90069210 2024-02-15T22:35:49.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: purged_snaps scrub starts 2024-02-15T22:35:49.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: purged_snaps scrub ok 2024-02-15T22:35:49.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-15T22:35:49.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:49.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: osd.2 [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] boot 2024-02-15T22:35:49.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: osdmap e19: 3 total, 3 up, 3 in 2024-02-15T22:35:49.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:35:49.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:49.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:48 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:50.352 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:50 smithi082 ceph-mon[37153]: osdmap e20: 3 total, 3 up, 3 in 2024-02-15T22:35:50.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:50 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:35:50.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:50 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:35:50.353 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:50 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:50.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:50 smithi033 ceph-mon[29033]: osdmap e20: 3 total, 3 up, 3 in 2024-02-15T22:35:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:35:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:35:50.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:50 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:51.185 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:51 smithi082 ceph-mon[37153]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:35:51.186 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:51 smithi082 ceph-mon[37153]: pgmap v77: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:51.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:51 smithi033 ceph-mon[29033]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:35:51.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:51 smithi033 ceph-mon[29033]: pgmap v77: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:51.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T22:35:51.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-15T22:35:51.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:51 smithi033 ceph-mon[29033]: osdmap e21: 3 total, 3 up, 3 in 2024-02-15T22:35:51.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-15T22:35:51.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T22:35:51.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-15T22:35:51.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:51 smithi082 ceph-mon[37153]: osdmap e21: 3 total, 3 up, 3 in 2024-02-15T22:35:51.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-15T22:35:52.363 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67588]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:35:52.363 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67588]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:52.363 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67588]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:52.364 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67588]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: osdmap e22: 3 total, 3 up, 3 in 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: Detected new or changed devices on smithi033 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi033 to 4289M 2024-02-15T22:35:52.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/259423290' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "111d4225-5978-43c6-8276-87091559a25b"}]: dispatch 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "111d4225-5978-43c6-8276-87091559a25b"}]: dispatch 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "111d4225-5978-43c6-8276-87091559a25b"}]': finished 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: osdmap e23: 4 total, 3 up, 4 in 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:35:52.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:52 smithi033 ceph-mon[29033]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-15T22:35:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: osdmap e22: 3 total, 3 up, 3 in 2024-02-15T22:35:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: Detected new or changed devices on smithi033 2024-02-15T22:35:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi033 to 4289M 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/259423290' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "111d4225-5978-43c6-8276-87091559a25b"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "111d4225-5978-43c6-8276-87091559a25b"}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "111d4225-5978-43c6-8276-87091559a25b"}]': finished 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: osdmap e23: 4 total, 3 up, 4 in 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:35:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:52 smithi082 ceph-mon[37153]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:52.648 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67605]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:35:52.648 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67605]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:52.648 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67605]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:52.648 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67605]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:52.927 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67661]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:35:52.927 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:52.927 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67661]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:52.927 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67661]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:53.182 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67714]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:35:53.182 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67714]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:53.182 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67714]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:53.182 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:35:52 smithi033 sudo[67714]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:53.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:35:53.390+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7efc9c0533b0 con 0x7efca80fd080 2024-02-15T22:35:53.456 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2659136894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:35:53.456 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:53.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 ceph-mon[29033]: osdmap e24: 4 total, 3 up, 4 in 2024-02-15T22:35:53.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:35:53.457 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67719]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:35:53.457 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67719]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:53.457 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67719]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:53.457 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67719]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:53.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:53 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2659136894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:35:53.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:53 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:53.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:53 smithi082 ceph-mon[37153]: osdmap e24: 4 total, 3 up, 4 in 2024-02-15T22:35:53.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:53 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:35:53.717 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67768]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:35:53.717 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67768]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:53.717 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67768]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:53.717 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67768]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:53.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67799]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:35:53.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67799]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:53.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67799]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:53.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67799]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:54.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67802]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:35:54.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67802]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:54.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67802]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:54.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:53 smithi033 sudo[67802]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:54.486 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41448]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:35:54.486 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41448]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:54.486 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41448]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:54.486 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41448]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:54.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: mgrmap e19: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:35:54.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:35:54.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:54.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:35:54.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:35:54.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:35:54.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:35:54.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:54 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:35:54.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41452]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:35:54.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41452]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:35:54.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41452]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:35:54.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 sudo[41452]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: mgrmap e19: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:35:54.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:54 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:35:55.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:55 smithi033 ceph-mon[29033]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:35:55.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:55 smithi033 ceph-mon[29033]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:35:55.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:55 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:55.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:55 smithi082 ceph-mon[37153]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:35:55.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:55 smithi082 ceph-mon[37153]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:35:55.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:55 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:56.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:56.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:56.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:56 smithi082 ceph-mon[37153]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:56.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:56.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:56.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:57.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:57.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:57.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:56 smithi033 ceph-mon[29033]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:57.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:35:57.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:35:57.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:35:59.116 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:58 smithi082 ceph-mon[37153]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:35:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:58 smithi033 ceph-mon[29033]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:36:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:59 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:36:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:59 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:35:59 smithi082 ceph-mon[37153]: Deploying daemon osd.3 on smithi082 2024-02-15T22:36:00.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:59 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:36:00.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:59 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:00.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:35:59 smithi033 ceph-mon[29033]: Deploying daemon osd.3 on smithi082 2024-02-15T22:36:01.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:00 smithi082 ceph-mon[37153]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-02-15T22:36:01.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:00 smithi033 ceph-mon[29033]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-02-15T22:36:02.011 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:02.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:03.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:02 smithi033 ceph-mon[29033]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-15T22:36:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:02 smithi082 ceph-mon[37153]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-15T22:36:05.108 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:04 smithi082 ceph-mon[37153]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-15T22:36:05.108 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:05.108 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:05.108 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:04 smithi033 ceph-mon[29033]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-15T22:36:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:07.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:06 smithi082 ceph-mon[37153]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-15T22:36:07.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:06 smithi033 ceph-mon[29033]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-15T22:36:07.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.514+0000 7efca4ff9700 1 -- 172.21.15.82:0/3335100619 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efca810e7f0 con 0x7efc90069210 2024-02-15T22:36:07.514 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2024-02-15T22:36:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efc90069210 msgr2=0x7efc9006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efc90069210 0x7efc9006b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc98000c00 tx=0x7efc98009e30 comp rx=0 tx=0).stop 2024-02-15T22:36:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fd080 msgr2=0x7efca810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fd080 0x7efca810cd80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00eb70 tx=0x7efc9c00b040 comp rx=0 tx=0).stop 2024-02-15T22:36:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 shutdown_connections 2024-02-15T22:36:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efc90069210 0x7efc9006b6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efca80fbe80 0x7efca810c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:07.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 --2- 172.21.15.82:0/3335100619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca80fd080 0x7efca810cd80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:07.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.516+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 >> 172.21.15.82:0/3335100619 conn(0x7efca80f7590 msgr2=0x7efca81002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:36:07.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.517+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 shutdown_connections 2024-02-15T22:36:07.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:07.517+0000 7efcae736700 1 -- 172.21.15.82:0/3335100619 wait complete. 2024-02-15T22:36:08.165 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.3.service 2024-02-15T22:36:08.167 INFO:tasks.cephadm:Deploying osd.4 on smithi082 with /dev/vg_nvme/lv_3... 2024-02-15T22:36:08.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T22:36:08.427 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:36:08 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[42700]: 2024-02-15T22:36:08.228+0000 7f846b511540 -1 osd.3 0 log_to_monitors true 2024-02-15T22:36:08.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:08 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:08 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:08 smithi033 ceph-mon[29033]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-15T22:36:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:08 smithi033 ceph-mon[29033]: from='osd.3 [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:36:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:08 smithi033 ceph-mon[29033]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:36:08.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:08 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:08.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:08 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:08.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:08 smithi082 ceph-mon[37153]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-15T22:36:08.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:08 smithi082 ceph-mon[37153]: from='osd.3 [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:36:08.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:08 smithi082 ceph-mon[37153]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:36:08.904 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:36:10.123 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:36:09 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[42700]: 2024-02-15T22:36:09.852+0000 7f8461ce3700 -1 osd.3 0 waiting for initial osdmap 2024-02-15T22:36:10.123 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:36:09 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[42700]: 2024-02-15T22:36:09.858+0000 7f845c2dd700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:36:10.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:09 smithi082 ceph-mon[37153]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:36:10.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:09 smithi082 ceph-mon[37153]: osdmap e25: 4 total, 3 up, 4 in 2024-02-15T22:36:10.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:09 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:10.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:09 smithi082 ceph-mon[37153]: from='osd.3 [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:10.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:09 smithi082 ceph-mon[37153]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:10.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:09 smithi033 ceph-mon[29033]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:36:10.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:09 smithi033 ceph-mon[29033]: osdmap e25: 4 total, 3 up, 4 in 2024-02-15T22:36:10.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:09 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:10.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:09 smithi033 ceph-mon[29033]: from='osd.3 [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:10.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:09 smithi033 ceph-mon[29033]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:10.825 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T22:36:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T22:36:10.826 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-02-15T22:36:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-02-15T22:36:10.826 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125758 s, 834 MB/s 2024-02-15T22:36:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-02-15T22:36:11.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-02-15T22:36:11.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: osdmap e26: 4 total, 3 up, 4 in 2024-02-15T22:36:11.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:11.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:11.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:36:11.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:11.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:11.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: osd.3 [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] boot 2024-02-15T22:36:11.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: osdmap e27: 4 total, 4 up, 4 in 2024-02-15T22:36:11.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:10 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:11.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: osdmap e26: 4 total, 3 up, 4 in 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: osd.3 [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] boot 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: osdmap e27: 4 total, 4 up, 4 in 2024-02-15T22:36:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:10 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:36:11.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-02-15T22:36:12.112 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:11 smithi082 ceph-mon[37153]: purged_snaps scrub starts 2024-02-15T22:36:12.112 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:11 smithi082 ceph-mon[37153]: purged_snaps scrub ok 2024-02-15T22:36:12.113 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:11 smithi082 ceph-mon[37153]: osdmap e28: 4 total, 4 up, 4 in 2024-02-15T22:36:12.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:11 smithi033 ceph-mon[29033]: purged_snaps scrub starts 2024-02-15T22:36:12.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:11 smithi033 ceph-mon[29033]: purged_snaps scrub ok 2024-02-15T22:36:12.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:11 smithi033 ceph-mon[29033]: osdmap e28: 4 total, 4 up, 4 in 2024-02-15T22:36:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:36:13.019 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:12 smithi082 ceph-mon[37153]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:13.019 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:12 smithi082 ceph-mon[37153]: osdmap e29: 4 total, 4 up, 4 in 2024-02-15T22:36:13.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:12 smithi033 ceph-mon[29033]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:13.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:12 smithi033 ceph-mon[29033]: osdmap e29: 4 total, 4 up, 4 in 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 -- 172.21.15.82:0/4020778435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 msgr2=0x7fc7bc0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/4020778435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc0fc250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac004940 tx=0x7fc7ac009e30 comp rx=0 tx=0).stop 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 -- 172.21.15.82:0/4020778435 shutdown_connections 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/4020778435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7bc0fcfb0 0x7fc7bc0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/4020778435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc0fc250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 -- 172.21.15.82:0/4020778435 >> 172.21.15.82:0/4020778435 conn(0x7fc7bc0f74e0 msgr2=0x7fc7bc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 -- 172.21.15.82:0/4020778435 shutdown_connections 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.846+0000 7fc7c0f35700 1 -- 172.21.15.82:0/4020778435 wait complete. 2024-02-15T22:36:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7c0f35700 1 Processor -- start 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7c0f35700 1 -- start start 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7c0f35700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7c0f35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7bc0fcfb0 0x7fc7bc112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7c0f35700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0664c0 con 0x7fc7bc0fcfb0 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7c0f35700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc066600 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7ba59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7ba59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47818/0 (socket says 172.21.15.82:47818) 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7ba59c700 1 -- 172.21.15.82:0/1783689571 learned_addr learned my addr 172.21.15.82:0/1783689571 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7b9d9b700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7bc0fcfb0 0x7fc7bc112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7ba59c700 1 -- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7bc0fcfb0 msgr2=0x7fc7bc112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7ba59c700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7bc0fcfb0 0x7fc7bc112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7ba59c700 1 -- 172.21.15.82:0/1783689571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac005040 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7b9d9b700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7bc0fcfb0 0x7fc7bc112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:36:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.847+0000 7fc7ba59c700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc110590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0093b0 tx=0x7fc7ac009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:36:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.848+0000 7fc7aaffd700 1 -- 172.21.15.82:0/1783689571 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac00e040 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.848+0000 7fc7aaffd700 1 -- 172.21.15.82:0/1783689571 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7ac00bcc0 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.848+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc1130e0 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.848+0000 7fc7aaffd700 1 -- 172.21.15.82:0/1783689571 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac01c630 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.848+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc113620 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.849+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7bc04bed0 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.849+0000 7fc7aaffd700 1 -- 172.21.15.82:0/1783689571 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fc7ac0139f0 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.849+0000 7fc7aaffd700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc7a40692a0 0x7fc7a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:36:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.849+0000 7fc7aaffd700 1 -- 172.21.15.82:0/1783689571 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fc7ac087f10 con 0x7fc7bc0fbe40 2024-02-15T22:36:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.850+0000 7fc7b9d9b700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc7a40692a0 0x7fc7a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:36:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.850+0000 7fc7b9d9b700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc7a40692a0 0x7fc7a406b750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007fd0 tx=0x7fc7b0009f60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:36:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:14.854+0000 7fc7aaffd700 1 -- 172.21.15.82:0/1783689571 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc7ac0548e0 con 0x7fc7bc0fbe40 2024-02-15T22:36:15.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:15.046+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7bc101990 con 0x7fc7a40692a0 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: osdmap e30: 4 total, 4 up, 4 in 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: Detected new or changed devices on smithi082 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi082 to 15936M 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.047 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:15.048 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:15.048 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.048 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:15.048 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:15.048 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:15.048 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:14 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: osdmap e30: 4 total, 4 up, 4 in 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: Detected new or changed devices on smithi082 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi082 to 15936M 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:15.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:15.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:15.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:15.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:14 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:16.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:15 smithi082 ceph-mon[37153]: osdmap e31: 4 total, 4 up, 4 in 2024-02-15T22:36:16.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:15 smithi082 ceph-mon[37153]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:36:16.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:15 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:36:16.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:15 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:36:16.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:15 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:16.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:15 smithi033 ceph-mon[29033]: osdmap e31: 4 total, 4 up, 4 in 2024-02-15T22:36:16.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:15 smithi033 ceph-mon[29033]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:36:16.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:15 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:36:16.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:15 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:36:16.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:15 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:17.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:16 smithi082 ceph-mon[37153]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-02-15T22:36:17.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:16 smithi033 ceph-mon[29033]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-02-15T22:36:18.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:17 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:18.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:17 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2374140505' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6625f0e7-013e-4fab-897d-06ed130d9878"}]: dispatch 2024-02-15T22:36:18.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:17 smithi082 ceph-mon[37153]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6625f0e7-013e-4fab-897d-06ed130d9878"}]: dispatch 2024-02-15T22:36:18.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:17 smithi082 ceph-mon[37153]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6625f0e7-013e-4fab-897d-06ed130d9878"}]': finished 2024-02-15T22:36:18.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:17 smithi082 ceph-mon[37153]: osdmap e32: 5 total, 4 up, 5 in 2024-02-15T22:36:18.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:17 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:18.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:17 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:17 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2374140505' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6625f0e7-013e-4fab-897d-06ed130d9878"}]: dispatch 2024-02-15T22:36:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:17 smithi033 ceph-mon[29033]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6625f0e7-013e-4fab-897d-06ed130d9878"}]: dispatch 2024-02-15T22:36:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:17 smithi033 ceph-mon[29033]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6625f0e7-013e-4fab-897d-06ed130d9878"}]': finished 2024-02-15T22:36:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:17 smithi033 ceph-mon[29033]: osdmap e32: 5 total, 4 up, 5 in 2024-02-15T22:36:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:17 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:18 smithi033 ceph-mon[29033]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-02-15T22:36:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:18 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/1151572509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:36:19.335 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:18 smithi082 ceph-mon[37153]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-02-15T22:36:19.335 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:18 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/1151572509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:36:21.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:20 smithi033 ceph-mon[29033]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-15T22:36:21.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:20 smithi082 ceph-mon[37153]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-15T22:36:23.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:22 smithi033 ceph-mon[29033]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-15T22:36:23.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:22 smithi082 ceph-mon[37153]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-15T22:36:25.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:24 smithi082 ceph-mon[37153]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:25.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:36:25.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:24 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:25.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:24 smithi033 ceph-mon[29033]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:25.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:36:25.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:24 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:26.263 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:25 smithi082 ceph-mon[37153]: Deploying daemon osd.4 on smithi082 2024-02-15T22:36:26.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:25 smithi033 ceph-mon[29033]: Deploying daemon osd.4 on smithi082 2024-02-15T22:36:27.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:26 smithi033 ceph-mon[29033]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:27.278 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:26 smithi082 ceph-mon[37153]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:28 smithi082 ceph-mon[37153]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:29.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:28 smithi033 ceph-mon[29033]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:31 smithi082 ceph-mon[37153]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:31 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:31 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:31 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:31.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:31 smithi033 ceph-mon[29033]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:31.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:31.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:31.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:32.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:32.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:33.304 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:33 smithi082 ceph-mon[37153]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.364+0000 7fc7aaffd700 1 -- 172.21.15.82:0/1783689571 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc7bc101990 con 0x7fc7a40692a0 2024-02-15T22:36:33.364 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 4 on host 'smithi082' 2024-02-15T22:36:33.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.365+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc7a40692a0 msgr2=0x7fc7a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:33.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.365+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc7a40692a0 0x7fc7a406b750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007fd0 tx=0x7fc7b0009f60 comp rx=0 tx=0).stop 2024-02-15T22:36:33.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.365+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 msgr2=0x7fc7bc110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.365+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc110590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0093b0 tx=0x7fc7ac009e30 comp rx=0 tx=0).stop 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.366+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 shutdown_connections 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.366+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc7a40692a0 0x7fc7a406b750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.366+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7bc0fbe40 0x7fc7bc110590 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.366+0000 7fc7c0f35700 1 --2- 172.21.15.82:0/1783689571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7bc0fcfb0 0x7fc7bc112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.366+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 >> 172.21.15.82:0/1783689571 conn(0x7fc7bc0f74e0 msgr2=0x7fc7bc100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.366+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 shutdown_connections 2024-02-15T22:36:33.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:33.366+0000 7fc7c0f35700 1 -- 172.21.15.82:0/1783689571 wait complete. 2024-02-15T22:36:33.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:33 smithi033 ceph-mon[29033]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:34.001 DEBUG:teuthology.orchestra.run.smithi082:osd.4> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.4.service 2024-02-15T22:36:34.004 INFO:tasks.cephadm:Deploying osd.5 on smithi082 with /dev/vg_nvme/lv_2... 2024-02-15T22:36:34.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T22:36:34.545 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:34 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:34.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:34 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:34.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:34 smithi082 ceph-mon[37153]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:34.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:34 smithi082 ceph-mon[37153]: from='osd.4 [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:36:34.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:34 smithi082 ceph-mon[37153]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:36:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:36:34.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:34 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:34.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:34 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:34.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:34 smithi033 ceph-mon[29033]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:34.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:34 smithi033 ceph-mon[29033]: from='osd.4 [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:36:34.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:34 smithi033 ceph-mon[29033]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:36:35.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-mon[37153]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:36:35.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-mon[37153]: osdmap e33: 5 total, 4 up, 5 in 2024-02-15T22:36:35.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:35.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-mon[37153]: from='osd.4 [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:35.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-mon[37153]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:35.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:35.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:35.624 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[49426]: 2024-02-15T22:36:35.353+0000 7ff57bbda700 -1 osd.4 0 waiting for initial osdmap 2024-02-15T22:36:35.624 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:36:35 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[49426]: 2024-02-15T22:36:35.360+0000 7ff5789d9700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:36:35.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:35 smithi033 ceph-mon[29033]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:36:35.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:35 smithi033 ceph-mon[29033]: osdmap e33: 5 total, 4 up, 5 in 2024-02-15T22:36:35.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:35.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:35 smithi033 ceph-mon[29033]: from='osd.4 [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:35.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:35 smithi033 ceph-mon[29033]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:36:35.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:35.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:36.531 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:36 smithi082 ceph-mon[37153]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-02-15T22:36:36.531 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:36 smithi082 ceph-mon[37153]: osdmap e34: 5 total, 4 up, 5 in 2024-02-15T22:36:36.531 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:36 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:36.531 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:36 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:36.531 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:36 smithi082 ceph-mon[37153]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:36.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:36 smithi033 ceph-mon[29033]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-02-15T22:36:36.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:36 smithi033 ceph-mon[29033]: osdmap e34: 5 total, 4 up, 5 in 2024-02-15T22:36:36.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:36.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:36.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:36 smithi033 ceph-mon[29033]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-15T22:36:36.778 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T22:36:36.778 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T22:36:36.778 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-02-15T22:36:36.778 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-02-15T22:36:36.778 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0136667 s, 767 MB/s 2024-02-15T22:36:36.779 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-02-15T22:36:37.520 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:37 smithi082 ceph-mon[37153]: purged_snaps scrub starts 2024-02-15T22:36:37.521 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:37 smithi082 ceph-mon[37153]: purged_snaps scrub ok 2024-02-15T22:36:37.521 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:37.521 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:37 smithi082 ceph-mon[37153]: osd.4 [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] boot 2024-02-15T22:36:37.521 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:37 smithi082 ceph-mon[37153]: osdmap e35: 5 total, 5 up, 5 in 2024-02-15T22:36:37.521 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:37.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:37 smithi033 ceph-mon[29033]: purged_snaps scrub starts 2024-02-15T22:36:37.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:37 smithi033 ceph-mon[29033]: purged_snaps scrub ok 2024-02-15T22:36:37.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:37.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:37 smithi033 ceph-mon[29033]: osd.4 [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] boot 2024-02-15T22:36:37.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:37 smithi033 ceph-mon[29033]: osdmap e35: 5 total, 5 up, 5 in 2024-02-15T22:36:37.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:36:38.615 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:38 smithi082 ceph-mon[37153]: osdmap e36: 5 total, 5 up, 5 in 2024-02-15T22:36:38.616 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:38 smithi082 ceph-mon[37153]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:38.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-02-15T22:36:38.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:38 smithi033 ceph-mon[29033]: osdmap e36: 5 total, 5 up, 5 in 2024-02-15T22:36:38.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:38 smithi033 ceph-mon[29033]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:36:40.553 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: Detected new or changed devices on smithi082 2024-02-15T22:36:40.553 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.553 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.553 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:36:40.553 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:36:40.553 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi082 to 7968M 2024-02-15T22:36:40.553 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.554 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:40 smithi082 ceph-mon[37153]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:40.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: Detected new or changed devices on smithi082 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi082 to 7968M 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:40 smithi033 ceph-mon[29033]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 -- 172.21.15.82:0/3732969463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fe0e0 msgr2=0x7f000c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 --2- 172.21.15.82:0/3732969463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fe0e0 0x7f000c0fe550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0000004970 tx=0x7f0000009e30 comp rx=0 tx=0).stop 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 -- 172.21.15.82:0/3732969463 shutdown_connections 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 --2- 172.21.15.82:0/3732969463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fe0e0 0x7f000c0fe550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 --2- 172.21.15.82:0/3732969463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000c0fcef0 0x7f000c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 -- 172.21.15.82:0/3732969463 >> 172.21.15.82:0/3732969463 conn(0x7f000c0f8620 msgr2=0x7f000c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 -- 172.21.15.82:0/3732969463 shutdown_connections 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.089+0000 7f001265c700 1 -- 172.21.15.82:0/3732969463 wait complete. 2024-02-15T22:36:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f001265c700 1 Processor -- start 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f001265c700 1 -- start start 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f001265c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fcef0 0x7f000c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f001265c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000c0fe0e0 0x7f000c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f001265c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c070970 con 0x7f000c0fe0e0 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f001265c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c070ae0 con 0x7f000c0fcef0 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f000bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fcef0 0x7f000c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f000bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fcef0 0x7f000c071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35102/0 (socket says 172.21.15.82:35102) 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.090+0000 7f000bfff700 1 -- 172.21.15.82:0/2793238933 learned_addr learned my addr 172.21.15.82:0/2793238933 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f000b7fe700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000c0fe0e0 0x7f000c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f000bfff700 1 -- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000c0fe0e0 msgr2=0x7f000c0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f000bfff700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000c0fe0e0 0x7f000c0702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f000bfff700 1 -- 172.21.15.82:0/2793238933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000005040 con 0x7f000c0fcef0 2024-02-15T22:36:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f000b7fe700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000c0fe0e0 0x7f000c0702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:36:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f000bfff700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fcef0 0x7f000c071e60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efffc00b790 tx=0x7efffc009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:36:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f0008ff9700 1 -- 172.21.15.82:0/2793238933 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efffc00f6f0 con 0x7f000c0fcef0 2024-02-15T22:36:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c070dc0 con 0x7f000c0fcef0 2024-02-15T22:36:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f0008ff9700 1 -- 172.21.15.82:0/2793238933 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efffc00fd20 con 0x7f000c0fcef0 2024-02-15T22:36:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f0008ff9700 1 -- 172.21.15.82:0/2793238933 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efffc0103a0 con 0x7f000c0fcef0 2024-02-15T22:36:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.091+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c071140 con 0x7f000c0fcef0 2024-02-15T22:36:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.092+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c04bed0 con 0x7f000c0fcef0 2024-02-15T22:36:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.092+0000 7f0008ff9700 1 -- 172.21.15.82:0/2793238933 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7efffc011400 con 0x7f000c0fcef0 2024-02-15T22:36:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.093+0000 7f0008ff9700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efff40692b0 0x7efff406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:36:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.093+0000 7f0008ff9700 1 -- 172.21.15.82:0/2793238933 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7efffc086b40 con 0x7f000c0fcef0 2024-02-15T22:36:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.093+0000 7f000b7fe700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efff40692b0 0x7efff406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:36:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.093+0000 7f000b7fe700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efff40692b0 0x7efff406b760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0000000c00 tx=0x7f0000009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:36:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.097+0000 7f0008ff9700 1 -- 172.21.15.82:0/2793238933 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efffc056d70 con 0x7f000c0fcef0 2024-02-15T22:36:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:36:41.287+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f000c102ac0 con 0x7efff40692b0 2024-02-15T22:36:41.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:36:41.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:36:41.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:42.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:36:42.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:36:42.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:42.662 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:42 smithi082 ceph-mon[37153]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:36:42.663 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:42 smithi082 ceph-mon[37153]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:43.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:42 smithi033 ceph-mon[29033]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:36:43.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:42 smithi033 ceph-mon[29033]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:44.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:43 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/3278230021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b74c887-f24b-4da2-85fd-5d351fe44045"}]: dispatch 2024-02-15T22:36:44.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:43 smithi033 ceph-mon[29033]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b74c887-f24b-4da2-85fd-5d351fe44045"}]: dispatch 2024-02-15T22:36:44.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:43 smithi033 ceph-mon[29033]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b74c887-f24b-4da2-85fd-5d351fe44045"}]': finished 2024-02-15T22:36:44.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:43 smithi033 ceph-mon[29033]: osdmap e37: 6 total, 5 up, 6 in 2024-02-15T22:36:44.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:43 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:36:44.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:43 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/3278230021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b74c887-f24b-4da2-85fd-5d351fe44045"}]: dispatch 2024-02-15T22:36:44.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:43 smithi082 ceph-mon[37153]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b74c887-f24b-4da2-85fd-5d351fe44045"}]: dispatch 2024-02-15T22:36:44.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:43 smithi082 ceph-mon[37153]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b74c887-f24b-4da2-85fd-5d351fe44045"}]': finished 2024-02-15T22:36:44.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:43 smithi082 ceph-mon[37153]: osdmap e37: 6 total, 5 up, 6 in 2024-02-15T22:36:44.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:43 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:36:45.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:44 smithi082 ceph-mon[37153]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:45.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:44 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/2196982462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:36:45.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:44 smithi033 ceph-mon[29033]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:45.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:44 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/2196982462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:36:47.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:46 smithi033 ceph-mon[29033]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:47.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:46 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:46 smithi082 ceph-mon[37153]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:46 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:36:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:48 smithi082 ceph-mon[37153]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:49.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:48 smithi033 ceph-mon[29033]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:51.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:50 smithi033 ceph-mon[29033]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:51.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:50 smithi082 ceph-mon[37153]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:52.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:36:52.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:52.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:36:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:36:52.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:52 smithi082 ceph-mon[37153]: Deploying daemon osd.5 on smithi082 2024-02-15T22:36:52.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:52 smithi082 ceph-mon[37153]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:52 smithi033 ceph-mon[29033]: Deploying daemon osd.5 on smithi082 2024-02-15T22:36:53.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:52 smithi033 ceph-mon[29033]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:55.025 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:54 smithi082 ceph-mon[37153]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:55.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:54 smithi033 ceph-mon[29033]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:57.241 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:56 smithi082 ceph-mon[37153]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:57.241 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:57.241 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:57.241 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:56 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:57.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:56 smithi033 ceph-mon[29033]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:57.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:57.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:36:57.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:56 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:36:59.060 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:36:58 smithi082 ceph-mon[37153]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:36:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:36:58 smithi033 ceph-mon[29033]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:37:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.815+0000 7f0008ff9700 1 -- 172.21.15.82:0/2793238933 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f000c102ac0 con 0x7efff40692b0 2024-02-15T22:37:00.816 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 5 on host 'smithi082' 2024-02-15T22:37:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efff40692b0 msgr2=0x7efff406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efff40692b0 0x7efff406b760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0000000c00 tx=0x7f0000009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fcef0 msgr2=0x7f000c071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fcef0 0x7f000c071e60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efffc00b790 tx=0x7efffc009220 comp rx=0 tx=0).stop 2024-02-15T22:37:00.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 shutdown_connections 2024-02-15T22:37:00.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7efff40692b0 0x7efff406b760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:00.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f000c0fcef0 0x7f000c071e60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:00.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 --2- 172.21.15.82:0/2793238933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000c0fe0e0 0x7f000c0702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:00.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.817+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 >> 172.21.15.82:0/2793238933 conn(0x7f000c0f8620 msgr2=0x7f000c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:00.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.818+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 shutdown_connections 2024-02-15T22:37:00.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:00.818+0000 7f001265c700 1 -- 172.21.15.82:0/2793238933 wait complete. 2024-02-15T22:37:01.471 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:01 smithi082 ceph-mon[37153]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:37:01.471 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:01 smithi082 ceph-mon[37153]: from='osd.5 [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:37:01.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:01 smithi082 ceph-mon[37153]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:37:01.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.501 DEBUG:teuthology.orchestra.run.smithi082:osd.5> sudo journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.5.service 2024-02-15T22:37:01.503 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-15T22:37:01.503 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-15T22:37:01.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:01 smithi033 ceph-mon[29033]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:37:01.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:01 smithi033 ceph-mon[29033]: from='osd.5 [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:37:01.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:01 smithi033 ceph-mon[29033]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:37:01.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:02.511 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-mon[37153]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T22:37:02.511 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-mon[37153]: osdmap e38: 6 total, 5 up, 6 in 2024-02-15T22:37:02.511 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:02.511 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-mon[37153]: from='osd.5 [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:37:02.511 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-mon[37153]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:37:02.511 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:02.511 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[55888]: 2024-02-15T22:37:02.231+0000 7f599cf02700 -1 osd.5 0 waiting for initial osdmap 2024-02-15T22:37:02.511 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:37:02 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[55888]: 2024-02-15T22:37:02.239+0000 7f59964fa700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:37:02.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:02 smithi033 ceph-mon[29033]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T22:37:02.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:02 smithi033 ceph-mon[29033]: osdmap e38: 6 total, 5 up, 6 in 2024-02-15T22:37:02.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:02 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:02.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:02 smithi033 ceph-mon[29033]: from='osd.5 [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:37:02.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:02 smithi033 ceph-mon[29033]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:37:02.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:02 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:03.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:03 smithi033 ceph-mon[29033]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:37:03.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:03 smithi033 ceph-mon[29033]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-02-15T22:37:03.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:03 smithi033 ceph-mon[29033]: osdmap e39: 6 total, 5 up, 6 in 2024-02-15T22:37:03.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:03.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:03 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 -- 172.21.15.33:0/2478963682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 msgr2=0x7fc8fc0fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 --2- 172.21.15.33:0/2478963682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc0fd230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4004940 tx=0x7fc8e4009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 -- 172.21.15.33:0/2478963682 shutdown_connections 2024-02-15T22:37:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 --2- 172.21.15.33:0/2478963682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc0fd230 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 --2- 172.21.15.33:0/2478963682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8fc0fc470 0x7fc8fc0fc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 -- 172.21.15.33:0/2478963682 >> 172.21.15.33:0/2478963682 conn(0x7fc8fc0f6d20 msgr2=0x7fc8fc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 -- 172.21.15.33:0/2478963682 shutdown_connections 2024-02-15T22:37:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.547+0000 7fc901811700 1 -- 172.21.15.33:0/2478963682 wait complete. 2024-02-15T22:37:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc901811700 1 Processor -- start 2024-02-15T22:37:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc901811700 1 -- start start 2024-02-15T22:37:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc901811700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8fc0fc470 0x7fc8fc10dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc901811700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc10e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc901811700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc10e730 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc901811700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc10efd0 con 0x7fc8fc0fc470 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8fa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc10e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8faffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8fc0fc470 0x7fc8fc10dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8fa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc10e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50482/0 (socket says 172.21.15.33:50482) 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8fa7fc700 1 -- 172.21.15.33:0/2295491187 learned_addr learned my addr 172.21.15.33:0/2295491187 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8fa7fc700 1 -- 172.21.15.33:0/2295491187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8fc0fc470 msgr2=0x7fc8fc10dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8fa7fc700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8fc0fc470 0x7fc8fc10dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8fa7fc700 1 -- 172.21.15.33:0/2295491187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4005040 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.548+0000 7fc8fa7fc700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc10e130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40093b0 tx=0x7fc8e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.549+0000 7fc8f37fe700 1 -- 172.21.15.33:0/2295491187 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e400e040 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.549+0000 7fc8f37fe700 1 -- 172.21.15.33:0/2295491187 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8e400bcc0 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.549+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc10f250 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.549+0000 7fc8f37fe700 1 -- 172.21.15.33:0/2295491187 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e401c630 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.549+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc10f790 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.550+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc04bed0 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.550+0000 7fc8f37fe700 1 -- 172.21.15.33:0/2295491187 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fc8e4013980 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.551+0000 7fc8f37fe700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc8e80692a0 0x7fc8e806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.551+0000 7fc8f37fe700 1 -- 172.21.15.33:0/2295491187 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc8e40881d0 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.551+0000 7fc8faffd700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc8e80692a0 0x7fc8e806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.551+0000 7fc8faffd700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc8e80692a0 0x7fc8e806b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009fd0 tx=0x7fc8ec00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.555+0000 7fc8f37fe700 1 -- 172.21.15.33:0/2295491187 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc8e40582d0 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:03 smithi082 ceph-mon[37153]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-15T22:37:03.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:03 smithi082 ceph-mon[37153]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-02-15T22:37:03.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:03 smithi082 ceph-mon[37153]: osdmap e39: 6 total, 5 up, 6 in 2024-02-15T22:37:03.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:03.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:03 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.749+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc8fc067690 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.749+0000 7fc8f37fe700 1 -- 172.21.15.33:0/2295491187 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc8e4057e60 con 0x7fc8fc0fcdc0 2024-02-15T22:37:03.750 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc8e80692a0 msgr2=0x7fc8e806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc8e80692a0 0x7fc8e806b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009fd0 tx=0x7fc8ec00b040 comp rx=0 tx=0).stop 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 msgr2=0x7fc8fc10e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc10e130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40093b0 tx=0x7fc8e4009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 shutdown_connections 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc8e80692a0 0x7fc8e806b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8fc0fc470 0x7fc8fc10dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:03.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 --2- 172.21.15.33:0/2295491187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0fcdc0 0x7fc8fc10e130 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 >> 172.21.15.33:0/2295491187 conn(0x7fc8fc0f6d20 msgr2=0x7fc8fc0fb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 shutdown_connections 2024-02-15T22:37:03.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:03.752+0000 7fc901811700 1 -- 172.21.15.33:0/2295491187 wait complete. 2024-02-15T22:37:04.343 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:04 smithi033 ceph-mon[29033]: purged_snaps scrub starts 2024-02-15T22:37:04.343 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:04 smithi033 ceph-mon[29033]: purged_snaps scrub ok 2024-02-15T22:37:04.344 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:04 smithi033 ceph-mon[29033]: osd.5 [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] boot 2024-02-15T22:37:04.344 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:04 smithi033 ceph-mon[29033]: osdmap e40: 6 total, 6 up, 6 in 2024-02-15T22:37:04.344 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:04.344 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:04 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2295491187' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T22:37:04.477 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1708036623,"num_in_osds":6,"osd_in_since":1708036603,"num_remapped_pgs":0} 2024-02-15T22:37:04.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T22:37:04.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:04 smithi082 ceph-mon[37153]: purged_snaps scrub starts 2024-02-15T22:37:04.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:04 smithi082 ceph-mon[37153]: purged_snaps scrub ok 2024-02-15T22:37:04.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:04 smithi082 ceph-mon[37153]: osd.5 [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] boot 2024-02-15T22:37:04.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:04 smithi082 ceph-mon[37153]: osdmap e40: 6 total, 6 up, 6 in 2024-02-15T22:37:04.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:37:04.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:04 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2295491187' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T22:37:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:05.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: osdmap e41: 6 total, 6 up, 6 in 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:37:05.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:37:05.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:37:05.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:05 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:05.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: osdmap e41: 6 total, 6 up, 6 in 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:37:05.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:37:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:37:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:05 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:37:06.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:06 smithi033 ceph-mon[29033]: Detected new or changed devices on smithi082 2024-02-15T22:37:06.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:06 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi082 to 5312M 2024-02-15T22:37:06.509 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:06 smithi082 ceph-mon[37153]: Detected new or changed devices on smithi082 2024-02-15T22:37:06.509 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:06 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi082 to 5312M 2024-02-15T22:37:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 -- 172.21.15.33:0/2027716574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 msgr2=0x7f50f8103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/2027716574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f8103510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f50e8004940 tx=0x7f50e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 -- 172.21.15.33:0/2027716574 shutdown_connections 2024-02-15T22:37:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/2027716574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 0x7f50f80fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/2027716574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f8103510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 -- 172.21.15.33:0/2027716574 >> 172.21.15.33:0/2027716574 conn(0x7f50f8071560 msgr2=0x7f50f8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 -- 172.21.15.33:0/2027716574 shutdown_connections 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 -- 172.21.15.33:0/2027716574 wait complete. 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.509+0000 7f50fdcb3700 1 Processor -- start 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50fdcb3700 1 -- start start 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50fdcb3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 0x7f50f8113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50fdcb3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f81140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50fdcb3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f81146f0 con 0x7f50f8103140 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50fdcb3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f810da20 con 0x7f50f80fb570 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 0x7f50f8113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f81140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 0x7f50f8113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:36860/0 (socket says 172.21.15.33:36860) 2024-02-15T22:37:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f81140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48570/0 (socket says 172.21.15.33:48570) 2024-02-15T22:37:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f77fe700 1 -- 172.21.15.33:0/3616033909 learned_addr learned my addr 172.21.15.33:0/3616033909 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f6ffd700 1 -- 172.21.15.33:0/3616033909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 msgr2=0x7f50f8113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f6ffd700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 0x7f50f8113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f6ffd700 1 -- 172.21.15.33:0/3616033909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8005040 con 0x7f50f8103140 2024-02-15T22:37:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.510+0000 7f50f77fe700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 0x7f50f8113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:37:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.511+0000 7f50f6ffd700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f81140a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009fd0 tx=0x7f50ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.511+0000 7f50dffff700 1 -- 172.21.15.33:0/3616033909 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50ec004e90 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.511+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f810dca0 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.511+0000 7f50dffff700 1 -- 172.21.15.33:0/3616033909 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50ec00f040 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.511+0000 7f50dffff700 1 -- 172.21.15.33:0/3616033909 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50ec00ca50 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.511+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f810e1e0 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.512+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f8100310 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.512+0000 7f50dffff700 1 -- 172.21.15.33:0/3616033909 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f50ec007cc0 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.513+0000 7f50dffff700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f50e00692a0 0x7f50e006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.513+0000 7f50dffff700 1 -- 172.21.15.33:0/3616033909 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f50ec0868a0 con 0x7f50f8103140 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.513+0000 7f50f77fe700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f50e00692a0 0x7f50e006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.513+0000 7f50f77fe700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f50e00692a0 0x7f50e006b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50e800b0d0 tx=0x7f50e8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:06.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.517+0000 7f50dffff700 1 -- 172.21.15.33:0/3616033909 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f50ec04dbd0 con 0x7f50f8103140 2024-02-15T22:37:06.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.709+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50f810a1b0 con 0x7f50f8103140 2024-02-15T22:37:06.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.710+0000 7f50dffff700 1 -- 172.21.15.33:0/3616033909 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+10984 (secure 0 0 0) 0x7f50ec0569d0 con 0x7f50f8103140 2024-02-15T22:37:06.711 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:37:06.711 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","created":"2024-02-15T22:31:07.591719+0000","modified":"2024-02-15T22:37:04.227236+0000","last_up_change":"2024-02-15T22:37:03.221336+0000","last_in_change":"2024-02-15T22:36:43.765254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:35:50.180713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"630ee5c8-c8e3-4190-878c-82aa86eb7366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6803","nonce":308155144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6805","nonce":308155144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6809","nonce":308155144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6807","nonce":308155144}]},"public_addr":"172.21.15.33:6803/308155144","cluster_addr":"172.21.15.33:6805/308155144","heartbeat_back_addr":"172.21.15.33:6809/308155144","heartbeat_front_addr":"172.21.15.33:6807/308155144","state":["exists","up"]},{"osd":1,"uuid":"9edc1e24-0b17-4e9a-ac42-18decf1d9c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6811","nonce":283250145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6813","nonce":283250145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6817","nonce":283250145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6815","nonce":283250145}]},"public_addr":"172.21.15.33:6811/283250145","cluster_addr":"172.21.15.33:6813/283250145","heartbeat_back_addr":"172.21.15.33:6817/283250145","heartbeat_front_addr":"172.21.15.33:6815/283250145","state":["exists","up"]},{"osd":2,"uuid":"eaa0a666-819e-4268-a788-e2ab2b12dd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6819","nonce":936985146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6821","nonce":936985146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6825","nonce":936985146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6823","nonce":936985146}]},"public_addr":"172.21.15.33:6819/936985146","cluster_addr":"172.21.15.33:6821/936985146","heartbeat_back_addr":"172.21.15.33:6825/936985146","heartbeat_front_addr":"172.21.15.33:6823/936985146","state":["exists","up"]},{"osd":3,"uuid":"111d4225-5978-43c6-8276-87091559a25b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6801","nonce":234002786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6803","nonce":234002786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6807","nonce":234002786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6805","nonce":234002786}]},"public_addr":"172.21.15.82:6801/234002786","cluster_addr":"172.21.15.82:6803/234002786","heartbeat_back_addr":"172.21.15.82:6807/234002786","heartbeat_front_addr":"172.21.15.82:6805/234002786","state":["exists","up"]},{"osd":4,"uuid":"6625f0e7-013e-4fab-897d-06ed130d9878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6809","nonce":462085336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6811","nonce":462085336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6815","nonce":462085336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6813","nonce":462085336}]},"public_addr":"172.21.15.82:6809/462085336","cluster_addr":"172.21.15.82:6811/462085336","heartbeat_back_addr":"172.21.15.82:6815/462085336","heartbeat_front_addr":"172.21.15.82:6813/462085336","state":["exists","up"]},{"osd":5,"uuid":"6b74c887-f24b-4da2-85fd-5d351fe44045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6817","nonce":483187029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6819","nonce":483187029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6823","nonce":483187029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6821","nonce":483187029}]},"public_addr":"172.21.15.82:6817/483187029","cluster_addr":"172.21.15.82:6819/483187029","heartbeat_back_addr":"172.21.15.82:6823/483187029","heartbeat_front_addr":"172.21.15.82:6821/483187029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:34:48.066478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:16.174578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:46.001693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:09.278760+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:34.947739+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:37:01.519872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/771735499":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/4080754497":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/1038575526":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6801/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6801/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/2241336882":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6800/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/547235877":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/245484360":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6801/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/275440289":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/3583368704":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/735416243":"2024-02-16T22:31:43.072803+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f50e00692a0 msgr2=0x7f50e006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f50e00692a0 0x7f50e006b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50e800b0d0 tx=0x7f50e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 msgr2=0x7f50f81140a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f81140a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009fd0 tx=0x7f50ec00b040 comp rx=0 tx=0).stop 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 shutdown_connections 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f50e00692a0 0x7f50e006b750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f80fb570 0x7f50f8113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 --2- 172.21.15.33:0/3616033909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f8103140 0x7f50f81140a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 >> 172.21.15.33:0/3616033909 conn(0x7f50f8071560 msgr2=0x7f50f80fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 shutdown_connections 2024-02-15T22:37:06.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:06.712+0000 7f50fdcb3700 1 -- 172.21.15.33:0/3616033909 wait complete. 2024-02-15T22:37:07.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:07 smithi033 ceph-mon[29033]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:07.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:07 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3616033909' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:37:07.551 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:35:50.180713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-02-15T22:37:07.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-15T22:37:07.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:07 smithi082 ceph-mon[37153]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:07.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:07 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3616033909' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:37:07.817 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:09.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:08 smithi082 ceph-mon[37153]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:09.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:08 smithi033 ceph-mon[29033]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.561+0000 7f0d87951700 1 -- 172.21.15.33:0/3070199199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 msgr2=0x7f0d800fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.561+0000 7f0d87951700 1 --2- 172.21.15.33:0/3070199199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d800fb9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c004940 tx=0x7f0d7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.561+0000 7f0d87951700 1 -- 172.21.15.33:0/3070199199 shutdown_connections 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.561+0000 7f0d87951700 1 --2- 172.21.15.33:0/3070199199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d800fb9c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 --2- 172.21.15.33:0/3070199199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103140 0x7f0d80103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 -- 172.21.15.33:0/3070199199 >> 172.21.15.33:0/3070199199 conn(0x7f0d80071560 msgr2=0x7f0d80071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 -- 172.21.15.33:0/3070199199 shutdown_connections 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 -- 172.21.15.33:0/3070199199 wait complete. 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 Processor -- start 2024-02-15T22:37:09.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 -- start start 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d80113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103140 0x7f0d80114160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80114840 con 0x7f0d800fb570 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d87951700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8010dae0 con 0x7f0d80103140 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d856ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d80113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d856ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d80113c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48584/0 (socket says 172.21.15.33:48584) 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.562+0000 7f0d856ed700 1 -- 172.21.15.33:0/1212847682 learned_addr learned my addr 172.21.15.33:0/1212847682 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d84eec700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103140 0x7f0d80114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d856ed700 1 -- 172.21.15.33:0/1212847682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103140 msgr2=0x7f0d80114160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d856ed700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103140 0x7f0d80114160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d856ed700 1 -- 172.21.15.33:0/1212847682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c005040 con 0x7f0d800fb570 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d84eec700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103140 0x7f0d80114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:37:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d856ed700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d80113c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000b790 tx=0x7f0d70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d75ffb700 1 -- 172.21.15.33:0/1212847682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7000f770 con 0x7f0d800fb570 2024-02-15T22:37:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8010ddc0 con 0x7f0d800fb570 2024-02-15T22:37:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d75ffb700 1 -- 172.21.15.33:0/1212847682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d7000fda0 con 0x7f0d800fb570 2024-02-15T22:37:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d75ffb700 1 -- 172.21.15.33:0/1212847682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7000d310 con 0x7f0d800fb570 2024-02-15T22:37:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.563+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8010e300 con 0x7f0d800fb570 2024-02-15T22:37:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.564+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d80105570 con 0x7f0d800fb570 2024-02-15T22:37:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.565+0000 7f0d75ffb700 1 -- 172.21.15.33:0/1212847682 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f0d70010420 con 0x7f0d800fb570 2024-02-15T22:37:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.565+0000 7f0d75ffb700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f0d6c0692a0 0x7f0d6c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.565+0000 7f0d84eec700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f0d6c0692a0 0x7f0d6c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.565+0000 7f0d75ffb700 1 -- 172.21.15.33:0/1212847682 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0d70086e70 con 0x7f0d800fb570 2024-02-15T22:37:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.565+0000 7f0d84eec700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f0d6c0692a0 0x7f0d6c06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c000c00 tx=0x7f0d7c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:09.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.570+0000 7f0d75ffb700 1 -- 172.21.15.33:0/1212847682 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0d70056f70 con 0x7f0d800fb570 2024-02-15T22:37:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.759+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d8010a2a0 con 0x7f0d800fb570 2024-02-15T22:37:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.760+0000 7f0d75ffb700 1 -- 172.21.15.33:0/1212847682 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d70056b00 con 0x7f0d800fb570 2024-02-15T22:37:09.760 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T22:37:09.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f0d6c0692a0 msgr2=0x7f0d6c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:09.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f0d6c0692a0 0x7f0d6c06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c000c00 tx=0x7f0d7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:09.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 msgr2=0x7f0d80113c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:09.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d80113c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000b790 tx=0x7f0d70009250 comp rx=0 tx=0).stop 2024-02-15T22:37:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 shutdown_connections 2024-02-15T22:37:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f0d6c0692a0 0x7f0d6c06b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d800fb570 0x7f0d80113c20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 --2- 172.21.15.33:0/1212847682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103140 0x7f0d80114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 >> 172.21.15.33:0/1212847682 conn(0x7f0d80071560 msgr2=0x7f0d800f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 shutdown_connections 2024-02-15T22:37:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:09.762+0000 7f0d87951700 1 -- 172.21.15.33:0/1212847682 wait complete. 2024-02-15T22:37:10.111 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:09 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1212847682' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:37:10.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:09 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1212847682' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:37:10.411 INFO:tasks.cephadm:Setting up client nodes... 2024-02-15T22:37:10.412 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T22:37:10.669 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:11.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:10 smithi033 ceph-mon[29033]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:11.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:10 smithi082 ceph-mon[37153]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 -- 172.21.15.33:0/4180762381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c40fda80 msgr2=0x7f66c40ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4180762381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c40fda80 0x7f66c40ffe60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009ce0 tx=0x7f66bc004d10 comp rx=0 tx=0).stop 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 -- 172.21.15.33:0/4180762381 shutdown_connections 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4180762381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c41003a0 0x7f66c4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4180762381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c40fda80 0x7f66c40ffe60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 -- 172.21.15.33:0/4180762381 >> 172.21.15.33:0/4180762381 conn(0x7f66c40f7500 msgr2=0x7f66c40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 -- 172.21.15.33:0/4180762381 shutdown_connections 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 -- 172.21.15.33:0/4180762381 wait complete. 2024-02-15T22:37:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 Processor -- start 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 -- start start 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.241+0000 7f66c8b87700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c40fda80 0x7f66c410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c8b87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c41003a0 0x7f66c410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c8b87700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c410e5f0 con 0x7f66c41003a0 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c8b87700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c410ee90 con 0x7f66c40fda80 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c41003a0 0x7f66c410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c41003a0 0x7f66c410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48604/0 (socket says 172.21.15.33:48604) 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c1d9b700 1 -- 172.21.15.33:0/4019094434 learned_addr learned my addr 172.21.15.33:0/4019094434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c259c700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c40fda80 0x7f66c410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c1d9b700 1 -- 172.21.15.33:0/4019094434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c40fda80 msgr2=0x7f66c410dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c1d9b700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c40fda80 0x7f66c410dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c1d9b700 1 -- 172.21.15.33:0/4019094434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009940 con 0x7f66c41003a0 2024-02-15T22:37:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c1d9b700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c41003a0 0x7f66c410dff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66ac002a50 tx=0x7f66ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66baffd700 1 -- 172.21.15.33:0/4019094434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66ac007cc0 con 0x7f66c41003a0 2024-02-15T22:37:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66baffd700 1 -- 172.21.15.33:0/4019094434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66ac00f040 con 0x7f66c41003a0 2024-02-15T22:37:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c410f170 con 0x7f66c41003a0 2024-02-15T22:37:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66baffd700 1 -- 172.21.15.33:0/4019094434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66ac00da30 con 0x7f66c41003a0 2024-02-15T22:37:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.242+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c410f6b0 con 0x7f66c41003a0 2024-02-15T22:37:12.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.243+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c404bed0 con 0x7f66c41003a0 2024-02-15T22:37:12.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.244+0000 7f66baffd700 1 -- 172.21.15.33:0/4019094434 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f66ac00dbb0 con 0x7f66c41003a0 2024-02-15T22:37:12.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.244+0000 7f66baffd700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f66b00692b0 0x7f66b006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:12.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.244+0000 7f66baffd700 1 -- 172.21.15.33:0/4019094434 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f66ac086c00 con 0x7f66c41003a0 2024-02-15T22:37:12.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.244+0000 7f66c259c700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f66b00692b0 0x7f66b006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:12.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.244+0000 7f66c259c700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f66b00692b0 0x7f66b006b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66bc005010 tx=0x7f66bc004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:12.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.248+0000 7f66baffd700 1 -- 172.21.15.33:0/4019094434 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f66ac08c020 con 0x7f66c41003a0 2024-02-15T22:37:12.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.519+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f66c4105a10 con 0x7f66c41003a0 2024-02-15T22:37:12.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.525+0000 7f66baffd700 1 -- 172.21.15.33:0/4019094434 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f66ac056c80 con 0x7f66c41003a0 2024-02-15T22:37:12.526 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-02-15T22:37:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAYks5lBB0OHxAA5K5ltiDyESf05P98kTY6Nw== 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f66b00692b0 msgr2=0x7f66b006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f66b00692b0 0x7f66b006b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66bc005010 tx=0x7f66bc004d10 comp rx=0 tx=0).stop 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c41003a0 msgr2=0x7f66c410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c41003a0 0x7f66c410dff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66ac002a50 tx=0x7f66ac0046b0 comp rx=0 tx=0).stop 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 shutdown_connections 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f66b00692b0 0x7f66b006b760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c40fda80 0x7f66c410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 --2- 172.21.15.33:0/4019094434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66c41003a0 0x7f66c410dff0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.527+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 >> 172.21.15.33:0/4019094434 conn(0x7f66c40f7500 msgr2=0x7f66c40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.528+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 shutdown_connections 2024-02-15T22:37:12.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:12.528+0000 7f66c8b87700 1 -- 172.21.15.33:0/4019094434 wait complete. 2024-02-15T22:37:13.200 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:12 smithi033 ceph-mon[29033]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:13.200 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:12 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/4019094434' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:37:13.200 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:12 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/4019094434' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:37:13.225 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:37:13.225 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-15T22:37:13.226 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-15T22:37:13.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T22:37:13.299 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:12 smithi082 ceph-mon[37153]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:13.299 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:12 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/4019094434' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:37:13.299 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:12 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/4019094434' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:37:13.530 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi082/config 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.081+0000 7fec46175700 1 -- 172.21.15.82:0/1370934865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 msgr2=0x7fec400fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.081+0000 7fec46175700 1 --2- 172.21.15.82:0/1370934865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec400fb630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec30004940 tx=0x7fec30009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 -- 172.21.15.82:0/1370934865 shutdown_connections 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 --2- 172.21.15.82:0/1370934865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400fe2b0 0x7fec400fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 --2- 172.21.15.82:0/1370934865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec400fb630 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 -- 172.21.15.82:0/1370934865 >> 172.21.15.82:0/1370934865 conn(0x7fec400f6ca0 msgr2=0x7fec400f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 -- 172.21.15.82:0/1370934865 shutdown_connections 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 -- 172.21.15.82:0/1370934865 wait complete. 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 Processor -- start 2024-02-15T22:37:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.082+0000 7fec46175700 1 -- start start 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec46175700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec4010d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec46175700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400fe2b0 0x7fec4010df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec46175700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4010e500 con 0x7fec400fe2b0 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec46175700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4010eda0 con 0x7fec400fb220 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec4010d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec4010d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56178/0 (socket says 172.21.15.82:56178) 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3f7fe700 1 -- 172.21.15.82:0/1810537984 learned_addr learned my addr 172.21.15.82:0/1810537984 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3f7fe700 1 -- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400fe2b0 msgr2=0x7fec4010df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3effd700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400fe2b0 0x7fec4010df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3f7fe700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400fe2b0 0x7fec4010df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3f7fe700 1 -- 172.21.15.82:0/1810537984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30005040 con 0x7fec400fb220 2024-02-15T22:37:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec3f7fe700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec4010d9c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec30000c00 tx=0x7fec30009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec27fff700 1 -- 172.21.15.82:0/1810537984 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec30021070 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4010f020 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec27fff700 1 -- 172.21.15.82:0/1810537984 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec3001c400 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec27fff700 1 -- 172.21.15.82:0/1810537984 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3000e070 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.083+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4010f500 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.084+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4004bed0 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.085+0000 7fec27fff700 1 -- 172.21.15.82:0/1810537984 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fec3001ca50 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.085+0000 7fec27fff700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fec280692a0 0x7fec2806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.085+0000 7fec27fff700 1 -- 172.21.15.82:0/1810537984 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec30088090 con 0x7fec400fb220 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.085+0000 7fec3effd700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fec280692a0 0x7fec2806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.086+0000 7fec3effd700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fec280692a0 0x7fec2806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec34004600 tx=0x7fec3400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:15.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.089+0000 7fec27fff700 1 -- 172.21.15.82:0/1810537984 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fec30058190 con 0x7fec400fb220 2024-02-15T22:37:15.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:14 smithi082 ceph-mon[37153]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:15.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:14 smithi033 ceph-mon[29033]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:15.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.345+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fec40105a60 con 0x7fec400fb220 2024-02-15T22:37:15.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.352+0000 7fec27fff700 1 -- 172.21.15.82:0/1810537984 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fec30057d20 con 0x7fec400fb220 2024-02-15T22:37:15.353 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2024-02-15T22:37:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAbks5lqhuzFBAArjk6QBpFd1jlQA4AUwdxLQ== 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fec280692a0 msgr2=0x7fec2806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fec280692a0 0x7fec2806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec34004600 tx=0x7fec3400b040 comp rx=0 tx=0).stop 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 msgr2=0x7fec4010d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec4010d9c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec30000c00 tx=0x7fec30009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 shutdown_connections 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fec280692a0 0x7fec2806b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec400fb220 0x7fec4010d9c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 --2- 172.21.15.82:0/1810537984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400fe2b0 0x7fec4010df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 >> 172.21.15.82:0/1810537984 conn(0x7fec400f6ca0 msgr2=0x7fec401014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:15.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 shutdown_connections 2024-02-15T22:37:15.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-02-15T22:37:15.354+0000 7fec46175700 1 -- 172.21.15.82:0/1810537984 wait complete. 2024-02-15T22:37:16.021 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:15 smithi082 ceph-mon[37153]: from='client.? 172.21.15.82:0/1810537984' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:37:16.021 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:15 smithi082 ceph-mon[37153]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:37:16.021 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:15 smithi082 ceph-mon[37153]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:37:16.048 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:37:16.048 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-15T22:37:16.048 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-15T22:37:16.133 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-15T22:37:16.133 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-15T22:37:16.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph mgr dump --format=json 2024-02-15T22:37:16.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:15 smithi033 ceph-mon[29033]: from='client.? 172.21.15.82:0/1810537984' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:37:16.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:15 smithi033 ceph-mon[29033]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:37:16.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:15 smithi033 ceph-mon[29033]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:37:16.407 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:17.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:16 smithi033 ceph-mon[29033]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:17.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:16 smithi082 ceph-mon[37153]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.084+0000 7f58f3f41700 1 -- 172.21.15.33:0/1322288859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec0fb570 msgr2=0x7f58ec0fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.084+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1322288859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec0fb570 0x7f58ec0fb9c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f58e8004940 tx=0x7f58e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.084+0000 7f58f3f41700 1 -- 172.21.15.33:0/1322288859 shutdown_connections 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.084+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1322288859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec0fb570 0x7f58ec0fb9c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.084+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1322288859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec103140 0x7f58ec103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.084+0000 7f58f3f41700 1 -- 172.21.15.33:0/1322288859 >> 172.21.15.33:0/1322288859 conn(0x7f58ec071560 msgr2=0x7f58ec071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 -- 172.21.15.33:0/1322288859 shutdown_connections 2024-02-15T22:37:18.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 -- 172.21.15.33:0/1322288859 wait complete. 2024-02-15T22:37:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 Processor -- start 2024-02-15T22:37:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 -- start start 2024-02-15T22:37:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fb570 0x7f58ec113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec103140 0x7f58ec1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec114710 con 0x7f58ec103140 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f3f41700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec10da40 con 0x7f58ec0fb570 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.085+0000 7f58f14dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec103140 0x7f58ec1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f14dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec103140 0x7f58ec1140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50438/0 (socket says 172.21.15.33:50438) 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f14dc700 1 -- 172.21.15.33:0/1591175209 learned_addr learned my addr 172.21.15.33:0/1591175209 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f1cdd700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fb570 0x7f58ec113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f14dc700 1 -- 172.21.15.33:0/1591175209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fb570 msgr2=0x7f58ec113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f14dc700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fb570 0x7f58ec113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f14dc700 1 -- 172.21.15.33:0/1591175209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8005040 con 0x7f58ec103140 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f1cdd700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fb570 0x7f58ec113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f14dc700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec103140 0x7f58ec1140c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b3b0 tx=0x7f58e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58de7fc700 1 -- 172.21.15.33:0/1591175209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e800e040 con 0x7f58ec103140 2024-02-15T22:37:18.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58de7fc700 1 -- 172.21.15.33:0/1591175209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58e800bbf0 con 0x7f58ec103140 2024-02-15T22:37:18.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec10dcc0 con 0x7f58ec103140 2024-02-15T22:37:18.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58de7fc700 1 -- 172.21.15.33:0/1591175209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e801c630 con 0x7f58ec103140 2024-02-15T22:37:18.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.086+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec10e200 con 0x7f58ec103140 2024-02-15T22:37:18.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.087+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec1054d0 con 0x7f58ec103140 2024-02-15T22:37:18.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.088+0000 7f58de7fc700 1 -- 172.21.15.33:0/1591175209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f58e800bd60 con 0x7f58ec103140 2024-02-15T22:37:18.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.088+0000 7f58de7fc700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58d80692a0 0x7f58d806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:18.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.088+0000 7f58de7fc700 1 -- 172.21.15.33:0/1591175209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f58e8088250 con 0x7f58ec103140 2024-02-15T22:37:18.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.088+0000 7f58f1cdd700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58d80692a0 0x7f58d806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:18.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.088+0000 7f58f1cdd700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58d80692a0 0x7f58d806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009fd0 tx=0x7f58e0009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:18.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.093+0000 7f58de7fc700 1 -- 172.21.15.33:0/1591175209 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f58e8058350 con 0x7f58ec103140 2024-02-15T22:37:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.340+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f58ec10f160 con 0x7f58ec103140 2024-02-15T22:37:18.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.343+0000 7f58de7fc700 1 -- 172.21.15.33:0/1591175209 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167171 (secure 0 0 0) 0x7f58e8057ee0 con 0x7f58ec103140 2024-02-15T22:37:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:37:18.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58d80692a0 msgr2=0x7f58d806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:18.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58d80692a0 0x7f58d806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009fd0 tx=0x7f58e0009ee0 comp rx=0 tx=0).stop 2024-02-15T22:37:18.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec103140 msgr2=0x7f58ec1140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:18.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec103140 0x7f58ec1140c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b3b0 tx=0x7f58e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:18.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 shutdown_connections 2024-02-15T22:37:18.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58d80692a0 0x7f58d806b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:18.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fb570 0x7f58ec113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:18.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 --2- 172.21.15.33:0/1591175209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58ec103140 0x7f58ec1140c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:18.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 >> 172.21.15.33:0/1591175209 conn(0x7f58ec071560 msgr2=0x7f58ec0f97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:18.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 shutdown_connections 2024-02-15T22:37:18.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:18.345+0000 7f58f3f41700 1 -- 172.21.15.33:0/1591175209 wait complete. 2024-02-15T22:37:19.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:18 smithi033 ceph-mon[29033]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:19.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:18 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1591175209' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T22:37:19.116 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"active_gid":14214,"active_name":"smithi033.swohxi","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1523928063},{"type":"v1","addr":"172.21.15.33:6801","nonce":1523928063}]},"active_addr":"172.21.15.33:6801/1523928063","active_change":"2024-02-15T22:33:31.850932+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14236,"name":"smithi082.mjhlse","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.33:8443/","prometheus":"http://172.21.15.33:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3612339404}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3237183308}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3396978947}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":4132586080}]}]} 2024-02-15T22:37:19.121 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-15T22:37:19.121 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-15T22:37:19.121 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T22:37:19.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:18 smithi082 ceph-mon[37153]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:19.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:18 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1591175209' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T22:37:19.384 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:21.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 -- 172.21.15.33:0/1111355908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 msgr2=0x7f68d4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:21.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 --2- 172.21.15.33:0/1111355908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4102210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009ce0 tx=0x7f68cc004d10 comp rx=0 tx=0).stop 2024-02-15T22:37:21.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 -- 172.21.15.33:0/1111355908 shutdown_connections 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 --2- 172.21.15.33:0/1111355908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d41027e0 0x7f68d40fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 --2- 172.21.15.33:0/1111355908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4102210 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 -- 172.21.15.33:0/1111355908 >> 172.21.15.33:0/1111355908 conn(0x7f68d4071d90 msgr2=0x7f68d4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 -- 172.21.15.33:0/1111355908 shutdown_connections 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 -- 172.21.15.33:0/1111355908 wait complete. 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.182+0000 7f68db005700 1 Processor -- start 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68db005700 1 -- start start 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68db005700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68db005700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d41027e0 0x7f68d4114100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68db005700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4114750 con 0x7f68d4101e40 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68db005700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d410da80 con 0x7f68d41027e0 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d8da1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d8da1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50456/0 (socket says 172.21.15.33:50456) 2024-02-15T22:37:21.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d8da1700 1 -- 172.21.15.33:0/3443734574 learned_addr learned my addr 172.21.15.33:0/3443734574 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d3fff700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d41027e0 0x7f68d4114100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d8da1700 1 -- 172.21.15.33:0/3443734574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d41027e0 msgr2=0x7f68d4114100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d8da1700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d41027e0 0x7f68d4114100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d8da1700 1 -- 172.21.15.33:0/3443734574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc009940 con 0x7f68d4101e40 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.183+0000 7f68d8da1700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4113bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00be90 tx=0x7f68cc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.184+0000 7f68d17fa700 1 -- 172.21.15.33:0/3443734574 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68cc00e040 con 0x7f68d4101e40 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.184+0000 7f68d17fa700 1 -- 172.21.15.33:0/3443734574 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68cc008e20 con 0x7f68d4101e40 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.184+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d410dd00 con 0x7f68d4101e40 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.184+0000 7f68d17fa700 1 -- 172.21.15.33:0/3443734574 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68cc01c620 con 0x7f68d4101e40 2024-02-15T22:37:21.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.184+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d410e240 con 0x7f68d4101e40 2024-02-15T22:37:21.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.185+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d40738b0 con 0x7f68d4101e40 2024-02-15T22:37:21.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.185+0000 7f68d17fa700 1 -- 172.21.15.33:0/3443734574 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f68cc012a70 con 0x7f68d4101e40 2024-02-15T22:37:21.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.185+0000 7f68d17fa700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f68c00692a0 0x7f68c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:21.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.186+0000 7f68d17fa700 1 -- 172.21.15.33:0/3443734574 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f68cc088960 con 0x7f68d4101e40 2024-02-15T22:37:21.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.186+0000 7f68d3fff700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f68c00692a0 0x7f68c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:21.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.186+0000 7f68d3fff700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f68c00692a0 0x7f68c006b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68d410f3f0 tx=0x7f68c400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:21.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.190+0000 7f68d17fa700 1 -- 172.21.15.33:0/3443734574 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f68cc0589e0 con 0x7f68d4101e40 2024-02-15T22:37:21.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:20 smithi033 ceph-mon[29033]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:21.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:20 smithi082 ceph-mon[37153]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:21.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.384+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68d410f1a0 con 0x7f68d4101e40 2024-02-15T22:37:21.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.385+0000 7f68d17fa700 1 -- 172.21.15.33:0/3443734574 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+10984 (secure 0 0 0) 0x7f68cc004e10 con 0x7f68d4101e40 2024-02-15T22:37:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:37:21.387 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","created":"2024-02-15T22:31:07.591719+0000","modified":"2024-02-15T22:37:04.227236+0000","last_up_change":"2024-02-15T22:37:03.221336+0000","last_in_change":"2024-02-15T22:36:43.765254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:35:50.180713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"630ee5c8-c8e3-4190-878c-82aa86eb7366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6803","nonce":308155144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6805","nonce":308155144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6809","nonce":308155144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6807","nonce":308155144}]},"public_addr":"172.21.15.33:6803/308155144","cluster_addr":"172.21.15.33:6805/308155144","heartbeat_back_addr":"172.21.15.33:6809/308155144","heartbeat_front_addr":"172.21.15.33:6807/308155144","state":["exists","up"]},{"osd":1,"uuid":"9edc1e24-0b17-4e9a-ac42-18decf1d9c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6811","nonce":283250145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6813","nonce":283250145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6817","nonce":283250145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6815","nonce":283250145}]},"public_addr":"172.21.15.33:6811/283250145","cluster_addr":"172.21.15.33:6813/283250145","heartbeat_back_addr":"172.21.15.33:6817/283250145","heartbeat_front_addr":"172.21.15.33:6815/283250145","state":["exists","up"]},{"osd":2,"uuid":"eaa0a666-819e-4268-a788-e2ab2b12dd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6819","nonce":936985146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6821","nonce":936985146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6825","nonce":936985146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6823","nonce":936985146}]},"public_addr":"172.21.15.33:6819/936985146","cluster_addr":"172.21.15.33:6821/936985146","heartbeat_back_addr":"172.21.15.33:6825/936985146","heartbeat_front_addr":"172.21.15.33:6823/936985146","state":["exists","up"]},{"osd":3,"uuid":"111d4225-5978-43c6-8276-87091559a25b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6801","nonce":234002786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6803","nonce":234002786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6807","nonce":234002786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6805","nonce":234002786}]},"public_addr":"172.21.15.82:6801/234002786","cluster_addr":"172.21.15.82:6803/234002786","heartbeat_back_addr":"172.21.15.82:6807/234002786","heartbeat_front_addr":"172.21.15.82:6805/234002786","state":["exists","up"]},{"osd":4,"uuid":"6625f0e7-013e-4fab-897d-06ed130d9878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6809","nonce":462085336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6811","nonce":462085336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6815","nonce":462085336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6813","nonce":462085336}]},"public_addr":"172.21.15.82:6809/462085336","cluster_addr":"172.21.15.82:6811/462085336","heartbeat_back_addr":"172.21.15.82:6815/462085336","heartbeat_front_addr":"172.21.15.82:6813/462085336","state":["exists","up"]},{"osd":5,"uuid":"6b74c887-f24b-4da2-85fd-5d351fe44045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6817","nonce":483187029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6819","nonce":483187029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6823","nonce":483187029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6821","nonce":483187029}]},"public_addr":"172.21.15.82:6817/483187029","cluster_addr":"172.21.15.82:6819/483187029","heartbeat_back_addr":"172.21.15.82:6823/483187029","heartbeat_front_addr":"172.21.15.82:6821/483187029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:34:48.066478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:16.174578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:46.001693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:09.278760+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:34.947739+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:37:01.519872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/771735499":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/4080754497":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/1038575526":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6801/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6801/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/2241336882":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6800/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/547235877":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/245484360":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6801/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/275440289":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/3583368704":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/735416243":"2024-02-16T22:31:43.072803+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f68c00692a0 msgr2=0x7f68c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f68c00692a0 0x7f68c006b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68d410f3f0 tx=0x7f68c400b040 comp rx=0 tx=0).stop 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 msgr2=0x7f68d4113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4113bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00be90 tx=0x7f68cc004d10 comp rx=0 tx=0).stop 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 shutdown_connections 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f68c00692a0 0x7f68c006b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d4101e40 0x7f68d4113bc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:21.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 --2- 172.21.15.33:0/3443734574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d41027e0 0x7f68d4114100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:21.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 >> 172.21.15.33:0/3443734574 conn(0x7f68d4071d90 msgr2=0x7f68d4065700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:21.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 shutdown_connections 2024-02-15T22:37:21.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:21.387+0000 7f68db005700 1 -- 172.21.15.33:0/3443734574 wait complete. 2024-02-15T22:37:22.120 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:21 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3443734574' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:37:22.148 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-15T22:37:22.151 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T22:37:22.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:21 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3443734574' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:37:22.414 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:23.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:22 smithi033 ceph-mon[29033]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:23.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:22 smithi082 ceph-mon[37153]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.154+0000 7f076466a700 1 -- 172.21.15.33:0/2272345738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 msgr2=0x7f075c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.154+0000 7f076466a700 1 --2- 172.21.15.33:0/2272345738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c0fcf60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f074c004940 tx=0x7f074c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 -- 172.21.15.33:0/2272345738 shutdown_connections 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 --2- 172.21.15.33:0/2272345738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c0fcf60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 --2- 172.21.15.33:0/2272345738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c102f50 0x7f075c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 -- 172.21.15.33:0/2272345738 >> 172.21.15.33:0/2272345738 conn(0x7f075c0f8ae0 msgr2=0x7f075c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 -- 172.21.15.33:0/2272345738 shutdown_connections 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 -- 172.21.15.33:0/2272345738 wait complete. 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 Processor -- start 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 -- start start 2024-02-15T22:37:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c102f50 0x7f075c113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c114590 con 0x7f075c1038f0 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.155+0000 7f076466a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c10d8c0 con 0x7f075c102f50 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0761c05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0761c05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50486/0 (socket says 172.21.15.33:50486) 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0761c05700 1 -- 172.21.15.33:0/452610749 learned_addr learned my addr 172.21.15.33:0/452610749 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0762406700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c102f50 0x7f075c113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0761c05700 1 -- 172.21.15.33:0/452610749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c102f50 msgr2=0x7f075c113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0761c05700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c102f50 0x7f075c113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0761c05700 1 -- 172.21.15.33:0/452610749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c005040 con 0x7f075c1038f0 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0762406700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c102f50 0x7f075c113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0761c05700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c113f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f074c0090d0 tx=0x7f074c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0752ffd700 1 -- 172.21.15.33:0/452610749 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c00e040 con 0x7f075c1038f0 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c10db40 con 0x7f075c1038f0 2024-02-15T22:37:24.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0752ffd700 1 -- 172.21.15.33:0/452610749 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f074c00bbf0 con 0x7f075c1038f0 2024-02-15T22:37:24.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c10e080 con 0x7f075c1038f0 2024-02-15T22:37:24.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.156+0000 7f0752ffd700 1 -- 172.21.15.33:0/452610749 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c01c630 con 0x7f075c1038f0 2024-02-15T22:37:24.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.157+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c105420 con 0x7f075c1038f0 2024-02-15T22:37:24.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.158+0000 7f0752ffd700 1 -- 172.21.15.33:0/452610749 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f074c00bd60 con 0x7f075c1038f0 2024-02-15T22:37:24.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.158+0000 7f0752ffd700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f07480692a0 0x7f074806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:24.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.158+0000 7f0752ffd700 1 -- 172.21.15.33:0/452610749 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f074c0881b0 con 0x7f075c1038f0 2024-02-15T22:37:24.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.158+0000 7f0762406700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f07480692a0 0x7f074806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:24.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.159+0000 7f0762406700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f07480692a0 0x7f074806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0758009490 tx=0x7f0758009ed0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.163+0000 7f0752ffd700 1 -- 172.21.15.33:0/452610749 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f074c0582b0 con 0x7f075c1038f0 2024-02-15T22:37:24.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.354+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f075c10a030 con 0x7f075c1038f0 2024-02-15T22:37:24.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.354+0000 7f0752ffd700 1 -- 172.21.15.33:0/452610749 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+10984 (secure 0 0 0) 0x7f074c013e60 con 0x7f075c1038f0 2024-02-15T22:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","created":"2024-02-15T22:31:07.591719+0000","modified":"2024-02-15T22:37:04.227236+0000","last_up_change":"2024-02-15T22:37:03.221336+0000","last_in_change":"2024-02-15T22:36:43.765254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:35:50.180713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"630ee5c8-c8e3-4190-878c-82aa86eb7366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6803","nonce":308155144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6805","nonce":308155144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6809","nonce":308155144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6807","nonce":308155144}]},"public_addr":"172.21.15.33:6803/308155144","cluster_addr":"172.21.15.33:6805/308155144","heartbeat_back_addr":"172.21.15.33:6809/308155144","heartbeat_front_addr":"172.21.15.33:6807/308155144","state":["exists","up"]},{"osd":1,"uuid":"9edc1e24-0b17-4e9a-ac42-18decf1d9c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6811","nonce":283250145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6813","nonce":283250145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6817","nonce":283250145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6815","nonce":283250145}]},"public_addr":"172.21.15.33:6811/283250145","cluster_addr":"172.21.15.33:6813/283250145","heartbeat_back_addr":"172.21.15.33:6817/283250145","heartbeat_front_addr":"172.21.15.33:6815/283250145","state":["exists","up"]},{"osd":2,"uuid":"eaa0a666-819e-4268-a788-e2ab2b12dd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6819","nonce":936985146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6821","nonce":936985146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6825","nonce":936985146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6823","nonce":936985146}]},"public_addr":"172.21.15.33:6819/936985146","cluster_addr":"172.21.15.33:6821/936985146","heartbeat_back_addr":"172.21.15.33:6825/936985146","heartbeat_front_addr":"172.21.15.33:6823/936985146","state":["exists","up"]},{"osd":3,"uuid":"111d4225-5978-43c6-8276-87091559a25b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6801","nonce":234002786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6803","nonce":234002786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6807","nonce":234002786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6805","nonce":234002786}]},"public_addr":"172.21.15.82:6801/234002786","cluster_addr":"172.21.15.82:6803/234002786","heartbeat_back_addr":"172.21.15.82:6807/234002786","heartbeat_front_addr":"172.21.15.82:6805/234002786","state":["exists","up"]},{"osd":4,"uuid":"6625f0e7-013e-4fab-897d-06ed130d9878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6809","nonce":462085336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6811","nonce":462085336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6815","nonce":462085336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6813","nonce":462085336}]},"public_addr":"172.21.15.82:6809/462085336","cluster_addr":"172.21.15.82:6811/462085336","heartbeat_back_addr":"172.21.15.82:6815/462085336","heartbeat_front_addr":"172.21.15.82:6813/462085336","state":["exists","up"]},{"osd":5,"uuid":"6b74c887-f24b-4da2-85fd-5d351fe44045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6817","nonce":483187029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6819","nonce":483187029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6823","nonce":483187029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6821","nonce":483187029}]},"public_addr":"172.21.15.82:6817/483187029","cluster_addr":"172.21.15.82:6819/483187029","heartbeat_back_addr":"172.21.15.82:6823/483187029","heartbeat_front_addr":"172.21.15.82:6821/483187029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:34:48.066478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:16.174578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:46.001693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:09.278760+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:34.947739+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:37:01.519872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/771735499":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/4080754497":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/1038575526":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6801/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6801/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/2241336882":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6800/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/547235877":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/245484360":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6801/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/275440289":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/3583368704":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/735416243":"2024-02-16T22:31:43.072803+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f07480692a0 msgr2=0x7f074806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f07480692a0 0x7f074806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0758009490 tx=0x7f0758009ed0 comp rx=0 tx=0).stop 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 msgr2=0x7f075c113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c113f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f074c0090d0 tx=0x7f074c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 shutdown_connections 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f07480692a0 0x7f074806b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c102f50 0x7f075c113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 --2- 172.21.15.33:0/452610749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075c1038f0 0x7f075c113f40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 >> 172.21.15.33:0/452610749 conn(0x7f075c0f8ae0 msgr2=0x7f075c0fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:24.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.356+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 shutdown_connections 2024-02-15T22:37:24.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:24.357+0000 7f076466a700 1 -- 172.21.15.33:0/452610749 wait complete. 2024-02-15T22:37:25.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-15T22:37:25.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-15T22:37:25.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-15T22:37:25.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-15T22:37:25.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-15T22:37:25.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-15T22:37:25.147 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:24 smithi082 ceph-mon[37153]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:25.147 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:24 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/452610749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:37:25.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:24 smithi033 ceph-mon[29033]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:25.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:24 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/452610749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:37:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:25.480 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:26.409 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:26.857 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:27.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:26 smithi033 ceph-mon[29033]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:27.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:26 smithi082 ceph-mon[37153]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:29.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:28 smithi033 ceph-mon[29033]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:28 smithi082 ceph-mon[37153]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:29.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 -- 172.21.15.33:0/3946590726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338102800 msgr2=0x7fd3380fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:29.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 --2- 172.21.15.33:0/3946590726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338102800 0x7fd3380fbe70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd324004940 tx=0x7fd324009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:29.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 -- 172.21.15.33:0/3946590726 shutdown_connections 2024-02-15T22:37:29.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 --2- 172.21.15.33:0/3946590726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338102800 0x7fd3380fbe70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 --2- 172.21.15.33:0/3946590726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd338101e60 0x7fd338102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 -- 172.21.15.33:0/3946590726 >> 172.21.15.33:0/3946590726 conn(0x7fd3380f7a10 msgr2=0x7fd3380f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 -- 172.21.15.33:0/3946590726 shutdown_connections 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.791+0000 7fd33edf0700 1 -- 172.21.15.33:0/3946590726 wait complete. 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33edf0700 1 Processor -- start 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33edf0700 1 -- start start 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33edf0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338101e60 0x7fd33810eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33edf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd338102800 0x7fd33810f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33edf0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33810f610 con 0x7fd338101e60 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33edf0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33810f780 con 0x7fd338102800 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33cb8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338101e60 0x7fd33810eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33cb8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338101e60 0x7fd33810eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42254/0 (socket says 172.21.15.33:42254) 2024-02-15T22:37:29.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33cb8c700 1 -- 172.21.15.33:0/1673966854 learned_addr learned my addr 172.21.15.33:0/1673966854 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd337fff700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd338102800 0x7fd33810f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33cb8c700 1 -- 172.21.15.33:0/1673966854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd338102800 msgr2=0x7fd33810f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33cb8c700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd338102800 0x7fd33810f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.792+0000 7fd33cb8c700 1 -- 172.21.15.33:0/1673966854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324005040 con 0x7fd338101e60 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.793+0000 7fd33cb8c700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338101e60 0x7fd33810eb40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd32c002a50 tx=0x7fd32c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.793+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32c007cc0 con 0x7fd338101e60 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.793+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd32c00f040 con 0x7fd338101e60 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.793+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd338117b10 con 0x7fd338101e60 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.793+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32c00da30 con 0x7fd338101e60 2024-02-15T22:37:29.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.793+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd338117fd0 con 0x7fd338101e60 2024-02-15T22:37:29.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.794+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd33805e690 con 0x7fd338101e60 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.794+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd32c00db90 con 0x7fd338101e60 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd3357fa700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3280692a0 0x7fd32806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd32c086bd0 con 0x7fd338101e60 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd337fff700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3280692a0 0x7fd32806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd3357fa700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] conn(0x7fd32806ef70 0x7fd328071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 --> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd328071a30 con 0x7fd32806ef70 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd32c08b220 con 0x7fd338101e60 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd33d38d700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] conn(0x7fd32806ef70 0x7fd328071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd337fff700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3280692a0 0x7fd32806b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd324004890 tx=0x7fd324009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.795+0000 7fd33d38d700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] conn(0x7fd32806ef70 0x7fd328071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:29.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.796+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== osd.1 v2:172.21.15.33:6810/283250145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd328071a30 con 0x7fd32806ef70 2024-02-15T22:37:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.811+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 --> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd33805eaf0 con 0x7fd32806ef70 2024-02-15T22:37:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd3357fa700 1 -- 172.21.15.33:0/1673966854 <== osd.1 v2:172.21.15.33:6810/283250145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd33805eaf0 con 0x7fd32806ef70 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] conn(0x7fd32806ef70 msgr2=0x7fd328071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] conn(0x7fd32806ef70 0x7fd328071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3280692a0 msgr2=0x7fd32806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3280692a0 0x7fd32806b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd324004890 tx=0x7fd324009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338101e60 msgr2=0x7fd33810eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338101e60 0x7fd33810eb40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd32c002a50 tx=0x7fd32c0046b0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 shutdown_connections 2024-02-15T22:37:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3280692a0 0x7fd32806b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:6810/283250145,v1:172.21.15.33:6811/283250145] conn(0x7fd32806ef70 0x7fd328071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd338101e60 0x7fd33810eb40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 --2- 172.21.15.33:0/1673966854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd338102800 0x7fd33810f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 >> 172.21.15.33:0/1673966854 conn(0x7fd3380f7a10 msgr2=0x7fd3380f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.812+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 shutdown_connections 2024-02-15T22:37:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:29.813+0000 7fd33edf0700 1 -- 172.21.15.33:0/1673966854 wait complete. 2024-02-15T22:37:30.965 INFO:teuthology.orchestra.run.smithi033.stdout:60129542174 2024-02-15T22:37:30.965 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-15T22:37:31.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:30 smithi033 ceph-mon[29033]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:30 smithi082 ceph-mon[37153]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:32.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/1430721304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 msgr2=0x7f7e48109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:32.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/1430721304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48109260 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c004970 tx=0x7f7e3c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:32.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/1430721304 shutdown_connections 2024-02-15T22:37:32.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/1430721304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48109260 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/1430721304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e48070330 0x7f7e48070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/1430721304 >> 172.21.15.33:0/1430721304 conn(0x7f7e480f8ae0 msgr2=0x7f7e480faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:32.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/1430721304 shutdown_connections 2024-02-15T22:37:32.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/1430721304 wait complete. 2024-02-15T22:37:32.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.028+0000 7f7e4cc6a700 1 Processor -- start 2024-02-15T22:37:32.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e4cc6a700 1 -- start start 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e4cc6a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e48070330 0x7f7e48115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e4cc6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e4cc6a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48116790 con 0x7f7e48070c40 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e4cc6a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4810fae0 con 0x7f7e48070330 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e45d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e45d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48116140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42274/0 (socket says 172.21.15.33:42274) 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e45d9b700 1 -- 172.21.15.33:0/4241237570 learned_addr learned my addr 172.21.15.33:0/4241237570 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e4659c700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e48070330 0x7f7e48115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e45d9b700 1 -- 172.21.15.33:0/4241237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e48070330 msgr2=0x7f7e48115c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e45d9b700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e48070330 0x7f7e48115c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e45d9b700 1 -- 172.21.15.33:0/4241237570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c005040 con 0x7f7e48070c40 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e45d9b700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48116140 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c005010 tx=0x7f7e3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e3c00e040 con 0x7f7e48070c40 2024-02-15T22:37:32.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e3c013420 con 0x7f7e48070c40 2024-02-15T22:37:32.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.029+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4810fd60 con 0x7f7e48070c40 2024-02-15T22:37:32.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.030+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e3c01c610 con 0x7f7e48070c40 2024-02-15T22:37:32.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.030+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e481102a0 con 0x7f7e48070c40 2024-02-15T22:37:32.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.030+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e48110800 con 0x7f7e48070c40 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.031+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f7e3c013590 con 0x7f7e48070c40 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.031+0000 7f7e36ffd700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f7e300692a0 0x7f7e3006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.031+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7e3c088090 con 0x7f7e48070c40 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.031+0000 7f7e4659c700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f7e300692a0 0x7f7e3006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.032+0000 7f7e36ffd700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] conn(0x7f7e3006ef70 0x7f7e30071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.032+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 --> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e30071a30 con 0x7f7e3006ef70 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.032+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e3c08a680 con 0x7f7e48070c40 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.032+0000 7f7e46d9d700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] conn(0x7f7e3006ef70 0x7f7e30071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.032+0000 7f7e4659c700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f7e300692a0 0x7f7e3006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009b80 tx=0x7f7e3800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.032+0000 7f7e46d9d700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] conn(0x7f7e3006ef70 0x7f7e30071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.033+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== osd.0 v2:172.21.15.33:6802/308155144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7e30071a30 con 0x7f7e3006ef70 2024-02-15T22:37:32.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.049+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 --> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e4805e690 con 0x7f7e3006ef70 2024-02-15T22:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.049+0000 7f7e36ffd700 1 -- 172.21.15.33:0/4241237570 <== osd.0 v2:172.21.15.33:6802/308155144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e4805e690 con 0x7f7e3006ef70 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] conn(0x7f7e3006ef70 msgr2=0x7f7e30071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] conn(0x7f7e3006ef70 0x7f7e30071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f7e300692a0 msgr2=0x7f7e3006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f7e300692a0 0x7f7e3006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009b80 tx=0x7f7e3800b040 comp rx=0 tx=0).stop 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 msgr2=0x7f7e48116140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48116140 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c005010 tx=0x7f7e3c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 shutdown_connections 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6802/308155144,v1:172.21.15.33:6803/308155144] conn(0x7f7e3006ef70 0x7f7e30071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f7e300692a0 0x7f7e3006b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e48070330 0x7f7e48115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 --2- 172.21.15.33:0/4241237570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e48070c40 0x7f7e48116140 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 >> 172.21.15.33:0/4241237570 conn(0x7f7e480f8ae0 msgr2=0x7f7e48103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 shutdown_connections 2024-02-15T22:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:32.050+0000 7f7e4cc6a700 1 -- 172.21.15.33:0/4241237570 wait complete. 2024-02-15T22:37:32.228 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:32.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:31 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:33.191 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:32 smithi033 ceph-mon[29033]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:33.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:32 smithi082 ceph-mon[37153]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:34.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 -- 172.21.15.33:0/1776051140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 msgr2=0x7fcd1c0fcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:34.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1776051140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c0fcf00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd08004940 tx=0x7fcd08009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:34.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 -- 172.21.15.33:0/1776051140 shutdown_connections 2024-02-15T22:37:34.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1776051140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c0fcf00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1776051140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c102ef0 0x7fcd1c1032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 -- 172.21.15.33:0/1776051140 >> 172.21.15.33:0/1776051140 conn(0x7fcd1c0f8a80 msgr2=0x7fcd1c0fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 -- 172.21.15.33:0/1776051140 shutdown_connections 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 -- 172.21.15.33:0/1776051140 wait complete. 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 Processor -- start 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.249+0000 7fcd2305f700 1 -- start start 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd2305f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c102ef0 0x7fcd1c1139e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd2305f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd2305f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c114600 con 0x7fcd1c103890 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd2305f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c10d8a0 con 0x7fcd1c102ef0 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd1bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd1bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42296/0 (socket says 172.21.15.33:42296) 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd1bfff700 1 -- 172.21.15.33:0/1305111931 learned_addr learned my addr 172.21.15.33:0/1305111931 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:34.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd20dfb700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c102ef0 0x7fcd1c1139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd1bfff700 1 -- 172.21.15.33:0/1305111931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c102ef0 msgr2=0x7fcd1c1139e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd1bfff700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c102ef0 0x7fcd1c1139e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd1bfff700 1 -- 172.21.15.33:0/1305111931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08005040 con 0x7fcd1c103890 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd1bfff700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c113f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009150 tx=0x7fcd08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd0800e040 con 0x7fcd1c103890 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd0800bbf0 con 0x7fcd1c103890 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c10db20 con 0x7fcd1c103890 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd0801c3f0 con 0x7fcd1c103890 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.250+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c10e0e0 con 0x7fcd1c103890 2024-02-15T22:37:34.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.251+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd1c10e600 con 0x7fcd1c103890 2024-02-15T22:37:34.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fcd0800bd60 con 0x7fcd1c103890 2024-02-15T22:37:34.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd197fa700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcd0c0692a0 0x7fcd0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:34.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcd080881e0 con 0x7fcd1c103890 2024-02-15T22:37:34.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd20dfb700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcd0c0692a0 0x7fcd0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd197fa700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] conn(0x7fcd0c06ef70 0x7fcd0c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 --> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd0c071a30 con 0x7fcd0c06ef70 2024-02-15T22:37:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd0808a7d0 con 0x7fcd1c103890 2024-02-15T22:37:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.252+0000 7fcd215fc700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] conn(0x7fcd0c06ef70 0x7fcd0c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.253+0000 7fcd20dfb700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcd0c0692a0 0x7fcd0c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009bf0 tx=0x7fcd100091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.253+0000 7fcd215fc700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] conn(0x7fcd0c06ef70 0x7fcd0c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.253+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== osd.2 v2:172.21.15.33:6818/936985146 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcd0c071a30 con 0x7fcd0c06ef70 2024-02-15T22:37:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.268+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 --> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd1c0fac60 con 0x7fcd0c06ef70 2024-02-15T22:37:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.268+0000 7fcd197fa700 1 -- 172.21.15.33:0/1305111931 <== osd.2 v2:172.21.15.33:6818/936985146 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd1c0fac60 con 0x7fcd0c06ef70 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] conn(0x7fcd0c06ef70 msgr2=0x7fcd0c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] conn(0x7fcd0c06ef70 0x7fcd0c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcd0c0692a0 msgr2=0x7fcd0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcd0c0692a0 0x7fcd0c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009bf0 tx=0x7fcd100091a0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 msgr2=0x7fcd1c113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c113f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009150 tx=0x7fcd08009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 shutdown_connections 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6818/936985146,v1:172.21.15.33:6819/936985146] conn(0x7fcd0c06ef70 0x7fcd0c071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcd0c0692a0 0x7fcd0c06b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c102ef0 0x7fcd1c1139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 --2- 172.21.15.33:0/1305111931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1c103890 0x7fcd1c113f20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 >> 172.21.15.33:0/1305111931 conn(0x7fcd1c0f8a80 msgr2=0x7fcd1c0fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:34.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 shutdown_connections 2024-02-15T22:37:34.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:34.269+0000 7fcd2305f700 1 -- 172.21.15.33:0/1305111931 wait complete. 2024-02-15T22:37:34.710 INFO:teuthology.orchestra.run.smithi033.stdout:38654705700 2024-02-15T22:37:34.710 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-15T22:37:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 -- 172.21.15.33:0/1862942192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fe8f0 msgr2=0x7fdaac107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1862942192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fe8f0 0x7fdaac107050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00048b0 tx=0x7fdaa0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 -- 172.21.15.33:0/1862942192 shutdown_connections 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1862942192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fe8f0 0x7fdaac107050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1862942192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac0fdfe0 0x7fdaac0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 -- 172.21.15.33:0/1862942192 >> 172.21.15.33:0/1862942192 conn(0x7fdaac071d90 msgr2=0x7fdaac072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 -- 172.21.15.33:0/1862942192 shutdown_connections 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.087+0000 7fdab1b30700 1 -- 172.21.15.33:0/1862942192 wait complete. 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdab1b30700 1 Processor -- start 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdab1b30700 1 -- start start 2024-02-15T22:37:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdab1b30700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fdfe0 0x7fdaac1139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdab1b30700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac0fe8f0 0x7fdaac113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdab1b30700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac114580 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdab1b30700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac10d8b0 con 0x7fdaac0fe8f0 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdaab7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fdfe0 0x7fdaac1139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdaab7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fdfe0 0x7fdaac1139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42316/0 (socket says 172.21.15.33:42316) 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.088+0000 7fdaab7fe700 1 -- 172.21.15.33:0/1515416533 learned_addr learned my addr 172.21.15.33:0/1515416533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fdaaaffd700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac0fe8f0 0x7fdaac113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fdaab7fe700 1 -- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac0fe8f0 msgr2=0x7fdaac113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fdaab7fe700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac0fe8f0 0x7fdaac113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fdaab7fe700 1 -- 172.21.15.33:0/1515416533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c005040 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fdaab7fe700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fdfe0 0x7fdaac1139f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0096b0 tx=0x7fda9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:35.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9c017070 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda9c00f040 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0005040 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac10dee0 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.089+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9c013c20 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.090+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdaac10e3d0 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fda9c00e840 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fda93fff700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fda940692b0 0x7fda9406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fda9c086ca0 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fdaaaffd700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fda940692b0 0x7fda9406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fda93fff700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] conn(0x7fda9406ef80 0x7fda94071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 --> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda94071a40 con 0x7fda9406ef80 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda9c08c300 con 0x7fdaac0fdfe0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.091+0000 7fdaaaffd700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fda940692b0 0x7fda9406b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdaac10f220 tx=0x7fdaa0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.092+0000 7fdaabfff700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] conn(0x7fda9406ef80 0x7fda94071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.092+0000 7fdaabfff700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] conn(0x7fda9406ef80 0x7fda94071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:35.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.093+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== osd.3 v2:172.21.15.82:6800/234002786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fda94071a40 con 0x7fda9406ef80 2024-02-15T22:37:35.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.111+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 --> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdaac0738b0 con 0x7fda9406ef80 2024-02-15T22:37:35.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fda93fff700 1 -- 172.21.15.33:0/1515416533 <== osd.3 v2:172.21.15.82:6800/234002786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fdaac0738b0 con 0x7fda9406ef80 2024-02-15T22:37:35.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] conn(0x7fda9406ef80 msgr2=0x7fda94071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:35.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] conn(0x7fda9406ef80 0x7fda94071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fda940692b0 msgr2=0x7fda9406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fda940692b0 0x7fda9406b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdaac10f220 tx=0x7fdaa0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fdfe0 msgr2=0x7fdaac1139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fdfe0 0x7fdaac1139f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0096b0 tx=0x7fda9c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 shutdown_connections 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fda940692b0 0x7fda9406b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:6800/234002786,v1:172.21.15.82:6801/234002786] conn(0x7fda9406ef80 0x7fda94071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaac0fdfe0 0x7fdaac1139f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.112+0000 7fdab1b30700 1 --2- 172.21.15.33:0/1515416533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac0fe8f0 0x7fdaac113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.113+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 >> 172.21.15.33:0/1515416533 conn(0x7fdaac071d90 msgr2=0x7fdaac101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:35.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.113+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 shutdown_connections 2024-02-15T22:37:35.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:35.113+0000 7fdab1b30700 1 -- 172.21.15.33:0/1515416533 wait complete. 2024-02-15T22:37:35.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:34 smithi033 ceph-mon[29033]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:35.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:34 smithi082 ceph-mon[37153]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:36.168 INFO:teuthology.orchestra.run.smithi033.stdout:81604378649 2024-02-15T22:37:36.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-15T22:37:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 -- 172.21.15.33:0/2397298627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 msgr2=0x7fe8d8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2397298627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d8102210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004880 tx=0x7fe8d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 -- 172.21.15.33:0/2397298627 shutdown_connections 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2397298627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d81027e0 0x7fe8d80fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2397298627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d8102210 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 -- 172.21.15.33:0/2397298627 >> 172.21.15.33:0/2397298627 conn(0x7fe8d8071d90 msgr2=0x7fe8d8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 -- 172.21.15.33:0/2397298627 shutdown_connections 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 -- 172.21.15.33:0/2397298627 wait complete. 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.807+0000 7fe8dd468700 1 Processor -- start 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8dd468700 1 -- start start 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8dd468700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d810eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8dd468700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d81027e0 0x7fe8d810f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8dd468700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d810f590 con 0x7fe8d8101e40 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8dd468700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d810f700 con 0x7fe8d81027e0 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d810eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d810eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32812/0 (socket says 172.21.15.33:32812) 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d6ffd700 1 -- 172.21.15.33:0/2400813600 learned_addr learned my addr 172.21.15.33:0/2400813600 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d67fc700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d81027e0 0x7fe8d810f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d6ffd700 1 -- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d81027e0 msgr2=0x7fe8d810f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d6ffd700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d81027e0 0x7fe8d810f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d6ffd700 1 -- 172.21.15.33:0/2400813600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0005040 con 0x7fe8d8101e40 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d67fc700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d81027e0 0x7fe8d810f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.808+0000 7fe8d6ffd700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d810eac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00134d0 tx=0x7fe8d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.809+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d000e030 con 0x7fe8d8101e40 2024-02-15T22:37:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.809+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8d0013e60 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.809+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d8117a30 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.809+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d001ce90 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.809+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d8117ef0 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.809+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8d805e690 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.810+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe8d001c400 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.810+0000 7fe8cf7fe700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe8c4069230 0x7fe8c406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.810+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe8d0088890 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.810+0000 7fe8d67fc700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe8c4069230 0x7fe8c406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.810+0000 7fe8cf7fe700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] conn(0x7fe8c406ed90 0x7fe8c40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.810+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 --> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8c4071850 con 0x7fe8c406ed90 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.810+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d008d220 con 0x7fe8d8101e40 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.811+0000 7fe8d67fc700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe8c4069230 0x7fe8c406b6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00046c0 tx=0x7fe8c000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.811+0000 7fe8d77fe700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] conn(0x7fe8c406ed90 0x7fe8c40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.811+0000 7fe8d77fe700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] conn(0x7fe8c406ed90 0x7fe8c40711a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.812+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== osd.5 v2:172.21.15.82:6816/483187029 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe8c4071850 con 0x7fe8c406ed90 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.827+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 --> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8d805eb40 con 0x7fe8c406ed90 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8cf7fe700 1 -- 172.21.15.33:0/2400813600 <== osd.5 v2:172.21.15.82:6816/483187029 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe8d805eb40 con 0x7fe8c406ed90 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] conn(0x7fe8c406ed90 msgr2=0x7fe8c40711a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] conn(0x7fe8c406ed90 0x7fe8c40711a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe8c4069230 msgr2=0x7fe8c406b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe8c4069230 0x7fe8c406b6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00046c0 tx=0x7fe8c000b040 comp rx=0 tx=0).stop 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 msgr2=0x7fe8d810eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d810eac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00134d0 tx=0x7fe8d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 shutdown_connections 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:6816/483187029,v1:172.21.15.82:6817/483187029] conn(0x7fe8c406ed90 0x7fe8c40711a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe8c4069230 0x7fe8c406b6e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8d8101e40 0x7fe8d810eac0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 --2- 172.21.15.33:0/2400813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d81027e0 0x7fe8d810f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 >> 172.21.15.33:0/2400813600 conn(0x7fe8d8071d90 msgr2=0x7fe8d80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 shutdown_connections 2024-02-15T22:37:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:36.828+0000 7fe8dd468700 1 -- 172.21.15.33:0/2400813600 wait complete. 2024-02-15T22:37:37.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:36 smithi033 ceph-mon[29033]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:37.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:36 smithi082 ceph-mon[37153]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:37.586 INFO:teuthology.orchestra.run.smithi033.stdout:171798691849 2024-02-15T22:37:37.586 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-15T22:37:38.369 INFO:teuthology.orchestra.run.smithi033.stdout:115964117011 2024-02-15T22:37:38.369 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-15T22:37:38.596 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:38.598 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.625+0000 7f73e07c8700 1 -- 172.21.15.33:0/3783551248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 msgr2=0x7f73d8106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.625+0000 7f73e07c8700 1 --2- 172.21.15.33:0/3783551248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 0x7f73d8106f30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73c8004940 tx=0x7f73c8009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.625+0000 7f73e07c8700 1 -- 172.21.15.33:0/3783551248 shutdown_connections 2024-02-15T22:37:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.625+0000 7f73e07c8700 1 --2- 172.21.15.33:0/3783551248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 0x7f73d8106f30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.625+0000 7f73e07c8700 1 --2- 172.21.15.33:0/3783551248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 0x7f73d80fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.625+0000 7f73e07c8700 1 -- 172.21.15.33:0/3783551248 >> 172.21.15.33:0/3783551248 conn(0x7f73d80f79e0 msgr2=0x7f73d80f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.626+0000 7f73e07c8700 1 -- 172.21.15.33:0/3783551248 shutdown_connections 2024-02-15T22:37:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.626+0000 7f73e07c8700 1 -- 172.21.15.33:0/3783551248 wait complete. 2024-02-15T22:37:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.627+0000 7f73e07c8700 1 Processor -- start 2024-02-15T22:37:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.627+0000 7f73e07c8700 1 -- start start 2024-02-15T22:37:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73e07c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 0x7f73d8113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73e07c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 0x7f73d8113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73e07c8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d81145f0 con 0x7f73d80fe8f0 2024-02-15T22:37:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73e07c8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d810d920 con 0x7f73d80fdf50 2024-02-15T22:37:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73ddd63700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 0x7f73d8113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73de564700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 0x7f73d8113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73de564700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 0x7f73d8113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:41050/0 (socket says 172.21.15.33:41050) 2024-02-15T22:37:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.628+0000 7f73de564700 1 -- 172.21.15.33:0/971479163 learned_addr learned my addr 172.21.15.33:0/971479163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.629+0000 7f73de564700 1 -- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 msgr2=0x7f73d8113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.629+0000 7f73de564700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 0x7f73d8113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.629+0000 7f73de564700 1 -- 172.21.15.33:0/971479163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8005040 con 0x7f73d80fdf50 2024-02-15T22:37:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.629+0000 7f73ddd63700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 0x7f73d8113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:37:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.629+0000 7f73de564700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 0x7f73d8113a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73d400eb40 tx=0x7f73d400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.629+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d4007cc0 con 0x7f73d80fdf50 2024-02-15T22:37:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.629+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73d400f040 con 0x7f73d80fdf50 2024-02-15T22:37:38.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.630+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d400ca10 con 0x7f73d80fdf50 2024-02-15T22:37:38.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.630+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d810dba0 con 0x7f73d80fdf50 2024-02-15T22:37:38.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.630+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d810dff0 con 0x7f73d80fdf50 2024-02-15T22:37:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.632+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73d810e4f0 con 0x7f73d80fdf50 2024-02-15T22:37:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.632+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f73d400cb70 con 0x7f73d80fdf50 2024-02-15T22:37:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.633+0000 7f73ceffd700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f73c40690f0 0x7f73c406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.633+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f73d4086620 con 0x7f73d80fdf50 2024-02-15T22:37:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.633+0000 7f73ceffd700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] conn(0x7f73c406ec50 0x7f73c4071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.633+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 --> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73c4071710 con 0x7f73c406ec50 2024-02-15T22:37:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.633+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73d4088bc0 con 0x7f73d80fdf50 2024-02-15T22:37:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.633+0000 7f73ded65700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] conn(0x7f73c406ec50 0x7f73c4071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.633+0000 7f73ddd63700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f73c40690f0 0x7f73c406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.634+0000 7f73ddd63700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f73c40690f0 0x7f73c406b5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f73d810f290 tx=0x7f73c8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.636+0000 7f73ded65700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] conn(0x7f73c406ec50 0x7f73c4071060 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:38.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.637+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== osd.4 v2:172.21.15.82:6808/462085336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f73c4071710 con 0x7f73c406ec50 2024-02-15T22:37:38.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.654+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 --> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f73d8064b00 con 0x7f73c406ec50 2024-02-15T22:37:38.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.654+0000 7f73ceffd700 1 -- 172.21.15.33:0/971479163 <== osd.4 v2:172.21.15.82:6808/462085336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f73d8064b00 con 0x7f73c406ec50 2024-02-15T22:37:38.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] conn(0x7f73c406ec50 msgr2=0x7f73c4071060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:38.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] conn(0x7f73c406ec50 0x7f73c4071060 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f73c40690f0 msgr2=0x7f73c406b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:38.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f73c40690f0 0x7f73c406b5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f73d810f290 tx=0x7f73c8009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 msgr2=0x7f73d8113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 0x7f73d8113a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73d400eb40 tx=0x7f73d400b040 comp rx=0 tx=0).stop 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 shutdown_connections 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:6808/462085336,v1:172.21.15.82:6809/462085336] conn(0x7f73c406ec50 0x7f73c4071060 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f73c40690f0 0x7f73c406b5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73d80fdf50 0x7f73d8113a60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 --2- 172.21.15.33:0/971479163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d80fe8f0 0x7f73d8113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 >> 172.21.15.33:0/971479163 conn(0x7f73d80f79e0 msgr2=0x7f73d81016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 shutdown_connections 2024-02-15T22:37:38.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:38.655+0000 7f73e07c8700 1 -- 172.21.15.33:0/971479163 wait complete. 2024-02-15T22:37:39.118 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:38 smithi033 ceph-mon[29033]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:39.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:38 smithi082 ceph-mon[37153]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:40.577 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:40.990 INFO:teuthology.orchestra.run.smithi033.stdout:150323855376 2024-02-15T22:37:40.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-15T22:37:41.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:40 smithi033 ceph-mon[29033]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:41.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:40 smithi082 ceph-mon[37153]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:43.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:42 smithi033 ceph-mon[29033]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:43.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:42 smithi082 ceph-mon[37153]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:44.533 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:44.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 -- 172.21.15.33:0/2080531817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c1038e0 msgr2=0x7fe51c0fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:44.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 --2- 172.21.15.33:0/2080531817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c1038e0 0x7fe51c0fcf50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe50c004940 tx=0x7fe50c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:44.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 -- 172.21.15.33:0/2080531817 shutdown_connections 2024-02-15T22:37:44.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 --2- 172.21.15.33:0/2080531817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c1038e0 0x7fe51c0fcf50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:44.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 --2- 172.21.15.33:0/2080531817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c102f40 0x7fe51c103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:44.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 -- 172.21.15.33:0/2080531817 >> 172.21.15.33:0/2080531817 conn(0x7fe51c0f8af0 msgr2=0x7fe51c0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:44.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 -- 172.21.15.33:0/2080531817 shutdown_connections 2024-02-15T22:37:44.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.549+0000 7fe52419f700 1 -- 172.21.15.33:0/2080531817 wait complete. 2024-02-15T22:37:44.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.550+0000 7fe52419f700 1 Processor -- start 2024-02-15T22:37:44.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.550+0000 7fe52419f700 1 -- start start 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.550+0000 7fe52419f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c102f40 0x7fe51c070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.550+0000 7fe52419f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c111a30 0x7fe51c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.550+0000 7fe52419f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c070e40 con 0x7fe51c102f40 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.550+0000 7fe52419f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c070fb0 con 0x7fe51c111a30 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.551+0000 7fe521f3b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c102f40 0x7fe51c070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.551+0000 7fe52173a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c111a30 0x7fe51c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.551+0000 7fe52173a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c111a30 0x7fe51c0707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:41078/0 (socket says 172.21.15.33:41078) 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.551+0000 7fe521f3b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c102f40 0x7fe51c070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32840/0 (socket says 172.21.15.33:32840) 2024-02-15T22:37:44.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.551+0000 7fe521f3b700 1 -- 172.21.15.33:0/3456684952 learned_addr learned my addr 172.21.15.33:0/3456684952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:44.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe521f3b700 1 -- 172.21.15.33:0/3456684952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c111a30 msgr2=0x7fe51c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:44.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe521f3b700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c111a30 0x7fe51c0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:44.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe521f3b700 1 -- 172.21.15.33:0/3456684952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c005040 con 0x7fe51c102f40 2024-02-15T22:37:44.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe52173a700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c111a30 0x7fe51c0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:37:44.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe521f3b700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c102f40 0x7fe51c070290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe51800eb40 tx=0x7fe51800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:44.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe5127fc700 1 -- 172.21.15.33:0/3456684952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe518007cc0 con 0x7fe51c102f40 2024-02-15T22:37:44.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe5127fc700 1 -- 172.21.15.33:0/3456684952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe51800f040 con 0x7fe51c102f40 2024-02-15T22:37:44.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe5127fc700 1 -- 172.21.15.33:0/3456684952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe518009620 con 0x7fe51c102f40 2024-02-15T22:37:44.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe52419f700 1 -- 172.21.15.33:0/3456684952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51c11e630 con 0x7fe51c102f40 2024-02-15T22:37:44.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.552+0000 7fe52419f700 1 -- 172.21.15.33:0/3456684952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c11eae0 con 0x7fe51c102f40 2024-02-15T22:37:44.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.554+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc0052b0 con 0x7fe51c102f40 2024-02-15T22:37:44.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.556+0000 7fe5127fc700 1 -- 172.21.15.33:0/3456684952 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe518009780 con 0x7fe51c102f40 2024-02-15T22:37:44.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.556+0000 7fe5127fc700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5080692a0 0x7fe50806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:44.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.556+0000 7fe5127fc700 1 -- 172.21.15.33:0/3456684952 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe518086ba0 con 0x7fe51c102f40 2024-02-15T22:37:44.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.556+0000 7fe52173a700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5080692a0 0x7fe50806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:44.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.557+0000 7fe52173a700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5080692a0 0x7fe50806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009fd0 tx=0x7fe50c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.562+0000 7fe5127fc700 1 -- 172.21.15.33:0/3456684952 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe518053360 con 0x7fe51c102f40 2024-02-15T22:37:44.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.757+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4fc005830 con 0x7fe51c102f40 2024-02-15T22:37:44.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.757+0000 7fe5127fc700 1 -- 172.21.15.33:0/3456684952 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe518053360 con 0x7fe51c102f40 2024-02-15T22:37:44.758 INFO:teuthology.orchestra.run.smithi033.stdout:60129542176 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5080692a0 msgr2=0x7fe50806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5080692a0 0x7fe50806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009fd0 tx=0x7fe50c009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c102f40 msgr2=0x7fe51c070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c102f40 0x7fe51c070290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe51800eb40 tx=0x7fe51800b040 comp rx=0 tx=0).stop 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 shutdown_connections 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5080692a0 0x7fe50806b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe51c102f40 0x7fe51c070290 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 --2- 172.21.15.33:0/3456684952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c111a30 0x7fe51c0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 >> 172.21.15.33:0/3456684952 conn(0x7fe51c0f8af0 msgr2=0x7fe51c0fa780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:44.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 shutdown_connections 2024-02-15T22:37:44.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:44.760+0000 7fe507fff700 1 -- 172.21.15.33:0/3456684952 wait complete. 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 -- 172.21.15.33:0/880052430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 msgr2=0x7f09ec103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 --2- 172.21.15.33:0/880052430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec103320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009ce0 tx=0x7f09dc004d10 comp rx=0 tx=0).stop 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 -- 172.21.15.33:0/880052430 shutdown_connections 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 --2- 172.21.15.33:0/880052430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09ec1038f0 0x7f09ec0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 --2- 172.21.15.33:0/880052430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec103320 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 -- 172.21.15.33:0/880052430 >> 172.21.15.33:0/880052430 conn(0x7f09ec0f8ae0 msgr2=0x7f09ec0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 -- 172.21.15.33:0/880052430 shutdown_connections 2024-02-15T22:37:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.089+0000 7f09f1228700 1 -- 172.21.15.33:0/880052430 wait complete. 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09f1228700 1 Processor -- start 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09f1228700 1 -- start start 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09f1228700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09f1228700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09ec1038f0 0x7f09ec114120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09f1228700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec114770 con 0x7f09ec102f50 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09f1228700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec10daa0 con 0x7f09ec1038f0 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09ead9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09ead9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32858/0 (socket says 172.21.15.33:32858) 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.090+0000 7f09ead9d700 1 -- 172.21.15.33:0/2353218468 learned_addr learned my addr 172.21.15.33:0/2353218468 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09ead9d700 1 -- 172.21.15.33:0/2353218468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09ec1038f0 msgr2=0x7f09ec114120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09e259c700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09ec1038f0 0x7f09ec114120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09ead9d700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09ec1038f0 0x7f09ec114120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09ead9d700 1 -- 172.21.15.33:0/2353218468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009940 con 0x7f09ec102f50 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09e259c700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09ec1038f0 0x7f09ec114120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09ead9d700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec113be0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00bf60 tx=0x7f09dc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09e3fff700 1 -- 172.21.15.33:0/2353218468 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09dc00e040 con 0x7f09ec102f50 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec10dd20 con 0x7f09ec102f50 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09e3fff700 1 -- 172.21.15.33:0/2353218468 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09dc0128e0 con 0x7f09ec102f50 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09e3fff700 1 -- 172.21.15.33:0/2353218468 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09dc01c870 con 0x7f09ec102f50 2024-02-15T22:37:45.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.091+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec10e260 con 0x7f09ec102f50 2024-02-15T22:37:45.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.092+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec100260 con 0x7f09ec102f50 2024-02-15T22:37:45.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.093+0000 7f09e3fff700 1 -- 172.21.15.33:0/2353218468 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f09dc012a50 con 0x7f09ec102f50 2024-02-15T22:37:45.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.093+0000 7f09e3fff700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f09d80692a0 0x7f09d806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:45.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.093+0000 7f09e3fff700 1 -- 172.21.15.33:0/2353218468 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f09dc088bc0 con 0x7f09ec102f50 2024-02-15T22:37:45.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.093+0000 7f09e259c700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f09d80692a0 0x7f09d806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:45.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.093+0000 7f09e259c700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f09d80692a0 0x7f09d806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09d4007fd0 tx=0x7f09d4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:45.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.098+0000 7f09e3fff700 1 -- 172.21.15.33:0/2353218468 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f09dc058c40 con 0x7f09ec102f50 2024-02-15T22:37:45.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:44 smithi033 ceph-mon[29033]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:45.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:44 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3456684952' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T22:37:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.291+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f09ec04bed0 con 0x7f09ec102f50 2024-02-15T22:37:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.291+0000 7f09e3fff700 1 -- 172.21.15.33:0/2353218468 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09dc0587d0 con 0x7f09ec102f50 2024-02-15T22:37:45.291 INFO:teuthology.orchestra.run.smithi033.stdout:171798691851 2024-02-15T22:37:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f09d80692a0 msgr2=0x7f09d806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f09d80692a0 0x7f09d806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09d4007fd0 tx=0x7f09d4009040 comp rx=0 tx=0).stop 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 msgr2=0x7f09ec113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec113be0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00bf60 tx=0x7f09dc004d10 comp rx=0 tx=0).stop 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 shutdown_connections 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f09d80692a0 0x7f09d806b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09ec102f50 0x7f09ec113be0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 --2- 172.21.15.33:0/2353218468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09ec1038f0 0x7f09ec114120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 >> 172.21.15.33:0/2353218468 conn(0x7f09ec0f8ae0 msgr2=0x7f09ec0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 shutdown_connections 2024-02-15T22:37:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.293+0000 7f09f1228700 1 -- 172.21.15.33:0/2353218468 wait complete. 2024-02-15T22:37:45.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:44 smithi082 ceph-mon[37153]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:45.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:44 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3456684952' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T22:37:46.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 -- 172.21.15.33:0/1235642304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37641027e0 msgr2=0x7f37640fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 --2- 172.21.15.33:0/1235642304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37641027e0 0x7f37640fbea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3758004940 tx=0x7f3758009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:46.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 -- 172.21.15.33:0/1235642304 shutdown_connections 2024-02-15T22:37:46.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 --2- 172.21.15.33:0/1235642304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37641027e0 0x7f37640fbea0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 --2- 172.21.15.33:0/1235642304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3764101e40 0x7f3764102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 -- 172.21.15.33:0/1235642304 >> 172.21.15.33:0/1235642304 conn(0x7f3764071d90 msgr2=0x7f3764072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:46.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 -- 172.21.15.33:0/1235642304 shutdown_connections 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.005+0000 7f376c26b700 1 -- 172.21.15.33:0/1235642304 wait complete. 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376c26b700 1 Processor -- start 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376c26b700 1 -- start start 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376c26b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3764101e40 0x7f3764113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376c26b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37641027e0 0x7f3764113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376c26b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37641145c0 con 0x7f3764101e40 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376c26b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376410d960 con 0x7f37641027e0 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376a007700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3764101e40 0x7f3764113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376a007700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3764101e40 0x7f3764113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32896/0 (socket says 172.21.15.33:32896) 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376a007700 1 -- 172.21.15.33:0/974327474 learned_addr learned my addr 172.21.15.33:0/974327474 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f3769806700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37641027e0 0x7f3764113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376a007700 1 -- 172.21.15.33:0/974327474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37641027e0 msgr2=0x7f3764113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376a007700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37641027e0 0x7f3764113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376a007700 1 -- 172.21.15.33:0/974327474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758005040 con 0x7f3764101e40 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f3769806700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37641027e0 0x7f3764113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:37:46.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f376a007700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3764101e40 0x7f3764113a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3754001d80 tx=0x7f3754009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.006+0000 7f3762ffd700 1 -- 172.21.15.33:0/974327474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3754007d10 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.007+0000 7f3762ffd700 1 -- 172.21.15.33:0/974327474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3754007e70 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.007+0000 7f3762ffd700 1 -- 172.21.15.33:0/974327474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3754014640 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.007+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376410dc40 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.007+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376410e180 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.007+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37640738b0 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.008+0000 7f3762ffd700 1 -- 172.21.15.33:0/974327474 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f375400e960 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.008+0000 7f3762ffd700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f374c0692a0 0x7f374c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.008+0000 7f3769806700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f374c0692a0 0x7f374c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.008+0000 7f3762ffd700 1 -- 172.21.15.33:0/974327474 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3754086b70 con 0x7f3764101e40 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.009+0000 7f3769806700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f374c0692a0 0x7f374c06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f376410eb70 tx=0x7f3758009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:46.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.013+0000 7f3762ffd700 1 -- 172.21.15.33:0/974327474 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f375404dbd0 con 0x7f3764101e40 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 -- 172.21.15.33:0/780585354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4102800 msgr2=0x7fbeb40fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 --2- 172.21.15.33:0/780585354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4102800 0x7fbeb40fbe70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbea0004940 tx=0x7fbea0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 -- 172.21.15.33:0/780585354 shutdown_connections 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 --2- 172.21.15.33:0/780585354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4102800 0x7fbeb40fbe70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 --2- 172.21.15.33:0/780585354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeb4101e60 0x7fbeb4102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 -- 172.21.15.33:0/780585354 >> 172.21.15.33:0/780585354 conn(0x7fbeb40f7a10 msgr2=0x7fbeb40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 -- 172.21.15.33:0/780585354 shutdown_connections 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.507+0000 7fbebaca6700 1 -- 172.21.15.33:0/780585354 wait complete. 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbebaca6700 1 Processor -- start 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbebaca6700 1 -- start start 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbebaca6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4101e60 0x7fbeb410c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbebaca6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeb4102800 0x7fbeb410cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbebaca6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb410d250 con 0x7fbeb4101e60 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbebaca6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb410d3c0 con 0x7fbeb4102800 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbeb8a42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4101e60 0x7fbeb410c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbeb8a42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4101e60 0x7fbeb410c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32880/0 (socket says 172.21.15.33:32880) 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.508+0000 7fbeb8a42700 1 -- 172.21.15.33:0/1380999718 learned_addr learned my addr 172.21.15.33:0/1380999718 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb3fff700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeb4102800 0x7fbeb410cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stdout:38654705702 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb8a42700 1 -- 172.21.15.33:0/1380999718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeb4102800 msgr2=0x7fbeb410cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb8a42700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeb4102800 0x7fbeb410cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb8a42700 1 -- 172.21.15.33:0/1380999718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea0005040 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb8a42700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4101e60 0x7fbeb410c7d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbea8002a50 tx=0x7fbea80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb17fa700 1 -- 172.21.15.33:0/1380999718 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea8007cc0 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb4119e40 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb17fa700 1 -- 172.21.15.33:0/1380999718 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbea800f040 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbeb17fa700 1 -- 172.21.15.33:0/1380999718 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea8009640 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.509+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb411a240 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.510+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb4104330 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.510+0000 7fbeb17fa700 1 -- 172.21.15.33:0/1380999718 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fbea80097a0 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.511+0000 7fbeb17fa700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fbea40692a0 0x7fbea406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.511+0000 7fbeb17fa700 1 -- 172.21.15.33:0/1380999718 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbea8086c60 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.511+0000 7fbeb3fff700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fbea40692a0 0x7fbea406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.511+0000 7fbeb3fff700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fbea40692a0 0x7fbea406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4066a10 tx=0x7fbea0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.515+0000 7fbeb17fa700 1 -- 172.21.15.33:0/1380999718 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fbea8056ce0 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.710+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbeb4066750 con 0x7fbeb4101e60 2024-02-15T22:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.711+0000 7fbeb17fa700 1 -- 172.21.15.33:0/1380999718 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbea8056870 con 0x7fbeb4101e60 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fbea40692a0 msgr2=0x7fbea406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fbea40692a0 0x7fbea406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4066a10 tx=0x7fbea0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4101e60 msgr2=0x7fbeb410c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4101e60 0x7fbeb410c7d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbea8002a50 tx=0x7fbea80046b0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 shutdown_connections 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fbea40692a0 0x7fbea406b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbeb4101e60 0x7fbeb410c7d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 --2- 172.21.15.33:0/1380999718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeb4102800 0x7fbeb410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 >> 172.21.15.33:0/1380999718 conn(0x7fbeb40f7a10 msgr2=0x7fbeb40f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 shutdown_connections 2024-02-15T22:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:45.714+0000 7fbebaca6700 1 -- 172.21.15.33:0/1380999718 wait complete. 2024-02-15T22:37:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.215+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f376404bed0 con 0x7f3764101e40 2024-02-15T22:37:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.215+0000 7f3762ffd700 1 -- 172.21.15.33:0/974327474 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3754056d20 con 0x7f3764101e40 2024-02-15T22:37:46.216 INFO:teuthology.orchestra.run.smithi033.stdout:81604378651 2024-02-15T22:37:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f374c0692a0 msgr2=0x7f374c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f374c0692a0 0x7f374c06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f376410eb70 tx=0x7f3758009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3764101e40 msgr2=0x7f3764113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3764101e40 0x7f3764113a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3754001d80 tx=0x7f3754009ec0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 shutdown_connections 2024-02-15T22:37:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f374c0692a0 0x7f374c06b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3764101e40 0x7f3764113a30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 --2- 172.21.15.33:0/974327474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37641027e0 0x7f3764113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 >> 172.21.15.33:0/974327474 conn(0x7f3764071d90 msgr2=0x7f3764065720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 shutdown_connections 2024-02-15T22:37:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:46.217+0000 7f376c26b700 1 -- 172.21.15.33:0/974327474 wait complete. 2024-02-15T22:37:46.228 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:45 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2353218468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T22:37:46.228 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:45 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1380999718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T22:37:46.329 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:46.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:45 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2353218468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T22:37:46.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:45 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1380999718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T22:37:47.002 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-02-15T22:37:47.002 DEBUG:teuthology.parallel:result is None 2024-02-15T22:37:47.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:46 smithi033 ceph-mon[29033]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:47.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:46 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/974327474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T22:37:47.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:46 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:46 smithi082 ceph-mon[37153]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:46 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/974327474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T22:37:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:46 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:37:48.171 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-02-15T22:37:48.172 DEBUG:teuthology.parallel:result is None 2024-02-15T22:37:48.955 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:48 smithi033 ceph-mon[29033]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:48.982 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-02-15T22:37:48.982 DEBUG:teuthology.parallel:result is None 2024-02-15T22:37:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:48 smithi082 ceph-mon[37153]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:49.404 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691851 for osd.5 2024-02-15T22:37:49.404 DEBUG:teuthology.parallel:result is None 2024-02-15T22:37:50.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/872056911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68102f50 msgr2=0x7f3d68103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/872056911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68102f50 0x7f3d68103320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3d58004940 tx=0x7f3d58009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/872056911 shutdown_connections 2024-02-15T22:37:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/872056911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d681038f0 0x7f3d680fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/872056911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68102f50 0x7f3d68103320 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/872056911 >> 172.21.15.33:0/872056911 conn(0x7f3d680f8ae0 msgr2=0x7f3d680faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/872056911 shutdown_connections 2024-02-15T22:37:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.961+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/872056911 wait complete. 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d6e4c7700 1 Processor -- start 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d6e4c7700 1 -- start start 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d6e4c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d68102f50 0x7f3d68113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d6e4c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d681038f0 0x7f3d68113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d6e4c7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d681145e0 con 0x7f3d681038f0 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d6e4c7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6810d910 con 0x7f3d68102f50 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d681038f0 0x7f3d68113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d681038f0 0x7f3d68113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33162/0 (socket says 172.21.15.33:33162) 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d677fe700 1 -- 172.21.15.33:0/3548732182 learned_addr learned my addr 172.21.15.33:0/3548732182 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.962+0000 7f3d67fff700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d68102f50 0x7f3d68113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d677fe700 1 -- 172.21.15.33:0/3548732182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d68102f50 msgr2=0x7f3d68113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d677fe700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d68102f50 0x7f3d68113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d677fe700 1 -- 172.21.15.33:0/3548732182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58005040 con 0x7f3d681038f0 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d677fe700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d681038f0 0x7f3d68113f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c002a50 tx=0x7f3d5c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d64ff9700 1 -- 172.21.15.33:0/3548732182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d5c007cc0 con 0x7f3d681038f0 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6810dbf0 con 0x7f3d681038f0 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d64ff9700 1 -- 172.21.15.33:0/3548732182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d5c00f040 con 0x7f3d681038f0 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d64ff9700 1 -- 172.21.15.33:0/3548732182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d5c00d9c0 con 0x7f3d681038f0 2024-02-15T22:37:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.963+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6810e130 con 0x7f3d681038f0 2024-02-15T22:37:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.964+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d680fc6e0 con 0x7f3d681038f0 2024-02-15T22:37:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.965+0000 7f3d64ff9700 1 -- 172.21.15.33:0/3548732182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3d5c009730 con 0x7f3d681038f0 2024-02-15T22:37:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.965+0000 7f3d64ff9700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3d500692a0 0x7f3d5006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.965+0000 7f3d67fff700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3d500692a0 0x7f3d5006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.965+0000 7f3d64ff9700 1 -- 172.21.15.33:0/3548732182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d5c086c90 con 0x7f3d681038f0 2024-02-15T22:37:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.965+0000 7f3d67fff700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3d500692a0 0x7f3d5006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3d58004f90 tx=0x7f3d58009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:50.969+0000 7f3d64ff9700 1 -- 172.21.15.33:0/3548732182 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3d5c056c70 con 0x7f3d681038f0 2024-02-15T22:37:51.112 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:50 smithi033 ceph-mon[29033]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.164+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d6810e350 con 0x7f3d681038f0 2024-02-15T22:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.164+0000 7f3d64ff9700 1 -- 172.21.15.33:0/3548732182 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d5c056800 con 0x7f3d681038f0 2024-02-15T22:37:51.165 INFO:teuthology.orchestra.run.smithi033.stdout:115964117014 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3d500692a0 msgr2=0x7f3d5006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3d500692a0 0x7f3d5006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3d58004f90 tx=0x7f3d58009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d681038f0 msgr2=0x7f3d68113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d681038f0 0x7f3d68113f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c002a50 tx=0x7f3d5c004600 comp rx=0 tx=0).stop 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 shutdown_connections 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3d500692a0 0x7f3d5006b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d68102f50 0x7f3d68113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 --2- 172.21.15.33:0/3548732182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d681038f0 0x7f3d68113f90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.166+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 >> 172.21.15.33:0/3548732182 conn(0x7f3d680f8ae0 msgr2=0x7f3d680fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.167+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 shutdown_connections 2024-02-15T22:37:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.167+0000 7f3d6e4c7700 1 -- 172.21.15.33:0/3548732182 wait complete. 2024-02-15T22:37:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.216+0000 7f3984f5b700 1 -- 172.21.15.33:0/3161426853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 msgr2=0x7f39800fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.216+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3161426853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fe390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3970004940 tx=0x7f3970009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.216+0000 7f3984f5b700 1 -- 172.21.15.33:0/3161426853 shutdown_connections 2024-02-15T22:37:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.216+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3161426853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39800fe960 0x7f3980106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.216+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3161426853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fe390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.216+0000 7f3984f5b700 1 -- 172.21.15.33:0/3161426853 >> 172.21.15.33:0/3161426853 conn(0x7f39800f7a10 msgr2=0x7f39800f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.216+0000 7f3984f5b700 1 -- 172.21.15.33:0/3161426853 shutdown_connections 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f3984f5b700 1 -- 172.21.15.33:0/3161426853 wait complete. 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f3984f5b700 1 Processor -- start 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f3984f5b700 1 -- start start 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f3984f5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f3984f5b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39800fe960 0x7f39800fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f3984f5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800fc930 con 0x7f39800fdfc0 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f3984f5b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800fcaa0 con 0x7f39800fe960 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f397e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f397e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33176/0 (socket says 172.21.15.33:33176) 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f397e59c700 1 -- 172.21.15.33:0/3366948762 learned_addr learned my addr 172.21.15.33:0/3366948762 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.217+0000 7f397dd9b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39800fe960 0x7f39800fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f397e59c700 1 -- 172.21.15.33:0/3366948762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39800fe960 msgr2=0x7f39800fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f397e59c700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39800fe960 0x7f39800fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f397e59c700 1 -- 172.21.15.33:0/3366948762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970005040 con 0x7f39800fdfc0 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f397e59c700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fbdf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3970000c00 tx=0x7f3970009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f396effd700 1 -- 172.21.15.33:0/3366948762 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397000e040 con 0x7f39800fdfc0 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3980119c50 con 0x7f39800fdfc0 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f396effd700 1 -- 172.21.15.33:0/3366948762 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3970009af0 con 0x7f39800fdfc0 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f396effd700 1 -- 172.21.15.33:0/3366948762 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397001c630 con 0x7f39800fdfc0 2024-02-15T22:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.218+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398011a130 con 0x7f39800fdfc0 2024-02-15T22:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.219+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39801045b0 con 0x7f39800fdfc0 2024-02-15T22:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.219+0000 7f396effd700 1 -- 172.21.15.33:0/3366948762 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f397000bbf0 con 0x7f39800fdfc0 2024-02-15T22:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.220+0000 7f396effd700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f39680692a0 0x7f396806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.220+0000 7f396effd700 1 -- 172.21.15.33:0/3366948762 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f39700880c0 con 0x7f39800fdfc0 2024-02-15T22:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.220+0000 7f397dd9b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f39680692a0 0x7f396806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.220+0000 7f397dd9b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f39680692a0 0x7f396806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39800fd7f0 tx=0x7f397400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:51.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.224+0000 7f396effd700 1 -- 172.21.15.33:0/3366948762 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f39700547d0 con 0x7f39800fdfc0 2024-02-15T22:37:51.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:50 smithi082 ceph-mon[37153]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:51.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.418+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f39800fb610 con 0x7f39800fdfc0 2024-02-15T22:37:51.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.419+0000 7f396effd700 1 -- 172.21.15.33:0/3366948762 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3970057df0 con 0x7f39800fdfc0 2024-02-15T22:37:51.419 INFO:teuthology.orchestra.run.smithi033.stdout:150323855378 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f39680692a0 msgr2=0x7f396806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f39680692a0 0x7f396806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39800fd7f0 tx=0x7f397400b040 comp rx=0 tx=0).stop 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 msgr2=0x7f39800fbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fbdf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3970000c00 tx=0x7f3970009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 shutdown_connections 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f39680692a0 0x7f396806b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39800fdfc0 0x7f39800fbdf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 --2- 172.21.15.33:0/3366948762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39800fe960 0x7f39800fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 >> 172.21.15.33:0/3366948762 conn(0x7f39800f7a10 msgr2=0x7f3980101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 shutdown_connections 2024-02-15T22:37:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:51.421+0000 7f3984f5b700 1 -- 172.21.15.33:0/3366948762 wait complete. 2024-02-15T22:37:51.842 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117014 for osd.3 2024-02-15T22:37:51.842 DEBUG:teuthology.parallel:result is None 2024-02-15T22:37:52.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:51 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3548732182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T22:37:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:51 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3366948762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T22:37:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:51 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3548732182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T22:37:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:51 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3366948762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T22:37:52.517 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855376 got 150323855378 for osd.4 2024-02-15T22:37:52.517 DEBUG:teuthology.parallel:result is None 2024-02-15T22:37:52.518 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-15T22:37:52.518 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T22:37:52.785 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:52 smithi033 ceph-mon[29033]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:53.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:52 smithi082 ceph-mon[37153]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:54.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 -- 172.21.15.33:0/3983153062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fdfe0 msgr2=0x7fd34c0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:54.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 --2- 172.21.15.33:0/3983153062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fdfe0 0x7fd34c0fe3b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd348004970 tx=0x7fd348009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:54.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 -- 172.21.15.33:0/3983153062 shutdown_connections 2024-02-15T22:37:54.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 --2- 172.21.15.33:0/3983153062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34c0fe8f0 0x7fd34c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 --2- 172.21.15.33:0/3983153062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fdfe0 0x7fd34c0fe3b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 -- 172.21.15.33:0/3983153062 >> 172.21.15.33:0/3983153062 conn(0x7fd34c071d90 msgr2=0x7fd34c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 -- 172.21.15.33:0/3983153062 shutdown_connections 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.400+0000 7fd353843700 1 -- 172.21.15.33:0/3983153062 wait complete. 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd353843700 1 Processor -- start 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd353843700 1 -- start start 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd353843700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34c0fdfe0 0x7fd34c113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd353843700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fe8f0 0x7fd34c113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd353843700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c1145e0 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd353843700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c10d910 con 0x7fd34c0fdfe0 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd350dde700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fe8f0 0x7fd34c113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd3515df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34c0fdfe0 0x7fd34c113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:54.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd350dde700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fe8f0 0x7fd34c113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33194/0 (socket says 172.21.15.33:33194) 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd350dde700 1 -- 172.21.15.33:0/3048731048 learned_addr learned my addr 172.21.15.33:0/3048731048 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd350dde700 1 -- 172.21.15.33:0/3048731048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34c0fdfe0 msgr2=0x7fd34c113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd350dde700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34c0fdfe0 0x7fd34c113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd350dde700 1 -- 172.21.15.33:0/3048731048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348005040 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.401+0000 7fd350dde700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fe8f0 0x7fd34c113f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd33c002a50 tx=0x7fd33c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.402+0000 7fd341ffb700 1 -- 172.21.15.33:0/3048731048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c007cc0 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.402+0000 7fd341ffb700 1 -- 172.21.15.33:0/3048731048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd33c00f040 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.402+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c10dbf0 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.402+0000 7fd341ffb700 1 -- 172.21.15.33:0/3048731048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c00da30 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.402+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c10e130 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.403+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c1046c0 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.403+0000 7fd341ffb700 1 -- 172.21.15.33:0/3048731048 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd33c00db90 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.403+0000 7fd341ffb700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3380692a0 0x7fd33806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:54.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.404+0000 7fd341ffb700 1 -- 172.21.15.33:0/3048731048 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd33c086be0 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.404+0000 7fd3515df700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3380692a0 0x7fd33806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:54.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.404+0000 7fd3515df700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3380692a0 0x7fd33806b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd348000c00 tx=0x7fd348009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:54.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.408+0000 7fd341ffb700 1 -- 172.21.15.33:0/3048731048 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd33c056c60 con 0x7fd34c0fe8f0 2024-02-15T22:37:54.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.596+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd34c10a030 con 0x7fd3380692a0 2024-02-15T22:37:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.598+0000 7fd341ffb700 1 -- 172.21.15.33:0/3048731048 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27953 (secure 0 0 0) 0x7fd34c10a030 con 0x7fd3380692a0 2024-02-15T22:37:54.599 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3380692a0 msgr2=0x7fd33806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3380692a0 0x7fd33806b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd348000c00 tx=0x7fd348009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fe8f0 msgr2=0x7fd34c113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fe8f0 0x7fd34c113f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd33c002a50 tx=0x7fd33c0046b0 comp rx=0 tx=0).stop 2024-02-15T22:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 shutdown_connections 2024-02-15T22:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd3380692a0 0x7fd33806b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34c0fdfe0 0x7fd34c113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 --2- 172.21.15.33:0/3048731048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0fe8f0 0x7fd34c113f90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 >> 172.21.15.33:0/3048731048 conn(0x7fd34c071d90 msgr2=0x7fd34c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 shutdown_connections 2024-02-15T22:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:54.600+0000 7fd353843700 1 -- 172.21.15.33:0/3048731048 wait complete. 2024-02-15T22:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-02-15T22:37:55.143 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:54 smithi082 ceph-mon[37153]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:55.201 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:54 smithi033 ceph-mon[29033]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:55.228 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-02-15T22:37:53.905807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2625156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002122"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-15T22:37:03.224344+0000","last_change":"2024-02-15T22:36:36.359789+0000","last_active":"2024-02-15T22:37:03.224344+0000","last_peered":"2024-02-15T22:37:03.224344+0000","last_clean":"2024-02-15T22:37:03.224344+0000","last_became_active":"2024-02-15T22:36:36.359394+0000","last_became_peered":"2024-02-15T22:36:36.359394+0000","last_unstale":"2024-02-15T22:37:03.224344+0000","last_undegraded":"2024-02-15T22:37:03.224344+0000","last_fullsized":"2024-02-15T22:37:03.224344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:35:50.230811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:35:50.230811+0000","last_clean_scrub_stamp":"2024-02-15T22:35:50.230811+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:04.642114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]},{"osd":4,"up_from":35,"seq":150323855379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.752},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.377},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.433},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Feb 15 22:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.33200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:48 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46200000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.374},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.379,"15min":0.38300000000000001},"min":{"1min":0.27300000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.47599999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.317}]},{"osd":1,"last update":"Thu Feb 15 22:37:48 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40400000000000003,"15min":0.41099999999999998},"min":{"1min":0.25,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.504,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:37:11 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Feb 15 22:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.34799999999999998,"15min":0.34300000000000003},"min":{"1min":0.253,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.313}]},{"osd":2,"last update":"Thu Feb 15 22:36:51 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Feb 15 22:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.252,"5min":0.214,"15min":0.214},"max":{"1min":0.496,"5min":0.498,"15min":0.498},"last":0.219},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.31900000000000001},"min":{"1min":0.29499999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 15 22:36:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.246},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:37:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Feb 15 22:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:37:55.229 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T22:37:55.493 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:56.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:55 smithi033 ceph-mon[29033]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:37:56.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:55 smithi082 ceph-mon[37153]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:37:57.152 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:56 smithi033 ceph-mon[29033]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 -- 172.21.15.33:0/1592210405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 msgr2=0x7f5d00103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 --2- 172.21.15.33:0/1592210405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00103190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0004940 tx=0x7f5cf0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 -- 172.21.15.33:0/1592210405 shutdown_connections 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 --2- 172.21.15.33:0/1592210405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d00065760 0x7f5d00065bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 --2- 172.21.15.33:0/1592210405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00103190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 -- 172.21.15.33:0/1592210405 >> 172.21.15.33:0/1592210405 conn(0x7f5d00072b10 msgr2=0x7f5d00072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 -- 172.21.15.33:0/1592210405 shutdown_connections 2024-02-15T22:37:57.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.182+0000 7f5d05a03700 1 -- 172.21.15.33:0/1592210405 wait complete. 2024-02-15T22:37:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5d05a03700 1 Processor -- start 2024-02-15T22:37:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5d05a03700 1 -- start start 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5d05a03700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d00065760 0x7f5d00113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5d05a03700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00113d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5d05a03700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001143d0 con 0x7f5d00102dc0 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5d05a03700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0010d700 con 0x7f5d00065760 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5cfe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00113d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5cfe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00113d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49402/0 (socket says 172.21.15.33:49402) 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5cfe7fc700 1 -- 172.21.15.33:0/2408167652 learned_addr learned my addr 172.21.15.33:0/2408167652 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.183+0000 7f5cfeffd700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d00065760 0x7f5d00113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5cfe7fc700 1 -- 172.21.15.33:0/2408167652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d00065760 msgr2=0x7f5d00113840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5cfe7fc700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d00065760 0x7f5d00113840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5cfe7fc700 1 -- 172.21.15.33:0/2408167652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0005040 con 0x7f5d00102dc0 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5cfeffd700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d00065760 0x7f5d00113840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5cfe7fc700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00113d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4002a50 tx=0x7f5cf40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5ce77fe700 1 -- 172.21.15.33:0/2408167652 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf4007cc0 con 0x7f5d00102dc0 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5ce77fe700 1 -- 172.21.15.33:0/2408167652 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cf400f040 con 0x7f5d00102dc0 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5ce77fe700 1 -- 172.21.15.33:0/2408167652 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf4009640 con 0x7f5d00102dc0 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0010d9e0 con 0x7f5d00102dc0 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.184+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0010df50 con 0x7f5d00102dc0 2024-02-15T22:37:57.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.185+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0005f5c0 con 0x7f5d00102dc0 2024-02-15T22:37:57.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.186+0000 7f5ce77fe700 1 -- 172.21.15.33:0/2408167652 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f5cf40097a0 con 0x7f5d00102dc0 2024-02-15T22:37:57.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.186+0000 7f5ce77fe700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5ce80692a0 0x7f5ce806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:57.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.186+0000 7f5ce77fe700 1 -- 172.21.15.33:0/2408167652 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5cf4086c80 con 0x7f5d00102dc0 2024-02-15T22:37:57.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.186+0000 7f5cfeffd700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5ce80692a0 0x7f5ce806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:57.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.187+0000 7f5cfeffd700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5ce80692a0 0x7f5ce806b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0004f90 tx=0x7f5cf0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:57.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.191+0000 7f5ce77fe700 1 -- 172.21.15.33:0/2408167652 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5cf4056d00 con 0x7f5d00102dc0 2024-02-15T22:37:57.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:56 smithi082 ceph-mon[37153]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:57.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.381+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d0004bed0 con 0x7f5ce80692a0 2024-02-15T22:37:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.382+0000 7f5ce77fe700 1 -- 172.21.15.33:0/2408167652 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27936 (secure 0 0 0) 0x7f5d0004bed0 con 0x7f5ce80692a0 2024-02-15T22:37:57.383 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:37:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5ce80692a0 msgr2=0x7f5ce806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5ce80692a0 0x7f5ce806b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0004f90 tx=0x7f5cf0009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 msgr2=0x7f5d00113d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00113d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4002a50 tx=0x7f5cf40046b0 comp rx=0 tx=0).stop 2024-02-15T22:37:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 shutdown_connections 2024-02-15T22:37:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5ce80692a0 0x7f5ce806b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d00065760 0x7f5d00113840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:57.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 --2- 172.21.15.33:0/2408167652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d00102dc0 0x7f5d00113d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:57.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.384+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 >> 172.21.15.33:0/2408167652 conn(0x7f5d00072b10 msgr2=0x7f5d000fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:57.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.385+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 shutdown_connections 2024-02-15T22:37:57.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:57.385+0000 7f5d05a03700 1 -- 172.21.15.33:0/2408167652 wait complete. 2024-02-15T22:37:57.386 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-02-15T22:37:58.033 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-02-15T22:37:55.906157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2625156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002134"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-15T22:37:03.224344+0000","last_change":"2024-02-15T22:36:36.359789+0000","last_active":"2024-02-15T22:37:03.224344+0000","last_peered":"2024-02-15T22:37:03.224344+0000","last_clean":"2024-02-15T22:37:03.224344+0000","last_became_active":"2024-02-15T22:36:36.359394+0000","last_became_peered":"2024-02-15T22:36:36.359394+0000","last_unstale":"2024-02-15T22:37:03.224344+0000","last_undegraded":"2024-02-15T22:37:03.224344+0000","last_fullsized":"2024-02-15T22:37:03.224344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:35:50.230811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:35:50.230811+0000","last_clean_scrub_stamp":"2024-02-15T22:35:50.230811+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:04.642114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]},{"osd":4,"up_from":35,"seq":150323855379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.752},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.626},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Feb 15 22:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:48 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46200000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.374},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.379,"15min":0.38300000000000001},"min":{"1min":0.27300000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.47599999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.317}]},{"osd":1,"last update":"Thu Feb 15 22:37:48 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40400000000000003,"15min":0.41099999999999998},"min":{"1min":0.25,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.504,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:37:11 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Feb 15 22:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.34799999999999998,"15min":0.34300000000000003},"min":{"1min":0.253,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.373},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52700000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.249},{"interface":"front","average":{"1min":0.379,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.48799999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Feb 15 22:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Feb 15 22:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.375},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.252,"5min":0.214,"15min":0.214},"max":{"1min":0.496,"5min":0.498,"15min":0.498},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.31900000000000001},"min":{"1min":0.29499999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Feb 15 22:37:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.38900000000000001,"15min":0.39900000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.48199999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.5}]},{"osd":3,"last update":"Thu Feb 15 22:37:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Feb 15 22:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:37:58.034 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-15T22:37:58.034 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-15T22:37:58.035 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-15T22:37:58.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph health --format=json 2024-02-15T22:37:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:37:59.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:58 smithi033 ceph-mon[29033]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:37:59.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:37:58 smithi033 ceph-mon[29033]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:59.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:58 smithi082 ceph-mon[37153]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:37:59.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:37:58 smithi082 ceph-mon[37153]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:37:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 -- 172.21.15.33:0/1574883583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb198102f50 msgr2=0x7fb198103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 --2- 172.21.15.33:0/1574883583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb198102f50 0x7fb198103320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb190004940 tx=0x7fb190009e30 comp rx=0 tx=0).stop 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 -- 172.21.15.33:0/1574883583 shutdown_connections 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 --2- 172.21.15.33:0/1574883583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1981038f0 0x7fb1980fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 --2- 172.21.15.33:0/1574883583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb198102f50 0x7fb198103320 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 -- 172.21.15.33:0/1574883583 >> 172.21.15.33:0/1574883583 conn(0x7fb1980f8ae0 msgr2=0x7fb1980faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 -- 172.21.15.33:0/1574883583 shutdown_connections 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 -- 172.21.15.33:0/1574883583 wait complete. 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.920+0000 7fb19d948700 1 Processor -- start 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb19d948700 1 -- start start 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb19d948700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb198102f50 0x7fb198070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb19d948700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1981038f0 0x7fb1980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb19d948700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198070dd0 con 0x7fb1981038f0 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb19d948700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198070f40 con 0x7fb198102f50 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb1967fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1981038f0 0x7fb1980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb1967fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1981038f0 0x7fb1980707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49420/0 (socket says 172.21.15.33:49420) 2024-02-15T22:37:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb1967fc700 1 -- 172.21.15.33:0/2855109938 learned_addr learned my addr 172.21.15.33:0/2855109938 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:37:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb196ffd700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb198102f50 0x7fb198070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb1967fc700 1 -- 172.21.15.33:0/2855109938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb198102f50 msgr2=0x7fb198070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:37:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb1967fc700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb198102f50 0x7fb198070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:37:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb1967fc700 1 -- 172.21.15.33:0/2855109938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190005040 con 0x7fb1981038f0 2024-02-15T22:37:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.921+0000 7fb1967fc700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1981038f0 0x7fb1980707d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb180002a50 tx=0x7fb180004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.922+0000 7fb18f7fe700 1 -- 172.21.15.33:0/2855109938 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb180007cc0 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.922+0000 7fb18f7fe700 1 -- 172.21.15.33:0/2855109938 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb18000f040 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.922+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb198119c90 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.922+0000 7fb18f7fe700 1 -- 172.21.15.33:0/2855109938 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb18000d9c0 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.922+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19811a170 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.923+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1980fc6e0 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.923+0000 7fb18f7fe700 1 -- 172.21.15.33:0/2855109938 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb180009730 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.924+0000 7fb18f7fe700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1840692a0 0x7fb18406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.924+0000 7fb18f7fe700 1 -- 172.21.15.33:0/2855109938 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb180086b40 con 0x7fb1981038f0 2024-02-15T22:37:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.924+0000 7fb196ffd700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1840692a0 0x7fb18406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:37:59.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.924+0000 7fb196ffd700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1840692a0 0x7fb18406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb190004560 tx=0x7fb190009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:37:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:37:59.928+0000 7fb18f7fe700 1 -- 172.21.15.33:0/2855109938 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb1800531b0 con 0x7fb1981038f0 2024-02-15T22:38:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.165+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb19804bed0 con 0x7fb1981038f0 2024-02-15T22:38:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.165+0000 7fb18f7fe700 1 -- 172.21.15.33:0/2855109938 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb1800567d0 con 0x7fb1981038f0 2024-02-15T22:38:00.166 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:00.166 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1840692a0 msgr2=0x7fb18406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1840692a0 0x7fb18406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb190004560 tx=0x7fb190009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1981038f0 msgr2=0x7fb1980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1981038f0 0x7fb1980707d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb180002a50 tx=0x7fb180004600 comp rx=0 tx=0).stop 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 shutdown_connections 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1840692a0 0x7fb18406b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb198102f50 0x7fb198070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 --2- 172.21.15.33:0/2855109938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1981038f0 0x7fb1980707d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 >> 172.21.15.33:0/2855109938 conn(0x7fb1980f8ae0 msgr2=0x7fb1980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 shutdown_connections 2024-02-15T22:38:00.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:00.167+0000 7fb19d948700 1 -- 172.21.15.33:0/2855109938 wait complete. 2024-02-15T22:38:00.823 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-15T22:38:00.824 INFO:tasks.cephadm:Setup complete, yielding 2024-02-15T22:38:00.824 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:38:00.833 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-02-15T22:38:00.834 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:38:00.846 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:38:00.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-15T22:38:01.110 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:01.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:00 smithi033 ceph-mon[29033]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:01.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:00 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2855109938' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T22:38:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:00 smithi082 ceph-mon[37153]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:01.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:00 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2855109938' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T22:38:02.203 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:02.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:02.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.743+0000 7fe32c73e700 1 -- 172.21.15.33:0/2771035676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fcef0 msgr2=0x7fe3240fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:02.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.743+0000 7fe32c73e700 1 --2- 172.21.15.33:0/2771035676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fcef0 0x7fe3240fd320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe314004940 tx=0x7fe314009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:02.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.743+0000 7fe32c73e700 1 -- 172.21.15.33:0/2771035676 shutdown_connections 2024-02-15T22:38:02.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.743+0000 7fe32c73e700 1 --2- 172.21.15.33:0/2771035676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3240fe0e0 0x7fe3240fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:02.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.743+0000 7fe32c73e700 1 --2- 172.21.15.33:0/2771035676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fcef0 0x7fe3240fd320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:02.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.743+0000 7fe32c73e700 1 -- 172.21.15.33:0/2771035676 >> 172.21.15.33:0/2771035676 conn(0x7fe3240f8620 msgr2=0x7fe3240faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 -- 172.21.15.33:0/2771035676 shutdown_connections 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 -- 172.21.15.33:0/2771035676 wait complete. 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 Processor -- start 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 -- start start 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3240fcef0 0x7fe32410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fe0e0 0x7fe32410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32410e4b0 con 0x7fe3240fe0e0 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe32c73e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32410ed50 con 0x7fe3240fcef0 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.744+0000 7fe329cd9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fe0e0 0x7fe32410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe329cd9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fe0e0 0x7fe32410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49444/0 (socket says 172.21.15.33:49444) 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe329cd9700 1 -- 172.21.15.33:0/1049420397 learned_addr learned my addr 172.21.15.33:0/1049420397 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe32a4da700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3240fcef0 0x7fe32410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe329cd9700 1 -- 172.21.15.33:0/1049420397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3240fcef0 msgr2=0x7fe32410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe329cd9700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3240fcef0 0x7fe32410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe329cd9700 1 -- 172.21.15.33:0/1049420397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314005040 con 0x7fe3240fe0e0 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe329cd9700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fe0e0 0x7fe32410deb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe320002a50 tx=0x7fe3200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe31affd700 1 -- 172.21.15.33:0/1049420397 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe320007cc0 con 0x7fe3240fe0e0 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe31affd700 1 -- 172.21.15.33:0/1049420397 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe32000f040 con 0x7fe3240fe0e0 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32410f030 con 0x7fe3240fe0e0 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe31affd700 1 -- 172.21.15.33:0/1049420397 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32000da30 con 0x7fe3240fe0e0 2024-02-15T22:38:02.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.745+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32410f570 con 0x7fe3240fe0e0 2024-02-15T22:38:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.746+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32404bed0 con 0x7fe3240fe0e0 2024-02-15T22:38:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.747+0000 7fe31affd700 1 -- 172.21.15.33:0/1049420397 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe32000db90 con 0x7fe3240fe0e0 2024-02-15T22:38:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.747+0000 7fe31affd700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe3100692a0 0x7fe31006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.747+0000 7fe31affd700 1 -- 172.21.15.33:0/1049420397 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe320086b20 con 0x7fe3240fe0e0 2024-02-15T22:38:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.747+0000 7fe32a4da700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe3100692a0 0x7fe31006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.747+0000 7fe32a4da700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe3100692a0 0x7fe31006b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe314004890 tx=0x7fe314009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:02.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.751+0000 7fe31affd700 1 -- 172.21.15.33:0/1049420397 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe320056c20 con 0x7fe3240fe0e0 2024-02-15T22:38:02.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.943+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fe324105a30 con 0x7fe3240fe0e0 2024-02-15T22:38:02.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.948+0000 7fe31affd700 1 -- 172.21.15.33:0/1049420397 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe3200567b0 con 0x7fe3240fe0e0 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe3100692a0 msgr2=0x7fe31006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe3100692a0 0x7fe31006b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe314004890 tx=0x7fe314009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fe0e0 msgr2=0x7fe32410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fe0e0 0x7fe32410deb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe320002a50 tx=0x7fe3200046b0 comp rx=0 tx=0).stop 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 shutdown_connections 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe3100692a0 0x7fe31006b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3240fcef0 0x7fe32410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 --2- 172.21.15.33:0/1049420397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240fe0e0 0x7fe32410deb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 >> 172.21.15.33:0/1049420397 conn(0x7fe3240f8620 msgr2=0x7fe3241013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 shutdown_connections 2024-02-15T22:38:02.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:02.950+0000 7fe32c73e700 1 -- 172.21.15.33:0/1049420397 wait complete. 2024-02-15T22:38:03.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:02 smithi033 ceph-mon[29033]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:03.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:02 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1049420397' entity='client.admin' 2024-02-15T22:38:03.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:02 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:02 smithi082 ceph-mon[37153]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:02 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1049420397' entity='client.admin' 2024-02-15T22:38:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:02 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:03.847 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:38:03.858 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-15T22:38:03.858 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:38:03.869 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:38:03.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph orch status' 2024-02-15T22:38:04.133 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:04 smithi033 ceph-mon[29033]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:04 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:05.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:04 smithi082 ceph-mon[37153]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:05.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:05.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:04 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.846+0000 7f454d6e6700 1 -- 172.21.15.33:0/4165872121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 msgr2=0x7f45480fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.846+0000 7f454d6e6700 1 --2- 172.21.15.33:0/4165872121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f45480fd420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f453c004940 tx=0x7f453c009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 -- 172.21.15.33:0/4165872121 shutdown_connections 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 --2- 172.21.15.33:0/4165872121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f45480fd420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 --2- 172.21.15.33:0/4165872121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45480fbe40 0x7f45480fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 -- 172.21.15.33:0/4165872121 >> 172.21.15.33:0/4165872121 conn(0x7f45480f7520 msgr2=0x7f45480f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 -- 172.21.15.33:0/4165872121 shutdown_connections 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 -- 172.21.15.33:0/4165872121 wait complete. 2024-02-15T22:38:05.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 Processor -- start 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.847+0000 7f454d6e6700 1 -- start start 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f454d6e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45480fbe40 0x7f454810d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f454d6e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f454810de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f454d6e6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454810e480 con 0x7f45480fcfb0 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f454d6e6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454810ed20 con 0x7f45480fbe40 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f45467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f454810de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f45467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f454810de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49472/0 (socket says 172.21.15.33:49472) 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f45467fc700 1 -- 172.21.15.33:0/261619981 learned_addr learned my addr 172.21.15.33:0/261619981 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f4546ffd700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45480fbe40 0x7f454810d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f45467fc700 1 -- 172.21.15.33:0/261619981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45480fbe40 msgr2=0x7f454810d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f45467fc700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45480fbe40 0x7f454810d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f45467fc700 1 -- 172.21.15.33:0/261619981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c005040 con 0x7f45480fcfb0 2024-02-15T22:38:05.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f45467fc700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f454810de80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f453c0093b0 tx=0x7f453c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:05.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f452f7fe700 1 -- 172.21.15.33:0/261619981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453c00e040 con 0x7f45480fcfb0 2024-02-15T22:38:05.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f452f7fe700 1 -- 172.21.15.33:0/261619981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f453c00bcc0 con 0x7f45480fcfb0 2024-02-15T22:38:05.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f452f7fe700 1 -- 172.21.15.33:0/261619981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453c01c630 con 0x7f45480fcfb0 2024-02-15T22:38:05.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454810efa0 con 0x7f45480fcfb0 2024-02-15T22:38:05.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.848+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454810f4e0 con 0x7f45480fcfb0 2024-02-15T22:38:05.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.849+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454804bed0 con 0x7f45480fcfb0 2024-02-15T22:38:05.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.850+0000 7f452f7fe700 1 -- 172.21.15.33:0/261619981 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f453c0139f0 con 0x7f45480fcfb0 2024-02-15T22:38:05.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.850+0000 7f452f7fe700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f45300692a0 0x7f453006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:05.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.850+0000 7f452f7fe700 1 -- 172.21.15.33:0/261619981 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f453c0881e0 con 0x7f45480fcfb0 2024-02-15T22:38:05.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.850+0000 7f4546ffd700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f45300692a0 0x7f453006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:05.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.851+0000 7f4546ffd700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f45300692a0 0x7f453006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4538007fd0 tx=0x7f4538009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:05.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:05.855+0000 7f452f7fe700 1 -- 172.21.15.33:0/261619981 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f453c058380 con 0x7f45480fcfb0 2024-02-15T22:38:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.072+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f454810f900 con 0x7f45300692a0 2024-02-15T22:38:06.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.073+0000 7f452f7fe700 1 -- 172.21.15.33:0/261619981 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f454810f900 con 0x7f45300692a0 2024-02-15T22:38:06.073 INFO:teuthology.orchestra.run.smithi033.stdout:Backend: cephadm 2024-02-15T22:38:06.073 INFO:teuthology.orchestra.run.smithi033.stdout:Available: Yes 2024-02-15T22:38:06.073 INFO:teuthology.orchestra.run.smithi033.stdout:Paused: No 2024-02-15T22:38:06.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f45300692a0 msgr2=0x7f453006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:06.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f45300692a0 0x7f453006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4538007fd0 tx=0x7f4538009040 comp rx=0 tx=0).stop 2024-02-15T22:38:06.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 msgr2=0x7f454810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:06.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f454810de80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f453c0093b0 tx=0x7f453c009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:06.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 shutdown_connections 2024-02-15T22:38:06.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f45300692a0 0x7f453006b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:06.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45480fbe40 0x7f454810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:06.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 --2- 172.21.15.33:0/261619981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45480fcfb0 0x7f454810de80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:06.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 >> 172.21.15.33:0/261619981 conn(0x7f45480f7520 msgr2=0x7f4548065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:06.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 shutdown_connections 2024-02-15T22:38:06.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:06.075+0000 7f454d6e6700 1 -- 172.21.15.33:0/261619981 wait complete. 2024-02-15T22:38:06.751 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-15T22:38:07.013 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:07.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:06 smithi033 ceph-mon[29033]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:07.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:06 smithi033 ceph-mon[29033]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:06 smithi082 ceph-mon[37153]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:06 smithi082 ceph-mon[37153]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/231918031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fbe40 msgr2=0x7fc3e40fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/231918031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fbe40 0x7fc3e40fc250 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004940 tx=0x7fc3dc009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/231918031 shutdown_connections 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/231918031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e40fcfb0 0x7fc3e40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/231918031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fbe40 0x7fc3e40fc250 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/231918031 >> 172.21.15.33:0/231918031 conn(0x7fc3e40f74e0 msgr2=0x7fc3e40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/231918031 shutdown_connections 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.685+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/231918031 wait complete. 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ec3a2700 1 Processor -- start 2024-02-15T22:38:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ec3a2700 1 -- start start 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ec3a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e40fbe40 0x7fc3e410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ec3a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fcfb0 0x7fc3e410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ec3a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e410e500 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ec3a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e410ed40 con 0x7fc3e40fbe40 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3e993d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fcfb0 0x7fc3e410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3e993d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fcfb0 0x7fc3e410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45682/0 (socket says 172.21.15.33:45682) 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3e993d700 1 -- 172.21.15.33:0/4253176154 learned_addr learned my addr 172.21.15.33:0/4253176154 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ea13e700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e40fbe40 0x7fc3e410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3e993d700 1 -- 172.21.15.33:0/4253176154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e40fbe40 msgr2=0x7fc3e410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3e993d700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e40fbe40 0x7fc3e410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3e993d700 1 -- 172.21.15.33:0/4253176154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc005040 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3ea13e700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e40fbe40 0x7fc3e410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:38:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.686+0000 7fc3e993d700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fcfb0 0x7fc3e410de70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800b790 tx=0x7fc3d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:08.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.687+0000 7fc3e2ffd700 1 -- 172.21.15.33:0/4253176154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d800f770 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.687+0000 7fc3e2ffd700 1 -- 172.21.15.33:0/4253176154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3d800fda0 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.687+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e410f020 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.687+0000 7fc3e2ffd700 1 -- 172.21.15.33:0/4253176154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d800d310 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.687+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e410f510 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.688+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e404bed0 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.688+0000 7fc3e2ffd700 1 -- 172.21.15.33:0/4253176154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fc3d8010420 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.689+0000 7fc3e2ffd700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc3cc0692a0 0x7fc3cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:08.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.689+0000 7fc3e2ffd700 1 -- 172.21.15.33:0/4253176154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc3d8086e60 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.689+0000 7fc3ea13e700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc3cc0692a0 0x7fc3cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:08.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.689+0000 7fc3ea13e700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc3cc0692a0 0x7fc3cc06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004f90 tx=0x7fc3dc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:08.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.693+0000 7fc3e2ffd700 1 -- 172.21.15.33:0/4253176154 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc3d8056f60 con 0x7fc3e40fcfb0 2024-02-15T22:38:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.894+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3e410fac0 con 0x7fc3cc0692a0 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.902+0000 7fc3e2ffd700 1 -- 172.21.15.33:0/4253176154 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7fc3e410fac0 con 0x7fc3cc0692a0 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (3m) 2m ago 5m 26.2M - 0.25.0 c8568f914cd2 229a38709f4a 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (5m) 2m ago 5m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (4m) 68s ago 4m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (3m) 2m ago 5m 76.2M - 9.4.7 954c08fa6188 4e1a6363851b 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:9283 running (6m) 2m ago 6m 470M - 17.2.7-509-g9aa52330 61c0ec9cd187 4de1acba28ab 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283 running (4m) 68s ago 4m 434M - 17.2.7-509-g9aa52330 61c0ec9cd187 7c9a30ed03d3 2024-02-15T22:38:08.903 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 2m ago 7m 42.2M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (4m) 68s ago 4m 38.1M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (5m) 2m ago 5m 16.2M - 1.5.0 0da6a335fe13 edf3c832a7c2 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (4m) 68s ago 4m 16.9M - 1.5.0 0da6a335fe13 e8b1514d760c 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 2m ago 3m 36.4M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 2m ago 2m 35.9M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 2m ago 2m 35.6M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (2m) 68s ago 2m 42.1M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (99s) 68s ago 98s 39.9M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (72s) 68s ago 72s 12.1M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:38:08.904 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (3m) 2m ago 4m 39.5M - 2.43.0 a07b618ecd1d fcda9c48f34e 2024-02-15T22:38:08.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc3cc0692a0 msgr2=0x7fc3cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:08.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc3cc0692a0 0x7fc3cc06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004f90 tx=0x7fc3dc009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:08.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fcfb0 msgr2=0x7fc3e410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fcfb0 0x7fc3e410de70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800b790 tx=0x7fc3d8009250 comp rx=0 tx=0).stop 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 shutdown_connections 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc3cc0692a0 0x7fc3cc06b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e40fbe40 0x7fc3e410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 --2- 172.21.15.33:0/4253176154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e40fcfb0 0x7fc3e410de70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 >> 172.21.15.33:0/4253176154 conn(0x7fc3e40f74e0 msgr2=0x7fc3e40656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 shutdown_connections 2024-02-15T22:38:08.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:08.905+0000 7fc3ec3a2700 1 -- 172.21.15.33:0/4253176154 wait complete. 2024-02-15T22:38:09.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:08 smithi033 ceph-mon[29033]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:09.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:08 smithi082 ceph-mon[37153]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:09.584 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-15T22:38:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:10.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:09 smithi082 ceph-mon[37153]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:10.201 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:09 smithi033 ceph-mon[29033]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:11.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:10 smithi082 ceph-mon[37153]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:11.148 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:10 smithi033 ceph-mon[29033]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:11.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 -- 172.21.15.33:0/3803675352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fe0e0 msgr2=0x7fe1780fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:11.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 --2- 172.21.15.33:0/3803675352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fe0e0 0x7fe1780fe550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe16c004940 tx=0x7fe16c009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:11.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 -- 172.21.15.33:0/3803675352 shutdown_connections 2024-02-15T22:38:11.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 --2- 172.21.15.33:0/3803675352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fe0e0 0x7fe1780fe550 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:11.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 --2- 172.21.15.33:0/3803675352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1780fcef0 0x7fe1780fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 -- 172.21.15.33:0/3803675352 >> 172.21.15.33:0/3803675352 conn(0x7fe1780f8620 msgr2=0x7fe1780faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 -- 172.21.15.33:0/3803675352 shutdown_connections 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 -- 172.21.15.33:0/3803675352 wait complete. 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 Processor -- start 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.513+0000 7fe17f126700 1 -- start start 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17f126700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fcef0 0x7fe178071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17f126700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1780fe0e0 0x7fe1780702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17f126700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780708e0 con 0x7fe1780fcef0 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17f126700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178070a50 con 0x7fe1780fe0e0 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17cec2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fcef0 0x7fe178071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17cec2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fcef0 0x7fe178071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45706/0 (socket says 172.21.15.33:45706) 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17cec2700 1 -- 172.21.15.33:0/3353527391 learned_addr learned my addr 172.21.15.33:0/3353527391 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe177fff700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1780fe0e0 0x7fe1780702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17cec2700 1 -- 172.21.15.33:0/3353527391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1780fe0e0 msgr2=0x7fe1780702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:11.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17cec2700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1780fe0e0 0x7fe1780702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17cec2700 1 -- 172.21.15.33:0/3353527391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c005040 con 0x7fe1780fcef0 2024-02-15T22:38:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.514+0000 7fe17cec2700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fcef0 0x7fe178071e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe170001ce0 tx=0x7fe170009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.515+0000 7fe1757fa700 1 -- 172.21.15.33:0/3353527391 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe170007b30 con 0x7fe1780fcef0 2024-02-15T22:38:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.515+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe178070d30 con 0x7fe1780fcef0 2024-02-15T22:38:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.515+0000 7fe1757fa700 1 -- 172.21.15.33:0/3353527391 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe17000f040 con 0x7fe1780fcef0 2024-02-15T22:38:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.515+0000 7fe1757fa700 1 -- 172.21.15.33:0/3353527391 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1700096d0 con 0x7fe1780fcef0 2024-02-15T22:38:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.515+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1781159a0 con 0x7fe1780fcef0 2024-02-15T22:38:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.516+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17804bed0 con 0x7fe1780fcef0 2024-02-15T22:38:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.516+0000 7fe1757fa700 1 -- 172.21.15.33:0/3353527391 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe170007c90 con 0x7fe1780fcef0 2024-02-15T22:38:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.516+0000 7fe1757fa700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe1600692a0 0x7fe16006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.516+0000 7fe1757fa700 1 -- 172.21.15.33:0/3353527391 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe170086840 con 0x7fe1780fcef0 2024-02-15T22:38:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.516+0000 7fe177fff700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe1600692a0 0x7fe16006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.517+0000 7fe177fff700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe1600692a0 0x7fe16006b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00b3b0 tx=0x7fe16c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.521+0000 7fe1757fa700 1 -- 172.21.15.33:0/3353527391 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe17004cbd0 con 0x7fe1780fcef0 2024-02-15T22:38:11.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.720+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe178102ac0 con 0x7fe1600692a0 2024-02-15T22:38:11.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.724+0000 7fe1757fa700 1 -- 172.21.15.33:0/3353527391 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7fe178102ac0 con 0x7fe1600692a0 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:crash 2/2 2m ago 6m * 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:mgr 2/2 2m ago 6m count:2 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:mon 2/2 2m ago 5m smithi033:172.21.15.33=smithi033;smithi082:172.21.15.82=smithi082;count:2 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:osd 6 2m ago - 2024-02-15T22:38:11.725 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.726+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe1600692a0 msgr2=0x7fe16006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.726+0000 7fe17f126700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe1600692a0 0x7fe16006b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00b3b0 tx=0x7fe16c009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.726+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fcef0 msgr2=0x7fe178071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.726+0000 7fe17f126700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fcef0 0x7fe178071e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe170001ce0 tx=0x7fe170009e60 comp rx=0 tx=0).stop 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.727+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 shutdown_connections 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.727+0000 7fe17f126700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe1600692a0 0x7fe16006b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.727+0000 7fe17f126700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1780fcef0 0x7fe178071e60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.727+0000 7fe17f126700 1 --2- 172.21.15.33:0/3353527391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1780fe0e0 0x7fe1780702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:11.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.727+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 >> 172.21.15.33:0/3353527391 conn(0x7fe1780f8620 msgr2=0x7fe1781013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:11.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.727+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 shutdown_connections 2024-02-15T22:38:11.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:11.727+0000 7fe17f126700 1 -- 172.21.15.33:0/3353527391 wait complete. 2024-02-15T22:38:12.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-15T22:38:12.607 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:13.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:12 smithi033 ceph-mon[29033]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:13.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:12 smithi033 ceph-mon[29033]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:13.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:12 smithi082 ceph-mon[37153]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:13.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:12 smithi082 ceph-mon[37153]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 -- 172.21.15.33:0/4121916591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fcef0 msgr2=0x7f98a80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 --2- 172.21.15.33:0/4121916591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fcef0 0x7f98a80fd320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9898004940 tx=0x7f9898009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 -- 172.21.15.33:0/4121916591 shutdown_connections 2024-02-15T22:38:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 --2- 172.21.15.33:0/4121916591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a80fe0e0 0x7f98a80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 --2- 172.21.15.33:0/4121916591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fcef0 0x7f98a80fd320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 -- 172.21.15.33:0/4121916591 >> 172.21.15.33:0/4121916591 conn(0x7f98a80f8620 msgr2=0x7f98a80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 -- 172.21.15.33:0/4121916591 shutdown_connections 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 -- 172.21.15.33:0/4121916591 wait complete. 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 Processor -- start 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.270+0000 7f98ae41a700 1 -- start start 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98ae41a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a80fcef0 0x7f98a810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98ae41a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fe0e0 0x7f98a810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98ae41a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a810e4b0 con 0x7f98a80fe0e0 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98ae41a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a810ed50 con 0x7f98a80fcef0 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fe0e0 0x7f98a810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fe0e0 0x7f98a810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45724/0 (socket says 172.21.15.33:45724) 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a77fe700 1 -- 172.21.15.33:0/2679103492 learned_addr learned my addr 172.21.15.33:0/2679103492 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a7fff700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a80fcef0 0x7f98a810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:14.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a77fe700 1 -- 172.21.15.33:0/2679103492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a80fcef0 msgr2=0x7f98a810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a77fe700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a80fcef0 0x7f98a810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a77fe700 1 -- 172.21.15.33:0/2679103492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898005040 con 0x7f98a80fe0e0 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a77fe700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fe0e0 0x7f98a810deb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f989c002a50 tx=0x7f989c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a4ff9700 1 -- 172.21.15.33:0/2679103492 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989c007cc0 con 0x7f98a80fe0e0 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a810f030 con 0x7f98a80fe0e0 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a4ff9700 1 -- 172.21.15.33:0/2679103492 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f989c00f040 con 0x7f98a80fe0e0 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98a4ff9700 1 -- 172.21.15.33:0/2679103492 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989c00da30 con 0x7f98a80fe0e0 2024-02-15T22:38:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.271+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a810f570 con 0x7f98a80fe0e0 2024-02-15T22:38:14.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.272+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a804bed0 con 0x7f98a80fe0e0 2024-02-15T22:38:14.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.273+0000 7f98a4ff9700 1 -- 172.21.15.33:0/2679103492 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f989c00db90 con 0x7f98a80fe0e0 2024-02-15T22:38:14.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.273+0000 7f98a4ff9700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f98900692b0 0x7f989006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:14.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.273+0000 7f98a4ff9700 1 -- 172.21.15.33:0/2679103492 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f989c086be0 con 0x7f98a80fe0e0 2024-02-15T22:38:14.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.273+0000 7f98a7fff700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f98900692b0 0x7f989006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:14.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.274+0000 7f98a7fff700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f98900692b0 0x7f989006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f989800b3b0 tx=0x7f9898009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:14.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.278+0000 7f98a4ff9700 1 -- 172.21.15.33:0/2679103492 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f989c056c60 con 0x7f98a80fe0e0 2024-02-15T22:38:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.477+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f98a810f9c0 con 0x7f98900692b0 2024-02-15T22:38:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.478+0000 7f98a4ff9700 1 -- 172.21.15.33:0/2679103492 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f98a810f9c0 con 0x7f98900692b0 2024-02-15T22:38:14.479 INFO:teuthology.orchestra.run.smithi033.stdout:HOST ADDR LABELS STATUS 2024-02-15T22:38:14.479 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 172.21.15.33 2024-02-15T22:38:14.479 INFO:teuthology.orchestra.run.smithi033.stdout:smithi082 172.21.15.82 2024-02-15T22:38:14.479 INFO:teuthology.orchestra.run.smithi033.stdout:2 hosts in cluster 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f98900692b0 msgr2=0x7f989006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f98900692b0 0x7f989006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f989800b3b0 tx=0x7f9898009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fe0e0 msgr2=0x7f98a810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fe0e0 0x7f98a810deb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f989c002a50 tx=0x7f989c0046b0 comp rx=0 tx=0).stop 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 shutdown_connections 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f98900692b0 0x7f989006b760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a80fcef0 0x7f98a810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:14.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 --2- 172.21.15.33:0/2679103492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98a80fe0e0 0x7f98a810deb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:14.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.480+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 >> 172.21.15.33:0/2679103492 conn(0x7f98a80f8620 msgr2=0x7f98a81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:14.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.481+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 shutdown_connections 2024-02-15T22:38:14.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:14.481+0000 7f98ae41a700 1 -- 172.21.15.33:0/2679103492 wait complete. 2024-02-15T22:38:15.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:14 smithi033 ceph-mon[29033]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:15.078 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-15T22:38:15.336 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:15.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:14 smithi082 ceph-mon[37153]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:16.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:15 smithi033 ceph-mon[29033]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:16.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:15 smithi082 ceph-mon[37153]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:17.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:16 smithi033 ceph-mon[29033]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:17.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 -- 172.21.15.33:0/2548511036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 msgr2=0x7ff65c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2548511036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c0fd320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff64c004940 tx=0x7ff64c009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 -- 172.21.15.33:0/2548511036 shutdown_connections 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2548511036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65c0fe0e0 0x7ff65c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2548511036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c0fd320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 -- 172.21.15.33:0/2548511036 >> 172.21.15.33:0/2548511036 conn(0x7ff65c0f8620 msgr2=0x7ff65c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 -- 172.21.15.33:0/2548511036 shutdown_connections 2024-02-15T22:38:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.072+0000 7ff6610a0700 1 -- 172.21.15.33:0/2548511036 wait complete. 2024-02-15T22:38:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff6610a0700 1 Processor -- start 2024-02-15T22:38:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff6610a0700 1 -- start start 2024-02-15T22:38:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff6610a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c10fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff6610a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65c0fe0e0 0x7ff65c110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff6610a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c110650 con 0x7ff65c0fcef0 2024-02-15T22:38:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff6610a0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c110ef0 con 0x7ff65c0fe0e0 2024-02-15T22:38:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff65ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c10fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff65ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c10fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44750/0 (socket says 172.21.15.33:44750) 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff65ad9d700 1 -- 172.21.15.33:0/2496920862 learned_addr learned my addr 172.21.15.33:0/2496920862 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.073+0000 7ff65a59c700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65c0fe0e0 0x7ff65c110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff65ad9d700 1 -- 172.21.15.33:0/2496920862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65c0fe0e0 msgr2=0x7ff65c110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff65ad9d700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65c0fe0e0 0x7ff65c110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff65ad9d700 1 -- 172.21.15.33:0/2496920862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c005040 con 0x7ff65c0fcef0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff65ad9d700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c10fb10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00b3b0 tx=0x7ff64c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff6437fe700 1 -- 172.21.15.33:0/2496920862 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64c00e040 con 0x7ff65c0fcef0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c111170 con 0x7ff65c0fcef0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff6437fe700 1 -- 172.21.15.33:0/2496920862 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff64c00bcc0 con 0x7ff65c0fcef0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff6437fe700 1 -- 172.21.15.33:0/2496920862 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64c01c630 con 0x7ff65c0fcef0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.074+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c1116b0 con 0x7ff65c0fcef0 2024-02-15T22:38:17.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.075+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c102210 con 0x7ff65c0fcef0 2024-02-15T22:38:17.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.075+0000 7ff6437fe700 1 -- 172.21.15.33:0/2496920862 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7ff64c013980 con 0x7ff65c0fcef0 2024-02-15T22:38:17.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.076+0000 7ff6437fe700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff6440692a0 0x7ff64406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:17.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.076+0000 7ff6437fe700 1 -- 172.21.15.33:0/2496920862 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff64c088300 con 0x7ff65c0fcef0 2024-02-15T22:38:17.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.076+0000 7ff65a59c700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff6440692a0 0x7ff64406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:17.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.076+0000 7ff65a59c700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff6440692a0 0x7ff64406b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff650004f40 tx=0x7ff65000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:17.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.080+0000 7ff6437fe700 1 -- 172.21.15.33:0/2496920862 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff64c0584b0 con 0x7ff65c0fcef0 2024-02-15T22:38:17.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.278+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff65c02b310 con 0x7ff6440692a0 2024-02-15T22:38:17.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.280+0000 7ff6437fe700 1 -- 172.21.15.33:0/2496920862 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7ff65c02b310 con 0x7ff6440692a0 2024-02-15T22:38:17.280 INFO:teuthology.orchestra.run.smithi033.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-15T22:38:17.281 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-02-15T22:38:17.281 INFO:teuthology.orchestra.run.smithi033.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 72s ago Has a FileSystem, LVM detected 2024-02-15T22:38:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff6440692a0 msgr2=0x7ff64406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff6440692a0 0x7ff64406b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff650004f40 tx=0x7ff65000b040 comp rx=0 tx=0).stop 2024-02-15T22:38:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 msgr2=0x7ff65c10fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c10fb10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00b3b0 tx=0x7ff64c009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 shutdown_connections 2024-02-15T22:38:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff6440692a0 0x7ff64406b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff65c0fcef0 0x7ff65c10fb10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 --2- 172.21.15.33:0/2496920862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65c0fe0e0 0x7ff65c110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 >> 172.21.15.33:0/2496920862 conn(0x7ff65c0f8620 msgr2=0x7ff65c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 shutdown_connections 2024-02-15T22:38:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:17.282+0000 7ff6610a0700 1 -- 172.21.15.33:0/2496920862 wait complete. 2024-02-15T22:38:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:16 smithi082 ceph-mon[37153]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:18.068 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:38:18.078 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:38:18.078 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-15T22:38:18.337 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:19.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:18 smithi033 ceph-mon[29033]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:19.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:18 smithi033 ceph-mon[29033]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:19.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:18 smithi082 ceph-mon[37153]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:19.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:18 smithi082 ceph-mon[37153]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:19.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 -- 172.21.15.33:0/2245046239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fbe40 msgr2=0x7fc5e40fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:19.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 --2- 172.21.15.33:0/2245046239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fbe40 0x7fc5e40fc250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0004940 tx=0x7fc5e0009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:19.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 -- 172.21.15.33:0/2245046239 shutdown_connections 2024-02-15T22:38:19.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 --2- 172.21.15.33:0/2245046239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e40fcfb0 0x7fc5e40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:19.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 --2- 172.21.15.33:0/2245046239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fbe40 0x7fc5e40fc250 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:19.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 -- 172.21.15.33:0/2245046239 >> 172.21.15.33:0/2245046239 conn(0x7fc5e40f7520 msgr2=0x7fc5e40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:19.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 -- 172.21.15.33:0/2245046239 shutdown_connections 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.937+0000 7fc5eb664700 1 -- 172.21.15.33:0/2245046239 wait complete. 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5eb664700 1 Processor -- start 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5eb664700 1 -- start start 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5eb664700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e40fbe40 0x7fc5e410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5eb664700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fcfb0 0x7fc5e410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5eb664700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e410e500 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5eb664700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e410ed40 con 0x7fc5e40fbe40 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5e8bff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fcfb0 0x7fc5e410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5e8bff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fcfb0 0x7fc5e410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44754/0 (socket says 172.21.15.33:44754) 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5e8bff700 1 -- 172.21.15.33:0/491152356 learned_addr learned my addr 172.21.15.33:0/491152356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5e9400700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e40fbe40 0x7fc5e410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5e8bff700 1 -- 172.21.15.33:0/491152356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e40fbe40 msgr2=0x7fc5e410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5e8bff700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e40fbe40 0x7fc5e410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.938+0000 7fc5e8bff700 1 -- 172.21.15.33:0/491152356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0005040 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.939+0000 7fc5e8bff700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fcfb0 0x7fc5e410de70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00bbb0 tx=0x7fc5dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:19.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.939+0000 7fc5d9ffb700 1 -- 172.21.15.33:0/491152356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5dc0092e0 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.939+0000 7fc5d9ffb700 1 -- 172.21.15.33:0/491152356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5dc00cb20 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.939+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e410f020 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.939+0000 7fc5d9ffb700 1 -- 172.21.15.33:0/491152356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5dc015d70 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.939+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e410f560 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.940+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e404bed0 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.940+0000 7fc5d9ffb700 1 -- 172.21.15.33:0/491152356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fc5dc012070 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.941+0000 7fc5d9ffb700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc5d00692b0 0x7fc5d006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:19.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.941+0000 7fc5d9ffb700 1 -- 172.21.15.33:0/491152356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc5dc086ab0 con 0x7fc5e40fcfb0 2024-02-15T22:38:19.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.941+0000 7fc5e9400700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc5d00692b0 0x7fc5d006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:19.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.941+0000 7fc5e9400700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc5d00692b0 0x7fc5d006b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000b7a0 tx=0x7fc5e0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:19.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:19.945+0000 7fc5d9ffb700 1 -- 172.21.15.33:0/491152356 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc5dc056b30 con 0x7fc5e40fcfb0 2024-02-15T22:38:20.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:20.164+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e410fa40 con 0x7fc5d00692b0 2024-02-15T22:38:21.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:20 smithi033 ceph-mon[29033]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:21.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:20 smithi033 ceph-mon[29033]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:21.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:20 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T22:38:21.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:20 smithi082 ceph-mon[37153]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:21.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:20 smithi082 ceph-mon[37153]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:38:21.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:20 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T22:38:22.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.000+0000 7fc5d9ffb700 1 -- 172.21.15.33:0/491152356 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc5e410fa40 con 0x7fc5d00692b0 2024-02-15T22:38:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.004+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc5d00692b0 msgr2=0x7fc5d006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc5d00692b0 0x7fc5d006b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000b7a0 tx=0x7fc5e0009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fcfb0 msgr2=0x7fc5e410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fcfb0 0x7fc5e410de70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00bbb0 tx=0x7fc5dc009840 comp rx=0 tx=0).stop 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 shutdown_connections 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fc5d00692b0 0x7fc5d006b760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e40fbe40 0x7fc5e410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 --2- 172.21.15.33:0/491152356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40fcfb0 0x7fc5e410de70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 >> 172.21.15.33:0/491152356 conn(0x7fc5e40f7520 msgr2=0x7fc5e4065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 shutdown_connections 2024-02-15T22:38:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:22.005+0000 7fc5eb664700 1 -- 172.21.15.33:0/491152356 wait complete. 2024-02-15T22:38:22.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:21 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T22:38:22.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:21 smithi033 ceph-mon[29033]: osdmap e42: 6 total, 6 up, 6 in 2024-02-15T22:38:22.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:21 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:38:22.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:21 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[29029]: 2024-02-15T22:38:21.981+0000 7f08f46f5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:38:22.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:21 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T22:38:22.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:21 smithi082 ceph-mon[37153]: osdmap e42: 6 total, 6 up, 6 in 2024-02-15T22:38:22.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:21 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:38:22.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: pgmap v175: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: osdmap e43: 6 total, 6 up, 6 in 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T22:38:23.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: osdmap e44: 6 total, 6 up, 6 in 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: fsmap cephfs:0 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: Saving service mds.cephfs spec with placement count:4 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:23.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:22 smithi033 ceph-mon[29033]: Deploying daemon mds.cephfs.smithi033.ruqork on smithi033 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: pgmap v175: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: osdmap e43: 6 total, 6 up, 6 in 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: osdmap e44: 6 total, 6 up, 6 in 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: fsmap cephfs:0 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: Saving service mds.cephfs spec with placement count:4 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:23.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:23.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:23.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:23.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:23.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:23.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:23.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:22 smithi082 ceph-mon[37153]: Deploying daemon mds.cephfs.smithi033.ruqork on smithi033 2024-02-15T22:38:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:24.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:23 smithi033 ceph-mon[29033]: osdmap e45: 6 total, 6 up, 6 in 2024-02-15T22:38:24.274 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:23 smithi082 ceph-mon[37153]: osdmap e45: 6 total, 6 up, 6 in 2024-02-15T22:38:25.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:24 smithi033 ceph-mon[29033]: pgmap v179: 65 pgs: 4 creating+activating, 16 active+clean, 45 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:25.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:24 smithi033 ceph-mon[29033]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-15T22:38:25.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:24 smithi033 ceph-mon[29033]: osdmap e46: 6 total, 6 up, 6 in 2024-02-15T22:38:25.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:24 smithi082 ceph-mon[37153]: pgmap v179: 65 pgs: 4 creating+activating, 16 active+clean, 45 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:25.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:24 smithi082 ceph-mon[37153]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-15T22:38:25.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:24 smithi082 ceph-mon[37153]: osdmap e46: 6 total, 6 up, 6 in 2024-02-15T22:38:25.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 -- 172.21.15.33:0/2810117856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c40fda20 msgr2=0x7fb5c40ffe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:25.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 --2- 172.21.15.33:0/2810117856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c40fda20 0x7fb5c40ffe00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009ce0 tx=0x7fb5b4004d10 comp rx=0 tx=0).stop 2024-02-15T22:38:25.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 -- 172.21.15.33:0/2810117856 shutdown_connections 2024-02-15T22:38:25.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 --2- 172.21.15.33:0/2810117856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5c4100340 0x7fb5c4102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 --2- 172.21.15.33:0/2810117856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c40fda20 0x7fb5c40ffe00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 -- 172.21.15.33:0/2810117856 >> 172.21.15.33:0/2810117856 conn(0x7fb5c40f7480 msgr2=0x7fb5c40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 -- 172.21.15.33:0/2810117856 shutdown_connections 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 -- 172.21.15.33:0/2810117856 wait complete. 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 Processor -- start 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.971+0000 7fb5cb812700 1 -- start start 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5cb812700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5c40fda20 0x7fb5c410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5cb812700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c4100340 0x7fb5c410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5cb812700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c410e4f0 con 0x7fb5c4100340 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5cb812700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c410ed90 con 0x7fb5c40fda20 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c8dad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c4100340 0x7fb5c410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c8dad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c4100340 0x7fb5c410def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44774/0 (socket says 172.21.15.33:44774) 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c8dad700 1 -- 172.21.15.33:0/3077006420 learned_addr learned my addr 172.21.15.33:0/3077006420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c95ae700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5c40fda20 0x7fb5c410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:25.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c8dad700 1 -- 172.21.15.33:0/3077006420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5c40fda20 msgr2=0x7fb5c410d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c8dad700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5c40fda20 0x7fb5c410d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c8dad700 1 -- 172.21.15.33:0/3077006420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009940 con 0x7fb5c4100340 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c95ae700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5c40fda20 0x7fb5c410d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c8dad700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c4100340 0x7fb5c410def0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c830 tx=0x7fb5b8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c1ffb700 1 -- 172.21.15.33:0/3077006420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b800a760 con 0x7fb5c4100340 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c410f070 con 0x7fb5c4100340 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c1ffb700 1 -- 172.21.15.33:0/3077006420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5b800ad90 con 0x7fb5c4100340 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.972+0000 7fb5c1ffb700 1 -- 172.21.15.33:0/3077006420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b80113a0 con 0x7fb5c4100340 2024-02-15T22:38:25.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.973+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c410f5b0 con 0x7fb5c4100340 2024-02-15T22:38:25.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.973+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c41079f0 con 0x7fb5c4100340 2024-02-15T22:38:25.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.974+0000 7fb5c1ffb700 1 -- 172.21.15.33:0/3077006420 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb5b8012400 con 0x7fb5c4100340 2024-02-15T22:38:25.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.975+0000 7fb5c1ffb700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb5ac0692a0 0x7fb5ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:25.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.975+0000 7fb5c1ffb700 1 -- 172.21.15.33:0/3077006420 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb5b8087cf0 con 0x7fb5c4100340 2024-02-15T22:38:25.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.975+0000 7fb5c95ae700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb5ac0692a0 0x7fb5ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:25.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.975+0000 7fb5c95ae700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb5ac0692a0 0x7fb5ac06b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4003400 tx=0x7fb5b4004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:25.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:25.979+0000 7fb5c1ffb700 1 -- 172.21.15.33:0/3077006420 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb5b8057a90 con 0x7fb5c4100340 2024-02-15T22:38:26.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.220+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb5c404bed0 con 0x7fb5c4100340 2024-02-15T22:38:26.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.220+0000 7fb5c1ffb700 1 -- 172.21.15.33:0/3077006420 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fb5b8057620 con 0x7fb5c4100340 2024-02-15T22:38:26.222 INFO:teuthology.orchestra.run.smithi033.stdout:e2 2024-02-15T22:38:26.222 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:38:26.222 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:38:26.222 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 2 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:38:21.981850+0000 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:38:26.223 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:in 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 0 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:26.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.222+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb5ac0692a0 msgr2=0x7fb5ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.222+0000 7fb5cb812700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb5ac0692a0 0x7fb5ac06b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4003400 tx=0x7fb5b4004d10 comp rx=0 tx=0).stop 2024-02-15T22:38:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.222+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c4100340 msgr2=0x7fb5c410def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.222+0000 7fb5cb812700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c4100340 0x7fb5c410def0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c830 tx=0x7fb5b8004470 comp rx=0 tx=0).stop 2024-02-15T22:38:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.223+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 shutdown_connections 2024-02-15T22:38:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.223+0000 7fb5cb812700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb5ac0692a0 0x7fb5ac06b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.223+0000 7fb5cb812700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5c40fda20 0x7fb5c410d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.223+0000 7fb5cb812700 1 --2- 172.21.15.33:0/3077006420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c4100340 0x7fb5c410def0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.223+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 >> 172.21.15.33:0/3077006420 conn(0x7fb5c40f7480 msgr2=0x7fb5c40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.223+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 shutdown_connections 2024-02-15T22:38:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:26.223+0000 7fb5cb812700 1 -- 172.21.15.33:0/3077006420 wait complete. 2024-02-15T22:38:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-02-15T22:38:26.987 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:38:26.997 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:38:26.998 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-15T22:38:27.266 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:27.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: pgmap v181: 65 pgs: 4 creating+activating, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:27.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3077006420' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:38:27.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:27.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:27.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:27.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:27.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:27.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:27.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: pgmap v181: 65 pgs: 4 creating+activating, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:38:27.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3077006420' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:38:27.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:27.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:27.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:27.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:27.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:27.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: Deploying daemon mds.cephfs.smithi082.lvpzpf on smithi082 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] up:boot 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: daemon mds.cephfs.smithi033.ruqork assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: Cluster is now healthy 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: fsmap cephfs:0 1 up:standby 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:creating} 2024-02-15T22:38:28.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:28 smithi033 ceph-mon[29033]: daemon mds.cephfs.smithi033.ruqork is now active in filesystem cephfs as rank 0 2024-02-15T22:38:28.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: Deploying daemon mds.cephfs.smithi082.lvpzpf on smithi082 2024-02-15T22:38:28.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] up:boot 2024-02-15T22:38:28.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: daemon mds.cephfs.smithi033.ruqork assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T22:38:28.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T22:38:28.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T22:38:28.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: Cluster is now healthy 2024-02-15T22:38:28.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: fsmap cephfs:0 1 up:standby 2024-02-15T22:38:28.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:38:28.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:creating} 2024-02-15T22:38:28.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:28 smithi082 ceph-mon[37153]: daemon mds.cephfs.smithi033.ruqork is now active in filesystem cephfs as rank 0 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 -- 172.21.15.33:0/1402227076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 msgr2=0x7f8af80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/1402227076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af80ffb10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8004940 tx=0x7f8ae8009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 -- 172.21.15.33:0/1402227076 shutdown_connections 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/1402227076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8af81000e0 0x7f8af8102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/1402227076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af80ffb10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 -- 172.21.15.33:0/1402227076 >> 172.21.15.33:0/1402227076 conn(0x7f8af80f7500 msgr2=0x7f8af80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 -- 172.21.15.33:0/1402227076 shutdown_connections 2024-02-15T22:38:28.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.950+0000 7f8afdf3b700 1 -- 172.21.15.33:0/1402227076 wait complete. 2024-02-15T22:38:28.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8afdf3b700 1 Processor -- start 2024-02-15T22:38:28.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8afdf3b700 1 -- start start 2024-02-15T22:38:28.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8afdf3b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af810d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:28.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8afdf3b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8af81000e0 0x7f8af810de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:28.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8afdf3b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af810e480 con 0x7f8af8066c50 2024-02-15T22:38:28.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8afdf3b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af810ed20 con 0x7f8af81000e0 2024-02-15T22:38:28.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af810d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af810d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60200/0 (socket says 172.21.15.33:60200) 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8af77fe700 1 -- 172.21.15.33:0/2234174775 learned_addr learned my addr 172.21.15.33:0/2234174775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.951+0000 7f8af6ffd700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8af81000e0 0x7f8af810de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8af77fe700 1 -- 172.21.15.33:0/2234174775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8af81000e0 msgr2=0x7f8af810de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8af77fe700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8af81000e0 0x7f8af810de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8af77fe700 1 -- 172.21.15.33:0/2234174775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8005040 con 0x7f8af8066c50 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8af77fe700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af810d940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800b3b0 tx=0x7f8ae8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8adffff700 1 -- 172.21.15.33:0/2234174775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae800e040 con 0x7f8af8066c50 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8adffff700 1 -- 172.21.15.33:0/2234174775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ae800bd90 con 0x7f8af8066c50 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af810efa0 con 0x7f8af8066c50 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8adffff700 1 -- 172.21.15.33:0/2234174775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae801c630 con 0x7f8af8066c50 2024-02-15T22:38:28.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.952+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af810f4e0 con 0x7f8af8066c50 2024-02-15T22:38:28.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.953+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af804bed0 con 0x7f8af8066c50 2024-02-15T22:38:28.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.954+0000 7f8adffff700 1 -- 172.21.15.33:0/2234174775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f8ae8013980 con 0x7f8af8066c50 2024-02-15T22:38:28.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.954+0000 7f8adffff700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f8ae00692b0 0x7f8ae006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:28.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.954+0000 7f8adffff700 1 -- 172.21.15.33:0/2234174775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8ae80886b0 con 0x7f8af8066c50 2024-02-15T22:38:28.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.954+0000 7f8af6ffd700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f8ae00692b0 0x7f8ae006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:28.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.955+0000 7f8af6ffd700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f8ae00692b0 0x7f8ae006b760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0041d0 tx=0x7f8aec0043c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:28.959+0000 7f8adffff700 1 -- 172.21.15.33:0/2234174775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8ae80583d0 con 0x7f8af8066c50 2024-02-15T22:38:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:29.201+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f8af810f940 con 0x7f8af8066c50 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: pgmap v182: 65 pgs: 3 creating+activating, 62 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 172 B/s wr, 0 op/s 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] up:active 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:29 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:29.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: pgmap v182: 65 pgs: 3 creating+activating, 62 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 172 B/s wr, 0 op/s 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] up:active 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:29 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.025+0000 7f8adffff700 1 -- 172.21.15.33:0/2234174775 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f8ae8057f60 con 0x7f8af8066c50 2024-02-15T22:38:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f8ae00692b0 msgr2=0x7f8ae006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f8ae00692b0 0x7f8ae006b760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0041d0 tx=0x7f8aec0043c0 comp rx=0 tx=0).stop 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 msgr2=0x7f8af810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af810d940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800b3b0 tx=0x7f8ae8009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 shutdown_connections 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f8ae00692b0 0x7f8ae006b760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af8066c50 0x7f8af810d940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 --2- 172.21.15.33:0/2234174775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8af81000e0 0x7f8af810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 >> 172.21.15.33:0/2234174775 conn(0x7f8af80f7500 msgr2=0x7f8af80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 shutdown_connections 2024-02-15T22:38:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:30.028+0000 7f8afdf3b700 1 -- 172.21.15.33:0/2234174775 wait complete. 2024-02-15T22:38:30.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:30 smithi082 ceph-mon[37153]: Deploying daemon mds.cephfs.smithi033.xkdegf on smithi033 2024-02-15T22:38:30.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:30 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] up:boot 2024-02-15T22:38:30.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:30 smithi082 ceph-mon[37153]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 1 up:standby 2024-02-15T22:38:30.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:30 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:38:30.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:30 smithi082 ceph-mon[37153]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 1 up:standby 2024-02-15T22:38:30.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:30 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2234174775' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T22:38:30.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:30 smithi033 ceph-mon[29033]: Deploying daemon mds.cephfs.smithi033.xkdegf on smithi033 2024-02-15T22:38:30.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:30 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] up:boot 2024-02-15T22:38:30.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:30 smithi033 ceph-mon[29033]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 1 up:standby 2024-02-15T22:38:30.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:30 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:38:30.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:30 smithi033 ceph-mon[29033]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 1 up:standby 2024-02-15T22:38:30.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:30 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2234174775' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T22:38:31.247 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:38:31.256 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:38:31.257 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-02-15T22:38:31.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 387 B/s wr, 3 op/s 2024-02-15T22:38:31.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T22:38:31.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2234174775' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T22:38:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: daemon mds.cephfs.smithi082.lvpzpf assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T22:38:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T22:38:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T22:38:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 1 up:standby 2024-02-15T22:38:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:creating} 2024-02-15T22:38:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:31 smithi033 ceph-mon[29033]: daemon mds.cephfs.smithi082.lvpzpf is now active in filesystem cephfs as rank 1 2024-02-15T22:38:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 387 B/s wr, 3 op/s 2024-02-15T22:38:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T22:38:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2234174775' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T22:38:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: daemon mds.cephfs.smithi082.lvpzpf assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T22:38:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T22:38:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T22:38:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: fsmap cephfs:1 {0=cephfs.smithi033.ruqork=up:active} 1 up:standby 2024-02-15T22:38:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:creating} 2024-02-15T22:38:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:31 smithi082 ceph-mon[37153]: daemon mds.cephfs.smithi082.lvpzpf is now active in filesystem cephfs as rank 1 2024-02-15T22:38:31.857 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] up:active 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:32.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:32.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:32.367 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] up:active 2024-02-15T22:38:32.367 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:38:32.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:33.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:33 smithi033 ceph-mon[29033]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 7 op/s 2024-02-15T22:38:33.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:33 smithi033 ceph-mon[29033]: Deploying daemon mds.cephfs.smithi082.rtwnpu on smithi082 2024-02-15T22:38:33.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:33 smithi033 ceph-mon[29033]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T22:38:33.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:33 smithi033 ceph-mon[29033]: Cluster is now healthy 2024-02-15T22:38:33.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:33 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] up:boot 2024-02-15T22:38:33.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:33 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby 2024-02-15T22:38:33.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:33 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:38:33.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:33 smithi082 ceph-mon[37153]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 7 op/s 2024-02-15T22:38:33.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:33 smithi082 ceph-mon[37153]: Deploying daemon mds.cephfs.smithi082.rtwnpu on smithi082 2024-02-15T22:38:33.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:33 smithi082 ceph-mon[37153]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T22:38:33.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:33 smithi082 ceph-mon[37153]: Cluster is now healthy 2024-02-15T22:38:33.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:33 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] up:boot 2024-02-15T22:38:33.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:33 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby 2024-02-15T22:38:33.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:33 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:38:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.458+0000 7f85c426e700 1 -- 172.21.15.33:0/865148989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fcfb0 msgr2=0x7f85bc0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.458+0000 7f85c426e700 1 --2- 172.21.15.33:0/865148989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fcfb0 0x7f85bc0fd420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f85ac004940 tx=0x7f85ac009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 -- 172.21.15.33:0/865148989 shutdown_connections 2024-02-15T22:38:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 --2- 172.21.15.33:0/865148989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fcfb0 0x7f85bc0fd420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 --2- 172.21.15.33:0/865148989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc0fbe40 0x7f85bc0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 -- 172.21.15.33:0/865148989 >> 172.21.15.33:0/865148989 conn(0x7f85bc0f7520 msgr2=0x7f85bc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 -- 172.21.15.33:0/865148989 shutdown_connections 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 -- 172.21.15.33:0/865148989 wait complete. 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 Processor -- start 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 -- start start 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fbe40 0x7f85bc10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc0fcfb0 0x7f85bc10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc10e470 con 0x7f85bc0fbe40 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c426e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc10ed10 con 0x7f85bc0fcfb0 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.459+0000 7f85c200a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fbe40 0x7f85bc10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c200a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fbe40 0x7f85bc10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60222/0 (socket says 172.21.15.33:60222) 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c200a700 1 -- 172.21.15.33:0/3773521912 learned_addr learned my addr 172.21.15.33:0/3773521912 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c1809700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc0fcfb0 0x7f85bc10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c200a700 1 -- 172.21.15.33:0/3773521912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc0fcfb0 msgr2=0x7f85bc10de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c200a700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc0fcfb0 0x7f85bc10de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c200a700 1 -- 172.21.15.33:0/3773521912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac005040 con 0x7f85bc0fbe40 2024-02-15T22:38:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c200a700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fbe40 0x7f85bc10d930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f85b8002a50 tx=0x7f85b80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85b2ffd700 1 -- 172.21.15.33:0/3773521912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b8007cc0 con 0x7f85bc0fbe40 2024-02-15T22:38:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85b2ffd700 1 -- 172.21.15.33:0/3773521912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85b800f040 con 0x7f85bc0fbe40 2024-02-15T22:38:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85b2ffd700 1 -- 172.21.15.33:0/3773521912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b800da30 con 0x7f85bc0fbe40 2024-02-15T22:38:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc10eff0 con 0x7f85bc0fbe40 2024-02-15T22:38:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.460+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc10f530 con 0x7f85bc0fbe40 2024-02-15T22:38:33.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.461+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc04bed0 con 0x7f85bc0fbe40 2024-02-15T22:38:33.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.462+0000 7f85b2ffd700 1 -- 172.21.15.33:0/3773521912 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f85b800db90 con 0x7f85bc0fbe40 2024-02-15T22:38:33.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.462+0000 7f85b2ffd700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f85a80692a0 0x7f85a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:33.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.462+0000 7f85b2ffd700 1 -- 172.21.15.33:0/3773521912 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f85b8086e60 con 0x7f85bc0fbe40 2024-02-15T22:38:33.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.462+0000 7f85c1809700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f85a80692a0 0x7f85a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:33.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.463+0000 7f85c1809700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f85a80692a0 0x7f85a806b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b3b0 tx=0x7f85ac009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.467+0000 7f85b2ffd700 1 -- 172.21.15.33:0/3773521912 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f85b8056c20 con 0x7f85bc0fbe40 2024-02-15T22:38:33.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:33.703+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f85bc104930 con 0x7f85bc0fbe40 2024-02-15T22:38:34.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.044+0000 7f85b2ffd700 1 -- 172.21.15.33:0/3773521912 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v12) v1 ==== 121+0+0 (secure 0 0 0) 0x7f85b80567b0 con 0x7f85bc0fbe40 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f85a80692a0 msgr2=0x7f85a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f85a80692a0 0x7f85a806b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b3b0 tx=0x7f85ac009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fbe40 msgr2=0x7f85bc10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fbe40 0x7f85bc10d930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f85b8002a50 tx=0x7f85b80046b0 comp rx=0 tx=0).stop 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 shutdown_connections 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f85a80692a0 0x7f85a806b750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85bc0fbe40 0x7f85bc10d930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 --2- 172.21.15.33:0/3773521912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc0fcfb0 0x7f85bc10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 >> 172.21.15.33:0/3773521912 conn(0x7f85bc0f7520 msgr2=0x7f85bc065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 shutdown_connections 2024-02-15T22:38:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:34.048+0000 7f85c426e700 1 -- 172.21.15.33:0/3773521912 wait complete. 2024-02-15T22:38:34.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:34 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3773521912' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-15T22:38:34.423 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:34 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3773521912' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-15T22:38:34.981 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:38:34.991 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:38:34.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3773521912' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby-replay 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:35 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:35.364 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3773521912' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby-replay 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:35.365 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:35 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:35.694 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:36.069 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:36 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] up:boot 2024-02-15T22:38:36.069 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:36 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] up:active 2024-02-15T22:38:36.069 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:36 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:38:36.069 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:38:36.069 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:36 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:36.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:36 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] up:boot 2024-02-15T22:38:36.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:36 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] up:active 2024-02-15T22:38:36.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:36 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:38:36.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:36 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:38:36.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:36 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:37.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:37 smithi082 ceph-mon[37153]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 859 B/s rd, 2.0 KiB/s wr, 8 op/s 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:37 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] up:standby-replay 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:37 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:37 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:37 smithi033 ceph-mon[29033]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 859 B/s rd, 2.0 KiB/s wr, 8 op/s 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:37 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] up:standby-replay 2024-02-15T22:38:37.374 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:37 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:37.375 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:37.375 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:37.375 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:37 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:37.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 -- 172.21.15.33:0/316865076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 msgr2=0x7feffc0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:37.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 --2- 172.21.15.33:0/316865076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc0ffb10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fefec009ce0 tx=0x7fefec004d10 comp rx=0 tx=0).stop 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 -- 172.21.15.33:0/316865076 shutdown_connections 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 --2- 172.21.15.33:0/316865076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feffc1000e0 0x7feffc102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 --2- 172.21.15.33:0/316865076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc0ffb10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 -- 172.21.15.33:0/316865076 >> 172.21.15.33:0/316865076 conn(0x7feffc0f7520 msgr2=0x7feffc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 -- 172.21.15.33:0/316865076 shutdown_connections 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 -- 172.21.15.33:0/316865076 wait complete. 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.583+0000 7ff003336700 1 Processor -- start 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff003336700 1 -- start start 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff003336700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff003336700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feffc1000e0 0x7feffc110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff003336700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc111050 con 0x7feffc066c50 2024-02-15T22:38:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff003336700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc1111c0 con 0x7feffc1000e0 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0010d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0010d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc10fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39826/0 (socket says 172.21.15.33:39826) 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0010d2700 1 -- 172.21.15.33:0/2287729542 learned_addr learned my addr 172.21.15.33:0/2287729542 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0008d1700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feffc1000e0 0x7feffc110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0010d2700 1 -- 172.21.15.33:0/2287729542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feffc1000e0 msgr2=0x7feffc110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0010d2700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feffc1000e0 0x7feffc110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0010d2700 1 -- 172.21.15.33:0/2287729542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec009940 con 0x7feffc066c50 2024-02-15T22:38:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff0010d2700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc10fd50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fefec015040 tx=0x7fefec004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7feff9ffb700 1 -- 172.21.15.33:0/2287729542 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefec00e040 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7feff9ffb700 1 -- 172.21.15.33:0/2287729542 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefec0128e0 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc1113e0 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.584+0000 7feff9ffb700 1 -- 172.21.15.33:0/2287729542 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefec01c840 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.585+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc111920 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.586+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc04bed0 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.586+0000 7feff9ffb700 1 -- 172.21.15.33:0/2287729542 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fefec012a50 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.586+0000 7feff9ffb700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fefe40692a0 0x7fefe406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.586+0000 7feff9ffb700 1 -- 172.21.15.33:0/2287729542 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fefec088e10 con 0x7feffc066c50 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.586+0000 7ff0008d1700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fefe40692a0 0x7fefe406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.587+0000 7ff0008d1700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fefe40692a0 0x7fefe406b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feffc066990 tx=0x7feff000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:37.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.591+0000 7feff9ffb700 1 -- 172.21.15.33:0/2287729542 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fefec055140 con 0x7feffc066c50 2024-02-15T22:38:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:37.830+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7feffc111d50 con 0x7feffc066c50 2024-02-15T22:38:38.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.067+0000 7feff9ffb700 1 -- 172.21.15.33:0/2287729542 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v17) v1 ==== 133+0+0 (secure 0 0 0) 0x7fefec058760 con 0x7feffc066c50 2024-02-15T22:38:38.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fefe40692a0 msgr2=0x7fefe406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fefe40692a0 0x7fefe406b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feffc066990 tx=0x7feff000b040 comp rx=0 tx=0).stop 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 msgr2=0x7feffc10fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc10fd50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fefec015040 tx=0x7fefec004d10 comp rx=0 tx=0).stop 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 shutdown_connections 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fefe40692a0 0x7fefe406b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc066c50 0x7feffc10fd50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 --2- 172.21.15.33:0/2287729542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feffc1000e0 0x7feffc110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 >> 172.21.15.33:0/2287729542 conn(0x7feffc0f7520 msgr2=0x7feffc0fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 shutdown_connections 2024-02-15T22:38:38.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:38.069+0000 7ff003336700 1 -- 172.21.15.33:0/2287729542 wait complete. 2024-02-15T22:38:38.072 INFO:teuthology.orchestra.run.smithi033.stderr:inline data disabled 2024-02-15T22:38:38.361 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:38 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2287729542' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-15T22:38:38.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:38 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2287729542' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-15T22:38:38.763 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:38:38.773 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:38:38.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T22:38:39.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:39 smithi033 ceph-mon[29033]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 2.0 KiB/s wr, 8 op/s 2024-02-15T22:38:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:39 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2287729542' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-15T22:38:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:39 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] up:active 2024-02-15T22:38:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:39 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:39.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:39 smithi082 ceph-mon[37153]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 2.0 KiB/s wr, 8 op/s 2024-02-15T22:38:39.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:39 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2287729542' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-15T22:38:39.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:39 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] up:active 2024-02-15T22:38:39.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:39 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:40.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:40 smithi082 ceph-mon[37153]: mds.? [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] up:standby-replay 2024-02-15T22:38:40.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:40 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:40.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:40 smithi033 ceph-mon[29033]: mds.? [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] up:standby-replay 2024-02-15T22:38:40.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:40 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:38:41.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.118+0000 7fd649781700 1 -- 172.21.15.33:0/188272773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 msgr2=0x7fd644102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:41.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.118+0000 7fd649781700 1 --2- 172.21.15.33:0/188272773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd644102520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd638004940 tx=0x7fd638009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:41.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 -- 172.21.15.33:0/188272773 shutdown_connections 2024-02-15T22:38:41.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 --2- 172.21.15.33:0/188272773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd644102520 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:41.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 --2- 172.21.15.33:0/188272773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd644066c70 0x7fd6440ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:41.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 -- 172.21.15.33:0/188272773 >> 172.21.15.33:0/188272773 conn(0x7fd6440f7520 msgr2=0x7fd6440f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:41.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 -- 172.21.15.33:0/188272773 shutdown_connections 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 -- 172.21.15.33:0/188272773 wait complete. 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 Processor -- start 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 -- start start 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd644066c70 0x7fd64410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd64410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64410e470 con 0x7fd6441000c0 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.119+0000 7fd649781700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64410ed10 con 0x7fd644066c70 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd6427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd64410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd6427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd64410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39830/0 (socket says 172.21.15.33:39830) 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd6427fc700 1 -- 172.21.15.33:0/2870103206 learned_addr learned my addr 172.21.15.33:0/2870103206 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd642ffd700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd644066c70 0x7fd64410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd6427fc700 1 -- 172.21.15.33:0/2870103206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd644066c70 msgr2=0x7fd64410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd6427fc700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd644066c70 0x7fd64410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:41.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd6427fc700 1 -- 172.21.15.33:0/2870103206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638005040 con 0x7fd6441000c0 2024-02-15T22:38:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd642ffd700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd644066c70 0x7fd64410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:38:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd6427fc700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd64410de70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd638000c00 tx=0x7fd638009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd62b7fe700 1 -- 172.21.15.33:0/2870103206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63800e040 con 0x7fd6441000c0 2024-02-15T22:38:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd62b7fe700 1 -- 172.21.15.33:0/2870103206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd63800bcc0 con 0x7fd6441000c0 2024-02-15T22:38:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64410ef90 con 0x7fd6441000c0 2024-02-15T22:38:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd62b7fe700 1 -- 172.21.15.33:0/2870103206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63801c630 con 0x7fd6441000c0 2024-02-15T22:38:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.120+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64410f4d0 con 0x7fd6441000c0 2024-02-15T22:38:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.121+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd644107a50 con 0x7fd6441000c0 2024-02-15T22:38:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.122+0000 7fd62b7fe700 1 -- 172.21.15.33:0/2870103206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd638013980 con 0x7fd6441000c0 2024-02-15T22:38:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.122+0000 7fd62b7fe700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd62c0692a0 0x7fd62c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.122+0000 7fd62b7fe700 1 -- 172.21.15.33:0/2870103206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd6380885c0 con 0x7fd6441000c0 2024-02-15T22:38:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.122+0000 7fd642ffd700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd62c0692a0 0x7fd62c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.123+0000 7fd642ffd700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd62c0692a0 0x7fd62c06b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd634007fd0 tx=0x7fd634009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:41.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.128+0000 7fd62b7fe700 1 -- 172.21.15.33:0/2870103206 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd638058300 con 0x7fd6441000c0 2024-02-15T22:38:41.290 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:41 smithi033 ceph-mon[29033]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.364+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd644105a10 con 0x7fd6441000c0 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.364+0000 7fd62b7fe700 1 -- 172.21.15.33:0/2870103206 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1827 (secure 0 0 0) 0x7fd638057e90 con 0x7fd6441000c0 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stdout:e18 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:38:41.365 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 18 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:38:39.066363+0000 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:38:41.366 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:38:41.367 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:38:41.368 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:38:41.368 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:38:41.368 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:38:41.368 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:38:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd62c0692a0 msgr2=0x7fd62c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd62c0692a0 0x7fd62c06b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd634007fd0 tx=0x7fd634009040 comp rx=0 tx=0).stop 2024-02-15T22:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 msgr2=0x7fd64410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd64410de70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd638000c00 tx=0x7fd638009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 shutdown_connections 2024-02-15T22:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fd62c0692a0 0x7fd62c06b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd644066c70 0x7fd64410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 --2- 172.21.15.33:0/2870103206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6441000c0 0x7fd64410de70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 >> 172.21.15.33:0/2870103206 conn(0x7fd6440f7520 msgr2=0x7fd6440f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 shutdown_connections 2024-02-15T22:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:41.366+0000 7fd649781700 1 -- 172.21.15.33:0/2870103206 wait complete. 2024-02-15T22:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 18 2024-02-15T22:38:41.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:41 smithi082 ceph-mon[37153]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-02-15T22:38:42.202 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:42 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2870103206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:38:42.230 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-15T22:38:42.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:42 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2870103206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:38:42.952 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:43.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:43 smithi082 ceph-mon[37153]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-02-15T22:38:43.402 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:43 smithi033 ceph-mon[29033]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-02-15T22:38:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 -- 172.21.15.33:0/2680846644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 msgr2=0x7f58280fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 --2- 172.21.15.33:0/2680846644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f58280fd320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5824004940 tx=0x7f5824009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 -- 172.21.15.33:0/2680846644 shutdown_connections 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 --2- 172.21.15.33:0/2680846644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280fe0e0 0x7f58280fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 --2- 172.21.15.33:0/2680846644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f58280fd320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 -- 172.21.15.33:0/2680846644 >> 172.21.15.33:0/2680846644 conn(0x7f58280f8620 msgr2=0x7f58280faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 -- 172.21.15.33:0/2680846644 shutdown_connections 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.558+0000 7f582f93f700 1 -- 172.21.15.33:0/2680846644 wait complete. 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582f93f700 1 Processor -- start 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582f93f700 1 -- start start 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582f93f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f582810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582f93f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280fe0e0 0x7f58281100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582f93f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58281106e0 con 0x7f58280fcef0 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582f93f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828110f80 con 0x7f58280fe0e0 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582d6db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f582810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582d6db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f582810fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39842/0 (socket says 172.21.15.33:39842) 2024-02-15T22:38:44.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582d6db700 1 -- 172.21.15.33:0/3567961648 learned_addr learned my addr 172.21.15.33:0/3567961648 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582ceda700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280fe0e0 0x7f58281100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582d6db700 1 -- 172.21.15.33:0/3567961648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280fe0e0 msgr2=0x7f58281100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582d6db700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280fe0e0 0x7f58281100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.559+0000 7f582d6db700 1 -- 172.21.15.33:0/3567961648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824005040 con 0x7f58280fcef0 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.560+0000 7f582d6db700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f582810fba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f582400b3b0 tx=0x7f5824009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.560+0000 7f581dffb700 1 -- 172.21.15.33:0/3567961648 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582400e040 con 0x7f58280fcef0 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.560+0000 7f581dffb700 1 -- 172.21.15.33:0/3567961648 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f582400bcc0 con 0x7f58280fcef0 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.560+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5828111200 con 0x7f58280fcef0 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.560+0000 7f581dffb700 1 -- 172.21.15.33:0/3567961648 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582401c630 con 0x7f58280fcef0 2024-02-15T22:38:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.560+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58281116f0 con 0x7f58280fcef0 2024-02-15T22:38:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.561+0000 7f581dffb700 1 -- 172.21.15.33:0/3567961648 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f5824013420 con 0x7f58280fcef0 2024-02-15T22:38:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.561+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5828102210 con 0x7f58280fcef0 2024-02-15T22:38:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.562+0000 7f581dffb700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58140692a0 0x7f581406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.562+0000 7f581dffb700 1 -- 172.21.15.33:0/3567961648 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5824088620 con 0x7f58280fcef0 2024-02-15T22:38:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.562+0000 7f582ceda700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58140692a0 0x7f581406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.562+0000 7f582ceda700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58140692a0 0x7f581406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5818007fd0 tx=0x7f5818009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.567+0000 7f581dffb700 1 -- 172.21.15.33:0/3567961648 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f58240583e0 con 0x7f58280fcef0 2024-02-15T22:38:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.815+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f582804bed0 con 0x7f58280fcef0 2024-02-15T22:38:44.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.815+0000 7f581dffb700 1 -- 172.21.15.33:0/3567961648 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f5824057f70 con 0x7f58280fcef0 2024-02-15T22:38:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.817+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58140692a0 msgr2=0x7f581406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.817+0000 7f582f93f700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58140692a0 0x7f581406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5818007fd0 tx=0x7f5818009040 comp rx=0 tx=0).stop 2024-02-15T22:38:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.817+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 msgr2=0x7f582810fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.817+0000 7f582f93f700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f582810fba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f582400b3b0 tx=0x7f5824009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.818+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 shutdown_connections 2024-02-15T22:38:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.818+0000 7f582f93f700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58140692a0 0x7f581406b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.818+0000 7f582f93f700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58280fcef0 0x7f582810fba0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.818+0000 7f582f93f700 1 --2- 172.21.15.33:0/3567961648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280fe0e0 0x7f58281100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.818+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 >> 172.21.15.33:0/3567961648 conn(0x7f58280f8620 msgr2=0x7f58280ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.818+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 shutdown_connections 2024-02-15T22:38:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:44.818+0000 7f582f93f700 1 -- 172.21.15.33:0/3567961648 wait complete. 2024-02-15T22:38:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 18 2024-02-15T22:38:44.829 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:45 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3567961648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:38:45.446 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:45 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3567961648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:38:45.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-15T22:38:46.386 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:47 smithi082 ceph-mon[37153]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T22:38:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:47.448 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:47 smithi033 ceph-mon[29033]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T22:38:47.448 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:47.448 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:47.448 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:47.448 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:38:49.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:48 smithi033 ceph-mon[29033]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:38:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:48 smithi082 ceph-mon[37153]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.245+0000 7f58746f5700 1 -- 172.21.15.33:0/846626594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fbca0 msgr2=0x7f586c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.245+0000 7f58746f5700 1 --2- 172.21.15.33:0/846626594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fbca0 0x7f586c0fe550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5868004940 tx=0x7f5868009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.245+0000 7f58746f5700 1 -- 172.21.15.33:0/846626594 shutdown_connections 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.245+0000 7f58746f5700 1 --2- 172.21.15.33:0/846626594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fbca0 0x7f586c0fe550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.245+0000 7f58746f5700 1 --2- 172.21.15.33:0/846626594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f586c0fb2c0 0x7f586c0fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.245+0000 7f58746f5700 1 -- 172.21.15.33:0/846626594 >> 172.21.15.33:0/846626594 conn(0x7f586c0f6ca0 msgr2=0x7f586c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 -- 172.21.15.33:0/846626594 shutdown_connections 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 -- 172.21.15.33:0/846626594 wait complete. 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 Processor -- start 2024-02-15T22:38:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 -- start start 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fb2c0 0x7f586c10dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f586c10e230 0x7f586c10ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c10e6f0 con 0x7f586c0fb2c0 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f58746f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c10e830 con 0x7f586c10e230 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f5872491700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fb2c0 0x7f586c10dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f5872491700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fb2c0 0x7f586c10dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47248/0 (socket says 172.21.15.33:47248) 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f5872491700 1 -- 172.21.15.33:0/2300894779 learned_addr learned my addr 172.21.15.33:0/2300894779 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.246+0000 7f5871c90700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f586c10e230 0x7f586c10ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f5872491700 1 -- 172.21.15.33:0/2300894779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f586c10e230 msgr2=0x7f586c10ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f5872491700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f586c10e230 0x7f586c10ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f5872491700 1 -- 172.21.15.33:0/2300894779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868005040 con 0x7f586c0fb2c0 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f5872491700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fb2c0 0x7f586c10dcf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f585c002a50 tx=0x7f585c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f5862ffd700 1 -- 172.21.15.33:0/2300894779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585c007cc0 con 0x7f586c0fb2c0 2024-02-15T22:38:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f5862ffd700 1 -- 172.21.15.33:0/2300894779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f585c00f040 con 0x7f586c0fb2c0 2024-02-15T22:38:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f5862ffd700 1 -- 172.21.15.33:0/2300894779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585c00da70 con 0x7f586c0fb2c0 2024-02-15T22:38:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586c10f670 con 0x7f586c0fb2c0 2024-02-15T22:38:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.247+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586c10fbb0 con 0x7f586c0fb2c0 2024-02-15T22:38:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.248+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586c0fa940 con 0x7f586c0fb2c0 2024-02-15T22:38:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.248+0000 7f5862ffd700 1 -- 172.21.15.33:0/2300894779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f585c00dc10 con 0x7f586c0fb2c0 2024-02-15T22:38:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.249+0000 7f5862ffd700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58580692a0 0x7f585806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.249+0000 7f5862ffd700 1 -- 172.21.15.33:0/2300894779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f585c086880 con 0x7f586c0fb2c0 2024-02-15T22:38:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.249+0000 7f5871c90700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58580692a0 0x7f585806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.249+0000 7f5871c90700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58580692a0 0x7f585806b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5868004f90 tx=0x7f5868009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.253+0000 7f5862ffd700 1 -- 172.21.15.33:0/2300894779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f585c056560 con 0x7f586c0fb2c0 2024-02-15T22:38:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.533+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f586c105db0 con 0x7f586c0fb2c0 2024-02-15T22:38:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.534+0000 7f5862ffd700 1 -- 172.21.15.33:0/2300894779 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+99 (secure 0 0 0) 0x7f585c017080 con 0x7f586c0fb2c0 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58580692a0 msgr2=0x7f585806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58580692a0 0x7f585806b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5868004f90 tx=0x7f5868009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fb2c0 msgr2=0x7f586c10dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fb2c0 0x7f586c10dcf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f585c002a50 tx=0x7f585c0046b0 comp rx=0 tx=0).stop 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 shutdown_connections 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f58580692a0 0x7f585806b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f586c0fb2c0 0x7f586c10dcf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 --2- 172.21.15.33:0/2300894779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f586c10e230 0x7f586c10ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 >> 172.21.15.33:0/2300894779 conn(0x7f586c0f6ca0 msgr2=0x7f586c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 shutdown_connections 2024-02-15T22:38:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:49.536+0000 7f58746f5700 1 -- 172.21.15.33:0/2300894779 wait complete. 2024-02-15T22:38:49.547 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:38:50.146 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:49 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2300894779' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T22:38:50.173 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-15T22:38:50.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/3178740810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 msgr2=0x7fe5c40fda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/3178740810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c40fda90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0048d0 tx=0x7fe5ac009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/3178740810 shutdown_connections 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/3178740810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c40fda90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/3178740810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c40fa570 0x7fe5c40fa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/3178740810 >> 172.21.15.33:0/3178740810 conn(0x7fe5c40f6050 msgr2=0x7fe5c40f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/3178740810 shutdown_connections 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.322+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/3178740810 wait complete. 2024-02-15T22:38:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c8b9d640 1 Processor -- start 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c8b9d640 1 -- start start 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c8b9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c40fa570 0x7fe5c410cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c8b9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c8b9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c410d6c0 con 0x7fe5c40fd620 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c8b9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4112110 con 0x7fe5c40fa570 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5bbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5bbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c410d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47264/0 (socket says 172.21.15.33:47264) 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5bbfff640 1 -- 172.21.15.33:0/2869202200 learned_addr learned my addr 172.21.15.33:0/2869202200 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c259c640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c40fa570 0x7fe5c410cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5bbfff640 1 -- 172.21.15.33:0/2869202200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c40fa570 msgr2=0x7fe5c410cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5bbfff640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c40fa570 0x7fe5c410cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5bbfff640 1 -- 172.21.15.33:0/2869202200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac005040 con 0x7fe5c40fd620 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.323+0000 7fe5c259c640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c40fa570 0x7fe5c410cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.324+0000 7fe5bbfff640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c410d070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac007da0 tx=0x7fe5ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.324+0000 7fe5baffd640 1 -- 172.21.15.33:0/2869202200 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac0094c0 con 0x7fe5c40fd620 2024-02-15T22:38:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.324+0000 7fe5baffd640 1 -- 172.21.15.33:0/2869202200 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5ac009620 con 0x7fe5c40fd620 2024-02-15T22:38:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.324+0000 7fe5baffd640 1 -- 172.21.15.33:0/2869202200 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac03b620 con 0x7fe5c40fd620 2024-02-15T22:38:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.324+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4112250 con 0x7fe5c40fd620 2024-02-15T22:38:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.324+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c4112740 con 0x7fe5c40fd620 2024-02-15T22:38:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.325+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4104df0 con 0x7fe5c40fd620 2024-02-15T22:38:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.325+0000 7fe5baffd640 1 -- 172.21.15.33:0/2869202200 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe5ac02f070 con 0x7fe5c40fd620 2024-02-15T22:38:50.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.326+0000 7fe5baffd640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5b0069210 0x7fe5b006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.326+0000 7fe5baffd640 1 -- 172.21.15.33:0/2869202200 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe5ac0a97f0 con 0x7fe5c40fd620 2024-02-15T22:38:50.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.326+0000 7fe5c259c640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5b0069210 0x7fe5b006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.326+0000 7fe5c259c640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5b0069210 0x7fe5b006b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4065490 tx=0x7fe5b400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.330+0000 7fe5baffd640 1 -- 172.21.15.33:0/2869202200 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe5ac075aa0 con 0x7fe5c40fd620 2024-02-15T22:38:50.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:49 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2300894779' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T22:38:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.508+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5c4112a10 con 0x7fe5c40fd620 2024-02-15T22:38:50.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.509+0000 7fe5baffd640 1 -- 172.21.15.33:0/2869202200 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14169 (secure 0 0 0) 0x7fe5ac0790c0 con 0x7fe5c40fd620 2024-02-15T22:38:50.509 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":46,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","created":"2024-02-15T22:31:07.591719+0000","modified":"2024-02-15T22:38:23.987815+0000","last_up_change":"2024-02-15T22:37:03.221336+0000","last_in_change":"2024-02-15T22:36:43.765254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:35:50.180713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:38:20.412479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:38:21.217027+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"630ee5c8-c8e3-4190-878c-82aa86eb7366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6803","nonce":308155144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6805","nonce":308155144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6809","nonce":308155144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":308155144},{"type":"v1","addr":"172.21.15.33:6807","nonce":308155144}]},"public_addr":"172.21.15.33:6803/308155144","cluster_addr":"172.21.15.33:6805/308155144","heartbeat_back_addr":"172.21.15.33:6809/308155144","heartbeat_front_addr":"172.21.15.33:6807/308155144","state":["exists","up"]},{"osd":1,"uuid":"9edc1e24-0b17-4e9a-ac42-18decf1d9c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6811","nonce":283250145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6813","nonce":283250145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6817","nonce":283250145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":283250145},{"type":"v1","addr":"172.21.15.33:6815","nonce":283250145}]},"public_addr":"172.21.15.33:6811/283250145","cluster_addr":"172.21.15.33:6813/283250145","heartbeat_back_addr":"172.21.15.33:6817/283250145","heartbeat_front_addr":"172.21.15.33:6815/283250145","state":["exists","up"]},{"osd":2,"uuid":"eaa0a666-819e-4268-a788-e2ab2b12dd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6819","nonce":936985146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6821","nonce":936985146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6825","nonce":936985146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":936985146},{"type":"v1","addr":"172.21.15.33:6823","nonce":936985146}]},"public_addr":"172.21.15.33:6819/936985146","cluster_addr":"172.21.15.33:6821/936985146","heartbeat_back_addr":"172.21.15.33:6825/936985146","heartbeat_front_addr":"172.21.15.33:6823/936985146","state":["exists","up"]},{"osd":3,"uuid":"111d4225-5978-43c6-8276-87091559a25b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6801","nonce":234002786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6803","nonce":234002786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6807","nonce":234002786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":234002786},{"type":"v1","addr":"172.21.15.82:6805","nonce":234002786}]},"public_addr":"172.21.15.82:6801/234002786","cluster_addr":"172.21.15.82:6803/234002786","heartbeat_back_addr":"172.21.15.82:6807/234002786","heartbeat_front_addr":"172.21.15.82:6805/234002786","state":["exists","up"]},{"osd":4,"uuid":"6625f0e7-013e-4fab-897d-06ed130d9878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6809","nonce":462085336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6811","nonce":462085336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6815","nonce":462085336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":462085336},{"type":"v1","addr":"172.21.15.82:6813","nonce":462085336}]},"public_addr":"172.21.15.82:6809/462085336","cluster_addr":"172.21.15.82:6811/462085336","heartbeat_back_addr":"172.21.15.82:6815/462085336","heartbeat_front_addr":"172.21.15.82:6813/462085336","state":["exists","up"]},{"osd":5,"uuid":"6b74c887-f24b-4da2-85fd-5d351fe44045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6817","nonce":483187029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6819","nonce":483187029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6823","nonce":483187029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":483187029},{"type":"v1","addr":"172.21.15.82:6821","nonce":483187029}]},"public_addr":"172.21.15.82:6817/483187029","cluster_addr":"172.21.15.82:6819/483187029","heartbeat_back_addr":"172.21.15.82:6823/483187029","heartbeat_front_addr":"172.21.15.82:6821/483187029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:34:48.066478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:16.174578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:46.001693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:09.278760+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:34.947739+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:37:01.519872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/771735499":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/4080754497":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/1038575526":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6801/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6800/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6801/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/2241336882":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6800/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/547235877":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/245484360":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6801/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/275440289":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/3583368704":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/735416243":"2024-02-16T22:31:43.072803+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5b0069210 msgr2=0x7fe5b006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5b0069210 0x7fe5b006b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4065490 tx=0x7fe5b400b040 comp rx=0 tx=0).stop 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 msgr2=0x7fe5c410d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c410d070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac007da0 tx=0x7fe5ac009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 shutdown_connections 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe5b0069210 0x7fe5b006b6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5c40fd620 0x7fe5c410d070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 --2- 172.21.15.33:0/2869202200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c40fa570 0x7fe5c410cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 >> 172.21.15.33:0/2869202200 conn(0x7fe5c40f6050 msgr2=0x7fe5c4100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 shutdown_connections 2024-02-15T22:38:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.511+0000 7fe5c8b9d640 1 -- 172.21.15.33:0/2869202200 wait complete. 2024-02-15T22:38:50.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:35:50.180713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:38:20.412479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:38:21.217027+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-15T22:38:50.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 -- 172.21.15.33:0/4147103807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 msgr2=0x7fe04c0fc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4147103807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c0fc880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe0400048d0 tx=0x7fe040009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 -- 172.21.15.33:0/4147103807 shutdown_connections 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4147103807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c0fc880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4147103807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe04c0fb1e0 0x7fe04c0fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 -- 172.21.15.33:0/4147103807 >> 172.21.15.33:0/4147103807 conn(0x7fe04c0f6900 msgr2=0x7fe04c0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 -- 172.21.15.33:0/4147103807 shutdown_connections 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.631+0000 7fe051b9d640 1 -- 172.21.15.33:0/4147103807 wait complete. 2024-02-15T22:38:50.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe051b9d640 1 Processor -- start 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe051b9d640 1 -- start start 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe051b9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe04c0fb1e0 0x7fe04c065b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe051b9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c1119b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe051b9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c111ef0 con 0x7fe04c0fc410 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe051b9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c112030 con 0x7fe04c0fb1e0 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe04affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c1119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe04affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c1119b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47284/0 (socket says 172.21.15.33:47284) 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe04affd640 1 -- 172.21.15.33:0/4241809856 learned_addr learned my addr 172.21.15.33:0/4241809856 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe04b7fe640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe04c0fb1e0 0x7fe04c065b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe04affd640 1 -- 172.21.15.33:0/4241809856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe04c0fb1e0 msgr2=0x7fe04c065b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.632+0000 7fe04affd640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe04c0fb1e0 0x7fe04c065b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.633+0000 7fe04affd640 1 -- 172.21.15.33:0/4241809856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040005040 con 0x7fe04c0fc410 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.633+0000 7fe04affd640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c1119b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe040007dd0 tx=0x7fe040009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.633+0000 7fe033fff640 1 -- 172.21.15.33:0/4241809856 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0400094c0 con 0x7fe04c0fc410 2024-02-15T22:38:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.633+0000 7fe033fff640 1 -- 172.21.15.33:0/4241809856 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe040009620 con 0x7fe04c0fc410 2024-02-15T22:38:50.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.633+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c112280 con 0x7fe04c0fc410 2024-02-15T22:38:50.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.633+0000 7fe033fff640 1 -- 172.21.15.33:0/4241809856 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04003b640 con 0x7fe04c0fc410 2024-02-15T22:38:50.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.633+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c1127a0 con 0x7fe04c0fc410 2024-02-15T22:38:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.634+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c103d30 con 0x7fe04c0fc410 2024-02-15T22:38:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.634+0000 7fe033fff640 1 -- 172.21.15.33:0/4241809856 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe04002f070 con 0x7fe04c0fc410 2024-02-15T22:38:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.635+0000 7fe033fff640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe034069210 0x7fe03406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.635+0000 7fe04b7fe640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe034069210 0x7fe03406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.635+0000 7fe033fff640 1 -- 172.21.15.33:0/4241809856 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe0400a9780 con 0x7fe04c0fc410 2024-02-15T22:38:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.635+0000 7fe04b7fe640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe034069210 0x7fe03406b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0fc270 tx=0x7fe03c009ef0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:50.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.639+0000 7fe033fff640 1 -- 172.21.15.33:0/4241809856 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe040075a30 con 0x7fe04c0fc410 2024-02-15T22:38:50.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.827+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe04c103ec0 con 0x7fe04c0fc410 2024-02-15T22:38:50.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.828+0000 7fe033fff640 1 -- 172.21.15.33:0/4241809856 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe04c103ec0 con 0x7fe04c0fc410 2024-02-15T22:38:50.828 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe034069210 msgr2=0x7fe03406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe034069210 0x7fe03406b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0fc270 tx=0x7fe03c009ef0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 msgr2=0x7fe04c1119b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c1119b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe040007dd0 tx=0x7fe040009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 shutdown_connections 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fe034069210 0x7fe03406b6c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe04c0fc410 0x7fe04c1119b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 --2- 172.21.15.33:0/4241809856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe04c0fb1e0 0x7fe04c065b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 >> 172.21.15.33:0/4241809856 conn(0x7fe04c0f6900 msgr2=0x7fe04c0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 shutdown_connections 2024-02-15T22:38:50.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.830+0000 7fe051b9d640 1 -- 172.21.15.33:0/4241809856 wait complete. 2024-02-15T22:38:50.841 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T22:38:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 -- 172.21.15.33:0/1844964471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 msgr2=0x7fcc7c0fc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 --2- 172.21.15.33:0/1844964471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c0fc8c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0048d0 tx=0x7fcc6c009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 -- 172.21.15.33:0/1844964471 shutdown_connections 2024-02-15T22:38:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 --2- 172.21.15.33:0/1844964471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c0fc8c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 --2- 172.21.15.33:0/1844964471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc7c0fb180 0x7fcc7c0fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 -- 172.21.15.33:0/1844964471 >> 172.21.15.33:0/1844964471 conn(0x7fcc7c0f6960 msgr2=0x7fcc7c0f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 -- 172.21.15.33:0/1844964471 shutdown_connections 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 -- 172.21.15.33:0/1844964471 wait complete. 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 Processor -- start 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 -- start start 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc7c0fb180 0x7fcc7c066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c111980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.943+0000 7fcc8082e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c111ec0 con 0x7fcc7c0fc450 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc8082e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c112000 con 0x7fcc7c0fb180 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc79d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c111980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc79d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c111980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47288/0 (socket says 172.21.15.33:47288) 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc79d9b640 1 -- 172.21.15.33:0/585704096 learned_addr learned my addr 172.21.15.33:0/585704096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc7a59c640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc7c0fb180 0x7fcc7c066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc79d9b640 1 -- 172.21.15.33:0/585704096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc7c0fb180 msgr2=0x7fcc7c066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc79d9b640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc7c0fb180 0x7fcc7c066140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc79d9b640 1 -- 172.21.15.33:0/585704096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c005040 con 0x7fcc7c0fc450 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc7a59c640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc7c0fb180 0x7fcc7c066140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc79d9b640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c111980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007d20 tx=0x7fcc6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc72ffd640 1 -- 172.21.15.33:0/585704096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc6c009590 con 0x7fcc7c0fc450 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc72ffd640 1 -- 172.21.15.33:0/585704096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc6c0096f0 con 0x7fcc7c0fc450 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c112230 con 0x7fcc7c0fc450 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc72ffd640 1 -- 172.21.15.33:0/585704096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc6c03b6d0 con 0x7fcc7c0fc450 2024-02-15T22:38:50.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.944+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c112750 con 0x7fcc7c0fc450 2024-02-15T22:38:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.945+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c103cf0 con 0x7fcc7c0fc450 2024-02-15T22:38:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.945+0000 7fcc72ffd640 1 -- 172.21.15.33:0/585704096 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fcc6c02f070 con 0x7fcc7c0fc450 2024-02-15T22:38:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.946+0000 7fcc72ffd640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcc68069210 0x7fcc6806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.946+0000 7fcc72ffd640 1 -- 172.21.15.33:0/585704096 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcc6c0a9860 con 0x7fcc7c0fc450 2024-02-15T22:38:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.946+0000 7fcc7a59c640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcc68069210 0x7fcc6806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.946+0000 7fcc7a59c640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcc68069210 0x7fcc6806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc64004550 tx=0x7fcc64009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:50.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:50.950+0000 7fcc72ffd640 1 -- 172.21.15.33:0/585704096 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcc6c075b90 con 0x7fcc7c0fc450 2024-02-15T22:38:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.122+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fcc7c112a80 con 0x7fcc7c0fc450 2024-02-15T22:38:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.123+0000 7fcc72ffd640 1 -- 172.21.15.33:0/585704096 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcc6c0791b0 con 0x7fcc7c0fc450 2024-02-15T22:38:51.123 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcc68069210 msgr2=0x7fcc6806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcc68069210 0x7fcc6806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc64004550 tx=0x7fcc64009040 comp rx=0 tx=0).stop 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 msgr2=0x7fcc7c111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c111980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007d20 tx=0x7fcc6c009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 shutdown_connections 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fcc68069210 0x7fcc6806b6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc7c0fc450 0x7fcc7c111980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 --2- 172.21.15.33:0/585704096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc7c0fb180 0x7fcc7c066140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 >> 172.21.15.33:0/585704096 conn(0x7fcc7c0f6960 msgr2=0x7fcc7c0ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 shutdown_connections 2024-02-15T22:38:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.125+0000 7fcc8082e640 1 -- 172.21.15.33:0/585704096 wait complete. 2024-02-15T22:38:51.135 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:50 smithi033 ceph-mon[29033]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-15T22:38:51.135 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:50 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2869202200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:38:51.135 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:50 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/4241809856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:38:51.136 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 -- 172.21.15.33:0/1217087309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 msgr2=0x7f1c70101b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 --2- 172.21.15.33:0/1217087309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c70101b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1c640048d0 tx=0x7f1c64009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 -- 172.21.15.33:0/1217087309 shutdown_connections 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 --2- 172.21.15.33:0/1217087309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c70101b30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 --2- 172.21.15.33:0/1217087309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c700fce30 0x7f1c700ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 -- 172.21.15.33:0/1217087309 >> 172.21.15.33:0/1217087309 conn(0x7f1c700f68d0 msgr2=0x7f1c700f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 -- 172.21.15.33:0/1217087309 shutdown_connections 2024-02-15T22:38:51.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 -- 172.21.15.33:0/1217087309 wait complete. 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 Processor -- start 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 -- start start 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c700fce30 0x7f1c7010ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c7010f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.237+0000 7f1c7826e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7010f920 con 0x7f1c700ff750 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c7826e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c70114370 con 0x7f1c700fce30 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c75809640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c7010f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c75809640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c7010f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47300/0 (socket says 172.21.15.33:47300) 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c75809640 1 -- 172.21.15.33:0/3384370890 learned_addr learned my addr 172.21.15.33:0/3384370890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c75809640 1 -- 172.21.15.33:0/3384370890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c700fce30 msgr2=0x7f1c7010ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c75809640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c700fce30 0x7f1c7010ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c75809640 1 -- 172.21.15.33:0/3384370890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64005040 con 0x7f1c700ff750 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c75809640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c7010f2d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1c64034040 tx=0x7f1c64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c6effd640 1 -- 172.21.15.33:0/3384370890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c640094c0 con 0x7f1c700ff750 2024-02-15T22:38:51.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c6effd640 1 -- 172.21.15.33:0/3384370890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c64009620 con 0x7f1c700ff750 2024-02-15T22:38:51.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c701144b0 con 0x7f1c700ff750 2024-02-15T22:38:51.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c6effd640 1 -- 172.21.15.33:0/3384370890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c6403b640 con 0x7f1c700ff750 2024-02-15T22:38:51.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.238+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c701149a0 con 0x7f1c700ff750 2024-02-15T22:38:51.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.239+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c70104e30 con 0x7f1c700ff750 2024-02-15T22:38:51.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.240+0000 7f1c6effd640 1 -- 172.21.15.33:0/3384370890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f1c6402f070 con 0x7f1c700ff750 2024-02-15T22:38:51.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.240+0000 7f1c6effd640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1c58069210 0x7f1c5806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:51.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.240+0000 7f1c6effd640 1 -- 172.21.15.33:0/3384370890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1c640a96d0 con 0x7f1c700ff750 2024-02-15T22:38:51.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.240+0000 7f1c7600a640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1c58069210 0x7f1c5806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:51.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.241+0000 7f1c7600a640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1c58069210 0x7f1c5806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1c68004c80 tx=0x7f1c68009c50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.245+0000 7f1c6effd640 1 -- 172.21.15.33:0/3384370890 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1c64075a00 con 0x7f1c700ff750 2024-02-15T22:38:51.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:50 smithi082 ceph-mon[37153]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-15T22:38:51.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:50 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2869202200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:38:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:50 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/4241809856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:38:51.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.436+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f1c70114cd0 con 0x7f1c700ff750 2024-02-15T22:38:51.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.437+0000 7f1c6effd640 1 -- 172.21.15.33:0/3384370890 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1c64079020 con 0x7f1c700ff750 2024-02-15T22:38:51.437 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1c58069210 msgr2=0x7f1c5806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1c58069210 0x7f1c5806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1c68004c80 tx=0x7f1c68009c50 comp rx=0 tx=0).stop 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 msgr2=0x7f1c7010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c7010f2d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1c64034040 tx=0x7f1c64009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 shutdown_connections 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f1c58069210 0x7f1c5806b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c700ff750 0x7f1c7010f2d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 --2- 172.21.15.33:0/3384370890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c700fce30 0x7f1c7010ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 >> 172.21.15.33:0/3384370890 conn(0x7f1c700f68d0 msgr2=0x7f1c700fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 shutdown_connections 2024-02-15T22:38:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.439+0000 7f1c7826e640 1 -- 172.21.15.33:0/3384370890 wait complete. 2024-02-15T22:38:51.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T22:38:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 -- 172.21.15.33:0/1758272584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fb1d0 msgr2=0x7f90dc0fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 --2- 172.21.15.33:0/1758272584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fb1d0 0x7f90dc0fb5e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f90d80048d0 tx=0x7f90d8009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 -- 172.21.15.33:0/1758272584 shutdown_connections 2024-02-15T22:38:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 --2- 172.21.15.33:0/1758272584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90dc0fc400 0x7f90dc0fc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 --2- 172.21.15.33:0/1758272584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fb1d0 0x7f90dc0fb5e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 -- 172.21.15.33:0/1758272584 >> 172.21.15.33:0/1758272584 conn(0x7f90dc0f68d0 msgr2=0x7f90dc0f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 -- 172.21.15.33:0/1758272584 shutdown_connections 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 -- 172.21.15.33:0/1758272584 wait complete. 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 Processor -- start 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.555+0000 7f90e379d640 1 -- start start 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e379d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90dc0fb1d0 0x7f90dc065c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e379d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fc400 0x7f90dc1119c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e379d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc111f00 con 0x7f90dc0fc400 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e379d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc112040 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e0d38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fc400 0x7f90dc1119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e0d38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fc400 0x7f90dc1119c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47322/0 (socket says 172.21.15.33:47322) 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e1539640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90dc0fb1d0 0x7f90dc065c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e0d38640 1 -- 172.21.15.33:0/2256525083 learned_addr learned my addr 172.21.15.33:0/2256525083 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e1539640 1 -- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fc400 msgr2=0x7f90dc1119c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e1539640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fc400 0x7f90dc1119c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e1539640 1 -- 172.21.15.33:0/2256525083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8005040 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e0d38640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fc400 0x7f90dc1119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.556+0000 7f90e1539640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90dc0fb1d0 0x7f90dc065c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90d802be70 tx=0x7f90d8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.557+0000 7f90cdffb640 1 -- 172.21.15.33:0/2256525083 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d80094c0 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.557+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90dc112270 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.557+0000 7f90cdffb640 1 -- 172.21.15.33:0/2256525083 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90d8032e90 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.557+0000 7f90cdffb640 1 -- 172.21.15.33:0/2256525083 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d80435f0 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.557+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90dc112700 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.558+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90dc103d40 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.558+0000 7f90cdffb640 1 -- 172.21.15.33:0/2256525083 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f90d802f070 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.559+0000 7f90cdffb640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f90c8069220 0x7f90c806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.559+0000 7f90cdffb640 1 -- 172.21.15.33:0/2256525083 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f90d80a90a0 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.559+0000 7f90e0d38640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f90c8069220 0x7f90c806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.559+0000 7f90e0d38640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f90c8069220 0x7f90c806b6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90d0004fd0 tx=0x7f90d000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:51.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.564+0000 7f90cdffb640 1 -- 172.21.15.33:0/2256525083 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f90d8075400 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.779+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90dc112c00 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.780+0000 7f90cdffb640 1 -- 172.21.15.33:0/2256525083 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f90d8009620 con 0x7f90dc0fb1d0 2024-02-15T22:38:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:38:51.781 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:38:39.066363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6827/3373069689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3373069689},{"type":"v1","addr":"172.21.15.33:6827","nonce":3373069689}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi033.xkdegf","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.33:6829/1442215635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1442215635},{"type":"v1","addr":"172.21.15.33:6829","nonce":1442215635}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24295":{"gid":24295,"name":"cephfs.smithi082.lvpzpf","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6825/998691031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":998691031},{"type":"v1","addr":"172.21.15.82:6825","nonce":998691031}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24305":{"gid":24305,"name":"cephfs.smithi082.rtwnpu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6827/2744053727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2744053727},{"type":"v1","addr":"172.21.15.82:6827","nonce":2744053727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T22:38:51.781 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 18 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f90c8069220 msgr2=0x7f90c806b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f90c8069220 0x7f90c806b6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90d0004fd0 tx=0x7f90d000b040 comp rx=0 tx=0).stop 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90dc0fb1d0 msgr2=0x7f90dc065c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90dc0fb1d0 0x7f90dc065c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90d802be70 tx=0x7f90d8009da0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 shutdown_connections 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f90c8069220 0x7f90c806b6d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90dc0fc400 0x7f90dc1119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 --2- 172.21.15.33:0/2256525083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90dc0fb1d0 0x7f90dc065c00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 >> 172.21.15.33:0/2256525083 conn(0x7f90dc0f68d0 msgr2=0x7f90dc0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 shutdown_connections 2024-02-15T22:38:51.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:51.782+0000 7f90e379d640 1 -- 172.21.15.33:0/2256525083 wait complete. 2024-02-15T22:38:51.794 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 50} 2024-02-15T22:38:51.794 INFO:teuthology.run_tasks:Running task kclient... 2024-02-15T22:38:51.817 INFO:tasks.kclient:Mounting kernel clients... 2024-02-15T22:38:51.818 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-15T22:38:51.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:51.818 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-02-15T22:38:51.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:51.833 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-02-15T22:38:51.902 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-02-15T22:38:51.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:38:51.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:51.904 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-02-15T22:38:51.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:51.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-02-15T22:38:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-02-15T22:38:51.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:38:52.000 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-15T22:38:52.000 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-15T22:38:52.000 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-15T22:38:52.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph fs ls 2024-02-15T22:38:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:52.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/585704096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:38:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3384370890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:38:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:51 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2256525083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:38:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/585704096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:38:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3384370890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:38:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:38:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:38:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:38:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:51 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2256525083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:38:53.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:52 smithi033 ceph-mon[29033]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:38:53.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:52 smithi082 ceph-mon[37153]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:38:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 -- 172.21.15.33:0/3079811722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 msgr2=0x7fa744107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 --2- 172.21.15.33:0/3079811722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744107050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa734004970 tx=0x7fa734009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 -- 172.21.15.33:0/3079811722 shutdown_connections 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 --2- 172.21.15.33:0/3079811722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744107050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 --2- 172.21.15.33:0/3079811722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7440fdfe0 0x7fa7440fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 -- 172.21.15.33:0/3079811722 >> 172.21.15.33:0/3079811722 conn(0x7fa744071d90 msgr2=0x7fa744072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 -- 172.21.15.33:0/3079811722 shutdown_connections 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.911+0000 7fa749035700 1 -- 172.21.15.33:0/3079811722 wait complete. 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa749035700 1 Processor -- start 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa749035700 1 -- start start 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa749035700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7440fdfe0 0x7fa744113a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa749035700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa749035700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441145a0 con 0x7fa7440fe8f0 2024-02-15T22:38:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa749035700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74410d8d0 con 0x7fa7440fdfe0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa74259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa74259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47334/0 (socket says 172.21.15.33:47334) 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa74259c700 1 -- 172.21.15.33:0/2652215623 learned_addr learned my addr 172.21.15.33:0/2652215623 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa742d9d700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7440fdfe0 0x7fa744113a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa74259c700 1 -- 172.21.15.33:0/2652215623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7440fdfe0 msgr2=0x7fa744113a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa74259c700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7440fdfe0 0x7fa744113a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.912+0000 7fa74259c700 1 -- 172.21.15.33:0/2652215623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734005040 con 0x7fa7440fe8f0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.913+0000 7fa74259c700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744113f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa734000c00 tx=0x7fa734009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.913+0000 7fa72b7fe700 1 -- 172.21.15.33:0/2652215623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa73400e040 con 0x7fa7440fe8f0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.913+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74410db50 con 0x7fa7440fe8f0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.913+0000 7fa72b7fe700 1 -- 172.21.15.33:0/2652215623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa734009af0 con 0x7fa7440fe8f0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.913+0000 7fa72b7fe700 1 -- 172.21.15.33:0/2652215623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa73401c3f0 con 0x7fa7440fe8f0 2024-02-15T22:38:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.913+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74410e090 con 0x7fa7440fe8f0 2024-02-15T22:38:53.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.914+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7441046c0 con 0x7fa7440fe8f0 2024-02-15T22:38:53.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.914+0000 7fa72b7fe700 1 -- 172.21.15.33:0/2652215623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fa73400bc10 con 0x7fa7440fe8f0 2024-02-15T22:38:53.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.915+0000 7fa72b7fe700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa72c0692a0 0x7fa72c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:53.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.915+0000 7fa72b7fe700 1 -- 172.21.15.33:0/2652215623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa734088450 con 0x7fa7440fe8f0 2024-02-15T22:38:53.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.915+0000 7fa742d9d700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa72c0692a0 0x7fa72c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:53.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.915+0000 7fa742d9d700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa72c0692a0 0x7fa72c06b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa738004f60 tx=0x7fa73800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:53.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:53.919+0000 7fa72b7fe700 1 -- 172.21.15.33:0/2652215623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa734058190 con 0x7fa7440fe8f0 2024-02-15T22:38:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.158+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa74410a050 con 0x7fa7440fe8f0 2024-02-15T22:38:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.158+0000 7fa72b7fe700 1 -- 172.21.15.33:0/2652215623 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa734004de0 con 0x7fa7440fe8f0 2024-02-15T22:38:54.159 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa72c0692a0 msgr2=0x7fa72c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa72c0692a0 0x7fa72c06b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa738004f60 tx=0x7fa73800b040 comp rx=0 tx=0).stop 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 msgr2=0x7fa744113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744113f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa734000c00 tx=0x7fa734009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 shutdown_connections 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa72c0692a0 0x7fa72c06b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7440fdfe0 0x7fa744113a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 --2- 172.21.15.33:0/2652215623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7440fe8f0 0x7fa744113f50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 >> 172.21.15.33:0/2652215623 conn(0x7fa744071d90 msgr2=0x7fa744101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 shutdown_connections 2024-02-15T22:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:54.160+0000 7fa749035700 1 -- 172.21.15.33:0/2652215623 wait complete. 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T22:38:54.779 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-15T22:38:54.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:54.780 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:38:54.797 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42288sec preferred_lft 42288sec 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:54.798 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-02-15T22:38:54.799 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T22:38:54.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:54.799 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T22:38:54.799 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T22:38:54.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-02-15T22:38:54.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-02-15T22:38:54.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-02-15T22:38:54.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T22:38:54.799 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T22:38:54.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:54.958 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T22:38:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-02-15T22:38:54.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:54.987 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-02-15T22:38:55.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:54 smithi033 ceph-mon[29033]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:38:55.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:54 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2652215623' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:38:55.057 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-02-15T22:38:55.058 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T22:38:55.058 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-15T22:38:55.058 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-15T22:38:55.058 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T22:38:55.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.058 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T22:38:55.058 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T22:38:55.058 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-15T22:38:55.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-15T22:38:55.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-15T22:38:55.059 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T22:38:55.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.317 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-02-15T22:38:55.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.331 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-02-15T22:38:55.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:54 smithi082 ceph-mon[37153]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:38:55.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:54 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2652215623' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:38:55.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.385 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T22:38:55.386 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T22:38:55.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T22:38:55.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-15T22:38:55.386 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T22:38:55.468 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-15T22:38:55.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-15T22:38:55.469 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T22:38:55.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.611 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T22:38:55.611 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T22:38:55.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-02-15T22:38:55.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T22:38:55.611 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T22:38:55.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:38:55.652 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-15T22:38:55.707 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-15T22:38:55.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:38:55.707 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-15T22:38:55.761 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-15T22:38:55.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:38:55.859 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:38:55.859 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-15T22:38:55.859 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-02-15T22:38:55.969 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:38:55.969 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-15T22:38:55.969 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-02-15T22:38:55.969 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.82:3300" 2024-02-15T22:38:55.969 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:38:55.977 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:38:55.977 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-15T22:38:55.977 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-02-15T22:38:55.977 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.82:3300" 2024-02-15T22:38:55.977 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:38:55.977 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.82:6789" 2024-02-15T22:38:55.978 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.82:6789:/ 2024-02-15T22:38:55.978 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cfc49586-cc51-11ee-95ba-87774f69a715" will pass to kernel 2024-02-15T22:38:55.978 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-15T22:38:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-02-15T22:38:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-15T22:38:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-02-15T22:38:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-15T22:38:55.980 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T22:38:55.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:55.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-15T22:38:56.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:56.009 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:38:56.068 INFO:teuthology.orchestra.run.smithi033.stdout:client14530 2024-02-15T22:38:56.069 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:38:56.069 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:38:56.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:56.126 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:38:56.189 INFO:teuthology.orchestra.run.smithi033.stdout:client14530 2024-02-15T22:38:56.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:56.189 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:38:56.249 INFO:teuthology.orchestra.run.smithi033.stdout:client14530 2024-02-15T22:38:56.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:56.249 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cfc49586-cc51-11ee-95ba-87774f69a715.client14530/status') 2024-02-15T22:38:56.317 INFO:teuthology.orchestra.run.smithi033.stdout:instance: client.14530 (3)192.168.0.1:0/1910498570 2024-02-15T22:38:56.317 INFO:teuthology.orchestra.run.smithi033.stdout:blocklisted: false 2024-02-15T22:38:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records in 2024-02-15T22:38:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records out 2024-02-15T22:38:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:70 bytes copied, 2.4415e-05 s, 2.9 MB/s 2024-02-15T22:38:56.318 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-15T22:38:56.318 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-15T22:38:56.318 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-15T22:38:56.319 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- ceph fs ls 2024-02-15T22:38:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:38:57.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:56 smithi033 ceph-mon[29033]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:38:57.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:56 smithi082 ceph-mon[37153]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:38:58.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 -- 172.21.15.33:0/1549569772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870102800 msgr2=0x7fa8700fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:58.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 --2- 172.21.15.33:0/1549569772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870102800 0x7fa8700fbe70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa864004940 tx=0x7fa864009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:58.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 -- 172.21.15.33:0/1549569772 shutdown_connections 2024-02-15T22:38:58.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 --2- 172.21.15.33:0/1549569772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870102800 0x7fa8700fbe70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 --2- 172.21.15.33:0/1549569772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870101e60 0x7fa870102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 -- 172.21.15.33:0/1549569772 >> 172.21.15.33:0/1549569772 conn(0x7fa8700f7a10 msgr2=0x7fa8700f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 -- 172.21.15.33:0/1549569772 shutdown_connections 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 -- 172.21.15.33:0/1549569772 wait complete. 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 Processor -- start 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.293+0000 7fa8785e5700 1 -- start start 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa8785e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870101e60 0x7fa870113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa8785e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870102800 0x7fa870114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa8785e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870114700 con 0x7fa870101e60 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa8785e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87010d9a0 con 0x7fa870102800 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa876381700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870101e60 0x7fa870113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa876381700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870101e60 0x7fa870113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49758/0 (socket says 172.21.15.33:49758) 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa876381700 1 -- 172.21.15.33:0/648781114 learned_addr learned my addr 172.21.15.33:0/648781114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa875b80700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870102800 0x7fa870114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa876381700 1 -- 172.21.15.33:0/648781114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870102800 msgr2=0x7fa870114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa876381700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870102800 0x7fa870114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa876381700 1 -- 172.21.15.33:0/648781114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864005040 con 0x7fa870101e60 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa875b80700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870102800 0x7fa870114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa876381700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870101e60 0x7fa870113ae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa86800bbb0 tx=0x7fa868009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa86effd700 1 -- 172.21.15.33:0/648781114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8680092e0 con 0x7fa870101e60 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87010dc80 con 0x7fa870101e60 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa86effd700 1 -- 172.21.15.33:0/648781114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa86800cbd0 con 0x7fa870101e60 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.294+0000 7fa86effd700 1 -- 172.21.15.33:0/648781114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa868007400 con 0x7fa870101e60 2024-02-15T22:38:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.295+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87010e1c0 con 0x7fa870101e60 2024-02-15T22:38:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.296+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8700fb610 con 0x7fa870101e60 2024-02-15T22:38:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.296+0000 7fa86effd700 1 -- 172.21.15.33:0/648781114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fa868012070 con 0x7fa870101e60 2024-02-15T22:38:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.296+0000 7fa86effd700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa8580692a0 0x7fa85806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:38:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.296+0000 7fa86effd700 1 -- 172.21.15.33:0/648781114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa868086f90 con 0x7fa870101e60 2024-02-15T22:38:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.297+0000 7fa875b80700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa8580692a0 0x7fa85806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:38:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.297+0000 7fa875b80700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa8580692a0 0x7fa85806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b3b0 tx=0x7fa864009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:38:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.301+0000 7fa86effd700 1 -- 172.21.15.33:0/648781114 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa868056cd0 con 0x7fa870101e60 2024-02-15T22:38:58.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.538+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa87010f0c0 con 0x7fa870101e60 2024-02-15T22:38:58.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.539+0000 7fa86effd700 1 -- 172.21.15.33:0/648781114 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa868056860 con 0x7fa870101e60 2024-02-15T22:38:58.540 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T22:38:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa8580692a0 msgr2=0x7fa85806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa8580692a0 0x7fa85806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b3b0 tx=0x7fa864009e30 comp rx=0 tx=0).stop 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870101e60 msgr2=0x7fa870113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870101e60 0x7fa870113ae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa86800bbb0 tx=0x7fa868009840 comp rx=0 tx=0).stop 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 shutdown_connections 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fa8580692a0 0x7fa85806b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870101e60 0x7fa870113ae0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 --2- 172.21.15.33:0/648781114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa870102800 0x7fa870114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 >> 172.21.15.33:0/648781114 conn(0x7fa8700f7a10 msgr2=0x7fa870065ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 shutdown_connections 2024-02-15T22:38:58.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:38:58.541+0000 7fa8785e5700 1 -- 172.21.15.33:0/648781114 wait complete. 2024-02-15T22:38:59.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:58 smithi033 ceph-mon[29033]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:38:59.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:38:58 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/648781114' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T22:38:59.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T22:38:59.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-15T22:38:59.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.174 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-02-15T22:38:59.194 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T22:38:59.194 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T22:38:59.194 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T22:38:59.194 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:38:59.194 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-02-15T22:38:59.194 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-15T22:38:59.195 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42279sec preferred_lft 42279sec 2024-02-15T22:38:59.196 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-02-15T22:38:59.196 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:38:59.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T22:38:59.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.196 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-02-15T22:38:59.196 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-02-15T22:38:59.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-02-15T22:38:59.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-02-15T22:38:59.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-02-15T22:38:59.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T22:38:59.197 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-02-15T22:38:59.264 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:58 smithi082 ceph-mon[37153]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:38:59.264 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:38:58 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/648781114' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:38:59.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.372 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T22:38:59.439 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-02-15T22:38:59.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.441 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-02-15T22:38:59.509 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-02-15T22:38:59.509 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T22:38:59.509 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-15T22:38:59.509 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-15T22:38:59.509 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T22:38:59.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.509 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-02-15T22:38:59.510 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-02-15T22:38:59.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-15T22:38:59.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-15T22:38:59.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-15T22:38:59.510 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-02-15T22:38:59.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.773 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-02-15T22:38:59.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.789 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-02-15T22:38:59.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.843 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-02-15T22:38:59.843 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-02-15T22:38:59.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T22:38:59.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-15T22:38:59.843 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-02-15T22:38:59.926 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-15T22:38:59.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:38:59.926 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-02-15T22:38:59.926 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-02-15T22:38:59.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-15T22:38:59.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T22:38:59.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-15T22:38:59.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-15T22:38:59.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-15T22:38:59.927 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-02-15T22:39:00.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:39:00.056 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-02-15T22:39:00.056 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-02-15T22:39:00.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-02-15T22:39:00.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T22:39:00.056 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-02-15T22:39:00.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:39:00.097 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-15T22:39:00.153 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-15T22:39:00.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:39:00.153 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-15T22:39:00.207 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-15T22:39:00.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:39:00.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:39:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:39:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-15T22:39:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-02-15T22:39:00.418 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:39:00.418 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-15T22:39:00.418 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-02-15T22:39:00.418 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.82:3300" 2024-02-15T22:39:00.418 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:39:00.422 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:39:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-15T22:39:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-02-15T22:39:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.82:3300" 2024-02-15T22:39:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:39:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.82:6789" 2024-02-15T22:39:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.82:6789:/ 2024-02-15T22:39:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cfc49586-cc51-11ee-95ba-87774f69a715" will pass to kernel 2024-02-15T22:39:00.424 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-15T22:39:00.424 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-02-15T22:39:00.424 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-15T22:39:00.424 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-02-15T22:39:00.424 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-15T22:39:00.425 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T22:39:00.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:39:00.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-15T22:39:00.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:39:00.452 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi082.stdout:client14536 2024-02-15T22:39:00.508 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:39:00.508 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:39:00.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:39:00.565 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:39:00.622 INFO:teuthology.orchestra.run.smithi082.stdout:client14536 2024-02-15T22:39:00.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:39:00.622 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:39:00.678 INFO:teuthology.orchestra.run.smithi082.stdout:client14536 2024-02-15T22:39:00.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:39:00.678 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cfc49586-cc51-11ee-95ba-87774f69a715.client14536/status') 2024-02-15T22:39:00.745 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.14536 (3)172.21.15.82:0/2392367035 2024-02-15T22:39:00.745 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-02-15T22:39:00.745 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-02-15T22:39:00.745 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-02-15T22:39:00.745 INFO:teuthology.orchestra.run.smithi082.stderr:71 bytes copied, 2.1032e-05 s, 3.4 MB/s 2024-02-15T22:39:00.746 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:39:00.756 INFO:teuthology.task.print:**** done client 2024-02-15T22:39:00.757 INFO:teuthology.run_tasks:Running task parallel... 2024-02-15T22:39:00.771 INFO:teuthology.task.parallel:starting parallel... 2024-02-15T22:39:00.771 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T22:39:00.771 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:39:00.772 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:39:00.772 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-15T22:39:00.772 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T22:39:00.772 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-15T22:39:00.776 INFO:tasks.workunit:Pulling workunits from ref f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:00.776 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-15T22:39:00.776 INFO:tasks.workunit:timeout=3h 2024-02-15T22:39:00.776 INFO:tasks.workunit:cleanup=True 2024-02-15T22:39:00.776 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 94h/148d Inode: 1 Links: 2 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 22:38:27.003612001 +0000 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 22:38:56.006545147 +0000 2024-02-15T22:39:00.796 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-02-15 22:38:27.003612001 +0000 2024-02-15T22:39:00.797 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-15T22:39:00.797 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-15T22:39:00.869 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-02-15 22:39:00.863473583 +0000 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-02-15 22:39:00.863473583 +0000 2024-02-15T22:39:00.885 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-02-15 22:38:27.003612001 +0000 2024-02-15T22:39:00.885 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-15T22:39:00.885 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-15T22:39:00.955 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:00.955 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:00.970 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-15T22:39:01.011 INFO:tasks.workunit.client.1.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-15T22:39:01.054 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:39:01.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:00 smithi082 ceph-mon[37153]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:01.177 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:00 smithi033 ceph-mon[29033]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:02.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:02.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:02.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.735+0000 7f3b9d03d700 1 -- 172.21.15.33:0/2382010001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 msgr2=0x7f3b980fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:02.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.735+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/2382010001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fe700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c004940 tx=0x7f3b8c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:02.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.735+0000 7f3b9d03d700 1 -- 172.21.15.33:0/2382010001 shutdown_connections 2024-02-15T22:39:02.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.735+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/2382010001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fe700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.735+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/2382010001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980fb220 0x7f3b980fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.735+0000 7f3b9d03d700 1 -- 172.21.15.33:0/2382010001 >> 172.21.15.33:0/2382010001 conn(0x7f3b980f6ca0 msgr2=0x7f3b980f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 -- 172.21.15.33:0/2382010001 shutdown_connections 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 -- 172.21.15.33:0/2382010001 wait complete. 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 Processor -- start 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 -- start start 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980fb220 0x7f3b980fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980fc7c0 con 0x7f3b980fe2b0 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.736+0000 7f3b9d03d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980fc930 con 0x7f3b980fb220 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49766/0 (socket says 172.21.15.33:49766) 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9659c700 1 -- 172.21.15.33:0/22721359 learned_addr learned my addr 172.21.15.33:0/22721359 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b96d9d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980fb220 0x7f3b980fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9659c700 1 -- 172.21.15.33:0/22721359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980fb220 msgr2=0x7f3b980fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:02.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9659c700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980fb220 0x7f3b980fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:02.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9659c700 1 -- 172.21.15.33:0/22721359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c005040 con 0x7f3b980fe2b0 2024-02-15T22:39:02.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9659c700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fc1c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00b3b0 tx=0x7f3b8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:02.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b7f7fe700 1 -- 172.21.15.33:0/22721359 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c00e040 con 0x7f3b980fe2b0 2024-02-15T22:39:02.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b7f7fe700 1 -- 172.21.15.33:0/22721359 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b8c00bbf0 con 0x7f3b980fe2b0 2024-02-15T22:39:02.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980fcbb0 con 0x7f3b980fe2b0 2024-02-15T22:39:02.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b7f7fe700 1 -- 172.21.15.33:0/22721359 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c01c630 con 0x7f3b980fe2b0 2024-02-15T22:39:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.737+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b98115a40 con 0x7f3b980fe2b0 2024-02-15T22:39:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.738+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b98107a80 con 0x7f3b980fe2b0 2024-02-15T22:39:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.739+0000 7f3b7f7fe700 1 -- 172.21.15.33:0/22721359 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3b8c00bd60 con 0x7f3b980fe2b0 2024-02-15T22:39:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.739+0000 7f3b7f7fe700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b800692a0 0x7f3b8006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.739+0000 7f3b7f7fe700 1 -- 172.21.15.33:0/22721359 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3b8c088480 con 0x7f3b980fe2b0 2024-02-15T22:39:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.739+0000 7f3b96d9d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b800692a0 0x7f3b8006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.740+0000 7f3b96d9d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b800692a0 0x7f3b8006b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b980fdad0 tx=0x7f3b8800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:02.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.744+0000 7f3b7f7fe700 1 -- 172.21.15.33:0/22721359 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3b8c0582e0 con 0x7f3b980fe2b0 2024-02-15T22:39:02.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.937+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f3b9804bed0 con 0x7f3b980fe2b0 2024-02-15T22:39:02.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.937+0000 7f3b7f7fe700 1 -- 172.21.15.33:0/22721359 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f3b8c057e70 con 0x7f3b980fe2b0 2024-02-15T22:39:02.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b800692a0 msgr2=0x7f3b8006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b800692a0 0x7f3b8006b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b980fdad0 tx=0x7f3b8800b040 comp rx=0 tx=0).stop 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 msgr2=0x7f3b980fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fc1c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00b3b0 tx=0x7f3b8c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 shutdown_connections 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b800692a0 0x7f3b8006b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980fb220 0x7f3b980fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 --2- 172.21.15.33:0/22721359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b980fe2b0 0x7f3b980fc1c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 >> 172.21.15.33:0/22721359 conn(0x7f3b980f6ca0 msgr2=0x7f3b980f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 shutdown_connections 2024-02-15T22:39:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:02.939+0000 7f3b9d03d700 1 -- 172.21.15.33:0/22721359 wait complete. 2024-02-15T22:39:03.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:02 smithi033 ceph-mon[29033]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:03 smithi082 ceph-mon[37153]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:03.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-15T22:39:03.879 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:39:05.264 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:05 smithi033 ceph-mon[29033]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:05 smithi082 ceph-mon[37153]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.675+0000 7f2b93bcc700 1 -- 172.21.15.33:0/1191355772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 msgr2=0x7f2b8c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.675+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/1191355772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c0fd420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c004940 tx=0x7f2b7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.675+0000 7f2b93bcc700 1 -- 172.21.15.33:0/1191355772 shutdown_connections 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.675+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/1191355772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c0fd420 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.675+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/1191355772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0fbe40 0x7f2b8c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.675+0000 7f2b93bcc700 1 -- 172.21.15.33:0/1191355772 >> 172.21.15.33:0/1191355772 conn(0x7f2b8c0f7520 msgr2=0x7f2b8c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 -- 172.21.15.33:0/1191355772 shutdown_connections 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 -- 172.21.15.33:0/1191355772 wait complete. 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 Processor -- start 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 -- start start 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0fbe40 0x7f2b8c10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c10e470 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b93bcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c10ed10 con 0x7f2b8c0fbe40 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b91167700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b91167700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c10de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49780/0 (socket says 172.21.15.33:49780) 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.676+0000 7f2b91167700 1 -- 172.21.15.33:0/896232141 learned_addr learned my addr 172.21.15.33:0/896232141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b91968700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0fbe40 0x7f2b8c10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b91167700 1 -- 172.21.15.33:0/896232141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0fbe40 msgr2=0x7f2b8c10d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b91167700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0fbe40 0x7f2b8c10d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b91167700 1 -- 172.21.15.33:0/896232141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c005040 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b91167700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c10de70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0093b0 tx=0x7f2b7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b827fc700 1 -- 172.21.15.33:0/896232141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c00e040 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c10ef90 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b827fc700 1 -- 172.21.15.33:0/896232141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b7c00bcc0 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b827fc700 1 -- 172.21.15.33:0/896232141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c01c630 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.677+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c10f4d0 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.678+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c04bed0 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.679+0000 7f2b827fc700 1 -- 172.21.15.33:0/896232141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f2b7c013980 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.679+0000 7f2b827fc700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2b780692a0 0x7f2b7806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.679+0000 7f2b827fc700 1 -- 172.21.15.33:0/896232141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2b7c088500 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.679+0000 7f2b91968700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2b780692a0 0x7f2b7806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:05.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.679+0000 7f2b91968700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2b780692a0 0x7f2b7806b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b88004f40 tx=0x7f2b8800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:05.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.684+0000 7f2b827fc700 1 -- 172.21.15.33:0/896232141 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2b7c0582c0 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.877+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f2b8c104930 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.878+0000 7f2b827fc700 1 -- 172.21.15.33:0/896232141 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2b7c057e50 con 0x7f2b8c0fcfb0 2024-02-15T22:39:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.879+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2b780692a0 msgr2=0x7f2b7806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.879+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2b780692a0 0x7f2b7806b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b88004f40 tx=0x7f2b8800b040 comp rx=0 tx=0).stop 2024-02-15T22:39:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.879+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 msgr2=0x7f2b8c10de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.879+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c10de70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0093b0 tx=0x7f2b7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.880+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 shutdown_connections 2024-02-15T22:39:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.880+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2b780692a0 0x7f2b7806b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.880+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0fbe40 0x7f2b8c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.880+0000 7f2b93bcc700 1 --2- 172.21.15.33:0/896232141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b8c0fcfb0 0x7f2b8c10de70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.880+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 >> 172.21.15.33:0/896232141 conn(0x7f2b8c0f7520 msgr2=0x7f2b8c065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.880+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 shutdown_connections 2024-02-15T22:39:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:05.880+0000 7f2b93bcc700 1 -- 172.21.15.33:0/896232141 wait complete. 2024-02-15T22:39:06.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-15T22:39:06.993 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:39:07.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:07 smithi033 ceph-mon[29033]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-02-15T22:39:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:07 smithi082 ceph-mon[37153]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-02-15T22:39:08.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.682+0000 7f3b7064b700 1 -- 172.21.15.33:0/2507424848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 msgr2=0x7f3b680fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:08.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.682+0000 7f3b7064b700 1 --2- 172.21.15.33:0/2507424848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b680fd420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3b58004940 tx=0x7f3b58009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:08.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.682+0000 7f3b7064b700 1 -- 172.21.15.33:0/2507424848 shutdown_connections 2024-02-15T22:39:08.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.682+0000 7f3b7064b700 1 --2- 172.21.15.33:0/2507424848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b680fd420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:08.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.682+0000 7f3b7064b700 1 --2- 172.21.15.33:0/2507424848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b680fbe40 0x7f3b680fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:08.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.682+0000 7f3b7064b700 1 -- 172.21.15.33:0/2507424848 >> 172.21.15.33:0/2507424848 conn(0x7f3b680f7520 msgr2=0x7f3b680f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:08.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 -- 172.21.15.33:0/2507424848 shutdown_connections 2024-02-15T22:39:08.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 -- 172.21.15.33:0/2507424848 wait complete. 2024-02-15T22:39:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 Processor -- start 2024-02-15T22:39:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 -- start start 2024-02-15T22:39:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b680fbe40 0x7f3b68112a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b68114fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68066be0 con 0x7f3b680fcfb0 2024-02-15T22:39:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b7064b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68066d20 con 0x7f3b680fbe40 2024-02-15T22:39:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b6dbe6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b68114fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b6dbe6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b68114fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56388/0 (socket says 172.21.15.33:56388) 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.683+0000 7f3b6dbe6700 1 -- 172.21.15.33:0/3525441394 learned_addr learned my addr 172.21.15.33:0/3525441394 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b6e3e7700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b680fbe40 0x7f3b68112a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b6dbe6700 1 -- 172.21.15.33:0/3525441394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b680fbe40 msgr2=0x7f3b68112a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b6dbe6700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b680fbe40 0x7f3b68112a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b6dbe6700 1 -- 172.21.15.33:0/3525441394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58005040 con 0x7f3b680fcfb0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b6dbe6700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b68114fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009fd0 tx=0x7f3b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b5effd700 1 -- 172.21.15.33:0/3525441394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5800e040 con 0x7f3b680fcfb0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b5effd700 1 -- 172.21.15.33:0/3525441394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b5800bcc0 con 0x7f3b680fcfb0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.684+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b681154f0 con 0x7f3b680fcfb0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.685+0000 7f3b5effd700 1 -- 172.21.15.33:0/3525441394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5801c630 con 0x7f3b680fcfb0 2024-02-15T22:39:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.685+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b68115890 con 0x7f3b680fcfb0 2024-02-15T22:39:08.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.686+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6804bed0 con 0x7f3b680fcfb0 2024-02-15T22:39:08.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.686+0000 7f3b5effd700 1 -- 172.21.15.33:0/3525441394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3b58013420 con 0x7f3b680fcfb0 2024-02-15T22:39:08.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.686+0000 7f3b5effd700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b540692b0 0x7f3b5406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:08.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.686+0000 7f3b5effd700 1 -- 172.21.15.33:0/3525441394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3b580884d0 con 0x7f3b680fcfb0 2024-02-15T22:39:08.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.686+0000 7f3b6e3e7700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b540692b0 0x7f3b5406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:08.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.687+0000 7f3b6e3e7700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b540692b0 0x7f3b5406b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b68066970 tx=0x7f3b6400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:08.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.691+0000 7f3b5effd700 1 -- 172.21.15.33:0/3525441394 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3b580548a0 con 0x7f3b680fcfb0 2024-02-15T22:39:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.881+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f3b68104930 con 0x7f3b680fcfb0 2024-02-15T22:39:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.881+0000 7f3b5effd700 1 -- 172.21.15.33:0/3525441394 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3b58054020 con 0x7f3b680fcfb0 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b540692b0 msgr2=0x7f3b5406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b540692b0 0x7f3b5406b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b68066970 tx=0x7f3b6400b040 comp rx=0 tx=0).stop 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 msgr2=0x7f3b68114fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b68114fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009fd0 tx=0x7f3b58009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 shutdown_connections 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3b540692b0 0x7f3b5406b760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b680fbe40 0x7f3b68112a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:08.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 --2- 172.21.15.33:0/3525441394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b680fcfb0 0x7f3b68114fb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:08.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 >> 172.21.15.33:0/3525441394 conn(0x7f3b680f7520 msgr2=0x7f3b68100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:08.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.883+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 shutdown_connections 2024-02-15T22:39:08.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:08.884+0000 7f3b7064b700 1 -- 172.21.15.33:0/3525441394 wait complete. 2024-02-15T22:39:09.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:08 smithi033 ceph-mon[29033]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-15T22:39:09.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:08 smithi082 ceph-mon[37153]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-15T22:39:09.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-15T22:39:09.877 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:39:11.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:10 smithi033 ceph-mon[29033]: pgmap v203: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-02-15T22:39:11.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:10 smithi082 ceph-mon[37153]: pgmap v203: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-02-15T22:39:11.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 -- 172.21.15.33:0/3975257820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874070840 msgr2=0x7ff874070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:11.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 --2- 172.21.15.33:0/3975257820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874070840 0x7ff874070cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff85c004940 tx=0x7ff85c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 -- 172.21.15.33:0/3975257820 shutdown_connections 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 --2- 172.21.15.33:0/3975257820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874070840 0x7ff874070cb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 --2- 172.21.15.33:0/3975257820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff874071df0 0x7ff874070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 -- 172.21.15.33:0/3975257820 >> 172.21.15.33:0/3975257820 conn(0x7ff8740f86b0 msgr2=0x7ff8740faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 -- 172.21.15.33:0/3975257820 shutdown_connections 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 -- 172.21.15.33:0/3975257820 wait complete. 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.497+0000 7ff879f5e700 1 Processor -- start 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff879f5e700 1 -- start start 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff879f5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff874070840 0x7ff87410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff879f5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874071df0 0x7ff874110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff879f5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874110680 con 0x7ff874071df0 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff879f5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874110f20 con 0x7ff874070840 2024-02-15T22:39:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff872ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874071df0 0x7ff874110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff872ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874071df0 0x7ff874110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56412/0 (socket says 172.21.15.33:56412) 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff872ffd700 1 -- 172.21.15.33:0/71192511 learned_addr learned my addr 172.21.15.33:0/71192511 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff8737fe700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff874070840 0x7ff87410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff872ffd700 1 -- 172.21.15.33:0/71192511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff874070840 msgr2=0x7ff87410fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff872ffd700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff874070840 0x7ff87410fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff872ffd700 1 -- 172.21.15.33:0/71192511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c005040 con 0x7ff874071df0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.498+0000 7ff872ffd700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874071df0 0x7ff874110080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0093b0 tx=0x7ff85c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.499+0000 7ff86bfff700 1 -- 172.21.15.33:0/71192511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85c00e040 con 0x7ff874071df0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.499+0000 7ff86bfff700 1 -- 172.21.15.33:0/71192511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff85c00bcc0 con 0x7ff874071df0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.499+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8741111a0 con 0x7ff874071df0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.499+0000 7ff86bfff700 1 -- 172.21.15.33:0/71192511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85c01c630 con 0x7ff874071df0 2024-02-15T22:39:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.499+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8741116e0 con 0x7ff874071df0 2024-02-15T22:39:11.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.500+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87404bed0 con 0x7ff874071df0 2024-02-15T22:39:11.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.500+0000 7ff86bfff700 1 -- 172.21.15.33:0/71192511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7ff85c01c790 con 0x7ff874071df0 2024-02-15T22:39:11.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.500+0000 7ff86bfff700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff8600692a0 0x7ff86006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:11.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.501+0000 7ff86bfff700 1 -- 172.21.15.33:0/71192511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff85c088500 con 0x7ff874071df0 2024-02-15T22:39:11.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.501+0000 7ff8737fe700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff8600692a0 0x7ff86006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:11.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.501+0000 7ff8737fe700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff8600692a0 0x7ff86006b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff874071b30 tx=0x7ff86c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:11.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.505+0000 7ff86bfff700 1 -- 172.21.15.33:0/71192511 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff85c058360 con 0x7ff874071df0 2024-02-15T22:39:11.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:11.716+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff874111b80 con 0x7ff8600692a0 2024-02-15T22:39:13.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:12 smithi033 ceph-mon[29033]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:13.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:12 smithi033 ceph-mon[29033]: pgmap v204: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-02-15T22:39:13.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:12 smithi082 ceph-mon[37153]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:13.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:12 smithi082 ceph-mon[37153]: pgmap v204: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-02-15T22:39:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:14 smithi033 ceph-mon[29033]: pgmap v205: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:39:15.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:14 smithi082 ceph-mon[37153]: pgmap v205: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:39:17.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:16 smithi033 ceph-mon[29033]: pgmap v206: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:39:17.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:16 smithi082 ceph-mon[37153]: pgmap v206: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:39:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:18 smithi033 ceph-mon[29033]: pgmap v207: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:39:19.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:18 smithi082 ceph-mon[37153]: pgmap v207: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:39:21.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:20 smithi033 ceph-mon[29033]: pgmap v208: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:21.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:20 smithi082 ceph-mon[37153]: pgmap v208: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:23.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:22 smithi033 ceph-mon[29033]: pgmap v209: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:23.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:22 smithi082 ceph-mon[37153]: pgmap v209: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:25.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:24 smithi033 ceph-mon[29033]: pgmap v210: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:39:25.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:24 smithi082 ceph-mon[37153]: pgmap v210: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:39:27.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:26 smithi033 ceph-mon[29033]: pgmap v211: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:27.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:26 smithi082 ceph-mon[37153]: pgmap v211: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:29.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:28 smithi033 ceph-mon[29033]: pgmap v212: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:39:29.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:28 smithi082 ceph-mon[37153]: pgmap v212: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:39:31.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:30 smithi033 ceph-mon[29033]: pgmap v213: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:30 smithi082 ceph-mon[37153]: pgmap v213: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:31 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:32.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:31 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:33.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:32 smithi033 ceph-mon[29033]: pgmap v214: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:33.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:32 smithi082 ceph-mon[37153]: pgmap v214: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:39:35.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:34 smithi033 ceph-mon[29033]: pgmap v215: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:39:35.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:34 smithi082 ceph-mon[37153]: pgmap v215: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:39:37.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:36 smithi033 ceph-mon[29033]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-15T22:39:37.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:36 smithi082 ceph-mon[37153]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-15T22:39:39.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:38 smithi033 ceph-mon[29033]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-02-15T22:39:39.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:38 smithi082 ceph-mon[37153]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-02-15T22:39:41.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:40 smithi033 ceph-mon[29033]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:41.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:40 smithi082 ceph-mon[37153]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.131+0000 7ff86bfff700 1 -- 172.21.15.33:0/71192511 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff874111b80 con 0x7ff8600692a0 2024-02-15T22:39:43.133 INFO:teuthology.orchestra.run.smithi033.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff8600692a0 msgr2=0x7ff86006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff8600692a0 0x7ff86006b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff874071b30 tx=0x7ff86c00b040 comp rx=0 tx=0).stop 2024-02-15T22:39:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874071df0 msgr2=0x7ff874110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874071df0 0x7ff874110080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0093b0 tx=0x7ff85c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 shutdown_connections 2024-02-15T22:39:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff8600692a0 0x7ff86006b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff874070840 0x7ff87410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 --2- 172.21.15.33:0/71192511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff874071df0 0x7ff874110080 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.133+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 >> 172.21.15.33:0/71192511 conn(0x7ff8740f86b0 msgr2=0x7ff874102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.134+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 shutdown_connections 2024-02-15T22:39:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:43.134+0000 7ff879f5e700 1 -- 172.21.15.33:0/71192511 wait complete. 2024-02-15T22:39:43.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:42 smithi033 ceph-mon[29033]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:43.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:42 smithi082 ceph-mon[37153]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:43.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-15T22:39:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:39:44.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:44 smithi033 ceph-mon[29033]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:44.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:44.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:39:44.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:39:44.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:39:44.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:44 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:44.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:44 smithi082 ceph-mon[37153]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:44.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:44.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:39:44.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:39:44.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:39:44.546 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:44 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:45.375 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:45 smithi033 ceph-mon[29033]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:45.375 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:45 smithi033 ceph-mon[29033]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:45.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:45 smithi082 ceph-mon[37153]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:39:45.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:45 smithi082 ceph-mon[37153]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:39:47.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-15T22:39:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-15T22:39:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:39:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:39:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: Upgrade: Need to upgrade myself (mgr.smithi033.swohxi) 2024-02-15T22:39:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:47 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: Upgrade: Need to upgrade myself (mgr.smithi033.swohxi) 2024-02-15T22:39:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:47 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:39:48.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:48 smithi033 ceph-mon[29033]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi082 2024-02-15T22:39:48.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:48 smithi082 ceph-mon[37153]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi082 2024-02-15T22:39:49.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:49 smithi033 ceph-mon[29033]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T22:39:49.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:49 smithi082 ceph-mon[37153]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T22:39:49.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 -- 172.21.15.33:0/2501976931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb80fda80 msgr2=0x7f6fb80ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:49.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2501976931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb80fda80 0x7f6fb80ffe60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4004940 tx=0x7f6fb4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:49.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 -- 172.21.15.33:0/2501976931 shutdown_connections 2024-02-15T22:39:49.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2501976931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fb81003a0 0x7f6fb8102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:49.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2501976931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb80fda80 0x7f6fb80ffe60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:49.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 -- 172.21.15.33:0/2501976931 >> 172.21.15.33:0/2501976931 conn(0x7f6fb80f74e0 msgr2=0x7f6fb80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 -- 172.21.15.33:0/2501976931 shutdown_connections 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.825+0000 7f6fc0209700 1 -- 172.21.15.33:0/2501976931 wait complete. 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fc0209700 1 Processor -- start 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fc0209700 1 -- start start 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fc0209700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fb80fda80 0x7f6fb80fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fc0209700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb81003a0 0x7f6fb80fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fc0209700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80fbf90 con 0x7f6fb81003a0 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fc0209700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80fc100 con 0x7f6fb80fda80 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fbd7a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb81003a0 0x7f6fb80fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fbd7a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb81003a0 0x7f6fb80fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36742/0 (socket says 172.21.15.33:36742) 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fbd7a4700 1 -- 172.21.15.33:0/2446211954 learned_addr learned my addr 172.21.15.33:0/2446211954 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fbdfa5700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fb80fda80 0x7f6fb80fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fbd7a4700 1 -- 172.21.15.33:0/2446211954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fb80fda80 msgr2=0x7f6fb80fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fbd7a4700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fb80fda80 0x7f6fb80fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.826+0000 7f6fbd7a4700 1 -- 172.21.15.33:0/2446211954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4005040 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.827+0000 7f6fbd7a4700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb81003a0 0x7f6fb80fb990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800eb40 tx=0x7f6fa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.827+0000 7f6fae7fc700 1 -- 172.21.15.33:0/2446211954 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa8007cc0 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.827+0000 7f6fae7fc700 1 -- 172.21.15.33:0/2446211954 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fa800f040 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.827+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80fc380 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.827+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb81158f0 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.828+0000 7f6fae7fc700 1 -- 172.21.15.33:0/2446211954 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa800ca10 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.828+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb8107a50 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.829+0000 7f6fae7fc700 1 -- 172.21.15.33:0/2446211954 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f6fa800cb70 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.829+0000 7f6fae7fc700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6fa40690a0 0x7f6fa406b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.829+0000 7f6fae7fc700 1 -- 172.21.15.33:0/2446211954 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6fa8086c40 con 0x7f6fb81003a0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.831+0000 7f6fbdfa5700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6fa40690a0 0x7f6fa406b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.832+0000 7f6fbdfa5700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6fa40690a0 0x7f6fa406b550 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000c00 tx=0x7f6fb4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:49.837+0000 7f6fae7fc700 1 -- 172.21.15.33:0/2446211954 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6fa8056770 con 0x7f6fb81003a0 2024-02-15T22:39:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.146+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fb802b3b0 con 0x7f6fa40690a0 2024-02-15T22:39:50.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.148+0000 7f6fae7fc700 1 -- 172.21.15.33:0/2446211954 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f6fb802b3b0 con 0x7f6fa40690a0 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6fa40690a0 msgr2=0x7f6fa406b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6fa40690a0 0x7f6fa406b550 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000c00 tx=0x7f6fb4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb81003a0 msgr2=0x7f6fb80fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb81003a0 0x7f6fb80fb990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800eb40 tx=0x7f6fa800b040 comp rx=0 tx=0).stop 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 shutdown_connections 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6fa40690a0 0x7f6fa406b550 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fb80fda80 0x7f6fb80fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 --2- 172.21.15.33:0/2446211954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb81003a0 0x7f6fb80fb990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 >> 172.21.15.33:0/2446211954 conn(0x7f6fb80f74e0 msgr2=0x7f6fb80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 shutdown_connections 2024-02-15T22:39:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.150+0000 7f6fc0209700 1 -- 172.21.15.33:0/2446211954 wait complete. 2024-02-15T22:39:50.164 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.310+0000 7f3ad481f700 1 -- 172.21.15.33:0/4071518990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fcfb0 msgr2=0x7f3ad00fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.310+0000 7f3ad481f700 1 --2- 172.21.15.33:0/4071518990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fcfb0 0x7f3ad00fd420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4004940 tx=0x7f3ac4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.311+0000 7f3ad481f700 1 -- 172.21.15.33:0/4071518990 shutdown_connections 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.311+0000 7f3ad481f700 1 --2- 172.21.15.33:0/4071518990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fcfb0 0x7f3ad00fd420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.311+0000 7f3ad481f700 1 --2- 172.21.15.33:0/4071518990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ad00fbe40 0x7f3ad00fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.311+0000 7f3ad481f700 1 -- 172.21.15.33:0/4071518990 >> 172.21.15.33:0/4071518990 conn(0x7f3ad00f74e0 msgr2=0x7f3ad00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.311+0000 7f3ad481f700 1 -- 172.21.15.33:0/4071518990 shutdown_connections 2024-02-15T22:39:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.311+0000 7f3ad481f700 1 -- 172.21.15.33:0/4071518990 wait complete. 2024-02-15T22:39:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.312+0000 7f3ad481f700 1 Processor -- start 2024-02-15T22:39:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.312+0000 7f3ad481f700 1 -- start start 2024-02-15T22:39:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.312+0000 7f3ad481f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fbe40 0x7f3ad0113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.312+0000 7f3ad481f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ad00fcfb0 0x7f3ad0114410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ace59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fbe40 0x7f3ad0113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ace59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fbe40 0x7f3ad0113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36760/0 (socket says 172.21.15.33:36760) 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ace59c700 1 -- 172.21.15.33:0/1468173921 learned_addr learned my addr 172.21.15.33:0/1468173921 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3acdd9b700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ad00fcfb0 0x7f3ad0114410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ad481f700 1 -- 172.21.15.33:0/1468173921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0114a10 con 0x7f3ad00fbe40 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ad481f700 1 -- 172.21.15.33:0/1468173921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01152b0 con 0x7f3ad00fcfb0 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ace59c700 1 -- 172.21.15.33:0/1468173921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ad00fcfb0 msgr2=0x7f3ad0114410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ace59c700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ad00fcfb0 0x7f3ad0114410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.313+0000 7f3ace59c700 1 -- 172.21.15.33:0/1468173921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4005040 con 0x7f3ad00fbe40 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.314+0000 7f3ace59c700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fbe40 0x7f3ad0113ed0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000eb40 tx=0x7f3ac000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.314+0000 7f3abeffd700 1 -- 172.21.15.33:0/1468173921 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac0007cc0 con 0x7f3ad00fbe40 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.314+0000 7f3abeffd700 1 -- 172.21.15.33:0/1468173921 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ac000f040 con 0x7f3ad00fbe40 2024-02-15T22:39:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.314+0000 7f3ad481f700 1 -- 172.21.15.33:0/1468173921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad0115530 con 0x7f3ad00fbe40 2024-02-15T22:39:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.315+0000 7f3abeffd700 1 -- 172.21.15.33:0/1468173921 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac000ca10 con 0x7f3ad00fbe40 2024-02-15T22:39:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.315+0000 7f3ad481f700 1 -- 172.21.15.33:0/1468173921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad0115a70 con 0x7f3ad00fbe40 2024-02-15T22:39:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.316+0000 7f3abeffd700 1 -- 172.21.15.33:0/1468173921 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3ac000cc30 con 0x7f3ad00fbe40 2024-02-15T22:39:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.316+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab40052b0 con 0x7f3ad00fbe40 2024-02-15T22:39:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.317+0000 7f3abeffd700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3ab80690f0 0x7f3ab806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.317+0000 7f3abeffd700 1 -- 172.21.15.33:0/1468173921 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3ac008b170 con 0x7f3ad00fbe40 2024-02-15T22:39:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.317+0000 7f3acdd9b700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3ab80690f0 0x7f3ab806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.318+0000 7f3acdd9b700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3ab80690f0 0x7f3ab806b5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40137b0 tx=0x7f3ac4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.322+0000 7f3abeffd700 1 -- 172.21.15.33:0/1468173921 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3ac008c060 con 0x7f3ad00fbe40 2024-02-15T22:39:50.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.623+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ab4000bc0 con 0x7f3ab80690f0 2024-02-15T22:39:50.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.624+0000 7f3abeffd700 1 -- 172.21.15.33:0/1468173921 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f3ab4000bc0 con 0x7f3ab80690f0 2024-02-15T22:39:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3ab80690f0 msgr2=0x7f3ab806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3ab80690f0 0x7f3ab806b5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40137b0 tx=0x7f3ac4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fbe40 msgr2=0x7f3ad0113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fbe40 0x7f3ad0113ed0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000eb40 tx=0x7f3ac000b040 comp rx=0 tx=0).stop 2024-02-15T22:39:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 shutdown_connections 2024-02-15T22:39:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f3ab80690f0 0x7f3ab806b5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00fbe40 0x7f3ad0113ed0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 --2- 172.21.15.33:0/1468173921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ad00fcfb0 0x7f3ad0114410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 >> 172.21.15.33:0/1468173921 conn(0x7f3ad00f74e0 msgr2=0x7f3ad0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:50.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 shutdown_connections 2024-02-15T22:39:50.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.627+0000 7f3abcff9700 1 -- 172.21.15.33:0/1468173921 wait complete. 2024-02-15T22:39:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 -- 172.21.15.33:0/3459226210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c0fda90 msgr2=0x7ff33c0ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 --2- 172.21.15.33:0/3459226210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c0fda90 0x7ff33c0ffe70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff32c004880 tx=0x7ff32c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 -- 172.21.15.33:0/3459226210 shutdown_connections 2024-02-15T22:39:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 --2- 172.21.15.33:0/3459226210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c1003b0 0x7ff33c102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 --2- 172.21.15.33:0/3459226210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c0fda90 0x7ff33c0ffe70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 -- 172.21.15.33:0/3459226210 >> 172.21.15.33:0/3459226210 conn(0x7ff33c0f7510 msgr2=0x7ff33c0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 -- 172.21.15.33:0/3459226210 shutdown_connections 2024-02-15T22:39:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.763+0000 7ff3419fa700 1 -- 172.21.15.33:0/3459226210 wait complete. 2024-02-15T22:39:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff3419fa700 1 Processor -- start 2024-02-15T22:39:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff3419fa700 1 -- start start 2024-02-15T22:39:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff3419fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c0fda90 0x7ff33c10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff3419fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c1003b0 0x7ff33c10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff3419fa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c10e430 con 0x7ff33c0fda90 2024-02-15T22:39:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff3419fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c10ecd0 con 0x7ff33c1003b0 2024-02-15T22:39:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff33a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c1003b0 0x7ff33c10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff33affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c0fda90 0x7ff33c10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff33affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c0fda90 0x7ff33c10d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36778/0 (socket says 172.21.15.33:36778) 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff33affd700 1 -- 172.21.15.33:0/899627585 learned_addr learned my addr 172.21.15.33:0/899627585 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.764+0000 7ff33a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c1003b0 0x7ff33c10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:35996/0 (socket says 172.21.15.33:35996) 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff33affd700 1 -- 172.21.15.33:0/899627585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c1003b0 msgr2=0x7ff33c10de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff33affd700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c1003b0 0x7ff33c10de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff33affd700 1 -- 172.21.15.33:0/899627585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330005040 con 0x7ff33c0fda90 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff33affd700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c0fda90 0x7ff33c10d8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0137c0 tx=0x7ff32c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff3237fe700 1 -- 172.21.15.33:0/899627585 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32c00e040 con 0x7ff33c0fda90 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c005040 con 0x7ff33c0fda90 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff3237fe700 1 -- 172.21.15.33:0/899627585 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff32c009220 con 0x7ff33c0fda90 2024-02-15T22:39:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.765+0000 7ff3237fe700 1 -- 172.21.15.33:0/899627585 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32c013bf0 con 0x7ff33c0fda90 2024-02-15T22:39:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.766+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c10f2a0 con 0x7ff33c0fda90 2024-02-15T22:39:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.767+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c04bed0 con 0x7ff33c0fda90 2024-02-15T22:39:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.767+0000 7ff3237fe700 1 -- 172.21.15.33:0/899627585 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7ff32c01c990 con 0x7ff33c0fda90 2024-02-15T22:39:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.768+0000 7ff3237fe700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff324069310 0x7ff32406b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.768+0000 7ff3237fe700 1 -- 172.21.15.33:0/899627585 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff32c0887e0 con 0x7ff33c0fda90 2024-02-15T22:39:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.768+0000 7ff33a7fc700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff324069310 0x7ff32406b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.769+0000 7ff33a7fc700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff324069310 0x7ff32406b7c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff330009fd0 tx=0x7ff33000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:50.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:50.773+0000 7ff3237fe700 1 -- 172.21.15.33:0/899627585 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff32c058520 con 0x7ff33c0fda90 2024-02-15T22:39:51.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.142+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff33c0008d0 con 0x7ff324069310 2024-02-15T22:39:51.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.153+0000 7ff3237fe700 1 -- 172.21.15.33:0/899627585 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7ff33c0008d0 con 0x7ff324069310 2024-02-15T22:39:51.153 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:39:51.153 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (5m) 59s ago 7m 25.4M - 0.25.0 c8568f914cd2 229a38709f4a 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 59s ago 7m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (6m) 64s ago 6m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (5m) 59s ago 6m 81.5M - 9.4.7 954c08fa6188 4e1a6363851b 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (85s) 59s ago 84s 14.9M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (79s) 59s ago 79s 15.5M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (82s) 64s ago 82s 15.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (77s) 64s ago 76s 15.5M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:9283 running (8m) 59s ago 8m 481M - 17.2.7-509-g9aa52330 61c0ec9cd187 4de1acba28ab 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283 running (5m) 64s ago 5m 435M - 17.2.7-509-g9aa52330 61c0ec9cd187 7c9a30ed03d3 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (8m) 59s ago 8m 47.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (5m) 64s ago 5m 35.8M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:39:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (7m) 59s ago 7m 16.1M - 1.5.0 0da6a335fe13 edf3c832a7c2 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 64s ago 6m 17.1M - 1.5.0 0da6a335fe13 e8b1514d760c 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 59s ago 5m 46.7M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (4m) 59s ago 4m 46.4M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 59s ago 4m 44.0M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (3m) 64s ago 3m 46.9M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (3m) 64s ago 3m 44.4M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (2m) 64s ago 2m 41.1M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:39:51.155 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 59s ago 6m 54.6M - 2.43.0 a07b618ecd1d fcda9c48f34e 2024-02-15T22:39:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff324069310 msgr2=0x7ff32406b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff324069310 0x7ff32406b7c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff330009fd0 tx=0x7ff33000b040 comp rx=0 tx=0).stop 2024-02-15T22:39:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c0fda90 msgr2=0x7ff33c10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c0fda90 0x7ff33c10d8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0137c0 tx=0x7ff32c009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 shutdown_connections 2024-02-15T22:39:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7ff324069310 0x7ff32406b7c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff33c0fda90 0x7ff33c10d8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 --2- 172.21.15.33:0/899627585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff33c1003b0 0x7ff33c10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.155+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 >> 172.21.15.33:0/899627585 conn(0x7ff33c0f7510 msgr2=0x7ff33c0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.156+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 shutdown_connections 2024-02-15T22:39:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.156+0000 7ff3419fa700 1 -- 172.21.15.33:0/899627585 wait complete. 2024-02-15T22:39:51.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/1979815489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc01003b0 msgr2=0x7f9fc0102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:51.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/1979815489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc01003b0 0x7f9fc0102790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4004940 tx=0x7f9fb4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:51.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/1979815489 shutdown_connections 2024-02-15T22:39:51.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/1979815489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc01003b0 0x7f9fc0102790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/1979815489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc00fda90 0x7f9fc00ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/1979815489 >> 172.21.15.33:0/1979815489 conn(0x7f9fc00f7510 msgr2=0x7f9fc00f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:51.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/1979815489 shutdown_connections 2024-02-15T22:39:51.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.316+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/1979815489 wait complete. 2024-02-15T22:39:51.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.317+0000 7f9fc5e0a700 1 Processor -- start 2024-02-15T22:39:51.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.317+0000 7f9fc5e0a700 1 -- start start 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.317+0000 7f9fc5e0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00fda90 0x7f9fc00fd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.317+0000 7f9fc5e0a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01003b0 0x7f9fc00fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fc5e0a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01115b0 con 0x7f9fc00fda90 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fc5e0a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0111720 con 0x7f9fc01003b0 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01003b0 0x7f9fc00fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01003b0 0x7f9fc00fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:36006/0 (socket says 172.21.15.33:36006) 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbeffd700 1 -- 172.21.15.33:0/398887138 learned_addr learned my addr 172.21.15.33:0/398887138 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbf7fe700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00fda90 0x7f9fc00fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbeffd700 1 -- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00fda90 msgr2=0x7f9fc00fd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbeffd700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00fda90 0x7f9fc00fd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbeffd700 1 -- 172.21.15.33:0/398887138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4005040 con 0x7f9fc01003b0 2024-02-15T22:39:51.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.318+0000 7f9fbf7fe700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00fda90 0x7f9fc00fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:39:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.319+0000 7f9fbeffd700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01003b0 0x7f9fc00fb9a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000c00 tx=0x7f9fb4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.319+0000 7f9fa7fff700 1 -- 172.21.15.33:0/398887138 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb4021070 con 0x7f9fc01003b0 2024-02-15T22:39:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.319+0000 7f9fa7fff700 1 -- 172.21.15.33:0/398887138 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fb401c400 con 0x7f9fc01003b0 2024-02-15T22:39:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.319+0000 7f9fa7fff700 1 -- 172.21.15.33:0/398887138 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb400e070 con 0x7f9fc01003b0 2024-02-15T22:39:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.319+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc00fbfa0 con 0x7f9fc01003b0 2024-02-15T22:39:51.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.319+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc00fc480 con 0x7f9fc01003b0 2024-02-15T22:39:51.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.321+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc0107a60 con 0x7f9fc01003b0 2024-02-15T22:39:51.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.321+0000 7f9fa7fff700 1 -- 172.21.15.33:0/398887138 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f9fb401ca20 con 0x7f9fc01003b0 2024-02-15T22:39:51.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.321+0000 7f9fa7fff700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f9fa80692a0 0x7f9fa806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.322+0000 7f9fbf7fe700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f9fa80692a0 0x7f9fa806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.322+0000 7f9fa7fff700 1 -- 172.21.15.33:0/398887138 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9fb4088450 con 0x7f9fc01003b0 2024-02-15T22:39:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.322+0000 7f9fbf7fe700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f9fa80692a0 0x7f9fa806b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00fd2b0 tx=0x7f9fb000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.330+0000 7f9fa7fff700 1 -- 172.21.15.33:0/398887138 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9fb40581f0 con 0x7f9fc01003b0 2024-02-15T22:39:51.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:51 smithi082 ceph-mon[37153]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-15T22:39:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:51 smithi082 ceph-mon[37153]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:51.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:51 smithi033 ceph-mon[29033]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-15T22:39:51.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:51 smithi033 ceph-mon[29033]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:51.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.871+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9fc0105ac0 con 0x7f9fc01003b0 2024-02-15T22:39:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.871+0000 7f9fa7fff700 1 -- 172.21.15.33:0/398887138 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f9fb4057d80 con 0x7f9fc01003b0 2024-02-15T22:39:51.872 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:39:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:39:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:39:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:39:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 14 2024-02-15T22:39:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:39:51.874 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f9fa80692a0 msgr2=0x7f9fa806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f9fa80692a0 0x7f9fa806b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00fd2b0 tx=0x7f9fb000b040 comp rx=0 tx=0).stop 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01003b0 msgr2=0x7f9fc00fb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01003b0 0x7f9fc00fb9a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000c00 tx=0x7f9fb4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 shutdown_connections 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f9fa80692a0 0x7f9fa806b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00fda90 0x7f9fc00fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 --2- 172.21.15.33:0/398887138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01003b0 0x7f9fc00fb9a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 >> 172.21.15.33:0/398887138 conn(0x7f9fc00f7510 msgr2=0x7f9fc00f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.874+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 shutdown_connections 2024-02-15T22:39:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:51.875+0000 7f9fc5e0a700 1 -- 172.21.15.33:0/398887138 wait complete. 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 -- 172.21.15.33:0/3705028608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8071eb0 msgr2=0x7f64a8070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 --2- 172.21.15.33:0/3705028608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8071eb0 0x7f64a8070320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f64a4004940 tx=0x7f64a4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 -- 172.21.15.33:0/3705028608 shutdown_connections 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 --2- 172.21.15.33:0/3705028608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a8070860 0x7f64a8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 --2- 172.21.15.33:0/3705028608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8071eb0 0x7f64a8070320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 -- 172.21.15.33:0/3705028608 >> 172.21.15.33:0/3705028608 conn(0x7f64a80f8620 msgr2=0x7f64a80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 -- 172.21.15.33:0/3705028608 shutdown_connections 2024-02-15T22:39:52.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.024+0000 7f64b06d7700 1 -- 172.21.15.33:0/3705028608 wait complete. 2024-02-15T22:39:52.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64b06d7700 1 Processor -- start 2024-02-15T22:39:52.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64b06d7700 1 -- start start 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64b06d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8070860 0x7f64a810fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64b06d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a8071eb0 0x7f64a8110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64b06d7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8110600 con 0x7f64a8070860 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64b06d7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8110ea0 con 0x7f64a8071eb0 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64ae473700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8070860 0x7f64a810fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64ae473700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8070860 0x7f64a810fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36818/0 (socket says 172.21.15.33:36818) 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64ae473700 1 -- 172.21.15.33:0/1145902096 learned_addr learned my addr 172.21.15.33:0/1145902096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64adc72700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a8071eb0 0x7f64a8110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64ae473700 1 -- 172.21.15.33:0/1145902096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a8071eb0 msgr2=0x7f64a8110000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64ae473700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a8071eb0 0x7f64a8110000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.025+0000 7f64ae473700 1 -- 172.21.15.33:0/1145902096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4005040 con 0x7f64a8070860 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.026+0000 7f64ae473700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8070860 0x7f64a810fac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000c00 tx=0x7f64a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:52.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.026+0000 7f649effd700 1 -- 172.21.15.33:0/1145902096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a4021070 con 0x7f64a8070860 2024-02-15T22:39:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.026+0000 7f649effd700 1 -- 172.21.15.33:0/1145902096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64a401c400 con 0x7f64a8070860 2024-02-15T22:39:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.026+0000 7f649effd700 1 -- 172.21.15.33:0/1145902096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a400e070 con 0x7f64a8070860 2024-02-15T22:39:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.026+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a8111120 con 0x7f64a8070860 2024-02-15T22:39:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.026+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a8111600 con 0x7f64a8070860 2024-02-15T22:39:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.027+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a804bed0 con 0x7f64a8070860 2024-02-15T22:39:52.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.028+0000 7f649effd700 1 -- 172.21.15.33:0/1145902096 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f64a401ca50 con 0x7f64a8070860 2024-02-15T22:39:52.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.028+0000 7f649effd700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6494069370 0x7f649406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:39:52.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.028+0000 7f649effd700 1 -- 172.21.15.33:0/1145902096 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f64a4088350 con 0x7f64a8070860 2024-02-15T22:39:52.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.029+0000 7f64adc72700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6494069370 0x7f649406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:39:52.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.029+0000 7f64adc72700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6494069370 0x7f649406b820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6498009b80 tx=0x7f649800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:39:52.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.033+0000 7f649effd700 1 -- 172.21.15.33:0/1145902096 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f64a40580f0 con 0x7f64a8070860 2024-02-15T22:39:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:52 smithi033 ceph-mon[29033]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:52 smithi033 ceph-mon[29033]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:52.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:52 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/398887138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:39:52.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.281+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64a8104550 con 0x7f6494069370 2024-02-15T22:39:52.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.283+0000 7f649effd700 1 -- 172.21.15.33:0/1145902096 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f64a8104550 con 0x7f6494069370 2024-02-15T22:39:52.283 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:39:52.283 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T22:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "0/2 daemons upgraded", 2024-02-15T22:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 image on host smithi082", 2024-02-15T22:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:39:52.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.285+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6494069370 msgr2=0x7f649406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:52.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.285+0000 7f64b06d7700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6494069370 0x7f649406b820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6498009b80 tx=0x7f649800b040 comp rx=0 tx=0).stop 2024-02-15T22:39:52.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.285+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8070860 msgr2=0x7f64a810fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:39:52.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.285+0000 7f64b06d7700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8070860 0x7f64a810fac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000c00 tx=0x7f64a4009e30 comp rx=0 tx=0).stop 2024-02-15T22:39:52.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.286+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 shutdown_connections 2024-02-15T22:39:52.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.286+0000 7f64b06d7700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f6494069370 0x7f649406b820 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:52.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.286+0000 7f64b06d7700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64a8070860 0x7f64a810fac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:52.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.286+0000 7f64b06d7700 1 --2- 172.21.15.33:0/1145902096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a8071eb0 0x7f64a8110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:39:52.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.286+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 >> 172.21.15.33:0/1145902096 conn(0x7f64a80f8620 msgr2=0x7f64a8102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:39:52.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.286+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 shutdown_connections 2024-02-15T22:39:52.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:39:52.286+0000 7f64b06d7700 1 -- 172.21.15.33:0/1145902096 wait complete. 2024-02-15T22:39:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:52 smithi082 ceph-mon[37153]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:52.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:52 smithi082 ceph-mon[37153]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:52 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/398887138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:39:53.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:53 smithi082 ceph-mon[37153]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:39:53.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:53 smithi033 ceph-mon[29033]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:39:54.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:54 smithi082 ceph-mon[37153]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:54.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:54 smithi033 ceph-mon[29033]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:39:55.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:55 smithi082 ceph-mon[37153]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:39:55.420 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:55 smithi033 ceph-mon[29033]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:39:57.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:57 smithi082 ceph-mon[37153]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:39:57.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:57 smithi033 ceph-mon[29033]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:39:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:39:58 smithi033 ceph-mon[29033]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:39:59.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:39:58 smithi082 ceph-mon[37153]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:40:01.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:00 smithi033 ceph-mon[29033]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:01.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:00 smithi033 ceph-mon[29033]: overall HEALTH_OK 2024-02-15T22:40:01.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:00 smithi082 ceph-mon[37153]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:01.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:00 smithi082 ceph-mon[37153]: overall HEALTH_OK 2024-02-15T22:40:02.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:01 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:02.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:01 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:03.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:02 smithi033 ceph-mon[29033]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:03.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:02 smithi082 ceph-mon[37153]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:04 smithi033 ceph-mon[29033]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:40:05.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:04 smithi082 ceph-mon[37153]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:40:07.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:07 smithi033 ceph-mon[29033]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:07.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:07 smithi082 ceph-mon[37153]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:09.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:08 smithi033 ceph-mon[29033]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:40:09.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:08 smithi082 ceph-mon[37153]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:40:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:10 smithi033 ceph-mon[29033]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:11.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:10 smithi082 ceph-mon[37153]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:13.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:12 smithi033 ceph-mon[29033]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:13.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:12 smithi082 ceph-mon[37153]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:14.830 INFO:tasks.workunit.client.0.smithi033.stderr:Updating files: 98% (11989/12222) Updating files: 99% (12100/12222) Updating files: 100% (12222/12222) Updating files: 100% (12222/12222), done. 2024-02-15T22:40:15.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:14 smithi033 ceph-mon[29033]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:40:15.287 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:14 smithi082 ceph-mon[37153]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to 'f78a58c0ffd401d1493058a1022c35f011d65275'. 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T22:40:15.471 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T22:40:15.472 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at f78a58c0ffd Merge PR #55601 into wip-batrick-testing-20240215.160715 2024-02-15T22:40:15.473 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-15T22:40:15.513 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T22:40:15.515 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T22:40:15.515 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T22:40:16.330 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T22:40:16.398 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T22:40:16.440 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T22:40:16.441 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T22:40:16.441 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T22:40:16.480 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T22:40:16.483 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:40:16.483 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-15T22:40:16.538 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-15T22:40:16.539 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T22:40:16.540 DEBUG:teuthology.orchestra.run.smithi033:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f78a58c0ffd401d1493058a1022c35f011d65275 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-15T22:40:16.598 INFO:tasks.workunit.client.0.smithi033.stderr:+ mkdir -p fsstress 2024-02-15T22:40:16.599 INFO:tasks.workunit.client.0.smithi033.stderr:+ pushd fsstress 2024-02-15T22:40:16.600 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:40:16.600 INFO:tasks.workunit.client.0.smithi033.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T22:40:17.068 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:16 smithi082 ceph-mon[37153]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:17.068 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:17.069 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:40:17.069 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:40:17.069 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:40:17.069 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:16 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:17.120 INFO:tasks.workunit.client.0.smithi033.stderr:+ tar xzf ltp-full.tgz 2024-02-15T22:40:17.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:16 smithi033 ceph-mon[29033]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:40:17.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:17.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:40:17.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:40:17.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:40:17.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:16 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:17 smithi033 ceph-mon[29033]: Upgrade: Updating mgr.smithi082.mjhlse 2024-02-15T22:40:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:17 smithi033 ceph-mon[29033]: Deploying daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:40:18.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:17 smithi082 ceph-mon[37153]: Upgrade: Updating mgr.smithi082.mjhlse 2024-02-15T22:40:18.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:17 smithi082 ceph-mon[37153]: Deploying daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:40:19.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:18 smithi033 ceph-mon[29033]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:40:19.366 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:19 smithi082 ceph-mon[37153]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:40:21.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:21 smithi033 ceph-mon[29033]: pgmap v238: 65 pgs: 65 active+clean; 2.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 140 KiB/s wr, 4 op/s 2024-02-15T22:40:21.324 INFO:tasks.workunit.client.1.smithi082.stderr:Note: switching to 'f78a58c0ffd401d1493058a1022c35f011d65275'. 2024-02-15T22:40:21.324 INFO:tasks.workunit.client.1.smithi082.stderr: 2024-02-15T22:40:21.324 INFO:tasks.workunit.client.1.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T22:40:21.324 INFO:tasks.workunit.client.1.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T22:40:21.324 INFO:tasks.workunit.client.1.smithi082.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T22:40:21.324 INFO:tasks.workunit.client.1.smithi082.stderr: 2024-02-15T22:40:21.324 INFO:tasks.workunit.client.1.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr: 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr: git switch -c 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr: 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr:Or undo this operation with: 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr: 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr: git switch - 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr: 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T22:40:21.325 INFO:tasks.workunit.client.1.smithi082.stderr: 2024-02-15T22:40:21.326 INFO:tasks.workunit.client.1.smithi082.stderr:HEAD is now at f78a58c0ffd Merge PR #55601 into wip-batrick-testing-20240215.160715 2024-02-15T22:40:21.327 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-15T22:40:21.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:21 smithi082 ceph-mon[37153]: pgmap v238: 65 pgs: 65 active+clean; 2.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 140 KiB/s wr, 4 op/s 2024-02-15T22:40:21.508 INFO:tasks.workunit.client.1.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T22:40:21.510 INFO:tasks.workunit.client.1.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T22:40:21.510 INFO:tasks.workunit.client.1.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T22:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.473+0000 7f2452ff9700 1 -- 172.21.15.33:0/1886371147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c06ea50 msgr2=0x7f244c06ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.473+0000 7f2452ff9700 1 --2- 172.21.15.33:0/1886371147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c06ea50 0x7f244c06ee60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2440004940 tx=0x7f2440009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.477+0000 7f2452ff9700 1 -- 172.21.15.33:0/1886371147 shutdown_connections 2024-02-15T22:40:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.477+0000 7f2452ff9700 1 --2- 172.21.15.33:0/1886371147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06f430 0x7f244c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.477+0000 7f2452ff9700 1 --2- 172.21.15.33:0/1886371147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c06ea50 0x7f244c06ee60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.477+0000 7f2452ff9700 1 -- 172.21.15.33:0/1886371147 >> 172.21.15.33:0/1886371147 conn(0x7f244c069e70 msgr2=0x7f244c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.477+0000 7f2452ff9700 1 -- 172.21.15.33:0/1886371147 shutdown_connections 2024-02-15T22:40:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.477+0000 7f2452ff9700 1 -- 172.21.15.33:0/1886371147 wait complete. 2024-02-15T22:40:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.478+0000 7f2452ff9700 1 Processor -- start 2024-02-15T22:40:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.478+0000 7f2452ff9700 1 -- start start 2024-02-15T22:40:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.478+0000 7f2452ff9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06ea50 0x7f244c113d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.478+0000 7f2452ff9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c1142a0 0x7f244c115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:22.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.479+0000 7f2452ff9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c11a4d0 con 0x7f244c1142a0 2024-02-15T22:40:22.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.479+0000 7f2452ff9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c114710 con 0x7f244c06ea50 2024-02-15T22:40:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.479+0000 7f2450d95700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06ea50 0x7f244c113d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.479+0000 7f2450d95700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06ea50 0x7f244c113d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:45416/0 (socket says 172.21.15.33:45416) 2024-02-15T22:40:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.479+0000 7f2450d95700 1 -- 172.21.15.33:0/1138859498 learned_addr learned my addr 172.21.15.33:0/1138859498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.480+0000 7f244bfff700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c1142a0 0x7f244c115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.480+0000 7f2450d95700 1 -- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c1142a0 msgr2=0x7f244c115190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.480+0000 7f2450d95700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c1142a0 0x7f244c115190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:22.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.480+0000 7f2450d95700 1 -- 172.21.15.33:0/1138859498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440005040 con 0x7f244c06ea50 2024-02-15T22:40:22.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.481+0000 7f2450d95700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06ea50 0x7f244c113d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2440000c00 tx=0x7f2440009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:22.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.481+0000 7f24497fa700 1 -- 172.21.15.33:0/1138859498 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244000e030 con 0x7f244c06ea50 2024-02-15T22:40:22.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.481+0000 7f24497fa700 1 -- 172.21.15.33:0/1138859498 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24400093d0 con 0x7f244c06ea50 2024-02-15T22:40:22.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.481+0000 7f2452ff9700 1 -- 172.21.15.33:0/1138859498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c1156d0 con 0x7f244c06ea50 2024-02-15T22:40:22.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.481+0000 7f2452ff9700 1 -- 172.21.15.33:0/1138859498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244c115c10 con 0x7f244c06ea50 2024-02-15T22:40:22.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.482+0000 7f24497fa700 1 -- 172.21.15.33:0/1138859498 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244000e030 con 0x7f244c06ea50 2024-02-15T22:40:22.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.484+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244c04bed0 con 0x7f244c06ea50 2024-02-15T22:40:22.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.484+0000 7f24497fa700 1 -- 172.21.15.33:0/1138859498 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f2440013420 con 0x7f244c06ea50 2024-02-15T22:40:22.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.485+0000 7f24497fa700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2434069360 0x7f243406b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:22.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.485+0000 7f24497fa700 1 -- 172.21.15.33:0/1138859498 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f244005b170 con 0x7f244c06ea50 2024-02-15T22:40:22.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.486+0000 7f244bfff700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2434069360 0x7f243406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:22.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.487+0000 7f244bfff700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2434069360 0x7f243406b810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f244c114dd0 tx=0x7f243c000f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:22.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.495+0000 7f24497fa700 1 -- 172.21.15.33:0/1138859498 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f24400549f0 con 0x7f244c06ea50 2024-02-15T22:40:22.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.953+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f244c1148a0 con 0x7f2434069360 2024-02-15T22:40:22.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.956+0000 7f24497fa700 1 -- 172.21.15.33:0/1138859498 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f244c1148a0 con 0x7f2434069360 2024-02-15T22:40:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.961+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2434069360 msgr2=0x7f243406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.961+0000 7f2432ffd700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2434069360 0x7f243406b810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f244c114dd0 tx=0x7f243c000f90 comp rx=0 tx=0).stop 2024-02-15T22:40:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.961+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06ea50 msgr2=0x7f244c113d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.961+0000 7f2432ffd700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06ea50 0x7f244c113d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2440000c00 tx=0x7f2440009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:22.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.963+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 shutdown_connections 2024-02-15T22:40:22.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.963+0000 7f2432ffd700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f2434069360 0x7f243406b810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:22.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.963+0000 7f2432ffd700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244c06ea50 0x7f244c113d60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:22.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.963+0000 7f2432ffd700 1 --2- 172.21.15.33:0/1138859498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c1142a0 0x7f244c115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:22.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.963+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 >> 172.21.15.33:0/1138859498 conn(0x7f244c069e70 msgr2=0x7f244c06c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:22.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.964+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 shutdown_connections 2024-02-15T22:40:22.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:22.966+0000 7f2432ffd700 1 -- 172.21.15.33:0/1138859498 wait complete. 2024-02-15T22:40:22.988 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:40:23.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.151+0000 7f62cb76d700 1 -- 172.21.15.33:0/2135756075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62c40fc2d0 msgr2=0x7f62c40fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.151+0000 7f62cb76d700 1 --2- 172.21.15.33:0/2135756075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62c40fc2d0 0x7f62c40fc6e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f62c00049c0 tx=0x7f62c0009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:23.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.152+0000 7f62cb76d700 1 -- 172.21.15.33:0/2135756075 shutdown_connections 2024-02-15T22:40:23.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.152+0000 7f62cb76d700 1 --2- 172.21.15.33:0/2135756075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40faf90 0x7f62c40fb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.152+0000 7f62cb76d700 1 --2- 172.21.15.33:0/2135756075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62c40fc2d0 0x7f62c40fc6e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.152+0000 7f62cb76d700 1 -- 172.21.15.33:0/2135756075 >> 172.21.15.33:0/2135756075 conn(0x7f62c40f6ca0 msgr2=0x7f62c40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:23.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.154+0000 7f62cb76d700 1 -- 172.21.15.33:0/2135756075 shutdown_connections 2024-02-15T22:40:23.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.154+0000 7f62cb76d700 1 -- 172.21.15.33:0/2135756075 wait complete. 2024-02-15T22:40:23.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.154+0000 7f62cb76d700 1 Processor -- start 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62cb76d700 1 -- start start 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62cb76d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62c40faf90 0x7f62c410b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62cb76d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40fc2d0 0x7f62c410bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62cb76d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c410c210 con 0x7f62c40faf90 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62cb76d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c410caa0 con 0x7f62c40fc2d0 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62c8d08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40fc2d0 0x7f62c410bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62c8d08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40fc2d0 0x7f62c410bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:45432/0 (socket says 172.21.15.33:45432) 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.155+0000 7f62c8d08700 1 -- 172.21.15.33:0/4021161269 learned_addr learned my addr 172.21.15.33:0/4021161269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.156+0000 7f62c8d08700 1 -- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62c40faf90 msgr2=0x7f62c410b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.156+0000 7f62c8d08700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62c40faf90 0x7f62c410b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.156+0000 7f62c8d08700 1 -- 172.21.15.33:0/4021161269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0005040 con 0x7f62c40fc2d0 2024-02-15T22:40:23.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.156+0000 7f62c8d08700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40fc2d0 0x7f62c410bbc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62b4002a50 tx=0x7f62b40046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:23.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.157+0000 7f62b9ffb700 1 -- 172.21.15.33:0/4021161269 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b4007cc0 con 0x7f62c40fc2d0 2024-02-15T22:40:23.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.157+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c410cd80 con 0x7f62c40fc2d0 2024-02-15T22:40:23.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.158+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c410d2c0 con 0x7f62c40fc2d0 2024-02-15T22:40:23.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.158+0000 7f62b9ffb700 1 -- 172.21.15.33:0/4021161269 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62b400f040 con 0x7f62c40fc2d0 2024-02-15T22:40:23.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.158+0000 7f62b9ffb700 1 -- 172.21.15.33:0/4021161269 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b4009640 con 0x7f62c40fc2d0 2024-02-15T22:40:23.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.161+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a80052e0 con 0x7f62c40fc2d0 2024-02-15T22:40:23.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.161+0000 7f62b9ffb700 1 -- 172.21.15.33:0/4021161269 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f62b40097a0 con 0x7f62c40fc2d0 2024-02-15T22:40:23.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.162+0000 7f62b9ffb700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f62b00693c0 0x7f62b006b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:23.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.162+0000 7f62b9ffb700 1 -- 172.21.15.33:0/4021161269 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f62b40112f0 con 0x7f62c40fc2d0 2024-02-15T22:40:23.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.164+0000 7f62c9509700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f62b00693c0 0x7f62b006b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:23.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.166+0000 7f62c9509700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f62b00693c0 0x7f62b006b870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62c0004fd0 tx=0x7f62c0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:23.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.170+0000 7f62b9ffb700 1 -- 172.21.15.33:0/4021161269 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f62b4053940 con 0x7f62c40fc2d0 2024-02-15T22:40:23.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:23 smithi033 ceph-mon[29033]: pgmap v239: 65 pgs: 65 active+clean; 7.5 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 455 KiB/s rd, 593 KiB/s wr, 5 op/s 2024-02-15T22:40:23.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:23 smithi082 ceph-mon[37153]: pgmap v239: 65 pgs: 65 active+clean; 7.5 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 455 KiB/s rd, 593 KiB/s wr, 5 op/s 2024-02-15T22:40:23.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.531+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62a8000bf0 con 0x7f62b00693c0 2024-02-15T22:40:23.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.532+0000 7f62b9ffb700 1 -- 172.21.15.33:0/4021161269 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f62a8000bf0 con 0x7f62b00693c0 2024-02-15T22:40:23.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f62b00693c0 msgr2=0x7f62b006b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f62b00693c0 0x7f62b006b870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62c0004fd0 tx=0x7f62c0009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40fc2d0 msgr2=0x7f62c410bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40fc2d0 0x7f62c410bbc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62b4002a50 tx=0x7f62b40046b0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 shutdown_connections 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f62b00693c0 0x7f62b006b870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62c40faf90 0x7f62c410b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 --2- 172.21.15.33:0/4021161269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62c40fc2d0 0x7f62c410bbc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.534+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 >> 172.21.15.33:0/4021161269 conn(0x7f62c40f6ca0 msgr2=0x7f62c40ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.535+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 shutdown_connections 2024-02-15T22:40:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.535+0000 7f62cb76d700 1 -- 172.21.15.33:0/4021161269 wait complete. 2024-02-15T22:40:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 -- 172.21.15.33:0/673880386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 msgr2=0x7f5f94102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/673880386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f94102520 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5f84004940 tx=0x7f5f84009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 -- 172.21.15.33:0/673880386 shutdown_connections 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/673880386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f94102520 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/673880386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940663e0 0x7f5f940ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 -- 172.21.15.33:0/673880386 >> 172.21.15.33:0/673880386 conn(0x7f5f940f74e0 msgr2=0x7f5f940f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 -- 172.21.15.33:0/673880386 shutdown_connections 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 -- 172.21.15.33:0/673880386 wait complete. 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 Processor -- start 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.668+0000 7f5f9bafe700 1 -- start start 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f9bafe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940663e0 0x7f5f940fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f9bafe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f940fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f9bafe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940fbff0 con 0x7f5f941000c0 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f9bafe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940fc160 con 0x7f5f940663e0 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f99099700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f940fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f99099700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f940fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46306/0 (socket says 172.21.15.33:46306) 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f99099700 1 -- 172.21.15.33:0/3545090551 learned_addr learned my addr 172.21.15.33:0/3545090551 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f9989a700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940663e0 0x7f5f940fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f99099700 1 -- 172.21.15.33:0/3545090551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940663e0 msgr2=0x7f5f940fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f99099700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940663e0 0x7f5f940fd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f99099700 1 -- 172.21.15.33:0/3545090551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84005040 con 0x7f5f941000c0 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.669+0000 7f5f99099700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f940fb9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f84000c00 tx=0x7f5f84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.670+0000 7f5f8a7fc700 1 -- 172.21.15.33:0/3545090551 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f8400e040 con 0x7f5f941000c0 2024-02-15T22:40:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.670+0000 7f5f8a7fc700 1 -- 172.21.15.33:0/3545090551 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f8400bbf0 con 0x7f5f941000c0 2024-02-15T22:40:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.670+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f940fc3e0 con 0x7f5f941000c0 2024-02-15T22:40:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.670+0000 7f5f8a7fc700 1 -- 172.21.15.33:0/3545090551 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f8401c630 con 0x7f5f941000c0 2024-02-15T22:40:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.670+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f941159a0 con 0x7f5f941000c0 2024-02-15T22:40:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.671+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9404bed0 con 0x7f5f941000c0 2024-02-15T22:40:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.671+0000 7f5f8a7fc700 1 -- 172.21.15.33:0/3545090551 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f5f8400bd60 con 0x7f5f941000c0 2024-02-15T22:40:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.672+0000 7f5f8a7fc700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5f800692a0 0x7f5f8006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.672+0000 7f5f8a7fc700 1 -- 172.21.15.33:0/3545090551 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5f840883f0 con 0x7f5f941000c0 2024-02-15T22:40:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.672+0000 7f5f9989a700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5f800692a0 0x7f5f8006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.672+0000 7f5f9989a700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5f800692a0 0x7f5f8006b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f940fd300 tx=0x7f5f90009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:23.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.678+0000 7f5f8a7fc700 1 -- 172.21.15.33:0/3545090551 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5f84058250 con 0x7f5f941000c0 2024-02-15T22:40:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.934+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f94100d60 con 0x7f5f800692a0 2024-02-15T22:40:23.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.944+0000 7f5f8a7fc700 1 -- 172.21.15.33:0/3545090551 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5f94100d60 con 0x7f5f800692a0 2024-02-15T22:40:23.944 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 92s ago 7m 25.4M - 0.25.0 c8568f914cd2 229a38709f4a 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 92s ago 7m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (6m) 97s ago 6m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (5m) 92s ago 7m 81.5M - 9.4.7 954c08fa6188 4e1a6363851b 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (118s) 92s ago 117s 14.9M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (112s) 92s ago 112s 15.5M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (115s) 97s ago 115s 15.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (110s) 97s ago 109s 15.5M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:9283 running (8m) 92s ago 8m 481M - 17.2.7-509-g9aa52330 61c0ec9cd187 4de1acba28ab 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283 running (6m) 97s ago 6m 435M - 17.2.7-509-g9aa52330 61c0ec9cd187 7c9a30ed03d3 2024-02-15T22:40:23.945 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (9m) 92s ago 9m 47.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (6m) 97s ago 6m 35.8M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (7m) 92s ago 7m 16.1M - 1.5.0 0da6a335fe13 edf3c832a7c2 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 97s ago 6m 17.1M - 1.5.0 0da6a335fe13 e8b1514d760c 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 92s ago 5m 46.7M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (5m) 92s ago 5m 46.4M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 92s ago 4m 44.0M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (4m) 97s ago 4m 46.9M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (3m) 97s ago 3m 44.4M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (3m) 97s ago 3m 41.1M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:40:23.946 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 92s ago 6m 54.6M - 2.43.0 a07b618ecd1d fcda9c48f34e 2024-02-15T22:40:23.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5f800692a0 msgr2=0x7f5f8006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5f800692a0 0x7f5f8006b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f940fd300 tx=0x7f5f90009040 comp rx=0 tx=0).stop 2024-02-15T22:40:23.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 msgr2=0x7f5f940fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:23.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f940fb9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f84000c00 tx=0x7f5f84009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:23.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 shutdown_connections 2024-02-15T22:40:23.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f5f800692a0 0x7f5f8006b750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940663e0 0x7f5f940fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 --2- 172.21.15.33:0/3545090551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f941000c0 0x7f5f940fb9f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:23.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 >> 172.21.15.33:0/3545090551 conn(0x7f5f940f74e0 msgr2=0x7f5f940f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:23.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 shutdown_connections 2024-02-15T22:40:23.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:23.947+0000 7f5f9bafe700 1 -- 172.21.15.33:0/3545090551 wait complete. 2024-02-15T22:40:24.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.055+0000 7f67b3dbd700 1 -- 172.21.15.33:0/2471875897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 msgr2=0x7f67ac0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.055+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/2471875897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac0fe550 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f679c004940 tx=0x7f679c009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.055+0000 7f67b3dbd700 1 -- 172.21.15.33:0/2471875897 shutdown_connections 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.055+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/2471875897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac0fe550 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.055+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/2471875897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0fcef0 0x7f67ac0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.055+0000 7f67b3dbd700 1 -- 172.21.15.33:0/2471875897 >> 172.21.15.33:0/2471875897 conn(0x7f67ac0f8620 msgr2=0x7f67ac0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 -- 172.21.15.33:0/2471875897 shutdown_connections 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 -- 172.21.15.33:0/2471875897 wait complete. 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 Processor -- start 2024-02-15T22:40:24.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 -- start start 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0fcef0 0x7f67ac10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac10e540 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.056+0000 7f67b3dbd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac10ed80 con 0x7f67ac0fcef0 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1358700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1358700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac10deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46318/0 (socket says 172.21.15.33:46318) 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1358700 1 -- 172.21.15.33:0/621878011 learned_addr learned my addr 172.21.15.33:0/621878011 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:24.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1b59700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0fcef0 0x7f67ac10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1358700 1 -- 172.21.15.33:0/621878011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0fcef0 msgr2=0x7f67ac10d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1358700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0fcef0 0x7f67ac10d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1358700 1 -- 172.21.15.33:0/621878011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c005040 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67b1358700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac10deb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f679c0093b0 tx=0x7f679c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.057+0000 7f67a27fc700 1 -- 172.21.15.33:0/621878011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f679c00e040 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.058+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac10f000 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.058+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac10f540 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.058+0000 7f67a27fc700 1 -- 172.21.15.33:0/621878011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f679c00bcc0 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.058+0000 7f67a27fc700 1 -- 172.21.15.33:0/621878011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f679c01c630 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.058+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac04bed0 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.059+0000 7f67a27fc700 1 -- 172.21.15.33:0/621878011 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f679c013420 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.060+0000 7f67a27fc700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f67980692a0 0x7f679806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:24.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.060+0000 7f67a27fc700 1 -- 172.21.15.33:0/621878011 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f679c0883e0 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.060+0000 7f67b1b59700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f67980692a0 0x7f679806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:24.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.060+0000 7f67b1b59700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f67980692a0 0x7f679806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0fcc30 tx=0x7f67a80091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:24.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.064+0000 7f67a27fc700 1 -- 172.21.15.33:0/621878011 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f679c058240 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:24 smithi033 ceph-mon[29033]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:24.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.364+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f67ac10fa20 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.365+0000 7f67a27fc700 1 -- 172.21.15.33:0/621878011 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f679c057dd0 con 0x7f67ac0fe0e0 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 14 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:40:24.367 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f67980692a0 msgr2=0x7f679806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f67980692a0 0x7f679806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0fcc30 tx=0x7f67a80091a0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 msgr2=0x7f67ac10deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac10deb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f679c0093b0 tx=0x7f679c009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 shutdown_connections 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7f67980692a0 0x7f679806b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0fcef0 0x7f67ac10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 --2- 172.21.15.33:0/621878011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ac0fe0e0 0x7f67ac10deb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 >> 172.21.15.33:0/621878011 conn(0x7f67ac0f8620 msgr2=0x7f67ac1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 shutdown_connections 2024-02-15T22:40:24.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.368+0000 7f67b3dbd700 1 -- 172.21.15.33:0/621878011 wait complete. 2024-02-15T22:40:24.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:24 smithi082 ceph-mon[37153]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.492+0000 7fb1dd47a700 1 -- 172.21.15.33:0/3188935499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 msgr2=0x7fb1d80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.492+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/3188935499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d80fe550 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc004940 tx=0x7fb1cc009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.492+0000 7fb1dd47a700 1 -- 172.21.15.33:0/3188935499 shutdown_connections 2024-02-15T22:40:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.492+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/3188935499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d80fe550 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.492+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/3188935499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d80fcef0 0x7fb1d80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.492+0000 7fb1dd47a700 1 -- 172.21.15.33:0/3188935499 >> 172.21.15.33:0/3188935499 conn(0x7fb1d80f8620 msgr2=0x7fb1d80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.493+0000 7fb1dd47a700 1 -- 172.21.15.33:0/3188935499 shutdown_connections 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.493+0000 7fb1dd47a700 1 -- 172.21.15.33:0/3188935499 wait complete. 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.493+0000 7fb1dd47a700 1 Processor -- start 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1dd47a700 1 -- start start 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1dd47a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d80fcef0 0x7fb1d810fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1dd47a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d81100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1dd47a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d81106a0 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1d67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d81100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1dd47a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8110f40 con 0x7fb1d80fcef0 2024-02-15T22:40:24.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1d67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d81100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46324/0 (socket says 172.21.15.33:46324) 2024-02-15T22:40:24.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1d67fc700 1 -- 172.21.15.33:0/2491958323 learned_addr learned my addr 172.21.15.33:0/2491958323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:24.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1d6ffd700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d80fcef0 0x7fb1d810fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:24.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1d67fc700 1 -- 172.21.15.33:0/2491958323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d80fcef0 msgr2=0x7fb1d810fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1d67fc700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d80fcef0 0x7fb1d810fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.494+0000 7fb1d67fc700 1 -- 172.21.15.33:0/2491958323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc005040 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.495+0000 7fb1d67fc700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d81100a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0093b0 tx=0x7fb1cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:24.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.495+0000 7fb1bf7fe700 1 -- 172.21.15.33:0/2491958323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc00e040 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.495+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d81111c0 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.495+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d8111700 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.495+0000 7fb1bf7fe700 1 -- 172.21.15.33:0/2491958323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1cc00bcc0 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.495+0000 7fb1bf7fe700 1 -- 172.21.15.33:0/2491958323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc01c630 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.496+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d8102210 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.496+0000 7fb1bf7fe700 1 -- 172.21.15.33:0/2491958323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb1cc013980 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.497+0000 7fb1bf7fe700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1c00692a0 0x7fb1c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.497+0000 7fb1bf7fe700 1 -- 172.21.15.33:0/2491958323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb1cc088430 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.497+0000 7fb1d6ffd700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1c00692a0 0x7fb1c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.498+0000 7fb1d6ffd700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1c00692a0 0x7fb1c006b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80fcc30 tx=0x7fb1c8009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:24.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.502+0000 7fb1bf7fe700 1 -- 172.21.15.33:0/2491958323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb1cc058290 con 0x7fb1d80fe0e0 2024-02-15T22:40:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.766+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 --> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d802b2f0 con 0x7fb1c00692a0 2024-02-15T22:40:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.768+0000 7fb1bf7fe700 1 -- 172.21.15.33:0/2491958323 <== mgr.14214 v2:172.21.15.33:6800/1523928063 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fb1d802b2f0 con 0x7fb1c00692a0 2024-02-15T22:40:24.768 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:40:24.768 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:40:24.769 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:40:24.769 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:40:24.769 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T22:40:24.769 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "0/2 daemons upgraded", 2024-02-15T22:40:24.769 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading mgr daemons", 2024-02-15T22:40:24.769 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:40:24.769 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:40:24.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1c00692a0 msgr2=0x7fb1c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1c00692a0 0x7fb1c006b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80fcc30 tx=0x7fb1c8009040 comp rx=0 tx=0).stop 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 msgr2=0x7fb1d81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d81100a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0093b0 tx=0x7fb1cc009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 shutdown_connections 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:6800/1523928063,v1:172.21.15.33:6801/1523928063] conn(0x7fb1c00692a0 0x7fb1c006b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d80fcef0 0x7fb1d810fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 --2- 172.21.15.33:0/2491958323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1d80fe0e0 0x7fb1d81100a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 >> 172.21.15.33:0/2491958323 conn(0x7fb1d80f8620 msgr2=0x7fb1d80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 shutdown_connections 2024-02-15T22:40:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:24.770+0000 7fb1dd47a700 1 -- 172.21.15.33:0/2491958323 wait complete. 2024-02-15T22:40:25.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:25 smithi033 ceph-mon[29033]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:25.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:25 smithi033 ceph-mon[29033]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:25.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:25 smithi033 ceph-mon[29033]: pgmap v240: 65 pgs: 65 active+clean; 18 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 455 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2024-02-15T22:40:25.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:25 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/621878011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:40:25.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:25 smithi082 ceph-mon[37153]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:25.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:25 smithi082 ceph-mon[37153]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:25.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:25 smithi082 ceph-mon[37153]: pgmap v240: 65 pgs: 65 active+clean; 18 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 455 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2024-02-15T22:40:25.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:25 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/621878011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:40:26.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:26 smithi082 ceph-mon[37153]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:26.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:26 smithi033 ceph-mon[29033]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:27.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:27 smithi033 ceph-mon[29033]: pgmap v241: 65 pgs: 65 active+clean; 55 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 470 op/s 2024-02-15T22:40:27.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:27.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:27.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:27 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:27.323 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:27 smithi082 ceph-mon[37153]: pgmap v241: 65 pgs: 65 active+clean; 55 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 470 op/s 2024-02-15T22:40:27.323 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:27.324 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:27.324 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:27 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:28.277 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:28 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:40:28.380 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:28 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:40:29.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:29 smithi082 ceph-mon[37153]: pgmap v242: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 506 op/s 2024-02-15T22:40:29.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:29 smithi033 ceph-mon[29033]: pgmap v242: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 506 op/s 2024-02-15T22:40:31.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:31 smithi082 ceph-mon[37153]: pgmap v243: 65 pgs: 65 active+clean; 63 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 509 op/s 2024-02-15T22:40:31.404 INFO:tasks.workunit.client.1.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T22:40:31.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:31 smithi033 ceph-mon[29033]: pgmap v243: 65 pgs: 65 active+clean; 63 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 509 op/s 2024-02-15T22:40:32.115 INFO:tasks.workunit.client.0.smithi033.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T22:40:32.116 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:40:32.116 INFO:tasks.workunit.client.0.smithi033.stderr:+ make 2024-02-15T22:40:32.253 INFO:tasks.workunit.client.0.smithi033.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T22:40:32.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:32 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:32.418 INFO:tasks.workunit.client.1.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T22:40:32.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:32 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:32.541 INFO:tasks.workunit.client.0.smithi033.stderr:++ readlink -f fsstress 2024-02-15T22:40:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T22:40:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:+ popd 2024-02-15T22:40:32.542 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:40:32.543 INFO:tasks.workunit.client.0.smithi033.stderr:+ popd 2024-02-15T22:40:32.543 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:40:32.543 INFO:tasks.workunit.client.0.smithi033.stderr:++ mktemp -d -p . 2024-02-15T22:40:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:+ T=./tmp.wtoHaaVMZL 2024-02-15T22:40:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.wtoHaaVMZL -l 1 -n 1000 -p 10 -v 2024-02-15T22:40:32.544 INFO:tasks.workunit.client.0.smithi033.stdout:seed = 1707524241 2024-02-15T22:40:32.548 INFO:tasks.workunit.client.0.smithi033.stdout:0/0: creat f0 x:0 0 0 2024-02-15T22:40:32.548 INFO:tasks.workunit.client.0.smithi033.stdout:0/1: chown f0 4914 1 2024-02-15T22:40:32.548 INFO:tasks.workunit.client.0.smithi033.stdout:0/2: chown f0 391170718 1 2024-02-15T22:40:32.548 INFO:tasks.workunit.client.0.smithi033.stdout:0/3: write f0 [635736,20561] 0 2024-02-15T22:40:32.548 INFO:tasks.workunit.client.0.smithi033.stdout:0/4: readlink - no filename 2024-02-15T22:40:32.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/0: dwrite - no filename 2024-02-15T22:40:32.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/1: fdatasync - no filename 2024-02-15T22:40:32.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/2: rmdir - no directory 2024-02-15T22:40:32.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/3: dwrite - no filename 2024-02-15T22:40:32.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/4: write - no filename 2024-02-15T22:40:32.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/5: unlink - no file 2024-02-15T22:40:32.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/6: fsync - no filename 2024-02-15T22:40:32.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/7: truncate - no filename 2024-02-15T22:40:32.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/8: link - no file 2024-02-15T22:40:32.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/9: dwrite - no filename 2024-02-15T22:40:32.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/10: dread - no filename 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/0: creat f0 x:0 0 0 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/1: dread - f0 zero size 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/2: chown f0 497557 1 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:3/0: unlink - no file 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:3/1: stat - no entries 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:3/2: write - no filename 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:3/3: dwrite - no filename 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:3/4: write - no filename 2024-02-15T22:40:32.551 INFO:tasks.workunit.client.0.smithi033.stdout:2/11: symlink l0 0 2024-02-15T22:40:32.552 INFO:tasks.workunit.client.0.smithi033.stdout:3/5: mkdir d0 0 2024-02-15T22:40:32.553 INFO:tasks.workunit.client.0.smithi033.stdout:2/12: mkdir d1 0 2024-02-15T22:40:32.553 INFO:tasks.workunit.client.0.smithi033.stdout:2/13: dwrite - no filename 2024-02-15T22:40:32.553 INFO:tasks.workunit.client.0.smithi033.stdout:2/14: dwrite - no filename 2024-02-15T22:40:32.554 INFO:tasks.workunit.client.0.smithi033.stdout:5/0: read - no filename 2024-02-15T22:40:32.555 INFO:tasks.workunit.client.0.smithi033.stdout:5/1: link - no file 2024-02-15T22:40:32.555 INFO:tasks.workunit.client.0.smithi033.stdout:5/2: write - no filename 2024-02-15T22:40:32.555 INFO:tasks.workunit.client.0.smithi033.stdout:5/3: chown . 214 1 2024-02-15T22:40:32.555 INFO:tasks.workunit.client.0.smithi033.stdout:4/0: symlink l0 0 2024-02-15T22:40:32.556 INFO:tasks.workunit.client.0.smithi033.stdout:3/6: mknod d0/c1 0 2024-02-15T22:40:32.560 INFO:tasks.workunit.client.0.smithi033.stdout:2/15: creat d1/f2 x:0 0 0 2024-02-15T22:40:32.560 INFO:tasks.workunit.client.0.smithi033.stdout:6/0: truncate - no filename 2024-02-15T22:40:32.560 INFO:tasks.workunit.client.0.smithi033.stdout:6/1: rename - no filename 2024-02-15T22:40:32.560 INFO:tasks.workunit.client.0.smithi033.stdout:6/2: write - no filename 2024-02-15T22:40:32.560 INFO:tasks.workunit.client.0.smithi033.stdout:5/4: symlink l0 0 2024-02-15T22:40:32.560 INFO:tasks.workunit.client.0.smithi033.stdout:5/5: dwrite - no filename 2024-02-15T22:40:32.561 INFO:tasks.workunit.client.0.smithi033.stdout:5/6: chown l0 5 1 2024-02-15T22:40:32.561 INFO:tasks.workunit.client.0.smithi033.stdout:3/7: mknod d0/c2 0 2024-02-15T22:40:32.561 INFO:tasks.workunit.client.0.smithi033.stdout:2/16: mknod d1/c3 0 2024-02-15T22:40:32.561 INFO:tasks.workunit.client.0.smithi033.stdout:2/17: chown d1/c3 73 1 2024-02-15T22:40:32.564 INFO:tasks.workunit.client.0.smithi033.stdout:7/0: truncate - no filename 2024-02-15T22:40:32.564 INFO:tasks.workunit.client.0.smithi033.stdout:7/1: dwrite - no filename 2024-02-15T22:40:32.565 INFO:tasks.workunit.client.0.smithi033.stdout:7/2: chown . 363867 1 2024-02-15T22:40:32.565 INFO:tasks.workunit.client.0.smithi033.stdout:7/3: chown . 27291 1 2024-02-15T22:40:32.565 INFO:tasks.workunit.client.0.smithi033.stdout:6/3: symlink l0 0 2024-02-15T22:40:32.565 INFO:tasks.workunit.client.0.smithi033.stdout:6/4: truncate - no filename 2024-02-15T22:40:32.565 INFO:tasks.workunit.client.0.smithi033.stdout:6/5: write - no filename 2024-02-15T22:40:32.566 INFO:tasks.workunit.client.0.smithi033.stdout:5/7: mknod c1 0 2024-02-15T22:40:32.566 INFO:tasks.workunit.client.0.smithi033.stdout:5/8: chown c1 15 1 2024-02-15T22:40:32.566 INFO:tasks.workunit.client.0.smithi033.stdout:5/9: dwrite - no filename 2024-02-15T22:40:32.566 INFO:tasks.workunit.client.0.smithi033.stdout:3/8: mkdir d0/d3 0 2024-02-15T22:40:32.566 INFO:tasks.workunit.client.0.smithi033.stdout:3/9: rename d0 to d0/d3/d4 22 2024-02-15T22:40:32.567 INFO:tasks.workunit.client.0.smithi033.stdout:3/10: truncate - no filename 2024-02-15T22:40:32.567 INFO:tasks.workunit.client.0.smithi033.stdout:3/11: rename d0/d3 to d0/d3/d5 22 2024-02-15T22:40:32.567 INFO:tasks.workunit.client.0.smithi033.stdout:3/12: fsync - no filename 2024-02-15T22:40:32.576 INFO:tasks.workunit.client.0.smithi033.stdout:2/18: mknod d1/c4 0 2024-02-15T22:40:32.576 INFO:tasks.workunit.client.0.smithi033.stdout:2/19: write d1/f2 [32986,126623] 0 2024-02-15T22:40:32.577 INFO:tasks.workunit.client.0.smithi033.stdout:8/0: truncate - no filename 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:6/6: link l0 l1 0 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:5/10: rename l0 to l2 0 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:5/11: truncate - no filename 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:7/4: mknod c0 0 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:7/5: dwrite - no filename 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:7/6: fdatasync - no filename 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:7/7: stat c0 0 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:3/13: unlink d0/c2 0 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:2/20: rename d1/c3 to d1/c5 0 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:2/21: write d1/f2 [981881,56518] 0 2024-02-15T22:40:32.584 INFO:tasks.workunit.client.0.smithi033.stdout:2/22: write d1/f2 [1182291,113082] 0 2024-02-15T22:40:32.585 INFO:tasks.workunit.client.0.smithi033.stdout:6/7: creat f2 x:0 0 0 2024-02-15T22:40:32.585 INFO:tasks.workunit.client.0.smithi033.stdout:6/8: chown l0 458166572 1 2024-02-15T22:40:32.585 INFO:tasks.workunit.client.0.smithi033.stdout:5/12: stat l2 0 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:3/14: mknod d0/c6 0 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/8: unlink c0 0 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/9: truncate - no filename 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/10: dread - no filename 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/11: dread - no filename 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/12: write - no filename 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/13: chown . 605 1 2024-02-15T22:40:32.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/14: dwrite - no filename 2024-02-15T22:40:32.590 INFO:tasks.workunit.client.0.smithi033.stdout:2/23: link d1/c4 d1/c6 0 2024-02-15T22:40:32.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/9: stat l0 0 2024-02-15T22:40:32.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/10: creat f3 x:0 0 0 2024-02-15T22:40:32.591 INFO:tasks.workunit.client.0.smithi033.stdout:6/11: creat f4 x:0 0 0 2024-02-15T22:40:32.591 INFO:tasks.workunit.client.0.smithi033.stdout:6/12: chown f3 351580351 1 2024-02-15T22:40:32.594 INFO:tasks.workunit.client.0.smithi033.stdout:3/15: creat d0/f7 x:0 0 0 2024-02-15T22:40:32.595 INFO:tasks.workunit.client.0.smithi033.stdout:7/15: symlink l1 0 2024-02-15T22:40:32.596 INFO:tasks.workunit.client.0.smithi033.stdout:9/0: creat f0 x:0 0 0 2024-02-15T22:40:32.596 INFO:tasks.workunit.client.0.smithi033.stdout:9/1: creat f1 x:0 0 0 2024-02-15T22:40:32.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/2: creat f2 x:0 0 0 2024-02-15T22:40:32.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/3: chown f1 26 1 2024-02-15T22:40:32.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/4: write f0 [843324,48781] 0 2024-02-15T22:40:32.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/5: rmdir - no directory 2024-02-15T22:40:32.599 INFO:tasks.workunit.client.0.smithi033.stdout:3/16: mkdir d0/d8 0 2024-02-15T22:40:32.599 INFO:tasks.workunit.client.0.smithi033.stdout:7/16: symlink l2 0 2024-02-15T22:40:32.602 INFO:tasks.workunit.client.0.smithi033.stdout:3/17: creat d0/d3/f9 x:0 0 0 2024-02-15T22:40:32.603 INFO:tasks.workunit.client.0.smithi033.stdout:7/17: mknod c3 0 2024-02-15T22:40:32.603 INFO:tasks.workunit.client.0.smithi033.stdout:7/18: write - no filename 2024-02-15T22:40:32.603 INFO:tasks.workunit.client.0.smithi033.stdout:7/19: fsync - no filename 2024-02-15T22:40:32.604 INFO:tasks.workunit.client.0.smithi033.stdout:7/20: write - no filename 2024-02-15T22:40:32.607 INFO:tasks.workunit.client.0.smithi033.stdout:7/21: creat f4 x:0 0 0 2024-02-15T22:40:32.607 INFO:tasks.workunit.client.0.smithi033.stdout:7/22: dread - f4 zero size 2024-02-15T22:40:32.607 INFO:tasks.workunit.client.0.smithi033.stdout:7/23: stat l2 0 2024-02-15T22:40:32.607 INFO:tasks.workunit.client.0.smithi033.stdout:7/24: truncate f4 511568 0 2024-02-15T22:40:32.635 INFO:tasks.workunit.client.1.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T22:40:32.638 INFO:tasks.workunit.client.1.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T22:40:32.638 INFO:tasks.workunit.client.1.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T22:40:32.838 INFO:tasks.workunit.client.0.smithi033.stdout:1/3: dwrite f0 [0,4194304] 0 2024-02-15T22:40:32.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/13: getdents . 0 2024-02-15T22:40:32.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/14: read - no filename 2024-02-15T22:40:32.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/15: chown c1 12431 1 2024-02-15T22:40:32.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/16: dread - no filename 2024-02-15T22:40:32.887 INFO:tasks.workunit.client.1.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T22:40:32.892 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:40:32.892 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-15T22:40:32.957 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-15T22:40:32.959 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T22:40:32.959 DEBUG:teuthology.orchestra.run.smithi082:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f78a58c0ffd401d1493058a1022c35f011d65275 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-15T22:40:33.040 INFO:tasks.workunit.client.1.smithi082.stderr:+ mkdir -p fsstress 2024-02-15T22:40:33.044 INFO:tasks.workunit.client.1.smithi082.stderr:+ pushd fsstress 2024-02-15T22:40:33.045 INFO:tasks.workunit.client.1.smithi082.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:40:33.045 INFO:tasks.workunit.client.1.smithi082.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T22:40:33.109 INFO:tasks.workunit.client.0.smithi033.stdout:6/13: dwrite f4 [0,4194304] 0 2024-02-15T22:40:33.274 INFO:tasks.workunit.client.0.smithi033.stdout:7/25: dread f4 [0,4194304] 0 2024-02-15T22:40:33.361 INFO:tasks.workunit.client.0.smithi033.stdout:1/4: dread f0 [0,4194304] 0 2024-02-15T22:40:33.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:33 smithi082 ceph-mon[37153]: pgmap v244: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 523 op/s 2024-02-15T22:40:33.389 INFO:tasks.workunit.client.0.smithi033.stdout:6/14: dread f4 [0,4194304] 0 2024-02-15T22:40:33.426 INFO:tasks.workunit.client.0.smithi033.stdout:9/6: dwrite f0 [0,4194304] 0 2024-02-15T22:40:33.426 INFO:tasks.workunit.client.0.smithi033.stdout:9/7: readlink - no filename 2024-02-15T22:40:33.426 INFO:tasks.workunit.client.0.smithi033.stdout:9/8: creat f3 x:0 0 0 2024-02-15T22:40:33.443 INFO:tasks.workunit.client.0.smithi033.stdout:6/15: dwrite f3 [0,4194304] 0 2024-02-15T22:40:33.443 INFO:tasks.workunit.client.0.smithi033.stdout:6/16: creat f5 x:0 0 0 2024-02-15T22:40:33.473 INFO:tasks.workunit.client.0.smithi033.stdout:3/18: dwrite d0/d3/f9 [0,4194304] 0 2024-02-15T22:40:33.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/24: dwrite d1/f2 [0,4194304] 0 2024-02-15T22:40:33.480 INFO:tasks.workunit.client.0.smithi033.stdout:2/25: chown d1/c4 870 1 2024-02-15T22:40:33.480 INFO:tasks.workunit.client.0.smithi033.stdout:2/26: fsync d1/f2 0 2024-02-15T22:40:33.481 INFO:tasks.workunit.client.0.smithi033.stdout:7/26: dwrite f4 [0,4194304] 0 2024-02-15T22:40:33.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:33 smithi033 ceph-mon[29033]: pgmap v244: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 523 op/s 2024-02-15T22:40:33.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/17: dwrite f2 [0,4194304] 0 2024-02-15T22:40:33.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/18: creat f6 x:0 0 0 2024-02-15T22:40:33.636 INFO:tasks.workunit.client.0.smithi033.stdout:5/17: mknod c3 0 2024-02-15T22:40:33.636 INFO:tasks.workunit.client.0.smithi033.stdout:5/18: dread - no filename 2024-02-15T22:40:34.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:34 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse restarted 2024-02-15T22:40:34.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:34 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:40:34.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:34 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:40:34.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:34 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:40:34.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:34 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:40:34.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:34 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:40:34.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:34 smithi033 ceph-mon[29033]: Standby manager daemon smithi082.mjhlse restarted 2024-02-15T22:40:34.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:34 smithi033 ceph-mon[29033]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:40:34.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:34 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:40:34.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:34 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:40:34.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:34 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:40:34.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:34 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:40:34.988 INFO:tasks.workunit.client.1.smithi082.stderr:+ tar xzf ltp-full.tgz 2024-02-15T22:40:35.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:35 smithi082 ceph-mon[37153]: pgmap v245: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 602 op/s 2024-02-15T22:40:35.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:35 smithi082 ceph-mon[37153]: mgrmap e20: smithi033.swohxi(active, since 7m), standbys: smithi082.mjhlse 2024-02-15T22:40:35.406 INFO:tasks.workunit.client.0.smithi033.stdout:1/5: mkdir d1 0 2024-02-15T22:40:35.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:35 smithi033 ceph-mon[29033]: pgmap v245: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 602 op/s 2024-02-15T22:40:35.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:35 smithi033 ceph-mon[29033]: mgrmap e20: smithi033.swohxi(active, since 7m), standbys: smithi082.mjhlse 2024-02-15T22:40:36.129 INFO:tasks.workunit.client.0.smithi033.stdout:7/27: mkdir d5 0 2024-02-15T22:40:36.147 INFO:tasks.workunit.client.0.smithi033.stdout:7/28: dwrite f4 [0,4194304] 0 2024-02-15T22:40:36.728 INFO:tasks.workunit.client.0.smithi033.stdout:6/19: symlink l7 0 2024-02-15T22:40:36.728 INFO:tasks.workunit.client.0.smithi033.stdout:5/19: getdents . 0 2024-02-15T22:40:36.730 INFO:tasks.workunit.client.0.smithi033.stdout:1/6: creat d1/f2 x:0 0 0 2024-02-15T22:40:36.830 INFO:tasks.workunit.client.0.smithi033.stdout:6/20: mknod c8 0 2024-02-15T22:40:36.832 INFO:tasks.workunit.client.0.smithi033.stdout:5/20: creat f4 x:0 0 0 2024-02-15T22:40:36.832 INFO:tasks.workunit.client.0.smithi033.stdout:5/21: read - f4 zero size 2024-02-15T22:40:36.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/7: unlink f0 0 2024-02-15T22:40:36.850 INFO:tasks.workunit.client.0.smithi033.stdout:6/21: write f2 [255397,104719] 0 2024-02-15T22:40:36.856 INFO:tasks.workunit.client.0.smithi033.stdout:5/22: dwrite f4 [0,4194304] 0 2024-02-15T22:40:36.857 INFO:tasks.workunit.client.0.smithi033.stdout:1/8: dwrite d1/f2 [0,4194304] 0 2024-02-15T22:40:36.866 INFO:tasks.workunit.client.0.smithi033.stdout:5/23: mknod c5 0 2024-02-15T22:40:36.869 INFO:tasks.workunit.client.0.smithi033.stdout:6/22: dwrite f3 [0,4194304] 0 2024-02-15T22:40:36.869 INFO:tasks.workunit.client.0.smithi033.stdout:6/23: truncate f5 323023 0 2024-02-15T22:40:36.873 INFO:tasks.workunit.client.0.smithi033.stdout:6/24: mknod c9 0 2024-02-15T22:40:36.873 INFO:tasks.workunit.client.0.smithi033.stdout:6/25: chown l7 0 1 2024-02-15T22:40:36.873 INFO:tasks.workunit.client.0.smithi033.stdout:6/26: read - f6 zero size 2024-02-15T22:40:36.873 INFO:tasks.workunit.client.0.smithi033.stdout:6/27: read - f6 zero size 2024-02-15T22:40:36.875 INFO:tasks.workunit.client.0.smithi033.stdout:1/9: dwrite d1/f2 [0,4194304] 0 2024-02-15T22:40:36.875 INFO:tasks.workunit.client.0.smithi033.stdout:1/10: creat d1/f3 x:0 0 0 2024-02-15T22:40:36.881 INFO:tasks.workunit.client.0.smithi033.stdout:1/11: symlink d1/l4 0 2024-02-15T22:40:36.881 INFO:tasks.workunit.client.0.smithi033.stdout:1/12: chown d1 0 1 2024-02-15T22:40:36.883 INFO:tasks.workunit.client.0.smithi033.stdout:5/24: dwrite f4 [0,4194304] 0 2024-02-15T22:40:37.004 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:36 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.004 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:36 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.004 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:36 smithi082 ceph-mon[37153]: pgmap v246: 65 pgs: 65 active+clean; 136 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 10 MiB/s wr, 726 op/s 2024-02-15T22:40:37.004 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:36 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.005 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:36 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.113 INFO:tasks.workunit.client.0.smithi033.stdout:2/27: dwrite d1/f2 [4194304,4194304] 0 2024-02-15T22:40:37.113 INFO:tasks.workunit.client.0.smithi033.stdout:2/28: creat d1/f7 x:0 0 0 2024-02-15T22:40:37.119 INFO:tasks.workunit.client.0.smithi033.stdout:2/29: write d1/f2 [4101333,64332] 0 2024-02-15T22:40:37.130 INFO:tasks.workunit.client.0.smithi033.stdout:2/30: write d1/f2 [5754127,130592] 0 2024-02-15T22:40:37.130 INFO:tasks.workunit.client.0.smithi033.stdout:2/31: truncate d1/f7 921632 0 2024-02-15T22:40:37.145 INFO:tasks.workunit.client.0.smithi033.stdout:2/32: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:37.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:36 smithi033 ceph-mon[29033]: pgmap v246: 65 pgs: 65 active+clean; 136 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 10 MiB/s wr, 726 op/s 2024-02-15T22:40:37.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:36 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:37.547 INFO:tasks.workunit.client.0.smithi033.stdout:5/25: readlink l2 0 2024-02-15T22:40:37.552 INFO:tasks.workunit.client.0.smithi033.stdout:2/33: mkdir d1/d8 0 2024-02-15T22:40:37.554 INFO:tasks.workunit.client.0.smithi033.stdout:2/34: mknod d1/c9 0 2024-02-15T22:40:37.556 INFO:tasks.workunit.client.0.smithi033.stdout:5/26: mkdir d6 0 2024-02-15T22:40:37.557 INFO:tasks.workunit.client.0.smithi033.stdout:2/35: mkdir d1/d8/da 0 2024-02-15T22:40:37.558 INFO:tasks.workunit.client.0.smithi033.stdout:5/27: creat d6/f7 x:0 0 0 2024-02-15T22:40:37.560 INFO:tasks.workunit.client.0.smithi033.stdout:5/28: mknod d6/c8 0 2024-02-15T22:40:37.561 INFO:tasks.workunit.client.0.smithi033.stdout:5/29: mknod d6/c9 0 2024-02-15T22:40:37.570 INFO:tasks.workunit.client.0.smithi033.stdout:5/30: dread f4 [0,4194304] 0 2024-02-15T22:40:37.585 INFO:tasks.workunit.client.0.smithi033.stdout:6/28: dwrite f2 [4194304,4194304] 0 2024-02-15T22:40:37.585 INFO:tasks.workunit.client.0.smithi033.stdout:6/29: write f6 [477768,38537] 0 2024-02-15T22:40:37.715 INFO:tasks.workunit.client.0.smithi033.stdout:7/29: truncate f4 2970175 0 2024-02-15T22:40:37.740 INFO:tasks.workunit.client.0.smithi033.stdout:6/30: unlink f4 0 2024-02-15T22:40:37.740 INFO:tasks.workunit.client.0.smithi033.stdout:6/31: write f6 [1342033,89505] 0 2024-02-15T22:40:37.745 INFO:tasks.workunit.client.0.smithi033.stdout:1/13: getdents d1 0 2024-02-15T22:40:37.755 INFO:tasks.workunit.client.0.smithi033.stdout:1/14: write d1/f2 [67407,107018] 0 2024-02-15T22:40:37.772 INFO:tasks.workunit.client.0.smithi033.stdout:1/15: dwrite d1/f3 [0,4194304] 0 2024-02-15T22:40:37.780 INFO:tasks.workunit.client.0.smithi033.stdout:1/16: dread d1/f2 [0,4194304] 0 2024-02-15T22:40:37.795 INFO:tasks.workunit.client.0.smithi033.stdout:1/17: dwrite d1/f3 [0,4194304] 0 2024-02-15T22:40:37.796 INFO:tasks.workunit.client.0.smithi033.stdout:1/18: fdatasync d1/f2 0 2024-02-15T22:40:37.808 INFO:tasks.workunit.client.0.smithi033.stdout:6/32: rename f3 to fa 0 2024-02-15T22:40:37.808 INFO:tasks.workunit.client.0.smithi033.stdout:6/33: fdatasync f2 0 2024-02-15T22:40:37.811 INFO:tasks.workunit.client.0.smithi033.stdout:1/19: creat d1/f5 x:0 0 0 2024-02-15T22:40:37.815 INFO:tasks.workunit.client.0.smithi033.stdout:6/34: write f2 [4412308,55443] 0 2024-02-15T22:40:37.817 INFO:tasks.workunit.client.0.smithi033.stdout:6/35: symlink lb 0 2024-02-15T22:40:37.819 INFO:tasks.workunit.client.0.smithi033.stdout:1/20: read d1/f3 [2623253,41674] 0 2024-02-15T22:40:37.819 INFO:tasks.workunit.client.0.smithi033.stdout:6/36: write f6 [137926,81654] 0 2024-02-15T22:40:37.819 INFO:tasks.workunit.client.0.smithi033.stdout:6/37: rmdir - no directory 2024-02-15T22:40:37.820 INFO:tasks.workunit.client.0.smithi033.stdout:1/21: creat d1/f6 x:0 0 0 2024-02-15T22:40:37.820 INFO:tasks.workunit.client.0.smithi033.stdout:1/22: creat d1/f7 x:0 0 0 2024-02-15T22:40:37.820 INFO:tasks.workunit.client.0.smithi033.stdout:1/23: truncate d1/f5 1016707 0 2024-02-15T22:40:37.820 INFO:tasks.workunit.client.0.smithi033.stdout:1/24: chown d1 27928 1 2024-02-15T22:40:37.825 INFO:tasks.workunit.client.0.smithi033.stdout:6/38: fsync f6 0 2024-02-15T22:40:37.825 INFO:tasks.workunit.client.0.smithi033.stdout:1/25: dread d1/f3 [0,4194304] 0 2024-02-15T22:40:37.827 INFO:tasks.workunit.client.0.smithi033.stdout:6/39: mknod cc 0 2024-02-15T22:40:37.827 INFO:tasks.workunit.client.0.smithi033.stdout:6/40: creat fd x:0 0 0 2024-02-15T22:40:37.830 INFO:tasks.workunit.client.0.smithi033.stdout:6/41: symlink le 0 2024-02-15T22:40:38.431 INFO:tasks.workunit.client.0.smithi033.stdout:2/36: dwrite d1/f7 [4194304,4194304] 0 2024-02-15T22:40:38.431 INFO:tasks.workunit.client.0.smithi033.stdout:2/37: chown d1/c5 42906 1 2024-02-15T22:40:38.436 INFO:tasks.workunit.client.0.smithi033.stdout:1/26: getdents d1 0 2024-02-15T22:40:38.438 INFO:tasks.workunit.client.0.smithi033.stdout:6/42: getdents . 0 2024-02-15T22:40:38.440 INFO:tasks.workunit.client.0.smithi033.stdout:6/43: unlink f2 0 2024-02-15T22:40:38.440 INFO:tasks.workunit.client.0.smithi033.stdout:6/44: rmdir - no directory 2024-02-15T22:40:38.441 INFO:tasks.workunit.client.0.smithi033.stdout:6/45: creat ff x:0 0 0 2024-02-15T22:40:38.441 INFO:tasks.workunit.client.0.smithi033.stdout:6/46: fdatasync f5 0 2024-02-15T22:40:38.441 INFO:tasks.workunit.client.0.smithi033.stdout:1/27: dread d1/f3 [0,4194304] 0 2024-02-15T22:40:38.446 INFO:tasks.workunit.client.0.smithi033.stdout:2/38: write d1/f7 [1994574,3616] 0 2024-02-15T22:40:38.447 INFO:tasks.workunit.client.0.smithi033.stdout:2/39: chown d1/c4 0 1 2024-02-15T22:40:38.447 INFO:tasks.workunit.client.0.smithi033.stdout:2/40: stat d1 0 2024-02-15T22:40:38.447 INFO:tasks.workunit.client.0.smithi033.stdout:1/28: rename d1/f2 to d1/f8 0 2024-02-15T22:40:38.448 INFO:tasks.workunit.client.0.smithi033.stdout:7/30: dread f4 [0,4194304] 0 2024-02-15T22:40:38.449 INFO:tasks.workunit.client.0.smithi033.stdout:2/41: link d1/f7 d1/d8/da/fb 0 2024-02-15T22:40:38.450 INFO:tasks.workunit.client.0.smithi033.stdout:1/29: mknod d1/c9 0 2024-02-15T22:40:38.452 INFO:tasks.workunit.client.0.smithi033.stdout:2/42: getdents d1/d8 0 2024-02-15T22:40:38.452 INFO:tasks.workunit.client.0.smithi033.stdout:2/43: chown d1/d8/da 2 1 2024-02-15T22:40:38.453 INFO:tasks.workunit.client.0.smithi033.stdout:1/30: rename d1/f3 to d1/fa 0 2024-02-15T22:40:38.454 INFO:tasks.workunit.client.0.smithi033.stdout:1/31: chown d1/l4 24073838 1 2024-02-15T22:40:38.455 INFO:tasks.workunit.client.0.smithi033.stdout:2/44: mknod d1/d8/cc 0 2024-02-15T22:40:38.456 INFO:tasks.workunit.client.0.smithi033.stdout:1/32: mknod d1/cb 0 2024-02-15T22:40:38.457 INFO:tasks.workunit.client.0.smithi033.stdout:2/45: write d1/d8/da/fb [9303674,110199] 0 2024-02-15T22:40:38.458 INFO:tasks.workunit.client.0.smithi033.stdout:6/47: dwrite fd [0,4194304] 0 2024-02-15T22:40:38.460 INFO:tasks.workunit.client.0.smithi033.stdout:1/33: mkdir d1/dc 0 2024-02-15T22:40:38.462 INFO:tasks.workunit.client.0.smithi033.stdout:2/46: mknod d1/cd 0 2024-02-15T22:40:38.462 INFO:tasks.workunit.client.0.smithi033.stdout:2/47: chown d1/c5 1030006 1 2024-02-15T22:40:38.465 INFO:tasks.workunit.client.0.smithi033.stdout:7/31: dwrite f4 [0,4194304] 0 2024-02-15T22:40:38.465 INFO:tasks.workunit.client.0.smithi033.stdout:1/34: symlink d1/ld 0 2024-02-15T22:40:38.468 INFO:tasks.workunit.client.0.smithi033.stdout:7/32: mkdir d5/d6 0 2024-02-15T22:40:38.470 INFO:tasks.workunit.client.0.smithi033.stdout:1/35: rmdir d1/dc 0 2024-02-15T22:40:38.472 INFO:tasks.workunit.client.0.smithi033.stdout:2/48: link d1/f2 d1/d8/fe 0 2024-02-15T22:40:38.473 INFO:tasks.workunit.client.0.smithi033.stdout:6/48: rename le to l10 0 2024-02-15T22:40:38.474 INFO:tasks.workunit.client.0.smithi033.stdout:7/33: creat d5/d6/f7 x:0 0 0 2024-02-15T22:40:38.476 INFO:tasks.workunit.client.0.smithi033.stdout:7/34: symlink d5/l8 0 2024-02-15T22:40:38.478 INFO:tasks.workunit.client.0.smithi033.stdout:6/49: symlink l11 0 2024-02-15T22:40:38.479 INFO:tasks.workunit.client.0.smithi033.stdout:7/35: symlink d5/l9 0 2024-02-15T22:40:38.479 INFO:tasks.workunit.client.0.smithi033.stdout:7/36: dread - d5/d6/f7 zero size 2024-02-15T22:40:38.480 INFO:tasks.workunit.client.0.smithi033.stdout:7/37: creat d5/d6/fa x:0 0 0 2024-02-15T22:40:38.480 INFO:tasks.workunit.client.0.smithi033.stdout:7/38: fdatasync f4 0 2024-02-15T22:40:38.487 INFO:tasks.workunit.client.0.smithi033.stdout:2/49: dread d1/d8/da/fb [4194304,4194304] 0 2024-02-15T22:40:38.489 INFO:tasks.workunit.client.0.smithi033.stdout:6/50: dread fd [0,4194304] 0 2024-02-15T22:40:38.492 INFO:tasks.workunit.client.0.smithi033.stdout:6/51: mkdir d12 0 2024-02-15T22:40:38.492 INFO:tasks.workunit.client.0.smithi033.stdout:2/50: dread d1/d8/fe [4194304,4194304] 0 2024-02-15T22:40:38.492 INFO:tasks.workunit.client.0.smithi033.stdout:2/51: chown d1/f2 24341 1 2024-02-15T22:40:38.494 INFO:tasks.workunit.client.0.smithi033.stdout:2/52: mknod d1/d8/da/cf 0 2024-02-15T22:40:38.494 INFO:tasks.workunit.client.0.smithi033.stdout:2/53: chown d1 3046568 1 2024-02-15T22:40:38.499 INFO:tasks.workunit.client.0.smithi033.stdout:2/54: dread d1/d8/da/fb [4194304,4194304] 0 2024-02-15T22:40:38.503 INFO:tasks.workunit.client.0.smithi033.stdout:1/36: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:38.503 INFO:tasks.workunit.client.0.smithi033.stdout:1/37: readlink d1/ld 0 2024-02-15T22:40:38.503 INFO:tasks.workunit.client.0.smithi033.stdout:1/38: read - d1/f6 zero size 2024-02-15T22:40:38.504 INFO:tasks.workunit.client.0.smithi033.stdout:1/39: chown d1/ld 2667620 1 2024-02-15T22:40:38.506 INFO:tasks.workunit.client.0.smithi033.stdout:1/40: mkdir d1/de 0 2024-02-15T22:40:38.507 INFO:tasks.workunit.client.0.smithi033.stdout:1/41: mknod d1/de/cf 0 2024-02-15T22:40:38.507 INFO:tasks.workunit.client.0.smithi033.stdout:1/42: write d1/f6 [858178,3331] 0 2024-02-15T22:40:38.507 INFO:tasks.workunit.client.0.smithi033.stdout:1/43: chown d1/f6 931 1 2024-02-15T22:40:38.508 INFO:tasks.workunit.client.0.smithi033.stdout:1/44: link d1/c9 d1/c10 0 2024-02-15T22:40:38.509 INFO:tasks.workunit.client.0.smithi033.stdout:7/39: dwrite f4 [4194304,4194304] 0 2024-02-15T22:40:38.510 INFO:tasks.workunit.client.0.smithi033.stdout:1/45: creat d1/f11 x:0 0 0 2024-02-15T22:40:38.510 INFO:tasks.workunit.client.0.smithi033.stdout:1/46: truncate d1/f5 1041118 0 2024-02-15T22:40:38.510 INFO:tasks.workunit.client.0.smithi033.stdout:1/47: chown d1/f8 14223 1 2024-02-15T22:40:38.511 INFO:tasks.workunit.client.0.smithi033.stdout:7/40: mknod d5/cb 0 2024-02-15T22:40:38.512 INFO:tasks.workunit.client.0.smithi033.stdout:6/52: dwrite fd [0,4194304] 0 2024-02-15T22:40:38.513 INFO:tasks.workunit.client.0.smithi033.stdout:7/41: mkdir d5/dc 0 2024-02-15T22:40:38.513 INFO:tasks.workunit.client.0.smithi033.stdout:7/42: dread - d5/d6/f7 zero size 2024-02-15T22:40:38.513 INFO:tasks.workunit.client.0.smithi033.stdout:7/43: chown l1 10251151 1 2024-02-15T22:40:38.518 INFO:tasks.workunit.client.0.smithi033.stdout:2/55: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:38.540 INFO:tasks.workunit.client.0.smithi033.stdout:1/48: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:38.540 INFO:tasks.workunit.client.0.smithi033.stdout:7/44: dwrite d5/d6/fa [0,4194304] 0 2024-02-15T22:40:38.543 INFO:tasks.workunit.client.0.smithi033.stdout:7/45: creat d5/dc/fd x:0 0 0 2024-02-15T22:40:38.544 INFO:tasks.workunit.client.0.smithi033.stdout:7/46: mknod d5/dc/ce 0 2024-02-15T22:40:38.647 INFO:tasks.workunit.client.0.smithi033.stdout:0/5: sync 2024-02-15T22:40:38.800 INFO:tasks.workunit.client.0.smithi033.stdout:0/6: dread f0 [0,4194304] 0 2024-02-15T22:40:38.800 INFO:tasks.workunit.client.0.smithi033.stdout:0/7: fdatasync f0 0 2024-02-15T22:40:38.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/8: getdents . 0 2024-02-15T22:40:38.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/9: stat f0 0 2024-02-15T22:40:38.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/10: chown f0 229 1 2024-02-15T22:40:38.857 INFO:tasks.workunit.client.0.smithi033.stdout:0/11: dread f0 [0,4194304] 0 2024-02-15T22:40:38.859 INFO:tasks.workunit.client.0.smithi033.stdout:0/12: dread f0 [0,4194304] 0 2024-02-15T22:40:38.865 INFO:tasks.workunit.client.0.smithi033.stdout:0/13: link f0 f1 0 2024-02-15T22:40:38.867 INFO:tasks.workunit.client.0.smithi033.stdout:0/14: dread f0 [0,4194304] 0 2024-02-15T22:40:38.869 INFO:tasks.workunit.client.0.smithi033.stdout:0/15: dread f1 [0,4194304] 0 2024-02-15T22:40:38.870 INFO:tasks.workunit.client.0.smithi033.stdout:0/16: dread f1 [0,4194304] 0 2024-02-15T22:40:38.874 INFO:tasks.workunit.client.0.smithi033.stdout:0/17: creat f2 x:0 0 0 2024-02-15T22:40:38.878 INFO:tasks.workunit.client.0.smithi033.stdout:0/18: unlink f2 0 2024-02-15T22:40:38.878 INFO:tasks.workunit.client.0.smithi033.stdout:0/19: creat f3 x:0 0 0 2024-02-15T22:40:38.879 INFO:tasks.workunit.client.0.smithi033.stdout:0/20: write f1 [1058886,46278] 0 2024-02-15T22:40:38.884 INFO:tasks.workunit.client.0.smithi033.stdout:0/21: dread f1 [0,4194304] 0 2024-02-15T22:40:38.884 INFO:tasks.workunit.client.0.smithi033.stdout:0/22: stat f3 0 2024-02-15T22:40:38.884 INFO:tasks.workunit.client.0.smithi033.stdout:0/23: chown f3 20633 1 2024-02-15T22:40:38.899 INFO:tasks.workunit.client.0.smithi033.stdout:0/24: dwrite f0 [0,4194304] 0 2024-02-15T22:40:38.900 INFO:tasks.workunit.client.0.smithi033.stdout:0/25: dread - f3 zero size 2024-02-15T22:40:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:2/56: fsync d1/f7 0 2024-02-15T22:40:39.040 INFO:tasks.workunit.client.0.smithi033.stdout:6/53: write fd [4596725,27452] 0 2024-02-15T22:40:39.044 INFO:tasks.workunit.client.0.smithi033.stdout:6/54: link ff d12/f13 0 2024-02-15T22:40:39.047 INFO:tasks.workunit.client.0.smithi033.stdout:6/55: mkdir d12/d14 0 2024-02-15T22:40:39.047 INFO:tasks.workunit.client.0.smithi033.stdout:6/56: truncate f5 802858 0 2024-02-15T22:40:39.051 INFO:tasks.workunit.client.0.smithi033.stdout:6/57: unlink l7 0 2024-02-15T22:40:39.052 INFO:tasks.workunit.client.0.smithi033.stdout:6/58: dread f5 [0,4194304] 0 2024-02-15T22:40:39.052 INFO:tasks.workunit.client.0.smithi033.stdout:6/59: write d12/f13 [310163,99968] 0 2024-02-15T22:40:39.054 INFO:tasks.workunit.client.0.smithi033.stdout:6/60: rmdir d12 39 2024-02-15T22:40:39.061 INFO:tasks.workunit.client.0.smithi033.stdout:2/57: truncate d1/f7 8791057 0 2024-02-15T22:40:39.063 INFO:tasks.workunit.client.0.smithi033.stdout:6/61: write fa [3126195,92251] 0 2024-02-15T22:40:39.066 INFO:tasks.workunit.client.0.smithi033.stdout:7/47: truncate f4 5180641 0 2024-02-15T22:40:39.069 INFO:tasks.workunit.client.0.smithi033.stdout:7/48: mkdir d5/df 0 2024-02-15T22:40:39.069 INFO:tasks.workunit.client.0.smithi033.stdout:7/49: truncate d5/d6/f7 480546 0 2024-02-15T22:40:39.081 INFO:tasks.workunit.client.0.smithi033.stdout:6/62: dwrite ff [0,4194304] 0 2024-02-15T22:40:39.084 INFO:tasks.workunit.client.0.smithi033.stdout:6/63: symlink d12/l15 0 2024-02-15T22:40:39.086 INFO:tasks.workunit.client.0.smithi033.stdout:6/64: read f6 [302795,78023] 0 2024-02-15T22:40:39.089 INFO:tasks.workunit.client.0.smithi033.stdout:6/65: unlink fd 0 2024-02-15T22:40:39.107 INFO:tasks.workunit.client.0.smithi033.stdout:6/66: dwrite d12/f13 [0,4194304] 0 2024-02-15T22:40:39.109 INFO:tasks.workunit.client.0.smithi033.stdout:6/67: chown c8 3832 1 2024-02-15T22:40:39.111 INFO:tasks.workunit.client.0.smithi033.stdout:6/68: creat d12/d14/f16 x:0 0 0 2024-02-15T22:40:39.119 INFO:tasks.workunit.client.0.smithi033.stdout:6/69: read ff [248744,22653] 0 2024-02-15T22:40:39.121 INFO:tasks.workunit.client.0.smithi033.stdout:6/70: mknod d12/c17 0 2024-02-15T22:40:39.123 INFO:tasks.workunit.client.0.smithi033.stdout:6/71: creat d12/f18 x:0 0 0 2024-02-15T22:40:39.140 INFO:tasks.workunit.client.0.smithi033.stdout:6/72: dwrite d12/f13 [0,4194304] 0 2024-02-15T22:40:39.140 INFO:tasks.workunit.client.0.smithi033.stdout:6/73: chown l11 1153 1 2024-02-15T22:40:39.140 INFO:tasks.workunit.client.0.smithi033.stdout:6/74: chown ff 47522969 1 2024-02-15T22:40:39.146 INFO:tasks.workunit.client.0.smithi033.stdout:6/75: dread fa [0,4194304] 0 2024-02-15T22:40:39.148 INFO:tasks.workunit.client.0.smithi033.stdout:6/76: mkdir d12/d14/d19 0 2024-02-15T22:40:39.149 INFO:tasks.workunit.client.0.smithi033.stdout:6/77: readlink d12/l15 0 2024-02-15T22:40:39.149 INFO:tasks.workunit.client.0.smithi033.stdout:6/78: dread - d12/f18 zero size 2024-02-15T22:40:39.158 INFO:tasks.workunit.client.0.smithi033.stdout:6/79: write ff [1510136,58577] 0 2024-02-15T22:40:39.159 INFO:tasks.workunit.client.0.smithi033.stdout:6/80: mkdir d12/d14/d19/d1a 0 2024-02-15T22:40:39.162 INFO:tasks.workunit.client.0.smithi033.stdout:6/81: unlink l10 0 2024-02-15T22:40:39.162 INFO:tasks.workunit.client.0.smithi033.stdout:6/82: write ff [3444147,49566] 0 2024-02-15T22:40:39.162 INFO:tasks.workunit.client.0.smithi033.stdout:6/83: fdatasync f6 0 2024-02-15T22:40:39.164 INFO:tasks.workunit.client.0.smithi033.stdout:6/84: mkdir d12/d1b 0 2024-02-15T22:40:39.188 INFO:tasks.workunit.client.0.smithi033.stdout:0/26: fsync f3 0 2024-02-15T22:40:39.188 INFO:tasks.workunit.client.0.smithi033.stdout:0/27: rmdir - no directory 2024-02-15T22:40:39.197 INFO:tasks.workunit.client.0.smithi033.stdout:0/28: dread f0 [0,4194304] 0 2024-02-15T22:40:39.197 INFO:tasks.workunit.client.0.smithi033.stdout:0/29: dread - f3 zero size 2024-02-15T22:40:39.202 INFO:tasks.workunit.client.0.smithi033.stdout:0/30: dread f1 [0,4194304] 0 2024-02-15T22:40:39.211 INFO:tasks.workunit.client.0.smithi033.stdout:0/31: unlink f3 0 2024-02-15T22:40:39.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:38 smithi033 ceph-mon[29033]: pgmap v247: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 7.3 MiB/s wr, 430 op/s 2024-02-15T22:40:39.291 INFO:tasks.workunit.client.0.smithi033.stdout:2/58: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:39.294 INFO:tasks.workunit.client.0.smithi033.stdout:2/59: mknod d1/d8/c10 0 2024-02-15T22:40:39.297 INFO:tasks.workunit.client.0.smithi033.stdout:2/60: mknod d1/d8/da/c11 0 2024-02-15T22:40:39.305 INFO:tasks.workunit.client.0.smithi033.stdout:2/61: dread d1/d8/da/fb [0,4194304] 0 2024-02-15T22:40:39.318 INFO:tasks.workunit.client.0.smithi033.stdout:2/62: dwrite d1/f2 [0,4194304] 0 2024-02-15T22:40:39.320 INFO:tasks.workunit.client.0.smithi033.stdout:2/63: mkdir d1/d8/da/d12 0 2024-02-15T22:40:39.336 INFO:tasks.workunit.client.0.smithi033.stdout:2/64: dwrite d1/d8/da/fb [8388608,4194304] 0 2024-02-15T22:40:39.337 INFO:tasks.workunit.client.0.smithi033.stdout:2/65: mkdir d1/d8/da/d13 0 2024-02-15T22:40:39.341 INFO:tasks.workunit.client.0.smithi033.stdout:2/66: write d1/d8/da/fb [6567651,10605] 0 2024-02-15T22:40:39.344 INFO:tasks.workunit.client.0.smithi033.stdout:2/67: getdents d1 0 2024-02-15T22:40:39.363 INFO:tasks.workunit.client.0.smithi033.stdout:2/68: dwrite d1/f7 [12582912,4194304] 0 2024-02-15T22:40:39.365 INFO:tasks.workunit.client.0.smithi033.stdout:2/69: mknod d1/c14 0 2024-02-15T22:40:39.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:38 smithi082 ceph-mon[37153]: pgmap v247: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 7.3 MiB/s wr, 430 op/s 2024-02-15T22:40:39.371 INFO:tasks.workunit.client.0.smithi033.stdout:2/70: creat d1/d8/da/d12/f15 x:0 0 0 2024-02-15T22:40:39.371 INFO:tasks.workunit.client.0.smithi033.stdout:2/71: fdatasync d1/f7 0 2024-02-15T22:40:39.371 INFO:tasks.workunit.client.0.smithi033.stdout:2/72: dread - d1/d8/da/d12/f15 zero size 2024-02-15T22:40:39.378 INFO:tasks.workunit.client.0.smithi033.stdout:2/73: write d1/d8/fe [3498020,55] 0 2024-02-15T22:40:39.379 INFO:tasks.workunit.client.0.smithi033.stdout:2/74: mkdir d1/d16 0 2024-02-15T22:40:39.813 INFO:tasks.workunit.client.0.smithi033.stdout:7/50: truncate f4 1637176 0 2024-02-15T22:40:39.896 INFO:tasks.workunit.client.0.smithi033.stdout:3/19: sync 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:9/9: sync 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:5/31: sync 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/1: sync 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/2: write - no filename 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/3: rmdir - no directory 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/4: truncate - no filename 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/5: write - no filename 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/6: write - no filename 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/7: dwrite - no filename 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:5/32: write d6/f7 [946693,15471] 0 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:8/1: sync 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:8/2: link - no file 2024-02-15T22:40:39.897 INFO:tasks.workunit.client.0.smithi033.stdout:8/3: truncate - no filename 2024-02-15T22:40:39.898 INFO:tasks.workunit.client.0.smithi033.stdout:8/4: truncate - no filename 2024-02-15T22:40:39.898 INFO:tasks.workunit.client.0.smithi033.stdout:0/32: sync 2024-02-15T22:40:39.898 INFO:tasks.workunit.client.0.smithi033.stdout:1/49: sync 2024-02-15T22:40:39.898 INFO:tasks.workunit.client.0.smithi033.stdout:6/85: sync 2024-02-15T22:40:39.898 INFO:tasks.workunit.client.0.smithi033.stdout:1/50: chown d1/f7 172 1 2024-02-15T22:40:39.898 INFO:tasks.workunit.client.0.smithi033.stdout:2/75: sync 2024-02-15T22:40:39.898 INFO:tasks.workunit.client.0.smithi033.stdout:1/51: chown d1/l4 1038 1 2024-02-15T22:40:39.899 INFO:tasks.workunit.client.0.smithi033.stdout:9/10: mkdir d4 0 2024-02-15T22:40:39.901 INFO:tasks.workunit.client.0.smithi033.stdout:3/20: symlink d0/d8/la 0 2024-02-15T22:40:39.902 INFO:tasks.workunit.client.0.smithi033.stdout:0/33: dread f0 [0,4194304] 0 2024-02-15T22:40:39.903 INFO:tasks.workunit.client.0.smithi033.stdout:7/51: dread f4 [0,4194304] 0 2024-02-15T22:40:39.903 INFO:tasks.workunit.client.0.smithi033.stdout:5/33: truncate f4 2638156 0 2024-02-15T22:40:39.906 INFO:tasks.workunit.client.0.smithi033.stdout:8/5: creat f0 x:0 0 0 2024-02-15T22:40:39.907 INFO:tasks.workunit.client.0.smithi033.stdout:0/34: write f0 [3332928,81600] 0 2024-02-15T22:40:39.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/52: truncate d1/f8 415753 0 2024-02-15T22:40:39.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/53: dread - d1/f11 zero size 2024-02-15T22:40:39.911 INFO:tasks.workunit.client.0.smithi033.stdout:2/76: creat d1/d8/da/d13/f17 x:0 0 0 2024-02-15T22:40:39.915 INFO:tasks.workunit.client.0.smithi033.stdout:3/21: link d0/f7 d0/d8/fb 0 2024-02-15T22:40:39.916 INFO:tasks.workunit.client.0.smithi033.stdout:7/52: mkdir d5/d6/d10 0 2024-02-15T22:40:39.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/53: dread d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:39.919 INFO:tasks.workunit.client.0.smithi033.stdout:5/34: symlink d6/la 0 2024-02-15T22:40:39.919 INFO:tasks.workunit.client.0.smithi033.stdout:5/35: creat d6/fb x:0 0 0 2024-02-15T22:40:39.919 INFO:tasks.workunit.client.0.smithi033.stdout:5/36: chown l2 5115878 1 2024-02-15T22:40:39.922 INFO:tasks.workunit.client.0.smithi033.stdout:1/54: link d1/c10 d1/c12 0 2024-02-15T22:40:39.923 INFO:tasks.workunit.client.0.smithi033.stdout:2/77: symlink d1/d16/l18 0 2024-02-15T22:40:39.923 INFO:tasks.workunit.client.0.smithi033.stdout:2/78: stat d1/d8/da/d13/f17 0 2024-02-15T22:40:39.928 INFO:tasks.workunit.client.0.smithi033.stdout:8/6: dwrite f0 [0,4194304] 0 2024-02-15T22:40:39.930 INFO:tasks.workunit.client.0.smithi033.stdout:7/54: read d5/d6/fa [2593528,14761] 0 2024-02-15T22:40:39.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/37: rename l2 to d6/lc 0 2024-02-15T22:40:39.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/38: chown d6/lc 1906348 1 2024-02-15T22:40:39.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/39: fsync d6/f7 0 2024-02-15T22:40:39.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/40: read - d6/fb zero size 2024-02-15T22:40:39.932 INFO:tasks.workunit.client.0.smithi033.stdout:0/35: getdents . 0 2024-02-15T22:40:39.937 INFO:tasks.workunit.client.0.smithi033.stdout:8/7: write f0 [3960268,30386] 0 2024-02-15T22:40:39.937 INFO:tasks.workunit.client.0.smithi033.stdout:8/8: chown f0 5233894 1 2024-02-15T22:40:39.938 INFO:tasks.workunit.client.0.smithi033.stdout:1/55: truncate d1/fa 1050195 0 2024-02-15T22:40:39.940 INFO:tasks.workunit.client.0.smithi033.stdout:2/79: creat d1/d8/f19 x:0 0 0 2024-02-15T22:40:39.942 INFO:tasks.workunit.client.0.smithi033.stdout:1/56: dread d1/f5 [0,4194304] 0 2024-02-15T22:40:39.945 INFO:tasks.workunit.client.0.smithi033.stdout:5/41: dwrite d6/f7 [0,4194304] 0 2024-02-15T22:40:39.945 INFO:tasks.workunit.client.0.smithi033.stdout:5/42: write d6/fb [940480,108313] 0 2024-02-15T22:40:39.951 INFO:tasks.workunit.client.0.smithi033.stdout:7/55: symlink d5/dc/l11 0 2024-02-15T22:40:39.951 INFO:tasks.workunit.client.0.smithi033.stdout:7/56: fsync d5/dc/fd 0 2024-02-15T22:40:39.953 INFO:tasks.workunit.client.0.smithi033.stdout:8/9: mkdir d1 0 2024-02-15T22:40:39.954 INFO:tasks.workunit.client.0.smithi033.stdout:0/36: dwrite f0 [0,4194304] 0 2024-02-15T22:40:39.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/80: creat d1/d16/f1a x:0 0 0 2024-02-15T22:40:39.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/81: truncate d1/d8/da/d13/f17 1001946 0 2024-02-15T22:40:39.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/82: rename d1 to d1/d8/da/d1b 22 2024-02-15T22:40:39.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/83: creat d1/d8/da/d13/f1c x:0 0 0 2024-02-15T22:40:39.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/84: chown d1/d8/da/c11 3159009 1 2024-02-15T22:40:39.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/85: chown d1/d8/da/d13 60885391 1 2024-02-15T22:40:39.961 INFO:tasks.workunit.client.0.smithi033.stdout:7/57: rename d5/l8 to d5/l12 0 2024-02-15T22:40:39.963 INFO:tasks.workunit.client.0.smithi033.stdout:8/10: mkdir d1/d2 0 2024-02-15T22:40:39.965 INFO:tasks.workunit.client.0.smithi033.stdout:0/37: creat f4 x:0 0 0 2024-02-15T22:40:39.965 INFO:tasks.workunit.client.0.smithi033.stdout:0/38: creat f5 x:0 0 0 2024-02-15T22:40:39.971 INFO:tasks.workunit.client.0.smithi033.stdout:5/43: unlink c1 0 2024-02-15T22:40:39.976 INFO:tasks.workunit.client.0.smithi033.stdout:8/11: rename d1/d2 to d1/d3 0 2024-02-15T22:40:39.982 INFO:tasks.workunit.client.0.smithi033.stdout:8/12: dread f0 [0,4194304] 0 2024-02-15T22:40:39.982 INFO:tasks.workunit.client.0.smithi033.stdout:8/13: fdatasync f0 0 2024-02-15T22:40:39.982 INFO:tasks.workunit.client.0.smithi033.stdout:8/14: chown f0 1549 1 2024-02-15T22:40:39.987 INFO:tasks.workunit.client.0.smithi033.stdout:5/44: dread f4 [0,4194304] 0 2024-02-15T22:40:39.988 INFO:tasks.workunit.client.0.smithi033.stdout:8/15: dread f0 [0,4194304] 0 2024-02-15T22:40:39.989 INFO:tasks.workunit.client.0.smithi033.stdout:8/16: stat d1/d3 0 2024-02-15T22:40:39.990 INFO:tasks.workunit.client.0.smithi033.stdout:3/22: rmdir d0 39 2024-02-15T22:40:39.994 INFO:tasks.workunit.client.0.smithi033.stdout:8/17: dread f0 [0,4194304] 0 2024-02-15T22:40:39.994 INFO:tasks.workunit.client.0.smithi033.stdout:8/18: getdents d1/d3 0 2024-02-15T22:40:39.994 INFO:tasks.workunit.client.0.smithi033.stdout:3/23: symlink d0/lc 0 2024-02-15T22:40:39.996 INFO:tasks.workunit.client.0.smithi033.stdout:8/19: link f0 d1/d3/f4 0 2024-02-15T22:40:39.999 INFO:tasks.workunit.client.0.smithi033.stdout:3/24: mkdir d0/d3/dd 0 2024-02-15T22:40:40.020 INFO:tasks.workunit.client.0.smithi033.stdout:1/57: dwrite d1/fa [0,4194304] 0 2024-02-15T22:40:40.024 INFO:tasks.workunit.client.0.smithi033.stdout:2/86: rename d1/d8/da to d1/d1d 0 2024-02-15T22:40:40.024 INFO:tasks.workunit.client.0.smithi033.stdout:2/87: truncate d1/d1d/d13/f1c 349213 0 2024-02-15T22:40:40.033 INFO:tasks.workunit.client.0.smithi033.stdout:5/45: rename c3 to d6/cd 0 2024-02-15T22:40:40.034 INFO:tasks.workunit.client.0.smithi033.stdout:8/20: truncate f0 3358400 0 2024-02-15T22:40:40.035 INFO:tasks.workunit.client.0.smithi033.stdout:2/88: dread d1/f7 [8388608,4194304] 0 2024-02-15T22:40:40.035 INFO:tasks.workunit.client.0.smithi033.stdout:2/89: truncate d1/d1d/d13/f1c 508835 0 2024-02-15T22:40:40.037 INFO:tasks.workunit.client.0.smithi033.stdout:1/58: dwrite d1/f6 [0,4194304] 0 2024-02-15T22:40:40.040 INFO:tasks.workunit.client.0.smithi033.stdout:2/90: creat d1/d1d/f1e x:0 0 0 2024-02-15T22:40:40.040 INFO:tasks.workunit.client.0.smithi033.stdout:2/91: write d1/d1d/d13/f1c [851334,45211] 0 2024-02-15T22:40:40.051 INFO:tasks.workunit.client.0.smithi033.stdout:5/46: dwrite d6/fb [0,4194304] 0 2024-02-15T22:40:40.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/92: dwrite d1/d1d/d13/f1c [0,4194304] 0 2024-02-15T22:40:40.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/93: dread - d1/d16/f1a zero size 2024-02-15T22:40:40.064 INFO:tasks.workunit.client.0.smithi033.stdout:5/47: getdents d6 0 2024-02-15T22:40:40.065 INFO:tasks.workunit.client.0.smithi033.stdout:8/21: write d1/d3/f4 [3458261,11980] 0 2024-02-15T22:40:40.067 INFO:tasks.workunit.client.0.smithi033.stdout:2/94: symlink d1/l1f 0 2024-02-15T22:40:40.071 INFO:tasks.workunit.client.0.smithi033.stdout:8/22: rename f0 to d1/f5 0 2024-02-15T22:40:40.072 INFO:tasks.workunit.client.0.smithi033.stdout:5/48: write d6/fb [761947,4777] 0 2024-02-15T22:40:40.074 INFO:tasks.workunit.client.0.smithi033.stdout:2/95: creat d1/f20 x:0 0 0 2024-02-15T22:40:40.078 INFO:tasks.workunit.client.0.smithi033.stdout:8/23: rename d1/d3 to d1/d6 0 2024-02-15T22:40:40.078 INFO:tasks.workunit.client.0.smithi033.stdout:1/59: write d1/f6 [4182138,44633] 0 2024-02-15T22:40:40.080 INFO:tasks.workunit.client.0.smithi033.stdout:5/49: creat d6/fe x:0 0 0 2024-02-15T22:40:40.081 INFO:tasks.workunit.client.0.smithi033.stdout:5/50: creat d6/ff x:0 0 0 2024-02-15T22:40:40.083 INFO:tasks.workunit.client.0.smithi033.stdout:2/96: symlink d1/d1d/l21 0 2024-02-15T22:40:40.086 INFO:tasks.workunit.client.0.smithi033.stdout:8/24: rename d1/d6/f4 to d1/d6/f7 0 2024-02-15T22:40:40.089 INFO:tasks.workunit.client.0.smithi033.stdout:1/60: creat d1/de/f13 x:0 0 0 2024-02-15T22:40:40.093 INFO:tasks.workunit.client.0.smithi033.stdout:2/97: write d1/d1d/d13/f1c [2019949,99225] 0 2024-02-15T22:40:40.098 INFO:tasks.workunit.client.0.smithi033.stdout:8/25: rename d1/f5 to d1/f8 0 2024-02-15T22:40:40.100 INFO:tasks.workunit.client.0.smithi033.stdout:1/61: truncate d1/fa 2318773 0 2024-02-15T22:40:40.100 INFO:tasks.workunit.client.0.smithi033.stdout:1/62: creat d1/de/f14 x:0 0 0 2024-02-15T22:40:40.100 INFO:tasks.workunit.client.0.smithi033.stdout:1/63: chown d1/c9 125 1 2024-02-15T22:40:40.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/64: creat d1/f15 x:0 0 0 2024-02-15T22:40:40.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/65: creat d1/de/f16 x:0 0 0 2024-02-15T22:40:40.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/66: chown d1/c9 125 1 2024-02-15T22:40:40.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/67: chown d1/de/cf 51177 1 2024-02-15T22:40:40.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/68: write d1/f5 [279799,75400] 0 2024-02-15T22:40:40.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/69: readlink d1/ld 0 2024-02-15T22:40:40.102 INFO:tasks.workunit.client.0.smithi033.stdout:5/51: link d6/ff d6/f10 0 2024-02-15T22:40:40.126 INFO:tasks.workunit.client.0.smithi033.stdout:5/52: symlink d6/l11 0 2024-02-15T22:40:40.129 INFO:tasks.workunit.client.0.smithi033.stdout:8/26: truncate d1/d6/f7 683339 0 2024-02-15T22:40:40.132 INFO:tasks.workunit.client.0.smithi033.stdout:1/70: rmdir d1 39 2024-02-15T22:40:40.135 INFO:tasks.workunit.client.0.smithi033.stdout:5/53: mknod d6/c12 0 2024-02-15T22:40:40.139 INFO:tasks.workunit.client.0.smithi033.stdout:8/27: mknod d1/d6/c9 0 2024-02-15T22:40:40.142 INFO:tasks.workunit.client.0.smithi033.stdout:8/28: mkdir d1/da 0 2024-02-15T22:40:40.145 INFO:tasks.workunit.client.0.smithi033.stdout:5/54: getdents d6 0 2024-02-15T22:40:40.147 INFO:tasks.workunit.client.0.smithi033.stdout:1/71: dwrite d1/f11 [0,4194304] 0 2024-02-15T22:40:40.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/29: mknod d1/cb 0 2024-02-15T22:40:40.149 INFO:tasks.workunit.client.0.smithi033.stdout:5/55: dread d6/fb [0,4194304] 0 2024-02-15T22:40:40.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/56: truncate d6/f10 511798 0 2024-02-15T22:40:40.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/57: truncate d6/ff 638182 0 2024-02-15T22:40:40.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/58: fdatasync d6/f7 0 2024-02-15T22:40:40.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/59: dread d6/ff [0,4194304] 0 2024-02-15T22:40:40.155 INFO:tasks.workunit.client.0.smithi033.stdout:8/30: mknod d1/da/cc 0 2024-02-15T22:40:40.155 INFO:tasks.workunit.client.0.smithi033.stdout:8/31: write d1/d6/f7 [1156857,10238] 0 2024-02-15T22:40:40.159 INFO:tasks.workunit.client.0.smithi033.stdout:5/60: rename d6/cd to d6/c13 0 2024-02-15T22:40:40.159 INFO:tasks.workunit.client.0.smithi033.stdout:5/61: write d6/f10 [1464192,83213] 0 2024-02-15T22:40:40.161 INFO:tasks.workunit.client.0.smithi033.stdout:1/72: truncate d1/f11 1500882 0 2024-02-15T22:40:40.164 INFO:tasks.workunit.client.0.smithi033.stdout:8/32: rename d1/da/cc to d1/d6/cd 0 2024-02-15T22:40:40.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/33: dread d1/f8 [0,4194304] 0 2024-02-15T22:40:40.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/34: chown d1/d6 74 1 2024-02-15T22:40:40.193 INFO:tasks.workunit.client.0.smithi033.stdout:8/35: rmdir d1/da 0 2024-02-15T22:40:40.195 INFO:tasks.workunit.client.0.smithi033.stdout:8/36: dread d1/f8 [0,4194304] 0 2024-02-15T22:40:40.197 INFO:tasks.workunit.client.0.smithi033.stdout:1/73: dwrite d1/f5 [0,4194304] 0 2024-02-15T22:40:40.197 INFO:tasks.workunit.client.0.smithi033.stdout:5/62: dwrite d6/f10 [0,4194304] 0 2024-02-15T22:40:40.198 INFO:tasks.workunit.client.0.smithi033.stdout:8/37: unlink d1/d6/c9 0 2024-02-15T22:40:40.198 INFO:tasks.workunit.client.0.smithi033.stdout:8/38: write d1/d6/f7 [1720226,67211] 0 2024-02-15T22:40:40.202 INFO:tasks.workunit.client.0.smithi033.stdout:1/74: read d1/f11 [247268,111574] 0 2024-02-15T22:40:40.202 INFO:tasks.workunit.client.0.smithi033.stdout:1/75: write d1/f8 [1256299,95688] 0 2024-02-15T22:40:40.203 INFO:tasks.workunit.client.0.smithi033.stdout:1/76: fdatasync d1/de/f14 0 2024-02-15T22:40:40.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/63: mkdir d6/d14 0 2024-02-15T22:40:40.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/64: readlink d6/lc 0 2024-02-15T22:40:40.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/65: dread - d6/fe zero size 2024-02-15T22:40:40.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/66: readlink d6/la 0 2024-02-15T22:40:40.273 INFO:tasks.workunit.client.0.smithi033.stdout:8/39: mkdir d1/de 0 2024-02-15T22:40:40.277 INFO:tasks.workunit.client.0.smithi033.stdout:1/77: creat d1/f17 x:0 0 0 2024-02-15T22:40:40.277 INFO:tasks.workunit.client.0.smithi033.stdout:1/78: fsync d1/de/f16 0 2024-02-15T22:40:40.283 INFO:tasks.workunit.client.0.smithi033.stdout:5/67: symlink d6/d14/l15 0 2024-02-15T22:40:40.285 INFO:tasks.workunit.client.0.smithi033.stdout:8/40: mkdir d1/df 0 2024-02-15T22:40:40.289 INFO:tasks.workunit.client.0.smithi033.stdout:5/68: creat d6/f16 x:0 0 0 2024-02-15T22:40:40.290 INFO:tasks.workunit.client.0.smithi033.stdout:8/41: creat d1/f10 x:0 0 0 2024-02-15T22:40:40.292 INFO:tasks.workunit.client.0.smithi033.stdout:1/79: getdents d1 0 2024-02-15T22:40:40.294 INFO:tasks.workunit.client.0.smithi033.stdout:5/69: mknod d6/d14/c17 0 2024-02-15T22:40:40.294 INFO:tasks.workunit.client.0.smithi033.stdout:5/70: stat f4 0 2024-02-15T22:40:40.296 INFO:tasks.workunit.client.0.smithi033.stdout:8/42: mknod d1/c11 0 2024-02-15T22:40:40.297 INFO:tasks.workunit.client.0.smithi033.stdout:5/71: truncate d6/f7 3205530 0 2024-02-15T22:40:40.298 INFO:tasks.workunit.client.0.smithi033.stdout:8/43: creat d1/de/f12 x:0 0 0 2024-02-15T22:40:40.298 INFO:tasks.workunit.client.0.smithi033.stdout:8/44: fsync d1/d6/f7 0 2024-02-15T22:40:40.299 INFO:tasks.workunit.client.0.smithi033.stdout:5/72: symlink d6/l18 0 2024-02-15T22:40:40.303 INFO:tasks.workunit.client.0.smithi033.stdout:8/45: mkdir d1/de/d13 0 2024-02-15T22:40:40.305 INFO:tasks.workunit.client.0.smithi033.stdout:8/46: write d1/d6/f7 [1052366,9399] 0 2024-02-15T22:40:40.309 INFO:tasks.workunit.client.0.smithi033.stdout:5/73: read d6/f10 [2715685,8140] 0 2024-02-15T22:40:40.313 INFO:tasks.workunit.client.0.smithi033.stdout:1/80: dwrite d1/f8 [0,4194304] 0 2024-02-15T22:40:40.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/81: dwrite d1/de/f13 [0,4194304] 0 2024-02-15T22:40:40.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/82: write d1/f15 [487737,17939] 0 2024-02-15T22:40:40.330 INFO:tasks.workunit.client.0.smithi033.stdout:5/74: dwrite d6/ff [0,4194304] 0 2024-02-15T22:40:40.349 INFO:tasks.workunit.client.0.smithi033.stdout:1/83: dwrite d1/de/f14 [0,4194304] 0 2024-02-15T22:40:40.349 INFO:tasks.workunit.client.0.smithi033.stdout:1/84: write d1/f15 [1415914,127326] 0 2024-02-15T22:40:40.349 INFO:tasks.workunit.client.0.smithi033.stdout:1/85: getdents d1 0 2024-02-15T22:40:40.399 INFO:tasks.workunit.client.0.smithi033.stdout:5/75: creat d6/d14/f19 x:0 0 0 2024-02-15T22:40:40.402 INFO:tasks.workunit.client.0.smithi033.stdout:5/76: dread d6/fb [0,4194304] 0 2024-02-15T22:40:40.405 INFO:tasks.workunit.client.0.smithi033.stdout:1/86: mknod d1/de/c18 0 2024-02-15T22:40:40.405 INFO:tasks.workunit.client.0.smithi033.stdout:1/87: write d1/f15 [2561132,118831] 0 2024-02-15T22:40:40.412 INFO:tasks.workunit.client.0.smithi033.stdout:1/88: creat d1/f19 x:0 0 0 2024-02-15T22:40:40.413 INFO:tasks.workunit.client.0.smithi033.stdout:1/89: write d1/f5 [4259418,76245] 0 2024-02-15T22:40:40.414 INFO:tasks.workunit.client.0.smithi033.stdout:1/90: dread d1/f11 [0,4194304] 0 2024-02-15T22:40:40.416 INFO:tasks.workunit.client.0.smithi033.stdout:5/77: rmdir d6 39 2024-02-15T22:40:40.417 INFO:tasks.workunit.client.0.smithi033.stdout:1/91: mknod d1/de/c1a 0 2024-02-15T22:40:40.417 INFO:tasks.workunit.client.0.smithi033.stdout:1/92: stat d1/de/c1a 0 2024-02-15T22:40:40.419 INFO:tasks.workunit.client.0.smithi033.stdout:5/78: mknod d6/c1a 0 2024-02-15T22:40:40.421 INFO:tasks.workunit.client.0.smithi033.stdout:5/79: creat d6/f1b x:0 0 0 2024-02-15T22:40:40.421 INFO:tasks.workunit.client.0.smithi033.stdout:5/80: fdatasync d6/f1b 0 2024-02-15T22:40:40.422 INFO:tasks.workunit.client.0.smithi033.stdout:5/81: creat d6/d14/f1c x:0 0 0 2024-02-15T22:40:40.422 INFO:tasks.workunit.client.0.smithi033.stdout:5/82: stat c5 0 2024-02-15T22:40:40.426 INFO:tasks.workunit.client.0.smithi033.stdout:5/83: unlink d6/c1a 0 2024-02-15T22:40:40.427 INFO:tasks.workunit.client.0.smithi033.stdout:1/93: write d1/f7 [169556,37700] 0 2024-02-15T22:40:40.429 INFO:tasks.workunit.client.0.smithi033.stdout:1/94: creat d1/de/f1b x:0 0 0 2024-02-15T22:40:40.432 INFO:tasks.workunit.client.0.smithi033.stdout:1/95: rename d1/f5 to d1/f1c 0 2024-02-15T22:40:40.432 INFO:tasks.workunit.client.0.smithi033.stdout:1/96: readlink d1/ld 0 2024-02-15T22:40:40.438 INFO:tasks.workunit.client.0.smithi033.stdout:5/84: dread d6/ff [0,4194304] 0 2024-02-15T22:40:40.438 INFO:tasks.workunit.client.0.smithi033.stdout:5/85: write d6/f1b [706895,35183] 0 2024-02-15T22:40:40.438 INFO:tasks.workunit.client.0.smithi033.stdout:5/86: stat d6/f16 0 2024-02-15T22:40:40.438 INFO:tasks.workunit.client.0.smithi033.stdout:5/87: chown f4 123106 1 2024-02-15T22:40:40.438 INFO:tasks.workunit.client.0.smithi033.stdout:5/88: creat d6/d14/f1d x:0 0 0 2024-02-15T22:40:40.439 INFO:tasks.workunit.client.0.smithi033.stdout:5/89: read - d6/fe zero size 2024-02-15T22:40:40.439 INFO:tasks.workunit.client.0.smithi033.stdout:5/90: readlink d6/d14/l15 0 2024-02-15T22:40:40.454 INFO:tasks.workunit.client.0.smithi033.stdout:1/97: dwrite d1/f8 [0,4194304] 0 2024-02-15T22:40:40.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/91: fsync d6/d14/f1c 0 2024-02-15T22:40:40.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/92: creat d6/f1e x:0 0 0 2024-02-15T22:40:40.461 INFO:tasks.workunit.client.0.smithi033.stdout:5/93: link d6/c12 d6/d14/c1f 0 2024-02-15T22:40:40.469 INFO:tasks.workunit.client.0.smithi033.stdout:1/98: dread d1/de/f14 [0,4194304] 0 2024-02-15T22:40:40.481 INFO:tasks.workunit.client.0.smithi033.stdout:5/94: dwrite d6/ff [0,4194304] 0 2024-02-15T22:40:40.493 INFO:tasks.workunit.client.0.smithi033.stdout:5/95: truncate d6/f1b 308046 0 2024-02-15T22:40:40.493 INFO:tasks.workunit.client.0.smithi033.stdout:5/96: readlink d6/la 0 2024-02-15T22:40:40.493 INFO:tasks.workunit.client.0.smithi033.stdout:5/97: write d6/d14/f1d [471683,60702] 0 2024-02-15T22:40:40.493 INFO:tasks.workunit.client.0.smithi033.stdout:5/98: creat d6/d14/f20 x:0 0 0 2024-02-15T22:40:40.497 INFO:tasks.workunit.client.0.smithi033.stdout:5/99: mknod d6/c21 0 2024-02-15T22:40:40.497 INFO:tasks.workunit.client.0.smithi033.stdout:5/100: chown d6/c8 1459643 1 2024-02-15T22:40:40.501 INFO:tasks.workunit.client.0.smithi033.stdout:4/8: sync 2024-02-15T22:40:40.501 INFO:tasks.workunit.client.0.smithi033.stdout:4/9: stat l0 0 2024-02-15T22:40:40.501 INFO:tasks.workunit.client.0.smithi033.stdout:4/10: chown l0 1 1 2024-02-15T22:40:40.505 INFO:tasks.workunit.client.0.smithi033.stdout:4/11: link l0 l1 0 2024-02-15T22:40:40.505 INFO:tasks.workunit.client.0.smithi033.stdout:4/12: fsync - no filename 2024-02-15T22:40:40.506 INFO:tasks.workunit.client.0.smithi033.stdout:4/13: creat f2 x:0 0 0 2024-02-15T22:40:40.512 INFO:tasks.workunit.client.0.smithi033.stdout:5/101: dwrite d6/f16 [0,4194304] 0 2024-02-15T22:40:40.512 INFO:tasks.workunit.client.0.smithi033.stdout:5/102: creat d6/d14/f22 x:0 0 0 2024-02-15T22:40:40.523 INFO:tasks.workunit.client.0.smithi033.stdout:5/103: symlink d6/l23 0 2024-02-15T22:40:40.523 INFO:tasks.workunit.client.0.smithi033.stdout:4/14: dwrite f2 [0,4194304] 0 2024-02-15T22:40:40.524 INFO:tasks.workunit.client.0.smithi033.stdout:5/104: unlink d6/f7 0 2024-02-15T22:40:40.530 INFO:tasks.workunit.client.0.smithi033.stdout:4/15: mknod c3 0 2024-02-15T22:40:40.532 INFO:tasks.workunit.client.0.smithi033.stdout:5/105: mknod d6/d14/c24 0 2024-02-15T22:40:40.535 INFO:tasks.workunit.client.0.smithi033.stdout:5/106: mkdir d6/d25 0 2024-02-15T22:40:40.539 INFO:tasks.workunit.client.0.smithi033.stdout:4/16: write f2 [3722152,11778] 0 2024-02-15T22:40:40.539 INFO:tasks.workunit.client.0.smithi033.stdout:4/17: creat f4 x:0 0 0 2024-02-15T22:40:40.540 INFO:tasks.workunit.client.0.smithi033.stdout:5/107: dread d6/fb [0,4194304] 0 2024-02-15T22:40:40.540 INFO:tasks.workunit.client.0.smithi033.stdout:5/108: truncate d6/d14/f20 259829 0 2024-02-15T22:40:40.545 INFO:tasks.workunit.client.0.smithi033.stdout:5/109: mknod d6/c26 0 2024-02-15T22:40:40.545 INFO:tasks.workunit.client.0.smithi033.stdout:5/110: chown d6/c8 7 1 2024-02-15T22:40:40.547 INFO:tasks.workunit.client.0.smithi033.stdout:5/111: mknod d6/c27 0 2024-02-15T22:40:40.550 INFO:tasks.workunit.client.0.smithi033.stdout:5/112: mkdir d6/d14/d28 0 2024-02-15T22:40:40.560 INFO:tasks.workunit.client.0.smithi033.stdout:4/18: dwrite f2 [0,4194304] 0 2024-02-15T22:40:40.560 INFO:tasks.workunit.client.0.smithi033.stdout:4/19: dread - f4 zero size 2024-02-15T22:40:40.560 INFO:tasks.workunit.client.0.smithi033.stdout:4/20: creat f5 x:0 0 0 2024-02-15T22:40:40.577 INFO:tasks.workunit.client.0.smithi033.stdout:5/113: dwrite d6/fb [0,4194304] 0 2024-02-15T22:40:40.579 INFO:tasks.workunit.client.0.smithi033.stdout:5/114: creat d6/d25/f29 x:0 0 0 2024-02-15T22:40:40.579 INFO:tasks.workunit.client.0.smithi033.stdout:5/115: truncate d6/d14/f19 1045881 0 2024-02-15T22:40:40.579 INFO:tasks.workunit.client.0.smithi033.stdout:5/116: truncate d6/f1e 700317 0 2024-02-15T22:40:40.585 INFO:tasks.workunit.client.0.smithi033.stdout:4/21: dwrite f5 [0,4194304] 0 2024-02-15T22:40:40.585 INFO:tasks.workunit.client.0.smithi033.stdout:4/22: write f4 [545609,113807] 0 2024-02-15T22:40:40.594 INFO:tasks.workunit.client.0.smithi033.stdout:5/117: dread d6/f10 [0,4194304] 0 2024-02-15T22:40:40.614 INFO:tasks.workunit.client.0.smithi033.stdout:5/118: dwrite d6/fe [0,4194304] 0 2024-02-15T22:40:40.614 INFO:tasks.workunit.client.0.smithi033.stdout:4/23: dwrite f5 [0,4194304] 0 2024-02-15T22:40:40.623 INFO:tasks.workunit.client.0.smithi033.stdout:4/24: write f2 [2341127,55118] 0 2024-02-15T22:40:40.624 INFO:tasks.workunit.client.0.smithi033.stdout:4/25: chown f2 142246 1 2024-02-15T22:40:40.624 INFO:tasks.workunit.client.0.smithi033.stdout:4/26: write f4 [1240868,50303] 0 2024-02-15T22:40:40.635 INFO:tasks.workunit.client.0.smithi033.stdout:5/119: mknod d6/d25/c2a 0 2024-02-15T22:40:40.635 INFO:tasks.workunit.client.0.smithi033.stdout:5/120: chown d6/f10 15486784 1 2024-02-15T22:40:40.637 INFO:tasks.workunit.client.0.smithi033.stdout:4/27: rename f2 to f6 0 2024-02-15T22:40:40.638 INFO:tasks.workunit.client.0.smithi033.stdout:4/28: write f4 [318696,43108] 0 2024-02-15T22:40:40.638 INFO:tasks.workunit.client.0.smithi033.stdout:4/29: creat f7 x:0 0 0 2024-02-15T22:40:40.639 INFO:tasks.workunit.client.0.smithi033.stdout:5/121: mknod d6/d25/c2b 0 2024-02-15T22:40:40.644 INFO:tasks.workunit.client.0.smithi033.stdout:5/122: dread d6/ff [0,4194304] 0 2024-02-15T22:40:40.645 INFO:tasks.workunit.client.0.smithi033.stdout:5/123: dread d6/f1b [0,4194304] 0 2024-02-15T22:40:40.647 INFO:tasks.workunit.client.0.smithi033.stdout:5/124: rename d6/d25/c2b to d6/d14/c2c 0 2024-02-15T22:40:40.651 INFO:tasks.workunit.client.0.smithi033.stdout:5/125: rename d6/d14/c1f to d6/d25/c2d 0 2024-02-15T22:40:40.651 INFO:tasks.workunit.client.0.smithi033.stdout:5/126: read - d6/d25/f29 zero size 2024-02-15T22:40:40.651 INFO:tasks.workunit.client.0.smithi033.stdout:5/127: chown d6/fb 7382965 1 2024-02-15T22:40:40.656 INFO:tasks.workunit.client.0.smithi033.stdout:5/128: write d6/f10 [210312,77213] 0 2024-02-15T22:40:40.660 INFO:tasks.workunit.client.0.smithi033.stdout:4/30: truncate f5 1256012 0 2024-02-15T22:40:40.660 INFO:tasks.workunit.client.0.smithi033.stdout:4/31: stat f4 0 2024-02-15T22:40:40.660 INFO:tasks.workunit.client.0.smithi033.stdout:4/32: dread - f7 zero size 2024-02-15T22:40:40.669 INFO:tasks.workunit.client.0.smithi033.stdout:4/33: getdents . 0 2024-02-15T22:40:40.674 INFO:tasks.workunit.client.0.smithi033.stdout:4/34: mkdir d8 0 2024-02-15T22:40:40.675 INFO:tasks.workunit.client.0.smithi033.stdout:5/129: dwrite d6/fe [4194304,4194304] 0 2024-02-15T22:40:40.675 INFO:tasks.workunit.client.0.smithi033.stdout:5/130: dread - d6/d25/f29 zero size 2024-02-15T22:40:40.675 INFO:tasks.workunit.client.0.smithi033.stdout:5/131: read - d6/d14/f1c zero size 2024-02-15T22:40:40.675 INFO:tasks.workunit.client.0.smithi033.stdout:5/132: truncate d6/d14/f1d 1130773 0 2024-02-15T22:40:40.676 INFO:tasks.workunit.client.0.smithi033.stdout:5/133: write d6/d14/f19 [223759,79069] 0 2024-02-15T22:40:40.676 INFO:tasks.workunit.client.0.smithi033.stdout:5/134: chown d6/d14/f19 78738366 1 2024-02-15T22:40:40.676 INFO:tasks.workunit.client.0.smithi033.stdout:5/135: creat d6/d14/f2e x:0 0 0 2024-02-15T22:40:40.676 INFO:tasks.workunit.client.0.smithi033.stdout:5/136: fdatasync d6/d25/f29 0 2024-02-15T22:40:40.677 INFO:tasks.workunit.client.0.smithi033.stdout:5/137: stat d6/d25 0 2024-02-15T22:40:40.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/138: symlink d6/d25/l2f 0 2024-02-15T22:40:40.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/139: chown c5 245170805 1 2024-02-15T22:40:40.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/140: chown d6/d14/c17 21174619 1 2024-02-15T22:40:40.686 INFO:tasks.workunit.client.0.smithi033.stdout:5/141: link d6/ff d6/d14/f30 0 2024-02-15T22:40:40.686 INFO:tasks.workunit.client.0.smithi033.stdout:5/142: chown d6/l11 99635516 1 2024-02-15T22:40:40.689 INFO:tasks.workunit.client.0.smithi033.stdout:5/143: mkdir d6/d14/d31 0 2024-02-15T22:40:40.694 INFO:tasks.workunit.client.0.smithi033.stdout:5/144: dread f4 [0,4194304] 0 2024-02-15T22:40:40.697 INFO:tasks.workunit.client.0.smithi033.stdout:5/145: unlink f4 0 2024-02-15T22:40:40.700 INFO:tasks.workunit.client.0.smithi033.stdout:4/35: truncate f5 634732 0 2024-02-15T22:40:40.700 INFO:tasks.workunit.client.0.smithi033.stdout:4/36: dread - f7 zero size 2024-02-15T22:40:40.701 INFO:tasks.workunit.client.0.smithi033.stdout:4/37: mknod d8/c9 0 2024-02-15T22:40:40.702 INFO:tasks.workunit.client.0.smithi033.stdout:4/38: mknod d8/ca 0 2024-02-15T22:40:40.704 INFO:tasks.workunit.client.0.smithi033.stdout:4/39: rmdir d8 39 2024-02-15T22:40:40.705 INFO:tasks.workunit.client.0.smithi033.stdout:4/40: write f6 [4281751,65122] 0 2024-02-15T22:40:40.715 INFO:tasks.workunit.client.0.smithi033.stdout:5/146: dwrite d6/d14/f2e [0,4194304] 0 2024-02-15T22:40:40.715 INFO:tasks.workunit.client.0.smithi033.stdout:5/147: fdatasync d6/f1b 0 2024-02-15T22:40:40.717 INFO:tasks.workunit.client.0.smithi033.stdout:6/86: sync 2024-02-15T22:40:40.717 INFO:tasks.workunit.client.0.smithi033.stdout:9/11: sync 2024-02-15T22:40:40.721 INFO:tasks.workunit.client.0.smithi033.stdout:6/87: readlink lb 0 2024-02-15T22:40:40.723 INFO:tasks.workunit.client.0.smithi033.stdout:9/12: creat d4/f5 x:0 0 0 2024-02-15T22:40:40.724 INFO:tasks.workunit.client.0.smithi033.stdout:9/13: fsync f1 0 2024-02-15T22:40:40.724 INFO:tasks.workunit.client.0.smithi033.stdout:9/14: write f2 [753945,128747] 0 2024-02-15T22:40:40.724 INFO:tasks.workunit.client.0.smithi033.stdout:9/15: truncate f1 881158 0 2024-02-15T22:40:40.729 INFO:tasks.workunit.client.0.smithi033.stdout:6/88: dread ff [0,4194304] 0 2024-02-15T22:40:40.729 INFO:tasks.workunit.client.0.smithi033.stdout:5/148: dwrite d6/d14/f22 [0,4194304] 0 2024-02-15T22:40:40.731 INFO:tasks.workunit.client.0.smithi033.stdout:6/89: link c8 d12/c1c 0 2024-02-15T22:40:40.736 INFO:tasks.workunit.client.0.smithi033.stdout:6/90: dread fa [0,4194304] 0 2024-02-15T22:40:40.745 INFO:tasks.workunit.client.0.smithi033.stdout:6/91: rename d12/d14/d19/d1a to d12/d14/d1d 0 2024-02-15T22:40:40.755 INFO:tasks.workunit.client.0.smithi033.stdout:5/149: dwrite d6/f1e [0,4194304] 0 2024-02-15T22:40:40.763 INFO:tasks.workunit.client.0.smithi033.stdout:6/92: dwrite f5 [0,4194304] 0 2024-02-15T22:40:40.763 INFO:tasks.workunit.client.0.smithi033.stdout:9/16: dwrite f3 [0,4194304] 0 2024-02-15T22:40:40.763 INFO:tasks.workunit.client.0.smithi033.stdout:6/93: getdents d12/d1b 0 2024-02-15T22:40:40.768 INFO:tasks.workunit.client.0.smithi033.stdout:5/150: dread d6/d14/f2e [0,4194304] 0 2024-02-15T22:40:40.768 INFO:tasks.workunit.client.0.smithi033.stdout:5/151: truncate d6/f1b 946325 0 2024-02-15T22:40:40.768 INFO:tasks.workunit.client.0.smithi033.stdout:5/152: fdatasync d6/d14/f22 0 2024-02-15T22:40:40.768 INFO:tasks.workunit.client.0.smithi033.stdout:5/153: creat d6/d14/f32 x:0 0 0 2024-02-15T22:40:40.768 INFO:tasks.workunit.client.0.smithi033.stdout:5/154: write d6/d14/f19 [1334489,45673] 0 2024-02-15T22:40:40.769 INFO:tasks.workunit.client.0.smithi033.stdout:5/155: dread d6/f1b [0,4194304] 0 2024-02-15T22:40:40.773 INFO:tasks.workunit.client.0.smithi033.stdout:9/17: read f0 [2685885,22562] 0 2024-02-15T22:40:40.777 INFO:tasks.workunit.client.0.smithi033.stdout:6/94: stat l1 0 2024-02-15T22:40:40.784 INFO:tasks.workunit.client.0.smithi033.stdout:6/95: dread f6 [0,4194304] 0 2024-02-15T22:40:40.784 INFO:tasks.workunit.client.0.smithi033.stdout:6/96: truncate f6 1588022 0 2024-02-15T22:40:40.786 INFO:tasks.workunit.client.0.smithi033.stdout:9/18: dread f3 [0,4194304] 0 2024-02-15T22:40:40.787 INFO:tasks.workunit.client.0.smithi033.stdout:6/97: mknod d12/c1e 0 2024-02-15T22:40:40.796 INFO:tasks.workunit.client.0.smithi033.stdout:5/156: dwrite d6/f1e [4194304,4194304] 0 2024-02-15T22:40:40.796 INFO:tasks.workunit.client.0.smithi033.stdout:5/157: creat d6/f33 x:0 0 0 2024-02-15T22:40:40.802 INFO:tasks.workunit.client.0.smithi033.stdout:3/25: sync 2024-02-15T22:40:40.802 INFO:tasks.workunit.client.0.smithi033.stdout:2/98: sync 2024-02-15T22:40:40.802 INFO:tasks.workunit.client.0.smithi033.stdout:7/58: sync 2024-02-15T22:40:40.802 INFO:tasks.workunit.client.0.smithi033.stdout:3/26: truncate d0/f7 141458 0 2024-02-15T22:40:40.803 INFO:tasks.workunit.client.0.smithi033.stdout:0/39: sync 2024-02-15T22:40:40.803 INFO:tasks.workunit.client.0.smithi033.stdout:0/40: stat f4 0 2024-02-15T22:40:40.803 INFO:tasks.workunit.client.0.smithi033.stdout:0/41: fsync f4 0 2024-02-15T22:40:40.803 INFO:tasks.workunit.client.0.smithi033.stdout:3/27: creat d0/fe x:0 0 0 2024-02-15T22:40:40.804 INFO:tasks.workunit.client.0.smithi033.stdout:3/28: stat d0/lc 0 2024-02-15T22:40:40.805 INFO:tasks.workunit.client.0.smithi033.stdout:7/59: symlink d5/d6/l13 0 2024-02-15T22:40:40.806 INFO:tasks.workunit.client.0.smithi033.stdout:0/42: rename f1 to f6 0 2024-02-15T22:40:40.807 INFO:tasks.workunit.client.0.smithi033.stdout:2/99: dread d1/d8/fe [0,4194304] 0 2024-02-15T22:40:40.808 INFO:tasks.workunit.client.0.smithi033.stdout:7/60: dread f4 [0,4194304] 0 2024-02-15T22:40:40.808 INFO:tasks.workunit.client.0.smithi033.stdout:7/61: dread - d5/dc/fd zero size 2024-02-15T22:40:40.808 INFO:tasks.workunit.client.0.smithi033.stdout:3/29: unlink d0/d8/fb 0 2024-02-15T22:40:40.811 INFO:tasks.workunit.client.0.smithi033.stdout:0/43: symlink l7 0 2024-02-15T22:40:40.811 INFO:tasks.workunit.client.0.smithi033.stdout:5/158: write d6/d14/f22 [334467,12914] 0 2024-02-15T22:40:40.811 INFO:tasks.workunit.client.0.smithi033.stdout:5/159: dread - d6/f33 zero size 2024-02-15T22:40:40.811 INFO:tasks.workunit.client.0.smithi033.stdout:7/62: dread d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/98: dwrite d12/f18 [0,4194304] 0 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/99: chown l11 26256680 1 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:7/63: truncate d5/dc/fd 94333 0 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/100: creat d12/d14/f1f x:0 0 0 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/101: write f6 [239042,104088] 0 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/102: creat d12/d14/f20 x:0 0 0 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/103: truncate d12/d14/f16 852861 0 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/104: chown d12/l15 3094509 1 2024-02-15T22:40:40.812 INFO:tasks.workunit.client.0.smithi033.stdout:9/19: dwrite f3 [0,4194304] 0 2024-02-15T22:40:40.813 INFO:tasks.workunit.client.0.smithi033.stdout:6/105: read f6 [617587,42274] 0 2024-02-15T22:40:40.818 INFO:tasks.workunit.client.0.smithi033.stdout:5/160: dread d6/ff [0,4194304] 0 2024-02-15T22:40:40.818 INFO:tasks.workunit.client.0.smithi033.stdout:3/30: rename d0/c1 to d0/d3/dd/cf 0 2024-02-15T22:40:40.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/44: symlink l8 0 2024-02-15T22:40:40.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/45: fdatasync f0 0 2024-02-15T22:40:40.832 INFO:tasks.workunit.client.0.smithi033.stdout:7/64: link d5/dc/l11 d5/dc/l14 0 2024-02-15T22:40:40.833 INFO:tasks.workunit.client.0.smithi033.stdout:9/20: dwrite f2 [0,4194304] 0 2024-02-15T22:40:40.833 INFO:tasks.workunit.client.0.smithi033.stdout:2/100: dwrite d1/f2 [0,4194304] 0 2024-02-15T22:40:40.834 INFO:tasks.workunit.client.0.smithi033.stdout:2/101: write d1/d1d/d13/f17 [335821,59246] 0 2024-02-15T22:40:40.834 INFO:tasks.workunit.client.0.smithi033.stdout:2/102: creat d1/d16/f22 x:0 0 0 2024-02-15T22:40:40.834 INFO:tasks.workunit.client.0.smithi033.stdout:2/103: dread - d1/d8/f19 zero size 2024-02-15T22:40:40.834 INFO:tasks.workunit.client.0.smithi033.stdout:2/104: write d1/d16/f22 [88062,41832] 0 2024-02-15T22:40:40.840 INFO:tasks.workunit.client.0.smithi033.stdout:0/46: dwrite f6 [0,4194304] 0 2024-02-15T22:40:40.841 INFO:tasks.workunit.client.0.smithi033.stdout:5/161: symlink d6/d25/l34 0 2024-02-15T22:40:40.841 INFO:tasks.workunit.client.0.smithi033.stdout:5/162: read d6/d14/f22 [1309291,121766] 0 2024-02-15T22:40:40.844 INFO:tasks.workunit.client.0.smithi033.stdout:3/31: unlink d0/d3/dd/cf 0 2024-02-15T22:40:40.846 INFO:tasks.workunit.client.0.smithi033.stdout:7/65: creat d5/f15 x:0 0 0 2024-02-15T22:40:40.848 INFO:tasks.workunit.client.0.smithi033.stdout:7/66: write f4 [1013282,38989] 0 2024-02-15T22:40:40.852 INFO:tasks.workunit.client.0.smithi033.stdout:9/21: unlink f0 0 2024-02-15T22:40:40.855 INFO:tasks.workunit.client.0.smithi033.stdout:2/105: symlink d1/l23 0 2024-02-15T22:40:40.860 INFO:tasks.workunit.client.0.smithi033.stdout:9/22: dread f3 [0,4194304] 0 2024-02-15T22:40:40.861 INFO:tasks.workunit.client.0.smithi033.stdout:0/47: symlink l9 0 2024-02-15T22:40:40.861 INFO:tasks.workunit.client.0.smithi033.stdout:9/23: readlink - no filename 2024-02-15T22:40:40.861 INFO:tasks.workunit.client.0.smithi033.stdout:9/24: fdatasync f3 0 2024-02-15T22:40:40.861 INFO:tasks.workunit.client.0.smithi033.stdout:0/48: creat fa x:0 0 0 2024-02-15T22:40:40.861 INFO:tasks.workunit.client.0.smithi033.stdout:0/49: readlink l9 0 2024-02-15T22:40:40.861 INFO:tasks.workunit.client.0.smithi033.stdout:9/25: dread f1 [0,4194304] 0 2024-02-15T22:40:40.863 INFO:tasks.workunit.client.0.smithi033.stdout:5/163: rmdir d6/d14/d28 0 2024-02-15T22:40:40.863 INFO:tasks.workunit.client.0.smithi033.stdout:5/164: creat d6/d25/f35 x:0 0 0 2024-02-15T22:40:40.864 INFO:tasks.workunit.client.0.smithi033.stdout:5/165: truncate d6/d25/f35 396282 0 2024-02-15T22:40:40.864 INFO:tasks.workunit.client.0.smithi033.stdout:5/166: chown d6/c26 6008096 1 2024-02-15T22:40:40.869 INFO:tasks.workunit.client.0.smithi033.stdout:3/32: symlink d0/d3/l10 0 2024-02-15T22:40:40.872 INFO:tasks.workunit.client.0.smithi033.stdout:7/67: mkdir d5/d6/d10/d16 0 2024-02-15T22:40:40.872 INFO:tasks.workunit.client.0.smithi033.stdout:6/106: truncate f6 794322 0 2024-02-15T22:40:40.879 INFO:tasks.workunit.client.0.smithi033.stdout:5/167: dwrite d6/f1b [0,4194304] 0 2024-02-15T22:40:40.884 INFO:tasks.workunit.client.0.smithi033.stdout:6/107: dread d12/f13 [0,4194304] 0 2024-02-15T22:40:40.890 INFO:tasks.workunit.client.0.smithi033.stdout:7/68: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:40.890 INFO:tasks.workunit.client.0.smithi033.stdout:7/69: write d5/f15 [1041984,76216] 0 2024-02-15T22:40:40.890 INFO:tasks.workunit.client.0.smithi033.stdout:2/106: mkdir d1/d1d/d24 0 2024-02-15T22:40:40.894 INFO:tasks.workunit.client.0.smithi033.stdout:0/50: mkdir db 0 2024-02-15T22:40:40.894 INFO:tasks.workunit.client.0.smithi033.stdout:0/51: fdatasync f4 0 2024-02-15T22:40:40.896 INFO:tasks.workunit.client.0.smithi033.stdout:9/26: mknod d4/c6 0 2024-02-15T22:40:40.903 INFO:tasks.workunit.client.0.smithi033.stdout:3/33: dread d0/f7 [0,4194304] 0 2024-02-15T22:40:40.903 INFO:tasks.workunit.client.0.smithi033.stdout:8/47: sync 2024-02-15T22:40:40.903 INFO:tasks.workunit.client.0.smithi033.stdout:1/99: sync 2024-02-15T22:40:40.905 INFO:tasks.workunit.client.0.smithi033.stdout:4/41: sync 2024-02-15T22:40:40.908 INFO:tasks.workunit.client.0.smithi033.stdout:5/168: creat d6/d14/d31/f36 x:0 0 0 2024-02-15T22:40:40.908 INFO:tasks.workunit.client.0.smithi033.stdout:5/169: readlink d6/la 0 2024-02-15T22:40:40.910 INFO:tasks.workunit.client.0.smithi033.stdout:1/100: dread d1/de/f14 [0,4194304] 0 2024-02-15T22:40:40.910 INFO:tasks.workunit.client.0.smithi033.stdout:1/101: dread - d1/f17 zero size 2024-02-15T22:40:40.910 INFO:tasks.workunit.client.0.smithi033.stdout:1/102: write d1/f1c [5163565,17975] 0 2024-02-15T22:40:40.910 INFO:tasks.workunit.client.0.smithi033.stdout:1/103: stat d1/de/c18 0 2024-02-15T22:40:40.910 INFO:tasks.workunit.client.0.smithi033.stdout:1/104: write d1/f6 [320644,94246] 0 2024-02-15T22:40:40.910 INFO:tasks.workunit.client.0.smithi033.stdout:1/105: truncate d1/f17 639926 0 2024-02-15T22:40:40.911 INFO:tasks.workunit.client.0.smithi033.stdout:6/108: creat d12/d14/d19/f21 x:0 0 0 2024-02-15T22:40:40.911 INFO:tasks.workunit.client.0.smithi033.stdout:6/109: getdents d12/d1b 0 2024-02-15T22:40:40.912 INFO:tasks.workunit.client.0.smithi033.stdout:3/34: dread d0/d3/f9 [0,4194304] 0 2024-02-15T22:40:40.914 INFO:tasks.workunit.client.0.smithi033.stdout:5/170: dread d6/d14/f22 [0,4194304] 0 2024-02-15T22:40:40.914 INFO:tasks.workunit.client.0.smithi033.stdout:5/171: creat d6/d14/d31/f37 x:0 0 0 2024-02-15T22:40:40.916 INFO:tasks.workunit.client.0.smithi033.stdout:7/70: symlink d5/d6/d10/d16/l17 0 2024-02-15T22:40:40.918 INFO:tasks.workunit.client.0.smithi033.stdout:2/107: mknod d1/d1d/d12/c25 0 2024-02-15T22:40:40.920 INFO:tasks.workunit.client.0.smithi033.stdout:1/106: write d1/f8 [2879169,87093] 0 2024-02-15T22:40:40.920 INFO:tasks.workunit.client.0.smithi033.stdout:1/107: readlink d1/ld 0 2024-02-15T22:40:40.921 INFO:tasks.workunit.client.0.smithi033.stdout:0/52: mkdir db/dc 0 2024-02-15T22:40:40.926 INFO:tasks.workunit.client.0.smithi033.stdout:4/42: mknod d8/cb 0 2024-02-15T22:40:40.927 INFO:tasks.workunit.client.0.smithi033.stdout:7/71: dread d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:40.932 INFO:tasks.workunit.client.0.smithi033.stdout:6/110: truncate d12/d14/f16 252972 0 2024-02-15T22:40:40.934 INFO:tasks.workunit.client.0.smithi033.stdout:3/35: truncate d0/d3/f9 1309486 0 2024-02-15T22:40:40.939 INFO:tasks.workunit.client.0.smithi033.stdout:5/172: mkdir d6/d14/d31/d38 0 2024-02-15T22:40:40.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/108: rename d1/c4 to d1/c26 0 2024-02-15T22:40:40.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/109: dread - d1/d1d/d12/f15 zero size 2024-02-15T22:40:40.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/110: stat d1/d1d/d24 0 2024-02-15T22:40:40.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/111: readlink d1/l1f 0 2024-02-15T22:40:40.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/112: write d1/f7 [16978886,277] 0 2024-02-15T22:40:40.946 INFO:tasks.workunit.client.0.smithi033.stdout:1/108: unlink d1/c10 0 2024-02-15T22:40:40.947 INFO:tasks.workunit.client.0.smithi033.stdout:0/53: symlink db/ld 0 2024-02-15T22:40:40.949 INFO:tasks.workunit.client.0.smithi033.stdout:8/48: getdents d1 0 2024-02-15T22:40:40.952 INFO:tasks.workunit.client.0.smithi033.stdout:4/43: rename d8/cb to d8/cc 0 2024-02-15T22:40:40.955 INFO:tasks.workunit.client.0.smithi033.stdout:4/44: dread f5 [0,4194304] 0 2024-02-15T22:40:40.956 INFO:tasks.workunit.client.0.smithi033.stdout:7/72: rename d5/dc/fd to d5/f18 0 2024-02-15T22:40:40.956 INFO:tasks.workunit.client.0.smithi033.stdout:7/73: creat d5/f19 x:0 0 0 2024-02-15T22:40:40.956 INFO:tasks.workunit.client.0.smithi033.stdout:7/74: write d5/f19 [15979,36764] 0 2024-02-15T22:40:40.958 INFO:tasks.workunit.client.0.smithi033.stdout:6/111: creat d12/d14/d1d/f22 x:0 0 0 2024-02-15T22:40:40.958 INFO:tasks.workunit.client.0.smithi033.stdout:6/112: write d12/d14/f16 [1121998,131016] 0 2024-02-15T22:40:40.964 INFO:tasks.workunit.client.0.smithi033.stdout:7/75: read d5/d6/f7 [3761489,16930] 0 2024-02-15T22:40:40.964 INFO:tasks.workunit.client.0.smithi033.stdout:3/36: dwrite d0/d3/f9 [0,4194304] 0 2024-02-15T22:40:40.971 INFO:tasks.workunit.client.0.smithi033.stdout:2/113: creat d1/d1d/d12/f27 x:0 0 0 2024-02-15T22:40:40.971 INFO:tasks.workunit.client.0.smithi033.stdout:2/114: truncate d1/d1d/d12/f27 457922 0 2024-02-15T22:40:40.971 INFO:tasks.workunit.client.0.smithi033.stdout:2/115: fsync d1/d1d/d13/f17 0 2024-02-15T22:40:40.971 INFO:tasks.workunit.client.0.smithi033.stdout:2/116: dread - d1/d8/f19 zero size 2024-02-15T22:40:40.972 INFO:tasks.workunit.client.0.smithi033.stdout:0/54: dwrite f5 [0,4194304] 0 2024-02-15T22:40:40.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/109: mkdir d1/d1d 0 2024-02-15T22:40:40.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/110: chown d1/f15 1868163 1 2024-02-15T22:40:40.976 INFO:tasks.workunit.client.0.smithi033.stdout:8/49: mkdir d1/d6/d14 0 2024-02-15T22:40:40.977 INFO:tasks.workunit.client.0.smithi033.stdout:4/45: truncate f5 367273 0 2024-02-15T22:40:40.981 INFO:tasks.workunit.client.0.smithi033.stdout:5/173: rename d6/c13 to d6/d14/d31/c39 0 2024-02-15T22:40:40.987 INFO:tasks.workunit.client.0.smithi033.stdout:0/55: dwrite f0 [4194304,4194304] 0 2024-02-15T22:40:40.987 INFO:tasks.workunit.client.0.smithi033.stdout:7/76: symlink d5/dc/l1a 0 2024-02-15T22:40:40.989 INFO:tasks.workunit.client.0.smithi033.stdout:3/37: symlink d0/l11 0 2024-02-15T22:40:40.992 INFO:tasks.workunit.client.0.smithi033.stdout:2/117: mknod d1/d16/c28 0 2024-02-15T22:40:40.999 INFO:tasks.workunit.client.0.smithi033.stdout:1/111: mknod d1/de/c1e 0 2024-02-15T22:40:41.003 INFO:tasks.workunit.client.0.smithi033.stdout:8/50: link d1/c11 d1/d6/d14/c15 0 2024-02-15T22:40:41.003 INFO:tasks.workunit.client.0.smithi033.stdout:8/51: chown d1/f8 663 1 2024-02-15T22:40:41.005 INFO:tasks.workunit.client.0.smithi033.stdout:4/46: creat d8/fd x:0 0 0 2024-02-15T22:40:41.008 INFO:tasks.workunit.client.0.smithi033.stdout:6/113: rename lb to d12/l23 0 2024-02-15T22:40:41.008 INFO:tasks.workunit.client.0.smithi033.stdout:6/114: read ff [3233514,84050] 0 2024-02-15T22:40:41.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/115: dread - d12/d14/f20 zero size 2024-02-15T22:40:41.010 INFO:tasks.workunit.client.0.smithi033.stdout:5/174: mknod d6/c3a 0 2024-02-15T22:40:41.014 INFO:tasks.workunit.client.0.smithi033.stdout:0/56: rmdir db/dc 0 2024-02-15T22:40:41.017 INFO:tasks.workunit.client.0.smithi033.stdout:7/77: link d5/dc/l14 d5/d6/d10/d16/l1b 0 2024-02-15T22:40:41.019 INFO:tasks.workunit.client.0.smithi033.stdout:3/38: mknod d0/c12 0 2024-02-15T22:40:41.019 INFO:tasks.workunit.client.0.smithi033.stdout:1/112: dwrite d1/de/f16 [0,4194304] 0 2024-02-15T22:40:41.019 INFO:tasks.workunit.client.0.smithi033.stdout:1/113: creat d1/de/f1f x:0 0 0 2024-02-15T22:40:41.020 INFO:tasks.workunit.client.0.smithi033.stdout:2/118: mknod d1/d16/c29 0 2024-02-15T22:40:41.020 INFO:tasks.workunit.client.0.smithi033.stdout:2/119: read - d1/d1d/d12/f15 zero size 2024-02-15T22:40:41.021 INFO:tasks.workunit.client.0.smithi033.stdout:2/120: write d1/d16/f22 [470387,86439] 0 2024-02-15T22:40:41.030 INFO:tasks.workunit.client.0.smithi033.stdout:8/52: mkdir d1/d6/d16 0 2024-02-15T22:40:41.035 INFO:tasks.workunit.client.0.smithi033.stdout:6/116: symlink d12/d1b/l24 0 2024-02-15T22:40:41.036 INFO:tasks.workunit.client.0.smithi033.stdout:5/175: link d6/d14/f1c d6/d14/d31/f3b 0 2024-02-15T22:40:41.038 INFO:tasks.workunit.client.0.smithi033.stdout:0/57: creat db/fe x:0 0 0 2024-02-15T22:40:41.042 INFO:tasks.workunit.client.0.smithi033.stdout:1/114: mkdir d1/d20 0 2024-02-15T22:40:41.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/78: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:41.045 INFO:tasks.workunit.client.0.smithi033.stdout:8/53: mkdir d1/d6/d17 0 2024-02-15T22:40:41.045 INFO:tasks.workunit.client.0.smithi033.stdout:8/54: dread - d1/de/f12 zero size 2024-02-15T22:40:41.045 INFO:tasks.workunit.client.0.smithi033.stdout:8/55: fdatasync d1/f8 0 2024-02-15T22:40:41.046 INFO:tasks.workunit.client.0.smithi033.stdout:8/56: chown d1/de 1743021305 1 2024-02-15T22:40:41.046 INFO:tasks.workunit.client.0.smithi033.stdout:8/57: stat d1/f10 0 2024-02-15T22:40:41.046 INFO:tasks.workunit.client.0.smithi033.stdout:4/47: getdents d8 0 2024-02-15T22:40:41.046 INFO:tasks.workunit.client.0.smithi033.stdout:4/48: truncate d8/fd 23526 0 2024-02-15T22:40:41.048 INFO:tasks.workunit.client.0.smithi033.stdout:6/117: mknod d12/d14/d1d/c25 0 2024-02-15T22:40:41.050 INFO:tasks.workunit.client.0.smithi033.stdout:0/58: symlink db/lf 0 2024-02-15T22:40:41.050 INFO:tasks.workunit.client.0.smithi033.stdout:0/59: dread - fa zero size 2024-02-15T22:40:41.053 INFO:tasks.workunit.client.0.smithi033.stdout:3/39: dwrite d0/fe [0,4194304] 0 2024-02-15T22:40:41.053 INFO:tasks.workunit.client.0.smithi033.stdout:3/40: chown d0 200 1 2024-02-15T22:40:41.053 INFO:tasks.workunit.client.0.smithi033.stdout:3/41: creat d0/f13 x:0 0 0 2024-02-15T22:40:41.053 INFO:tasks.workunit.client.0.smithi033.stdout:3/42: truncate d0/d3/f9 5055624 0 2024-02-15T22:40:41.053 INFO:tasks.workunit.client.0.smithi033.stdout:7/79: link c3 d5/d6/d10/c1c 0 2024-02-15T22:40:41.053 INFO:tasks.workunit.client.0.smithi033.stdout:7/80: rename d5/d6 to d5/d6/d10/d16/d1d 22 2024-02-15T22:40:41.054 INFO:tasks.workunit.client.0.smithi033.stdout:8/58: mkdir d1/d6/d16/d18 0 2024-02-15T22:40:41.056 INFO:tasks.workunit.client.0.smithi033.stdout:6/118: rmdir d12/d1b 39 2024-02-15T22:40:41.056 INFO:tasks.workunit.client.0.smithi033.stdout:6/119: dread - d12/d14/f1f zero size 2024-02-15T22:40:41.060 INFO:tasks.workunit.client.0.smithi033.stdout:3/43: symlink d0/d3/l14 0 2024-02-15T22:40:41.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/121: dwrite d1/f2 [8388608,4194304] 0 2024-02-15T22:40:41.063 INFO:tasks.workunit.client.0.smithi033.stdout:5/176: dwrite d6/d14/d31/f3b [0,4194304] 0 2024-02-15T22:40:41.064 INFO:tasks.workunit.client.0.smithi033.stdout:1/115: dwrite d1/de/f13 [0,4194304] 0 2024-02-15T22:40:41.064 INFO:tasks.workunit.client.0.smithi033.stdout:1/116: write d1/de/f13 [5232196,25235] 0 2024-02-15T22:40:41.065 INFO:tasks.workunit.client.0.smithi033.stdout:6/120: link f6 d12/d14/d19/f26 0 2024-02-15T22:40:41.065 INFO:tasks.workunit.client.0.smithi033.stdout:6/121: readlink d12/l15 0 2024-02-15T22:40:41.065 INFO:tasks.workunit.client.0.smithi033.stdout:6/122: truncate d12/d14/d19/f26 1138073 0 2024-02-15T22:40:41.065 INFO:tasks.workunit.client.0.smithi033.stdout:6/123: chown d12/c1e 405052 1 2024-02-15T22:40:41.065 INFO:tasks.workunit.client.0.smithi033.stdout:4/49: dread f4 [0,4194304] 0 2024-02-15T22:40:41.065 INFO:tasks.workunit.client.0.smithi033.stdout:4/50: getdents d8 0 2024-02-15T22:40:41.067 INFO:tasks.workunit.client.0.smithi033.stdout:0/60: read f0 [8213224,76651] 0 2024-02-15T22:40:41.067 INFO:tasks.workunit.client.0.smithi033.stdout:0/61: fdatasync fa 0 2024-02-15T22:40:41.070 INFO:tasks.workunit.client.0.smithi033.stdout:3/44: symlink d0/d3/dd/l15 0 2024-02-15T22:40:41.070 INFO:tasks.workunit.client.0.smithi033.stdout:3/45: creat d0/f16 x:0 0 0 2024-02-15T22:40:41.073 INFO:tasks.workunit.client.0.smithi033.stdout:2/122: mkdir d1/d1d/d24/d2a 0 2024-02-15T22:40:41.080 INFO:tasks.workunit.client.0.smithi033.stdout:7/81: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:41.080 INFO:tasks.workunit.client.0.smithi033.stdout:7/82: read f4 [439888,44553] 0 2024-02-15T22:40:41.080 INFO:tasks.workunit.client.0.smithi033.stdout:7/83: fdatasync d5/f18 0 2024-02-15T22:40:41.081 INFO:tasks.workunit.client.0.smithi033.stdout:8/59: dwrite d1/f8 [0,4194304] 0 2024-02-15T22:40:41.081 INFO:tasks.workunit.client.0.smithi033.stdout:5/177: mkdir d6/d14/d31/d3c 0 2024-02-15T22:40:41.082 INFO:tasks.workunit.client.0.smithi033.stdout:6/124: getdents d12/d1b 0 2024-02-15T22:40:41.082 INFO:tasks.workunit.client.0.smithi033.stdout:6/125: chown l11 100 1 2024-02-15T22:40:41.082 INFO:tasks.workunit.client.0.smithi033.stdout:6/126: readlink l1 0 2024-02-15T22:40:41.082 INFO:tasks.workunit.client.0.smithi033.stdout:6/127: chown d12/l15 1680 1 2024-02-15T22:40:41.082 INFO:tasks.workunit.client.0.smithi033.stdout:4/51: stat l0 0 2024-02-15T22:40:41.091 INFO:tasks.workunit.client.0.smithi033.stdout:3/46: creat d0/d3/f17 x:0 0 0 2024-02-15T22:40:41.091 INFO:tasks.workunit.client.0.smithi033.stdout:3/47: chown d0/d8 53 1 2024-02-15T22:40:41.091 INFO:tasks.workunit.client.0.smithi033.stdout:3/48: dread - d0/f13 zero size 2024-02-15T22:40:41.099 INFO:tasks.workunit.client.0.smithi033.stdout:7/84: mknod d5/d6/d10/c1e 0 2024-02-15T22:40:41.103 INFO:tasks.workunit.client.0.smithi033.stdout:8/60: link d1/d6/d14/c15 d1/d6/d14/c19 0 2024-02-15T22:40:41.105 INFO:tasks.workunit.client.0.smithi033.stdout:5/178: rename d6/c8 to d6/d14/d31/d3c/c3d 0 2024-02-15T22:40:41.110 INFO:tasks.workunit.client.0.smithi033.stdout:4/52: unlink d8/cc 0 2024-02-15T22:40:41.110 INFO:tasks.workunit.client.0.smithi033.stdout:4/53: chown d8 0 1 2024-02-15T22:40:41.110 INFO:tasks.workunit.client.0.smithi033.stdout:4/54: readlink l0 0 2024-02-15T22:40:41.113 INFO:tasks.workunit.client.0.smithi033.stdout:0/62: truncate f0 8334289 0 2024-02-15T22:40:41.113 INFO:tasks.workunit.client.0.smithi033.stdout:3/49: fsync d0/f16 0 2024-02-15T22:40:41.116 INFO:tasks.workunit.client.0.smithi033.stdout:2/123: rmdir d1/d16 39 2024-02-15T22:40:41.116 INFO:tasks.workunit.client.0.smithi033.stdout:2/124: readlink l0 0 2024-02-15T22:40:41.121 INFO:tasks.workunit.client.0.smithi033.stdout:7/85: symlink d5/dc/l1f 0 2024-02-15T22:40:41.126 INFO:tasks.workunit.client.0.smithi033.stdout:6/128: rename d12/d14/d1d/c25 to d12/c27 0 2024-02-15T22:40:41.126 INFO:tasks.workunit.client.0.smithi033.stdout:6/129: creat d12/f28 x:0 0 0 2024-02-15T22:40:41.126 INFO:tasks.workunit.client.0.smithi033.stdout:6/130: chown d12 26759587 1 2024-02-15T22:40:41.126 INFO:tasks.workunit.client.0.smithi033.stdout:6/131: write ff [3292582,110997] 0 2024-02-15T22:40:41.126 INFO:tasks.workunit.client.0.smithi033.stdout:7/86: dread d5/d6/fa [0,4194304] 0 2024-02-15T22:40:41.128 INFO:tasks.workunit.client.0.smithi033.stdout:5/179: link d6/d14/f30 d6/d14/f3e 0 2024-02-15T22:40:41.128 INFO:tasks.workunit.client.0.smithi033.stdout:5/180: write d6/d14/f30 [4749169,115295] 0 2024-02-15T22:40:41.131 INFO:tasks.workunit.client.0.smithi033.stdout:4/55: dwrite f6 [4194304,4194304] 0 2024-02-15T22:40:41.132 INFO:tasks.workunit.client.0.smithi033.stdout:0/63: dwrite f4 [0,4194304] 0 2024-02-15T22:40:41.135 INFO:tasks.workunit.client.0.smithi033.stdout:6/132: dread f5 [0,4194304] 0 2024-02-15T22:40:41.137 INFO:tasks.workunit.client.0.smithi033.stdout:8/61: rename d1/d6/d16/d18 to d1/de/d1a 0 2024-02-15T22:40:41.137 INFO:tasks.workunit.client.0.smithi033.stdout:8/62: fdatasync d1/f8 0 2024-02-15T22:40:41.142 INFO:tasks.workunit.client.0.smithi033.stdout:7/87: mkdir d5/d6/d10/d16/d20 0 2024-02-15T22:40:41.146 INFO:tasks.workunit.client.0.smithi033.stdout:2/125: mkdir d1/d8/d2b 0 2024-02-15T22:40:41.146 INFO:tasks.workunit.client.0.smithi033.stdout:2/126: truncate d1/f20 425290 0 2024-02-15T22:40:41.146 INFO:tasks.workunit.client.0.smithi033.stdout:2/127: chown d1/c5 11474 1 2024-02-15T22:40:41.154 INFO:tasks.workunit.client.0.smithi033.stdout:0/64: link db/lf db/l10 0 2024-02-15T22:40:41.172 INFO:tasks.workunit.client.0.smithi033.stdout:7/88: creat d5/d6/d10/d16/f21 x:0 0 0 2024-02-15T22:40:41.176 INFO:tasks.workunit.client.0.smithi033.stdout:5/181: rmdir d6/d14 39 2024-02-15T22:40:41.179 INFO:tasks.workunit.client.0.smithi033.stdout:2/128: symlink d1/d16/l2c 0 2024-02-15T22:40:41.179 INFO:tasks.workunit.client.0.smithi033.stdout:2/129: chown d1/d1d/d13 2120 1 2024-02-15T22:40:41.179 INFO:tasks.workunit.client.0.smithi033.stdout:2/130: chown d1/l1f 531893362 1 2024-02-15T22:40:41.180 INFO:tasks.workunit.client.0.smithi033.stdout:4/56: rmdir d8 39 2024-02-15T22:40:41.180 INFO:tasks.workunit.client.0.smithi033.stdout:7/89: read d5/d6/f7 [2434180,52552] 0 2024-02-15T22:40:41.184 INFO:tasks.workunit.client.0.smithi033.stdout:0/65: truncate f0 6118637 0 2024-02-15T22:40:41.184 INFO:tasks.workunit.client.0.smithi033.stdout:0/66: creat db/f11 x:0 0 0 2024-02-15T22:40:41.189 INFO:tasks.workunit.client.0.smithi033.stdout:5/182: mkdir d6/d14/d31/d38/d3f 0 2024-02-15T22:40:41.197 INFO:tasks.workunit.client.0.smithi033.stdout:4/57: dwrite f7 [0,4194304] 0 2024-02-15T22:40:41.197 INFO:tasks.workunit.client.0.smithi033.stdout:7/90: link l1 d5/d6/d10/d16/d20/l22 0 2024-02-15T22:40:41.198 INFO:tasks.workunit.client.0.smithi033.stdout:7/91: chown d5/dc/l14 45881 1 2024-02-15T22:40:41.201 INFO:tasks.workunit.client.0.smithi033.stdout:0/67: link db/lf db/l12 0 2024-02-15T22:40:41.203 INFO:tasks.workunit.client.0.smithi033.stdout:8/63: rmdir d1/d6/d16 0 2024-02-15T22:40:41.203 INFO:tasks.workunit.client.0.smithi033.stdout:8/64: getdents d1 0 2024-02-15T22:40:41.205 INFO:tasks.workunit.client.0.smithi033.stdout:5/183: getdents d6/d14/d31/d3c 0 2024-02-15T22:40:41.205 INFO:tasks.workunit.client.0.smithi033.stdout:5/184: creat d6/d25/f40 x:0 0 0 2024-02-15T22:40:41.238 INFO:tasks.workunit.client.0.smithi033.stdout:2/131: rename d1/d8/c10 to d1/d8/c2d 0 2024-02-15T22:40:41.247 INFO:tasks.workunit.client.0.smithi033.stdout:4/58: creat d8/fe x:0 0 0 2024-02-15T22:40:41.247 INFO:tasks.workunit.client.0.smithi033.stdout:4/59: creat d8/ff x:0 0 0 2024-02-15T22:40:41.248 INFO:tasks.workunit.client.0.smithi033.stdout:4/60: truncate f5 423663 0 2024-02-15T22:40:41.249 INFO:tasks.workunit.client.0.smithi033.stdout:7/92: rmdir d5/d6/d10/d16/d20 39 2024-02-15T22:40:41.252 INFO:tasks.workunit.client.0.smithi033.stdout:7/93: write d5/f15 [328523,108498] 0 2024-02-15T22:40:41.252 INFO:tasks.workunit.client.0.smithi033.stdout:7/94: write d5/f18 [945830,125224] 0 2024-02-15T22:40:41.257 INFO:tasks.workunit.client.0.smithi033.stdout:8/65: creat d1/d6/d14/f1b x:0 0 0 2024-02-15T22:40:41.265 INFO:tasks.workunit.client.0.smithi033.stdout:5/185: link d6/d14/c24 d6/d14/c41 0 2024-02-15T22:40:41.265 INFO:tasks.workunit.client.0.smithi033.stdout:5/186: chown d6/l23 31 1 2024-02-15T22:40:41.265 INFO:tasks.workunit.client.0.smithi033.stdout:5/187: write d6/ff [2278750,122933] 0 2024-02-15T22:40:41.265 INFO:tasks.workunit.client.0.smithi033.stdout:5/188: chown d6/f1e 58 1 2024-02-15T22:40:41.266 INFO:tasks.workunit.client.0.smithi033.stdout:5/189: creat d6/f42 x:0 0 0 2024-02-15T22:40:41.266 INFO:tasks.workunit.client.0.smithi033.stdout:5/190: dread - d6/d14/d31/f37 zero size 2024-02-15T22:40:41.266 INFO:tasks.workunit.client.0.smithi033.stdout:2/132: mknod d1/d1d/d24/d2a/c2e 0 2024-02-15T22:40:41.270 INFO:tasks.workunit.client.0.smithi033.stdout:4/61: dwrite f5 [0,4194304] 0 2024-02-15T22:40:41.272 INFO:tasks.workunit.client.0.smithi033.stdout:4/62: dread d8/fd [0,4194304] 0 2024-02-15T22:40:41.274 INFO:tasks.workunit.client.0.smithi033.stdout:7/95: symlink d5/d6/d10/l23 0 2024-02-15T22:40:41.277 INFO:tasks.workunit.client.0.smithi033.stdout:0/68: rmdir db 39 2024-02-15T22:40:41.278 INFO:tasks.workunit.client.0.smithi033.stdout:8/66: dwrite d1/f8 [4194304,4194304] 0 2024-02-15T22:40:41.278 INFO:tasks.workunit.client.0.smithi033.stdout:8/67: creat d1/de/f1c x:0 0 0 2024-02-15T22:40:41.293 INFO:tasks.workunit.client.0.smithi033.stdout:4/63: dwrite f6 [0,4194304] 0 2024-02-15T22:40:41.302 INFO:tasks.workunit.client.0.smithi033.stdout:7/96: dwrite d5/d6/fa [4194304,4194304] 0 2024-02-15T22:40:41.302 INFO:tasks.workunit.client.0.smithi033.stdout:7/97: write d5/d6/fa [1582399,8996] 0 2024-02-15T22:40:41.305 INFO:tasks.workunit.client.0.smithi033.stdout:5/191: mkdir d6/d14/d43 0 2024-02-15T22:40:41.307 INFO:tasks.workunit.client.0.smithi033.stdout:7/98: dread d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:41.313 INFO:tasks.workunit.client.0.smithi033.stdout:0/69: rename db/l10 to db/l13 0 2024-02-15T22:40:41.320 INFO:tasks.workunit.client.0.smithi033.stdout:8/68: mkdir d1/df/d1d 0 2024-02-15T22:40:41.323 INFO:tasks.workunit.client.0.smithi033.stdout:7/99: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:41.326 INFO:tasks.workunit.client.0.smithi033.stdout:7/100: dread f4 [0,4194304] 0 2024-02-15T22:40:41.344 INFO:tasks.workunit.client.0.smithi033.stdout:7/101: dwrite d5/f18 [0,4194304] 0 2024-02-15T22:40:41.368 INFO:tasks.workunit.client.0.smithi033.stdout:4/64: mknod d8/c10 0 2024-02-15T22:40:41.372 INFO:tasks.workunit.client.0.smithi033.stdout:5/192: symlink d6/d14/d43/l44 0 2024-02-15T22:40:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:40:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:40:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr fail", "who": "smithi033.swohxi"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: osdmap e47: 6 total, 6 up, 6 in 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "mgr fail", "who": "smithi033.swohxi"}]': finished 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: mgrmap e21: smithi082.mjhlse(active, starting, since 0.00583849s) 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:40:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: Manager daemon smithi082.mjhlse is now available 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/trash_purge_schedule"}]: dispatch 2024-02-15T22:40:41.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/trash_purge_schedule"}]: dispatch 2024-02-15T22:40:41.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:41.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:41 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:41.378 INFO:tasks.workunit.client.0.smithi033.stdout:5/193: dread d6/ff [0,4194304] 0 2024-02-15T22:40:41.378 INFO:tasks.workunit.client.0.smithi033.stdout:2/133: rename d1/d1d to d1/d8/d2b/d2f 0 2024-02-15T22:40:41.382 INFO:tasks.workunit.client.0.smithi033.stdout:8/69: symlink d1/de/d1a/l1e 0 2024-02-15T22:40:41.400 INFO:tasks.workunit.client.0.smithi033.stdout:4/65: mknod d8/c11 0 2024-02-15T22:40:41.401 INFO:tasks.workunit.client.0.smithi033.stdout:2/134: dwrite d1/d8/d2b/d2f/d12/f15 [0,4194304] 0 2024-02-15T22:40:41.401 INFO:tasks.workunit.client.0.smithi033.stdout:2/135: read - d1/d8/f19 zero size 2024-02-15T22:40:41.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/136: dwrite d1/f7 [8388608,4194304] 0 2024-02-15T22:40:41.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/137: dread d1/f20 [0,4194304] 0 2024-02-15T22:40:41.429 INFO:tasks.workunit.client.0.smithi033.stdout:5/194: rmdir d6/d14/d43 39 2024-02-15T22:40:41.431 INFO:tasks.workunit.client.0.smithi033.stdout:0/70: rename l9 to db/l14 0 2024-02-15T22:40:41.434 INFO:tasks.workunit.client.0.smithi033.stdout:8/70: symlink d1/d6/d17/l1f 0 2024-02-15T22:40:41.434 INFO:tasks.workunit.client.0.smithi033.stdout:8/71: chown d1/d6/f7 17 1 2024-02-15T22:40:41.437 INFO:tasks.workunit.client.0.smithi033.stdout:4/66: symlink d8/l12 0 2024-02-15T22:40:41.437 INFO:tasks.workunit.client.0.smithi033.stdout:4/67: write d8/fe [461064,1672] 0 2024-02-15T22:40:41.443 INFO:tasks.workunit.client.0.smithi033.stdout:2/138: creat d1/d8/d2b/d2f/d24/f30 x:0 0 0 2024-02-15T22:40:41.446 INFO:tasks.workunit.client.0.smithi033.stdout:5/195: creat d6/d14/f45 x:0 0 0 2024-02-15T22:40:41.450 INFO:tasks.workunit.client.0.smithi033.stdout:0/71: symlink db/l15 0 2024-02-15T22:40:41.450 INFO:tasks.workunit.client.0.smithi033.stdout:0/72: chown db/lf 240 1 2024-02-15T22:40:41.451 INFO:tasks.workunit.client.0.smithi033.stdout:8/72: dwrite d1/f8 [8388608,4194304] 0 2024-02-15T22:40:41.453 INFO:tasks.workunit.client.0.smithi033.stdout:4/68: mkdir d8/d13 0 2024-02-15T22:40:41.457 INFO:tasks.workunit.client.0.smithi033.stdout:0/73: rmdir db 39 2024-02-15T22:40:41.457 INFO:tasks.workunit.client.0.smithi033.stdout:0/74: chown fa 5 1 2024-02-15T22:40:41.457 INFO:tasks.workunit.client.0.smithi033.stdout:0/75: chown db/ld 19 1 2024-02-15T22:40:41.459 INFO:tasks.workunit.client.0.smithi033.stdout:4/69: mknod d8/d13/c14 0 2024-02-15T22:40:41.463 INFO:tasks.workunit.client.0.smithi033.stdout:0/76: rename l8 to db/l16 0 2024-02-15T22:40:41.463 INFO:tasks.workunit.client.0.smithi033.stdout:0/77: truncate db/fe 1000020 0 2024-02-15T22:40:41.463 INFO:tasks.workunit.client.0.smithi033.stdout:0/78: write db/f11 [808813,71156] 0 2024-02-15T22:40:41.467 INFO:tasks.workunit.client.0.smithi033.stdout:0/79: creat db/f17 x:0 0 0 2024-02-15T22:40:41.467 INFO:tasks.workunit.client.0.smithi033.stdout:0/80: creat db/f18 x:0 0 0 2024-02-15T22:40:41.469 INFO:tasks.workunit.client.0.smithi033.stdout:5/196: dwrite d6/d25/f29 [0,4194304] 0 2024-02-15T22:40:41.469 INFO:tasks.workunit.client.0.smithi033.stdout:5/197: fdatasync d6/d25/f40 0 2024-02-15T22:40:41.470 INFO:tasks.workunit.client.0.smithi033.stdout:2/139: dwrite d1/f7 [16777216,4194304] 0 2024-02-15T22:40:41.470 INFO:tasks.workunit.client.0.smithi033.stdout:2/140: write d1/f20 [802310,87027] 0 2024-02-15T22:40:41.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/73: dwrite d1/f8 [4194304,4194304] 0 2024-02-15T22:40:41.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/74: readlink d1/de/d1a/l1e 0 2024-02-15T22:40:41.476 INFO:tasks.workunit.client.0.smithi033.stdout:5/198: link d6/d14/c24 d6/d14/c46 0 2024-02-15T22:40:41.477 INFO:tasks.workunit.client.0.smithi033.stdout:5/199: truncate d6/d14/f20 635881 0 2024-02-15T22:40:41.481 INFO:tasks.workunit.client.0.smithi033.stdout:2/141: mkdir d1/d8/d2b/d2f/d24/d31 0 2024-02-15T22:40:41.491 INFO:tasks.workunit.client.0.smithi033.stdout:9/27: sync 2024-02-15T22:40:41.492 INFO:tasks.workunit.client.0.smithi033.stdout:9/28: creat d4/f7 x:0 0 0 2024-02-15T22:40:41.492 INFO:tasks.workunit.client.0.smithi033.stdout:9/29: creat d4/f8 x:0 0 0 2024-02-15T22:40:41.493 INFO:tasks.workunit.client.0.smithi033.stdout:0/81: dwrite f6 [4194304,4194304] 0 2024-02-15T22:40:41.493 INFO:tasks.workunit.client.0.smithi033.stdout:0/82: chown f5 86 1 2024-02-15T22:40:41.493 INFO:tasks.workunit.client.0.smithi033.stdout:0/83: write db/f18 [629189,22035] 0 2024-02-15T22:40:41.493 INFO:tasks.workunit.client.0.smithi033.stdout:0/84: truncate f4 4574109 0 2024-02-15T22:40:41.497 INFO:tasks.workunit.client.0.smithi033.stdout:8/75: dwrite d1/f10 [0,4194304] 0 2024-02-15T22:40:41.502 INFO:tasks.workunit.client.0.smithi033.stdout:0/85: mkdir db/d19 0 2024-02-15T22:40:41.502 INFO:tasks.workunit.client.0.smithi033.stdout:0/86: dread - fa zero size 2024-02-15T22:40:41.508 INFO:tasks.workunit.client.0.smithi033.stdout:5/200: dwrite d6/d14/f1d [0,4194304] 0 2024-02-15T22:40:41.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/30: dwrite d4/f7 [0,4194304] 0 2024-02-15T22:40:41.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/31: readlink - no filename 2024-02-15T22:40:41.509 INFO:tasks.workunit.client.0.smithi033.stdout:0/87: dread db/f18 [0,4194304] 0 2024-02-15T22:40:41.513 INFO:tasks.workunit.client.0.smithi033.stdout:5/201: creat d6/d14/d31/f47 x:0 0 0 2024-02-15T22:40:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:40:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:40:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr fail", "who": "smithi033.swohxi"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: osdmap e47: 6 total, 6 up, 6 in 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.14214 172.21.15.33:0/505707597' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "mgr fail", "who": "smithi033.swohxi"}]': finished 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: mgrmap e21: smithi082.mjhlse(active, starting, since 0.00583849s) 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:40:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: Manager daemon smithi082.mjhlse is now available 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:40:41.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:40:41.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/trash_purge_schedule"}]: dispatch 2024-02-15T22:40:41.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.mjhlse/trash_purge_schedule"}]: dispatch 2024-02-15T22:40:41.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:41.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:41 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:41.523 INFO:tasks.workunit.client.0.smithi033.stdout:9/32: link d4/f5 d4/f9 0 2024-02-15T22:40:41.523 INFO:tasks.workunit.client.0.smithi033.stdout:9/33: write f1 [1871355,2924] 0 2024-02-15T22:40:41.524 INFO:tasks.workunit.client.0.smithi033.stdout:0/88: creat db/d19/f1a x:0 0 0 2024-02-15T22:40:41.525 INFO:tasks.workunit.client.0.smithi033.stdout:5/202: mkdir d6/d14/d31/d48 0 2024-02-15T22:40:41.529 INFO:tasks.workunit.client.0.smithi033.stdout:9/34: mknod d4/ca 0 2024-02-15T22:40:41.532 INFO:tasks.workunit.client.0.smithi033.stdout:5/203: mkdir d6/d14/d31/d48/d49 0 2024-02-15T22:40:41.532 INFO:tasks.workunit.client.0.smithi033.stdout:5/204: chown d6/d14/f2e 832384 1 2024-02-15T22:40:41.535 INFO:tasks.workunit.client.0.smithi033.stdout:9/35: rename d4/f7 to d4/fb 0 2024-02-15T22:40:41.535 INFO:tasks.workunit.client.0.smithi033.stdout:9/36: chown d4 143914 1 2024-02-15T22:40:41.540 INFO:tasks.workunit.client.0.smithi033.stdout:0/89: dwrite db/f18 [0,4194304] 0 2024-02-15T22:40:41.540 INFO:tasks.workunit.client.0.smithi033.stdout:0/90: chown f6 27117 1 2024-02-15T22:40:41.543 INFO:tasks.workunit.client.0.smithi033.stdout:9/37: unlink d4/ca 0 2024-02-15T22:40:41.549 INFO:tasks.workunit.client.0.smithi033.stdout:0/91: dread db/f18 [0,4194304] 0 2024-02-15T22:40:41.551 INFO:tasks.workunit.client.0.smithi033.stdout:5/205: dwrite d6/f10 [0,4194304] 0 2024-02-15T22:40:41.552 INFO:tasks.workunit.client.0.smithi033.stdout:0/92: mknod db/d19/c1b 0 2024-02-15T22:40:41.554 INFO:tasks.workunit.client.0.smithi033.stdout:5/206: unlink d6/d14/l15 0 2024-02-15T22:40:41.555 INFO:tasks.workunit.client.0.smithi033.stdout:5/207: dread d6/d14/f20 [0,4194304] 0 2024-02-15T22:40:41.555 INFO:tasks.workunit.client.0.smithi033.stdout:5/208: chown d6/d14/f2e 3060527 1 2024-02-15T22:40:41.556 INFO:tasks.workunit.client.0.smithi033.stdout:0/93: mkdir db/d1c 0 2024-02-15T22:40:41.560 INFO:tasks.workunit.client.0.smithi033.stdout:0/94: dread db/f11 [0,4194304] 0 2024-02-15T22:40:41.565 INFO:tasks.workunit.client.0.smithi033.stdout:5/209: write d6/d14/f30 [1008870,1762] 0 2024-02-15T22:40:41.576 INFO:tasks.workunit.client.0.smithi033.stdout:5/210: dread d6/d14/f1c [0,4194304] 0 2024-02-15T22:40:41.576 INFO:tasks.workunit.client.0.smithi033.stdout:5/211: stat d6/f10 0 2024-02-15T22:40:41.584 INFO:tasks.workunit.client.0.smithi033.stdout:5/212: dread d6/d14/f1d [0,4194304] 0 2024-02-15T22:40:41.588 INFO:tasks.workunit.client.0.smithi033.stdout:5/213: dread d6/d14/f3e [0,4194304] 0 2024-02-15T22:40:41.595 INFO:tasks.workunit.client.0.smithi033.stdout:5/214: dread d6/f16 [0,4194304] 0 2024-02-15T22:40:41.596 INFO:tasks.workunit.client.0.smithi033.stdout:9/38: getdents d4 0 2024-02-15T22:40:41.598 INFO:tasks.workunit.client.0.smithi033.stdout:9/39: creat d4/fc x:0 0 0 2024-02-15T22:40:41.599 INFO:tasks.workunit.client.0.smithi033.stdout:9/40: fsync f2 0 2024-02-15T22:40:41.616 INFO:tasks.workunit.client.0.smithi033.stdout:0/95: truncate f0 6122105 0 2024-02-15T22:40:41.618 INFO:tasks.workunit.client.0.smithi033.stdout:9/41: dwrite d4/f5 [0,4194304] 0 2024-02-15T22:40:41.618 INFO:tasks.workunit.client.0.smithi033.stdout:9/42: stat d4 0 2024-02-15T22:40:41.626 INFO:tasks.workunit.client.0.smithi033.stdout:9/43: creat d4/fd x:0 0 0 2024-02-15T22:40:41.629 INFO:tasks.workunit.client.0.smithi033.stdout:0/96: dwrite db/fe [0,4194304] 0 2024-02-15T22:40:41.631 INFO:tasks.workunit.client.0.smithi033.stdout:0/97: dread db/f11 [0,4194304] 0 2024-02-15T22:40:41.631 INFO:tasks.workunit.client.0.smithi033.stdout:0/98: readlink db/l12 0 2024-02-15T22:40:41.635 INFO:tasks.workunit.client.0.smithi033.stdout:0/99: symlink db/d19/l1d 0 2024-02-15T22:40:41.635 INFO:tasks.workunit.client.0.smithi033.stdout:0/100: dread - db/d19/f1a zero size 2024-02-15T22:40:41.635 INFO:tasks.workunit.client.0.smithi033.stdout:0/101: chown db/l13 922518132 1 2024-02-15T22:40:41.639 INFO:tasks.workunit.client.0.smithi033.stdout:0/102: getdents db 0 2024-02-15T22:40:41.662 INFO:tasks.workunit.client.0.smithi033.stdout:9/44: rmdir d4 39 2024-02-15T22:40:41.666 INFO:tasks.workunit.client.0.smithi033.stdout:9/45: dread f3 [0,4194304] 0 2024-02-15T22:40:41.669 INFO:tasks.workunit.client.0.smithi033.stdout:9/46: truncate f3 826359 0 2024-02-15T22:40:41.670 INFO:tasks.workunit.client.0.smithi033.stdout:0/103: rmdir db/d19 39 2024-02-15T22:40:41.684 INFO:tasks.workunit.client.0.smithi033.stdout:0/104: write db/fe [3051581,125506] 0 2024-02-15T22:40:41.685 INFO:tasks.workunit.client.0.smithi033.stdout:0/105: stat db/d1c 0 2024-02-15T22:40:41.689 INFO:tasks.workunit.client.0.smithi033.stdout:9/47: dwrite d4/f9 [0,4194304] 0 2024-02-15T22:40:41.689 INFO:tasks.workunit.client.0.smithi033.stdout:9/48: fdatasync d4/fc 0 2024-02-15T22:40:41.829 INFO:tasks.workunit.client.0.smithi033.stdout:1/117: sync 2024-02-15T22:40:41.829 INFO:tasks.workunit.client.0.smithi033.stdout:3/50: sync 2024-02-15T22:40:41.829 INFO:tasks.workunit.client.0.smithi033.stdout:3/51: readlink d0/d8/la 0 2024-02-15T22:40:41.831 INFO:tasks.workunit.client.0.smithi033.stdout:1/118: mknod d1/d1d/c21 0 2024-02-15T22:40:41.833 INFO:tasks.workunit.client.0.smithi033.stdout:3/52: truncate d0/fe 3301839 0 2024-02-15T22:40:41.835 INFO:tasks.workunit.client.0.smithi033.stdout:1/119: rename d1/de/c1a to d1/d20/c22 0 2024-02-15T22:40:41.835 INFO:tasks.workunit.client.0.smithi033.stdout:1/120: write d1/f19 [85175,79135] 0 2024-02-15T22:40:41.835 INFO:tasks.workunit.client.0.smithi033.stdout:1/121: chown d1/de 0 1 2024-02-15T22:40:41.837 INFO:tasks.workunit.client.0.smithi033.stdout:3/53: rmdir d0 39 2024-02-15T22:40:41.837 INFO:tasks.workunit.client.0.smithi033.stdout:3/54: write d0/f13 [667113,111565] 0 2024-02-15T22:40:41.841 INFO:tasks.workunit.client.0.smithi033.stdout:1/122: truncate d1/f6 491937 0 2024-02-15T22:40:41.844 INFO:tasks.workunit.client.0.smithi033.stdout:1/123: mknod d1/de/c23 0 2024-02-15T22:40:41.850 INFO:tasks.workunit.client.0.smithi033.stdout:3/55: dwrite d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:41.979 INFO:tasks.workunit.client.0.smithi033.stdout:8/76: sync 2024-02-15T22:40:41.979 INFO:tasks.workunit.client.0.smithi033.stdout:2/142: sync 2024-02-15T22:40:41.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/102: sync 2024-02-15T22:40:41.979 INFO:tasks.workunit.client.0.smithi033.stdout:6/133: sync 2024-02-15T22:40:41.979 INFO:tasks.workunit.client.0.smithi033.stdout:4/70: sync 2024-02-15T22:40:41.979 INFO:tasks.workunit.client.0.smithi033.stdout:6/134: creat d12/f29 x:0 0 0 2024-02-15T22:40:41.979 INFO:tasks.workunit.client.0.smithi033.stdout:5/215: sync 2024-02-15T22:40:41.981 INFO:tasks.workunit.client.0.smithi033.stdout:8/77: creat d1/de/d1a/f20 x:0 0 0 2024-02-15T22:40:41.982 INFO:tasks.workunit.client.0.smithi033.stdout:8/78: read - d1/d6/d14/f1b zero size 2024-02-15T22:40:41.985 INFO:tasks.workunit.client.0.smithi033.stdout:2/143: unlink d1/c9 0 2024-02-15T22:40:41.985 INFO:tasks.workunit.client.0.smithi033.stdout:2/144: chown d1/cd 12549 1 2024-02-15T22:40:41.987 INFO:tasks.workunit.client.0.smithi033.stdout:7/103: unlink d5/d6/d10/d16/d20/l22 0 2024-02-15T22:40:41.990 INFO:tasks.workunit.client.0.smithi033.stdout:3/56: dwrite d0/f7 [0,4194304] 0 2024-02-15T22:40:41.990 INFO:tasks.workunit.client.0.smithi033.stdout:4/71: write f6 [411525,71550] 0 2024-02-15T22:40:41.991 INFO:tasks.workunit.client.0.smithi033.stdout:6/135: unlink d12/l15 0 2024-02-15T22:40:41.992 INFO:tasks.workunit.client.0.smithi033.stdout:6/136: fsync d12/d14/f1f 0 2024-02-15T22:40:41.994 INFO:tasks.workunit.client.0.smithi033.stdout:5/216: symlink d6/d14/d31/d48/l4a 0 2024-02-15T22:40:41.995 INFO:tasks.workunit.client.0.smithi033.stdout:5/217: fsync d6/d14/f1d 0 2024-02-15T22:40:41.995 INFO:tasks.workunit.client.0.smithi033.stdout:5/218: chown d6/d14/d31/d38/d3f 23 1 2024-02-15T22:40:41.997 INFO:tasks.workunit.client.0.smithi033.stdout:8/79: mknod d1/d6/d17/c21 0 2024-02-15T22:40:41.997 INFO:tasks.workunit.client.0.smithi033.stdout:8/80: dread - d1/d6/d14/f1b zero size 2024-02-15T22:40:41.997 INFO:tasks.workunit.client.0.smithi033.stdout:8/81: creat d1/de/f22 x:0 0 0 2024-02-15T22:40:41.997 INFO:tasks.workunit.client.0.smithi033.stdout:8/82: fdatasync d1/de/f12 0 2024-02-15T22:40:41.998 INFO:tasks.workunit.client.0.smithi033.stdout:2/145: mknod d1/d8/d2b/d2f/d13/c32 0 2024-02-15T22:40:41.999 INFO:tasks.workunit.client.0.smithi033.stdout:2/146: read d1/d8/d2b/d2f/d12/f27 [399003,72823] 0 2024-02-15T22:40:42.002 INFO:tasks.workunit.client.0.smithi033.stdout:7/104: mknod d5/c24 0 2024-02-15T22:40:42.013 INFO:tasks.workunit.client.0.smithi033.stdout:3/57: creat d0/d3/dd/f18 x:0 0 0 2024-02-15T22:40:42.014 INFO:tasks.workunit.client.0.smithi033.stdout:5/219: truncate d6/f1e 8233014 0 2024-02-15T22:40:42.018 INFO:tasks.workunit.client.0.smithi033.stdout:6/137: dwrite d12/d14/f20 [0,4194304] 0 2024-02-15T22:40:42.019 INFO:tasks.workunit.client.0.smithi033.stdout:4/72: dwrite f5 [0,4194304] 0 2024-02-15T22:40:42.019 INFO:tasks.workunit.client.0.smithi033.stdout:8/83: rename d1/de/f12 to d1/df/f23 0 2024-02-15T22:40:42.019 INFO:tasks.workunit.client.0.smithi033.stdout:8/84: dread - d1/de/d1a/f20 zero size 2024-02-15T22:40:42.020 INFO:tasks.workunit.client.0.smithi033.stdout:4/73: read d8/fe [25392,125714] 0 2024-02-15T22:40:42.021 INFO:tasks.workunit.client.0.smithi033.stdout:2/147: creat d1/d8/d2b/d2f/d24/d31/f33 x:0 0 0 2024-02-15T22:40:42.021 INFO:tasks.workunit.client.0.smithi033.stdout:2/148: chown d1/d16/c28 165098628 1 2024-02-15T22:40:42.021 INFO:tasks.workunit.client.0.smithi033.stdout:2/149: dread - d1/d16/f1a zero size 2024-02-15T22:40:42.022 INFO:tasks.workunit.client.0.smithi033.stdout:7/105: symlink d5/d6/d10/l25 0 2024-02-15T22:40:42.024 INFO:tasks.workunit.client.0.smithi033.stdout:3/58: creat d0/f19 x:0 0 0 2024-02-15T22:40:42.030 INFO:tasks.workunit.client.0.smithi033.stdout:6/138: rename l11 to d12/d14/d1d/l2a 0 2024-02-15T22:40:42.030 INFO:tasks.workunit.client.0.smithi033.stdout:5/220: dwrite d6/d14/f1d [4194304,4194304] 0 2024-02-15T22:40:42.030 INFO:tasks.workunit.client.0.smithi033.stdout:5/221: write d6/d14/d31/f36 [427132,35990] 0 2024-02-15T22:40:42.033 INFO:tasks.workunit.client.0.smithi033.stdout:8/85: creat d1/df/d1d/f24 x:0 0 0 2024-02-15T22:40:42.033 INFO:tasks.workunit.client.0.smithi033.stdout:8/86: read - d1/df/d1d/f24 zero size 2024-02-15T22:40:42.034 INFO:tasks.workunit.client.0.smithi033.stdout:6/139: dread f6 [0,4194304] 0 2024-02-15T22:40:42.035 INFO:tasks.workunit.client.0.smithi033.stdout:6/140: write d12/f13 [3824162,62707] 0 2024-02-15T22:40:42.035 INFO:tasks.workunit.client.0.smithi033.stdout:6/141: truncate d12/f18 4380131 0 2024-02-15T22:40:42.035 INFO:tasks.workunit.client.0.smithi033.stdout:6/142: creat d12/f2b x:0 0 0 2024-02-15T22:40:42.035 INFO:tasks.workunit.client.0.smithi033.stdout:6/143: chown ff 458778 1 2024-02-15T22:40:42.039 INFO:tasks.workunit.client.0.smithi033.stdout:7/106: mkdir d5/d6/d10/d16/d26 0 2024-02-15T22:40:42.039 INFO:tasks.workunit.client.0.smithi033.stdout:7/107: fdatasync f4 0 2024-02-15T22:40:42.041 INFO:tasks.workunit.client.0.smithi033.stdout:3/59: truncate d0/f13 230787 0 2024-02-15T22:40:42.045 INFO:tasks.workunit.client.0.smithi033.stdout:4/74: dwrite d8/fd [0,4194304] 0 2024-02-15T22:40:42.046 INFO:tasks.workunit.client.0.smithi033.stdout:5/222: rename d6/d14/c41 to d6/d14/d31/d3c/c4b 0 2024-02-15T22:40:42.046 INFO:tasks.workunit.client.0.smithi033.stdout:5/223: stat d6/d14/d31/d48/d49 0 2024-02-15T22:40:42.048 INFO:tasks.workunit.client.0.smithi033.stdout:8/87: truncate d1/f10 2884242 0 2024-02-15T22:40:42.052 INFO:tasks.workunit.client.0.smithi033.stdout:7/108: write d5/d6/f7 [646289,53295] 0 2024-02-15T22:40:42.052 INFO:tasks.workunit.client.0.smithi033.stdout:2/150: mkdir d1/d8/d34 0 2024-02-15T22:40:42.053 INFO:tasks.workunit.client.0.smithi033.stdout:6/144: dwrite d12/f2b [0,4194304] 0 2024-02-15T22:40:42.053 INFO:tasks.workunit.client.0.smithi033.stdout:5/224: dread d6/d14/f1d [0,4194304] 0 2024-02-15T22:40:42.068 INFO:tasks.workunit.client.0.smithi033.stdout:4/75: symlink d8/d13/l15 0 2024-02-15T22:40:42.071 INFO:tasks.workunit.client.0.smithi033.stdout:3/60: rename d0/c12 to d0/d3/dd/c1a 0 2024-02-15T22:40:42.071 INFO:tasks.workunit.client.0.smithi033.stdout:3/61: stat d0 0 2024-02-15T22:40:42.071 INFO:tasks.workunit.client.0.smithi033.stdout:3/62: dread - d0/f19 zero size 2024-02-15T22:40:42.072 INFO:tasks.workunit.client.0.smithi033.stdout:5/225: dwrite d6/ff [0,4194304] 0 2024-02-15T22:40:42.076 INFO:tasks.workunit.client.0.smithi033.stdout:2/151: rmdir d1/d8/d2b 39 2024-02-15T22:40:42.078 INFO:tasks.workunit.client.0.smithi033.stdout:3/63: read d0/fe [641981,128428] 0 2024-02-15T22:40:42.082 INFO:tasks.workunit.client.0.smithi033.stdout:4/76: mkdir d8/d16 0 2024-02-15T22:40:42.083 INFO:tasks.workunit.client.0.smithi033.stdout:4/77: readlink d8/d13/l15 0 2024-02-15T22:40:42.084 INFO:tasks.workunit.client.0.smithi033.stdout:5/226: rename d6/d14/d31/d3c/c3d to d6/d14/c4c 0 2024-02-15T22:40:42.084 INFO:tasks.workunit.client.0.smithi033.stdout:5/227: readlink d6/l23 0 2024-02-15T22:40:42.085 INFO:tasks.workunit.client.0.smithi033.stdout:8/88: rmdir d1/d6/d14 39 2024-02-15T22:40:42.086 INFO:tasks.workunit.client.0.smithi033.stdout:7/109: getdents d5/d6 0 2024-02-15T22:40:42.088 INFO:tasks.workunit.client.0.smithi033.stdout:7/110: dread d5/f19 [0,4194304] 0 2024-02-15T22:40:42.090 INFO:tasks.workunit.client.0.smithi033.stdout:3/64: mknod d0/d8/c1b 0 2024-02-15T22:40:42.091 INFO:tasks.workunit.client.0.smithi033.stdout:4/78: link d8/c11 d8/d13/c17 0 2024-02-15T22:40:42.093 INFO:tasks.workunit.client.0.smithi033.stdout:7/111: mknod d5/df/c27 0 2024-02-15T22:40:42.093 INFO:tasks.workunit.client.0.smithi033.stdout:7/112: chown d5/d6/d10/d16/f21 62 1 2024-02-15T22:40:42.093 INFO:tasks.workunit.client.0.smithi033.stdout:7/113: rename d5 to d5/d6/d10/d16/d26/d28 22 2024-02-15T22:40:42.094 INFO:tasks.workunit.client.0.smithi033.stdout:2/152: mknod d1/d8/c35 0 2024-02-15T22:40:42.094 INFO:tasks.workunit.client.0.smithi033.stdout:2/153: dread - d1/d8/f19 zero size 2024-02-15T22:40:42.094 INFO:tasks.workunit.client.0.smithi033.stdout:2/154: chown d1/d8/d2b/d2f/fb 48687440 1 2024-02-15T22:40:42.094 INFO:tasks.workunit.client.0.smithi033.stdout:2/155: stat d1/d8/d2b/d2f/l21 0 2024-02-15T22:40:42.094 INFO:tasks.workunit.client.0.smithi033.stdout:2/156: stat d1/l23 0 2024-02-15T22:40:42.095 INFO:tasks.workunit.client.0.smithi033.stdout:3/65: truncate d0/d3/f17 1346295 0 2024-02-15T22:40:42.097 INFO:tasks.workunit.client.0.smithi033.stdout:2/157: dread d1/f7 [4194304,4194304] 0 2024-02-15T22:40:42.098 INFO:tasks.workunit.client.0.smithi033.stdout:4/79: mkdir d8/d18 0 2024-02-15T22:40:42.100 INFO:tasks.workunit.client.0.smithi033.stdout:7/114: mknod d5/d6/c29 0 2024-02-15T22:40:42.104 INFO:tasks.workunit.client.0.smithi033.stdout:3/66: mkdir d0/d1c 0 2024-02-15T22:40:42.105 INFO:tasks.workunit.client.0.smithi033.stdout:2/158: rmdir d1/d8/d2b/d2f/d12 39 2024-02-15T22:40:42.106 INFO:tasks.workunit.client.0.smithi033.stdout:2/159: truncate d1/d8/d2b/d2f/f1e 801916 0 2024-02-15T22:40:42.106 INFO:tasks.workunit.client.0.smithi033.stdout:2/160: stat d1/d8/d2b/d2f/d24/d2a/c2e 0 2024-02-15T22:40:42.108 INFO:tasks.workunit.client.0.smithi033.stdout:2/161: dread d1/d8/d2b/d2f/d13/f17 [0,4194304] 0 2024-02-15T22:40:42.108 INFO:tasks.workunit.client.0.smithi033.stdout:4/80: mkdir d8/d16/d19 0 2024-02-15T22:40:42.111 INFO:tasks.workunit.client.0.smithi033.stdout:3/67: mknod d0/c1d 0 2024-02-15T22:40:42.111 INFO:tasks.workunit.client.0.smithi033.stdout:3/68: creat d0/f1e x:0 0 0 2024-02-15T22:40:42.111 INFO:tasks.workunit.client.0.smithi033.stdout:3/69: stat d0/d8/c1b 0 2024-02-15T22:40:42.111 INFO:tasks.workunit.client.0.smithi033.stdout:3/70: readlink d0/d3/dd/l15 0 2024-02-15T22:40:42.116 INFO:tasks.workunit.client.0.smithi033.stdout:4/81: dread f5 [0,4194304] 0 2024-02-15T22:40:42.120 INFO:tasks.workunit.client.0.smithi033.stdout:7/115: dwrite d5/d6/fa [0,4194304] 0 2024-02-15T22:40:42.120 INFO:tasks.workunit.client.0.smithi033.stdout:2/162: rename d1/l23 to d1/d8/l36 0 2024-02-15T22:40:42.121 INFO:tasks.workunit.client.0.smithi033.stdout:2/163: read d1/d8/d2b/d2f/f1e [510479,68447] 0 2024-02-15T22:40:42.122 INFO:tasks.workunit.client.0.smithi033.stdout:4/82: mkdir d8/d1a 0 2024-02-15T22:40:42.125 INFO:tasks.workunit.client.0.smithi033.stdout:7/116: creat d5/d6/d10/d16/d26/f2a x:0 0 0 2024-02-15T22:40:42.126 INFO:tasks.workunit.client.0.smithi033.stdout:7/117: write d5/f15 [984687,40373] 0 2024-02-15T22:40:42.128 INFO:tasks.workunit.client.0.smithi033.stdout:2/164: mknod d1/d8/d34/c37 0 2024-02-15T22:40:42.128 INFO:tasks.workunit.client.0.smithi033.stdout:2/165: chown d1/d8/d2b/d2f/d24/f30 28 1 2024-02-15T22:40:42.129 INFO:tasks.workunit.client.0.smithi033.stdout:2/166: write d1/d8/f19 [657718,29862] 0 2024-02-15T22:40:42.130 INFO:tasks.workunit.client.0.smithi033.stdout:4/83: rmdir d8/d16 39 2024-02-15T22:40:42.132 INFO:tasks.workunit.client.0.smithi033.stdout:4/84: dread d8/fe [0,4194304] 0 2024-02-15T22:40:42.133 INFO:tasks.workunit.client.0.smithi033.stdout:7/118: symlink d5/d6/d10/l2b 0 2024-02-15T22:40:42.133 INFO:tasks.workunit.client.0.smithi033.stdout:7/119: chown d5/d6/d10/d16/d26/f2a 142057411 1 2024-02-15T22:40:42.133 INFO:tasks.workunit.client.0.smithi033.stdout:7/120: write d5/d6/d10/d16/f21 [335448,92143] 0 2024-02-15T22:40:42.133 INFO:tasks.workunit.client.0.smithi033.stdout:7/121: readlink d5/d6/l13 0 2024-02-15T22:40:42.134 INFO:tasks.workunit.client.0.smithi033.stdout:3/71: dwrite d0/f19 [0,4194304] 0 2024-02-15T22:40:42.134 INFO:tasks.workunit.client.0.smithi033.stdout:3/72: dread - d0/f16 zero size 2024-02-15T22:40:42.134 INFO:tasks.workunit.client.0.smithi033.stdout:3/73: chown d0/l11 879 1 2024-02-15T22:40:42.134 INFO:tasks.workunit.client.0.smithi033.stdout:3/74: chown d0/d3 17 1 2024-02-15T22:40:42.135 INFO:tasks.workunit.client.0.smithi033.stdout:2/167: unlink d1/d8/d2b/d2f/d24/f30 0 2024-02-15T22:40:42.135 INFO:tasks.workunit.client.0.smithi033.stdout:2/168: write d1/d8/fe [7661719,3346] 0 2024-02-15T22:40:42.135 INFO:tasks.workunit.client.0.smithi033.stdout:2/169: write d1/d8/d2b/d2f/fb [4476248,84228] 0 2024-02-15T22:40:42.136 INFO:tasks.workunit.client.0.smithi033.stdout:4/85: stat d8/c11 0 2024-02-15T22:40:42.141 INFO:tasks.workunit.client.0.smithi033.stdout:7/122: write d5/d6/fa [5954910,82780] 0 2024-02-15T22:40:42.141 INFO:tasks.workunit.client.0.smithi033.stdout:0/106: sync 2024-02-15T22:40:42.141 INFO:tasks.workunit.client.0.smithi033.stdout:9/49: sync 2024-02-15T22:40:42.142 INFO:tasks.workunit.client.0.smithi033.stdout:9/50: fdatasync d4/f9 0 2024-02-15T22:40:42.144 INFO:tasks.workunit.client.0.smithi033.stdout:2/170: rmdir d1/d8/d2b 39 2024-02-15T22:40:42.145 INFO:tasks.workunit.client.0.smithi033.stdout:4/86: mknod d8/d16/d19/c1b 0 2024-02-15T22:40:42.148 INFO:tasks.workunit.client.0.smithi033.stdout:7/123: mkdir d5/df/d2c 0 2024-02-15T22:40:42.154 INFO:tasks.workunit.client.0.smithi033.stdout:9/51: fdatasync d4/fb 0 2024-02-15T22:40:42.167 INFO:tasks.workunit.client.0.smithi033.stdout:7/124: unlink d5/l9 0 2024-02-15T22:40:42.167 INFO:tasks.workunit.client.0.smithi033.stdout:7/125: readlink l2 0 2024-02-15T22:40:42.168 INFO:tasks.workunit.client.0.smithi033.stdout:7/126: read d5/d6/d10/d16/f21 [170763,34839] 0 2024-02-15T22:40:42.168 INFO:tasks.workunit.client.0.smithi033.stdout:7/127: write d5/d6/f7 [1837787,14834] 0 2024-02-15T22:40:42.169 INFO:tasks.workunit.client.0.smithi033.stdout:9/52: creat d4/fe x:0 0 0 2024-02-15T22:40:42.171 INFO:tasks.workunit.client.0.smithi033.stdout:7/128: unlink d5/dc/l1a 0 2024-02-15T22:40:42.172 INFO:tasks.workunit.client.0.smithi033.stdout:9/53: creat d4/ff x:0 0 0 2024-02-15T22:40:42.175 INFO:tasks.workunit.client.0.smithi033.stdout:7/129: mknod d5/c2d 0 2024-02-15T22:40:42.176 INFO:tasks.workunit.client.0.smithi033.stdout:7/130: stat d5/d6/fa 0 2024-02-15T22:40:42.176 INFO:tasks.workunit.client.0.smithi033.stdout:2/171: dwrite d1/f7 [8388608,4194304] 0 2024-02-15T22:40:42.176 INFO:tasks.workunit.client.0.smithi033.stdout:2/172: chown d1/f2 1323 1 2024-02-15T22:40:42.176 INFO:tasks.workunit.client.0.smithi033.stdout:2/173: write d1/d16/f22 [1410639,64390] 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/174: read d1/d16/f22 [1387999,4289] 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:0/107: dwrite f5 [0,4194304] 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/175: fdatasync d1/d8/d2b/d2f/d13/f17 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/176: fsync d1/f7 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:4/87: dwrite f7 [0,4194304] 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:4/88: fsync d8/ff 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:4/89: fdatasync d8/ff 0 2024-02-15T22:40:42.177 INFO:tasks.workunit.client.0.smithi033.stdout:4/90: write f4 [70710,80149] 0 2024-02-15T22:40:42.188 INFO:tasks.workunit.client.0.smithi033.stdout:9/54: mknod d4/c10 0 2024-02-15T22:40:42.196 INFO:tasks.workunit.client.0.smithi033.stdout:8/89: write d1/f10 [600429,82211] 0 2024-02-15T22:40:42.196 INFO:tasks.workunit.client.0.smithi033.stdout:8/90: write d1/df/f23 [998253,31125] 0 2024-02-15T22:40:42.197 INFO:tasks.workunit.client.0.smithi033.stdout:9/55: creat d4/f11 x:0 0 0 2024-02-15T22:40:42.198 INFO:tasks.workunit.client.0.smithi033.stdout:1/124: sync 2024-02-15T22:40:42.199 INFO:tasks.workunit.client.0.smithi033.stdout:0/108: rename db/f17 to db/d19/f1e 0 2024-02-15T22:40:42.199 INFO:tasks.workunit.client.0.smithi033.stdout:2/177: dwrite d1/d16/f22 [0,4194304] 0 2024-02-15T22:40:42.200 INFO:tasks.workunit.client.0.smithi033.stdout:7/131: dwrite d5/d6/fa [4194304,4194304] 0 2024-02-15T22:40:42.204 INFO:tasks.workunit.client.0.smithi033.stdout:0/109: creat db/d19/f1f x:0 0 0 2024-02-15T22:40:42.209 INFO:tasks.workunit.client.0.smithi033.stdout:2/178: mkdir d1/d8/d2b/d2f/d38 0 2024-02-15T22:40:42.210 INFO:tasks.workunit.client.0.smithi033.stdout:2/179: dread d1/d8/d2b/d2f/d12/f27 [0,4194304] 0 2024-02-15T22:40:42.210 INFO:tasks.workunit.client.0.smithi033.stdout:2/180: fsync d1/d8/d2b/d2f/d24/d31/f33 0 2024-02-15T22:40:42.214 INFO:tasks.workunit.client.0.smithi033.stdout:9/56: symlink d4/l12 0 2024-02-15T22:40:42.214 INFO:tasks.workunit.client.0.smithi033.stdout:9/57: write d4/fc [968720,114697] 0 2024-02-15T22:40:42.217 INFO:tasks.workunit.client.0.smithi033.stdout:0/110: read f6 [3816137,92426] 0 2024-02-15T22:40:42.219 INFO:tasks.workunit.client.0.smithi033.stdout:9/58: creat d4/f13 x:0 0 0 2024-02-15T22:40:42.220 INFO:tasks.workunit.client.0.smithi033.stdout:8/91: dwrite d1/df/d1d/f24 [0,4194304] 0 2024-02-15T22:40:42.220 INFO:tasks.workunit.client.0.smithi033.stdout:1/125: dwrite d1/f7 [4194304,4194304] 0 2024-02-15T22:40:42.220 INFO:tasks.workunit.client.0.smithi033.stdout:1/126: fsync d1/f7 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:2/181: dread d1/f2 [0,4194304] 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:2/182: fdatasync d1/d16/f22 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:2/183: creat d1/d8/d2b/d2f/d24/f39 x:0 0 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:2/184: chown d1/cd 3422778 1 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:2/185: write d1/d16/f1a [661789,29578] 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:9/59: dread f1 [0,4194304] 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:9/60: stat f2 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:2/186: write d1/d8/f19 [1666342,86768] 0 2024-02-15T22:40:42.223 INFO:tasks.workunit.client.0.smithi033.stdout:7/132: rmdir d5/d6/d10/d16/d20 0 2024-02-15T22:40:42.226 INFO:tasks.workunit.client.0.smithi033.stdout:0/111: symlink db/d1c/l20 0 2024-02-15T22:40:42.232 INFO:tasks.workunit.client.0.smithi033.stdout:8/92: write d1/f8 [918265,80652] 0 2024-02-15T22:40:42.232 INFO:tasks.workunit.client.0.smithi033.stdout:9/61: dread d4/f9 [0,4194304] 0 2024-02-15T22:40:42.237 INFO:tasks.workunit.client.0.smithi033.stdout:0/112: dread f0 [4194304,4194304] 0 2024-02-15T22:40:42.241 INFO:tasks.workunit.client.0.smithi033.stdout:3/75: read d0/d3/f17 [255155,120845] 0 2024-02-15T22:40:42.241 INFO:tasks.workunit.client.0.smithi033.stdout:3/76: chown d0/d8/c1b 29888 1 2024-02-15T22:40:42.241 INFO:tasks.workunit.client.0.smithi033.stdout:3/77: chown d0/d3/dd/f18 7 1 2024-02-15T22:40:42.241 INFO:tasks.workunit.client.0.smithi033.stdout:3/78: creat d0/f1f x:0 0 0 2024-02-15T22:40:42.241 INFO:tasks.workunit.client.0.smithi033.stdout:3/79: chown d0/f13 1071822016 1 2024-02-15T22:40:42.245 INFO:tasks.workunit.client.0.smithi033.stdout:2/187: dwrite d1/d8/d2b/d2f/d24/d31/f33 [0,4194304] 0 2024-02-15T22:40:42.253 INFO:tasks.workunit.client.0.smithi033.stdout:7/133: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:42.253 INFO:tasks.workunit.client.0.smithi033.stdout:7/134: read f4 [303126,42215] 0 2024-02-15T22:40:42.253 INFO:tasks.workunit.client.0.smithi033.stdout:1/127: link d1/fa d1/d20/f24 0 2024-02-15T22:40:42.255 INFO:tasks.workunit.client.0.smithi033.stdout:7/135: dread f4 [0,4194304] 0 2024-02-15T22:40:42.255 INFO:tasks.workunit.client.0.smithi033.stdout:7/136: creat d5/dc/f2e x:0 0 0 2024-02-15T22:40:42.258 INFO:tasks.workunit.client.0.smithi033.stdout:8/93: unlink d1/df/f23 0 2024-02-15T22:40:42.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/62: creat d4/f14 x:0 0 0 2024-02-15T22:40:42.261 INFO:tasks.workunit.client.0.smithi033.stdout:0/113: stat db/f18 0 2024-02-15T22:40:42.264 INFO:tasks.workunit.client.0.smithi033.stdout:9/63: dread d4/fc [0,4194304] 0 2024-02-15T22:40:42.264 INFO:tasks.workunit.client.0.smithi033.stdout:9/64: truncate d4/ff 260813 0 2024-02-15T22:40:42.264 INFO:tasks.workunit.client.0.smithi033.stdout:9/65: chown d4/f11 0 1 2024-02-15T22:40:42.265 INFO:tasks.workunit.client.0.smithi033.stdout:3/80: truncate d0/fe 2251726 0 2024-02-15T22:40:42.265 INFO:tasks.workunit.client.0.smithi033.stdout:3/81: chown d0/c6 18924 1 2024-02-15T22:40:42.272 INFO:tasks.workunit.client.0.smithi033.stdout:7/137: dwrite d5/d6/fa [4194304,4194304] 0 2024-02-15T22:40:42.273 INFO:tasks.workunit.client.0.smithi033.stdout:7/138: chown l2 18485 1 2024-02-15T22:40:42.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/128: truncate d1/de/f16 4035964 0 2024-02-15T22:40:42.281 INFO:tasks.workunit.client.0.smithi033.stdout:9/66: dwrite d4/f9 [4194304,4194304] 0 2024-02-15T22:40:42.283 INFO:tasks.workunit.client.0.smithi033.stdout:7/139: write d5/d6/fa [280494,95374] 0 2024-02-15T22:40:42.283 INFO:tasks.workunit.client.0.smithi033.stdout:7/140: truncate d5/f15 1739949 0 2024-02-15T22:40:42.283 INFO:tasks.workunit.client.0.smithi033.stdout:8/94: symlink d1/d6/d17/l25 0 2024-02-15T22:40:42.284 INFO:tasks.workunit.client.0.smithi033.stdout:1/129: write d1/f1c [4724154,26152] 0 2024-02-15T22:40:42.285 INFO:tasks.workunit.client.0.smithi033.stdout:0/114: truncate db/fe 362369 0 2024-02-15T22:40:42.288 INFO:tasks.workunit.client.0.smithi033.stdout:3/82: unlink d0/d3/f9 0 2024-02-15T22:40:42.295 INFO:tasks.workunit.client.0.smithi033.stdout:0/115: dread f4 [0,4194304] 0 2024-02-15T22:40:42.295 INFO:tasks.workunit.client.0.smithi033.stdout:0/116: dread - db/d19/f1a zero size 2024-02-15T22:40:42.296 INFO:tasks.workunit.client.0.smithi033.stdout:7/141: truncate f4 418269 0 2024-02-15T22:40:42.300 INFO:tasks.workunit.client.0.smithi033.stdout:8/95: dwrite d1/f10 [0,4194304] 0 2024-02-15T22:40:42.304 INFO:tasks.workunit.client.0.smithi033.stdout:9/67: link f1 d4/f15 0 2024-02-15T22:40:42.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/142: link d5/d6/d10/d16/f21 d5/df/d2c/f2f 0 2024-02-15T22:40:42.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/143: creat d5/f30 x:0 0 0 2024-02-15T22:40:42.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/144: creat d5/f31 x:0 0 0 2024-02-15T22:40:42.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/145: stat d5/dc/ce 0 2024-02-15T22:40:42.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/146: write d5/d6/d10/d16/d26/f2a [655500,38636] 0 2024-02-15T22:40:42.317 INFO:tasks.workunit.client.0.smithi033.stdout:4/91: truncate f7 667992 0 2024-02-15T22:40:42.319 INFO:tasks.workunit.client.0.smithi033.stdout:8/96: symlink d1/de/d1a/l26 0 2024-02-15T22:40:42.319 INFO:tasks.workunit.client.0.smithi033.stdout:8/97: chown d1/f10 17159901 1 2024-02-15T22:40:42.320 INFO:tasks.workunit.client.0.smithi033.stdout:0/117: dwrite db/f11 [0,4194304] 0 2024-02-15T22:40:42.322 INFO:tasks.workunit.client.0.smithi033.stdout:9/68: unlink f3 0 2024-02-15T22:40:42.322 INFO:tasks.workunit.client.0.smithi033.stdout:9/69: dread - d4/fd zero size 2024-02-15T22:40:42.332 INFO:tasks.workunit.client.0.smithi033.stdout:4/92: mkdir d8/d16/d19/d1c 0 2024-02-15T22:40:42.332 INFO:tasks.workunit.client.0.smithi033.stdout:4/93: fdatasync d8/ff 0 2024-02-15T22:40:42.333 INFO:tasks.workunit.client.0.smithi033.stdout:8/98: mkdir d1/de/d1a/d27 0 2024-02-15T22:40:42.341 INFO:tasks.workunit.client.0.smithi033.stdout:8/99: dread d1/f10 [0,4194304] 0 2024-02-15T22:40:42.345 INFO:tasks.workunit.client.0.smithi033.stdout:4/94: symlink d8/d18/l1d 0 2024-02-15T22:40:42.345 INFO:tasks.workunit.client.0.smithi033.stdout:4/95: chown d8/d13/c14 3893 1 2024-02-15T22:40:42.345 INFO:tasks.workunit.client.0.smithi033.stdout:4/96: chown d8/ff 1206 1 2024-02-15T22:40:42.348 INFO:tasks.workunit.client.0.smithi033.stdout:8/100: mknod d1/df/c28 0 2024-02-15T22:40:42.348 INFO:tasks.workunit.client.0.smithi033.stdout:8/101: readlink d1/d6/d17/l25 0 2024-02-15T22:40:42.350 INFO:tasks.workunit.client.0.smithi033.stdout:9/70: rename d4/f14 to d4/f16 0 2024-02-15T22:40:42.352 INFO:tasks.workunit.client.0.smithi033.stdout:4/97: symlink d8/d18/l1e 0 2024-02-15T22:40:42.353 INFO:tasks.workunit.client.0.smithi033.stdout:8/102: creat d1/de/d13/f29 x:0 0 0 2024-02-15T22:40:42.354 INFO:tasks.workunit.client.0.smithi033.stdout:8/103: read - d1/de/f1c zero size 2024-02-15T22:40:42.354 INFO:tasks.workunit.client.0.smithi033.stdout:4/98: dread f4 [0,4194304] 0 2024-02-15T22:40:42.359 INFO:tasks.workunit.client.0.smithi033.stdout:9/71: unlink f1 0 2024-02-15T22:40:42.360 INFO:tasks.workunit.client.0.smithi033.stdout:8/104: mkdir d1/de/d1a/d2a 0 2024-02-15T22:40:42.362 INFO:tasks.workunit.client.0.smithi033.stdout:4/99: dread d8/fd [0,4194304] 0 2024-02-15T22:40:42.365 INFO:tasks.workunit.client.0.smithi033.stdout:8/105: unlink d1/cb 0 2024-02-15T22:40:42.366 INFO:tasks.workunit.client.0.smithi033.stdout:4/100: dread f5 [0,4194304] 0 2024-02-15T22:40:42.367 INFO:tasks.workunit.client.0.smithi033.stdout:9/72: symlink d4/l17 0 2024-02-15T22:40:42.369 INFO:tasks.workunit.client.0.smithi033.stdout:8/106: rmdir d1/d6/d17 39 2024-02-15T22:40:42.370 INFO:tasks.workunit.client.0.smithi033.stdout:1/130: getdents d1/d20 0 2024-02-15T22:40:42.372 INFO:tasks.workunit.client.0.smithi033.stdout:4/101: mkdir d8/d1f 0 2024-02-15T22:40:42.376 INFO:tasks.workunit.client.0.smithi033.stdout:8/107: stat d1/d6/cd 0 2024-02-15T22:40:42.376 INFO:tasks.workunit.client.0.smithi033.stdout:8/108: truncate d1/f10 4460014 0 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:1/131: rmdir d1/d1d 39 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:1/132: truncate d1/f6 1102187 0 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:1/133: fdatasync d1/de/f13 0 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:1/134: fdatasync d1/de/f13 0 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:3/83: fsync d0/f1f 0 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:3/84: write d0/f13 [631383,15653] 0 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:3/85: fsync d0/d3/dd/f18 0 2024-02-15T22:40:42.380 INFO:tasks.workunit.client.0.smithi033.stdout:3/86: dread - d0/d3/dd/f18 zero size 2024-02-15T22:40:42.381 INFO:tasks.workunit.client.0.smithi033.stdout:3/87: write d0/d3/dd/f18 [23022,19283] 0 2024-02-15T22:40:42.381 INFO:tasks.workunit.client.0.smithi033.stdout:8/109: dread d1/f8 [0,4194304] 0 2024-02-15T22:40:42.381 INFO:tasks.workunit.client.0.smithi033.stdout:8/110: chown d1/d6 860984452 1 2024-02-15T22:40:42.381 INFO:tasks.workunit.client.0.smithi033.stdout:4/102: symlink d8/d1a/l20 0 2024-02-15T22:40:42.388 INFO:tasks.workunit.client.0.smithi033.stdout:1/135: mkdir d1/d1d/d25 0 2024-02-15T22:40:42.391 INFO:tasks.workunit.client.0.smithi033.stdout:3/88: truncate d0/f7 865517 0 2024-02-15T22:40:42.392 INFO:tasks.workunit.client.0.smithi033.stdout:3/89: dread d0/d3/dd/f18 [0,4194304] 0 2024-02-15T22:40:42.392 INFO:tasks.workunit.client.0.smithi033.stdout:3/90: fdatasync d0/f7 0 2024-02-15T22:40:42.393 INFO:tasks.workunit.client.0.smithi033.stdout:1/136: dread d1/f8 [0,4194304] 0 2024-02-15T22:40:42.398 INFO:tasks.workunit.client.0.smithi033.stdout:1/137: read d1/fa [1777561,52578] 0 2024-02-15T22:40:42.399 INFO:tasks.workunit.client.0.smithi033.stdout:3/91: mkdir d0/d3/d20 0 2024-02-15T22:40:42.402 INFO:tasks.workunit.client.0.smithi033.stdout:1/138: symlink d1/d1d/l26 0 2024-02-15T22:40:42.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/147: getdents d5/dc 0 2024-02-15T22:40:42.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/148: chown d5/f30 91680835 1 2024-02-15T22:40:42.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/92: getdents d0/d8 0 2024-02-15T22:40:42.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/93: write d0/d3/dd/f18 [125084,100705] 0 2024-02-15T22:40:42.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/94: readlink d0/d3/l10 0 2024-02-15T22:40:42.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/95: truncate d0/f16 532691 0 2024-02-15T22:40:42.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/96: fsync d0/f13 0 2024-02-15T22:40:42.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/97: creat d0/d3/f21 x:0 0 0 2024-02-15T22:40:42.409 INFO:tasks.workunit.client.0.smithi033.stdout:1/139: mkdir d1/de/d27 0 2024-02-15T22:40:42.409 INFO:tasks.workunit.client.0.smithi033.stdout:1/140: write d1/d20/f24 [1079551,103628] 0 2024-02-15T22:40:42.411 INFO:tasks.workunit.client.0.smithi033.stdout:7/149: symlink d5/dc/l32 0 2024-02-15T22:40:42.416 INFO:tasks.workunit.client.0.smithi033.stdout:3/98: unlink d0/f1e 0 2024-02-15T22:40:42.419 INFO:tasks.workunit.client.0.smithi033.stdout:0/118: rename db/fe to db/d19/f21 0 2024-02-15T22:40:42.419 INFO:tasks.workunit.client.0.smithi033.stdout:8/111: rename d1/de/d1a/d2a to d1/de/d1a/d2a/d2b 22 2024-02-15T22:40:42.421 INFO:tasks.workunit.client.0.smithi033.stdout:1/141: mkdir d1/de/d27/d28 0 2024-02-15T22:40:42.426 INFO:tasks.workunit.client.0.smithi033.stdout:3/99: read d0/f19 [2321124,107408] 0 2024-02-15T22:40:42.429 INFO:tasks.workunit.client.0.smithi033.stdout:1/142: creat d1/de/d27/d28/f29 x:0 0 0 2024-02-15T22:40:42.429 INFO:tasks.workunit.client.0.smithi033.stdout:1/143: creat d1/de/d27/d28/f2a x:0 0 0 2024-02-15T22:40:42.429 INFO:tasks.workunit.client.0.smithi033.stdout:1/144: write d1/f1c [5830746,70800] 0 2024-02-15T22:40:42.431 INFO:tasks.workunit.client.0.smithi033.stdout:7/150: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:42.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/112: write d1/df/d1d/f24 [3982414,111680] 0 2024-02-15T22:40:42.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/113: fdatasync d1/de/f22 0 2024-02-15T22:40:42.435 INFO:tasks.workunit.client.0.smithi033.stdout:3/100: rmdir d0/d3/d20 0 2024-02-15T22:40:42.435 INFO:tasks.workunit.client.0.smithi033.stdout:3/101: fsync d0/f16 0 2024-02-15T22:40:42.435 INFO:tasks.workunit.client.0.smithi033.stdout:3/102: creat d0/d3/f22 x:0 0 0 2024-02-15T22:40:42.437 INFO:tasks.workunit.client.0.smithi033.stdout:6/145: sync 2024-02-15T22:40:42.437 INFO:tasks.workunit.client.0.smithi033.stdout:5/228: sync 2024-02-15T22:40:42.442 INFO:tasks.workunit.client.0.smithi033.stdout:5/229: write d6/d14/f2e [4117436,96097] 0 2024-02-15T22:40:42.443 INFO:tasks.workunit.client.0.smithi033.stdout:5/230: chown d6/d14/f2e 130012 1 2024-02-15T22:40:42.443 INFO:tasks.workunit.client.0.smithi033.stdout:1/145: mknod d1/c2b 0 2024-02-15T22:40:42.448 INFO:tasks.workunit.client.0.smithi033.stdout:8/114: mknod d1/df/d1d/c2c 0 2024-02-15T22:40:42.448 INFO:tasks.workunit.client.0.smithi033.stdout:8/115: chown d1/de/d1a 7958937 1 2024-02-15T22:40:42.450 INFO:tasks.workunit.client.0.smithi033.stdout:0/119: rename db/l14 to db/l22 0 2024-02-15T22:40:42.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/103: dwrite d0/d3/f21 [0,4194304] 0 2024-02-15T22:40:42.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/104: write d0/fe [3095892,65092] 0 2024-02-15T22:40:42.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/105: creat d0/d3/dd/f23 x:0 0 0 2024-02-15T22:40:42.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/106: write d0/f1f [101117,99023] 0 2024-02-15T22:40:42.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/107: chown d0/d8/la 7 1 2024-02-15T22:40:42.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/108: fdatasync d0/d3/dd/f18 0 2024-02-15T22:40:42.456 INFO:tasks.workunit.client.0.smithi033.stdout:6/146: mkdir d12/d2c 0 2024-02-15T22:40:42.460 INFO:tasks.workunit.client.0.smithi033.stdout:5/231: mknod d6/d14/d31/d48/c4d 0 2024-02-15T22:40:42.460 INFO:tasks.workunit.client.0.smithi033.stdout:5/232: truncate d6/d14/f20 747976 0 2024-02-15T22:40:42.460 INFO:tasks.workunit.client.0.smithi033.stdout:5/233: dread d6/d14/f20 [0,4194304] 0 2024-02-15T22:40:42.461 INFO:tasks.workunit.client.0.smithi033.stdout:5/234: chown d6/c26 24820697 1 2024-02-15T22:40:42.461 INFO:tasks.workunit.client.0.smithi033.stdout:5/235: getdents d6/d14/d31/d48/d49 0 2024-02-15T22:40:42.463 INFO:tasks.workunit.client.0.smithi033.stdout:1/146: mkdir d1/d1d/d2c 0 2024-02-15T22:40:42.465 INFO:tasks.workunit.client.0.smithi033.stdout:8/116: symlink d1/l2d 0 2024-02-15T22:40:42.472 INFO:tasks.workunit.client.0.smithi033.stdout:0/120: dwrite f0 [4194304,4194304] 0 2024-02-15T22:40:42.472 INFO:tasks.workunit.client.0.smithi033.stdout:0/121: chown fa 0 1 2024-02-15T22:40:42.473 INFO:tasks.workunit.client.0.smithi033.stdout:5/236: write d6/ff [2253522,128930] 0 2024-02-15T22:40:42.474 INFO:tasks.workunit.client.0.smithi033.stdout:1/147: dread d1/de/f13 [0,4194304] 0 2024-02-15T22:40:42.478 INFO:tasks.workunit.client.0.smithi033.stdout:3/109: unlink d0/l11 0 2024-02-15T22:40:42.478 INFO:tasks.workunit.client.0.smithi033.stdout:3/110: write d0/f16 [161019,125802] 0 2024-02-15T22:40:42.486 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:42 smithi033 ceph-mon[29033]: Deploying cephadm binary to smithi082 2024-02-15T22:40:42.486 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:42 smithi033 ceph-mon[29033]: Deploying cephadm binary to smithi033 2024-02-15T22:40:42.486 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:42 smithi033 ceph-mon[29033]: mgrmap e22: smithi082.mjhlse(active, since 1.01811s) 2024-02-15T22:40:42.486 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:42 smithi033 ceph-mon[29033]: pgmap v3: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:42.490 INFO:tasks.workunit.client.0.smithi033.stdout:9/73: getdents d4 0 2024-02-15T22:40:42.493 INFO:tasks.workunit.client.0.smithi033.stdout:3/111: dwrite d0/f1f [0,4194304] 0 2024-02-15T22:40:42.493 INFO:tasks.workunit.client.0.smithi033.stdout:6/147: stat l0 0 2024-02-15T22:40:42.499 INFO:tasks.workunit.client.0.smithi033.stdout:8/117: rename d1/d6/d17 to d1/df/d2e 0 2024-02-15T22:40:42.504 INFO:tasks.workunit.client.0.smithi033.stdout:1/148: mkdir d1/de/d27/d28/d2d 0 2024-02-15T22:40:42.512 INFO:tasks.workunit.client.0.smithi033.stdout:9/74: link d4/f8 d4/f18 0 2024-02-15T22:40:42.514 INFO:tasks.workunit.client.0.smithi033.stdout:3/112: dwrite d0/fe [0,4194304] 0 2024-02-15T22:40:42.514 INFO:tasks.workunit.client.0.smithi033.stdout:3/113: write d0/d3/dd/f23 [172149,44343] 0 2024-02-15T22:40:42.514 INFO:tasks.workunit.client.0.smithi033.stdout:3/114: creat d0/f24 x:0 0 0 2024-02-15T22:40:42.514 INFO:tasks.workunit.client.0.smithi033.stdout:6/148: dwrite d12/f13 [0,4194304] 0 2024-02-15T22:40:42.514 INFO:tasks.workunit.client.0.smithi033.stdout:3/115: chown d0/d3/l10 4030 1 2024-02-15T22:40:42.515 INFO:tasks.workunit.client.0.smithi033.stdout:6/149: stat ff 0 2024-02-15T22:40:42.516 INFO:tasks.workunit.client.0.smithi033.stdout:8/118: rename d1/d6/d14/c15 to d1/de/c2f 0 2024-02-15T22:40:42.519 INFO:tasks.workunit.client.0.smithi033.stdout:1/149: symlink d1/d1d/l2e 0 2024-02-15T22:40:42.521 INFO:tasks.workunit.client.0.smithi033.stdout:9/75: creat d4/f19 x:0 0 0 2024-02-15T22:40:42.524 INFO:tasks.workunit.client.0.smithi033.stdout:7/151: getdents d5/dc 0 2024-02-15T22:40:42.529 INFO:tasks.workunit.client.0.smithi033.stdout:1/150: dread d1/f1c [0,4194304] 0 2024-02-15T22:40:42.532 INFO:tasks.workunit.client.0.smithi033.stdout:0/122: getdents db/d19 0 2024-02-15T22:40:42.537 INFO:tasks.workunit.client.0.smithi033.stdout:3/116: creat d0/d1c/f25 x:0 0 0 2024-02-15T22:40:42.537 INFO:tasks.workunit.client.0.smithi033.stdout:3/117: write d0/f13 [718017,111371] 0 2024-02-15T22:40:42.539 INFO:tasks.workunit.client.0.smithi033.stdout:6/150: mknod d12/c2d 0 2024-02-15T22:40:42.542 INFO:tasks.workunit.client.0.smithi033.stdout:8/119: rename d1/de/f22 to d1/de/d1a/d2a/f30 0 2024-02-15T22:40:42.542 INFO:tasks.workunit.client.0.smithi033.stdout:3/118: rename d0/d3 to d0/d3/d26 22 2024-02-15T22:40:42.542 INFO:tasks.workunit.client.0.smithi033.stdout:3/119: chown d0/f16 251 1 2024-02-15T22:40:42.546 INFO:tasks.workunit.client.0.smithi033.stdout:9/76: chown d4/fc 105093 1 2024-02-15T22:40:42.547 INFO:tasks.workunit.client.0.smithi033.stdout:7/152: symlink d5/df/d2c/l33 0 2024-02-15T22:40:42.550 INFO:tasks.workunit.client.0.smithi033.stdout:1/151: creat d1/d1d/f2f x:0 0 0 2024-02-15T22:40:42.551 INFO:tasks.workunit.client.0.smithi033.stdout:0/123: creat db/d1c/f23 x:0 0 0 2024-02-15T22:40:42.553 INFO:tasks.workunit.client.0.smithi033.stdout:8/120: dwrite d1/de/d13/f29 [0,4194304] 0 2024-02-15T22:40:42.553 INFO:tasks.workunit.client.0.smithi033.stdout:8/121: write d1/de/f1c [1010661,118884] 0 2024-02-15T22:40:42.555 INFO:tasks.workunit.client.0.smithi033.stdout:6/151: mkdir d12/d14/d1d/d2e 0 2024-02-15T22:40:42.555 INFO:tasks.workunit.client.0.smithi033.stdout:6/152: fdatasync d12/d14/d1d/f22 0 2024-02-15T22:40:42.555 INFO:tasks.workunit.client.0.smithi033.stdout:6/153: read - d12/f28 zero size 2024-02-15T22:40:42.555 INFO:tasks.workunit.client.0.smithi033.stdout:6/154: creat d12/d14/d19/f2f x:0 0 0 2024-02-15T22:40:42.556 INFO:tasks.workunit.client.0.smithi033.stdout:7/153: write d5/f18 [3088424,7581] 0 2024-02-15T22:40:42.562 INFO:tasks.workunit.client.0.smithi033.stdout:9/77: chown d4/l17 16770356 1 2024-02-15T22:40:42.564 INFO:tasks.workunit.client.0.smithi033.stdout:0/124: write db/f11 [1681822,68252] 0 2024-02-15T22:40:42.566 INFO:tasks.workunit.client.0.smithi033.stdout:1/152: mkdir d1/d1d/d2c/d30 0 2024-02-15T22:40:42.573 INFO:tasks.workunit.client.0.smithi033.stdout:8/122: rename d1/f8 to d1/de/f31 0 2024-02-15T22:40:42.578 INFO:tasks.workunit.client.0.smithi033.stdout:6/155: dwrite d12/f18 [4194304,4194304] 0 2024-02-15T22:40:42.580 INFO:tasks.workunit.client.0.smithi033.stdout:8/123: dread d1/df/d1d/f24 [0,4194304] 0 2024-02-15T22:40:42.580 INFO:tasks.workunit.client.0.smithi033.stdout:7/154: dwrite d5/f31 [0,4194304] 0 2024-02-15T22:40:42.581 INFO:tasks.workunit.client.0.smithi033.stdout:9/78: stat d4/f11 0 2024-02-15T22:40:42.586 INFO:tasks.workunit.client.0.smithi033.stdout:0/125: mknod db/d1c/c24 0 2024-02-15T22:40:42.593 INFO:tasks.workunit.client.0.smithi033.stdout:3/120: rmdir d0/d3/dd 39 2024-02-15T22:40:42.602 INFO:tasks.workunit.client.0.smithi033.stdout:7/155: creat d5/d6/d10/f34 x:0 0 0 2024-02-15T22:40:42.613 INFO:tasks.workunit.client.0.smithi033.stdout:3/121: symlink d0/d8/l27 0 2024-02-15T22:40:42.615 INFO:tasks.workunit.client.0.smithi033.stdout:3/122: dread d0/d3/dd/f23 [0,4194304] 0 2024-02-15T22:40:42.615 INFO:tasks.workunit.client.0.smithi033.stdout:3/123: fsync d0/d3/dd/f23 0 2024-02-15T22:40:42.615 INFO:tasks.workunit.client.0.smithi033.stdout:3/124: fdatasync d0/f19 0 2024-02-15T22:40:42.615 INFO:tasks.workunit.client.0.smithi033.stdout:8/124: getdents d1/df 0 2024-02-15T22:40:42.620 INFO:tasks.workunit.client.0.smithi033.stdout:7/156: symlink d5/d6/d10/d16/d26/l35 0 2024-02-15T22:40:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:42 smithi082 ceph-mon[37153]: Deploying cephadm binary to smithi082 2024-02-15T22:40:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:42 smithi082 ceph-mon[37153]: Deploying cephadm binary to smithi033 2024-02-15T22:40:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:42 smithi082 ceph-mon[37153]: mgrmap e22: smithi082.mjhlse(active, since 1.01811s) 2024-02-15T22:40:42.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:42 smithi082 ceph-mon[37153]: pgmap v3: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:42.628 INFO:tasks.workunit.client.0.smithi033.stdout:8/125: dwrite d1/de/f1c [0,4194304] 0 2024-02-15T22:40:42.629 INFO:tasks.workunit.client.0.smithi033.stdout:0/126: symlink db/l25 0 2024-02-15T22:40:42.631 INFO:tasks.workunit.client.0.smithi033.stdout:7/157: rmdir d5/dc 39 2024-02-15T22:40:42.634 INFO:tasks.workunit.client.0.smithi033.stdout:9/79: rename d4/f11 to d4/f1a 0 2024-02-15T22:40:42.634 INFO:tasks.workunit.client.0.smithi033.stdout:0/127: rmdir db/d19 39 2024-02-15T22:40:42.637 INFO:tasks.workunit.client.0.smithi033.stdout:7/158: stat c3 0 2024-02-15T22:40:42.638 INFO:tasks.workunit.client.0.smithi033.stdout:9/80: dread - d4/fd zero size 2024-02-15T22:40:42.638 INFO:tasks.workunit.client.0.smithi033.stdout:2/188: sync 2024-02-15T22:40:42.642 INFO:tasks.workunit.client.0.smithi033.stdout:7/159: mkdir d5/d36 0 2024-02-15T22:40:42.644 INFO:tasks.workunit.client.0.smithi033.stdout:2/189: rmdir d1/d8/d2b 39 2024-02-15T22:40:42.647 INFO:tasks.workunit.client.0.smithi033.stdout:9/81: dread f2 [0,4194304] 0 2024-02-15T22:40:42.647 INFO:tasks.workunit.client.0.smithi033.stdout:0/128: link db/lf db/d1c/l26 0 2024-02-15T22:40:42.649 INFO:tasks.workunit.client.0.smithi033.stdout:7/160: getdents d5/df 0 2024-02-15T22:40:42.649 INFO:tasks.workunit.client.0.smithi033.stdout:7/161: write d5/df/d2c/f2f [258809,63985] 0 2024-02-15T22:40:42.651 INFO:tasks.workunit.client.0.smithi033.stdout:7/162: dread f4 [0,4194304] 0 2024-02-15T22:40:42.652 INFO:tasks.workunit.client.0.smithi033.stdout:8/126: dwrite d1/d6/d14/f1b [0,4194304] 0 2024-02-15T22:40:42.654 INFO:tasks.workunit.client.0.smithi033.stdout:2/190: symlink d1/d8/d2b/d2f/d24/d2a/l3a 0 2024-02-15T22:40:42.656 INFO:tasks.workunit.client.0.smithi033.stdout:9/82: truncate d4/ff 1187673 0 2024-02-15T22:40:42.656 INFO:tasks.workunit.client.0.smithi033.stdout:9/83: dread - d4/f18 zero size 2024-02-15T22:40:42.656 INFO:tasks.workunit.client.0.smithi033.stdout:9/84: fdatasync f2 0 2024-02-15T22:40:42.656 INFO:tasks.workunit.client.0.smithi033.stdout:9/85: fdatasync d4/ff 0 2024-02-15T22:40:42.656 INFO:tasks.workunit.client.0.smithi033.stdout:9/86: fsync d4/f18 0 2024-02-15T22:40:42.657 INFO:tasks.workunit.client.0.smithi033.stdout:0/129: truncate f4 1802704 0 2024-02-15T22:40:42.664 INFO:tasks.workunit.client.0.smithi033.stdout:8/127: truncate d1/de/f31 3733864 0 2024-02-15T22:40:42.668 INFO:tasks.workunit.client.0.smithi033.stdout:7/163: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:42.670 INFO:tasks.workunit.client.0.smithi033.stdout:7/164: fsync d5/d6/d10/d16/f21 0 2024-02-15T22:40:42.670 INFO:tasks.workunit.client.0.smithi033.stdout:7/165: write d5/df/d2c/f2f [1016273,97031] 0 2024-02-15T22:40:42.671 INFO:tasks.workunit.client.0.smithi033.stdout:7/166: write d5/f19 [1039270,9065] 0 2024-02-15T22:40:42.675 INFO:tasks.workunit.client.0.smithi033.stdout:9/87: mknod d4/c1b 0 2024-02-15T22:40:42.678 INFO:tasks.workunit.client.0.smithi033.stdout:7/167: symlink d5/d6/d10/d16/d26/l37 0 2024-02-15T22:40:42.680 INFO:tasks.workunit.client.0.smithi033.stdout:6/156: rename d12/d14 to d12/d2c/d30 0 2024-02-15T22:40:42.680 INFO:tasks.workunit.client.0.smithi033.stdout:8/128: rename d1/de/d1a/d2a to d1/de/d1a/d2a/d32 22 2024-02-15T22:40:42.680 INFO:tasks.workunit.client.0.smithi033.stdout:8/129: chown d1/de/d1a/l1e 2582 1 2024-02-15T22:40:42.683 INFO:tasks.workunit.client.0.smithi033.stdout:7/168: creat d5/d6/f38 x:0 0 0 2024-02-15T22:40:42.683 INFO:tasks.workunit.client.0.smithi033.stdout:7/169: creat d5/d6/f39 x:0 0 0 2024-02-15T22:40:42.684 INFO:tasks.workunit.client.0.smithi033.stdout:8/130: creat d1/f33 x:0 0 0 2024-02-15T22:40:42.684 INFO:tasks.workunit.client.0.smithi033.stdout:6/157: dread f5 [0,4194304] 0 2024-02-15T22:40:42.685 INFO:tasks.workunit.client.0.smithi033.stdout:9/88: mknod d4/c1c 0 2024-02-15T22:40:42.688 INFO:tasks.workunit.client.0.smithi033.stdout:7/170: symlink d5/d6/d10/d16/l3a 0 2024-02-15T22:40:42.689 INFO:tasks.workunit.client.0.smithi033.stdout:8/131: mknod d1/de/d1a/c34 0 2024-02-15T22:40:42.691 INFO:tasks.workunit.client.0.smithi033.stdout:6/158: creat d12/d2c/d30/f31 x:0 0 0 2024-02-15T22:40:42.692 INFO:tasks.workunit.client.0.smithi033.stdout:9/89: write d4/fe [244573,78515] 0 2024-02-15T22:40:42.694 INFO:tasks.workunit.client.0.smithi033.stdout:7/171: link d5/d6/d10/l25 d5/d36/l3b 0 2024-02-15T22:40:42.695 INFO:tasks.workunit.client.0.smithi033.stdout:6/159: mknod d12/d2c/d30/d1d/c32 0 2024-02-15T22:40:42.695 INFO:tasks.workunit.client.0.smithi033.stdout:6/160: read - d12/d2c/d30/f1f zero size 2024-02-15T22:40:42.697 INFO:tasks.workunit.client.0.smithi033.stdout:0/130: getdents db 0 2024-02-15T22:40:42.697 INFO:tasks.workunit.client.0.smithi033.stdout:0/131: chown f6 24746 1 2024-02-15T22:40:42.700 INFO:tasks.workunit.client.0.smithi033.stdout:6/161: truncate ff 2938260 0 2024-02-15T22:40:42.703 INFO:tasks.workunit.client.0.smithi033.stdout:7/172: write d5/f31 [2026637,64605] 0 2024-02-15T22:40:42.703 INFO:tasks.workunit.client.0.smithi033.stdout:7/173: creat d5/d6/d10/d16/d26/f3c x:0 0 0 2024-02-15T22:40:42.703 INFO:tasks.workunit.client.0.smithi033.stdout:7/174: chown d5/d6/l13 380064 1 2024-02-15T22:40:42.707 INFO:tasks.workunit.client.0.smithi033.stdout:2/191: rmdir d1/d8 39 2024-02-15T22:40:42.714 INFO:tasks.workunit.client.0.smithi033.stdout:9/90: mkdir d4/d1d 0 2024-02-15T22:40:42.715 INFO:tasks.workunit.client.0.smithi033.stdout:0/132: symlink db/d19/l27 0 2024-02-15T22:40:42.716 INFO:tasks.workunit.client.0.smithi033.stdout:2/192: write d1/d8/d2b/d2f/d12/f15 [1276722,28598] 0 2024-02-15T22:40:42.717 INFO:tasks.workunit.client.0.smithi033.stdout:2/193: write d1/d8/d2b/d2f/f1e [595610,72500] 0 2024-02-15T22:40:42.718 INFO:tasks.workunit.client.0.smithi033.stdout:6/162: creat d12/d2c/d30/d1d/f33 x:0 0 0 2024-02-15T22:40:42.719 INFO:tasks.workunit.client.0.smithi033.stdout:8/132: write d1/d6/f7 [3108419,126599] 0 2024-02-15T22:40:42.719 INFO:tasks.workunit.client.0.smithi033.stdout:8/133: write d1/d6/f7 [4610642,79761] 0 2024-02-15T22:40:42.719 INFO:tasks.workunit.client.0.smithi033.stdout:8/134: write d1/f33 [375391,23335] 0 2024-02-15T22:40:42.726 INFO:tasks.workunit.client.0.smithi033.stdout:8/135: dread d1/df/d1d/f24 [0,4194304] 0 2024-02-15T22:40:42.726 INFO:tasks.workunit.client.0.smithi033.stdout:7/175: mknod d5/d36/c3d 0 2024-02-15T22:40:42.728 INFO:tasks.workunit.client.0.smithi033.stdout:2/194: dread d1/f7 [16777216,4194304] 0 2024-02-15T22:40:42.728 INFO:tasks.workunit.client.0.smithi033.stdout:2/195: readlink d1/d8/d2b/d2f/d24/d2a/l3a 0 2024-02-15T22:40:42.729 INFO:tasks.workunit.client.0.smithi033.stdout:0/133: symlink db/d1c/l28 0 2024-02-15T22:40:42.730 INFO:tasks.workunit.client.0.smithi033.stdout:7/176: dread d5/f15 [0,4194304] 0 2024-02-15T22:40:42.736 INFO:tasks.workunit.client.0.smithi033.stdout:6/163: rename d12/c17 to d12/c34 0 2024-02-15T22:40:42.739 INFO:tasks.workunit.client.0.smithi033.stdout:8/136: link d1/de/f1c d1/df/d1d/f35 0 2024-02-15T22:40:42.741 INFO:tasks.workunit.client.0.smithi033.stdout:9/91: mknod d4/c1e 0 2024-02-15T22:40:42.744 INFO:tasks.workunit.client.0.smithi033.stdout:2/196: creat d1/d8/d2b/d2f/d13/f3b x:0 0 0 2024-02-15T22:40:42.746 INFO:tasks.workunit.client.0.smithi033.stdout:6/164: write d12/f2b [3225338,65891] 0 2024-02-15T22:40:42.746 INFO:tasks.workunit.client.0.smithi033.stdout:6/165: chown f6 3420865 1 2024-02-15T22:40:42.746 INFO:tasks.workunit.client.0.smithi033.stdout:6/166: read - d12/f29 zero size 2024-02-15T22:40:42.748 INFO:tasks.workunit.client.0.smithi033.stdout:7/177: link d5/d6/d10/l25 d5/d6/d10/d16/l3e 0 2024-02-15T22:40:42.751 INFO:tasks.workunit.client.0.smithi033.stdout:8/137: mkdir d1/d36 0 2024-02-15T22:40:42.754 INFO:tasks.workunit.client.0.smithi033.stdout:2/197: mknod d1/d8/d2b/d2f/d38/c3c 0 2024-02-15T22:40:42.764 INFO:tasks.workunit.client.0.smithi033.stdout:2/198: mkdir d1/d8/d2b/d2f/d3d 0 2024-02-15T22:40:42.771 INFO:tasks.workunit.client.0.smithi033.stdout:4/103: sync 2024-02-15T22:40:42.772 INFO:tasks.workunit.client.0.smithi033.stdout:6/167: dwrite d12/d2c/d30/d19/f2f [0,4194304] 0 2024-02-15T22:40:42.773 INFO:tasks.workunit.client.0.smithi033.stdout:7/178: dwrite d5/d6/f39 [0,4194304] 0 2024-02-15T22:40:42.773 INFO:tasks.workunit.client.0.smithi033.stdout:7/179: chown d5/d6/d10/d16/d26 571852 1 2024-02-15T22:40:42.777 INFO:tasks.workunit.client.0.smithi033.stdout:2/199: write d1/d16/f22 [1428921,8711] 0 2024-02-15T22:40:42.778 INFO:tasks.workunit.client.0.smithi033.stdout:6/168: rename d12/d2c/d30/d1d/d2e to d12/d2c/d30/d1d/d35 0 2024-02-15T22:40:42.779 INFO:tasks.workunit.client.0.smithi033.stdout:2/200: dread d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:42.779 INFO:tasks.workunit.client.0.smithi033.stdout:2/201: fsync d1/d8/d2b/d2f/d12/f15 0 2024-02-15T22:40:42.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/180: mkdir d5/d6/d10/d16/d26/d3f 0 2024-02-15T22:40:42.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/181: readlink d5/d6/d10/d16/d26/l37 0 2024-02-15T22:40:42.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/134: getdents db/d1c 0 2024-02-15T22:40:42.788 INFO:tasks.workunit.client.0.smithi033.stdout:4/104: dwrite f7 [0,4194304] 0 2024-02-15T22:40:42.788 INFO:tasks.workunit.client.0.smithi033.stdout:4/105: getdents d8/d1f 0 2024-02-15T22:40:42.788 INFO:tasks.workunit.client.0.smithi033.stdout:4/106: stat d8/ca 0 2024-02-15T22:40:42.790 INFO:tasks.workunit.client.0.smithi033.stdout:2/202: getdents d1/d8 0 2024-02-15T22:40:42.790 INFO:tasks.workunit.client.0.smithi033.stdout:2/203: truncate d1/d8/d2b/d2f/d24/f39 548256 0 2024-02-15T22:40:42.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/182: mkdir d5/df/d40 0 2024-02-15T22:40:42.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/183: write d5/f19 [1909903,69638] 0 2024-02-15T22:40:42.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/184: truncate d5/d6/d10/f34 473043 0 2024-02-15T22:40:42.794 INFO:tasks.workunit.client.0.smithi033.stdout:0/135: symlink db/l29 0 2024-02-15T22:40:42.796 INFO:tasks.workunit.client.0.smithi033.stdout:8/138: fsync d1/df/d1d/f35 0 2024-02-15T22:40:42.799 INFO:tasks.workunit.client.0.smithi033.stdout:4/107: creat d8/d1f/f21 x:0 0 0 2024-02-15T22:40:42.801 INFO:tasks.workunit.client.0.smithi033.stdout:2/204: link d1/d16/f1a d1/d8/d2b/d2f/d24/d31/f3e 0 2024-02-15T22:40:42.809 INFO:tasks.workunit.client.0.smithi033.stdout:7/185: rename d5/d6/d10/d16/l3a to d5/d6/l41 0 2024-02-15T22:40:42.811 INFO:tasks.workunit.client.0.smithi033.stdout:4/108: truncate f6 1044455 0 2024-02-15T22:40:42.814 INFO:tasks.workunit.client.0.smithi033.stdout:7/186: creat d5/df/d40/f42 x:0 0 0 2024-02-15T22:40:42.814 INFO:tasks.workunit.client.0.smithi033.stdout:7/187: read d5/f18 [2008262,92637] 0 2024-02-15T22:40:42.814 INFO:tasks.workunit.client.0.smithi033.stdout:7/188: creat d5/d6/d10/d16/f43 x:0 0 0 2024-02-15T22:40:42.818 INFO:tasks.workunit.client.0.smithi033.stdout:0/136: dwrite f6 [4194304,4194304] 0 2024-02-15T22:40:42.818 INFO:tasks.workunit.client.0.smithi033.stdout:0/137: write db/d19/f1e [588392,93606] 0 2024-02-15T22:40:42.818 INFO:tasks.workunit.client.0.smithi033.stdout:2/205: dwrite d1/f2 [0,4194304] 0 2024-02-15T22:40:42.823 INFO:tasks.workunit.client.0.smithi033.stdout:2/206: dread d1/d8/fe [4194304,4194304] 0 2024-02-15T22:40:42.907 INFO:tasks.workunit.client.0.smithi033.stdout:4/109: unlink d8/d13/c14 0 2024-02-15T22:40:42.907 INFO:tasks.workunit.client.0.smithi033.stdout:4/110: stat d8/ff 0 2024-02-15T22:40:42.910 INFO:tasks.workunit.client.0.smithi033.stdout:7/189: creat d5/df/f44 x:0 0 0 2024-02-15T22:40:42.910 INFO:tasks.workunit.client.0.smithi033.stdout:7/190: write d5/d6/d10/d16/d26/f3c [425578,54798] 0 2024-02-15T22:40:42.911 INFO:tasks.workunit.client.0.smithi033.stdout:0/138: mkdir db/d2a 0 2024-02-15T22:40:42.911 INFO:tasks.workunit.client.0.smithi033.stdout:0/139: read f0 [338280,124445] 0 2024-02-15T22:40:42.912 INFO:tasks.workunit.client.0.smithi033.stdout:2/207: truncate d1/d8/d2b/d2f/d24/d31/f33 1546044 0 2024-02-15T22:40:42.921 INFO:tasks.workunit.client.0.smithi033.stdout:2/208: read d1/f2 [10365401,112620] 0 2024-02-15T22:40:42.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/191: rmdir d5/dc 39 2024-02-15T22:40:42.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/192: creat d5/df/d40/f45 x:0 0 0 2024-02-15T22:40:42.925 INFO:tasks.workunit.client.0.smithi033.stdout:0/140: creat db/d2a/f2b x:0 0 0 2024-02-15T22:40:42.928 INFO:tasks.workunit.client.0.smithi033.stdout:2/209: mkdir d1/d16/d3f 0 2024-02-15T22:40:42.928 INFO:tasks.workunit.client.0.smithi033.stdout:2/210: dread - d1/d8/d2b/d2f/d13/f3b zero size 2024-02-15T22:40:42.931 INFO:tasks.workunit.client.0.smithi033.stdout:0/141: rmdir db 39 2024-02-15T22:40:42.940 INFO:tasks.workunit.client.0.smithi033.stdout:7/193: dwrite d5/df/d40/f45 [0,4194304] 0 2024-02-15T22:40:42.944 INFO:tasks.workunit.client.0.smithi033.stdout:7/194: mknod d5/d6/d10/d16/d26/d3f/c46 0 2024-02-15T22:40:42.944 INFO:tasks.workunit.client.0.smithi033.stdout:7/195: write d5/d6/d10/d16/f43 [5089,57857] 0 2024-02-15T22:40:42.946 INFO:tasks.workunit.client.0.smithi033.stdout:7/196: mkdir d5/df/d47 0 2024-02-15T22:40:42.947 INFO:tasks.workunit.client.0.smithi033.stdout:7/197: fsync d5/f15 0 2024-02-15T22:40:42.947 INFO:tasks.workunit.client.0.smithi033.stdout:0/142: dwrite f4 [0,4194304] 0 2024-02-15T22:40:42.947 INFO:tasks.workunit.client.0.smithi033.stdout:7/198: read d5/f19 [1602178,92238] 0 2024-02-15T22:40:42.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/111: truncate f6 1399711 0 2024-02-15T22:40:42.950 INFO:tasks.workunit.client.0.smithi033.stdout:0/143: mknod db/d1c/c2c 0 2024-02-15T22:40:42.954 INFO:tasks.workunit.client.0.smithi033.stdout:0/144: rename db/f11 to db/d19/f2d 0 2024-02-15T22:40:42.954 INFO:tasks.workunit.client.0.smithi033.stdout:0/145: write db/d19/f1a [248588,17022] 0 2024-02-15T22:40:42.957 INFO:tasks.workunit.client.0.smithi033.stdout:0/146: mkdir db/d19/d2e 0 2024-02-15T22:40:42.958 INFO:tasks.workunit.client.0.smithi033.stdout:7/199: dread d5/f18 [0,4194304] 0 2024-02-15T22:40:42.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/200: mkdir d5/df/d2c/d48 0 2024-02-15T22:40:42.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/201: getdents d5/df/d2c/d48 0 2024-02-15T22:40:42.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/202: creat d5/d6/d10/d16/f49 x:0 0 0 2024-02-15T22:40:42.967 INFO:tasks.workunit.client.0.smithi033.stdout:5/237: sync 2024-02-15T22:40:42.968 INFO:tasks.workunit.client.0.smithi033.stdout:5/238: stat d6/la 0 2024-02-15T22:40:42.968 INFO:tasks.workunit.client.0.smithi033.stdout:5/239: dread - d6/d14/d31/f37 zero size 2024-02-15T22:40:42.968 INFO:tasks.workunit.client.0.smithi033.stdout:5/240: creat d6/d14/f4e x:0 0 0 2024-02-15T22:40:42.972 INFO:tasks.workunit.client.0.smithi033.stdout:0/147: getdents db/d2a 0 2024-02-15T22:40:42.974 INFO:tasks.workunit.client.0.smithi033.stdout:5/241: write d6/f16 [2849126,11907] 0 2024-02-15T22:40:42.995 INFO:tasks.workunit.client.0.smithi033.stdout:4/112: truncate f6 1055160 0 2024-02-15T22:40:42.997 INFO:tasks.workunit.client.0.smithi033.stdout:0/148: dwrite db/d1c/f23 [0,4194304] 0 2024-02-15T22:40:42.997 INFO:tasks.workunit.client.0.smithi033.stdout:0/149: fsync f4 0 2024-02-15T22:40:42.998 INFO:tasks.workunit.client.0.smithi033.stdout:5/242: dwrite d6/f42 [0,4194304] 0 2024-02-15T22:40:43.002 INFO:tasks.workunit.client.0.smithi033.stdout:0/150: dread db/d19/f1e [0,4194304] 0 2024-02-15T22:40:43.012 INFO:tasks.workunit.client.0.smithi033.stdout:0/151: symlink db/d1c/l2f 0 2024-02-15T22:40:43.015 INFO:tasks.workunit.client.0.smithi033.stdout:0/152: rmdir db/d1c 39 2024-02-15T22:40:43.017 INFO:tasks.workunit.client.0.smithi033.stdout:4/113: dwrite f7 [4194304,4194304] 0 2024-02-15T22:40:43.019 INFO:tasks.workunit.client.0.smithi033.stdout:0/153: mknod db/d1c/c30 0 2024-02-15T22:40:43.021 INFO:tasks.workunit.client.0.smithi033.stdout:7/203: rmdir d5/d6/d10 39 2024-02-15T22:40:43.026 INFO:tasks.workunit.client.0.smithi033.stdout:4/114: write d8/fd [582577,75307] 0 2024-02-15T22:40:43.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/243: dwrite d6/f42 [0,4194304] 0 2024-02-15T22:40:43.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/244: readlink d6/l11 0 2024-02-15T22:40:43.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/245: rename d6/d14 to d6/d14/d31/d3c/d4f 22 2024-02-15T22:40:43.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/246: read - d6/d14/f4e zero size 2024-02-15T22:40:43.029 INFO:tasks.workunit.client.0.smithi033.stdout:0/154: mknod db/d2a/c31 0 2024-02-15T22:40:43.030 INFO:tasks.workunit.client.0.smithi033.stdout:7/204: mkdir d5/df/d40/d4a 0 2024-02-15T22:40:43.031 INFO:tasks.workunit.client.0.smithi033.stdout:5/247: dread d6/ff [0,4194304] 0 2024-02-15T22:40:43.043 INFO:tasks.workunit.client.0.smithi033.stdout:0/155: dwrite db/d19/f21 [0,4194304] 0 2024-02-15T22:40:43.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/205: stat d5/d36/l3b 0 2024-02-15T22:40:43.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/206: readlink d5/d6/d10/l25 0 2024-02-15T22:40:43.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/207: fsync d5/f15 0 2024-02-15T22:40:43.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/208: fdatasync d5/d6/f39 0 2024-02-15T22:40:43.047 INFO:tasks.workunit.client.0.smithi033.stdout:5/248: mkdir d6/d14/d31/d50 0 2024-02-15T22:40:43.048 INFO:tasks.workunit.client.0.smithi033.stdout:5/249: dread d6/d25/f35 [0,4194304] 0 2024-02-15T22:40:43.049 INFO:tasks.workunit.client.0.smithi033.stdout:4/115: getdents d8 0 2024-02-15T22:40:43.050 INFO:tasks.workunit.client.0.smithi033.stdout:4/116: creat d8/d1f/f22 x:0 0 0 2024-02-15T22:40:43.053 INFO:tasks.workunit.client.0.smithi033.stdout:5/250: mknod d6/d14/d31/c51 0 2024-02-15T22:40:43.057 INFO:tasks.workunit.client.0.smithi033.stdout:4/117: dread d8/fd [0,4194304] 0 2024-02-15T22:40:43.057 INFO:tasks.workunit.client.0.smithi033.stdout:4/118: fsync d8/ff 0 2024-02-15T22:40:43.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/119: mkdir d8/d1f/d23 0 2024-02-15T22:40:43.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/120: chown l1 106005 1 2024-02-15T22:40:43.065 INFO:tasks.workunit.client.0.smithi033.stdout:4/121: write d8/fe [924122,126728] 0 2024-02-15T22:40:43.065 INFO:tasks.workunit.client.0.smithi033.stdout:4/122: chown d8/fd 8040464 1 2024-02-15T22:40:43.067 INFO:tasks.workunit.client.0.smithi033.stdout:0/156: rename db/d1c to db/d19/d32 0 2024-02-15T22:40:43.068 INFO:tasks.workunit.client.0.smithi033.stdout:4/123: symlink d8/d1f/d23/l24 0 2024-02-15T22:40:43.070 INFO:tasks.workunit.client.0.smithi033.stdout:7/209: dwrite d5/d6/f39 [0,4194304] 0 2024-02-15T22:40:43.070 INFO:tasks.workunit.client.0.smithi033.stdout:5/251: dwrite d6/d25/f40 [0,4194304] 0 2024-02-15T22:40:43.070 INFO:tasks.workunit.client.0.smithi033.stdout:0/157: creat db/f33 x:0 0 0 2024-02-15T22:40:43.081 INFO:tasks.workunit.client.0.smithi033.stdout:9/92: sync 2024-02-15T22:40:43.081 INFO:tasks.workunit.client.0.smithi033.stdout:3/125: sync 2024-02-15T22:40:43.081 INFO:tasks.workunit.client.0.smithi033.stdout:1/153: sync 2024-02-15T22:40:43.082 INFO:tasks.workunit.client.0.smithi033.stdout:5/252: rename d6/l23 to d6/l52 0 2024-02-15T22:40:43.084 INFO:tasks.workunit.client.0.smithi033.stdout:7/210: dread d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:43.088 INFO:tasks.workunit.client.0.smithi033.stdout:3/126: mknod d0/d3/c28 0 2024-02-15T22:40:43.091 INFO:tasks.workunit.client.0.smithi033.stdout:5/253: mkdir d6/d14/d31/d48/d49/d53 0 2024-02-15T22:40:43.095 INFO:tasks.workunit.client.0.smithi033.stdout:3/127: rmdir d0/d8 39 2024-02-15T22:40:43.095 INFO:tasks.workunit.client.0.smithi033.stdout:3/128: fsync d0/f1f 0 2024-02-15T22:40:43.095 INFO:tasks.workunit.client.0.smithi033.stdout:3/129: chown d0/d3/dd/f18 2787 1 2024-02-15T22:40:43.096 INFO:tasks.workunit.client.0.smithi033.stdout:3/130: chown d0/lc 258784780 1 2024-02-15T22:40:43.104 INFO:tasks.workunit.client.0.smithi033.stdout:5/254: dread d6/d25/f29 [0,4194304] 0 2024-02-15T22:40:43.107 INFO:tasks.workunit.client.0.smithi033.stdout:0/158: dwrite db/d19/f1e [0,4194304] 0 2024-02-15T22:40:43.108 INFO:tasks.workunit.client.0.smithi033.stdout:5/255: creat d6/d14/d31/d3c/f54 x:0 0 0 2024-02-15T22:40:43.113 INFO:tasks.workunit.client.0.smithi033.stdout:0/159: creat db/d19/f34 x:0 0 0 2024-02-15T22:40:43.115 INFO:tasks.workunit.client.0.smithi033.stdout:5/256: truncate d6/d14/f1d 6293278 0 2024-02-15T22:40:43.115 INFO:tasks.workunit.client.0.smithi033.stdout:5/257: creat d6/d25/f55 x:0 0 0 2024-02-15T22:40:43.116 INFO:tasks.workunit.client.0.smithi033.stdout:0/160: symlink db/d19/d32/l35 0 2024-02-15T22:40:43.119 INFO:tasks.workunit.client.0.smithi033.stdout:5/258: mkdir d6/d14/d31/d48/d56 0 2024-02-15T22:40:43.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/124: dwrite d8/fd [0,4194304] 0 2024-02-15T22:40:43.122 INFO:tasks.workunit.client.0.smithi033.stdout:0/161: rename db/d19/d32/c30 to db/d2a/c36 0 2024-02-15T22:40:43.122 INFO:tasks.workunit.client.0.smithi033.stdout:0/162: stat db/d19/d32/c2c 0 2024-02-15T22:40:43.122 INFO:tasks.workunit.client.0.smithi033.stdout:0/163: write db/f33 [203564,106073] 0 2024-02-15T22:40:43.122 INFO:tasks.workunit.client.0.smithi033.stdout:0/164: fdatasync db/f18 0 2024-02-15T22:40:43.123 INFO:tasks.workunit.client.0.smithi033.stdout:5/259: mkdir d6/d14/d31/d48/d49/d53/d57 0 2024-02-15T22:40:43.123 INFO:tasks.workunit.client.0.smithi033.stdout:5/260: fdatasync d6/d25/f29 0 2024-02-15T22:40:43.123 INFO:tasks.workunit.client.0.smithi033.stdout:5/261: write d6/d14/d31/f37 [602704,50226] 0 2024-02-15T22:40:43.125 INFO:tasks.workunit.client.0.smithi033.stdout:4/125: creat d8/d18/f25 x:0 0 0 2024-02-15T22:40:43.126 INFO:tasks.workunit.client.0.smithi033.stdout:4/126: unlink l1 0 2024-02-15T22:40:43.126 INFO:tasks.workunit.client.0.smithi033.stdout:4/127: stat d8/ca 0 2024-02-15T22:40:43.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/128: symlink d8/d13/l26 0 2024-02-15T22:40:43.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/129: write d8/d1f/f22 [270190,50284] 0 2024-02-15T22:40:43.130 INFO:tasks.workunit.client.0.smithi033.stdout:1/154: dwrite d1/f7 [8388608,4194304] 0 2024-02-15T22:40:43.130 INFO:tasks.workunit.client.0.smithi033.stdout:1/155: chown d1/d1d/f2f 940 1 2024-02-15T22:40:43.130 INFO:tasks.workunit.client.0.smithi033.stdout:5/262: write d6/f42 [1627508,59163] 0 2024-02-15T22:40:43.131 INFO:tasks.workunit.client.0.smithi033.stdout:9/93: dwrite d4/ff [0,4194304] 0 2024-02-15T22:40:43.131 INFO:tasks.workunit.client.0.smithi033.stdout:7/211: dwrite d5/d6/d10/d16/d26/f3c [0,4194304] 0 2024-02-15T22:40:43.131 INFO:tasks.workunit.client.0.smithi033.stdout:9/94: readlink d4/l17 0 2024-02-15T22:40:43.133 INFO:tasks.workunit.client.0.smithi033.stdout:3/131: dwrite d0/f24 [0,4194304] 0 2024-02-15T22:40:43.133 INFO:tasks.workunit.client.0.smithi033.stdout:3/132: stat d0/d3 0 2024-02-15T22:40:43.134 INFO:tasks.workunit.client.0.smithi033.stdout:7/212: dread d5/d6/d10/d16/f43 [0,4194304] 0 2024-02-15T22:40:43.134 INFO:tasks.workunit.client.0.smithi033.stdout:0/165: dread db/d19/f1e [0,4194304] 0 2024-02-15T22:40:43.134 INFO:tasks.workunit.client.0.smithi033.stdout:0/166: chown db/d19/d32/f23 5634367 1 2024-02-15T22:40:43.139 INFO:tasks.workunit.client.0.smithi033.stdout:7/213: dread d5/f19 [0,4194304] 0 2024-02-15T22:40:43.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/214: chown d5/d6/d10/d16/d26/l37 12 1 2024-02-15T22:40:43.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/215: fsync d5/f30 0 2024-02-15T22:40:43.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/216: chown d5/dc/l11 905609881 1 2024-02-15T22:40:43.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/217: chown d5/dc/ce 194954616 1 2024-02-15T22:40:43.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/218: readlink d5/dc/l11 0 2024-02-15T22:40:43.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/219: chown d5/d6/d10/f34 77 1 2024-02-15T22:40:43.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/220: dread f4 [0,4194304] 0 2024-02-15T22:40:43.142 INFO:tasks.workunit.client.0.smithi033.stdout:3/133: dread d0/f24 [0,4194304] 0 2024-02-15T22:40:43.143 INFO:tasks.workunit.client.0.smithi033.stdout:3/134: dread d0/d3/dd/f23 [0,4194304] 0 2024-02-15T22:40:43.157 INFO:tasks.workunit.client.0.smithi033.stdout:9/95: dwrite d4/f13 [0,4194304] 0 2024-02-15T22:40:43.157 INFO:tasks.workunit.client.0.smithi033.stdout:9/96: write d4/f18 [670418,4925] 0 2024-02-15T22:40:43.158 INFO:tasks.workunit.client.0.smithi033.stdout:5/263: mknod d6/d14/d31/d48/c58 0 2024-02-15T22:40:43.171 INFO:tasks.workunit.client.0.smithi033.stdout:0/167: symlink db/d19/l37 0 2024-02-15T22:40:43.171 INFO:tasks.workunit.client.0.smithi033.stdout:0/168: chown f4 246026285 1 2024-02-15T22:40:43.171 INFO:tasks.workunit.client.0.smithi033.stdout:0/169: chown db/l15 1502189 1 2024-02-15T22:40:43.173 INFO:tasks.workunit.client.0.smithi033.stdout:7/221: unlink d5/d6/f38 0 2024-02-15T22:40:43.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/135: truncate d0/fe 1484480 0 2024-02-15T22:40:43.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/136: creat d0/d1c/f29 x:0 0 0 2024-02-15T22:40:43.175 INFO:tasks.workunit.client.0.smithi033.stdout:3/137: chown d0/f7 341 1 2024-02-15T22:40:43.182 INFO:tasks.workunit.client.0.smithi033.stdout:5/264: unlink d6/d25/l2f 0 2024-02-15T22:40:43.183 INFO:tasks.workunit.client.0.smithi033.stdout:3/138: write d0/f1f [2138015,112329] 0 2024-02-15T22:40:43.183 INFO:tasks.workunit.client.0.smithi033.stdout:3/139: stat d0/d1c 0 2024-02-15T22:40:43.185 INFO:tasks.workunit.client.0.smithi033.stdout:4/130: rename d8/d13 to d8/d16/d19/d27 0 2024-02-15T22:40:43.189 INFO:tasks.workunit.client.0.smithi033.stdout:9/97: symlink d4/l1f 0 2024-02-15T22:40:43.193 INFO:tasks.workunit.client.0.smithi033.stdout:3/140: mknod d0/d1c/c2a 0 2024-02-15T22:40:43.193 INFO:tasks.workunit.client.0.smithi033.stdout:3/141: write d0/d3/f22 [200182,582] 0 2024-02-15T22:40:43.195 INFO:tasks.workunit.client.0.smithi033.stdout:3/142: dread d0/f7 [0,4194304] 0 2024-02-15T22:40:43.197 INFO:tasks.workunit.client.0.smithi033.stdout:0/170: rename db/lf to db/d19/d2e/l38 0 2024-02-15T22:40:43.199 INFO:tasks.workunit.client.0.smithi033.stdout:9/98: fsync d4/fb 0 2024-02-15T22:40:43.199 INFO:tasks.workunit.client.0.smithi033.stdout:9/99: fsync d4/ff 0 2024-02-15T22:40:43.204 INFO:tasks.workunit.client.0.smithi033.stdout:7/222: rename d5/c24 to d5/df/c4b 0 2024-02-15T22:40:43.210 INFO:tasks.workunit.client.0.smithi033.stdout:4/131: rename d8/d1f/d23/l24 to d8/d1f/l28 0 2024-02-15T22:40:43.211 INFO:tasks.workunit.client.0.smithi033.stdout:7/223: mknod d5/d6/d10/d16/d26/c4c 0 2024-02-15T22:40:43.212 INFO:tasks.workunit.client.0.smithi033.stdout:9/100: dread d4/f15 [0,4194304] 0 2024-02-15T22:40:43.213 INFO:tasks.workunit.client.0.smithi033.stdout:4/132: mknod d8/d16/d19/d1c/c29 0 2024-02-15T22:40:43.215 INFO:tasks.workunit.client.0.smithi033.stdout:7/224: mkdir d5/df/d47/d4d 0 2024-02-15T22:40:43.217 INFO:tasks.workunit.client.0.smithi033.stdout:9/101: truncate d4/f16 593488 0 2024-02-15T22:40:43.218 INFO:tasks.workunit.client.0.smithi033.stdout:3/143: dwrite d0/f13 [0,4194304] 0 2024-02-15T22:40:43.218 INFO:tasks.workunit.client.0.smithi033.stdout:0/171: dwrite f4 [0,4194304] 0 2024-02-15T22:40:43.220 INFO:tasks.workunit.client.0.smithi033.stdout:7/225: mknod d5/df/c4e 0 2024-02-15T22:40:43.220 INFO:tasks.workunit.client.0.smithi033.stdout:4/133: dread f5 [0,4194304] 0 2024-02-15T22:40:43.220 INFO:tasks.workunit.client.0.smithi033.stdout:4/134: creat d8/d1f/f2a x:0 0 0 2024-02-15T22:40:43.221 INFO:tasks.workunit.client.0.smithi033.stdout:7/226: write d5/f15 [1641608,42110] 0 2024-02-15T22:40:43.221 INFO:tasks.workunit.client.0.smithi033.stdout:7/227: write d5/df/d40/f42 [524889,68646] 0 2024-02-15T22:40:43.222 INFO:tasks.workunit.client.0.smithi033.stdout:9/102: mknod d4/d1d/c20 0 2024-02-15T22:40:43.231 INFO:tasks.workunit.client.0.smithi033.stdout:3/144: mknod d0/c2b 0 2024-02-15T22:40:43.233 INFO:tasks.workunit.client.0.smithi033.stdout:8/139: sync 2024-02-15T22:40:43.233 INFO:tasks.workunit.client.0.smithi033.stdout:2/211: sync 2024-02-15T22:40:43.233 INFO:tasks.workunit.client.0.smithi033.stdout:6/169: sync 2024-02-15T22:40:43.233 INFO:tasks.workunit.client.0.smithi033.stdout:8/140: chown d1/df/d1d/f24 109 1 2024-02-15T22:40:43.234 INFO:tasks.workunit.client.0.smithi033.stdout:8/141: truncate d1/de/d1a/f20 263185 0 2024-02-15T22:40:43.234 INFO:tasks.workunit.client.0.smithi033.stdout:8/142: readlink d1/de/d1a/l1e 0 2024-02-15T22:40:43.234 INFO:tasks.workunit.client.0.smithi033.stdout:8/143: creat d1/de/f37 x:0 0 0 2024-02-15T22:40:43.234 INFO:tasks.workunit.client.0.smithi033.stdout:7/228: dwrite d5/d6/d10/f34 [0,4194304] 0 2024-02-15T22:40:43.238 INFO:tasks.workunit.client.0.smithi033.stdout:4/135: mknod d8/d1a/c2b 0 2024-02-15T22:40:43.238 INFO:tasks.workunit.client.0.smithi033.stdout:2/212: dread d1/d16/f22 [0,4194304] 0 2024-02-15T22:40:43.240 INFO:tasks.workunit.client.0.smithi033.stdout:9/103: creat d4/d1d/f21 x:0 0 0 2024-02-15T22:40:43.243 INFO:tasks.workunit.client.0.smithi033.stdout:3/145: unlink d0/c1d 0 2024-02-15T22:40:43.246 INFO:tasks.workunit.client.0.smithi033.stdout:6/170: link d12/f13 d12/d2c/d30/f36 0 2024-02-15T22:40:43.248 INFO:tasks.workunit.client.0.smithi033.stdout:0/172: rename db/d19/d2e to db/d19/d39 0 2024-02-15T22:40:43.248 INFO:tasks.workunit.client.0.smithi033.stdout:0/173: truncate db/d19/f1f 914804 0 2024-02-15T22:40:43.248 INFO:tasks.workunit.client.0.smithi033.stdout:0/174: creat db/d19/f3a x:0 0 0 2024-02-15T22:40:43.250 INFO:tasks.workunit.client.0.smithi033.stdout:8/144: symlink d1/d6/l38 0 2024-02-15T22:40:43.253 INFO:tasks.workunit.client.0.smithi033.stdout:6/171: write d12/f13 [1177373,89416] 0 2024-02-15T22:40:43.254 INFO:tasks.workunit.client.0.smithi033.stdout:6/172: write d12/f13 [2672342,81410] 0 2024-02-15T22:40:43.254 INFO:tasks.workunit.client.0.smithi033.stdout:6/173: read d12/f2b [3837679,32087] 0 2024-02-15T22:40:43.256 INFO:tasks.workunit.client.0.smithi033.stdout:7/229: mknod d5/d36/c4f 0 2024-02-15T22:40:43.256 INFO:tasks.workunit.client.0.smithi033.stdout:7/230: chown d5/d6/d10/d16/d26/l35 2 1 2024-02-15T22:40:43.256 INFO:tasks.workunit.client.0.smithi033.stdout:7/231: creat d5/f50 x:0 0 0 2024-02-15T22:40:43.257 INFO:tasks.workunit.client.0.smithi033.stdout:4/136: dwrite f5 [0,4194304] 0 2024-02-15T22:40:43.257 INFO:tasks.workunit.client.0.smithi033.stdout:4/137: chown d8/d16/d19/c1b 394 1 2024-02-15T22:40:43.258 INFO:tasks.workunit.client.0.smithi033.stdout:2/213: getdents d1/d8/d2b/d2f/d24/d2a 0 2024-02-15T22:40:43.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/146: mkdir d0/d3/d2c 0 2024-02-15T22:40:43.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/147: fsync d0/f1f 0 2024-02-15T22:40:43.266 INFO:tasks.workunit.client.0.smithi033.stdout:0/175: rename f0 to db/d19/d39/f3b 0 2024-02-15T22:40:43.268 INFO:tasks.workunit.client.0.smithi033.stdout:8/145: symlink d1/de/d1a/d2a/l39 0 2024-02-15T22:40:43.272 INFO:tasks.workunit.client.0.smithi033.stdout:6/174: getdents d12/d2c 0 2024-02-15T22:40:43.273 INFO:tasks.workunit.client.0.smithi033.stdout:8/146: dread d1/df/d1d/f24 [0,4194304] 0 2024-02-15T22:40:43.275 INFO:tasks.workunit.client.0.smithi033.stdout:3/148: dwrite d0/f1f [0,4194304] 0 2024-02-15T22:40:43.277 INFO:tasks.workunit.client.0.smithi033.stdout:7/232: rmdir d5/df/d47/d4d 0 2024-02-15T22:40:43.277 INFO:tasks.workunit.client.0.smithi033.stdout:7/233: truncate d5/df/f44 831629 0 2024-02-15T22:40:43.282 INFO:tasks.workunit.client.0.smithi033.stdout:4/138: unlink d8/d18/l1d 0 2024-02-15T22:40:43.285 INFO:tasks.workunit.client.0.smithi033.stdout:2/214: symlink d1/d8/d2b/d2f/l40 0 2024-02-15T22:40:43.287 INFO:tasks.workunit.client.0.smithi033.stdout:6/175: dwrite fa [4194304,4194304] 0 2024-02-15T22:40:43.288 INFO:tasks.workunit.client.0.smithi033.stdout:9/104: symlink d4/l22 0 2024-02-15T22:40:43.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/176: creat db/d19/d32/f3c x:0 0 0 2024-02-15T22:40:43.295 INFO:tasks.workunit.client.0.smithi033.stdout:8/147: mknod d1/d36/c3a 0 2024-02-15T22:40:43.297 INFO:tasks.workunit.client.0.smithi033.stdout:6/176: dread fa [0,4194304] 0 2024-02-15T22:40:43.297 INFO:tasks.workunit.client.0.smithi033.stdout:6/177: fsync d12/d2c/d30/f16 0 2024-02-15T22:40:43.297 INFO:tasks.workunit.client.0.smithi033.stdout:6/178: dread - d12/d2c/d30/f1f zero size 2024-02-15T22:40:43.298 INFO:tasks.workunit.client.0.smithi033.stdout:6/179: chown d12/d2c/d30/d19/f21 5785607 1 2024-02-15T22:40:43.298 INFO:tasks.workunit.client.0.smithi033.stdout:2/215: read d1/d8/fe [3436814,109677] 0 2024-02-15T22:40:43.299 INFO:tasks.workunit.client.0.smithi033.stdout:3/149: mknod d0/d8/c2d 0 2024-02-15T22:40:43.300 INFO:tasks.workunit.client.0.smithi033.stdout:7/234: symlink d5/df/l51 0 2024-02-15T22:40:43.302 INFO:tasks.workunit.client.0.smithi033.stdout:4/139: mknod d8/d16/d19/d1c/c2c 0 2024-02-15T22:40:43.303 INFO:tasks.workunit.client.0.smithi033.stdout:9/105: dwrite d4/fe [0,4194304] 0 2024-02-15T22:40:43.306 INFO:tasks.workunit.client.0.smithi033.stdout:8/148: creat d1/de/d1a/d2a/f3b x:0 0 0 2024-02-15T22:40:43.306 INFO:tasks.workunit.client.0.smithi033.stdout:8/149: chown d1/de/d1a/c34 428 1 2024-02-15T22:40:43.306 INFO:tasks.workunit.client.0.smithi033.stdout:8/150: creat d1/de/d1a/d2a/f3c x:0 0 0 2024-02-15T22:40:43.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/235: symlink d5/d36/l52 0 2024-02-15T22:40:43.314 INFO:tasks.workunit.client.0.smithi033.stdout:9/106: mkdir d4/d1d/d23 0 2024-02-15T22:40:43.315 INFO:tasks.workunit.client.0.smithi033.stdout:9/107: mkdir d4/d1d/d23/d24 0 2024-02-15T22:40:43.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/108: creat d4/d1d/d23/d24/f25 x:0 0 0 2024-02-15T22:40:43.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/109: fdatasync d4/f18 0 2024-02-15T22:40:43.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/110: write d4/f18 [1201738,97381] 0 2024-02-15T22:40:43.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/111: fsync d4/f5 0 2024-02-15T22:40:43.320 INFO:tasks.workunit.client.0.smithi033.stdout:9/112: symlink d4/d1d/l26 0 2024-02-15T22:40:43.321 INFO:tasks.workunit.client.0.smithi033.stdout:3/150: dwrite d0/fe [0,4194304] 0 2024-02-15T22:40:43.324 INFO:tasks.workunit.client.0.smithi033.stdout:0/177: rename db/d19/d39 to db/d19/d32/d3d 0 2024-02-15T22:40:43.324 INFO:tasks.workunit.client.0.smithi033.stdout:6/180: rename d12/d2c to d12/d2c/d30/d1d/d37 22 2024-02-15T22:40:43.324 INFO:tasks.workunit.client.0.smithi033.stdout:0/178: write db/d19/d32/d3d/f3b [838225,69598] 0 2024-02-15T22:40:43.324 INFO:tasks.workunit.client.0.smithi033.stdout:0/179: readlink db/d19/d32/l26 0 2024-02-15T22:40:43.329 INFO:tasks.workunit.client.0.smithi033.stdout:2/216: rename d1/c26 to d1/d8/d2b/d2f/d12/c41 0 2024-02-15T22:40:43.331 INFO:tasks.workunit.client.0.smithi033.stdout:7/236: dwrite d5/df/f44 [0,4194304] 0 2024-02-15T22:40:43.331 INFO:tasks.workunit.client.0.smithi033.stdout:7/237: chown d5/d6/d10/d16/l3e 126390 1 2024-02-15T22:40:43.333 INFO:tasks.workunit.client.0.smithi033.stdout:9/113: dread d4/ff [0,4194304] 0 2024-02-15T22:40:43.333 INFO:tasks.workunit.client.0.smithi033.stdout:8/151: dwrite d1/df/d1d/f35 [0,4194304] 0 2024-02-15T22:40:43.333 INFO:tasks.workunit.client.0.smithi033.stdout:8/152: fsync d1/f33 0 2024-02-15T22:40:43.333 INFO:tasks.workunit.client.0.smithi033.stdout:0/180: symlink db/d19/d32/l3e 0 2024-02-15T22:40:43.339 INFO:tasks.workunit.client.0.smithi033.stdout:3/151: dread d0/f13 [0,4194304] 0 2024-02-15T22:40:43.339 INFO:tasks.workunit.client.0.smithi033.stdout:4/140: rename d8/d16/d19/d1c/c2c to d8/d1f/d23/c2d 0 2024-02-15T22:40:43.340 INFO:tasks.workunit.client.0.smithi033.stdout:4/141: chown d8/d16/d19/d27 277967 1 2024-02-15T22:40:43.344 INFO:tasks.workunit.client.0.smithi033.stdout:3/152: dread d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:43.347 INFO:tasks.workunit.client.0.smithi033.stdout:7/238: rmdir d5/dc 39 2024-02-15T22:40:43.347 INFO:tasks.workunit.client.0.smithi033.stdout:7/239: dread - d5/dc/f2e zero size 2024-02-15T22:40:43.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/153: dread d0/f16 [0,4194304] 0 2024-02-15T22:40:43.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/154: dread - d0/d1c/f25 zero size 2024-02-15T22:40:43.350 INFO:tasks.workunit.client.0.smithi033.stdout:6/181: dwrite d12/f2b [0,4194304] 0 2024-02-15T22:40:43.354 INFO:tasks.workunit.client.0.smithi033.stdout:8/153: symlink d1/d6/d14/l3d 0 2024-02-15T22:40:43.356 INFO:tasks.workunit.client.0.smithi033.stdout:0/181: dwrite db/d2a/f2b [0,4194304] 0 2024-02-15T22:40:43.356 INFO:tasks.workunit.client.0.smithi033.stdout:0/182: creat db/d19/f3f x:0 0 0 2024-02-15T22:40:43.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/155: symlink d0/l2e 0 2024-02-15T22:40:43.362 INFO:tasks.workunit.client.0.smithi033.stdout:9/114: write d4/f9 [4857876,66126] 0 2024-02-15T22:40:43.362 INFO:tasks.workunit.client.0.smithi033.stdout:9/115: stat d4/fe 0 2024-02-15T22:40:43.362 INFO:tasks.workunit.client.0.smithi033.stdout:2/217: dwrite d1/f20 [0,4194304] 0 2024-02-15T22:40:43.362 INFO:tasks.workunit.client.0.smithi033.stdout:2/218: truncate d1/d8/d2b/d2f/d13/f3b 304043 0 2024-02-15T22:40:43.364 INFO:tasks.workunit.client.0.smithi033.stdout:6/182: mknod d12/d2c/d30/d1d/d35/c38 0 2024-02-15T22:40:43.365 INFO:tasks.workunit.client.0.smithi033.stdout:6/183: truncate d12/d2c/d30/d1d/f22 951167 0 2024-02-15T22:40:43.365 INFO:tasks.workunit.client.0.smithi033.stdout:6/184: fsync d12/d2c/d30/f31 0 2024-02-15T22:40:43.365 INFO:tasks.workunit.client.0.smithi033.stdout:6/185: truncate d12/d2c/d30/d19/f26 1970075 0 2024-02-15T22:40:43.365 INFO:tasks.workunit.client.0.smithi033.stdout:6/186: dread - d12/d2c/d30/d19/f21 zero size 2024-02-15T22:40:43.367 INFO:tasks.workunit.client.0.smithi033.stdout:8/154: mknod d1/df/d2e/c3e 0 2024-02-15T22:40:43.367 INFO:tasks.workunit.client.0.smithi033.stdout:8/155: chown d1/d6/d14 7494905 1 2024-02-15T22:40:43.368 INFO:tasks.workunit.client.0.smithi033.stdout:8/156: dread d1/f10 [4194304,4194304] 0 2024-02-15T22:40:43.373 INFO:tasks.workunit.client.0.smithi033.stdout:7/240: dwrite d5/f31 [0,4194304] 0 2024-02-15T22:40:43.374 INFO:tasks.workunit.client.0.smithi033.stdout:0/183: dwrite db/d2a/f2b [0,4194304] 0 2024-02-15T22:40:43.374 INFO:tasks.workunit.client.0.smithi033.stdout:0/184: truncate db/f33 1237416 0 2024-02-15T22:40:43.375 INFO:tasks.workunit.client.0.smithi033.stdout:7/241: dread d5/d6/d10/d16/d26/f2a [0,4194304] 0 2024-02-15T22:40:43.380 INFO:tasks.workunit.client.0.smithi033.stdout:3/156: rmdir d0/d8 39 2024-02-15T22:40:43.387 INFO:tasks.workunit.client.0.smithi033.stdout:0/185: write db/f18 [1717897,66968] 0 2024-02-15T22:40:43.388 INFO:tasks.workunit.client.0.smithi033.stdout:6/187: dwrite d12/d2c/d30/f1f [0,4194304] 0 2024-02-15T22:40:43.388 INFO:tasks.workunit.client.0.smithi033.stdout:6/188: fdatasync d12/f28 0 2024-02-15T22:40:43.389 INFO:tasks.workunit.client.0.smithi033.stdout:6/189: write d12/d2c/d30/f16 [649826,112318] 0 2024-02-15T22:40:43.389 INFO:tasks.workunit.client.0.smithi033.stdout:6/190: fdatasync f6 0 2024-02-15T22:40:43.392 INFO:tasks.workunit.client.0.smithi033.stdout:7/242: dwrite d5/d6/d10/d16/d26/f2a [0,4194304] 0 2024-02-15T22:40:43.392 INFO:tasks.workunit.client.0.smithi033.stdout:7/243: write d5/d6/d10/d16/f21 [509911,1992] 0 2024-02-15T22:40:43.394 INFO:tasks.workunit.client.0.smithi033.stdout:4/142: getdents d8/d1f/d23 0 2024-02-15T22:40:43.409 INFO:tasks.workunit.client.0.smithi033.stdout:9/116: symlink d4/d1d/d23/d24/l27 0 2024-02-15T22:40:43.411 INFO:tasks.workunit.client.0.smithi033.stdout:2/219: creat d1/d8/d2b/d2f/d12/f42 x:0 0 0 2024-02-15T22:40:43.412 INFO:tasks.workunit.client.0.smithi033.stdout:2/220: chown d1/d16/l2c 392 1 2024-02-15T22:40:43.416 INFO:tasks.workunit.client.0.smithi033.stdout:0/186: creat db/d2a/f40 x:0 0 0 2024-02-15T22:40:43.416 INFO:tasks.workunit.client.0.smithi033.stdout:0/187: chown db/d19/f1e 7 1 2024-02-15T22:40:43.422 INFO:tasks.workunit.client.0.smithi033.stdout:6/191: creat d12/d2c/d30/d1d/f39 x:0 0 0 2024-02-15T22:40:43.431 INFO:tasks.workunit.client.0.smithi033.stdout:7/244: creat d5/d6/d10/d16/f53 x:0 0 0 2024-02-15T22:40:43.431 INFO:tasks.workunit.client.0.smithi033.stdout:7/245: write d5/f50 [140819,100615] 0 2024-02-15T22:40:43.431 INFO:tasks.workunit.client.0.smithi033.stdout:7/246: read f4 [358743,57363] 0 2024-02-15T22:40:43.431 INFO:tasks.workunit.client.0.smithi033.stdout:7/247: readlink d5/d6/d10/d16/l1b 0 2024-02-15T22:40:43.431 INFO:tasks.workunit.client.0.smithi033.stdout:7/248: truncate d5/d6/d10/d16/f43 130782 0 2024-02-15T22:40:43.431 INFO:tasks.workunit.client.0.smithi033.stdout:7/249: fsync d5/d6/d10/d16/f49 0 2024-02-15T22:40:43.434 INFO:tasks.workunit.client.0.smithi033.stdout:4/143: rename d8/d1f/f2a to d8/d16/d19/f2e 0 2024-02-15T22:40:43.434 INFO:tasks.workunit.client.0.smithi033.stdout:4/144: chown d8/d1f/d23/c2d 1108397 1 2024-02-15T22:40:43.434 INFO:tasks.workunit.client.0.smithi033.stdout:4/145: chown d8/c11 275803 1 2024-02-15T22:40:43.435 INFO:tasks.workunit.client.0.smithi033.stdout:7/250: write d5/d6/f7 [1059821,60356] 0 2024-02-15T22:40:43.436 INFO:tasks.workunit.client.0.smithi033.stdout:7/251: dread - d5/d6/d10/d16/f53 zero size 2024-02-15T22:40:43.439 INFO:tasks.workunit.client.0.smithi033.stdout:2/221: truncate d1/d8/d2b/d2f/d13/f1c 2559567 0 2024-02-15T22:40:43.440 INFO:tasks.workunit.client.0.smithi033.stdout:5/265: sync 2024-02-15T22:40:43.441 INFO:tasks.workunit.client.0.smithi033.stdout:1/156: sync 2024-02-15T22:40:43.443 INFO:tasks.workunit.client.0.smithi033.stdout:0/188: mknod db/d2a/c41 0 2024-02-15T22:40:43.443 INFO:tasks.workunit.client.0.smithi033.stdout:0/189: truncate fa 566777 0 2024-02-15T22:40:43.447 INFO:tasks.workunit.client.0.smithi033.stdout:6/192: symlink d12/d2c/l3a 0 2024-02-15T22:40:43.449 INFO:tasks.workunit.client.0.smithi033.stdout:4/146: rmdir d8/d16 39 2024-02-15T22:40:43.455 INFO:tasks.workunit.client.0.smithi033.stdout:5/266: write d6/d14/f1d [3301145,94556] 0 2024-02-15T22:40:43.455 INFO:tasks.workunit.client.0.smithi033.stdout:1/157: creat d1/d1d/d2c/f31 x:0 0 0 2024-02-15T22:40:43.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/267: write d6/d14/d31/f37 [391776,45989] 0 2024-02-15T22:40:43.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/268: truncate d6/d14/f19 2020073 0 2024-02-15T22:40:43.461 INFO:tasks.workunit.client.0.smithi033.stdout:1/158: dread d1/f8 [0,4194304] 0 2024-02-15T22:40:43.461 INFO:tasks.workunit.client.0.smithi033.stdout:6/193: mknod d12/d2c/d30/d1d/d35/c3b 0 2024-02-15T22:40:43.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/159: write d1/f1c [5555194,87148] 0 2024-02-15T22:40:43.465 INFO:tasks.workunit.client.0.smithi033.stdout:4/147: mknod d8/d16/d19/d1c/c2f 0 2024-02-15T22:40:43.465 INFO:tasks.workunit.client.0.smithi033.stdout:9/117: dwrite d4/f8 [0,4194304] 0 2024-02-15T22:40:43.466 INFO:tasks.workunit.client.0.smithi033.stdout:7/252: dwrite d5/d6/d10/d16/f21 [0,4194304] 0 2024-02-15T22:40:43.467 INFO:tasks.workunit.client.0.smithi033.stdout:2/222: dwrite d1/f7 [4194304,4194304] 0 2024-02-15T22:40:43.467 INFO:tasks.workunit.client.0.smithi033.stdout:4/148: dread f4 [0,4194304] 0 2024-02-15T22:40:43.467 INFO:tasks.workunit.client.0.smithi033.stdout:4/149: truncate d8/d18/f25 190767 0 2024-02-15T22:40:43.468 INFO:tasks.workunit.client.0.smithi033.stdout:2/223: dread d1/d8/d2b/d2f/d24/d31/f3e [0,4194304] 0 2024-02-15T22:40:43.484 INFO:tasks.workunit.client.0.smithi033.stdout:4/150: write f7 [2634548,116187] 0 2024-02-15T22:40:43.484 INFO:tasks.workunit.client.0.smithi033.stdout:1/160: dwrite d1/de/f14 [4194304,4194304] 0 2024-02-15T22:40:43.485 INFO:tasks.workunit.client.0.smithi033.stdout:2/224: dwrite d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:43.487 INFO:tasks.workunit.client.0.smithi033.stdout:6/194: mkdir d12/d3c 0 2024-02-15T22:40:43.498 INFO:tasks.workunit.client.0.smithi033.stdout:2/225: write d1/f7 [6957614,4924] 0 2024-02-15T22:40:43.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/118: symlink d4/d1d/d23/d24/l28 0 2024-02-15T22:40:43.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/119: fdatasync d4/f16 0 2024-02-15T22:40:43.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/120: write d4/f1a [597568,64675] 0 2024-02-15T22:40:43.498 INFO:tasks.workunit.client.0.smithi033.stdout:0/190: rmdir db 39 2024-02-15T22:40:43.499 INFO:tasks.workunit.client.0.smithi033.stdout:6/195: dread d12/f2b [0,4194304] 0 2024-02-15T22:40:43.499 INFO:tasks.workunit.client.0.smithi033.stdout:6/196: write d12/d2c/d30/f31 [10077,86147] 0 2024-02-15T22:40:43.501 INFO:tasks.workunit.client.0.smithi033.stdout:9/121: dread d4/f5 [0,4194304] 0 2024-02-15T22:40:43.501 INFO:tasks.workunit.client.0.smithi033.stdout:7/253: link d5/d6/d10/d16/f21 d5/d6/f54 0 2024-02-15T22:40:43.513 INFO:tasks.workunit.client.0.smithi033.stdout:4/151: truncate d8/fd 944034 0 2024-02-15T22:40:43.514 INFO:tasks.workunit.client.0.smithi033.stdout:7/254: dwrite d5/df/f44 [4194304,4194304] 0 2024-02-15T22:40:43.519 INFO:tasks.workunit.client.0.smithi033.stdout:1/161: mknod d1/d20/c32 0 2024-02-15T22:40:43.519 INFO:tasks.workunit.client.0.smithi033.stdout:1/162: dread - d1/d1d/d2c/f31 zero size 2024-02-15T22:40:43.554 INFO:tasks.workunit.client.0.smithi033.stdout:2/226: creat d1/d8/d2b/d2f/d24/d31/f43 x:0 0 0 2024-02-15T22:40:43.556 INFO:tasks.workunit.client.0.smithi033.stdout:0/191: mknod db/d19/d32/c42 0 2024-02-15T22:40:43.559 INFO:tasks.workunit.client.0.smithi033.stdout:6/197: creat d12/d2c/d30/f3d x:0 0 0 2024-02-15T22:40:43.559 INFO:tasks.workunit.client.0.smithi033.stdout:6/198: dread - d12/d2c/d30/f3d zero size 2024-02-15T22:40:43.561 INFO:tasks.workunit.client.0.smithi033.stdout:6/199: dread f6 [0,4194304] 0 2024-02-15T22:40:43.561 INFO:tasks.workunit.client.0.smithi033.stdout:6/200: read d12/d2c/d30/f16 [342411,12364] 0 2024-02-15T22:40:43.562 INFO:tasks.workunit.client.0.smithi033.stdout:9/122: chown d4/c10 89720927 1 2024-02-15T22:40:43.565 INFO:tasks.workunit.client.0.smithi033.stdout:5/269: rename d6/d14/d31/d3c to d6/d14/d31/d48/d59 0 2024-02-15T22:40:43.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/152: creat d8/d1f/d23/f30 x:0 0 0 2024-02-15T22:40:43.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/153: stat d8/c10 0 2024-02-15T22:40:43.578 INFO:tasks.workunit.client.0.smithi033.stdout:2/227: truncate d1/f20 3287197 0 2024-02-15T22:40:43.578 INFO:tasks.workunit.client.0.smithi033.stdout:2/228: chown d1/d8/d2b/d2f/d12/f27 29429 1 2024-02-15T22:40:43.578 INFO:tasks.workunit.client.0.smithi033.stdout:2/229: chown d1/d8/fe 54 1 2024-02-15T22:40:43.578 INFO:tasks.workunit.client.0.smithi033.stdout:2/230: stat d1/d16/l2c 0 2024-02-15T22:40:43.578 INFO:tasks.workunit.client.0.smithi033.stdout:2/231: write d1/d8/f19 [798990,56023] 0 2024-02-15T22:40:43.579 INFO:tasks.workunit.client.0.smithi033.stdout:0/192: mkdir db/d19/d32/d43 0 2024-02-15T22:40:43.580 INFO:tasks.workunit.client.0.smithi033.stdout:2/232: write d1/d8/f19 [511037,66410] 0 2024-02-15T22:40:43.583 INFO:tasks.workunit.client.0.smithi033.stdout:6/201: creat d12/d2c/d30/d19/f3e x:0 0 0 2024-02-15T22:40:43.583 INFO:tasks.workunit.client.0.smithi033.stdout:9/123: creat d4/f29 x:0 0 0 2024-02-15T22:40:43.583 INFO:tasks.workunit.client.0.smithi033.stdout:9/124: write d4/f19 [29379,125264] 0 2024-02-15T22:40:43.584 INFO:tasks.workunit.client.0.smithi033.stdout:9/125: fsync d4/fb 0 2024-02-15T22:40:43.585 INFO:tasks.workunit.client.0.smithi033.stdout:5/270: mknod d6/d14/d31/c5a 0 2024-02-15T22:40:43.585 INFO:tasks.workunit.client.0.smithi033.stdout:5/271: stat d6/d14/f3e 0 2024-02-15T22:40:43.587 INFO:tasks.workunit.client.0.smithi033.stdout:4/154: mkdir d8/d1f/d31 0 2024-02-15T22:40:43.589 INFO:tasks.workunit.client.0.smithi033.stdout:1/163: unlink d1/de/f14 0 2024-02-15T22:40:43.589 INFO:tasks.workunit.client.0.smithi033.stdout:1/164: creat d1/d1d/f33 x:0 0 0 2024-02-15T22:40:43.591 INFO:tasks.workunit.client.0.smithi033.stdout:0/193: creat db/d19/d32/d3d/f44 x:0 0 0 2024-02-15T22:40:43.592 INFO:tasks.workunit.client.0.smithi033.stdout:0/194: dread db/f33 [0,4194304] 0 2024-02-15T22:40:43.595 INFO:tasks.workunit.client.0.smithi033.stdout:6/202: mkdir d12/d1b/d3f 0 2024-02-15T22:40:43.599 INFO:tasks.workunit.client.0.smithi033.stdout:5/272: creat d6/d14/d31/d48/d56/f5b x:0 0 0 2024-02-15T22:40:43.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:43 smithi033 ceph-mon[29033]: [15/Feb/2024:22:40:42] ENGINE Bus STARTING 2024-02-15T22:40:43.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:43 smithi033 ceph-mon[29033]: pgmap v4: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:43.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:43 smithi033 ceph-mon[29033]: [15/Feb/2024:22:40:42] ENGINE Serving on https://172.21.15.82:7150 2024-02-15T22:40:43.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:43 smithi033 ceph-mon[29033]: [15/Feb/2024:22:40:42] ENGINE Serving on http://172.21.15.82:8765 2024-02-15T22:40:43.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:43 smithi033 ceph-mon[29033]: [15/Feb/2024:22:40:42] ENGINE Bus STARTED 2024-02-15T22:40:43.601 INFO:tasks.workunit.client.0.smithi033.stdout:4/155: unlink d8/d16/d19/f2e 0 2024-02-15T22:40:43.605 INFO:tasks.workunit.client.0.smithi033.stdout:1/165: mknod d1/c34 0 2024-02-15T22:40:43.608 INFO:tasks.workunit.client.0.smithi033.stdout:0/195: dwrite db/d19/d32/f23 [4194304,4194304] 0 2024-02-15T22:40:43.608 INFO:tasks.workunit.client.0.smithi033.stdout:0/196: chown db/d2a/f40 10 1 2024-02-15T22:40:43.608 INFO:tasks.workunit.client.0.smithi033.stdout:0/197: creat db/d19/d32/d3d/f45 x:0 0 0 2024-02-15T22:40:43.609 INFO:tasks.workunit.client.0.smithi033.stdout:6/203: mknod d12/d2c/d30/d1d/d35/c40 0 2024-02-15T22:40:43.612 INFO:tasks.workunit.client.0.smithi033.stdout:9/126: getdents d4/d1d/d23/d24 0 2024-02-15T22:40:43.616 INFO:tasks.workunit.client.0.smithi033.stdout:5/273: mkdir d6/d14/d31/d50/d5c 0 2024-02-15T22:40:43.616 INFO:tasks.workunit.client.0.smithi033.stdout:5/274: chown d6/la 32228 1 2024-02-15T22:40:43.616 INFO:tasks.workunit.client.0.smithi033.stdout:5/275: dread - d6/d25/f55 zero size 2024-02-15T22:40:43.618 INFO:tasks.workunit.client.0.smithi033.stdout:4/156: creat d8/d16/d19/d1c/f32 x:0 0 0 2024-02-15T22:40:43.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/166: truncate d1/f8 794933 0 2024-02-15T22:40:43.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/167: read - d1/de/f1f zero size 2024-02-15T22:40:43.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:43 smithi082 ceph-mon[37153]: [15/Feb/2024:22:40:42] ENGINE Bus STARTING 2024-02-15T22:40:43.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:43 smithi082 ceph-mon[37153]: pgmap v4: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:43.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:43 smithi082 ceph-mon[37153]: [15/Feb/2024:22:40:42] ENGINE Serving on https://172.21.15.82:7150 2024-02-15T22:40:43.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:43 smithi082 ceph-mon[37153]: [15/Feb/2024:22:40:42] ENGINE Serving on http://172.21.15.82:8765 2024-02-15T22:40:43.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:43 smithi082 ceph-mon[37153]: [15/Feb/2024:22:40:42] ENGINE Bus STARTED 2024-02-15T22:40:43.624 INFO:tasks.workunit.client.0.smithi033.stdout:6/204: dwrite d12/d2c/d30/d1d/f33 [0,4194304] 0 2024-02-15T22:40:43.628 INFO:tasks.workunit.client.0.smithi033.stdout:0/198: mkdir db/d19/d32/d46 0 2024-02-15T22:40:43.630 INFO:tasks.workunit.client.0.smithi033.stdout:9/127: mknod d4/d1d/d23/c2a 0 2024-02-15T22:40:43.630 INFO:tasks.workunit.client.0.smithi033.stdout:9/128: readlink d4/l22 0 2024-02-15T22:40:43.638 INFO:tasks.workunit.client.0.smithi033.stdout:1/168: dwrite d1/f15 [0,4194304] 0 2024-02-15T22:40:43.640 INFO:tasks.workunit.client.0.smithi033.stdout:0/199: symlink db/d19/d32/d3d/l47 0 2024-02-15T22:40:43.643 INFO:tasks.workunit.client.0.smithi033.stdout:2/233: truncate d1/d8/f19 619820 0 2024-02-15T22:40:43.647 INFO:tasks.workunit.client.0.smithi033.stdout:1/169: mknod d1/d1d/c35 0 2024-02-15T22:40:43.647 INFO:tasks.workunit.client.0.smithi033.stdout:1/170: fdatasync d1/f7 0 2024-02-15T22:40:43.648 INFO:tasks.workunit.client.0.smithi033.stdout:9/129: dwrite d4/d1d/d23/d24/f25 [0,4194304] 0 2024-02-15T22:40:43.649 INFO:tasks.workunit.client.0.smithi033.stdout:9/130: chown d4/f9 11348 1 2024-02-15T22:40:43.649 INFO:tasks.workunit.client.0.smithi033.stdout:9/131: write d4/d1d/f21 [695978,100239] 0 2024-02-15T22:40:43.649 INFO:tasks.workunit.client.0.smithi033.stdout:9/132: fsync d4/f16 0 2024-02-15T22:40:43.649 INFO:tasks.workunit.client.0.smithi033.stdout:9/133: truncate d4/f29 818862 0 2024-02-15T22:40:43.651 INFO:tasks.workunit.client.0.smithi033.stdout:0/200: rename f6 to db/d19/d32/f48 0 2024-02-15T22:40:43.652 INFO:tasks.workunit.client.0.smithi033.stdout:9/134: dread f2 [0,4194304] 0 2024-02-15T22:40:43.654 INFO:tasks.workunit.client.0.smithi033.stdout:2/234: symlink d1/d16/d3f/l44 0 2024-02-15T22:40:43.654 INFO:tasks.workunit.client.0.smithi033.stdout:2/235: readlink d1/d16/d3f/l44 0 2024-02-15T22:40:43.657 INFO:tasks.workunit.client.0.smithi033.stdout:1/171: mkdir d1/de/d27/d28/d2d/d36 0 2024-02-15T22:40:43.660 INFO:tasks.workunit.client.0.smithi033.stdout:9/135: read d4/f13 [3681271,130953] 0 2024-02-15T22:40:43.667 INFO:tasks.workunit.client.0.smithi033.stdout:0/201: symlink db/d19/l49 0 2024-02-15T22:40:43.667 INFO:tasks.workunit.client.0.smithi033.stdout:0/202: chown db/d19/d32/l35 29 1 2024-02-15T22:40:43.668 INFO:tasks.workunit.client.0.smithi033.stdout:0/203: dread db/d19/f1f [0,4194304] 0 2024-02-15T22:40:43.668 INFO:tasks.workunit.client.0.smithi033.stdout:0/204: dread - db/d19/d32/d3d/f45 zero size 2024-02-15T22:40:43.670 INFO:tasks.workunit.client.0.smithi033.stdout:0/205: dread db/d19/f1a [0,4194304] 0 2024-02-15T22:40:43.670 INFO:tasks.workunit.client.0.smithi033.stdout:0/206: dread - db/d19/d32/d3d/f45 zero size 2024-02-15T22:40:43.671 INFO:tasks.workunit.client.0.smithi033.stdout:2/236: mknod d1/d8/c45 0 2024-02-15T22:40:43.671 INFO:tasks.workunit.client.0.smithi033.stdout:2/237: fsync d1/d16/f22 0 2024-02-15T22:40:43.673 INFO:tasks.workunit.client.0.smithi033.stdout:1/172: mkdir d1/de/d27/d28/d37 0 2024-02-15T22:40:43.674 INFO:tasks.workunit.client.0.smithi033.stdout:2/238: dread d1/d16/f22 [0,4194304] 0 2024-02-15T22:40:43.675 INFO:tasks.workunit.client.0.smithi033.stdout:2/239: chown d1/d8/d2b/d2f/d12/f27 10881 1 2024-02-15T22:40:43.675 INFO:tasks.workunit.client.0.smithi033.stdout:2/240: chown d1/f7 2 1 2024-02-15T22:40:43.675 INFO:tasks.workunit.client.0.smithi033.stdout:9/136: dwrite d4/f5 [4194304,4194304] 0 2024-02-15T22:40:43.675 INFO:tasks.workunit.client.0.smithi033.stdout:0/207: mknod db/d19/c4a 0 2024-02-15T22:40:43.677 INFO:tasks.workunit.client.0.smithi033.stdout:2/241: mkdir d1/d8/d46 0 2024-02-15T22:40:43.677 INFO:tasks.workunit.client.0.smithi033.stdout:2/242: write d1/d8/d2b/d2f/d12/f42 [461761,103557] 0 2024-02-15T22:40:43.678 INFO:tasks.workunit.client.0.smithi033.stdout:2/243: write d1/d8/d2b/d2f/d12/f27 [1042074,59082] 0 2024-02-15T22:40:43.680 INFO:tasks.workunit.client.0.smithi033.stdout:6/205: truncate d12/d2c/d30/d1d/f33 2594600 0 2024-02-15T22:40:43.684 INFO:tasks.workunit.client.0.smithi033.stdout:9/137: rmdir d4/d1d/d23/d24 39 2024-02-15T22:40:43.688 INFO:tasks.workunit.client.0.smithi033.stdout:6/206: unlink ff 0 2024-02-15T22:40:43.688 INFO:tasks.workunit.client.0.smithi033.stdout:6/207: fsync d12/d2c/d30/d19/f21 0 2024-02-15T22:40:43.695 INFO:tasks.workunit.client.0.smithi033.stdout:0/208: dwrite db/d19/f3a [0,4194304] 0 2024-02-15T22:40:43.695 INFO:tasks.workunit.client.0.smithi033.stdout:0/209: chown fa 345290334 1 2024-02-15T22:40:43.695 INFO:tasks.workunit.client.0.smithi033.stdout:2/244: dread d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:43.695 INFO:tasks.workunit.client.0.smithi033.stdout:2/245: fsync d1/d8/d2b/d2f/d12/f15 0 2024-02-15T22:40:43.708 INFO:tasks.workunit.client.0.smithi033.stdout:0/210: symlink db/d19/l4b 0 2024-02-15T22:40:43.710 INFO:tasks.workunit.client.0.smithi033.stdout:2/246: read d1/d8/d2b/d2f/fb [18219630,102678] 0 2024-02-15T22:40:43.710 INFO:tasks.workunit.client.0.smithi033.stdout:9/138: dwrite d4/f8 [4194304,4194304] 0 2024-02-15T22:40:43.710 INFO:tasks.workunit.client.0.smithi033.stdout:9/139: dread - d4/fd zero size 2024-02-15T22:40:43.710 INFO:tasks.workunit.client.0.smithi033.stdout:9/140: fdatasync d4/f19 0 2024-02-15T22:40:43.716 INFO:tasks.workunit.client.0.smithi033.stdout:2/247: link d1/d8/c45 d1/d16/c47 0 2024-02-15T22:40:43.717 INFO:tasks.workunit.client.0.smithi033.stdout:2/248: dread d1/d8/d2b/d2f/d13/f3b [0,4194304] 0 2024-02-15T22:40:43.718 INFO:tasks.workunit.client.0.smithi033.stdout:2/249: truncate d1/d8/d2b/d2f/d24/d31/f33 1577147 0 2024-02-15T22:40:43.718 INFO:tasks.workunit.client.0.smithi033.stdout:2/250: truncate d1/d8/d2b/d2f/d24/d31/f33 1621738 0 2024-02-15T22:40:43.718 INFO:tasks.workunit.client.0.smithi033.stdout:2/251: write d1/d8/d2b/d2f/d24/d31/f33 [1755673,72513] 0 2024-02-15T22:40:43.718 INFO:tasks.workunit.client.0.smithi033.stdout:2/252: chown d1/c14 5 1 2024-02-15T22:40:43.718 INFO:tasks.workunit.client.0.smithi033.stdout:2/253: write d1/d8/fe [9590341,31703] 0 2024-02-15T22:40:43.718 INFO:tasks.workunit.client.0.smithi033.stdout:2/254: creat d1/f48 x:0 0 0 2024-02-15T22:40:43.722 INFO:tasks.workunit.client.0.smithi033.stdout:0/211: rmdir db/d19/d32/d3d 39 2024-02-15T22:40:43.722 INFO:tasks.workunit.client.0.smithi033.stdout:0/212: dread - db/d2a/f40 zero size 2024-02-15T22:40:43.726 INFO:tasks.workunit.client.0.smithi033.stdout:2/255: dread d1/d8/d2b/d2f/d12/f15 [0,4194304] 0 2024-02-15T22:40:43.735 INFO:tasks.workunit.client.0.smithi033.stdout:9/141: rmdir d4/d1d 39 2024-02-15T22:40:43.735 INFO:tasks.workunit.client.0.smithi033.stdout:9/142: fdatasync d4/fe 0 2024-02-15T22:40:43.735 INFO:tasks.workunit.client.0.smithi033.stdout:9/143: chown d4/l1f 19 1 2024-02-15T22:40:43.738 INFO:tasks.workunit.client.0.smithi033.stdout:0/213: mknod db/d19/d32/d46/c4c 0 2024-02-15T22:40:43.741 INFO:tasks.workunit.client.0.smithi033.stdout:2/256: dwrite d1/d8/f19 [0,4194304] 0 2024-02-15T22:40:43.741 INFO:tasks.workunit.client.0.smithi033.stdout:2/257: chown d1/d16/c28 1 1 2024-02-15T22:40:43.746 INFO:tasks.workunit.client.0.smithi033.stdout:9/144: rename d4/f1a to d4/d1d/d23/d24/f2b 0 2024-02-15T22:40:43.747 INFO:tasks.workunit.client.0.smithi033.stdout:0/214: dread db/f18 [0,4194304] 0 2024-02-15T22:40:43.754 INFO:tasks.workunit.client.0.smithi033.stdout:9/145: write d4/fe [3322630,128952] 0 2024-02-15T22:40:43.754 INFO:tasks.workunit.client.0.smithi033.stdout:9/146: fsync d4/f19 0 2024-02-15T22:40:43.754 INFO:tasks.workunit.client.0.smithi033.stdout:9/147: write d4/d1d/d23/d24/f2b [779336,22672] 0 2024-02-15T22:40:43.770 INFO:tasks.workunit.client.0.smithi033.stdout:0/215: symlink db/d2a/l4d 0 2024-02-15T22:40:43.774 INFO:tasks.workunit.client.0.smithi033.stdout:9/148: truncate d4/ff 4186108 0 2024-02-15T22:40:43.779 INFO:tasks.workunit.client.0.smithi033.stdout:0/216: dread db/d19/d32/f23 [4194304,4194304] 0 2024-02-15T22:40:43.779 INFO:tasks.workunit.client.0.smithi033.stdout:0/217: fsync db/d19/d32/d3d/f44 0 2024-02-15T22:40:43.780 INFO:tasks.workunit.client.0.smithi033.stdout:9/149: creat d4/d1d/f2c x:0 0 0 2024-02-15T22:40:43.782 INFO:tasks.workunit.client.0.smithi033.stdout:0/218: mknod db/d19/c4e 0 2024-02-15T22:40:43.785 INFO:tasks.workunit.client.0.smithi033.stdout:2/258: truncate d1/f2 8391527 0 2024-02-15T22:40:43.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/219: rename db/f33 to db/d19/d32/d46/f4f 0 2024-02-15T22:40:43.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/220: write db/d19/d32/f3c [103932,36454] 0 2024-02-15T22:40:43.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/221: truncate f5 5078784 0 2024-02-15T22:40:43.814 INFO:tasks.workunit.client.0.smithi033.stdout:2/259: dwrite d1/d8/d2b/d2f/d12/f42 [0,4194304] 0 2024-02-15T22:40:43.816 INFO:tasks.workunit.client.0.smithi033.stdout:0/222: dwrite db/d19/d32/d3d/f3b [0,4194304] 0 2024-02-15T22:40:43.825 INFO:tasks.workunit.client.0.smithi033.stdout:0/223: dread db/d19/f21 [0,4194304] 0 2024-02-15T22:40:43.828 INFO:tasks.workunit.client.0.smithi033.stdout:9/150: write d4/ff [3925420,11134] 0 2024-02-15T22:40:43.830 INFO:tasks.workunit.client.0.smithi033.stdout:2/260: dwrite d1/d8/d2b/d2f/f1e [0,4194304] 0 2024-02-15T22:40:43.830 INFO:tasks.workunit.client.0.smithi033.stdout:2/261: fsync d1/f48 0 2024-02-15T22:40:43.845 INFO:tasks.workunit.client.0.smithi033.stdout:2/262: rmdir d1/d16 39 2024-02-15T22:40:43.847 INFO:tasks.workunit.client.0.smithi033.stdout:0/224: dwrite db/d19/f21 [4194304,4194304] 0 2024-02-15T22:40:43.847 INFO:tasks.workunit.client.0.smithi033.stdout:0/225: readlink db/d19/d32/l26 0 2024-02-15T22:40:43.847 INFO:tasks.workunit.client.0.smithi033.stdout:0/226: readlink db/d19/l1d 0 2024-02-15T22:40:43.847 INFO:tasks.workunit.client.0.smithi033.stdout:0/227: write db/d19/d32/f3c [524740,65754] 0 2024-02-15T22:40:43.848 INFO:tasks.workunit.client.0.smithi033.stdout:9/151: getdents d4 0 2024-02-15T22:40:43.852 INFO:tasks.workunit.client.0.smithi033.stdout:2/263: link d1/d8/d2b/d2f/d24/d31/f3e d1/d8/d2b/d2f/d13/f49 0 2024-02-15T22:40:43.852 INFO:tasks.workunit.client.0.smithi033.stdout:2/264: stat d1/d8/d2b/d2f/f1e 0 2024-02-15T22:40:43.852 INFO:tasks.workunit.client.0.smithi033.stdout:2/265: readlink d1/d16/l18 0 2024-02-15T22:40:43.852 INFO:tasks.workunit.client.0.smithi033.stdout:2/266: chown d1/d8/d2b/d2f/d24/d31/f3e 6778200 1 2024-02-15T22:40:43.856 INFO:tasks.workunit.client.0.smithi033.stdout:0/228: link db/d19/c4a db/d2a/c50 0 2024-02-15T22:40:43.860 INFO:tasks.workunit.client.0.smithi033.stdout:2/267: mknod d1/d8/d2b/c4a 0 2024-02-15T22:40:43.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/268: creat d1/d16/d3f/f4b x:0 0 0 2024-02-15T22:40:43.883 INFO:tasks.workunit.client.0.smithi033.stdout:0/229: dwrite db/d19/f3f [0,4194304] 0 2024-02-15T22:40:43.888 INFO:tasks.workunit.client.0.smithi033.stdout:0/230: rename db/d19/d32/c2c to db/c51 0 2024-02-15T22:40:43.888 INFO:tasks.workunit.client.0.smithi033.stdout:0/231: chown db/d19/c4e 118 1 2024-02-15T22:40:43.888 INFO:tasks.workunit.client.0.smithi033.stdout:0/232: readlink db/d19/l27 0 2024-02-15T22:40:43.888 INFO:tasks.workunit.client.0.smithi033.stdout:2/269: dwrite d1/d8/d2b/d2f/d13/f1c [0,4194304] 0 2024-02-15T22:40:43.891 INFO:tasks.workunit.client.0.smithi033.stdout:2/270: rmdir d1/d16 39 2024-02-15T22:40:43.891 INFO:tasks.workunit.client.0.smithi033.stdout:2/271: stat d1/d8/d2b/d2f/d38/c3c 0 2024-02-15T22:40:43.891 INFO:tasks.workunit.client.0.smithi033.stdout:2/272: fdatasync d1/d8/d2b/d2f/d12/f42 0 2024-02-15T22:40:43.896 INFO:tasks.workunit.client.0.smithi033.stdout:2/273: rename d1/d8/d2b/d2f/d12/c41 to d1/d8/d46/c4c 0 2024-02-15T22:40:43.896 INFO:tasks.workunit.client.0.smithi033.stdout:2/274: fdatasync d1/d8/d2b/d2f/d12/f42 0 2024-02-15T22:40:43.906 INFO:tasks.workunit.client.0.smithi033.stdout:0/233: dwrite db/d19/f1a [0,4194304] 0 2024-02-15T22:40:43.906 INFO:tasks.workunit.client.0.smithi033.stdout:0/234: write db/d2a/f40 [555609,67380] 0 2024-02-15T22:40:43.913 INFO:tasks.workunit.client.0.smithi033.stdout:2/275: dwrite d1/d8/d2b/d2f/d13/f17 [0,4194304] 0 2024-02-15T22:40:43.934 INFO:tasks.workunit.client.0.smithi033.stdout:2/276: dwrite d1/d8/fe [8388608,4194304] 0 2024-02-15T22:40:43.937 INFO:tasks.workunit.client.0.smithi033.stdout:0/235: symlink db/d19/d32/d3d/l52 0 2024-02-15T22:40:43.937 INFO:tasks.workunit.client.0.smithi033.stdout:0/236: write fa [1468511,108863] 0 2024-02-15T22:40:43.953 INFO:tasks.workunit.client.0.smithi033.stdout:2/277: unlink d1/d8/f19 0 2024-02-15T22:40:43.955 INFO:tasks.workunit.client.0.smithi033.stdout:0/237: getdents db/d19/d32 0 2024-02-15T22:40:43.955 INFO:tasks.workunit.client.0.smithi033.stdout:0/238: fdatasync f4 0 2024-02-15T22:40:43.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/278: mknod d1/d8/d2b/d2f/d3d/c4d 0 2024-02-15T22:40:43.958 INFO:tasks.workunit.client.0.smithi033.stdout:0/239: creat db/d19/d32/d46/f53 x:0 0 0 2024-02-15T22:40:43.961 INFO:tasks.workunit.client.0.smithi033.stdout:2/279: mkdir d1/d16/d3f/d4e 0 2024-02-15T22:40:43.986 INFO:tasks.workunit.client.0.smithi033.stdout:0/240: dwrite db/d19/f1e [0,4194304] 0 2024-02-15T22:40:43.986 INFO:tasks.workunit.client.0.smithi033.stdout:0/241: truncate db/d19/f1f 1035373 0 2024-02-15T22:40:43.987 INFO:tasks.workunit.client.0.smithi033.stdout:2/280: dwrite d1/d8/fe [0,4194304] 0 2024-02-15T22:40:43.995 INFO:tasks.workunit.client.0.smithi033.stdout:2/281: dread d1/d8/d2b/d2f/f1e [0,4194304] 0 2024-02-15T22:40:43.998 INFO:tasks.workunit.client.0.smithi033.stdout:2/282: rename d1/d8/c2d to d1/d8/d2b/d2f/d13/c4f 0 2024-02-15T22:40:43.998 INFO:tasks.workunit.client.0.smithi033.stdout:2/283: chown d1/d8/d2b/d2f/d24/d2a/l3a 13317339 1 2024-02-15T22:40:44.001 INFO:tasks.workunit.client.0.smithi033.stdout:2/284: dread d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:44.001 INFO:tasks.workunit.client.0.smithi033.stdout:0/242: dwrite db/d19/f3a [0,4194304] 0 2024-02-15T22:40:44.006 INFO:tasks.workunit.client.0.smithi033.stdout:0/243: rename db/d19/d32/d3d/f3b to db/d19/d32/d46/f54 0 2024-02-15T22:40:44.007 INFO:tasks.workunit.client.0.smithi033.stdout:0/244: fsync db/d19/d32/d46/f4f 0 2024-02-15T22:40:44.007 INFO:tasks.workunit.client.0.smithi033.stdout:0/245: chown db/d19/d32/d3d/l52 2 1 2024-02-15T22:40:44.010 INFO:tasks.workunit.client.0.smithi033.stdout:8/157: sync 2024-02-15T22:40:44.010 INFO:tasks.workunit.client.0.smithi033.stdout:8/158: truncate d1/de/f37 57652 0 2024-02-15T22:40:44.010 INFO:tasks.workunit.client.0.smithi033.stdout:3/157: sync 2024-02-15T22:40:44.011 INFO:tasks.workunit.client.0.smithi033.stdout:0/246: getdents db 0 2024-02-15T22:40:44.016 INFO:tasks.workunit.client.0.smithi033.stdout:3/158: rename d0/f24 to d0/d3/d2c/f2f 0 2024-02-15T22:40:44.030 INFO:tasks.workunit.client.0.smithi033.stdout:3/159: unlink d0/d3/l14 0 2024-02-15T22:40:44.033 INFO:tasks.workunit.client.0.smithi033.stdout:8/159: dwrite d1/de/f1c [0,4194304] 0 2024-02-15T22:40:44.034 INFO:tasks.workunit.client.0.smithi033.stdout:0/247: dwrite db/f18 [0,4194304] 0 2024-02-15T22:40:44.034 INFO:tasks.workunit.client.0.smithi033.stdout:0/248: chown db/d2a 14212908 1 2024-02-15T22:40:44.034 INFO:tasks.workunit.client.0.smithi033.stdout:3/160: rmdir d0/d1c 39 2024-02-15T22:40:44.039 INFO:tasks.workunit.client.0.smithi033.stdout:8/160: symlink d1/d6/d14/l3f 0 2024-02-15T22:40:44.040 INFO:tasks.workunit.client.0.smithi033.stdout:3/161: mknod d0/d3/dd/c30 0 2024-02-15T22:40:44.042 INFO:tasks.workunit.client.0.smithi033.stdout:8/161: mkdir d1/de/d1a/d2a/d40 0 2024-02-15T22:40:44.045 INFO:tasks.workunit.client.0.smithi033.stdout:0/249: write db/f18 [794441,100446] 0 2024-02-15T22:40:44.045 INFO:tasks.workunit.client.0.smithi033.stdout:3/162: mknod d0/d8/c31 0 2024-02-15T22:40:44.045 INFO:tasks.workunit.client.0.smithi033.stdout:3/163: write d0/f16 [1166557,62603] 0 2024-02-15T22:40:44.048 INFO:tasks.workunit.client.0.smithi033.stdout:8/162: creat d1/d36/f41 x:0 0 0 2024-02-15T22:40:44.048 INFO:tasks.workunit.client.0.smithi033.stdout:3/164: dread d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:44.048 INFO:tasks.workunit.client.0.smithi033.stdout:8/163: dread - d1/de/d1a/d2a/f30 zero size 2024-02-15T22:40:44.053 INFO:tasks.workunit.client.0.smithi033.stdout:0/250: write db/d19/f1a [4178452,66492] 0 2024-02-15T22:40:44.054 INFO:tasks.workunit.client.0.smithi033.stdout:8/164: mknod d1/de/d1a/d2a/c42 0 2024-02-15T22:40:44.055 INFO:tasks.workunit.client.0.smithi033.stdout:8/165: fsync d1/de/d1a/f20 0 2024-02-15T22:40:44.055 INFO:tasks.workunit.client.0.smithi033.stdout:8/166: creat d1/d36/f43 x:0 0 0 2024-02-15T22:40:44.060 INFO:tasks.workunit.client.0.smithi033.stdout:2/285: getdents d1/d8/d2b/d2f/d13 0 2024-02-15T22:40:44.066 INFO:tasks.workunit.client.0.smithi033.stdout:2/286: dread d1/d8/d2b/d2f/f1e [0,4194304] 0 2024-02-15T22:40:44.066 INFO:tasks.workunit.client.0.smithi033.stdout:2/287: chown d1/d8/c35 19 1 2024-02-15T22:40:44.066 INFO:tasks.workunit.client.0.smithi033.stdout:2/288: fsync d1/f2 0 2024-02-15T22:40:44.066 INFO:tasks.workunit.client.0.smithi033.stdout:2/289: fdatasync d1/d8/d2b/d2f/d12/f15 0 2024-02-15T22:40:44.066 INFO:tasks.workunit.client.0.smithi033.stdout:2/290: readlink d1/d8/l36 0 2024-02-15T22:40:44.072 INFO:tasks.workunit.client.0.smithi033.stdout:3/165: link d0/d3/d2c/f2f d0/d1c/f32 0 2024-02-15T22:40:44.072 INFO:tasks.workunit.client.0.smithi033.stdout:3/166: write d0/d3/f22 [864122,12395] 0 2024-02-15T22:40:44.072 INFO:tasks.workunit.client.0.smithi033.stdout:3/167: fdatasync d0/d3/f17 0 2024-02-15T22:40:44.073 INFO:tasks.workunit.client.0.smithi033.stdout:0/251: dwrite db/d19/d32/d46/f4f [0,4194304] 0 2024-02-15T22:40:44.076 INFO:tasks.workunit.client.0.smithi033.stdout:3/168: truncate d0/d3/f21 3264122 0 2024-02-15T22:40:44.082 INFO:tasks.workunit.client.0.smithi033.stdout:0/252: mknod db/c55 0 2024-02-15T22:40:44.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/169: link d0/d8/la d0/d8/l33 0 2024-02-15T22:40:44.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/170: chown d0/d3/f17 10 1 2024-02-15T22:40:44.087 INFO:tasks.workunit.client.0.smithi033.stdout:0/253: mknod db/d19/d32/d43/c56 0 2024-02-15T22:40:44.094 INFO:tasks.workunit.client.0.smithi033.stdout:0/254: unlink db/d19/d32/c24 0 2024-02-15T22:40:44.105 INFO:tasks.workunit.client.0.smithi033.stdout:3/171: dwrite d0/fe [0,4194304] 0 2024-02-15T22:40:44.107 INFO:tasks.workunit.client.0.smithi033.stdout:0/255: write db/d19/f1e [556853,47189] 0 2024-02-15T22:40:44.107 INFO:tasks.workunit.client.0.smithi033.stdout:0/256: chown db/d2a/c50 215 1 2024-02-15T22:40:44.113 INFO:tasks.workunit.client.0.smithi033.stdout:3/172: unlink d0/c2b 0 2024-02-15T22:40:44.113 INFO:tasks.workunit.client.0.smithi033.stdout:3/173: truncate d0/d3/f22 1783947 0 2024-02-15T22:40:44.113 INFO:tasks.workunit.client.0.smithi033.stdout:3/174: dread - d0/d1c/f25 zero size 2024-02-15T22:40:44.116 INFO:tasks.workunit.client.0.smithi033.stdout:0/257: symlink db/d19/d32/l57 0 2024-02-15T22:40:44.117 INFO:tasks.workunit.client.0.smithi033.stdout:0/258: readlink db/l15 0 2024-02-15T22:40:44.119 INFO:tasks.workunit.client.0.smithi033.stdout:3/175: rename d0/d3/dd/f23 to d0/d3/d2c/f34 0 2024-02-15T22:40:44.120 INFO:tasks.workunit.client.0.smithi033.stdout:3/176: chown d0/d3/f17 7699656 1 2024-02-15T22:40:44.122 INFO:tasks.workunit.client.0.smithi033.stdout:3/177: symlink d0/l35 0 2024-02-15T22:40:44.122 INFO:tasks.workunit.client.0.smithi033.stdout:3/178: creat d0/f36 x:0 0 0 2024-02-15T22:40:44.131 INFO:tasks.workunit.client.0.smithi033.stdout:3/179: dread d0/f19 [0,4194304] 0 2024-02-15T22:40:44.134 INFO:tasks.workunit.client.0.smithi033.stdout:3/180: truncate d0/d3/d2c/f2f 2596034 0 2024-02-15T22:40:44.134 INFO:tasks.workunit.client.0.smithi033.stdout:3/181: fsync d0/f16 0 2024-02-15T22:40:44.136 INFO:tasks.workunit.client.0.smithi033.stdout:0/259: dwrite db/d19/d32/f23 [4194304,4194304] 0 2024-02-15T22:40:44.136 INFO:tasks.workunit.client.0.smithi033.stdout:0/260: readlink db/d19/d32/l20 0 2024-02-15T22:40:44.139 INFO:tasks.workunit.client.0.smithi033.stdout:3/182: creat d0/d8/f37 x:0 0 0 2024-02-15T22:40:44.139 INFO:tasks.workunit.client.0.smithi033.stdout:3/183: read d0/f19 [3250390,103721] 0 2024-02-15T22:40:44.139 INFO:tasks.workunit.client.0.smithi033.stdout:3/184: creat d0/d8/f38 x:0 0 0 2024-02-15T22:40:44.139 INFO:tasks.workunit.client.0.smithi033.stdout:3/185: readlink d0/d3/dd/l15 0 2024-02-15T22:40:44.139 INFO:tasks.workunit.client.0.smithi033.stdout:3/186: chown d0/d3/dd/f18 35 1 2024-02-15T22:40:44.141 INFO:tasks.workunit.client.0.smithi033.stdout:0/261: symlink db/l58 0 2024-02-15T22:40:44.141 INFO:tasks.workunit.client.0.smithi033.stdout:0/262: write db/d19/f1f [1364087,131056] 0 2024-02-15T22:40:44.150 INFO:tasks.workunit.client.0.smithi033.stdout:0/263: creat db/d19/d32/d3d/f59 x:0 0 0 2024-02-15T22:40:44.157 INFO:tasks.workunit.client.0.smithi033.stdout:3/187: dwrite d0/f36 [0,4194304] 0 2024-02-15T22:40:44.162 INFO:tasks.workunit.client.0.smithi033.stdout:0/264: write db/d2a/f2b [3050960,32112] 0 2024-02-15T22:40:44.168 INFO:tasks.workunit.client.0.smithi033.stdout:3/188: getdents d0/d3/d2c 0 2024-02-15T22:40:44.168 INFO:tasks.workunit.client.0.smithi033.stdout:3/189: stat d0/d3/f22 0 2024-02-15T22:40:44.172 INFO:tasks.workunit.client.0.smithi033.stdout:3/190: mknod d0/d1c/c39 0 2024-02-15T22:40:44.172 INFO:tasks.workunit.client.0.smithi033.stdout:3/191: chown d0/f1f 0 1 2024-02-15T22:40:44.186 INFO:tasks.workunit.client.0.smithi033.stdout:0/265: dwrite db/d2a/f2b [4194304,4194304] 0 2024-02-15T22:40:44.189 INFO:tasks.workunit.client.0.smithi033.stdout:3/192: dwrite d0/d3/f21 [0,4194304] 0 2024-02-15T22:40:44.193 INFO:tasks.workunit.client.0.smithi033.stdout:3/193: rmdir d0/d3/d2c 39 2024-02-15T22:40:44.196 INFO:tasks.workunit.client.0.smithi033.stdout:3/194: mknod d0/d3/c3a 0 2024-02-15T22:40:44.209 INFO:tasks.workunit.client.0.smithi033.stdout:3/195: dwrite d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:44.225 INFO:tasks.workunit.client.0.smithi033.stdout:3/196: dwrite d0/f36 [0,4194304] 0 2024-02-15T22:40:44.248 INFO:tasks.workunit.client.0.smithi033.stdout:3/197: dwrite d0/f7 [0,4194304] 0 2024-02-15T22:40:44.255 INFO:tasks.workunit.client.0.smithi033.stdout:7/255: sync 2024-02-15T22:40:44.262 INFO:tasks.workunit.client.0.smithi033.stdout:3/198: dwrite d0/d3/d2c/f2f [0,4194304] 0 2024-02-15T22:40:44.270 INFO:tasks.workunit.client.0.smithi033.stdout:3/199: mkdir d0/d3/d3b 0 2024-02-15T22:40:44.270 INFO:tasks.workunit.client.0.smithi033.stdout:3/200: chown d0/d3/f21 161892 1 2024-02-15T22:40:44.273 INFO:tasks.workunit.client.0.smithi033.stdout:3/201: creat d0/d3/d3b/f3c x:0 0 0 2024-02-15T22:40:44.273 INFO:tasks.workunit.client.0.smithi033.stdout:3/202: stat d0/d3/c3a 0 2024-02-15T22:40:44.280 INFO:tasks.workunit.client.0.smithi033.stdout:3/203: read d0/d1c/f32 [4057915,62084] 0 2024-02-15T22:40:44.283 INFO:tasks.workunit.client.0.smithi033.stdout:3/204: mkdir d0/d8/d3d 0 2024-02-15T22:40:44.291 INFO:tasks.workunit.client.0.smithi033.stdout:3/205: dread d0/f36 [0,4194304] 0 2024-02-15T22:40:44.298 INFO:tasks.workunit.client.0.smithi033.stdout:3/206: read d0/f1f [3696339,24602] 0 2024-02-15T22:40:44.298 INFO:tasks.workunit.client.0.smithi033.stdout:3/207: truncate d0/d1c/f29 831652 0 2024-02-15T22:40:44.300 INFO:tasks.workunit.client.0.smithi033.stdout:3/208: symlink d0/d1c/l3e 0 2024-02-15T22:40:44.300 INFO:tasks.workunit.client.0.smithi033.stdout:3/209: readlink d0/l2e 0 2024-02-15T22:40:44.301 INFO:tasks.workunit.client.0.smithi033.stdout:3/210: write d0/f16 [988370,97505] 0 2024-02-15T22:40:44.301 INFO:tasks.workunit.client.0.smithi033.stdout:3/211: truncate d0/f19 4751360 0 2024-02-15T22:40:44.308 INFO:tasks.workunit.client.0.smithi033.stdout:3/212: dread d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:44.310 INFO:tasks.workunit.client.0.smithi033.stdout:3/213: mknod d0/d1c/c3f 0 2024-02-15T22:40:44.313 INFO:tasks.workunit.client.0.smithi033.stdout:3/214: rename d0/d3/f21 to d0/d3/f40 0 2024-02-15T22:40:44.319 INFO:tasks.workunit.client.0.smithi033.stdout:3/215: dread d0/d3/f40 [0,4194304] 0 2024-02-15T22:40:44.320 INFO:tasks.workunit.client.0.smithi033.stdout:3/216: creat d0/d3/f41 x:0 0 0 2024-02-15T22:40:44.321 INFO:tasks.workunit.client.0.smithi033.stdout:5/276: sync 2024-02-15T22:40:44.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/217: write d0/f36 [969628,112008] 0 2024-02-15T22:40:44.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/218: getdents d0/d3/d2c 0 2024-02-15T22:40:44.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/219: chown d0/d3/dd/c1a 334 1 2024-02-15T22:40:44.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/220: write d0/d3/f22 [1884567,49712] 0 2024-02-15T22:40:44.325 INFO:tasks.workunit.client.0.smithi033.stdout:5/277: link d6/ff d6/d25/f5d 0 2024-02-15T22:40:44.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/221: rename d0/f16 to d0/f42 0 2024-02-15T22:40:44.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/222: write d0/d1c/f25 [683364,11386] 0 2024-02-15T22:40:44.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/223: write d0/d1c/f32 [2451641,46986] 0 2024-02-15T22:40:44.330 INFO:tasks.workunit.client.0.smithi033.stdout:3/224: chown d0/d1c/c2a 34 1 2024-02-15T22:40:44.333 INFO:tasks.workunit.client.0.smithi033.stdout:3/225: dread d0/d3/f40 [0,4194304] 0 2024-02-15T22:40:44.335 INFO:tasks.workunit.client.0.smithi033.stdout:3/226: mkdir d0/d3/d2c/d43 0 2024-02-15T22:40:44.336 INFO:tasks.workunit.client.0.smithi033.stdout:3/227: chown d0/d8 1731 1 2024-02-15T22:40:44.344 INFO:tasks.workunit.client.0.smithi033.stdout:5/278: dwrite d6/d14/f3e [0,4194304] 0 2024-02-15T22:40:44.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/279: dread d6/fb [0,4194304] 0 2024-02-15T22:40:44.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/280: chown d6/d14/f2e 1903347553 1 2024-02-15T22:40:44.358 INFO:tasks.workunit.client.0.smithi033.stdout:3/228: dwrite d0/d8/f37 [0,4194304] 0 2024-02-15T22:40:44.369 INFO:tasks.workunit.client.0.smithi033.stdout:5/281: creat d6/d14/d31/d48/f5e x:0 0 0 2024-02-15T22:40:44.378 INFO:tasks.workunit.client.0.smithi033.stdout:5/282: write d6/fe [7875074,59876] 0 2024-02-15T22:40:44.381 INFO:tasks.workunit.client.0.smithi033.stdout:5/283: dread d6/d14/f19 [0,4194304] 0 2024-02-15T22:40:44.383 INFO:tasks.workunit.client.0.smithi033.stdout:3/229: rmdir d0/d3/d2c 39 2024-02-15T22:40:44.383 INFO:tasks.workunit.client.0.smithi033.stdout:3/230: chown d0/d3/dd/c30 18652926 1 2024-02-15T22:40:44.410 INFO:tasks.workunit.client.0.smithi033.stdout:5/284: creat d6/d14/d31/d50/d5c/f5f x:0 0 0 2024-02-15T22:40:44.410 INFO:tasks.workunit.client.0.smithi033.stdout:5/285: read - d6/d14/d31/d48/d59/f54 zero size 2024-02-15T22:40:44.410 INFO:tasks.workunit.client.0.smithi033.stdout:5/286: fsync d6/d25/f29 0 2024-02-15T22:40:44.410 INFO:tasks.workunit.client.0.smithi033.stdout:5/287: chown d6/d14/d31/d50/d5c 274299 1 2024-02-15T22:40:44.413 INFO:tasks.workunit.client.0.smithi033.stdout:5/288: getdents d6/d14/d31/d48/d59 0 2024-02-15T22:40:44.417 INFO:tasks.workunit.client.0.smithi033.stdout:5/289: rmdir d6/d14/d31/d50 39 2024-02-15T22:40:44.420 INFO:tasks.workunit.client.0.smithi033.stdout:3/231: dwrite d0/f7 [0,4194304] 0 2024-02-15T22:40:44.422 INFO:tasks.workunit.client.0.smithi033.stdout:5/290: link d6/d14/d31/c51 d6/d14/d31/d48/d59/c60 0 2024-02-15T22:40:44.422 INFO:tasks.workunit.client.0.smithi033.stdout:5/291: write d6/d25/f55 [799504,117274] 0 2024-02-15T22:40:44.433 INFO:tasks.workunit.client.0.smithi033.stdout:3/232: rename d0/d8/f38 to d0/d3/f44 0 2024-02-15T22:40:44.438 INFO:tasks.workunit.client.0.smithi033.stdout:5/292: dwrite d6/d14/f19 [0,4194304] 0 2024-02-15T22:40:44.448 INFO:tasks.workunit.client.0.smithi033.stdout:5/293: creat d6/d14/d31/d48/d49/d53/d57/f61 x:0 0 0 2024-02-15T22:40:44.449 INFO:tasks.workunit.client.0.smithi033.stdout:5/294: write d6/d14/f45 [265620,9603] 0 2024-02-15T22:40:44.449 INFO:tasks.workunit.client.0.smithi033.stdout:5/295: chown d6/d14/d31/c51 6 1 2024-02-15T22:40:44.449 INFO:tasks.workunit.client.0.smithi033.stdout:5/296: fsync d6/d14/d31/d48/d59/f54 0 2024-02-15T22:40:44.449 INFO:tasks.workunit.client.0.smithi033.stdout:5/297: readlink d6/la 0 2024-02-15T22:40:44.450 INFO:tasks.workunit.client.0.smithi033.stdout:3/233: dwrite d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:44.450 INFO:tasks.workunit.client.0.smithi033.stdout:3/234: fdatasync d0/d3/f22 0 2024-02-15T22:40:44.450 INFO:tasks.workunit.client.0.smithi033.stdout:3/235: chown d0/d3/f40 94976459 1 2024-02-15T22:40:44.450 INFO:tasks.workunit.client.0.smithi033.stdout:3/236: write d0/f36 [3803479,111983] 0 2024-02-15T22:40:44.453 INFO:tasks.workunit.client.0.smithi033.stdout:5/298: symlink d6/d14/d31/d48/d59/l62 0 2024-02-15T22:40:44.453 INFO:tasks.workunit.client.0.smithi033.stdout:5/299: dread - d6/d14/d31/f47 zero size 2024-02-15T22:40:44.456 INFO:tasks.workunit.client.0.smithi033.stdout:3/237: creat d0/d3/d2c/d43/f45 x:0 0 0 2024-02-15T22:40:44.461 INFO:tasks.workunit.client.0.smithi033.stdout:5/300: dread d6/f42 [0,4194304] 0 2024-02-15T22:40:44.461 INFO:tasks.workunit.client.0.smithi033.stdout:3/238: unlink d0/d8/l27 0 2024-02-15T22:40:44.464 INFO:tasks.workunit.client.0.smithi033.stdout:5/301: unlink d6/d14/c46 0 2024-02-15T22:40:44.466 INFO:tasks.workunit.client.0.smithi033.stdout:3/239: creat d0/d3/d2c/f46 x:0 0 0 2024-02-15T22:40:44.467 INFO:tasks.workunit.client.0.smithi033.stdout:5/302: mknod d6/d14/d31/d48/d49/c63 0 2024-02-15T22:40:44.469 INFO:tasks.workunit.client.0.smithi033.stdout:3/240: mkdir d0/d3/d3b/d47 0 2024-02-15T22:40:44.473 INFO:tasks.workunit.client.0.smithi033.stdout:3/241: creat d0/d8/d3d/f48 x:0 0 0 2024-02-15T22:40:44.482 INFO:tasks.workunit.client.0.smithi033.stdout:3/242: write d0/d8/f37 [3261337,26302] 0 2024-02-15T22:40:44.482 INFO:tasks.workunit.client.0.smithi033.stdout:3/243: truncate d0/d3/dd/f18 571593 0 2024-02-15T22:40:44.485 INFO:tasks.workunit.client.0.smithi033.stdout:3/244: rename d0/d3/d3b/f3c to d0/d8/f49 0 2024-02-15T22:40:44.500 INFO:tasks.workunit.client.0.smithi033.stdout:3/245: dwrite d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:44.500 INFO:tasks.workunit.client.0.smithi033.stdout:3/246: readlink d0/l35 0 2024-02-15T22:40:44.503 INFO:tasks.workunit.client.0.smithi033.stdout:5/303: truncate d6/d25/f5d 4370772 0 2024-02-15T22:40:44.503 INFO:tasks.workunit.client.0.smithi033.stdout:5/304: dread - d6/d14/d31/d48/d49/d53/d57/f61 zero size 2024-02-15T22:40:44.507 INFO:tasks.workunit.client.0.smithi033.stdout:5/305: mkdir d6/d14/d31/d64 0 2024-02-15T22:40:44.507 INFO:tasks.workunit.client.0.smithi033.stdout:5/306: write d6/d14/d31/f36 [678671,91265] 0 2024-02-15T22:40:44.513 INFO:tasks.workunit.client.0.smithi033.stdout:5/307: symlink d6/d14/d31/d48/d59/l65 0 2024-02-15T22:40:44.515 INFO:tasks.workunit.client.0.smithi033.stdout:3/247: dread d0/fe [0,4194304] 0 2024-02-15T22:40:44.518 INFO:tasks.workunit.client.0.smithi033.stdout:4/157: sync 2024-02-15T22:40:44.518 INFO:tasks.workunit.client.0.smithi033.stdout:4/158: stat d8/l12 0 2024-02-15T22:40:44.520 INFO:tasks.workunit.client.0.smithi033.stdout:3/248: getdents d0/d3/dd 0 2024-02-15T22:40:44.525 INFO:tasks.workunit.client.0.smithi033.stdout:4/159: rename d8/d16/d19/d27/l26 to d8/d16/l33 0 2024-02-15T22:40:44.525 INFO:tasks.workunit.client.0.smithi033.stdout:4/160: write d8/d1f/f21 [853365,130599] 0 2024-02-15T22:40:44.525 INFO:tasks.workunit.client.0.smithi033.stdout:4/161: chown d8/d16/d19 60538068 1 2024-02-15T22:40:44.527 INFO:tasks.workunit.client.0.smithi033.stdout:5/308: dwrite d6/d25/f35 [0,4194304] 0 2024-02-15T22:40:44.527 INFO:tasks.workunit.client.0.smithi033.stdout:5/309: dread - d6/d14/d31/d48/f5e zero size 2024-02-15T22:40:44.531 INFO:tasks.workunit.client.0.smithi033.stdout:4/162: creat d8/d1f/d31/f34 x:0 0 0 2024-02-15T22:40:44.542 INFO:tasks.workunit.client.0.smithi033.stdout:3/249: dwrite d0/d1c/f32 [0,4194304] 0 2024-02-15T22:40:44.546 INFO:tasks.workunit.client.0.smithi033.stdout:3/250: write d0/d3/f40 [3512568,101798] 0 2024-02-15T22:40:44.547 INFO:tasks.workunit.client.0.smithi033.stdout:3/251: creat d0/f4a x:0 0 0 2024-02-15T22:40:44.550 INFO:tasks.workunit.client.0.smithi033.stdout:5/310: dwrite d6/d14/f32 [0,4194304] 0 2024-02-15T22:40:44.550 INFO:tasks.workunit.client.0.smithi033.stdout:5/311: chown d6/d14/f32 17620049 1 2024-02-15T22:40:44.552 INFO:tasks.workunit.client.0.smithi033.stdout:4/163: dwrite f4 [0,4194304] 0 2024-02-15T22:40:44.553 INFO:tasks.workunit.client.0.smithi033.stdout:3/252: mknod d0/d8/c4b 0 2024-02-15T22:40:44.553 INFO:tasks.workunit.client.0.smithi033.stdout:3/253: dread - d0/d3/f41 zero size 2024-02-15T22:40:44.563 INFO:tasks.workunit.client.0.smithi033.stdout:5/312: rename d6/d14/d31/d48/d49/c63 to d6/d14/d31/d50/d5c/c66 0 2024-02-15T22:40:44.569 INFO:tasks.workunit.client.0.smithi033.stdout:3/254: dwrite d0/f13 [0,4194304] 0 2024-02-15T22:40:44.582 INFO:tasks.workunit.client.0.smithi033.stdout:4/164: rename d8/d1f/f22 to d8/d16/d19/d1c/f35 0 2024-02-15T22:40:44.586 INFO:tasks.workunit.client.0.smithi033.stdout:5/313: unlink d6/d14/f20 0 2024-02-15T22:40:44.591 INFO:tasks.workunit.client.0.smithi033.stdout:3/255: dwrite d0/f7 [0,4194304] 0 2024-02-15T22:40:44.597 INFO:tasks.workunit.client.0.smithi033.stdout:4/165: creat d8/d1a/f36 x:0 0 0 2024-02-15T22:40:44.601 INFO:tasks.workunit.client.0.smithi033.stdout:5/314: rename d6/d14/c24 to d6/d14/d31/d38/c67 0 2024-02-15T22:40:44.601 INFO:tasks.workunit.client.0.smithi033.stdout:5/315: dread - d6/d14/f4e zero size 2024-02-15T22:40:44.601 INFO:tasks.workunit.client.0.smithi033.stdout:5/316: truncate d6/d14/f1c 4783341 0 2024-02-15T22:40:44.601 INFO:tasks.workunit.client.0.smithi033.stdout:5/317: chown d6/c9 15769578 1 2024-02-15T22:40:44.602 INFO:tasks.workunit.client.0.smithi033.stdout:5/318: read - d6/d14/f4e zero size 2024-02-15T22:40:44.605 INFO:tasks.workunit.client.0.smithi033.stdout:3/256: rmdir d0/d1c 39 2024-02-15T22:40:44.605 INFO:tasks.workunit.client.0.smithi033.stdout:3/257: chown d0/f42 1193908 1 2024-02-15T22:40:44.610 INFO:tasks.workunit.client.0.smithi033.stdout:3/258: mknod d0/d3/d2c/d43/c4c 0 2024-02-15T22:40:44.614 INFO:tasks.workunit.client.0.smithi033.stdout:1/173: sync 2024-02-15T22:40:44.615 INFO:tasks.workunit.client.0.smithi033.stdout:1/174: dread - d1/de/d27/d28/f2a zero size 2024-02-15T22:40:44.618 INFO:tasks.workunit.client.0.smithi033.stdout:5/319: dwrite d6/d14/f4e [0,4194304] 0 2024-02-15T22:40:44.618 INFO:tasks.workunit.client.0.smithi033.stdout:5/320: chown d6/d14/c4c 120 1 2024-02-15T22:40:44.621 INFO:tasks.workunit.client.0.smithi033.stdout:3/259: symlink d0/d3/dd/l4d 0 2024-02-15T22:40:44.628 INFO:tasks.workunit.client.0.smithi033.stdout:5/321: mknod d6/d25/c68 0 2024-02-15T22:40:44.628 INFO:tasks.workunit.client.0.smithi033.stdout:5/322: creat d6/d14/d31/d48/f69 x:0 0 0 2024-02-15T22:40:44.631 INFO:tasks.workunit.client.0.smithi033.stdout:3/260: mknod d0/c4e 0 2024-02-15T22:40:44.637 INFO:tasks.workunit.client.0.smithi033.stdout:3/261: unlink d0/d3/f22 0 2024-02-15T22:40:44.638 INFO:tasks.workunit.client.0.smithi033.stdout:3/262: dread d0/f19 [4194304,4194304] 0 2024-02-15T22:40:44.641 INFO:tasks.workunit.client.0.smithi033.stdout:3/263: symlink d0/d3/dd/l4f 0 2024-02-15T22:40:44.641 INFO:tasks.workunit.client.0.smithi033.stdout:3/264: write d0/d3/f40 [3823925,48127] 0 2024-02-15T22:40:44.644 INFO:tasks.workunit.client.0.smithi033.stdout:1/175: dwrite d1/de/f16 [0,4194304] 0 2024-02-15T22:40:44.644 INFO:tasks.workunit.client.0.smithi033.stdout:1/176: chown d1/c34 33440907 1 2024-02-15T22:40:44.644 INFO:tasks.workunit.client.0.smithi033.stdout:1/177: truncate d1/f17 747679 0 2024-02-15T22:40:44.644 INFO:tasks.workunit.client.0.smithi033.stdout:1/178: creat d1/de/f38 x:0 0 0 2024-02-15T22:40:44.645 INFO:tasks.workunit.client.0.smithi033.stdout:5/323: dwrite d6/f33 [0,4194304] 0 2024-02-15T22:40:44.645 INFO:tasks.workunit.client.0.smithi033.stdout:3/265: creat d0/d3/d3b/d47/f50 x:0 0 0 2024-02-15T22:40:44.646 INFO:tasks.workunit.client.0.smithi033.stdout:3/266: dread - d0/d3/f44 zero size 2024-02-15T22:40:44.658 INFO:tasks.workunit.client.0.smithi033.stdout:5/324: mkdir d6/d14/d31/d50/d6a 0 2024-02-15T22:40:44.661 INFO:tasks.workunit.client.0.smithi033.stdout:3/267: link d0/d8/c31 d0/d8/c51 0 2024-02-15T22:40:44.664 INFO:tasks.workunit.client.0.smithi033.stdout:6/208: sync 2024-02-15T22:40:44.664 INFO:tasks.workunit.client.0.smithi033.stdout:9/152: sync 2024-02-15T22:40:44.664 INFO:tasks.workunit.client.0.smithi033.stdout:5/325: dread d6/f16 [0,4194304] 0 2024-02-15T22:40:44.664 INFO:tasks.workunit.client.0.smithi033.stdout:5/326: write d6/d14/f1c [5287830,104370] 0 2024-02-15T22:40:44.664 INFO:tasks.workunit.client.0.smithi033.stdout:5/327: chown d6/d25/f55 7339385 1 2024-02-15T22:40:44.664 INFO:tasks.workunit.client.0.smithi033.stdout:5/328: read d6/d14/f1d [838202,62326] 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/329: readlink d6/l18 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/330: write d6/d25/f29 [4811288,69940] 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/331: stat d6/d14/d31/d48/d56 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/332: fsync d6/d14/f32 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/333: write d6/ff [4390038,40601] 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/334: chown d6/f1e 51255470 1 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/335: chown d6/d14 91287448 1 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/336: fdatasync d6/d14/d31/d48/f5e 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/337: creat d6/d14/f6b x:0 0 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:1/179: dwrite d1/de/f1f [0,4194304] 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:1/180: stat d1/f7 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:1/181: truncate d1/f19 1060713 0 2024-02-15T22:40:44.665 INFO:tasks.workunit.client.0.smithi033.stdout:1/182: write d1/de/d27/d28/f2a [456876,69141] 0 2024-02-15T22:40:44.666 INFO:tasks.workunit.client.0.smithi033.stdout:3/268: creat d0/d3/dd/f52 x:0 0 0 2024-02-15T22:40:44.666 INFO:tasks.workunit.client.0.smithi033.stdout:3/269: dread - d0/d3/d2c/d43/f45 zero size 2024-02-15T22:40:44.666 INFO:tasks.workunit.client.0.smithi033.stdout:3/270: creat d0/f53 x:0 0 0 2024-02-15T22:40:44.668 INFO:tasks.workunit.client.0.smithi033.stdout:6/209: chown d12/d2c/d30/f36 210651181 1 2024-02-15T22:40:44.672 INFO:tasks.workunit.client.0.smithi033.stdout:5/338: write d6/f33 [2551653,47814] 0 2024-02-15T22:40:44.672 INFO:tasks.workunit.client.0.smithi033.stdout:5/339: readlink d6/d14/d31/d48/d59/l62 0 2024-02-15T22:40:44.672 INFO:tasks.workunit.client.0.smithi033.stdout:5/340: write d6/d14/d31/f36 [1091628,49017] 0 2024-02-15T22:40:44.673 INFO:tasks.workunit.client.0.smithi033.stdout:9/153: mknod d4/d1d/c2d 0 2024-02-15T22:40:44.675 INFO:tasks.workunit.client.0.smithi033.stdout:9/154: write d4/f15 [695892,8045] 0 2024-02-15T22:40:44.676 INFO:tasks.workunit.client.0.smithi033.stdout:9/155: dread d4/f29 [0,4194304] 0 2024-02-15T22:40:44.679 INFO:tasks.workunit.client.0.smithi033.stdout:2/291: sync 2024-02-15T22:40:44.679 INFO:tasks.workunit.client.0.smithi033.stdout:7/256: sync 2024-02-15T22:40:44.679 INFO:tasks.workunit.client.0.smithi033.stdout:2/292: chown d1/d16/c47 50 1 2024-02-15T22:40:44.679 INFO:tasks.workunit.client.0.smithi033.stdout:8/167: sync 2024-02-15T22:40:44.679 INFO:tasks.workunit.client.0.smithi033.stdout:0/266: sync 2024-02-15T22:40:44.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/341: dread d6/d25/f5d [0,4194304] 0 2024-02-15T22:40:44.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/342: fdatasync d6/fe 0 2024-02-15T22:40:44.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/343: stat d6/d14/f32 0 2024-02-15T22:40:44.691 INFO:tasks.workunit.client.0.smithi033.stdout:9/156: dwrite d4/fb [4194304,4194304] 0 2024-02-15T22:40:44.692 INFO:tasks.workunit.client.0.smithi033.stdout:1/183: stat d1/c9 0 2024-02-15T22:40:44.693 INFO:tasks.workunit.client.0.smithi033.stdout:9/157: dread d4/d1d/d23/d24/f2b [0,4194304] 0 2024-02-15T22:40:44.697 INFO:tasks.workunit.client.0.smithi033.stdout:3/271: mknod d0/d3/c54 0 2024-02-15T22:40:44.697 INFO:tasks.workunit.client.0.smithi033.stdout:3/272: chown d0/d3/f17 2072 1 2024-02-15T22:40:44.707 INFO:tasks.workunit.client.0.smithi033.stdout:4/166: rename d8/d1f to d8/d18/d37 0 2024-02-15T22:40:44.707 INFO:tasks.workunit.client.0.smithi033.stdout:4/167: creat d8/d16/d19/d1c/f38 x:0 0 0 2024-02-15T22:40:44.707 INFO:tasks.workunit.client.0.smithi033.stdout:4/168: dread - d8/ff zero size 2024-02-15T22:40:44.713 INFO:tasks.workunit.client.0.smithi033.stdout:7/257: symlink d5/df/d40/l55 0 2024-02-15T22:40:44.716 INFO:tasks.workunit.client.0.smithi033.stdout:8/168: truncate d1/de/d13/f29 454611 0 2024-02-15T22:40:44.716 INFO:tasks.workunit.client.0.smithi033.stdout:8/169: readlink d1/df/d2e/l25 0 2024-02-15T22:40:44.717 INFO:tasks.workunit.client.0.smithi033.stdout:0/267: mkdir db/d19/d32/d43/d5a 0 2024-02-15T22:40:44.725 INFO:tasks.workunit.client.0.smithi033.stdout:5/344: creat d6/d14/d43/f6c x:0 0 0 2024-02-15T22:40:44.725 INFO:tasks.workunit.client.0.smithi033.stdout:5/345: write d6/d14/d31/d48/d59/f54 [988238,73185] 0 2024-02-15T22:40:44.728 INFO:tasks.workunit.client.0.smithi033.stdout:6/210: dwrite d12/f18 [0,4194304] 0 2024-02-15T22:40:44.728 INFO:tasks.workunit.client.0.smithi033.stdout:6/211: truncate d12/d2c/d30/d1d/f39 597354 0 2024-02-15T22:40:44.729 INFO:tasks.workunit.client.0.smithi033.stdout:1/184: truncate d1/f8 147590 0 2024-02-15T22:40:44.733 INFO:tasks.workunit.client.0.smithi033.stdout:3/273: rename d0/d8/c2d to d0/d8/c55 0 2024-02-15T22:40:44.733 INFO:tasks.workunit.client.0.smithi033.stdout:3/274: creat d0/f56 x:0 0 0 2024-02-15T22:40:44.733 INFO:tasks.workunit.client.0.smithi033.stdout:3/275: fsync d0/d3/f44 0 2024-02-15T22:40:44.737 INFO:tasks.workunit.client.0.smithi033.stdout:2/293: rename d1/d8/d46 to d1/d50 0 2024-02-15T22:40:44.740 INFO:tasks.workunit.client.0.smithi033.stdout:9/158: dwrite d4/fc [0,4194304] 0 2024-02-15T22:40:44.741 INFO:tasks.workunit.client.0.smithi033.stdout:9/159: read d4/f29 [148633,62504] 0 2024-02-15T22:40:44.741 INFO:tasks.workunit.client.0.smithi033.stdout:9/160: dread - d4/fd zero size 2024-02-15T22:40:44.741 INFO:tasks.workunit.client.0.smithi033.stdout:9/161: write d4/f19 [968871,115731] 0 2024-02-15T22:40:44.741 INFO:tasks.workunit.client.0.smithi033.stdout:9/162: dread - d4/fd zero size 2024-02-15T22:40:44.744 INFO:tasks.workunit.client.0.smithi033.stdout:8/170: unlink d1/df/d1d/f24 0 2024-02-15T22:40:44.744 INFO:tasks.workunit.client.0.smithi033.stdout:8/171: truncate d1/f33 858136 0 2024-02-15T22:40:44.745 INFO:tasks.workunit.client.0.smithi033.stdout:4/169: dwrite d8/ff [0,4194304] 0 2024-02-15T22:40:44.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/346: dwrite d6/f1e [0,4194304] 0 2024-02-15T22:40:44.745 INFO:tasks.workunit.client.0.smithi033.stdout:7/258: dwrite d5/d6/d10/d16/d26/f3c [0,4194304] 0 2024-02-15T22:40:44.753 INFO:tasks.workunit.client.0.smithi033.stdout:1/185: unlink d1/l4 0 2024-02-15T22:40:44.757 INFO:tasks.workunit.client.0.smithi033.stdout:7/259: dread d5/d6/d10/d16/d26/f3c [0,4194304] 0 2024-02-15T22:40:44.757 INFO:tasks.workunit.client.0.smithi033.stdout:7/260: chown d5/f30 309788 1 2024-02-15T22:40:44.759 INFO:tasks.workunit.client.0.smithi033.stdout:3/276: mkdir d0/d8/d3d/d57 0 2024-02-15T22:40:44.759 INFO:tasks.workunit.client.0.smithi033.stdout:4/170: write d8/ff [388079,122835] 0 2024-02-15T22:40:44.761 INFO:tasks.workunit.client.0.smithi033.stdout:2/294: read d1/d8/d2b/d2f/fb [12239911,87973] 0 2024-02-15T22:40:44.769 INFO:tasks.workunit.client.0.smithi033.stdout:9/163: dwrite d4/fc [0,4194304] 0 2024-02-15T22:40:44.781 INFO:tasks.workunit.client.0.smithi033.stdout:5/347: mknod d6/d14/d31/d38/c6d 0 2024-02-15T22:40:44.781 INFO:tasks.workunit.client.0.smithi033.stdout:5/348: write d6/d25/f55 [1307764,29947] 0 2024-02-15T22:40:44.787 INFO:tasks.workunit.client.0.smithi033.stdout:2/295: dwrite d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:44.787 INFO:tasks.workunit.client.0.smithi033.stdout:6/212: link fa d12/f41 0 2024-02-15T22:40:44.788 INFO:tasks.workunit.client.0.smithi033.stdout:9/164: dwrite d4/f9 [0,4194304] 0 2024-02-15T22:40:44.788 INFO:tasks.workunit.client.0.smithi033.stdout:9/165: stat d4/l22 0 2024-02-15T22:40:44.788 INFO:tasks.workunit.client.0.smithi033.stdout:9/166: readlink d4/l12 0 2024-02-15T22:40:44.789 INFO:tasks.workunit.client.0.smithi033.stdout:1/186: mkdir d1/de/d27/d39 0 2024-02-15T22:40:44.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/261: rename d5/d36 to d5/df/d56 0 2024-02-15T22:40:44.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/262: fdatasync d5/f31 0 2024-02-15T22:40:44.794 INFO:tasks.workunit.client.0.smithi033.stdout:4/171: creat d8/f39 x:0 0 0 2024-02-15T22:40:44.796 INFO:tasks.workunit.client.0.smithi033.stdout:9/167: dread d4/fc [0,4194304] 0 2024-02-15T22:40:44.796 INFO:tasks.workunit.client.0.smithi033.stdout:9/168: chown d4/c10 6 1 2024-02-15T22:40:44.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/172: dread d8/fe [0,4194304] 0 2024-02-15T22:40:44.799 INFO:tasks.workunit.client.0.smithi033.stdout:2/296: dread d1/d8/d2b/d2f/d13/f49 [0,4194304] 0 2024-02-15T22:40:44.801 INFO:tasks.workunit.client.0.smithi033.stdout:7/263: dread d5/f18 [0,4194304] 0 2024-02-15T22:40:44.803 INFO:tasks.workunit.client.0.smithi033.stdout:5/349: unlink d6/d14/d31/d50/d5c/f5f 0 2024-02-15T22:40:44.803 INFO:tasks.workunit.client.0.smithi033.stdout:2/297: read d1/d8/d2b/d2f/d13/f49 [1308373,33716] 0 2024-02-15T22:40:44.807 INFO:tasks.workunit.client.0.smithi033.stdout:9/169: dread d4/d1d/d23/d24/f25 [0,4194304] 0 2024-02-15T22:40:44.807 INFO:tasks.workunit.client.0.smithi033.stdout:9/170: write f2 [4357794,14805] 0 2024-02-15T22:40:44.809 INFO:tasks.workunit.client.0.smithi033.stdout:6/213: symlink d12/d2c/l42 0 2024-02-15T22:40:44.812 INFO:tasks.workunit.client.0.smithi033.stdout:9/171: dread d4/fe [0,4194304] 0 2024-02-15T22:40:44.815 INFO:tasks.workunit.client.0.smithi033.stdout:1/187: mkdir d1/de/d27/d39/d3a 0 2024-02-15T22:40:44.815 INFO:tasks.workunit.client.0.smithi033.stdout:1/188: readlink d1/ld 0 2024-02-15T22:40:44.815 INFO:tasks.workunit.client.0.smithi033.stdout:1/189: write d1/f17 [159980,59975] 0 2024-02-15T22:40:44.815 INFO:tasks.workunit.client.0.smithi033.stdout:1/190: write d1/de/f1b [491712,40330] 0 2024-02-15T22:40:44.818 INFO:tasks.workunit.client.0.smithi033.stdout:3/277: rename d0/d1c/c39 to d0/d3/d2c/d43/c58 0 2024-02-15T22:40:44.818 INFO:tasks.workunit.client.0.smithi033.stdout:3/278: stat d0/d1c/c2a 0 2024-02-15T22:40:44.821 INFO:tasks.workunit.client.0.smithi033.stdout:4/173: link d8/d18/l1e d8/d16/l3a 0 2024-02-15T22:40:44.822 INFO:tasks.workunit.client.0.smithi033.stdout:5/350: dwrite d6/d14/f1d [4194304,4194304] 0 2024-02-15T22:40:44.822 INFO:tasks.workunit.client.0.smithi033.stdout:5/351: creat d6/d14/f6e x:0 0 0 2024-02-15T22:40:44.823 INFO:tasks.workunit.client.0.smithi033.stdout:5/352: write d6/d14/f6b [593437,66703] 0 2024-02-15T22:40:44.823 INFO:tasks.workunit.client.0.smithi033.stdout:5/353: write d6/d25/f55 [1789056,105477] 0 2024-02-15T22:40:44.823 INFO:tasks.workunit.client.0.smithi033.stdout:5/354: truncate d6/d25/f40 4262808 0 2024-02-15T22:40:44.823 INFO:tasks.workunit.client.0.smithi033.stdout:5/355: chown d6/d14/f19 90485279 1 2024-02-15T22:40:44.823 INFO:tasks.workunit.client.0.smithi033.stdout:7/264: symlink d5/df/d40/l57 0 2024-02-15T22:40:44.824 INFO:tasks.workunit.client.0.smithi033.stdout:5/356: write d6/d14/f45 [156484,23308] 0 2024-02-15T22:40:44.829 INFO:tasks.workunit.client.0.smithi033.stdout:2/298: unlink d1/d8/d2b/d2f/d12/f27 0 2024-02-15T22:40:44.829 INFO:tasks.workunit.client.0.smithi033.stdout:2/299: write d1/d8/d2b/d2f/d12/f15 [2140752,99567] 0 2024-02-15T22:40:44.829 INFO:tasks.workunit.client.0.smithi033.stdout:2/300: write d1/d16/f22 [997434,97858] 0 2024-02-15T22:40:44.834 INFO:tasks.workunit.client.0.smithi033.stdout:7/265: write d5/d6/d10/d16/d26/f2a [2871373,49966] 0 2024-02-15T22:40:44.835 INFO:tasks.workunit.client.0.smithi033.stdout:9/172: symlink d4/l2e 0 2024-02-15T22:40:44.835 INFO:tasks.workunit.client.0.smithi033.stdout:1/191: dwrite d1/de/f1f [4194304,4194304] 0 2024-02-15T22:40:44.840 INFO:tasks.workunit.client.0.smithi033.stdout:9/173: dread d4/fc [0,4194304] 0 2024-02-15T22:40:44.841 INFO:tasks.workunit.client.0.smithi033.stdout:3/279: creat d0/d1c/f59 x:0 0 0 2024-02-15T22:40:44.845 INFO:tasks.workunit.client.0.smithi033.stdout:5/357: symlink d6/d14/d31/d48/d49/l6f 0 2024-02-15T22:40:44.846 INFO:tasks.workunit.client.0.smithi033.stdout:5/358: write d6/d14/f3e [5317506,94374] 0 2024-02-15T22:40:44.846 INFO:tasks.workunit.client.0.smithi033.stdout:5/359: chown d6/d14/d31/d48/d49/d53/d57 34981 1 2024-02-15T22:40:44.848 INFO:tasks.workunit.client.0.smithi033.stdout:4/174: dwrite d8/f39 [0,4194304] 0 2024-02-15T22:40:44.851 INFO:tasks.workunit.client.0.smithi033.stdout:3/280: dread d0/f13 [0,4194304] 0 2024-02-15T22:40:44.855 INFO:tasks.workunit.client.0.smithi033.stdout:2/301: creat d1/d8/d2b/d2f/d38/f51 x:0 0 0 2024-02-15T22:40:44.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/175: dread d8/ff [0,4194304] 0 2024-02-15T22:40:44.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/176: truncate d8/d16/d19/d1c/f32 600562 0 2024-02-15T22:40:44.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/177: chown d8/d16/d19/d27/l15 0 1 2024-02-15T22:40:44.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/178: truncate d8/d18/f25 758426 0 2024-02-15T22:40:44.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/179: chown d8/c9 21004014 1 2024-02-15T22:40:44.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/180: write d8/d16/d19/d1c/f38 [379535,25147] 0 2024-02-15T22:40:44.860 INFO:tasks.workunit.client.0.smithi033.stdout:7/266: mkdir d5/df/d56/d58 0 2024-02-15T22:40:44.864 INFO:tasks.workunit.client.0.smithi033.stdout:1/192: mkdir d1/de/d27/d28/d2d/d3b 0 2024-02-15T22:40:44.868 INFO:tasks.workunit.client.0.smithi033.stdout:9/174: symlink d4/d1d/d23/d24/l2f 0 2024-02-15T22:40:44.870 INFO:tasks.workunit.client.0.smithi033.stdout:7/267: write d5/d6/f39 [1738198,4819] 0 2024-02-15T22:40:44.873 INFO:tasks.workunit.client.0.smithi033.stdout:9/175: dread d4/d1d/d23/d24/f25 [0,4194304] 0 2024-02-15T22:40:44.873 INFO:tasks.workunit.client.0.smithi033.stdout:5/360: mkdir d6/d14/d43/d70 0 2024-02-15T22:40:44.873 INFO:tasks.workunit.client.0.smithi033.stdout:5/361: chown d6/d14/f30 44255060 1 2024-02-15T22:40:44.874 INFO:tasks.workunit.client.0.smithi033.stdout:5/362: write d6/d14/f6b [699949,71325] 0 2024-02-15T22:40:44.875 INFO:tasks.workunit.client.0.smithi033.stdout:1/193: dwrite d1/de/d27/d28/f2a [0,4194304] 0 2024-02-15T22:40:44.876 INFO:tasks.workunit.client.0.smithi033.stdout:1/194: chown d1/d1d/d2c 10315 1 2024-02-15T22:40:44.880 INFO:tasks.workunit.client.0.smithi033.stdout:2/302: rmdir d1/d8/d2b/d2f 39 2024-02-15T22:40:44.885 INFO:tasks.workunit.client.0.smithi033.stdout:9/176: dread d4/f18 [4194304,4194304] 0 2024-02-15T22:40:44.891 INFO:tasks.workunit.client.0.smithi033.stdout:4/181: rename d8/c10 to d8/d16/d19/d27/c3b 0 2024-02-15T22:40:44.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/268: mkdir d5/df/d56/d58/d59 0 2024-02-15T22:40:44.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/269: stat d5/d6/d10/l2b 0 2024-02-15T22:40:44.919 INFO:tasks.workunit.client.0.smithi033.stdout:5/363: creat d6/d14/d31/d48/d59/f71 x:0 0 0 2024-02-15T22:40:44.919 INFO:tasks.workunit.client.0.smithi033.stdout:5/364: fdatasync d6/d14/d31/d48/f5e 0 2024-02-15T22:40:44.924 INFO:tasks.workunit.client.0.smithi033.stdout:1/195: mknod d1/de/d27/d28/d2d/c3c 0 2024-02-15T22:40:44.925 INFO:tasks.workunit.client.0.smithi033.stdout:2/303: mkdir d1/d8/d2b/d2f/d12/d52 0 2024-02-15T22:40:44.925 INFO:tasks.workunit.client.0.smithi033.stdout:2/304: chown d1/d8/d2b 258142914 1 2024-02-15T22:40:44.925 INFO:tasks.workunit.client.0.smithi033.stdout:2/305: write d1/f2 [13382967,130243] 0 2024-02-15T22:40:44.928 INFO:tasks.workunit.client.0.smithi033.stdout:4/182: mkdir d8/d16/d19/d1c/d3c 0 2024-02-15T22:40:44.929 INFO:tasks.workunit.client.0.smithi033.stdout:4/183: dread d8/d16/d19/d1c/f32 [0,4194304] 0 2024-02-15T22:40:44.929 INFO:tasks.workunit.client.0.smithi033.stdout:4/184: getdents d8/d16/d19/d1c/d3c 0 2024-02-15T22:40:44.931 INFO:tasks.workunit.client.0.smithi033.stdout:7/270: rename d5/d6/c29 to d5/df/d40/d4a/c5a 0 2024-02-15T22:40:44.933 INFO:tasks.workunit.client.0.smithi033.stdout:1/196: read d1/de/f16 [308732,101524] 0 2024-02-15T22:40:44.935 INFO:tasks.workunit.client.0.smithi033.stdout:5/365: creat d6/d14/d31/d38/f72 x:0 0 0 2024-02-15T22:40:44.939 INFO:tasks.workunit.client.0.smithi033.stdout:9/177: truncate d4/f5 5543229 0 2024-02-15T22:40:44.939 INFO:tasks.workunit.client.0.smithi033.stdout:9/178: readlink d4/l12 0 2024-02-15T22:40:44.939 INFO:tasks.workunit.client.0.smithi033.stdout:9/179: chown d4/f29 3 1 2024-02-15T22:40:44.943 INFO:tasks.workunit.client.0.smithi033.stdout:7/271: link d5/df/c27 d5/df/c5b 0 2024-02-15T22:40:44.943 INFO:tasks.workunit.client.0.smithi033.stdout:7/272: stat d5/d6/d10/d16/l3e 0 2024-02-15T22:40:44.945 INFO:tasks.workunit.client.0.smithi033.stdout:5/366: mknod d6/d14/d31/d50/d6a/c73 0 2024-02-15T22:40:44.946 INFO:tasks.workunit.client.0.smithi033.stdout:2/306: rmdir d1/d16/d3f 39 2024-02-15T22:40:44.948 INFO:tasks.workunit.client.0.smithi033.stdout:9/180: symlink d4/d1d/d23/d24/l30 0 2024-02-15T22:40:44.948 INFO:tasks.workunit.client.0.smithi033.stdout:9/181: write d4/ff [3558172,16340] 0 2024-02-15T22:40:44.948 INFO:tasks.workunit.client.0.smithi033.stdout:9/182: write d4/f15 [1808183,101169] 0 2024-02-15T22:40:44.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/185: dwrite d8/d16/d19/d1c/f32 [0,4194304] 0 2024-02-15T22:40:44.950 INFO:tasks.workunit.client.0.smithi033.stdout:9/183: fsync d4/f15 0 2024-02-15T22:40:44.951 INFO:tasks.workunit.client.0.smithi033.stdout:7/273: symlink d5/d6/d10/l5c 0 2024-02-15T22:40:44.956 INFO:tasks.workunit.client.0.smithi033.stdout:2/307: creat d1/d8/d34/f53 x:0 0 0 2024-02-15T22:40:44.963 INFO:tasks.workunit.client.0.smithi033.stdout:4/186: rename d8/d18/d37/l28 to d8/d18/d37/l3d 0 2024-02-15T22:40:45.050 INFO:tasks.workunit.client.0.smithi033.stdout:9/184: rename d4/l22 to d4/l31 0 2024-02-15T22:40:45.062 INFO:tasks.workunit.client.0.smithi033.stdout:2/308: truncate d1/d16/f22 3880012 0 2024-02-15T22:40:45.062 INFO:tasks.workunit.client.0.smithi033.stdout:2/309: chown d1/d8/d2b/d2f/d24/d31 19577146 1 2024-02-15T22:40:45.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/187: creat d8/d18/d37/d31/f3e x:0 0 0 2024-02-15T22:40:45.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/188: truncate d8/d1a/f36 323980 0 2024-02-15T22:40:45.065 INFO:tasks.workunit.client.0.smithi033.stdout:1/197: write d1/de/d27/d28/f2a [5184080,56731] 0 2024-02-15T22:40:45.066 INFO:tasks.workunit.client.0.smithi033.stdout:9/185: mkdir d4/d1d/d23/d32 0 2024-02-15T22:40:45.068 INFO:tasks.workunit.client.0.smithi033.stdout:2/310: link d1/d8/d2b/d2f/cf d1/d8/d2b/d2f/d3d/c54 0 2024-02-15T22:40:45.069 INFO:tasks.workunit.client.0.smithi033.stdout:9/186: dread d4/f15 [0,4194304] 0 2024-02-15T22:40:45.070 INFO:tasks.workunit.client.0.smithi033.stdout:4/189: mkdir d8/d16/d19/d1c/d3c/d3f 0 2024-02-15T22:40:45.070 INFO:tasks.workunit.client.0.smithi033.stdout:4/190: write f7 [6545408,63271] 0 2024-02-15T22:40:45.077 INFO:tasks.workunit.client.0.smithi033.stdout:2/311: mknod d1/d16/d3f/c55 0 2024-02-15T22:40:45.078 INFO:tasks.workunit.client.0.smithi033.stdout:2/312: write d1/f2 [5231984,120390] 0 2024-02-15T22:40:45.080 INFO:tasks.workunit.client.0.smithi033.stdout:5/367: getdents d6/d14/d31/d38 0 2024-02-15T22:40:45.081 INFO:tasks.workunit.client.0.smithi033.stdout:9/187: symlink d4/d1d/l33 0 2024-02-15T22:40:45.104 INFO:tasks.workunit.client.0.smithi033.stdout:4/191: creat d8/d18/d37/f40 x:0 0 0 2024-02-15T22:40:45.111 INFO:tasks.workunit.client.0.smithi033.stdout:1/198: rmdir d1/de 39 2024-02-15T22:40:45.114 INFO:tasks.workunit.client.0.smithi033.stdout:2/313: mknod d1/d16/d3f/d4e/c56 0 2024-02-15T22:40:45.114 INFO:tasks.workunit.client.0.smithi033.stdout:2/314: write d1/d16/d3f/f4b [285558,125587] 0 2024-02-15T22:40:45.117 INFO:tasks.workunit.client.0.smithi033.stdout:5/368: rename d6/c3a to d6/d14/d31/d48/d49/d53/d57/c74 0 2024-02-15T22:40:45.117 INFO:tasks.workunit.client.0.smithi033.stdout:5/369: fsync d6/d14/f1d 0 2024-02-15T22:40:45.118 INFO:tasks.workunit.client.0.smithi033.stdout:5/370: write d6/fe [7621025,67651] 0 2024-02-15T22:40:45.118 INFO:tasks.workunit.client.0.smithi033.stdout:5/371: truncate d6/d25/f35 4511078 0 2024-02-15T22:40:45.118 INFO:tasks.workunit.client.0.smithi033.stdout:5/372: chown d6/f10 1009327783 1 2024-02-15T22:40:45.128 INFO:tasks.workunit.client.0.smithi033.stdout:9/188: link d4/l17 d4/d1d/l34 0 2024-02-15T22:40:45.128 INFO:tasks.workunit.client.0.smithi033.stdout:9/189: write d4/f16 [123169,6849] 0 2024-02-15T22:40:45.129 INFO:tasks.workunit.client.0.smithi033.stdout:9/190: truncate d4/d1d/f21 1235735 0 2024-02-15T22:40:45.134 INFO:tasks.workunit.client.0.smithi033.stdout:1/199: creat d1/de/d27/d28/d2d/f3d x:0 0 0 2024-02-15T22:40:45.135 INFO:tasks.workunit.client.0.smithi033.stdout:1/200: write d1/f6 [95142,114449] 0 2024-02-15T22:40:45.140 INFO:tasks.workunit.client.0.smithi033.stdout:5/373: dwrite d6/d14/f32 [0,4194304] 0 2024-02-15T22:40:45.141 INFO:tasks.workunit.client.0.smithi033.stdout:2/315: dwrite d1/d8/d2b/d2f/d24/f39 [0,4194304] 0 2024-02-15T22:40:45.145 INFO:tasks.workunit.client.0.smithi033.stdout:1/201: rename d1/f19 to d1/de/d27/d28/d37/f3e 0 2024-02-15T22:40:45.145 INFO:tasks.workunit.client.0.smithi033.stdout:1/202: chown d1/de/cf 622312628 1 2024-02-15T22:40:45.154 INFO:tasks.workunit.client.0.smithi033.stdout:2/316: mkdir d1/d16/d57 0 2024-02-15T22:40:45.155 INFO:tasks.workunit.client.0.smithi033.stdout:2/317: creat d1/d8/d2b/d2f/d24/d31/f58 x:0 0 0 2024-02-15T22:40:45.155 INFO:tasks.workunit.client.0.smithi033.stdout:2/318: truncate d1/d8/d2b/d2f/d13/f3b 536912 0 2024-02-15T22:40:45.156 INFO:tasks.workunit.client.0.smithi033.stdout:1/203: write d1/f7 [11479064,91153] 0 2024-02-15T22:40:45.157 INFO:tasks.workunit.client.0.smithi033.stdout:4/192: rmdir d8/d16/d19/d1c 39 2024-02-15T22:40:45.162 INFO:tasks.workunit.client.0.smithi033.stdout:2/319: mkdir d1/d8/d2b/d2f/d13/d59 0 2024-02-15T22:40:45.162 INFO:tasks.workunit.client.0.smithi033.stdout:2/320: read - d1/f48 zero size 2024-02-15T22:40:45.168 INFO:tasks.workunit.client.0.smithi033.stdout:5/374: dwrite d6/d25/f29 [4194304,4194304] 0 2024-02-15T22:40:45.168 INFO:tasks.workunit.client.0.smithi033.stdout:5/375: write d6/d14/d31/f36 [1199093,44969] 0 2024-02-15T22:40:45.168 INFO:tasks.workunit.client.0.smithi033.stdout:1/204: write d1/f15 [225408,81641] 0 2024-02-15T22:40:45.168 INFO:tasks.workunit.client.0.smithi033.stdout:2/321: mkdir d1/d16/d5a 0 2024-02-15T22:40:45.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/322: dread d1/d8/d2b/d2f/fb [4194304,4194304] 0 2024-02-15T22:40:45.177 INFO:tasks.workunit.client.0.smithi033.stdout:1/205: mknod d1/c3f 0 2024-02-15T22:40:45.181 INFO:tasks.workunit.client.0.smithi033.stdout:4/193: dwrite f4 [0,4194304] 0 2024-02-15T22:40:45.181 INFO:tasks.workunit.client.0.smithi033.stdout:4/194: truncate d8/d18/d37/d23/f30 376782 0 2024-02-15T22:40:45.181 INFO:tasks.workunit.client.0.smithi033.stdout:4/195: fdatasync f5 0 2024-02-15T22:40:45.181 INFO:tasks.workunit.client.0.smithi033.stdout:4/196: stat d8/d16/d19/d1c 0 2024-02-15T22:40:45.182 INFO:tasks.workunit.client.0.smithi033.stdout:4/197: write d8/d18/d37/d23/f30 [802707,73147] 0 2024-02-15T22:40:45.182 INFO:tasks.workunit.client.0.smithi033.stdout:4/198: stat d8/d16/d19 0 2024-02-15T22:40:45.182 INFO:tasks.workunit.client.0.smithi033.stdout:4/199: write d8/d18/d37/d31/f3e [726234,11632] 0 2024-02-15T22:40:45.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/323: symlink d1/d8/d2b/d2f/d13/l5b 0 2024-02-15T22:40:45.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/324: chown d1/d8/d2b/d2f/d13/c32 595 1 2024-02-15T22:40:45.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/325: creat d1/d8/d2b/d2f/d38/f5c x:0 0 0 2024-02-15T22:40:45.187 INFO:tasks.workunit.client.0.smithi033.stdout:5/376: dwrite d6/d14/f3e [0,4194304] 0 2024-02-15T22:40:45.187 INFO:tasks.workunit.client.0.smithi033.stdout:5/377: chown d6/l52 141 1 2024-02-15T22:40:45.187 INFO:tasks.workunit.client.0.smithi033.stdout:5/378: chown d6/d14/d31/d48/d59/c60 17 1 2024-02-15T22:40:45.187 INFO:tasks.workunit.client.0.smithi033.stdout:5/379: chown d6/d14/d31/d48/d59/f54 1926460997 1 2024-02-15T22:40:45.188 INFO:tasks.workunit.client.0.smithi033.stdout:1/206: creat d1/d1d/d2c/d30/f40 x:0 0 0 2024-02-15T22:40:45.194 INFO:tasks.workunit.client.0.smithi033.stdout:4/200: dwrite f7 [4194304,4194304] 0 2024-02-15T22:40:45.195 INFO:tasks.workunit.client.0.smithi033.stdout:0/268: sync 2024-02-15T22:40:45.201 INFO:tasks.workunit.client.0.smithi033.stdout:2/326: unlink d1/d8/d2b/d2f/d24/d31/f33 0 2024-02-15T22:40:45.212 INFO:tasks.workunit.client.0.smithi033.stdout:5/380: symlink d6/l75 0 2024-02-15T22:40:45.214 INFO:tasks.workunit.client.0.smithi033.stdout:1/207: creat d1/d20/f41 x:0 0 0 2024-02-15T22:40:45.217 INFO:tasks.workunit.client.0.smithi033.stdout:4/201: symlink d8/d16/l41 0 2024-02-15T22:40:45.220 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:44 smithi033 ceph-mon[29033]: mgrmap e23: smithi082.mjhlse(active, since 3s) 2024-02-15T22:40:45.221 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:44 smithi033 ceph-mon[29033]: pgmap v5: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:45.221 INFO:tasks.workunit.client.0.smithi033.stdout:0/269: mknod db/d19/d32/d3d/c5b 0 2024-02-15T22:40:45.223 INFO:tasks.workunit.client.0.smithi033.stdout:2/327: truncate d1/d16/f1a 420283 0 2024-02-15T22:40:45.225 INFO:tasks.workunit.client.0.smithi033.stdout:5/381: rename c5 to d6/d14/d31/d50/c76 0 2024-02-15T22:40:45.227 INFO:tasks.workunit.client.0.smithi033.stdout:9/191: truncate d4/f5 4759408 0 2024-02-15T22:40:45.230 INFO:tasks.workunit.client.0.smithi033.stdout:0/270: creat db/d2a/f5c x:0 0 0 2024-02-15T22:40:45.230 INFO:tasks.workunit.client.0.smithi033.stdout:0/271: dread - db/d19/d32/d3d/f59 zero size 2024-02-15T22:40:45.230 INFO:tasks.workunit.client.0.smithi033.stdout:0/272: readlink db/ld 0 2024-02-15T22:40:45.231 INFO:tasks.workunit.client.0.smithi033.stdout:2/328: mkdir d1/d8/d2b/d2f/d24/d5d 0 2024-02-15T22:40:45.233 INFO:tasks.workunit.client.0.smithi033.stdout:9/192: dread d4/f13 [0,4194304] 0 2024-02-15T22:40:45.236 INFO:tasks.workunit.client.0.smithi033.stdout:0/273: mknod db/d19/c5d 0 2024-02-15T22:40:45.238 INFO:tasks.workunit.client.0.smithi033.stdout:4/202: dwrite d8/d16/d19/d1c/f32 [0,4194304] 0 2024-02-15T22:40:45.238 INFO:tasks.workunit.client.0.smithi033.stdout:9/193: write d4/f8 [7045837,50168] 0 2024-02-15T22:40:45.239 INFO:tasks.workunit.client.0.smithi033.stdout:2/329: truncate d1/d8/d2b/d2f/d13/f17 1252956 0 2024-02-15T22:40:45.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/274: rmdir db/d19/d32/d43 39 2024-02-15T22:40:45.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/275: fdatasync db/d19/f3a 0 2024-02-15T22:40:45.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/276: chown db/d19/d32 362835 1 2024-02-15T22:40:45.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/277: fsync db/d19/d32/d3d/f44 0 2024-02-15T22:40:45.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/278: readlink db/l16 0 2024-02-15T22:40:45.255 INFO:tasks.workunit.client.0.smithi033.stdout:1/208: rename d1/d1d to d1/d20/d42 0 2024-02-15T22:40:45.258 INFO:tasks.workunit.client.0.smithi033.stdout:0/279: symlink db/d19/d32/d46/l5e 0 2024-02-15T22:40:45.260 INFO:tasks.workunit.client.0.smithi033.stdout:1/209: rename d1/de/d27/d28/d2d/c3c to d1/d20/c43 0 2024-02-15T22:40:45.260 INFO:tasks.workunit.client.0.smithi033.stdout:1/210: readlink d1/ld 0 2024-02-15T22:40:45.260 INFO:tasks.workunit.client.0.smithi033.stdout:1/211: write d1/fa [415767,118486] 0 2024-02-15T22:40:45.263 INFO:tasks.workunit.client.0.smithi033.stdout:0/280: mknod db/d19/d32/d3d/c5f 0 2024-02-15T22:40:45.267 INFO:tasks.workunit.client.0.smithi033.stdout:0/281: read db/d19/d32/f3c [284970,55400] 0 2024-02-15T22:40:45.267 INFO:tasks.workunit.client.0.smithi033.stdout:9/194: dwrite d4/f15 [0,4194304] 0 2024-02-15T22:40:45.267 INFO:tasks.workunit.client.0.smithi033.stdout:9/195: fsync d4/fe 0 2024-02-15T22:40:45.267 INFO:tasks.workunit.client.0.smithi033.stdout:5/382: rename d6/d25/c2d to d6/d14/d43/c77 0 2024-02-15T22:40:45.267 INFO:tasks.workunit.client.0.smithi033.stdout:4/203: dwrite f7 [0,4194304] 0 2024-02-15T22:40:45.268 INFO:tasks.workunit.client.0.smithi033.stdout:2/330: dwrite d1/d8/d2b/d2f/d24/d31/f43 [0,4194304] 0 2024-02-15T22:40:45.277 INFO:tasks.workunit.client.0.smithi033.stdout:9/196: mkdir d4/d1d/d23/d35 0 2024-02-15T22:40:45.278 INFO:tasks.workunit.client.0.smithi033.stdout:4/204: stat d8/d18/d37/l3d 0 2024-02-15T22:40:45.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/212: dwrite d1/d20/d42/d2c/f31 [0,4194304] 0 2024-02-15T22:40:45.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/213: truncate d1/f17 859795 0 2024-02-15T22:40:45.281 INFO:tasks.workunit.client.0.smithi033.stdout:0/282: write f5 [1109974,54840] 0 2024-02-15T22:40:45.281 INFO:tasks.workunit.client.0.smithi033.stdout:0/283: chown db/c51 1 1 2024-02-15T22:40:45.281 INFO:tasks.workunit.client.0.smithi033.stdout:0/284: chown db/d19/d32/d3d/f44 74055877 1 2024-02-15T22:40:45.288 INFO:tasks.workunit.client.0.smithi033.stdout:4/205: dread f5 [0,4194304] 0 2024-02-15T22:40:45.288 INFO:tasks.workunit.client.0.smithi033.stdout:4/206: write d8/d16/d19/d1c/f38 [884218,66175] 0 2024-02-15T22:40:45.289 INFO:tasks.workunit.client.0.smithi033.stdout:4/207: creat d8/d18/d37/d31/f42 x:0 0 0 2024-02-15T22:40:45.289 INFO:tasks.workunit.client.0.smithi033.stdout:4/208: write d8/d18/d37/d31/f3e [1245713,64348] 0 2024-02-15T22:40:45.289 INFO:tasks.workunit.client.0.smithi033.stdout:5/383: dwrite d6/d14/f19 [4194304,4194304] 0 2024-02-15T22:40:45.290 INFO:tasks.workunit.client.0.smithi033.stdout:6/214: sync 2024-02-15T22:40:45.290 INFO:tasks.workunit.client.0.smithi033.stdout:8/172: sync 2024-02-15T22:40:45.291 INFO:tasks.workunit.client.0.smithi033.stdout:2/331: dwrite d1/d8/d2b/d2f/d13/f1c [0,4194304] 0 2024-02-15T22:40:45.299 INFO:tasks.workunit.client.0.smithi033.stdout:9/197: mknod d4/d1d/c36 0 2024-02-15T22:40:45.299 INFO:tasks.workunit.client.0.smithi033.stdout:9/198: chown d4/l17 141 1 2024-02-15T22:40:45.300 INFO:tasks.workunit.client.0.smithi033.stdout:8/173: dread d1/d6/d14/f1b [0,4194304] 0 2024-02-15T22:40:45.300 INFO:tasks.workunit.client.0.smithi033.stdout:8/174: write d1/d6/d14/f1b [4692266,111919] 0 2024-02-15T22:40:45.306 INFO:tasks.workunit.client.0.smithi033.stdout:1/214: symlink d1/d20/d42/l44 0 2024-02-15T22:40:45.306 INFO:tasks.workunit.client.0.smithi033.stdout:1/215: chown d1/de/d27/d39 572774868 1 2024-02-15T22:40:45.309 INFO:tasks.workunit.client.0.smithi033.stdout:0/285: mkdir db/d60 0 2024-02-15T22:40:45.309 INFO:tasks.workunit.client.0.smithi033.stdout:0/286: dread - db/d2a/f5c zero size 2024-02-15T22:40:45.313 INFO:tasks.workunit.client.0.smithi033.stdout:4/209: rename d8/d18/d37/d23/c2d to d8/d16/d19/c43 0 2024-02-15T22:40:45.323 INFO:tasks.workunit.client.0.smithi033.stdout:1/216: dwrite d1/d20/d42/f2f [0,4194304] 0 2024-02-15T22:40:45.323 INFO:tasks.workunit.client.0.smithi033.stdout:1/217: write d1/d20/d42/d2c/d30/f40 [284341,81368] 0 2024-02-15T22:40:45.325 INFO:tasks.workunit.client.0.smithi033.stdout:9/199: link d4/d1d/c2d d4/d1d/d23/d24/c37 0 2024-02-15T22:40:45.329 INFO:tasks.workunit.client.0.smithi033.stdout:8/175: mkdir d1/df/d44 0 2024-02-15T22:40:45.329 INFO:tasks.workunit.client.0.smithi033.stdout:9/200: dread d4/ff [0,4194304] 0 2024-02-15T22:40:45.331 INFO:tasks.workunit.client.0.smithi033.stdout:0/287: rmdir db 39 2024-02-15T22:40:45.331 INFO:tasks.workunit.client.0.smithi033.stdout:0/288: getdents db/d19/d32/d43/d5a 0 2024-02-15T22:40:45.332 INFO:tasks.workunit.client.0.smithi033.stdout:3/281: sync 2024-02-15T22:40:45.332 INFO:tasks.workunit.client.0.smithi033.stdout:7/274: sync 2024-02-15T22:40:45.332 INFO:tasks.workunit.client.0.smithi033.stdout:7/275: chown c3 781 1 2024-02-15T22:40:45.334 INFO:tasks.workunit.client.0.smithi033.stdout:4/210: rename d8/d16/d19/d1c/f35 to d8/d16/d19/f44 0 2024-02-15T22:40:45.334 INFO:tasks.workunit.client.0.smithi033.stdout:4/211: truncate d8/d18/d37/d31/f42 936410 0 2024-02-15T22:40:45.336 INFO:tasks.workunit.client.0.smithi033.stdout:6/215: creat d12/d1b/d3f/f43 x:0 0 0 2024-02-15T22:40:45.341 INFO:tasks.workunit.client.0.smithi033.stdout:0/289: read db/d19/f3f [1887582,111806] 0 2024-02-15T22:40:45.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/218: creat d1/de/d27/d28/d37/f45 x:0 0 0 2024-02-15T22:40:45.345 INFO:tasks.workunit.client.0.smithi033.stdout:8/176: mknod d1/de/d1a/d27/c45 0 2024-02-15T22:40:45.345 INFO:tasks.workunit.client.0.smithi033.stdout:8/177: chown d1/df/d2e 66739561 1 2024-02-15T22:40:45.347 INFO:tasks.workunit.client.0.smithi033.stdout:9/201: mkdir d4/d1d/d23/d35/d38 0 2024-02-15T22:40:45.349 INFO:tasks.workunit.client.0.smithi033.stdout:3/282: link d0/d8/l33 d0/d3/d3b/d47/l5a 0 2024-02-15T22:40:45.349 INFO:tasks.workunit.client.0.smithi033.stdout:3/283: truncate d0/d1c/f59 583865 0 2024-02-15T22:40:45.352 INFO:tasks.workunit.client.0.smithi033.stdout:4/212: dwrite d8/d16/d19/d1c/f38 [0,4194304] 0 2024-02-15T22:40:45.355 INFO:tasks.workunit.client.0.smithi033.stdout:9/202: dread d4/f13 [0,4194304] 0 2024-02-15T22:40:45.357 INFO:tasks.workunit.client.0.smithi033.stdout:0/290: rename db/d19/d32/c42 to db/c61 0 2024-02-15T22:40:45.357 INFO:tasks.workunit.client.0.smithi033.stdout:0/291: fdatasync db/d19/d32/d3d/f59 0 2024-02-15T22:40:45.359 INFO:tasks.workunit.client.0.smithi033.stdout:1/219: getdents d1/de/d27 0 2024-02-15T22:40:45.361 INFO:tasks.workunit.client.0.smithi033.stdout:3/284: mknod d0/d3/c5b 0 2024-02-15T22:40:45.361 INFO:tasks.workunit.client.0.smithi033.stdout:3/285: creat d0/d3/d2c/f5c x:0 0 0 2024-02-15T22:40:45.361 INFO:tasks.workunit.client.0.smithi033.stdout:3/286: fdatasync d0/d8/f49 0 2024-02-15T22:40:45.363 INFO:tasks.workunit.client.0.smithi033.stdout:4/213: mkdir d8/d16/d45 0 2024-02-15T22:40:45.363 INFO:tasks.workunit.client.0.smithi033.stdout:4/214: getdents d8/d16/d19/d1c/d3c/d3f 0 2024-02-15T22:40:45.364 INFO:tasks.workunit.client.0.smithi033.stdout:6/216: creat d12/d3c/f44 x:0 0 0 2024-02-15T22:40:45.366 INFO:tasks.workunit.client.0.smithi033.stdout:8/178: dwrite d1/d36/f43 [0,4194304] 0 2024-02-15T22:40:45.368 INFO:tasks.workunit.client.0.smithi033.stdout:9/203: link d4/l31 d4/l39 0 2024-02-15T22:40:45.368 INFO:tasks.workunit.client.0.smithi033.stdout:9/204: fsync d4/f16 0 2024-02-15T22:40:45.370 INFO:tasks.workunit.client.0.smithi033.stdout:0/292: write db/d19/d32/d46/f4f [3050575,46301] 0 2024-02-15T22:40:45.370 INFO:tasks.workunit.client.0.smithi033.stdout:0/293: creat db/d19/d32/d3d/f62 x:0 0 0 2024-02-15T22:40:45.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:44 smithi082 ceph-mon[37153]: mgrmap e23: smithi082.mjhlse(active, since 3s) 2024-02-15T22:40:45.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:44 smithi082 ceph-mon[37153]: pgmap v5: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:45.381 INFO:tasks.workunit.client.0.smithi033.stdout:1/220: mknod d1/c46 0 2024-02-15T22:40:45.382 INFO:tasks.workunit.client.0.smithi033.stdout:6/217: dwrite d12/f41 [4194304,4194304] 0 2024-02-15T22:40:45.387 INFO:tasks.workunit.client.0.smithi033.stdout:4/215: mknod d8/d16/d19/c46 0 2024-02-15T22:40:45.390 INFO:tasks.workunit.client.0.smithi033.stdout:6/218: dread d12/f41 [0,4194304] 0 2024-02-15T22:40:45.394 INFO:tasks.workunit.client.0.smithi033.stdout:8/179: unlink d1/d36/f41 0 2024-02-15T22:40:45.400 INFO:tasks.workunit.client.0.smithi033.stdout:1/221: dwrite d1/de/d27/d28/d37/f45 [0,4194304] 0 2024-02-15T22:40:45.400 INFO:tasks.workunit.client.0.smithi033.stdout:1/222: write d1/d20/d42/f33 [186754,100663] 0 2024-02-15T22:40:45.401 INFO:tasks.workunit.client.0.smithi033.stdout:0/294: creat db/f63 x:0 0 0 2024-02-15T22:40:45.401 INFO:tasks.workunit.client.0.smithi033.stdout:0/295: read - db/d19/d32/d3d/f62 zero size 2024-02-15T22:40:45.410 INFO:tasks.workunit.client.0.smithi033.stdout:4/216: truncate d8/d18/d37/d31/f3e 587767 0 2024-02-15T22:40:45.413 INFO:tasks.workunit.client.0.smithi033.stdout:6/219: symlink d12/d1b/d3f/l45 0 2024-02-15T22:40:45.416 INFO:tasks.workunit.client.0.smithi033.stdout:8/180: mknod d1/d6/d14/c46 0 2024-02-15T22:40:45.416 INFO:tasks.workunit.client.0.smithi033.stdout:8/181: truncate d1/de/d1a/d2a/f3b 546117 0 2024-02-15T22:40:45.421 INFO:tasks.workunit.client.0.smithi033.stdout:1/223: symlink d1/de/d27/l47 0 2024-02-15T22:40:45.423 INFO:tasks.workunit.client.0.smithi033.stdout:0/296: symlink db/d19/d32/d43/l64 0 2024-02-15T22:40:45.423 INFO:tasks.workunit.client.0.smithi033.stdout:0/297: chown db/d2a 309327 1 2024-02-15T22:40:45.425 INFO:tasks.workunit.client.0.smithi033.stdout:0/298: write db/d19/f1f [145931,104261] 0 2024-02-15T22:40:45.425 INFO:tasks.workunit.client.0.smithi033.stdout:3/287: rename d0/d8 to d0/d3/d2c/d5d 0 2024-02-15T22:40:45.427 INFO:tasks.workunit.client.0.smithi033.stdout:6/220: write d12/f29 [397666,51971] 0 2024-02-15T22:40:45.430 INFO:tasks.workunit.client.0.smithi033.stdout:8/182: symlink d1/de/d13/l47 0 2024-02-15T22:40:45.430 INFO:tasks.workunit.client.0.smithi033.stdout:8/183: dread - d1/de/d1a/d2a/f30 zero size 2024-02-15T22:40:45.430 INFO:tasks.workunit.client.0.smithi033.stdout:8/184: write d1/de/d13/f29 [1335335,33516] 0 2024-02-15T22:40:45.430 INFO:tasks.workunit.client.0.smithi033.stdout:8/185: fdatasync d1/d6/f7 0 2024-02-15T22:40:45.433 INFO:tasks.workunit.client.0.smithi033.stdout:3/288: write d0/d3/f17 [1793934,25370] 0 2024-02-15T22:40:45.434 INFO:tasks.workunit.client.0.smithi033.stdout:3/289: write d0/d3/d2c/f34 [389079,82057] 0 2024-02-15T22:40:45.434 INFO:tasks.workunit.client.0.smithi033.stdout:4/217: dwrite f5 [0,4194304] 0 2024-02-15T22:40:45.435 INFO:tasks.workunit.client.0.smithi033.stdout:0/299: getdents db/d19 0 2024-02-15T22:40:45.439 INFO:tasks.workunit.client.0.smithi033.stdout:9/205: rename d4/l1f to d4/d1d/d23/d24/l3a 0 2024-02-15T22:40:45.441 INFO:tasks.workunit.client.0.smithi033.stdout:6/221: creat d12/d2c/d30/d1d/f46 x:0 0 0 2024-02-15T22:40:45.441 INFO:tasks.workunit.client.0.smithi033.stdout:6/222: readlink d12/d2c/l3a 0 2024-02-15T22:40:45.446 INFO:tasks.workunit.client.0.smithi033.stdout:8/186: symlink d1/de/d1a/d2a/l48 0 2024-02-15T22:40:45.449 INFO:tasks.workunit.client.0.smithi033.stdout:3/290: dwrite d0/f4a [0,4194304] 0 2024-02-15T22:40:45.451 INFO:tasks.workunit.client.0.smithi033.stdout:6/223: dread d12/f18 [0,4194304] 0 2024-02-15T22:40:45.452 INFO:tasks.workunit.client.0.smithi033.stdout:4/218: mkdir d8/d18/d37/d31/d47 0 2024-02-15T22:40:45.454 INFO:tasks.workunit.client.0.smithi033.stdout:6/224: dread d12/d2c/d30/f16 [0,4194304] 0 2024-02-15T22:40:45.454 INFO:tasks.workunit.client.0.smithi033.stdout:6/225: dread - d12/d2c/d30/d19/f3e zero size 2024-02-15T22:40:45.455 INFO:tasks.workunit.client.0.smithi033.stdout:0/300: mknod db/c65 0 2024-02-15T22:40:45.458 INFO:tasks.workunit.client.0.smithi033.stdout:9/206: truncate d4/f13 961735 0 2024-02-15T22:40:45.458 INFO:tasks.workunit.client.0.smithi033.stdout:9/207: write d4/f18 [9333471,51738] 0 2024-02-15T22:40:45.462 INFO:tasks.workunit.client.0.smithi033.stdout:8/187: truncate d1/f10 482202 0 2024-02-15T22:40:45.462 INFO:tasks.workunit.client.0.smithi033.stdout:8/188: write d1/de/d1a/d2a/f3c [308053,85601] 0 2024-02-15T22:40:45.465 INFO:tasks.workunit.client.0.smithi033.stdout:1/224: truncate d1/de/d27/d28/d37/f45 3904860 0 2024-02-15T22:40:45.465 INFO:tasks.workunit.client.0.smithi033.stdout:1/225: chown d1/d20/c32 814944 1 2024-02-15T22:40:45.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/291: unlink d0/d3/l10 0 2024-02-15T22:40:45.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/292: write d0/f1f [5033435,30881] 0 2024-02-15T22:40:45.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/293: dread - d0/d3/f44 zero size 2024-02-15T22:40:45.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/294: read - d0/d3/dd/f52 zero size 2024-02-15T22:40:45.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/295: write d0/d3/d2c/d43/f45 [595578,60279] 0 2024-02-15T22:40:45.501 INFO:tasks.workunit.client.0.smithi033.stdout:4/219: dwrite d8/fe [0,4194304] 0 2024-02-15T22:40:45.501 INFO:tasks.workunit.client.0.smithi033.stdout:4/220: fsync f4 0 2024-02-15T22:40:45.501 INFO:tasks.workunit.client.0.smithi033.stdout:4/221: fsync d8/d1a/f36 0 2024-02-15T22:40:45.501 INFO:tasks.workunit.client.0.smithi033.stdout:6/226: creat d12/d2c/d30/d1d/d35/f47 x:0 0 0 2024-02-15T22:40:45.501 INFO:tasks.workunit.client.0.smithi033.stdout:6/227: creat d12/d2c/d30/f48 x:0 0 0 2024-02-15T22:40:45.503 INFO:tasks.workunit.client.0.smithi033.stdout:0/301: mknod db/d19/d32/d43/d5a/c66 0 2024-02-15T22:40:45.503 INFO:tasks.workunit.client.0.smithi033.stdout:0/302: dread - db/d19/d32/d3d/f59 zero size 2024-02-15T22:40:45.511 INFO:tasks.workunit.client.0.smithi033.stdout:8/189: mkdir d1/df/d44/d49 0 2024-02-15T22:40:45.511 INFO:tasks.workunit.client.0.smithi033.stdout:8/190: truncate d1/de/d1a/d2a/f30 398866 0 2024-02-15T22:40:45.514 INFO:tasks.workunit.client.0.smithi033.stdout:1/226: truncate d1/f15 673637 0 2024-02-15T22:40:45.514 INFO:tasks.workunit.client.0.smithi033.stdout:1/227: write d1/de/d27/d28/f29 [900182,122634] 0 2024-02-15T22:40:45.516 INFO:tasks.workunit.client.0.smithi033.stdout:3/296: symlink d0/l5e 0 2024-02-15T22:40:45.529 INFO:tasks.workunit.client.0.smithi033.stdout:6/228: rename f6 to d12/d2c/d30/f49 0 2024-02-15T22:40:45.541 INFO:tasks.workunit.client.0.smithi033.stdout:3/297: dwrite d0/f19 [0,4194304] 0 2024-02-15T22:40:45.541 INFO:tasks.workunit.client.0.smithi033.stdout:0/303: link db/l58 db/d19/d32/d3d/l67 0 2024-02-15T22:40:45.541 INFO:tasks.workunit.client.0.smithi033.stdout:0/304: chown db/d19/d32/d3d/c5b 25914 1 2024-02-15T22:40:45.544 INFO:tasks.workunit.client.0.smithi033.stdout:3/298: dread d0/f42 [0,4194304] 0 2024-02-15T22:40:45.544 INFO:tasks.workunit.client.0.smithi033.stdout:3/299: truncate d0/d3/d2c/d5d/d3d/f48 251571 0 2024-02-15T22:40:45.544 INFO:tasks.workunit.client.0.smithi033.stdout:8/191: mkdir d1/df/d1d/d4a 0 2024-02-15T22:40:45.546 INFO:tasks.workunit.client.0.smithi033.stdout:1/228: rmdir d1/d20/d42/d2c 39 2024-02-15T22:40:45.547 INFO:tasks.workunit.client.0.smithi033.stdout:1/229: write d1/de/d27/d28/d37/f3e [440178,119287] 0 2024-02-15T22:40:45.548 INFO:tasks.workunit.client.0.smithi033.stdout:4/222: rmdir d8/d16/d19 39 2024-02-15T22:40:45.549 INFO:tasks.workunit.client.0.smithi033.stdout:4/223: creat d8/d18/d37/d31/f48 x:0 0 0 2024-02-15T22:40:45.549 INFO:tasks.workunit.client.0.smithi033.stdout:4/224: chown d8/d16/d19/d1c/c29 398 1 2024-02-15T22:40:45.549 INFO:tasks.workunit.client.0.smithi033.stdout:4/225: write d8/d1a/f36 [308645,116728] 0 2024-02-15T22:40:45.550 INFO:tasks.workunit.client.0.smithi033.stdout:4/226: dread d8/d18/d37/d31/f3e [0,4194304] 0 2024-02-15T22:40:45.551 INFO:tasks.workunit.client.0.smithi033.stdout:6/229: creat d12/d2c/f4a x:0 0 0 2024-02-15T22:40:45.553 INFO:tasks.workunit.client.0.smithi033.stdout:0/305: mkdir db/d2a/d68 0 2024-02-15T22:40:45.556 INFO:tasks.workunit.client.0.smithi033.stdout:3/300: unlink d0/f7 0 2024-02-15T22:40:45.558 INFO:tasks.workunit.client.0.smithi033.stdout:0/306: dread db/d19/f3f [0,4194304] 0 2024-02-15T22:40:45.559 INFO:tasks.workunit.client.0.smithi033.stdout:8/192: creat d1/df/d2e/f4b x:0 0 0 2024-02-15T22:40:45.561 INFO:tasks.workunit.client.0.smithi033.stdout:1/230: truncate d1/de/f16 3258381 0 2024-02-15T22:40:45.561 INFO:tasks.workunit.client.0.smithi033.stdout:1/231: fsync d1/f8 0 2024-02-15T22:40:45.562 INFO:tasks.workunit.client.0.smithi033.stdout:1/232: creat d1/de/d27/d28/d2d/f48 x:0 0 0 2024-02-15T22:40:45.562 INFO:tasks.workunit.client.0.smithi033.stdout:1/233: fsync d1/de/f1b 0 2024-02-15T22:40:45.562 INFO:tasks.workunit.client.0.smithi033.stdout:0/307: dread db/d19/f1e [0,4194304] 0 2024-02-15T22:40:45.565 INFO:tasks.workunit.client.0.smithi033.stdout:4/227: mkdir d8/d16/d19/d1c/d3c/d49 0 2024-02-15T22:40:45.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/228: dread d8/d16/d19/f44 [0,4194304] 0 2024-02-15T22:40:45.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/229: creat d8/f4a x:0 0 0 2024-02-15T22:40:45.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/230: chown d8/d16/d19/d27/c17 7 1 2024-02-15T22:40:45.568 INFO:tasks.workunit.client.0.smithi033.stdout:6/230: mkdir d12/d1b/d3f/d4b 0 2024-02-15T22:40:45.570 INFO:tasks.workunit.client.0.smithi033.stdout:3/301: mkdir d0/d3/d5f 0 2024-02-15T22:40:45.571 INFO:tasks.workunit.client.0.smithi033.stdout:8/193: mkdir d1/df/d1d/d4a/d4c 0 2024-02-15T22:40:45.572 INFO:tasks.workunit.client.0.smithi033.stdout:8/194: dread d1/de/d1a/f20 [0,4194304] 0 2024-02-15T22:40:45.572 INFO:tasks.workunit.client.0.smithi033.stdout:8/195: fsync d1/de/d1a/d2a/f30 0 2024-02-15T22:40:45.572 INFO:tasks.workunit.client.0.smithi033.stdout:8/196: creat d1/de/d13/f4d x:0 0 0 2024-02-15T22:40:45.572 INFO:tasks.workunit.client.0.smithi033.stdout:8/197: chown d1/de/d1a/d2a 1202529 1 2024-02-15T22:40:45.574 INFO:tasks.workunit.client.0.smithi033.stdout:1/234: creat d1/d20/d42/f49 x:0 0 0 2024-02-15T22:40:45.576 INFO:tasks.workunit.client.0.smithi033.stdout:0/308: symlink db/d19/d32/l69 0 2024-02-15T22:40:45.577 INFO:tasks.workunit.client.0.smithi033.stdout:0/309: fdatasync db/d19/d32/d46/f54 0 2024-02-15T22:40:45.577 INFO:tasks.workunit.client.0.smithi033.stdout:6/231: read d12/d2c/d30/f20 [3217158,95753] 0 2024-02-15T22:40:45.582 INFO:tasks.workunit.client.0.smithi033.stdout:4/231: unlink d8/d16/d19/c1b 0 2024-02-15T22:40:45.586 INFO:tasks.workunit.client.0.smithi033.stdout:0/310: write db/d19/d32/f23 [3759451,86641] 0 2024-02-15T22:40:45.591 INFO:tasks.workunit.client.0.smithi033.stdout:0/311: dread fa [0,4194304] 0 2024-02-15T22:40:45.594 INFO:tasks.workunit.client.0.smithi033.stdout:6/232: dwrite d12/d2c/d30/f1f [4194304,4194304] 0 2024-02-15T22:40:45.594 INFO:tasks.workunit.client.0.smithi033.stdout:6/233: creat d12/d3c/f4c x:0 0 0 2024-02-15T22:40:45.595 INFO:tasks.workunit.client.0.smithi033.stdout:6/234: truncate d12/d2c/d30/f48 82711 0 2024-02-15T22:40:45.601 INFO:tasks.workunit.client.0.smithi033.stdout:3/302: rmdir d0/d3/d2c/d5d/d3d 39 2024-02-15T22:40:45.605 INFO:tasks.workunit.client.0.smithi033.stdout:8/198: rename d1/de/f31 to d1/de/d1a/d2a/d40/f4e 0 2024-02-15T22:40:45.607 INFO:tasks.workunit.client.0.smithi033.stdout:1/235: rmdir d1/de/d27/d39 39 2024-02-15T22:40:45.607 INFO:tasks.workunit.client.0.smithi033.stdout:1/236: creat d1/de/d27/d28/d37/f4a x:0 0 0 2024-02-15T22:40:45.607 INFO:tasks.workunit.client.0.smithi033.stdout:1/237: chown d1/de/d27/d28/d2d/d3b 91250 1 2024-02-15T22:40:45.609 INFO:tasks.workunit.client.0.smithi033.stdout:4/232: link d8/d1a/l20 d8/d16/d45/l4b 0 2024-02-15T22:40:45.609 INFO:tasks.workunit.client.0.smithi033.stdout:4/233: truncate d8/f4a 327293 0 2024-02-15T22:40:45.623 INFO:tasks.workunit.client.0.smithi033.stdout:6/235: link d12/d2c/d30/d19/f26 d12/d3c/f4d 0 2024-02-15T22:40:45.624 INFO:tasks.workunit.client.0.smithi033.stdout:6/236: fdatasync d12/d2c/d30/f20 0 2024-02-15T22:40:45.624 INFO:tasks.workunit.client.0.smithi033.stdout:6/237: truncate d12/d2c/d30/f3d 752279 0 2024-02-15T22:40:45.624 INFO:tasks.workunit.client.0.smithi033.stdout:6/238: write d12/d2c/d30/f48 [938702,37612] 0 2024-02-15T22:40:45.624 INFO:tasks.workunit.client.0.smithi033.stdout:8/199: dwrite d1/d36/f43 [0,4194304] 0 2024-02-15T22:40:45.624 INFO:tasks.workunit.client.0.smithi033.stdout:3/303: symlink d0/d3/l60 0 2024-02-15T22:40:45.627 INFO:tasks.workunit.client.0.smithi033.stdout:0/312: rename db/d19/l4b to db/l6a 0 2024-02-15T22:40:45.631 INFO:tasks.workunit.client.0.smithi033.stdout:1/238: truncate d1/d20/d42/f2f 3080510 0 2024-02-15T22:40:45.631 INFO:tasks.workunit.client.0.smithi033.stdout:1/239: chown d1/d20/d42/c35 14 1 2024-02-15T22:40:45.634 INFO:tasks.workunit.client.0.smithi033.stdout:5/384: sync 2024-02-15T22:40:45.634 INFO:tasks.workunit.client.0.smithi033.stdout:7/276: sync 2024-02-15T22:40:45.634 INFO:tasks.workunit.client.0.smithi033.stdout:2/332: sync 2024-02-15T22:40:45.634 INFO:tasks.workunit.client.0.smithi033.stdout:5/385: readlink d6/d14/d43/l44 0 2024-02-15T22:40:45.635 INFO:tasks.workunit.client.0.smithi033.stdout:2/333: write d1/d8/d2b/d2f/d38/f5c [627095,48269] 0 2024-02-15T22:40:45.636 INFO:tasks.workunit.client.0.smithi033.stdout:0/313: dread db/d19/d32/f48 [0,4194304] 0 2024-02-15T22:40:45.636 INFO:tasks.workunit.client.0.smithi033.stdout:6/239: creat d12/d2c/d30/d1d/f4e x:0 0 0 2024-02-15T22:40:45.636 INFO:tasks.workunit.client.0.smithi033.stdout:7/277: dread d5/f19 [0,4194304] 0 2024-02-15T22:40:45.637 INFO:tasks.workunit.client.0.smithi033.stdout:5/386: dread d6/d14/d31/f3b [4194304,4194304] 0 2024-02-15T22:40:45.642 INFO:tasks.workunit.client.0.smithi033.stdout:2/334: unlink d1/d8/l36 0 2024-02-15T22:40:45.646 INFO:tasks.workunit.client.0.smithi033.stdout:0/314: mknod db/d19/d32/d43/d5a/c6b 0 2024-02-15T22:40:45.647 INFO:tasks.workunit.client.0.smithi033.stdout:5/387: write d6/d14/f30 [1329656,33864] 0 2024-02-15T22:40:45.648 INFO:tasks.workunit.client.0.smithi033.stdout:1/240: dwrite d1/f6 [0,4194304] 0 2024-02-15T22:40:45.648 INFO:tasks.workunit.client.0.smithi033.stdout:1/241: chown d1/fa 62360499 1 2024-02-15T22:40:45.649 INFO:tasks.workunit.client.0.smithi033.stdout:6/240: mknod d12/d1b/d3f/c4f 0 2024-02-15T22:40:45.649 INFO:tasks.workunit.client.0.smithi033.stdout:6/241: dread - d12/d3c/f4c zero size 2024-02-15T22:40:45.651 INFO:tasks.workunit.client.0.smithi033.stdout:7/278: symlink d5/df/d47/l5d 0 2024-02-15T22:40:45.651 INFO:tasks.workunit.client.0.smithi033.stdout:7/279: chown d5/d6/d10/d16/d26/f2a 63527207 1 2024-02-15T22:40:45.653 INFO:tasks.workunit.client.0.smithi033.stdout:3/304: rmdir d0/d3/dd 39 2024-02-15T22:40:45.653 INFO:tasks.workunit.client.0.smithi033.stdout:9/208: sync 2024-02-15T22:40:45.657 INFO:tasks.workunit.client.0.smithi033.stdout:2/335: rename d1/d8/d2b/d2f/d3d/c4d to d1/d8/d2b/d2f/d24/d5d/c5e 0 2024-02-15T22:40:45.661 INFO:tasks.workunit.client.0.smithi033.stdout:0/315: mkdir db/d2a/d6c 0 2024-02-15T22:40:45.661 INFO:tasks.workunit.client.0.smithi033.stdout:0/316: readlink db/l13 0 2024-02-15T22:40:45.663 INFO:tasks.workunit.client.0.smithi033.stdout:5/388: creat d6/d14/d43/d70/f78 x:0 0 0 2024-02-15T22:40:45.664 INFO:tasks.workunit.client.0.smithi033.stdout:5/389: read d6/d14/f6b [464661,47470] 0 2024-02-15T22:40:45.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/390: creat d6/d14/d43/d70/f79 x:0 0 0 2024-02-15T22:40:45.665 INFO:tasks.workunit.client.0.smithi033.stdout:5/391: read d6/ff [5039251,10616] 0 2024-02-15T22:40:45.666 INFO:tasks.workunit.client.0.smithi033.stdout:1/242: mknod d1/de/d27/d28/d37/c4b 0 2024-02-15T22:40:45.667 INFO:tasks.workunit.client.0.smithi033.stdout:1/243: creat d1/de/d27/d28/d2d/f4c x:0 0 0 2024-02-15T22:40:45.668 INFO:tasks.workunit.client.0.smithi033.stdout:6/242: chown d12/c1e 2045137 1 2024-02-15T22:40:45.669 INFO:tasks.workunit.client.0.smithi033.stdout:5/392: dread d6/d14/d31/f37 [0,4194304] 0 2024-02-15T22:40:45.672 INFO:tasks.workunit.client.0.smithi033.stdout:7/280: dwrite d5/df/d40/f42 [0,4194304] 0 2024-02-15T22:40:45.672 INFO:tasks.workunit.client.0.smithi033.stdout:7/281: creat d5/df/f5e x:0 0 0 2024-02-15T22:40:45.672 INFO:tasks.workunit.client.0.smithi033.stdout:7/282: fsync d5/d6/f7 0 2024-02-15T22:40:45.672 INFO:tasks.workunit.client.0.smithi033.stdout:3/305: dwrite d0/d3/d2c/f46 [0,4194304] 0 2024-02-15T22:40:45.680 INFO:tasks.workunit.client.0.smithi033.stdout:3/306: dread d0/f36 [0,4194304] 0 2024-02-15T22:40:45.680 INFO:tasks.workunit.client.0.smithi033.stdout:3/307: chown d0/d3/d2c/d5d/f37 3 1 2024-02-15T22:40:45.681 INFO:tasks.workunit.client.0.smithi033.stdout:3/308: creat d0/d3/d2c/d43/f61 x:0 0 0 2024-02-15T22:40:45.813 INFO:tasks.workunit.client.0.smithi033.stdout:9/209: creat d4/f3b x:0 0 0 2024-02-15T22:40:45.822 INFO:tasks.workunit.client.0.smithi033.stdout:1/244: mkdir d1/d20/d42/d25/d4d 0 2024-02-15T22:40:45.824 INFO:tasks.workunit.client.0.smithi033.stdout:6/243: readlink d12/l23 0 2024-02-15T22:40:45.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/393: mkdir d6/d14/d31/d64/d7a 0 2024-02-15T22:40:45.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/394: truncate d6/d14/d31/d48/d56/f5b 718002 0 2024-02-15T22:40:45.827 INFO:tasks.workunit.client.0.smithi033.stdout:9/210: dwrite d4/f15 [4194304,4194304] 0 2024-02-15T22:40:45.828 INFO:tasks.workunit.client.0.smithi033.stdout:9/211: read d4/d1d/d23/d24/f2b [397498,46108] 0 2024-02-15T22:40:45.834 INFO:tasks.workunit.client.0.smithi033.stdout:7/283: rename d5/df/d2c to d5/dc/d5f 0 2024-02-15T22:40:45.836 INFO:tasks.workunit.client.0.smithi033.stdout:7/284: dread d5/f50 [0,4194304] 0 2024-02-15T22:40:45.841 INFO:tasks.workunit.client.0.smithi033.stdout:7/285: dread d5/d6/f39 [0,4194304] 0 2024-02-15T22:40:45.841 INFO:tasks.workunit.client.0.smithi033.stdout:3/309: mknod d0/d3/c62 0 2024-02-15T22:40:45.842 INFO:tasks.workunit.client.0.smithi033.stdout:7/286: dread d5/f50 [0,4194304] 0 2024-02-15T22:40:45.842 INFO:tasks.workunit.client.0.smithi033.stdout:7/287: chown d5/df/f44 218 1 2024-02-15T22:40:45.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/310: dread d0/d1c/f59 [0,4194304] 0 2024-02-15T22:40:45.844 INFO:tasks.workunit.client.0.smithi033.stdout:1/245: mkdir d1/d20/d42/d2c/d4e 0 2024-02-15T22:40:45.844 INFO:tasks.workunit.client.0.smithi033.stdout:1/246: fdatasync d1/f7 0 2024-02-15T22:40:45.844 INFO:tasks.workunit.client.0.smithi033.stdout:1/247: fdatasync d1/f1c 0 2024-02-15T22:40:45.845 INFO:tasks.workunit.client.0.smithi033.stdout:6/244: getdents d12/d1b 0 2024-02-15T22:40:45.846 INFO:tasks.workunit.client.0.smithi033.stdout:5/395: mknod d6/d14/d31/d50/d6a/c7b 0 2024-02-15T22:40:45.852 INFO:tasks.workunit.client.0.smithi033.stdout:9/212: rename d4/f8 to d4/d1d/f3c 0 2024-02-15T22:40:45.855 INFO:tasks.workunit.client.0.smithi033.stdout:7/288: rename d5/df/d56/d58 to d5/df/d56/d60 0 2024-02-15T22:40:45.858 INFO:tasks.workunit.client.0.smithi033.stdout:1/248: mknod d1/d20/d42/d25/c4f 0 2024-02-15T22:40:45.864 INFO:tasks.workunit.client.0.smithi033.stdout:5/396: dwrite d6/d14/d31/d48/d59/f71 [0,4194304] 0 2024-02-15T22:40:45.867 INFO:tasks.workunit.client.0.smithi033.stdout:6/245: mkdir d12/d1b/d3f/d50 0 2024-02-15T22:40:45.869 INFO:tasks.workunit.client.0.smithi033.stdout:9/213: creat d4/d1d/d23/f3d x:0 0 0 2024-02-15T22:40:45.871 INFO:tasks.workunit.client.0.smithi033.stdout:7/289: getdents d5/df/d47 0 2024-02-15T22:40:45.877 INFO:tasks.workunit.client.0.smithi033.stdout:5/397: rename d6/c21 to d6/d14/d31/d48/d49/d53/c7c 0 2024-02-15T22:40:45.879 INFO:tasks.workunit.client.0.smithi033.stdout:6/246: symlink d12/d2c/d30/l51 0 2024-02-15T22:40:45.879 INFO:tasks.workunit.client.0.smithi033.stdout:7/290: read d5/df/d40/f42 [3037116,125233] 0 2024-02-15T22:40:45.880 INFO:tasks.workunit.client.0.smithi033.stdout:1/249: dwrite d1/de/f16 [0,4194304] 0 2024-02-15T22:40:45.880 INFO:tasks.workunit.client.0.smithi033.stdout:1/250: write d1/d20/d42/d2c/d30/f40 [1152481,42296] 0 2024-02-15T22:40:45.880 INFO:tasks.workunit.client.0.smithi033.stdout:9/214: mkdir d4/d1d/d23/d32/d3e 0 2024-02-15T22:40:45.880 INFO:tasks.workunit.client.0.smithi033.stdout:9/215: truncate d4/fd 583011 0 2024-02-15T22:40:45.882 INFO:tasks.workunit.client.0.smithi033.stdout:5/398: rename d6/c9 to d6/d14/d31/d48/d49/d53/c7d 0 2024-02-15T22:40:45.887 INFO:tasks.workunit.client.0.smithi033.stdout:7/291: truncate d5/d6/f54 562779 0 2024-02-15T22:40:45.890 INFO:tasks.workunit.client.0.smithi033.stdout:1/251: dread d1/de/d27/d28/d37/f45 [0,4194304] 0 2024-02-15T22:40:45.896 INFO:tasks.workunit.client.0.smithi033.stdout:9/216: mkdir d4/d1d/d23/d35/d38/d3f 0 2024-02-15T22:40:45.896 INFO:tasks.workunit.client.0.smithi033.stdout:9/217: write d4/fe [4369923,38297] 0 2024-02-15T22:40:45.897 INFO:tasks.workunit.client.0.smithi033.stdout:9/218: write d4/d1d/d23/d24/f2b [683215,30406] 0 2024-02-15T22:40:45.899 INFO:tasks.workunit.client.0.smithi033.stdout:5/399: symlink d6/d14/d43/d70/l7e 0 2024-02-15T22:40:45.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/400: fsync d6/d14/d43/f6c 0 2024-02-15T22:40:45.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/401: chown d6/d14/d31/d48/f5e 106120976 1 2024-02-15T22:40:45.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/402: readlink d6/d14/d31/d48/l4a 0 2024-02-15T22:40:45.902 INFO:tasks.workunit.client.0.smithi033.stdout:1/252: symlink d1/de/d27/d28/d2d/l50 0 2024-02-15T22:40:45.904 INFO:tasks.workunit.client.0.smithi033.stdout:9/219: rename d4/d1d/d23/c2a to d4/d1d/d23/d32/c40 0 2024-02-15T22:40:45.904 INFO:tasks.workunit.client.0.smithi033.stdout:9/220: chown d4/d1d/d23/d24/l27 1245162 1 2024-02-15T22:40:45.906 INFO:tasks.workunit.client.0.smithi033.stdout:5/403: mknod d6/d14/d31/d48/d49/c7f 0 2024-02-15T22:40:45.908 INFO:tasks.workunit.client.0.smithi033.stdout:6/247: dwrite d12/f13 [0,4194304] 0 2024-02-15T22:40:45.908 INFO:tasks.workunit.client.0.smithi033.stdout:7/292: dwrite d5/d6/d10/f34 [0,4194304] 0 2024-02-15T22:40:45.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/253: creat d1/de/d27/d39/d3a/f51 x:0 0 0 2024-02-15T22:40:45.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/254: chown d1/d20/d42/d2c/d4e 2155 1 2024-02-15T22:40:45.911 INFO:tasks.workunit.client.0.smithi033.stdout:9/221: mkdir d4/d1d/d23/d24/d41 0 2024-02-15T22:40:45.911 INFO:tasks.workunit.client.0.smithi033.stdout:9/222: dread d4/f29 [0,4194304] 0 2024-02-15T22:40:45.912 INFO:tasks.workunit.client.0.smithi033.stdout:9/223: stat d4/fd 0 2024-02-15T22:40:45.916 INFO:tasks.workunit.client.0.smithi033.stdout:6/248: creat d12/d1b/f52 x:0 0 0 2024-02-15T22:40:45.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/293: symlink d5/dc/d5f/d48/l61 0 2024-02-15T22:40:45.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/294: write d5/df/d40/f42 [2027571,12100] 0 2024-02-15T22:40:45.926 INFO:tasks.workunit.client.0.smithi033.stdout:9/224: dwrite d4/ff [4194304,4194304] 0 2024-02-15T22:40:45.926 INFO:tasks.workunit.client.0.smithi033.stdout:9/225: readlink d4/l12 0 2024-02-15T22:40:45.928 INFO:tasks.workunit.client.0.smithi033.stdout:1/255: symlink d1/d20/d42/d2c/d4e/l52 0 2024-02-15T22:40:45.930 INFO:tasks.workunit.client.0.smithi033.stdout:6/249: mknod d12/d2c/d30/d1d/c53 0 2024-02-15T22:40:45.934 INFO:tasks.workunit.client.0.smithi033.stdout:7/295: creat d5/df/d56/d60/d59/f62 x:0 0 0 2024-02-15T22:40:45.936 INFO:tasks.workunit.client.0.smithi033.stdout:9/226: write d4/fb [1122878,110828] 0 2024-02-15T22:40:45.937 INFO:tasks.workunit.client.0.smithi033.stdout:9/227: readlink d4/d1d/d23/d24/l2f 0 2024-02-15T22:40:45.937 INFO:tasks.workunit.client.0.smithi033.stdout:9/228: read d4/f13 [695960,67386] 0 2024-02-15T22:40:45.937 INFO:tasks.workunit.client.0.smithi033.stdout:9/229: stat d4/c6 0 2024-02-15T22:40:45.940 INFO:tasks.workunit.client.0.smithi033.stdout:1/256: unlink d1/d20/f41 0 2024-02-15T22:40:45.942 INFO:tasks.workunit.client.0.smithi033.stdout:1/257: dread d1/de/d27/d28/d37/f3e [0,4194304] 0 2024-02-15T22:40:45.943 INFO:tasks.workunit.client.0.smithi033.stdout:1/258: fdatasync d1/de/f1b 0 2024-02-15T22:40:45.943 INFO:tasks.workunit.client.0.smithi033.stdout:1/259: write d1/d20/d42/f33 [487766,14274] 0 2024-02-15T22:40:45.943 INFO:tasks.workunit.client.0.smithi033.stdout:7/296: dread d5/d6/d10/d16/d26/f3c [0,4194304] 0 2024-02-15T22:40:45.944 INFO:tasks.workunit.client.0.smithi033.stdout:6/250: link d12/d2c/d30/l51 d12/d1b/l54 0 2024-02-15T22:40:45.946 INFO:tasks.workunit.client.0.smithi033.stdout:9/230: write d4/fb [4804533,98628] 0 2024-02-15T22:40:45.947 INFO:tasks.workunit.client.0.smithi033.stdout:1/260: mknod d1/de/d27/d39/c53 0 2024-02-15T22:40:45.951 INFO:tasks.workunit.client.0.smithi033.stdout:9/231: mkdir d4/d1d/d42 0 2024-02-15T22:40:45.951 INFO:tasks.workunit.client.0.smithi033.stdout:9/232: read d4/fe [1334467,129229] 0 2024-02-15T22:40:45.953 INFO:tasks.workunit.client.0.smithi033.stdout:4/234: sync 2024-02-15T22:40:45.955 INFO:tasks.workunit.client.0.smithi033.stdout:1/261: creat d1/de/d27/d28/d2d/d36/f54 x:0 0 0 2024-02-15T22:40:45.957 INFO:tasks.workunit.client.0.smithi033.stdout:9/233: dread d4/fe [0,4194304] 0 2024-02-15T22:40:45.957 INFO:tasks.workunit.client.0.smithi033.stdout:9/234: dread - d4/d1d/d23/f3d zero size 2024-02-15T22:40:45.958 INFO:tasks.workunit.client.0.smithi033.stdout:6/251: rename c9 to d12/d1b/d3f/d4b/c55 0 2024-02-15T22:40:45.961 INFO:tasks.workunit.client.0.smithi033.stdout:1/262: mknod d1/d20/d42/c55 0 2024-02-15T22:40:45.961 INFO:tasks.workunit.client.0.smithi033.stdout:1/263: chown d1/f7 0 1 2024-02-15T22:40:45.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/297: dwrite d5/d6/fa [8388608,4194304] 0 2024-02-15T22:40:45.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/298: dread - d5/df/f5e zero size 2024-02-15T22:40:45.964 INFO:tasks.workunit.client.0.smithi033.stdout:7/299: dread d5/d6/f54 [0,4194304] 0 2024-02-15T22:40:45.964 INFO:tasks.workunit.client.0.smithi033.stdout:7/300: chown d5/dc/d5f/l33 529 1 2024-02-15T22:40:45.964 INFO:tasks.workunit.client.0.smithi033.stdout:9/235: link d4/f3b d4/f43 0 2024-02-15T22:40:45.968 INFO:tasks.workunit.client.0.smithi033.stdout:4/235: rename f6 to d8/d18/d37/d31/d47/f4c 0 2024-02-15T22:40:45.972 INFO:tasks.workunit.client.0.smithi033.stdout:1/264: write d1/de/f1f [4417142,23561] 0 2024-02-15T22:40:45.972 INFO:tasks.workunit.client.0.smithi033.stdout:1/265: stat d1/de/d27/d39 0 2024-02-15T22:40:45.972 INFO:tasks.workunit.client.0.smithi033.stdout:6/252: dwrite d12/d2c/d30/d1d/f33 [0,4194304] 0 2024-02-15T22:40:45.972 INFO:tasks.workunit.client.0.smithi033.stdout:6/253: write d12/d2c/d30/d19/f3e [849318,17481] 0 2024-02-15T22:40:45.985 INFO:tasks.workunit.client.0.smithi033.stdout:7/301: creat d5/df/d56/f63 x:0 0 0 2024-02-15T22:40:45.985 INFO:tasks.workunit.client.0.smithi033.stdout:7/302: read d5/f18 [1658776,111366] 0 2024-02-15T22:40:45.986 INFO:tasks.workunit.client.0.smithi033.stdout:9/236: creat d4/d1d/d23/d32/d3e/f44 x:0 0 0 2024-02-15T22:40:45.991 INFO:tasks.workunit.client.0.smithi033.stdout:4/236: getdents d8/d16/d45 0 2024-02-15T22:40:45.995 INFO:tasks.workunit.client.0.smithi033.stdout:1/266: getdents d1/de/d27/d28 0 2024-02-15T22:40:46.004 INFO:tasks.workunit.client.0.smithi033.stdout:1/267: write d1/de/f16 [3227571,43829] 0 2024-02-15T22:40:46.008 INFO:tasks.workunit.client.0.smithi033.stdout:7/303: rename d5/dc/l32 to d5/df/d47/l64 0 2024-02-15T22:40:46.008 INFO:tasks.workunit.client.0.smithi033.stdout:9/237: dwrite d4/d1d/f2c [0,4194304] 0 2024-02-15T22:40:46.008 INFO:tasks.workunit.client.0.smithi033.stdout:9/238: readlink d4/l31 0 2024-02-15T22:40:46.016 INFO:tasks.workunit.client.0.smithi033.stdout:7/304: unlink d5/d6/f39 0 2024-02-15T22:40:46.021 INFO:tasks.workunit.client.0.smithi033.stdout:9/239: truncate d4/d1d/d23/d24/f2b 764187 0 2024-02-15T22:40:46.023 INFO:tasks.workunit.client.0.smithi033.stdout:4/237: getdents d8 0 2024-02-15T22:40:46.028 INFO:tasks.workunit.client.0.smithi033.stdout:7/305: creat d5/d6/d10/d16/d26/d3f/f65 x:0 0 0 2024-02-15T22:40:46.031 INFO:tasks.workunit.client.0.smithi033.stdout:1/268: dwrite d1/de/f16 [0,4194304] 0 2024-02-15T22:40:46.033 INFO:tasks.workunit.client.0.smithi033.stdout:7/306: dread d5/f50 [0,4194304] 0 2024-02-15T22:40:46.038 INFO:tasks.workunit.client.0.smithi033.stdout:1/269: unlink d1/de/d27/d28/d2d/f4c 0 2024-02-15T22:40:46.038 INFO:tasks.workunit.client.0.smithi033.stdout:1/270: fsync d1/de/d27/d28/f29 0 2024-02-15T22:40:46.038 INFO:tasks.workunit.client.0.smithi033.stdout:1/271: chown d1/d20/c43 1 1 2024-02-15T22:40:46.038 INFO:tasks.workunit.client.0.smithi033.stdout:1/272: stat d1/d20/d42/c35 0 2024-02-15T22:40:46.038 INFO:tasks.workunit.client.0.smithi033.stdout:1/273: fdatasync d1/de/f13 0 2024-02-15T22:40:46.040 INFO:tasks.workunit.client.0.smithi033.stdout:7/307: rename d5/df/d40/f42 to d5/d6/d10/d16/d26/d3f/f66 0 2024-02-15T22:40:46.040 INFO:tasks.workunit.client.0.smithi033.stdout:7/308: readlink d5/l12 0 2024-02-15T22:40:46.043 INFO:tasks.workunit.client.0.smithi033.stdout:7/309: mknod d5/c67 0 2024-02-15T22:40:46.044 INFO:tasks.workunit.client.0.smithi033.stdout:7/310: chown d5/d6/d10/d16/d26/d3f 125319364 1 2024-02-15T22:40:46.047 INFO:tasks.workunit.client.0.smithi033.stdout:7/311: unlink d5/df/c27 0 2024-02-15T22:40:46.047 INFO:tasks.workunit.client.0.smithi033.stdout:7/312: truncate d5/df/f44 8880647 0 2024-02-15T22:40:46.047 INFO:tasks.workunit.client.0.smithi033.stdout:7/313: creat d5/d6/f68 x:0 0 0 2024-02-15T22:40:46.047 INFO:tasks.workunit.client.0.smithi033.stdout:7/314: chown d5/d6/d10/d16 29 1 2024-02-15T22:40:46.050 INFO:tasks.workunit.client.0.smithi033.stdout:1/274: dread d1/f1c [0,4194304] 0 2024-02-15T22:40:46.050 INFO:tasks.workunit.client.0.smithi033.stdout:4/238: dwrite d8/d18/d37/d31/f34 [0,4194304] 0 2024-02-15T22:40:46.050 INFO:tasks.workunit.client.0.smithi033.stdout:9/240: dwrite d4/f43 [0,4194304] 0 2024-02-15T22:40:46.052 INFO:tasks.workunit.client.0.smithi033.stdout:7/315: symlink d5/df/d40/d4a/l69 0 2024-02-15T22:40:46.052 INFO:tasks.workunit.client.0.smithi033.stdout:7/316: chown d5/d6/d10/c1e 63 1 2024-02-15T22:40:46.053 INFO:tasks.workunit.client.0.smithi033.stdout:7/317: dread - d5/df/d56/f63 zero size 2024-02-15T22:40:46.058 INFO:tasks.workunit.client.0.smithi033.stdout:1/275: dread d1/de/f13 [0,4194304] 0 2024-02-15T22:40:46.064 INFO:tasks.workunit.client.0.smithi033.stdout:7/318: write d5/df/f44 [824180,129628] 0 2024-02-15T22:40:46.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/239: creat d8/d16/d19/d1c/d3c/f4d x:0 0 0 2024-02-15T22:40:46.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/240: stat d8/d16/d19/c46 0 2024-02-15T22:40:46.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/241: fsync d8/d18/d37/d31/f34 0 2024-02-15T22:40:46.066 INFO:tasks.workunit.client.0.smithi033.stdout:9/241: link d4/f3b d4/d1d/d23/d35/d38/d3f/f45 0 2024-02-15T22:40:46.073 INFO:tasks.workunit.client.0.smithi033.stdout:1/276: symlink d1/d20/l56 0 2024-02-15T22:40:46.077 INFO:tasks.workunit.client.0.smithi033.stdout:4/242: unlink d8/d16/d19/d27/l15 0 2024-02-15T22:40:46.077 INFO:tasks.workunit.client.0.smithi033.stdout:4/243: chown l0 400 1 2024-02-15T22:40:46.078 INFO:tasks.workunit.client.0.smithi033.stdout:4/244: read d8/f4a [213022,57454] 0 2024-02-15T22:40:46.083 INFO:tasks.workunit.client.0.smithi033.stdout:9/242: rmdir d4/d1d/d23/d35 39 2024-02-15T22:40:46.086 INFO:tasks.workunit.client.0.smithi033.stdout:1/277: mkdir d1/d57 0 2024-02-15T22:40:46.088 INFO:tasks.workunit.client.0.smithi033.stdout:7/319: getdents d5/d6 0 2024-02-15T22:40:46.088 INFO:tasks.workunit.client.0.smithi033.stdout:7/320: getdents d5/d6 0 2024-02-15T22:40:46.088 INFO:tasks.workunit.client.0.smithi033.stdout:7/321: fsync f4 0 2024-02-15T22:40:46.088 INFO:tasks.workunit.client.0.smithi033.stdout:7/322: chown d5/d6/d10/d16/d26/d3f 14 1 2024-02-15T22:40:46.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/323: readlink d5/d6/d10/d16/l3e 0 2024-02-15T22:40:46.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/324: truncate d5/d6/f68 368598 0 2024-02-15T22:40:46.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/325: write d5/d6/f68 [196960,55161] 0 2024-02-15T22:40:46.094 INFO:tasks.workunit.client.0.smithi033.stdout:9/243: dread d4/f3b [0,4194304] 0 2024-02-15T22:40:46.095 INFO:tasks.workunit.client.0.smithi033.stdout:1/278: link d1/ld d1/de/d27/d28/d2d/d36/l58 0 2024-02-15T22:40:46.104 INFO:tasks.workunit.client.0.smithi033.stdout:4/245: dwrite d8/f39 [0,4194304] 0 2024-02-15T22:40:46.110 INFO:tasks.workunit.client.0.smithi033.stdout:4/246: rename d8/d18/d37/f21 to d8/d16/f4e 0 2024-02-15T22:40:46.113 INFO:tasks.workunit.client.0.smithi033.stdout:9/244: read d4/f18 [3580795,77673] 0 2024-02-15T22:40:46.114 INFO:tasks.workunit.client.0.smithi033.stdout:4/247: mkdir d8/d16/d4f 0 2024-02-15T22:40:46.123 INFO:tasks.workunit.client.0.smithi033.stdout:4/248: write d8/fe [3584728,38827] 0 2024-02-15T22:40:46.123 INFO:tasks.workunit.client.0.smithi033.stdout:4/249: fdatasync d8/f4a 0 2024-02-15T22:40:46.123 INFO:tasks.workunit.client.0.smithi033.stdout:9/245: dread d4/f5 [0,4194304] 0 2024-02-15T22:40:46.125 INFO:tasks.workunit.client.0.smithi033.stdout:4/250: dread d8/d18/d37/d31/f3e [0,4194304] 0 2024-02-15T22:40:46.125 INFO:tasks.workunit.client.0.smithi033.stdout:1/279: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:46.125 INFO:tasks.workunit.client.0.smithi033.stdout:1/280: write d1/f1c [4487715,72947] 0 2024-02-15T22:40:46.126 INFO:tasks.workunit.client.0.smithi033.stdout:7/326: rmdir d5/df/d40 39 2024-02-15T22:40:46.126 INFO:tasks.workunit.client.0.smithi033.stdout:7/327: truncate d5/d6/f68 556413 0 2024-02-15T22:40:46.127 INFO:tasks.workunit.client.0.smithi033.stdout:2/336: sync 2024-02-15T22:40:46.128 INFO:tasks.workunit.client.0.smithi033.stdout:8/200: sync 2024-02-15T22:40:46.128 INFO:tasks.workunit.client.0.smithi033.stdout:2/337: chown d1/d8/d2b/d2f/d3d/c54 2546426 1 2024-02-15T22:40:46.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/251: chown c3 0 1 2024-02-15T22:40:46.130 INFO:tasks.workunit.client.0.smithi033.stdout:4/252: write d8/ff [1266367,73710] 0 2024-02-15T22:40:46.155 INFO:tasks.workunit.client.0.smithi033.stdout:7/328: dread d5/df/f44 [4194304,4194304] 0 2024-02-15T22:40:46.157 INFO:tasks.workunit.client.0.smithi033.stdout:9/246: dwrite d4/d1d/f2c [0,4194304] 0 2024-02-15T22:40:46.159 INFO:tasks.workunit.client.0.smithi033.stdout:2/338: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:46.160 INFO:tasks.workunit.client.0.smithi033.stdout:4/253: dwrite d8/fd [0,4194304] 0 2024-02-15T22:40:46.160 INFO:tasks.workunit.client.0.smithi033.stdout:4/254: getdents d8/d16/d4f 0 2024-02-15T22:40:46.169 INFO:tasks.workunit.client.0.smithi033.stdout:4/255: dread f5 [0,4194304] 0 2024-02-15T22:40:46.259 INFO:tasks.workunit.client.0.smithi033.stdout:7/329: rename d5/d6/fa to d5/dc/d5f/d48/f6a 0 2024-02-15T22:40:46.260 INFO:tasks.workunit.client.0.smithi033.stdout:9/247: rmdir d4/d1d/d23/d35/d38 39 2024-02-15T22:40:46.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/339: symlink d1/l5f 0 2024-02-15T22:40:46.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/340: chown d1/d8/d2b/d2f/d24/d2a 390 1 2024-02-15T22:40:46.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/341: fsync d1/d8/d2b/d2f/d13/f3b 0 2024-02-15T22:40:46.269 INFO:tasks.workunit.client.0.smithi033.stdout:4/256: mkdir d8/d16/d19/d1c/d50 0 2024-02-15T22:40:46.273 INFO:tasks.workunit.client.0.smithi033.stdout:9/248: dwrite d4/f29 [0,4194304] 0 2024-02-15T22:40:46.273 INFO:tasks.workunit.client.0.smithi033.stdout:9/249: fsync f2 0 2024-02-15T22:40:46.273 INFO:tasks.workunit.client.0.smithi033.stdout:2/342: symlink d1/d8/d2b/d2f/d38/l60 0 2024-02-15T22:40:46.281 INFO:tasks.workunit.client.0.smithi033.stdout:9/250: mknod d4/d1d/d23/c46 0 2024-02-15T22:40:46.291 INFO:tasks.workunit.client.0.smithi033.stdout:2/343: dwrite d1/f7 [12582912,4194304] 0 2024-02-15T22:40:46.291 INFO:tasks.workunit.client.0.smithi033.stdout:2/344: chown d1/d8/d34 8 1 2024-02-15T22:40:46.298 INFO:tasks.workunit.client.0.smithi033.stdout:9/251: dwrite d4/f43 [4194304,4194304] 0 2024-02-15T22:40:46.332 INFO:tasks.workunit.client.0.smithi033.stdout:2/345: truncate d1/d8/d2b/d2f/d13/f1c 1525198 0 2024-02-15T22:40:46.347 INFO:tasks.workunit.client.0.smithi033.stdout:0/317: sync 2024-02-15T22:40:46.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/311: sync 2024-02-15T22:40:46.347 INFO:tasks.workunit.client.0.smithi033.stdout:0/318: write db/d19/d32/f23 [189144,22229] 0 2024-02-15T22:40:46.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/312: creat d0/d3/d3b/f63 x:0 0 0 2024-02-15T22:40:46.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/313: readlink d0/d3/d2c/d5d/la 0 2024-02-15T22:40:46.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/314: write d0/d3/d2c/d5d/f49 [845195,24461] 0 2024-02-15T22:40:46.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/315: readlink d0/d3/l60 0 2024-02-15T22:40:46.351 INFO:tasks.workunit.client.0.smithi033.stdout:9/252: rename d4/f5 to d4/d1d/d23/f47 0 2024-02-15T22:40:46.351 INFO:tasks.workunit.client.0.smithi033.stdout:9/253: chown d4/d1d/d23/f3d 3604 1 2024-02-15T22:40:46.351 INFO:tasks.workunit.client.0.smithi033.stdout:9/254: read d4/d1d/f3c [3195701,98398] 0 2024-02-15T22:40:46.364 INFO:tasks.workunit.client.0.smithi033.stdout:3/316: dwrite d0/d3/f17 [0,4194304] 0 2024-02-15T22:40:46.436 INFO:tasks.workunit.client.0.smithi033.stdout:2/346: mkdir d1/d8/d2b/d2f/d13/d61 0 2024-02-15T22:40:46.441 INFO:tasks.workunit.client.0.smithi033.stdout:0/319: mknod db/d19/c6d 0 2024-02-15T22:40:46.442 INFO:tasks.workunit.client.0.smithi033.stdout:4/257: rename d8/d16/d19 to d8/d16/d51 0 2024-02-15T22:40:46.446 INFO:tasks.workunit.client.0.smithi033.stdout:9/255: link d4/d1d/d23/d24/l28 d4/d1d/d23/d35/d38/l48 0 2024-02-15T22:40:46.457 INFO:tasks.workunit.client.0.smithi033.stdout:3/317: symlink d0/d3/d2c/d43/l64 0 2024-02-15T22:40:46.467 INFO:tasks.workunit.client.0.smithi033.stdout:2/347: mkdir d1/d8/d2b/d2f/d38/d62 0 2024-02-15T22:40:46.471 INFO:tasks.workunit.client.0.smithi033.stdout:0/320: mkdir db/d2a/d6e 0 2024-02-15T22:40:46.473 INFO:tasks.workunit.client.0.smithi033.stdout:4/258: mknod d8/d16/d51/d1c/d3c/c52 0 2024-02-15T22:40:46.477 INFO:tasks.workunit.client.0.smithi033.stdout:9/256: creat d4/d1d/d23/d35/d38/f49 x:0 0 0 2024-02-15T22:40:46.477 INFO:tasks.workunit.client.0.smithi033.stdout:9/257: truncate d4/d1d/d23/f3d 914487 0 2024-02-15T22:40:46.482 INFO:tasks.workunit.client.0.smithi033.stdout:0/321: creat db/d19/d32/f6f x:0 0 0 2024-02-15T22:40:46.483 INFO:tasks.workunit.client.0.smithi033.stdout:0/322: write db/d19/f1f [1425044,23774] 0 2024-02-15T22:40:46.486 INFO:tasks.workunit.client.0.smithi033.stdout:4/259: unlink d8/c11 0 2024-02-15T22:40:46.487 INFO:tasks.workunit.client.0.smithi033.stdout:4/260: write d8/d18/d37/d31/f48 [68816,54654] 0 2024-02-15T22:40:46.491 INFO:tasks.workunit.client.0.smithi033.stdout:4/261: write f5 [2557507,27710] 0 2024-02-15T22:40:46.493 INFO:tasks.workunit.client.0.smithi033.stdout:2/348: dwrite d1/d8/d2b/d2f/d24/f39 [0,4194304] 0 2024-02-15T22:40:46.493 INFO:tasks.workunit.client.0.smithi033.stdout:0/323: link db/d19/d32/l2f db/d19/d32/d46/l70 0 2024-02-15T22:40:46.495 INFO:tasks.workunit.client.0.smithi033.stdout:9/258: getdents d4/d1d 0 2024-02-15T22:40:46.503 INFO:tasks.workunit.client.0.smithi033.stdout:9/259: dread d4/f15 [4194304,4194304] 0 2024-02-15T22:40:46.506 INFO:tasks.workunit.client.0.smithi033.stdout:0/324: unlink db/l29 0 2024-02-15T22:40:46.506 INFO:tasks.workunit.client.0.smithi033.stdout:0/325: fdatasync db/d19/f2d 0 2024-02-15T22:40:46.506 INFO:tasks.workunit.client.0.smithi033.stdout:0/326: fsync db/d19/f2d 0 2024-02-15T22:40:46.506 INFO:tasks.workunit.client.0.smithi033.stdout:0/327: read f5 [3047617,81842] 0 2024-02-15T22:40:46.506 INFO:tasks.workunit.client.0.smithi033.stdout:0/328: readlink db/d19/d32/l3e 0 2024-02-15T22:40:46.507 INFO:tasks.workunit.client.0.smithi033.stdout:4/262: dwrite f4 [0,4194304] 0 2024-02-15T22:40:46.509 INFO:tasks.workunit.client.0.smithi033.stdout:2/349: getdents d1/d8/d2b/d2f/d24/d31 0 2024-02-15T22:40:46.512 INFO:tasks.workunit.client.0.smithi033.stdout:9/260: mknod d4/d1d/d23/c4a 0 2024-02-15T22:40:46.514 INFO:tasks.workunit.client.0.smithi033.stdout:2/350: dread d1/d8/d2b/d2f/d13/f1c [0,4194304] 0 2024-02-15T22:40:46.516 INFO:tasks.workunit.client.0.smithi033.stdout:0/329: rename db/d2a/c36 to db/d2a/d6c/c71 0 2024-02-15T22:40:46.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/261: creat d4/d1d/d23/d24/f4b x:0 0 0 2024-02-15T22:40:46.523 INFO:tasks.workunit.client.0.smithi033.stdout:2/351: creat d1/d8/d2b/d2f/d13/d61/f63 x:0 0 0 2024-02-15T22:40:46.524 INFO:tasks.workunit.client.0.smithi033.stdout:2/352: rename d1/d8/d2b/d2f to d1/d8/d2b/d2f/d24/d5d/d64 22 2024-02-15T22:40:46.526 INFO:tasks.workunit.client.0.smithi033.stdout:0/330: unlink db/f18 0 2024-02-15T22:40:46.529 INFO:tasks.workunit.client.0.smithi033.stdout:4/263: dwrite d8/d16/d51/d1c/d3c/f4d [0,4194304] 0 2024-02-15T22:40:46.530 INFO:tasks.workunit.client.0.smithi033.stdout:9/262: rmdir d4/d1d/d23/d24/d41 0 2024-02-15T22:40:46.530 INFO:tasks.workunit.client.0.smithi033.stdout:9/263: write d4/f19 [1369696,8328] 0 2024-02-15T22:40:46.530 INFO:tasks.workunit.client.0.smithi033.stdout:9/264: readlink d4/d1d/l34 0 2024-02-15T22:40:46.532 INFO:tasks.workunit.client.0.smithi033.stdout:2/353: mknod d1/d8/d2b/d2f/d38/d62/c65 0 2024-02-15T22:40:46.538 INFO:tasks.workunit.client.0.smithi033.stdout:9/265: truncate d4/fd 525503 0 2024-02-15T22:40:46.538 INFO:tasks.workunit.client.0.smithi033.stdout:9/266: chown d4/fe 695327 1 2024-02-15T22:40:46.538 INFO:tasks.workunit.client.0.smithi033.stdout:9/267: fdatasync d4/d1d/f3c 0 2024-02-15T22:40:46.545 INFO:tasks.workunit.client.0.smithi033.stdout:5/404: sync 2024-02-15T22:40:46.545 INFO:tasks.workunit.client.0.smithi033.stdout:6/254: sync 2024-02-15T22:40:46.545 INFO:tasks.workunit.client.0.smithi033.stdout:5/405: chown d6/ff 3 1 2024-02-15T22:40:46.545 INFO:tasks.workunit.client.0.smithi033.stdout:6/255: fsync d12/f41 0 2024-02-15T22:40:46.546 INFO:tasks.workunit.client.0.smithi033.stdout:4/264: dwrite d8/d16/d51/d1c/f38 [0,4194304] 0 2024-02-15T22:40:46.548 INFO:tasks.workunit.client.0.smithi033.stdout:2/354: mkdir d1/d66 0 2024-02-15T22:40:46.549 INFO:tasks.workunit.client.0.smithi033.stdout:2/355: dread d1/d8/d2b/d2f/d13/f49 [0,4194304] 0 2024-02-15T22:40:46.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/356: write d1/d8/d2b/d2f/d13/f17 [1524054,82659] 0 2024-02-15T22:40:46.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/357: write d1/d8/d2b/d2f/d38/f51 [193510,5028] 0 2024-02-15T22:40:46.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/358: read d1/d8/fe [5556899,112189] 0 2024-02-15T22:40:46.554 INFO:tasks.workunit.client.0.smithi033.stdout:5/406: link d6/d14/d31/d48/d59/c4b d6/d14/d31/d48/c80 0 2024-02-15T22:40:46.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/330: sync 2024-02-15T22:40:46.555 INFO:tasks.workunit.client.0.smithi033.stdout:1/281: sync 2024-02-15T22:40:46.555 INFO:tasks.workunit.client.0.smithi033.stdout:8/201: sync 2024-02-15T22:40:46.555 INFO:tasks.workunit.client.0.smithi033.stdout:1/282: chown d1/de/c1e 424132 1 2024-02-15T22:40:46.555 INFO:tasks.workunit.client.0.smithi033.stdout:8/202: fdatasync d1/de/d1a/d2a/f3b 0 2024-02-15T22:40:46.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/331: truncate d5/f50 887801 0 2024-02-15T22:40:46.555 INFO:tasks.workunit.client.0.smithi033.stdout:8/203: chown d1/c11 145 1 2024-02-15T22:40:46.556 INFO:tasks.workunit.client.0.smithi033.stdout:6/256: mknod d12/d1b/d3f/c56 0 2024-02-15T22:40:46.558 INFO:tasks.workunit.client.0.smithi033.stdout:4/265: getdents d8/d18/d37/d23 0 2024-02-15T22:40:46.559 INFO:tasks.workunit.client.0.smithi033.stdout:1/283: dread d1/fa [0,4194304] 0 2024-02-15T22:40:46.561 INFO:tasks.workunit.client.0.smithi033.stdout:2/359: mkdir d1/d16/d5a/d67 0 2024-02-15T22:40:46.562 INFO:tasks.workunit.client.0.smithi033.stdout:2/360: fdatasync d1/d8/d34/f53 0 2024-02-15T22:40:46.562 INFO:tasks.workunit.client.0.smithi033.stdout:2/361: getdents d1/d8/d2b/d2f/d12/d52 0 2024-02-15T22:40:46.566 INFO:tasks.workunit.client.0.smithi033.stdout:5/407: mknod d6/d14/d43/c81 0 2024-02-15T22:40:46.572 INFO:tasks.workunit.client.0.smithi033.stdout:8/204: mknod d1/df/d1d/d4a/d4c/c4f 0 2024-02-15T22:40:46.572 INFO:tasks.workunit.client.0.smithi033.stdout:8/205: fdatasync d1/f33 0 2024-02-15T22:40:46.575 INFO:tasks.workunit.client.0.smithi033.stdout:8/206: read d1/f10 [188156,55587] 0 2024-02-15T22:40:46.577 INFO:tasks.workunit.client.0.smithi033.stdout:6/257: rename d12/d2c/d30/d1d/f4e to d12/d1b/d3f/f57 0 2024-02-15T22:40:46.579 INFO:tasks.workunit.client.0.smithi033.stdout:1/284: symlink d1/de/l59 0 2024-02-15T22:40:46.582 INFO:tasks.workunit.client.0.smithi033.stdout:2/362: symlink d1/d16/d5a/d67/l68 0 2024-02-15T22:40:46.582 INFO:tasks.workunit.client.0.smithi033.stdout:2/363: write d1/f48 [107643,114134] 0 2024-02-15T22:40:46.584 INFO:tasks.workunit.client.0.smithi033.stdout:6/258: read f5 [1045067,52254] 0 2024-02-15T22:40:46.584 INFO:tasks.workunit.client.0.smithi033.stdout:4/266: dwrite d8/fd [0,4194304] 0 2024-02-15T22:40:46.584 INFO:tasks.workunit.client.0.smithi033.stdout:6/259: truncate d12/d2c/d30/d19/f3e 1790641 0 2024-02-15T22:40:46.584 INFO:tasks.workunit.client.0.smithi033.stdout:5/408: getdents d6/d14/d31/d64 0 2024-02-15T22:40:46.585 INFO:tasks.workunit.client.0.smithi033.stdout:2/364: dread d1/d8/d2b/d2f/d13/f1c [0,4194304] 0 2024-02-15T22:40:46.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/332: creat d5/df/d56/d60/f6b x:0 0 0 2024-02-15T22:40:46.593 INFO:tasks.workunit.client.0.smithi033.stdout:1/285: symlink d1/de/d27/d28/d37/l5a 0 2024-02-15T22:40:46.594 INFO:tasks.workunit.client.0.smithi033.stdout:4/267: dread d8/fe [0,4194304] 0 2024-02-15T22:40:46.594 INFO:tasks.workunit.client.0.smithi033.stdout:8/207: dwrite d1/f10 [0,4194304] 0 2024-02-15T22:40:46.594 INFO:tasks.workunit.client.0.smithi033.stdout:8/208: creat d1/de/d13/f50 x:0 0 0 2024-02-15T22:40:46.594 INFO:tasks.workunit.client.0.smithi033.stdout:4/268: write d8/d18/d37/d31/f42 [1656329,114920] 0 2024-02-15T22:40:46.594 INFO:tasks.workunit.client.0.smithi033.stdout:8/209: readlink d1/d6/d14/l3d 0 2024-02-15T22:40:46.594 INFO:tasks.workunit.client.0.smithi033.stdout:4/269: chown d8/d18/d37/d31/f3e 1 1 2024-02-15T22:40:46.600 INFO:tasks.workunit.client.0.smithi033.stdout:6/260: mknod d12/d2c/d30/d19/c58 0 2024-02-15T22:40:46.603 INFO:tasks.workunit.client.0.smithi033.stdout:2/365: mkdir d1/d8/d2b/d2f/d24/d69 0 2024-02-15T22:40:46.604 INFO:tasks.workunit.client.0.smithi033.stdout:3/318: mkdir d0/d3/d65 0 2024-02-15T22:40:46.611 INFO:tasks.workunit.client.0.smithi033.stdout:1/286: truncate d1/f15 484225 0 2024-02-15T22:40:46.611 INFO:tasks.workunit.client.0.smithi033.stdout:1/287: readlink d1/de/d27/d28/d2d/l50 0 2024-02-15T22:40:46.614 INFO:tasks.workunit.client.0.smithi033.stdout:7/333: dwrite d5/d6/d10/d16/d26/f2a [4194304,4194304] 0 2024-02-15T22:40:46.617 INFO:tasks.workunit.client.0.smithi033.stdout:8/210: rename d1/df/d2e/f4b to d1/de/d1a/d2a/f51 0 2024-02-15T22:40:46.617 INFO:tasks.workunit.client.0.smithi033.stdout:5/409: dwrite d6/d25/f35 [0,4194304] 0 2024-02-15T22:40:46.618 INFO:tasks.workunit.client.0.smithi033.stdout:4/270: dwrite d8/d18/d37/d31/f34 [0,4194304] 0 2024-02-15T22:40:46.621 INFO:tasks.workunit.client.0.smithi033.stdout:6/261: mknod d12/d2c/d30/d1d/c59 0 2024-02-15T22:40:46.623 INFO:tasks.workunit.client.0.smithi033.stdout:3/319: truncate d0/d3/d2c/f2f 3103250 0 2024-02-15T22:40:46.623 INFO:tasks.workunit.client.0.smithi033.stdout:3/320: write d0/d3/d2c/f5c [900660,32933] 0 2024-02-15T22:40:46.624 INFO:tasks.workunit.client.0.smithi033.stdout:3/321: dread d0/d1c/f59 [0,4194304] 0 2024-02-15T22:40:46.625 INFO:tasks.workunit.client.0.smithi033.stdout:1/288: creat d1/f5b x:0 0 0 2024-02-15T22:40:46.633 INFO:tasks.workunit.client.0.smithi033.stdout:9/268: getdents d4/d1d/d23/d24 0 2024-02-15T22:40:46.637 INFO:tasks.workunit.client.0.smithi033.stdout:7/334: rename d5/d6/d10/d16/d26/d3f/f66 to d5/df/d56/f6c 0 2024-02-15T22:40:46.639 INFO:tasks.workunit.client.0.smithi033.stdout:8/211: link d1/df/c28 d1/de/d1a/d2a/d40/c52 0 2024-02-15T22:40:46.639 INFO:tasks.workunit.client.0.smithi033.stdout:8/212: creat d1/df/d2e/f53 x:0 0 0 2024-02-15T22:40:46.645 INFO:tasks.workunit.client.0.smithi033.stdout:5/410: dwrite d6/d25/f40 [0,4194304] 0 2024-02-15T22:40:46.647 INFO:tasks.workunit.client.0.smithi033.stdout:1/289: dread d1/de/d27/d28/f2a [0,4194304] 0 2024-02-15T22:40:46.647 INFO:tasks.workunit.client.0.smithi033.stdout:3/322: dwrite d0/f56 [0,4194304] 0 2024-02-15T22:40:46.647 INFO:tasks.workunit.client.0.smithi033.stdout:3/323: chown d0/d3/d3b/f63 1450 1 2024-02-15T22:40:46.647 INFO:tasks.workunit.client.0.smithi033.stdout:3/324: getdents d0/d3/d5f 0 2024-02-15T22:40:46.648 INFO:tasks.workunit.client.0.smithi033.stdout:3/325: write d0/d1c/f25 [488034,7527] 0 2024-02-15T22:40:46.649 INFO:tasks.workunit.client.0.smithi033.stdout:1/290: dread d1/d20/d42/f33 [0,4194304] 0 2024-02-15T22:40:46.655 INFO:tasks.workunit.client.0.smithi033.stdout:3/326: dread d0/f36 [0,4194304] 0 2024-02-15T22:40:46.655 INFO:tasks.workunit.client.0.smithi033.stdout:3/327: creat d0/d1c/f66 x:0 0 0 2024-02-15T22:40:46.655 INFO:tasks.workunit.client.0.smithi033.stdout:3/328: creat d0/d1c/f67 x:0 0 0 2024-02-15T22:40:46.661 INFO:tasks.workunit.client.0.smithi033.stdout:6/262: link d12/d2c/d30/l51 d12/d2c/l5a 0 2024-02-15T22:40:46.664 INFO:tasks.workunit.client.0.smithi033.stdout:9/269: creat d4/d1d/f4c x:0 0 0 2024-02-15T22:40:46.664 INFO:tasks.workunit.client.0.smithi033.stdout:9/270: chown d4/d1d/d23/d35/d38/d3f 3885969 1 2024-02-15T22:40:46.666 INFO:tasks.workunit.client.0.smithi033.stdout:4/271: rename d8/d16/d51/c43 to d8/d16/d51/d1c/d3c/d3f/c53 0 2024-02-15T22:40:46.669 INFO:tasks.workunit.client.0.smithi033.stdout:7/335: creat d5/d6/d10/f6d x:0 0 0 2024-02-15T22:40:46.672 INFO:tasks.workunit.client.0.smithi033.stdout:8/213: mknod d1/df/d1d/d4a/d4c/c54 0 2024-02-15T22:40:46.676 INFO:tasks.workunit.client.0.smithi033.stdout:4/272: dread d8/d16/d51/d1c/f32 [0,4194304] 0 2024-02-15T22:40:46.679 INFO:tasks.workunit.client.0.smithi033.stdout:1/291: link d1/c46 d1/de/d27/d28/d2d/d3b/c5c 0 2024-02-15T22:40:46.691 INFO:tasks.workunit.client.0.smithi033.stdout:3/329: mkdir d0/d3/d2c/d5d/d3d/d57/d68 0 2024-02-15T22:40:46.691 INFO:tasks.workunit.client.0.smithi033.stdout:3/330: readlink d0/d3/d2c/d5d/l33 0 2024-02-15T22:40:46.691 INFO:tasks.workunit.client.0.smithi033.stdout:3/331: write d0/d3/f40 [216658,101163] 0 2024-02-15T22:40:46.695 INFO:tasks.workunit.client.0.smithi033.stdout:1/292: dwrite d1/de/d27/d28/d37/f45 [0,4194304] 0 2024-02-15T22:40:46.699 INFO:tasks.workunit.client.0.smithi033.stdout:6/263: mkdir d12/d1b/d3f/d5b 0 2024-02-15T22:40:46.703 INFO:tasks.workunit.client.0.smithi033.stdout:9/271: truncate d4/f15 408572 0 2024-02-15T22:40:46.711 INFO:tasks.workunit.client.0.smithi033.stdout:5/411: rename d6/d14/f32 to d6/d14/d31/d38/f82 0 2024-02-15T22:40:46.716 INFO:tasks.workunit.client.0.smithi033.stdout:8/214: mkdir d1/de/d1a/d27/d55 0 2024-02-15T22:40:46.716 INFO:tasks.workunit.client.0.smithi033.stdout:8/215: dread - d1/de/d13/f4d zero size 2024-02-15T22:40:46.718 INFO:tasks.workunit.client.0.smithi033.stdout:4/273: truncate d8/d16/d51/d1c/f32 786037 0 2024-02-15T22:40:46.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/272: dwrite d4/ff [4194304,4194304] 0 2024-02-15T22:40:46.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/273: stat d4/c1e 0 2024-02-15T22:40:46.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/274: creat d4/d1d/d23/d32/d3e/f4d x:0 0 0 2024-02-15T22:40:46.723 INFO:tasks.workunit.client.0.smithi033.stdout:3/332: mknod d0/d3/d5f/c69 0 2024-02-15T22:40:46.725 INFO:tasks.workunit.client.0.smithi033.stdout:8/216: write d1/f10 [2405551,92047] 0 2024-02-15T22:40:46.727 INFO:tasks.workunit.client.0.smithi033.stdout:1/293: link d1/f7 d1/de/d27/d28/d2d/d36/f5d 0 2024-02-15T22:40:46.728 INFO:tasks.workunit.client.0.smithi033.stdout:6/264: mkdir d12/d1b/d3f/d5b/d5c 0 2024-02-15T22:40:46.732 INFO:tasks.workunit.client.0.smithi033.stdout:5/412: rename d6/d14/d43/l44 to d6/d14/d31/d48/d49/l83 0 2024-02-15T22:40:46.734 INFO:tasks.workunit.client.0.smithi033.stdout:7/336: mknod d5/df/d47/c6e 0 2024-02-15T22:40:46.735 INFO:tasks.workunit.client.0.smithi033.stdout:7/337: chown d5/c2d 50742004 1 2024-02-15T22:40:46.735 INFO:tasks.workunit.client.0.smithi033.stdout:5/413: dread d6/d14/d31/d48/d59/f54 [0,4194304] 0 2024-02-15T22:40:46.736 INFO:tasks.workunit.client.0.smithi033.stdout:4/274: creat d8/f54 x:0 0 0 2024-02-15T22:40:46.737 INFO:tasks.workunit.client.0.smithi033.stdout:4/275: creat d8/d18/d37/f55 x:0 0 0 2024-02-15T22:40:46.740 INFO:tasks.workunit.client.0.smithi033.stdout:9/275: creat d4/d1d/d42/f4e x:0 0 0 2024-02-15T22:40:46.742 INFO:tasks.workunit.client.0.smithi033.stdout:3/333: unlink d0/f4a 0 2024-02-15T22:40:46.745 INFO:tasks.workunit.client.0.smithi033.stdout:8/217: getdents d1/de/d1a/d2a/d40 0 2024-02-15T22:40:46.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/414: write d6/d14/f1d [5896865,41167] 0 2024-02-15T22:40:46.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/415: chown d6/l52 27003962 1 2024-02-15T22:40:46.748 INFO:tasks.workunit.client.0.smithi033.stdout:1/294: dwrite d1/de/d27/d28/d37/f4a [0,4194304] 0 2024-02-15T22:40:46.755 INFO:tasks.workunit.client.0.smithi033.stdout:4/276: mkdir d8/d16/d51/d56 0 2024-02-15T22:40:46.759 INFO:tasks.workunit.client.0.smithi033.stdout:9/276: creat d4/d1d/d23/d32/f4f x:0 0 0 2024-02-15T22:40:46.759 INFO:tasks.workunit.client.0.smithi033.stdout:7/338: write d5/df/d40/f45 [2936449,106937] 0 2024-02-15T22:40:46.759 INFO:tasks.workunit.client.0.smithi033.stdout:7/339: fsync d5/df/d56/f6c 0 2024-02-15T22:40:46.761 INFO:tasks.workunit.client.0.smithi033.stdout:3/334: creat d0/d3/dd/f6a x:0 0 0 2024-02-15T22:40:46.761 INFO:tasks.workunit.client.0.smithi033.stdout:3/335: creat d0/d1c/f6b x:0 0 0 2024-02-15T22:40:46.764 INFO:tasks.workunit.client.0.smithi033.stdout:8/218: unlink d1/df/c28 0 2024-02-15T22:40:46.768 INFO:tasks.workunit.client.0.smithi033.stdout:7/340: read d5/dc/d5f/d48/f6a [8846637,26676] 0 2024-02-15T22:40:46.773 INFO:tasks.workunit.client.0.smithi033.stdout:4/277: dwrite d8/d18/d37/d23/f30 [0,4194304] 0 2024-02-15T22:40:46.773 INFO:tasks.workunit.client.0.smithi033.stdout:5/416: rename d6/d14/d31/f3b to d6/d14/d31/d48/d49/f84 0 2024-02-15T22:40:46.777 INFO:tasks.workunit.client.0.smithi033.stdout:5/417: dread d6/d25/f55 [0,4194304] 0 2024-02-15T22:40:46.778 INFO:tasks.workunit.client.0.smithi033.stdout:6/265: rmdir d12/d2c 39 2024-02-15T22:40:46.778 INFO:tasks.workunit.client.0.smithi033.stdout:6/266: write d12/d1b/d3f/f43 [467878,31465] 0 2024-02-15T22:40:46.787 INFO:tasks.workunit.client.0.smithi033.stdout:1/295: mkdir d1/de/d27/d28/d2d/d5e 0 2024-02-15T22:40:46.788 INFO:tasks.workunit.client.0.smithi033.stdout:6/267: dread d12/d2c/d30/d19/f2f [0,4194304] 0 2024-02-15T22:40:46.788 INFO:tasks.workunit.client.0.smithi033.stdout:6/268: write d12/d2c/d30/d1d/f39 [1075497,125348] 0 2024-02-15T22:40:46.788 INFO:tasks.workunit.client.0.smithi033.stdout:6/269: write d12/d2c/d30/f16 [186370,46055] 0 2024-02-15T22:40:46.795 INFO:tasks.workunit.client.0.smithi033.stdout:5/418: dwrite d6/d14/f6e [0,4194304] 0 2024-02-15T22:40:46.798 INFO:tasks.workunit.client.0.smithi033.stdout:3/336: symlink d0/d1c/l6c 0 2024-02-15T22:40:46.798 INFO:tasks.workunit.client.0.smithi033.stdout:3/337: creat d0/d3/dd/f6d x:0 0 0 2024-02-15T22:40:46.801 INFO:tasks.workunit.client.0.smithi033.stdout:1/296: dwrite d1/de/d27/d28/d37/f45 [4194304,4194304] 0 2024-02-15T22:40:46.801 INFO:tasks.workunit.client.0.smithi033.stdout:1/297: write d1/de/f38 [548484,38355] 0 2024-02-15T22:40:46.815 INFO:tasks.workunit.client.0.smithi033.stdout:4/278: mknod d8/d18/d37/d31/c57 0 2024-02-15T22:40:46.817 INFO:tasks.workunit.client.0.smithi033.stdout:1/298: dwrite d1/d20/d42/f49 [0,4194304] 0 2024-02-15T22:40:46.826 INFO:tasks.workunit.client.0.smithi033.stdout:1/299: read d1/de/f16 [1416572,58119] 0 2024-02-15T22:40:46.841 INFO:tasks.workunit.client.0.smithi033.stdout:5/419: rmdir d6/d14/d31/d38 39 2024-02-15T22:40:46.842 INFO:tasks.workunit.client.0.smithi033.stdout:6/270: dread d12/f2b [0,4194304] 0 2024-02-15T22:40:46.849 INFO:tasks.workunit.client.0.smithi033.stdout:5/420: dread d6/f1b [0,4194304] 0 2024-02-15T22:40:46.850 INFO:tasks.workunit.client.0.smithi033.stdout:8/219: rmdir d1/de/d1a 39 2024-02-15T22:40:46.850 INFO:tasks.workunit.client.0.smithi033.stdout:8/220: dread - d1/de/d13/f50 zero size 2024-02-15T22:40:46.850 INFO:tasks.workunit.client.0.smithi033.stdout:8/221: write d1/d6/d14/f1b [5579324,46625] 0 2024-02-15T22:40:46.850 INFO:tasks.workunit.client.0.smithi033.stdout:8/222: creat d1/de/f56 x:0 0 0 2024-02-15T22:40:46.850 INFO:tasks.workunit.client.0.smithi033.stdout:8/223: truncate d1/de/d1a/d2a/f30 1198573 0 2024-02-15T22:40:46.850 INFO:tasks.workunit.client.0.smithi033.stdout:8/224: chown d1/de/d1a/d2a/f51 12 1 2024-02-15T22:40:46.850 INFO:tasks.workunit.client.0.smithi033.stdout:5/421: read d6/ff [4094937,120673] 0 2024-02-15T22:40:46.854 INFO:tasks.workunit.client.0.smithi033.stdout:9/277: fsync d4/d1d/d23/d32/f4f 0 2024-02-15T22:40:46.854 INFO:tasks.workunit.client.0.smithi033.stdout:9/278: dread - d4/d1d/f4c zero size 2024-02-15T22:40:46.858 INFO:tasks.workunit.client.0.smithi033.stdout:5/422: write d6/d14/f19 [3913045,6098] 0 2024-02-15T22:40:46.858 INFO:tasks.workunit.client.0.smithi033.stdout:5/423: read - d6/d14/d31/d38/f72 zero size 2024-02-15T22:40:46.858 INFO:tasks.workunit.client.0.smithi033.stdout:5/424: chown d6/fe 28994895 1 2024-02-15T22:40:46.858 INFO:tasks.workunit.client.0.smithi033.stdout:5/425: write d6/d25/f5d [1913808,45362] 0 2024-02-15T22:40:46.866 INFO:tasks.workunit.client.0.smithi033.stdout:1/300: rename d1/de/d27/d28/d37/f4a to d1/d57/f5f 0 2024-02-15T22:40:46.874 INFO:tasks.workunit.client.0.smithi033.stdout:6/271: unlink d12/d2c/d30/f48 0 2024-02-15T22:40:46.877 INFO:tasks.workunit.client.0.smithi033.stdout:3/338: rmdir d0/d3/d2c 39 2024-02-15T22:40:46.886 INFO:tasks.workunit.client.0.smithi033.stdout:9/279: creat d4/d1d/d23/d35/f50 x:0 0 0 2024-02-15T22:40:46.886 INFO:tasks.workunit.client.0.smithi033.stdout:9/280: dread - d4/d1d/d23/d35/d38/f49 zero size 2024-02-15T22:40:46.889 INFO:tasks.workunit.client.0.smithi033.stdout:4/279: getdents d8/d18 0 2024-02-15T22:40:46.892 INFO:tasks.workunit.client.0.smithi033.stdout:5/426: symlink d6/d14/d31/d48/d49/d53/d57/l85 0 2024-02-15T22:40:46.902 INFO:tasks.workunit.client.0.smithi033.stdout:1/301: unlink d1/f11 0 2024-02-15T22:40:46.913 INFO:tasks.workunit.client.0.smithi033.stdout:6/272: creat d12/f5d x:0 0 0 2024-02-15T22:40:46.914 INFO:tasks.workunit.client.0.smithi033.stdout:6/273: stat d12/l23 0 2024-02-15T22:40:46.914 INFO:tasks.workunit.client.0.smithi033.stdout:6/274: write d12/d3c/f4c [699623,78054] 0 2024-02-15T22:40:46.916 INFO:tasks.workunit.client.0.smithi033.stdout:3/339: creat d0/d3/d2c/d5d/d3d/d57/f6e x:0 0 0 2024-02-15T22:40:46.916 INFO:tasks.workunit.client.0.smithi033.stdout:3/340: dread - d0/d3/dd/f6d zero size 2024-02-15T22:40:46.916 INFO:tasks.workunit.client.0.smithi033.stdout:3/341: chown d0/d3/d3b/d47/l5a 5754385 1 2024-02-15T22:40:46.917 INFO:tasks.workunit.client.0.smithi033.stdout:3/342: creat d0/d3/d2c/d5d/d3d/d57/f6f x:0 0 0 2024-02-15T22:40:46.918 INFO:tasks.workunit.client.0.smithi033.stdout:8/225: getdents d1/df 0 2024-02-15T22:40:46.921 INFO:tasks.workunit.client.0.smithi033.stdout:9/281: mkdir d4/d1d/d23/d24/d51 0 2024-02-15T22:40:46.926 INFO:tasks.workunit.client.0.smithi033.stdout:4/280: mknod d8/c58 0 2024-02-15T22:40:46.926 INFO:tasks.workunit.client.0.smithi033.stdout:4/281: chown d8/d16/l41 122129388 1 2024-02-15T22:40:46.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/427: mkdir d6/d14/d31/d38/d3f/d86 0 2024-02-15T22:40:46.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/428: chown d6/d14/d31/c51 21176734 1 2024-02-15T22:40:46.932 INFO:tasks.workunit.client.0.smithi033.stdout:5/429: read d6/f10 [4822992,42663] 0 2024-02-15T22:40:46.935 INFO:tasks.workunit.client.0.smithi033.stdout:1/302: creat d1/d20/d42/d25/f60 x:0 0 0 2024-02-15T22:40:46.935 INFO:tasks.workunit.client.0.smithi033.stdout:1/303: write d1/de/d27/d28/d2d/f3d [560881,28845] 0 2024-02-15T22:40:46.935 INFO:tasks.workunit.client.0.smithi033.stdout:1/304: chown d1/d20/c32 50628200 1 2024-02-15T22:40:46.939 INFO:tasks.workunit.client.0.smithi033.stdout:9/282: dwrite d4/d1d/d23/d32/f4f [0,4194304] 0 2024-02-15T22:40:46.939 INFO:tasks.workunit.client.0.smithi033.stdout:8/226: dwrite d1/de/d13/f50 [0,4194304] 0 2024-02-15T22:40:46.939 INFO:tasks.workunit.client.0.smithi033.stdout:9/283: chown d4/d1d/d23/d35/d38/l48 2 1 2024-02-15T22:40:46.945 INFO:tasks.workunit.client.0.smithi033.stdout:3/343: truncate d0/d3/d2c/d5d/f37 1874163 0 2024-02-15T22:40:46.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/282: link d8/d16/d51/d1c/f32 d8/d18/d37/d31/f59 0 2024-02-15T22:40:46.951 INFO:tasks.workunit.client.0.smithi033.stdout:5/430: unlink d6/d14/d31/d48/c4d 0 2024-02-15T22:40:46.953 INFO:tasks.workunit.client.0.smithi033.stdout:1/305: link d1/de/d27/d28/d37/f45 d1/de/d27/d28/d2d/d5e/f61 0 2024-02-15T22:40:46.953 INFO:tasks.workunit.client.0.smithi033.stdout:1/306: creat d1/de/d27/d28/d2d/d36/f62 x:0 0 0 2024-02-15T22:40:46.954 INFO:tasks.workunit.client.0.smithi033.stdout:9/284: dwrite d4/fb [0,4194304] 0 2024-02-15T22:40:46.954 INFO:tasks.workunit.client.0.smithi033.stdout:9/285: chown d4/l17 225710 1 2024-02-15T22:40:46.955 INFO:tasks.workunit.client.0.smithi033.stdout:1/307: dread d1/d20/d42/f33 [0,4194304] 0 2024-02-15T22:40:46.957 INFO:tasks.workunit.client.0.smithi033.stdout:6/275: link d12/f2b d12/f5e 0 2024-02-15T22:40:46.969 INFO:tasks.workunit.client.0.smithi033.stdout:3/344: dwrite d0/d1c/f29 [0,4194304] 0 2024-02-15T22:40:46.970 INFO:tasks.workunit.client.0.smithi033.stdout:9/286: dwrite d4/d1d/d23/d24/f2b [0,4194304] 0 2024-02-15T22:40:46.970 INFO:tasks.workunit.client.0.smithi033.stdout:9/287: creat d4/d1d/f52 x:0 0 0 2024-02-15T22:40:46.970 INFO:tasks.workunit.client.0.smithi033.stdout:9/288: truncate d4/d1d/f4c 45591 0 2024-02-15T22:40:46.970 INFO:tasks.workunit.client.0.smithi033.stdout:9/289: chown d4/d1d/f2c 359792 1 2024-02-15T22:40:46.971 INFO:tasks.workunit.client.0.smithi033.stdout:8/227: mkdir d1/df/d57 0 2024-02-15T22:40:46.975 INFO:tasks.workunit.client.0.smithi033.stdout:4/283: symlink d8/d18/l5a 0 2024-02-15T22:40:46.975 INFO:tasks.workunit.client.0.smithi033.stdout:5/431: mknod d6/d14/d31/d48/d49/d53/c87 0 2024-02-15T22:40:46.978 INFO:tasks.workunit.client.0.smithi033.stdout:3/345: write d0/f56 [3069974,24611] 0 2024-02-15T22:40:46.979 INFO:tasks.workunit.client.0.smithi033.stdout:0/331: sync 2024-02-15T22:40:46.982 INFO:tasks.workunit.client.0.smithi033.stdout:2/366: sync 2024-02-15T22:40:46.983 INFO:tasks.workunit.client.0.smithi033.stdout:1/308: creat d1/de/f63 x:0 0 0 2024-02-15T22:40:46.984 INFO:tasks.workunit.client.0.smithi033.stdout:4/284: read d8/d16/d51/d1c/d3c/f4d [3614062,52870] 0 2024-02-15T22:40:46.991 INFO:tasks.workunit.client.0.smithi033.stdout:6/276: mknod d12/d2c/c5f 0 2024-02-15T22:40:46.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/341: sync 2024-02-15T22:40:46.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/342: creat d5/df/d56/f6f x:0 0 0 2024-02-15T22:40:46.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/343: chown d5 21937340 1 2024-02-15T22:40:46.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/344: fdatasync d5/f19 0 2024-02-15T22:40:47.000 INFO:tasks.workunit.client.0.smithi033.stdout:1/309: dread d1/d20/d42/d2c/f31 [0,4194304] 0 2024-02-15T22:40:47.000 INFO:tasks.workunit.client.0.smithi033.stdout:1/310: chown d1/de/d27 3862458 1 2024-02-15T22:40:47.013 INFO:tasks.workunit.client.0.smithi033.stdout:4/285: dwrite d8/d1a/f36 [0,4194304] 0 2024-02-15T22:40:47.014 INFO:tasks.workunit.client.0.smithi033.stdout:7/345: write d5/d6/d10/f34 [322157,105302] 0 2024-02-15T22:40:47.014 INFO:tasks.workunit.client.0.smithi033.stdout:2/367: dwrite d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:47.014 INFO:tasks.workunit.client.0.smithi033.stdout:3/346: dwrite d0/fe [0,4194304] 0 2024-02-15T22:40:47.015 INFO:tasks.workunit.client.0.smithi033.stdout:3/347: write d0/d3/dd/f6d [14507,110885] 0 2024-02-15T22:40:47.015 INFO:tasks.workunit.client.0.smithi033.stdout:9/290: unlink d4/d1d/d23/d24/l3a 0 2024-02-15T22:40:47.015 INFO:tasks.workunit.client.0.smithi033.stdout:9/291: write d4/d1d/d23/d32/d3e/f44 [164116,20698] 0 2024-02-15T22:40:47.017 INFO:tasks.workunit.client.0.smithi033.stdout:8/228: mkdir d1/df/d1d/d58 0 2024-02-15T22:40:47.019 INFO:tasks.workunit.client.0.smithi033.stdout:6/277: dwrite d12/d2c/f4a [0,4194304] 0 2024-02-15T22:40:47.021 INFO:tasks.workunit.client.0.smithi033.stdout:5/432: symlink d6/d14/d31/d38/d3f/d86/l88 0 2024-02-15T22:40:47.026 INFO:tasks.workunit.client.0.smithi033.stdout:2/368: write d1/f7 [12801859,90029] 0 2024-02-15T22:40:47.030 INFO:tasks.workunit.client.0.smithi033.stdout:3/348: dread d0/d1c/f29 [0,4194304] 0 2024-02-15T22:40:47.030 INFO:tasks.workunit.client.0.smithi033.stdout:3/349: fdatasync d0/d3/f40 0 2024-02-15T22:40:47.030 INFO:tasks.workunit.client.0.smithi033.stdout:1/311: getdents d1/de/d27/d28/d2d/d5e 0 2024-02-15T22:40:47.037 INFO:tasks.workunit.client.0.smithi033.stdout:4/286: creat d8/d18/d37/d23/f5b x:0 0 0 2024-02-15T22:40:47.040 INFO:tasks.workunit.client.0.smithi033.stdout:7/346: truncate d5/df/d40/f45 3742183 0 2024-02-15T22:40:47.045 INFO:tasks.workunit.client.0.smithi033.stdout:9/292: rename d4/d1d/d23/d35/d38/f49 to d4/d1d/d23/d35/d38/f53 0 2024-02-15T22:40:47.046 INFO:tasks.workunit.client.0.smithi033.stdout:4/287: write d8/d18/d37/d31/f34 [1242573,70594] 0 2024-02-15T22:40:47.052 INFO:tasks.workunit.client.0.smithi033.stdout:9/293: dread d4/fc [0,4194304] 0 2024-02-15T22:40:47.052 INFO:tasks.workunit.client.0.smithi033.stdout:9/294: write d4/d1d/d23/d32/d3e/f4d [175956,51873] 0 2024-02-15T22:40:47.052 INFO:tasks.workunit.client.0.smithi033.stdout:9/295: dread - d4/d1d/f52 zero size 2024-02-15T22:40:47.052 INFO:tasks.workunit.client.0.smithi033.stdout:6/278: rename d12/d2c/d30/d19/f21 to d12/d2c/d30/d1d/f60 0 2024-02-15T22:40:47.056 INFO:tasks.workunit.client.0.smithi033.stdout:5/433: symlink d6/d14/d31/d38/l89 0 2024-02-15T22:40:47.056 INFO:tasks.workunit.client.0.smithi033.stdout:5/434: stat d6/d14/d31/f47 0 2024-02-15T22:40:47.056 INFO:tasks.workunit.client.0.smithi033.stdout:5/435: chown d6/d14/d31/d48/d49/c7f 51443129 1 2024-02-15T22:40:47.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/369: truncate d1/f2 6410502 0 2024-02-15T22:40:47.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/370: write d1/d8/d2b/d2f/fb [15146802,70046] 0 2024-02-15T22:40:47.065 INFO:tasks.workunit.client.0.smithi033.stdout:3/350: creat d0/d3/f70 x:0 0 0 2024-02-15T22:40:47.065 INFO:tasks.workunit.client.0.smithi033.stdout:3/351: chown d0/d3/d2c/f2f 2 1 2024-02-15T22:40:47.067 INFO:tasks.workunit.client.0.smithi033.stdout:7/347: symlink d5/df/d56/d60/l70 0 2024-02-15T22:40:47.069 INFO:tasks.workunit.client.0.smithi033.stdout:4/288: dwrite d8/d16/d51/f44 [0,4194304] 0 2024-02-15T22:40:47.071 INFO:tasks.workunit.client.0.smithi033.stdout:9/296: unlink d4/c1b 0 2024-02-15T22:40:47.071 INFO:tasks.workunit.client.0.smithi033.stdout:9/297: fdatasync d4/d1d/d23/d24/f4b 0 2024-02-15T22:40:47.072 INFO:tasks.workunit.client.0.smithi033.stdout:9/298: write d4/d1d/d23/f47 [4706295,29612] 0 2024-02-15T22:40:47.072 INFO:tasks.workunit.client.0.smithi033.stdout:9/299: chown d4/d1d/f52 81 1 2024-02-15T22:40:47.073 INFO:tasks.workunit.client.0.smithi033.stdout:6/279: truncate d12/f41 1222544 0 2024-02-15T22:40:47.073 INFO:tasks.workunit.client.0.smithi033.stdout:6/280: stat d12/d2c/l42 0 2024-02-15T22:40:47.077 INFO:tasks.workunit.client.0.smithi033.stdout:3/352: rmdir d0/d3/d2c 39 2024-02-15T22:40:47.082 INFO:tasks.workunit.client.0.smithi033.stdout:4/289: write d8/d16/d51/f44 [24412,47669] 0 2024-02-15T22:40:47.082 INFO:tasks.workunit.client.0.smithi033.stdout:5/436: dwrite d6/d14/f2e [0,4194304] 0 2024-02-15T22:40:47.083 INFO:tasks.workunit.client.0.smithi033.stdout:7/348: link d5/d6/d10/d16/l1b d5/dc/l71 0 2024-02-15T22:40:47.091 INFO:tasks.workunit.client.0.smithi033.stdout:6/281: mkdir d12/d1b/d3f/d50/d61 0 2024-02-15T22:40:47.091 INFO:tasks.workunit.client.0.smithi033.stdout:6/282: write d12/d3c/f44 [274148,92970] 0 2024-02-15T22:40:47.095 INFO:tasks.workunit.client.0.smithi033.stdout:3/353: rename d0/f19 to d0/d3/d3b/f71 0 2024-02-15T22:40:47.105 INFO:tasks.workunit.client.0.smithi033.stdout:4/290: creat d8/d16/d51/d27/f5c x:0 0 0 2024-02-15T22:40:47.111 INFO:tasks.workunit.client.0.smithi033.stdout:5/437: creat d6/d14/d31/d64/f8a x:0 0 0 2024-02-15T22:40:47.115 INFO:tasks.workunit.client.0.smithi033.stdout:3/354: unlink d0/d3/dd/l4d 0 2024-02-15T22:40:47.115 INFO:tasks.workunit.client.0.smithi033.stdout:3/355: stat d0/d3/d2c/d43 0 2024-02-15T22:40:47.117 INFO:tasks.workunit.client.0.smithi033.stdout:3/356: read d0/d3/d2c/d5d/f49 [648459,69984] 0 2024-02-15T22:40:47.118 INFO:tasks.workunit.client.0.smithi033.stdout:7/349: rename d5/d6/d10/d16/l3e to d5/df/d40/l72 0 2024-02-15T22:40:47.118 INFO:tasks.workunit.client.0.smithi033.stdout:7/350: write d5/f18 [1123524,64748] 0 2024-02-15T22:40:47.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/291: symlink d8/d16/d51/d1c/d3c/d3f/l5d 0 2024-02-15T22:40:47.121 INFO:tasks.workunit.client.0.smithi033.stdout:4/292: readlink d8/d16/d51/d1c/d3c/d3f/l5d 0 2024-02-15T22:40:47.123 INFO:tasks.workunit.client.0.smithi033.stdout:3/357: rmdir d0/d3/d2c/d5d 39 2024-02-15T22:40:47.126 INFO:tasks.workunit.client.0.smithi033.stdout:5/438: dwrite d6/d14/d31/d48/d59/f54 [0,4194304] 0 2024-02-15T22:40:47.128 INFO:tasks.workunit.client.0.smithi033.stdout:4/293: creat d8/d16/d51/d27/f5e x:0 0 0 2024-02-15T22:40:47.128 INFO:tasks.workunit.client.0.smithi033.stdout:4/294: fdatasync d8/ff 0 2024-02-15T22:40:47.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/295: creat d8/d18/d37/f5f x:0 0 0 2024-02-15T22:40:47.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/296: chown f5 1507208680 1 2024-02-15T22:40:47.130 INFO:tasks.workunit.client.0.smithi033.stdout:3/358: symlink d0/d3/d65/l72 0 2024-02-15T22:40:47.130 INFO:tasks.workunit.client.0.smithi033.stdout:4/297: dread d8/d16/f4e [0,4194304] 0 2024-02-15T22:40:47.135 INFO:tasks.workunit.client.0.smithi033.stdout:7/351: dread d5/f18 [0,4194304] 0 2024-02-15T22:40:47.144 INFO:tasks.workunit.client.0.smithi033.stdout:4/298: write f7 [4672254,77937] 0 2024-02-15T22:40:47.144 INFO:tasks.workunit.client.0.smithi033.stdout:4/299: fsync d8/d18/d37/f55 0 2024-02-15T22:40:47.144 INFO:tasks.workunit.client.0.smithi033.stdout:4/300: read - d8/d16/d51/d27/f5c zero size 2024-02-15T22:40:47.147 INFO:tasks.workunit.client.0.smithi033.stdout:5/439: mknod d6/d25/c8b 0 2024-02-15T22:40:47.148 INFO:tasks.workunit.client.0.smithi033.stdout:5/440: chown d6/d14/d31 39 1 2024-02-15T22:40:47.148 INFO:tasks.workunit.client.0.smithi033.stdout:5/441: creat d6/d14/d31/d48/d49/d53/d57/f8c x:0 0 0 2024-02-15T22:40:47.149 INFO:tasks.workunit.client.0.smithi033.stdout:4/301: dread d8/d16/d51/d1c/d3c/f4d [0,4194304] 0 2024-02-15T22:40:47.151 INFO:tasks.workunit.client.0.smithi033.stdout:4/302: dread d8/d18/d37/d31/f3e [0,4194304] 0 2024-02-15T22:40:47.151 INFO:tasks.workunit.client.0.smithi033.stdout:4/303: readlink d8/d16/l33 0 2024-02-15T22:40:47.156 INFO:tasks.workunit.client.0.smithi033.stdout:6/283: dwrite d12/f41 [0,4194304] 0 2024-02-15T22:40:47.156 INFO:tasks.workunit.client.0.smithi033.stdout:6/284: write d12/d3c/f4d [2010275,33659] 0 2024-02-15T22:40:47.158 INFO:tasks.workunit.client.0.smithi033.stdout:7/352: dwrite d5/dc/d5f/d48/f6a [8388608,4194304] 0 2024-02-15T22:40:47.158 INFO:tasks.workunit.client.0.smithi033.stdout:7/353: chown d5/df 8406 1 2024-02-15T22:40:47.159 INFO:tasks.workunit.client.0.smithi033.stdout:3/359: symlink d0/d3/d3b/l73 0 2024-02-15T22:40:47.159 INFO:tasks.workunit.client.0.smithi033.stdout:3/360: stat d0/d3/d2c/d5d/d3d/f48 0 2024-02-15T22:40:47.159 INFO:tasks.workunit.client.0.smithi033.stdout:3/361: chown d0/d3/d2c/d5d/c4b 4 1 2024-02-15T22:40:47.161 INFO:tasks.workunit.client.0.smithi033.stdout:7/354: dread d5/d6/f54 [0,4194304] 0 2024-02-15T22:40:47.163 INFO:tasks.workunit.client.0.smithi033.stdout:4/304: dread d8/d16/d51/d1c/f38 [0,4194304] 0 2024-02-15T22:40:47.164 INFO:tasks.workunit.client.0.smithi033.stdout:7/355: dread d5/d6/d10/d16/f43 [0,4194304] 0 2024-02-15T22:40:47.171 INFO:tasks.workunit.client.0.smithi033.stdout:5/442: creat d6/d14/d31/d38/d3f/d86/f8d x:0 0 0 2024-02-15T22:40:47.174 INFO:tasks.workunit.client.0.smithi033.stdout:6/285: creat d12/d2c/d30/f62 x:0 0 0 2024-02-15T22:40:47.174 INFO:tasks.workunit.client.0.smithi033.stdout:6/286: chown d12 0 1 2024-02-15T22:40:47.175 INFO:tasks.workunit.client.0.smithi033.stdout:3/362: dwrite d0/d1c/f25 [0,4194304] 0 2024-02-15T22:40:47.175 INFO:tasks.workunit.client.0.smithi033.stdout:3/363: write d0/d3/dd/f18 [1014300,31854] 0 2024-02-15T22:40:47.175 INFO:tasks.workunit.client.0.smithi033.stdout:3/364: fsync d0/d3/d3b/f71 0 2024-02-15T22:40:47.178 INFO:tasks.workunit.client.0.smithi033.stdout:4/305: mknod d8/d16/d51/d1c/c60 0 2024-02-15T22:40:47.181 INFO:tasks.workunit.client.0.smithi033.stdout:7/356: mkdir d5/df/d40/d73 0 2024-02-15T22:40:47.182 INFO:tasks.workunit.client.0.smithi033.stdout:7/357: read d5/f50 [383201,79022] 0 2024-02-15T22:40:47.182 INFO:tasks.workunit.client.0.smithi033.stdout:7/358: readlink d5/df/d56/d60/l70 0 2024-02-15T22:40:47.182 INFO:tasks.workunit.client.0.smithi033.stdout:7/359: readlink d5/d6/l41 0 2024-02-15T22:40:47.182 INFO:tasks.workunit.client.0.smithi033.stdout:7/360: chown d5/df/d40/l55 22006 1 2024-02-15T22:40:47.182 INFO:tasks.workunit.client.0.smithi033.stdout:7/361: creat d5/df/d56/d60/d59/f74 x:0 0 0 2024-02-15T22:40:47.182 INFO:tasks.workunit.client.0.smithi033.stdout:7/362: write d5/d6/d10/d16/d26/d3f/f65 [984519,44981] 0 2024-02-15T22:40:47.182 INFO:tasks.workunit.client.0.smithi033.stdout:7/363: read d5/f18 [2903132,49774] 0 2024-02-15T22:40:47.184 INFO:tasks.workunit.client.0.smithi033.stdout:6/287: chown d12/c1c 259 1 2024-02-15T22:40:47.184 INFO:tasks.workunit.client.0.smithi033.stdout:6/288: chown d12/d2c/d30/f16 364784 1 2024-02-15T22:40:47.184 INFO:tasks.workunit.client.0.smithi033.stdout:6/289: getdents d12/d1b/d3f/d5b/d5c 0 2024-02-15T22:40:47.194 INFO:tasks.workunit.client.0.smithi033.stdout:6/290: write d12/d2c/f4a [1740405,50717] 0 2024-02-15T22:40:47.204 INFO:tasks.workunit.client.0.smithi033.stdout:7/364: getdents d5 0 2024-02-15T22:40:47.204 INFO:tasks.workunit.client.0.smithi033.stdout:7/365: write d5/d6/d10/d16/d26/d3f/f65 [1671068,29266] 0 2024-02-15T22:40:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:6/291: rmdir d12/d2c/d30/d1d/d35 39 2024-02-15T22:40:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:6/292: stat d12/d1b/d3f/d5b 0 2024-02-15T22:40:47.221 INFO:tasks.workunit.client.0.smithi033.stdout:6/293: creat d12/d2c/f63 x:0 0 0 2024-02-15T22:40:47.221 INFO:tasks.workunit.client.0.smithi033.stdout:6/294: chown d12/d2c/d30/f3d 5 1 2024-02-15T22:40:47.228 INFO:tasks.workunit.client.0.smithi033.stdout:6/295: write d12/f41 [2202769,11388] 0 2024-02-15T22:40:47.232 INFO:tasks.workunit.client.0.smithi033.stdout:6/296: symlink d12/d2c/d30/d1d/d35/l64 0 2024-02-15T22:40:47.232 INFO:tasks.workunit.client.0.smithi033.stdout:6/297: stat d12/d2c/d30/d19/f3e 0 2024-02-15T22:40:47.235 INFO:tasks.workunit.client.0.smithi033.stdout:6/298: creat d12/d1b/d3f/d50/f65 x:0 0 0 2024-02-15T22:40:47.242 INFO:tasks.workunit.client.0.smithi033.stdout:6/299: write d12/d2c/d30/d1d/f33 [490606,6783] 0 2024-02-15T22:40:47.242 INFO:tasks.workunit.client.0.smithi033.stdout:6/300: read d12/d2c/d30/d1d/f33 [1233881,40885] 0 2024-02-15T22:40:47.242 INFO:tasks.workunit.client.0.smithi033.stdout:3/365: getdents d0/d3/d3b 0 2024-02-15T22:40:47.248 INFO:tasks.workunit.client.0.smithi033.stdout:3/366: mkdir d0/d3/d2c/d5d/d3d/d57/d74 0 2024-02-15T22:40:47.248 INFO:tasks.workunit.client.0.smithi033.stdout:6/301: getdents d12/d3c 0 2024-02-15T22:40:47.250 INFO:tasks.workunit.client.0.smithi033.stdout:3/367: unlink d0/d3/d2c/d43/l64 0 2024-02-15T22:40:47.252 INFO:tasks.workunit.client.0.smithi033.stdout:6/302: rmdir d12/d1b/d3f/d50/d61 0 2024-02-15T22:40:47.252 INFO:tasks.workunit.client.0.smithi033.stdout:6/303: fdatasync d12/d1b/d3f/d50/f65 0 2024-02-15T22:40:47.252 INFO:tasks.workunit.client.0.smithi033.stdout:6/304: getdents d12/d3c 0 2024-02-15T22:40:47.254 INFO:tasks.workunit.client.0.smithi033.stdout:6/305: creat d12/d2c/d30/d1d/f66 x:0 0 0 2024-02-15T22:40:47.254 INFO:tasks.workunit.client.0.smithi033.stdout:6/306: fdatasync d12/d2c/d30/d1d/f60 0 2024-02-15T22:40:47.255 INFO:tasks.workunit.client.0.smithi033.stdout:6/307: write d12/d1b/d3f/f43 [326853,24745] 0 2024-02-15T22:40:47.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/368: write d0/d3/d2c/f46 [2304714,22823] 0 2024-02-15T22:40:47.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/369: fdatasync d0/d1c/f59 0 2024-02-15T22:40:47.263 INFO:tasks.workunit.client.0.smithi033.stdout:3/370: truncate d0/f1f 2854765 0 2024-02-15T22:40:47.263 INFO:tasks.workunit.client.0.smithi033.stdout:3/371: getdents d0/d3/d2c/d5d/d3d/d57/d74 0 2024-02-15T22:40:47.264 INFO:tasks.workunit.client.0.smithi033.stdout:3/372: rmdir d0/d3/d2c 39 2024-02-15T22:40:47.266 INFO:tasks.workunit.client.0.smithi033.stdout:3/373: creat d0/d3/d2c/d43/f75 x:0 0 0 2024-02-15T22:40:47.266 INFO:tasks.workunit.client.0.smithi033.stdout:3/374: stat d0/d3/d2c/d5d/d3d/d57/f6f 0 2024-02-15T22:40:47.272 INFO:tasks.workunit.client.0.smithi033.stdout:6/308: dwrite d12/d2c/f63 [0,4194304] 0 2024-02-15T22:40:47.277 INFO:tasks.workunit.client.0.smithi033.stdout:6/309: dread d12/f5e [0,4194304] 0 2024-02-15T22:40:47.281 INFO:tasks.workunit.client.0.smithi033.stdout:6/310: rename d12/d2c/d30/d1d/f66 to d12/d2c/d30/d19/f67 0 2024-02-15T22:40:47.282 INFO:tasks.workunit.client.0.smithi033.stdout:6/311: symlink d12/d1b/d3f/l68 0 2024-02-15T22:40:47.283 INFO:tasks.workunit.client.0.smithi033.stdout:6/312: getdents d12/d2c/d30/d1d/d35 0 2024-02-15T22:40:47.283 INFO:tasks.workunit.client.0.smithi033.stdout:6/313: write d12/d1b/d3f/f43 [1490034,114433] 0 2024-02-15T22:40:47.284 INFO:tasks.workunit.client.0.smithi033.stdout:6/314: creat d12/d3c/f69 x:0 0 0 2024-02-15T22:40:47.284 INFO:tasks.workunit.client.0.smithi033.stdout:6/315: truncate d12/d1b/f52 749205 0 2024-02-15T22:40:47.285 INFO:tasks.workunit.client.0.smithi033.stdout:6/316: mknod d12/d1b/d3f/d50/c6a 0 2024-02-15T22:40:47.286 INFO:tasks.workunit.client.0.smithi033.stdout:6/317: mknod d12/d1b/d3f/d50/c6b 0 2024-02-15T22:40:47.286 INFO:tasks.workunit.client.0.smithi033.stdout:6/318: chown d12/d2c/d30/d1d/d35/c38 17096202 1 2024-02-15T22:40:47.407 INFO:tasks.workunit.client.0.smithi033.stdout:0/332: sync 2024-02-15T22:40:47.407 INFO:tasks.workunit.client.0.smithi033.stdout:8/229: sync 2024-02-15T22:40:47.407 INFO:tasks.workunit.client.0.smithi033.stdout:8/230: write d1/df/d1d/f35 [4666247,107537] 0 2024-02-15T22:40:47.409 INFO:tasks.workunit.client.0.smithi033.stdout:8/231: creat d1/de/d1a/d27/d55/f59 x:0 0 0 2024-02-15T22:40:47.410 INFO:tasks.workunit.client.0.smithi033.stdout:0/333: dread fa [0,4194304] 0 2024-02-15T22:40:47.410 INFO:tasks.workunit.client.0.smithi033.stdout:0/334: stat db/c51 0 2024-02-15T22:40:47.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/232: dwrite d1/de/d13/f4d [0,4194304] 0 2024-02-15T22:40:47.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/233: write d1/f33 [1200028,33878] 0 2024-02-15T22:40:47.431 INFO:tasks.workunit.client.0.smithi033.stdout:0/335: dwrite db/d19/f1a [0,4194304] 0 2024-02-15T22:40:47.432 INFO:tasks.workunit.client.0.smithi033.stdout:8/234: getdents d1/de/d1a/d2a 0 2024-02-15T22:40:47.433 INFO:tasks.workunit.client.0.smithi033.stdout:8/235: mknod d1/df/c5a 0 2024-02-15T22:40:47.433 INFO:tasks.workunit.client.0.smithi033.stdout:8/236: readlink d1/de/d1a/l1e 0 2024-02-15T22:40:47.435 INFO:tasks.workunit.client.0.smithi033.stdout:8/237: rename d1/de/d13/l47 to d1/df/d57/l5b 0 2024-02-15T22:40:47.436 INFO:tasks.workunit.client.0.smithi033.stdout:8/238: chown d1/df/d2e/c3e 213745092 1 2024-02-15T22:40:47.437 INFO:tasks.workunit.client.0.smithi033.stdout:8/239: mkdir d1/de/d5c 0 2024-02-15T22:40:47.438 INFO:tasks.workunit.client.0.smithi033.stdout:8/240: unlink d1/de/f1c 0 2024-02-15T22:40:47.438 INFO:tasks.workunit.client.0.smithi033.stdout:8/241: dread - d1/de/d1a/d27/d55/f59 zero size 2024-02-15T22:40:47.439 INFO:tasks.workunit.client.0.smithi033.stdout:8/242: mkdir d1/d6/d14/d5d 0 2024-02-15T22:40:47.440 INFO:tasks.workunit.client.0.smithi033.stdout:8/243: rename d1/c11 to d1/d6/c5e 0 2024-02-15T22:40:47.443 INFO:tasks.workunit.client.0.smithi033.stdout:8/244: dread d1/de/d13/f29 [0,4194304] 0 2024-02-15T22:40:47.443 INFO:tasks.workunit.client.0.smithi033.stdout:8/245: truncate d1/f10 5044556 0 2024-02-15T22:40:47.444 INFO:tasks.workunit.client.0.smithi033.stdout:0/336: write db/d19/d32/f48 [8026435,42585] 0 2024-02-15T22:40:47.445 INFO:tasks.workunit.client.0.smithi033.stdout:0/337: creat db/d19/f72 x:0 0 0 2024-02-15T22:40:47.448 INFO:tasks.workunit.client.0.smithi033.stdout:8/246: dread d1/d6/f7 [0,4194304] 0 2024-02-15T22:40:47.450 INFO:tasks.workunit.client.0.smithi033.stdout:8/247: symlink d1/de/d1a/d2a/d40/l5f 0 2024-02-15T22:40:47.463 INFO:tasks.workunit.client.0.smithi033.stdout:8/248: dwrite d1/d6/d14/f1b [4194304,4194304] 0 2024-02-15T22:40:47.464 INFO:tasks.workunit.client.0.smithi033.stdout:8/249: truncate d1/df/d2e/f53 838277 0 2024-02-15T22:40:47.464 INFO:tasks.workunit.client.0.smithi033.stdout:8/250: fsync d1/f10 0 2024-02-15T22:40:47.464 INFO:tasks.workunit.client.0.smithi033.stdout:8/251: truncate d1/de/d1a/d27/d55/f59 877501 0 2024-02-15T22:40:47.465 INFO:tasks.workunit.client.0.smithi033.stdout:8/252: truncate d1/de/d1a/d2a/d40/f4e 2339504 0 2024-02-15T22:40:47.466 INFO:tasks.workunit.client.0.smithi033.stdout:8/253: mkdir d1/de/d1a/d27/d60 0 2024-02-15T22:40:47.471 INFO:tasks.workunit.client.0.smithi033.stdout:0/338: dwrite db/d19/d32/f48 [8388608,4194304] 0 2024-02-15T22:40:47.478 INFO:tasks.workunit.client.0.smithi033.stdout:0/339: write db/d19/d32/f48 [3435013,56326] 0 2024-02-15T22:40:47.481 INFO:tasks.workunit.client.0.smithi033.stdout:8/254: truncate d1/f10 2561792 0 2024-02-15T22:40:47.487 INFO:tasks.workunit.client.0.smithi033.stdout:8/255: dread d1/d6/f7 [0,4194304] 0 2024-02-15T22:40:47.503 INFO:tasks.workunit.client.0.smithi033.stdout:0/340: dwrite db/d19/d32/f23 [4194304,4194304] 0 2024-02-15T22:40:47.503 INFO:tasks.workunit.client.0.smithi033.stdout:0/341: dread - db/d19/d32/d46/f53 zero size 2024-02-15T22:40:47.505 INFO:tasks.workunit.client.0.smithi033.stdout:8/256: dwrite d1/d36/f43 [0,4194304] 0 2024-02-15T22:40:47.505 INFO:tasks.workunit.client.0.smithi033.stdout:8/257: creat d1/de/f61 x:0 0 0 2024-02-15T22:40:47.505 INFO:tasks.workunit.client.0.smithi033.stdout:8/258: fsync d1/de/d1a/d2a/f3c 0 2024-02-15T22:40:47.505 INFO:tasks.workunit.client.0.smithi033.stdout:0/342: rename db/l22 to db/d2a/l73 0 2024-02-15T22:40:47.519 INFO:tasks.workunit.client.0.smithi033.stdout:0/343: read db/d19/d32/f48 [10322368,97722] 0 2024-02-15T22:40:47.521 INFO:tasks.workunit.client.0.smithi033.stdout:0/344: link db/d19/d32/d46/f53 db/d19/d32/d3d/f74 0 2024-02-15T22:40:47.521 INFO:tasks.workunit.client.0.smithi033.stdout:0/345: stat db/d19/d32/d3d/c5f 0 2024-02-15T22:40:47.521 INFO:tasks.workunit.client.0.smithi033.stdout:0/346: readlink db/d19/d32/l28 0 2024-02-15T22:40:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:0/347: rename db/d19/d32/l2f to db/d19/d32/d43/d5a/l75 0 2024-02-15T22:40:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:8/259: dwrite d1/de/f61 [0,4194304] 0 2024-02-15T22:40:47.526 INFO:tasks.workunit.client.0.smithi033.stdout:8/260: mknod d1/c62 0 2024-02-15T22:40:47.526 INFO:tasks.workunit.client.0.smithi033.stdout:8/261: write d1/f33 [363715,4254] 0 2024-02-15T22:40:47.533 INFO:tasks.workunit.client.0.smithi033.stdout:0/348: write db/d19/f1a [2537234,87477] 0 2024-02-15T22:40:47.533 INFO:tasks.workunit.client.0.smithi033.stdout:0/349: chown db/d2a 251 1 2024-02-15T22:40:47.533 INFO:tasks.workunit.client.0.smithi033.stdout:0/350: write db/f63 [315447,66834] 0 2024-02-15T22:40:47.533 INFO:tasks.workunit.client.0.smithi033.stdout:0/351: chown db/d19/d32/d46 0 1 2024-02-15T22:40:47.534 INFO:tasks.workunit.client.0.smithi033.stdout:0/352: fdatasync db/d19/f2d 0 2024-02-15T22:40:47.534 INFO:tasks.workunit.client.0.smithi033.stdout:0/353: write db/d19/d32/d46/f4f [2924984,103346] 0 2024-02-15T22:40:47.534 INFO:tasks.workunit.client.0.smithi033.stdout:0/354: chown db/d19/d32/d3d/l52 3748 1 2024-02-15T22:40:47.534 INFO:tasks.workunit.client.0.smithi033.stdout:8/262: dread d1/df/d1d/f35 [0,4194304] 0 2024-02-15T22:40:47.535 INFO:tasks.workunit.client.0.smithi033.stdout:8/263: fdatasync d1/de/f61 0 2024-02-15T22:40:47.535 INFO:tasks.workunit.client.0.smithi033.stdout:0/355: unlink db/d19/d32/d3d/l67 0 2024-02-15T22:40:47.536 INFO:tasks.workunit.client.0.smithi033.stdout:8/264: mkdir d1/de/d63 0 2024-02-15T22:40:47.536 INFO:tasks.workunit.client.0.smithi033.stdout:8/265: getdents d1/d6/d14/d5d 0 2024-02-15T22:40:47.553 INFO:tasks.workunit.client.0.smithi033.stdout:2/371: sync 2024-02-15T22:40:47.553 INFO:tasks.workunit.client.0.smithi033.stdout:9/300: sync 2024-02-15T22:40:47.553 INFO:tasks.workunit.client.0.smithi033.stdout:1/312: sync 2024-02-15T22:40:47.553 INFO:tasks.workunit.client.0.smithi033.stdout:5/443: sync 2024-02-15T22:40:47.553 INFO:tasks.workunit.client.0.smithi033.stdout:2/372: read - d1/d8/d34/f53 zero size 2024-02-15T22:40:47.553 INFO:tasks.workunit.client.0.smithi033.stdout:1/313: creat d1/f64 x:0 0 0 2024-02-15T22:40:47.553 INFO:tasks.workunit.client.0.smithi033.stdout:5/444: write d6/d14/d31/d48/d49/d53/d57/f61 [968901,74934] 0 2024-02-15T22:40:47.557 INFO:tasks.workunit.client.0.smithi033.stdout:5/445: unlink d6/d14/d31/d38/d3f/d86/l88 0 2024-02-15T22:40:47.559 INFO:tasks.workunit.client.0.smithi033.stdout:5/446: mknod d6/d14/d31/d50/d5c/c8e 0 2024-02-15T22:40:47.562 INFO:tasks.workunit.client.0.smithi033.stdout:2/373: dread d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:47.564 INFO:tasks.workunit.client.0.smithi033.stdout:2/374: symlink d1/d8/d2b/d2f/d24/d5d/l6a 0 2024-02-15T22:40:47.567 INFO:tasks.workunit.client.0.smithi033.stdout:1/314: write d1/f6 [3745855,118082] 0 2024-02-15T22:40:47.567 INFO:tasks.workunit.client.0.smithi033.stdout:1/315: creat d1/d20/f65 x:0 0 0 2024-02-15T22:40:47.568 INFO:tasks.workunit.client.0.smithi033.stdout:1/316: readlink d1/de/d27/d28/d2d/l50 0 2024-02-15T22:40:47.570 INFO:tasks.workunit.client.0.smithi033.stdout:1/317: truncate d1/de/d27/d28/d2d/d36/f5d 11090327 0 2024-02-15T22:40:47.573 INFO:tasks.workunit.client.0.smithi033.stdout:0/356: dwrite db/d19/d32/d46/f54 [8388608,4194304] 0 2024-02-15T22:40:47.573 INFO:tasks.workunit.client.0.smithi033.stdout:8/266: dwrite d1/de/d1a/d2a/f3c [0,4194304] 0 2024-02-15T22:40:47.573 INFO:tasks.workunit.client.0.smithi033.stdout:8/267: fdatasync d1/de/d1a/d27/d55/f59 0 2024-02-15T22:40:47.575 INFO:tasks.workunit.client.0.smithi033.stdout:9/301: dwrite d4/fd [0,4194304] 0 2024-02-15T22:40:47.576 INFO:tasks.workunit.client.0.smithi033.stdout:0/357: write fa [1407381,24815] 0 2024-02-15T22:40:47.582 INFO:tasks.workunit.client.0.smithi033.stdout:5/447: dwrite d6/fe [4194304,4194304] 0 2024-02-15T22:40:47.585 INFO:tasks.workunit.client.0.smithi033.stdout:0/358: mkdir db/d19/d32/d43/d5a/d76 0 2024-02-15T22:40:47.585 INFO:tasks.workunit.client.0.smithi033.stdout:0/359: fsync db/d19/d32/d3d/f74 0 2024-02-15T22:40:47.585 INFO:tasks.workunit.client.0.smithi033.stdout:0/360: creat db/d19/d32/f77 x:0 0 0 2024-02-15T22:40:47.585 INFO:tasks.workunit.client.0.smithi033.stdout:0/361: write db/d19/f3f [2232268,74868] 0 2024-02-15T22:40:47.585 INFO:tasks.workunit.client.0.smithi033.stdout:0/362: chown db/d19/d32/f23 9684523 1 2024-02-15T22:40:47.586 INFO:tasks.workunit.client.0.smithi033.stdout:0/363: write db/f63 [384589,106388] 0 2024-02-15T22:40:47.588 INFO:tasks.workunit.client.0.smithi033.stdout:0/364: dread db/d19/d32/f3c [0,4194304] 0 2024-02-15T22:40:47.589 INFO:tasks.workunit.client.0.smithi033.stdout:8/268: mknod d1/df/d1d/d4a/c64 0 2024-02-15T22:40:47.592 INFO:tasks.workunit.client.0.smithi033.stdout:5/448: write d6/d14/d31/d38/f82 [3032414,22611] 0 2024-02-15T22:40:47.594 INFO:tasks.workunit.client.0.smithi033.stdout:1/318: dwrite d1/de/f38 [0,4194304] 0 2024-02-15T22:40:47.594 INFO:tasks.workunit.client.0.smithi033.stdout:1/319: chown d1/d20/c32 5 1 2024-02-15T22:40:47.594 INFO:tasks.workunit.client.0.smithi033.stdout:1/320: creat d1/de/d27/d28/d37/f66 x:0 0 0 2024-02-15T22:40:47.594 INFO:tasks.workunit.client.0.smithi033.stdout:1/321: write d1/f6 [4666184,92862] 0 2024-02-15T22:40:47.597 INFO:tasks.workunit.client.0.smithi033.stdout:5/449: read d6/f1b [1745955,52824] 0 2024-02-15T22:40:47.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/302: dwrite d4/f19 [0,4194304] 0 2024-02-15T22:40:47.612 INFO:tasks.workunit.client.0.smithi033.stdout:1/322: dwrite d1/de/d27/d28/d37/f45 [8388608,4194304] 0 2024-02-15T22:40:47.612 INFO:tasks.workunit.client.0.smithi033.stdout:1/323: chown d1/de/d27/d28/d2d/d36/f54 581393 1 2024-02-15T22:40:47.612 INFO:tasks.workunit.client.0.smithi033.stdout:1/324: fsync d1/de/f13 0 2024-02-15T22:40:47.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:47 smithi082 ceph-mon[37153]: pgmap v6: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:47.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:47 smithi033 ceph-mon[29033]: pgmap v6: 65 pgs: 65 active+clean; 354 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:40:47.883 INFO:tasks.workunit.client.0.smithi033.stdout:0/365: creat db/d19/d32/d43/f78 x:0 0 0 2024-02-15T22:40:47.891 INFO:tasks.workunit.client.0.smithi033.stdout:0/366: write db/d19/f3a [3283741,38211] 0 2024-02-15T22:40:47.891 INFO:tasks.workunit.client.0.smithi033.stdout:5/450: rename d6/d14/f3e to d6/d14/d31/d38/f8f 0 2024-02-15T22:40:47.899 INFO:tasks.workunit.client.0.smithi033.stdout:0/367: dread f4 [0,4194304] 0 2024-02-15T22:40:47.899 INFO:tasks.workunit.client.0.smithi033.stdout:0/368: stat db/d19/d32/d43/d5a/c66 0 2024-02-15T22:40:47.899 INFO:tasks.workunit.client.0.smithi033.stdout:0/369: readlink db/d19/d32/l57 0 2024-02-15T22:40:47.900 INFO:tasks.workunit.client.0.smithi033.stdout:0/370: write db/d19/d32/d3d/f59 [605134,12886] 0 2024-02-15T22:40:47.900 INFO:tasks.workunit.client.0.smithi033.stdout:1/325: mkdir d1/d20/d42/d25/d67 0 2024-02-15T22:40:47.900 INFO:tasks.workunit.client.0.smithi033.stdout:1/326: stat d1/d20/d42/d2c 0 2024-02-15T22:40:47.904 INFO:tasks.workunit.client.0.smithi033.stdout:5/451: mkdir d6/d14/d31/d48/d56/d90 0 2024-02-15T22:40:47.906 INFO:tasks.workunit.client.0.smithi033.stdout:1/327: creat d1/d20/d42/d2c/d30/f68 x:0 0 0 2024-02-15T22:40:47.906 INFO:tasks.workunit.client.0.smithi033.stdout:1/328: write d1/d20/f24 [644186,103088] 0 2024-02-15T22:40:47.906 INFO:tasks.workunit.client.0.smithi033.stdout:1/329: fsync d1/d20/d42/d25/f60 0 2024-02-15T22:40:47.908 INFO:tasks.workunit.client.0.smithi033.stdout:4/306: sync 2024-02-15T22:40:47.908 INFO:tasks.workunit.client.0.smithi033.stdout:7/366: sync 2024-02-15T22:40:47.908 INFO:tasks.workunit.client.0.smithi033.stdout:4/307: stat d8/ca 0 2024-02-15T22:40:47.908 INFO:tasks.workunit.client.0.smithi033.stdout:7/367: stat d5/df/d47 0 2024-02-15T22:40:47.908 INFO:tasks.workunit.client.0.smithi033.stdout:7/368: readlink d5/df/d56/l3b 0 2024-02-15T22:40:47.908 INFO:tasks.workunit.client.0.smithi033.stdout:5/452: symlink d6/d14/d31/d50/d5c/l91 0 2024-02-15T22:40:47.908 INFO:tasks.workunit.client.0.smithi033.stdout:5/453: chown d6/d14/d31/d38/f82 1614196 1 2024-02-15T22:40:47.910 INFO:tasks.workunit.client.0.smithi033.stdout:1/330: mkdir d1/de/d27/d28/d2d/d5e/d69 0 2024-02-15T22:40:47.912 INFO:tasks.workunit.client.0.smithi033.stdout:4/308: mkdir d8/d18/d37/d23/d61 0 2024-02-15T22:40:47.913 INFO:tasks.workunit.client.0.smithi033.stdout:3/375: sync 2024-02-15T22:40:47.913 INFO:tasks.workunit.client.0.smithi033.stdout:6/319: sync 2024-02-15T22:40:47.913 INFO:tasks.workunit.client.0.smithi033.stdout:2/375: sync 2024-02-15T22:40:47.913 INFO:tasks.workunit.client.0.smithi033.stdout:6/320: fdatasync d12/d2c/f63 0 2024-02-15T22:40:47.913 INFO:tasks.workunit.client.0.smithi033.stdout:6/321: read - d12/d2c/d30/d1d/d35/f47 zero size 2024-02-15T22:40:47.913 INFO:tasks.workunit.client.0.smithi033.stdout:9/303: sync 2024-02-15T22:40:47.913 INFO:tasks.workunit.client.0.smithi033.stdout:8/269: sync 2024-02-15T22:40:47.916 INFO:tasks.workunit.client.0.smithi033.stdout:7/369: rename d5/d6/d10/d16/f43 to d5/dc/d5f/f75 0 2024-02-15T22:40:47.922 INFO:tasks.workunit.client.0.smithi033.stdout:5/454: creat d6/d14/d31/d38/d3f/f92 x:0 0 0 2024-02-15T22:40:47.925 INFO:tasks.workunit.client.0.smithi033.stdout:9/304: link d4/d1d/d23/d24/l28 d4/d1d/d23/d32/d3e/l54 0 2024-02-15T22:40:47.927 INFO:tasks.workunit.client.0.smithi033.stdout:8/270: mknod d1/de/d5c/c65 0 2024-02-15T22:40:47.927 INFO:tasks.workunit.client.0.smithi033.stdout:8/271: write d1/df/d1d/f35 [5026392,34867] 0 2024-02-15T22:40:47.929 INFO:tasks.workunit.client.0.smithi033.stdout:4/309: rename d8/d1a/f36 to d8/d16/d51/d1c/d3c/d49/f62 0 2024-02-15T22:40:47.931 INFO:tasks.workunit.client.0.smithi033.stdout:7/370: mknod d5/df/d40/d4a/c76 0 2024-02-15T22:40:47.933 INFO:tasks.workunit.client.0.smithi033.stdout:8/272: creat d1/de/d1a/f66 x:0 0 0 2024-02-15T22:40:47.936 INFO:tasks.workunit.client.0.smithi033.stdout:2/376: rename d1/d8/c45 to d1/d8/d2b/d2f/d3d/c6b 0 2024-02-15T22:40:47.936 INFO:tasks.workunit.client.0.smithi033.stdout:2/377: read d1/f7 [14094838,68302] 0 2024-02-15T22:40:47.936 INFO:tasks.workunit.client.0.smithi033.stdout:2/378: write d1/d8/d2b/d2f/d24/d31/f58 [862511,69554] 0 2024-02-15T22:40:47.939 INFO:tasks.workunit.client.0.smithi033.stdout:7/371: unlink d5/dc/f2e 0 2024-02-15T22:40:47.940 INFO:tasks.workunit.client.0.smithi033.stdout:7/372: stat d5/d6/d10/c1e 0 2024-02-15T22:40:47.940 INFO:tasks.workunit.client.0.smithi033.stdout:8/273: rmdir d1/df 39 2024-02-15T22:40:47.940 INFO:tasks.workunit.client.0.smithi033.stdout:8/274: chown d1/de/f56 6 1 2024-02-15T22:40:47.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/379: symlink d1/d16/l6c 0 2024-02-15T22:40:47.945 INFO:tasks.workunit.client.0.smithi033.stdout:7/373: rename d5/df/d47/l5d to d5/dc/d5f/d48/l77 0 2024-02-15T22:40:47.945 INFO:tasks.workunit.client.0.smithi033.stdout:7/374: truncate d5/dc/d5f/f75 445627 0 2024-02-15T22:40:47.945 INFO:tasks.workunit.client.0.smithi033.stdout:7/375: stat d5 0 2024-02-15T22:40:47.948 INFO:tasks.workunit.client.0.smithi033.stdout:7/376: dread f4 [0,4194304] 0 2024-02-15T22:40:47.948 INFO:tasks.workunit.client.0.smithi033.stdout:2/380: rename d1/d16/l2c to d1/l6d 0 2024-02-15T22:40:47.950 INFO:tasks.workunit.client.0.smithi033.stdout:2/381: dread d1/d8/d2b/d2f/d13/f3b [0,4194304] 0 2024-02-15T22:40:47.950 INFO:tasks.workunit.client.0.smithi033.stdout:7/377: mkdir d5/d78 0 2024-02-15T22:40:47.950 INFO:tasks.workunit.client.0.smithi033.stdout:7/378: write d5/df/d56/f63 [886430,13649] 0 2024-02-15T22:40:47.953 INFO:tasks.workunit.client.0.smithi033.stdout:3/376: dwrite d0/fe [0,4194304] 0 2024-02-15T22:40:47.953 INFO:tasks.workunit.client.0.smithi033.stdout:3/377: write d0/f42 [3969,2481] 0 2024-02-15T22:40:47.954 INFO:tasks.workunit.client.0.smithi033.stdout:6/322: dwrite d12/d1b/d3f/f57 [0,4194304] 0 2024-02-15T22:40:47.958 INFO:tasks.workunit.client.0.smithi033.stdout:1/331: dwrite d1/f17 [0,4194304] 0 2024-02-15T22:40:47.958 INFO:tasks.workunit.client.0.smithi033.stdout:7/379: dread d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:47.958 INFO:tasks.workunit.client.0.smithi033.stdout:9/305: dwrite d4/d1d/f2c [0,4194304] 0 2024-02-15T22:40:47.958 INFO:tasks.workunit.client.0.smithi033.stdout:9/306: dread - d4/d1d/d23/d24/f4b zero size 2024-02-15T22:40:47.960 INFO:tasks.workunit.client.0.smithi033.stdout:3/378: dread d0/d3/d2c/f46 [0,4194304] 0 2024-02-15T22:40:47.960 INFO:tasks.workunit.client.0.smithi033.stdout:3/379: write d0/d3/d2c/d5d/f37 [351386,77071] 0 2024-02-15T22:40:47.962 INFO:tasks.workunit.client.0.smithi033.stdout:3/380: write d0/d3/dd/f18 [193187,94540] 0 2024-02-15T22:40:47.962 INFO:tasks.workunit.client.0.smithi033.stdout:3/381: creat d0/d3/dd/f76 x:0 0 0 2024-02-15T22:40:47.962 INFO:tasks.workunit.client.0.smithi033.stdout:2/382: dread d1/f2 [4194304,4194304] 0 2024-02-15T22:40:47.962 INFO:tasks.workunit.client.0.smithi033.stdout:3/382: write d0/f53 [20001,104697] 0 2024-02-15T22:40:47.962 INFO:tasks.workunit.client.0.smithi033.stdout:8/275: dwrite d1/de/f61 [4194304,4194304] 0 2024-02-15T22:40:47.962 INFO:tasks.workunit.client.0.smithi033.stdout:3/383: write d0/d3/d3b/d47/f50 [862753,53712] 0 2024-02-15T22:40:47.968 INFO:tasks.workunit.client.0.smithi033.stdout:4/310: getdents d8/d1a 0 2024-02-15T22:40:47.974 INFO:tasks.workunit.client.0.smithi033.stdout:7/380: rmdir d5/df/d40 39 2024-02-15T22:40:47.975 INFO:tasks.workunit.client.0.smithi033.stdout:1/332: read d1/d20/d42/f49 [312672,47611] 0 2024-02-15T22:40:47.975 INFO:tasks.workunit.client.0.smithi033.stdout:6/323: dwrite d12/d1b/f52 [0,4194304] 0 2024-02-15T22:40:47.976 INFO:tasks.workunit.client.0.smithi033.stdout:6/324: creat d12/d1b/f6c x:0 0 0 2024-02-15T22:40:47.978 INFO:tasks.workunit.client.0.smithi033.stdout:9/307: link d4/l31 d4/d1d/d23/d24/l55 0 2024-02-15T22:40:47.983 INFO:tasks.workunit.client.0.smithi033.stdout:9/308: dread d4/f9 [0,4194304] 0 2024-02-15T22:40:47.986 INFO:tasks.workunit.client.0.smithi033.stdout:3/384: mkdir d0/d3/d77 0 2024-02-15T22:40:47.986 INFO:tasks.workunit.client.0.smithi033.stdout:3/385: write d0/d3/dd/f6a [51438,17563] 0 2024-02-15T22:40:47.987 INFO:tasks.workunit.client.0.smithi033.stdout:4/311: dwrite d8/f54 [0,4194304] 0 2024-02-15T22:40:47.990 INFO:tasks.workunit.client.0.smithi033.stdout:7/381: creat d5/df/d40/f79 x:0 0 0 2024-02-15T22:40:47.992 INFO:tasks.workunit.client.0.smithi033.stdout:4/312: dread d8/d16/f4e [0,4194304] 0 2024-02-15T22:40:47.992 INFO:tasks.workunit.client.0.smithi033.stdout:4/313: chown d8/d16/d51/d27/f5e 2 1 2024-02-15T22:40:47.996 INFO:tasks.workunit.client.0.smithi033.stdout:6/325: link d12/d1b/l24 d12/d2c/d30/d1d/d35/l6d 0 2024-02-15T22:40:47.999 INFO:tasks.workunit.client.0.smithi033.stdout:1/333: dwrite d1/d20/d42/d2c/d30/f40 [0,4194304] 0 2024-02-15T22:40:48.000 INFO:tasks.workunit.client.0.smithi033.stdout:7/382: symlink d5/d6/d10/d16/l7a 0 2024-02-15T22:40:48.001 INFO:tasks.workunit.client.0.smithi033.stdout:4/314: truncate d8/d18/d37/d31/f3e 400778 0 2024-02-15T22:40:48.003 INFO:tasks.workunit.client.0.smithi033.stdout:4/315: write d8/d16/f4e [489432,91487] 0 2024-02-15T22:40:48.003 INFO:tasks.workunit.client.0.smithi033.stdout:4/316: fdatasync d8/d18/d37/f40 0 2024-02-15T22:40:48.004 INFO:tasks.workunit.client.0.smithi033.stdout:6/326: dread d12/d2c/d30/f20 [0,4194304] 0 2024-02-15T22:40:48.008 INFO:tasks.workunit.client.0.smithi033.stdout:3/386: rmdir d0/d3 39 2024-02-15T22:40:48.012 INFO:tasks.workunit.client.0.smithi033.stdout:1/334: symlink d1/d57/l6a 0 2024-02-15T22:40:48.013 INFO:tasks.workunit.client.0.smithi033.stdout:2/383: truncate d1/d8/d2b/d2f/d24/d31/f58 568586 0 2024-02-15T22:40:48.015 INFO:tasks.workunit.client.0.smithi033.stdout:7/383: mkdir d5/d78/d7b 0 2024-02-15T22:40:48.015 INFO:tasks.workunit.client.0.smithi033.stdout:7/384: readlink l1 0 2024-02-15T22:40:48.018 INFO:tasks.workunit.client.0.smithi033.stdout:4/317: unlink d8/d18/d37/d31/d47/f4c 0 2024-02-15T22:40:48.019 INFO:tasks.workunit.client.0.smithi033.stdout:1/335: dread d1/f1c [0,4194304] 0 2024-02-15T22:40:48.020 INFO:tasks.workunit.client.0.smithi033.stdout:1/336: write d1/de/f38 [4713449,36365] 0 2024-02-15T22:40:48.020 INFO:tasks.workunit.client.0.smithi033.stdout:1/337: chown d1/d20/d42/c21 2 1 2024-02-15T22:40:48.021 INFO:tasks.workunit.client.0.smithi033.stdout:3/387: mknod d0/d3/d2c/d43/c78 0 2024-02-15T22:40:48.021 INFO:tasks.workunit.client.0.smithi033.stdout:3/388: chown d0/d1c/f59 7 1 2024-02-15T22:40:48.023 INFO:tasks.workunit.client.0.smithi033.stdout:7/385: creat d5/d78/d7b/f7c x:0 0 0 2024-02-15T22:40:48.025 INFO:tasks.workunit.client.0.smithi033.stdout:3/389: dread d0/d3/d2c/d43/f45 [0,4194304] 0 2024-02-15T22:40:48.027 INFO:tasks.workunit.client.0.smithi033.stdout:4/318: truncate f7 4071058 0 2024-02-15T22:40:48.028 INFO:tasks.workunit.client.0.smithi033.stdout:6/327: rmdir d12/d3c 39 2024-02-15T22:40:48.030 INFO:tasks.workunit.client.0.smithi033.stdout:7/386: mknod d5/d6/d10/d16/c7d 0 2024-02-15T22:40:48.032 INFO:tasks.workunit.client.0.smithi033.stdout:3/390: symlink d0/d3/d2c/d5d/l79 0 2024-02-15T22:40:48.032 INFO:tasks.workunit.client.0.smithi033.stdout:3/391: chown d0/d3/d2c/d5d/f37 312 1 2024-02-15T22:40:48.032 INFO:tasks.workunit.client.0.smithi033.stdout:3/392: stat d0/d3/d2c/d5d/f49 0 2024-02-15T22:40:48.033 INFO:tasks.workunit.client.0.smithi033.stdout:2/384: dwrite d1/d8/d34/f53 [0,4194304] 0 2024-02-15T22:40:48.033 INFO:tasks.workunit.client.0.smithi033.stdout:3/393: write d0/d3/d2c/d5d/d3d/f48 [21520,2187] 0 2024-02-15T22:40:48.033 INFO:tasks.workunit.client.0.smithi033.stdout:3/394: readlink d0/d1c/l3e 0 2024-02-15T22:40:48.033 INFO:tasks.workunit.client.0.smithi033.stdout:4/319: symlink d8/d16/d45/l63 0 2024-02-15T22:40:48.033 INFO:tasks.workunit.client.0.smithi033.stdout:6/328: stat d12/f28 0 2024-02-15T22:40:48.036 INFO:tasks.workunit.client.0.smithi033.stdout:1/338: dwrite d1/d20/d42/d2c/f31 [0,4194304] 0 2024-02-15T22:40:48.036 INFO:tasks.workunit.client.0.smithi033.stdout:1/339: chown d1/ld 0 1 2024-02-15T22:40:48.037 INFO:tasks.workunit.client.0.smithi033.stdout:2/385: creat d1/d50/f6e x:0 0 0 2024-02-15T22:40:48.037 INFO:tasks.workunit.client.0.smithi033.stdout:2/386: write d1/d8/d2b/d2f/d38/f5c [734158,12408] 0 2024-02-15T22:40:48.041 INFO:tasks.workunit.client.0.smithi033.stdout:7/387: write d5/dc/d5f/d48/f6a [11943527,5795] 0 2024-02-15T22:40:48.042 INFO:tasks.workunit.client.0.smithi033.stdout:3/395: symlink d0/l7a 0 2024-02-15T22:40:48.044 INFO:tasks.workunit.client.0.smithi033.stdout:4/320: symlink d8/d18/d37/d23/d61/l64 0 2024-02-15T22:40:48.044 INFO:tasks.workunit.client.0.smithi033.stdout:4/321: stat d8/d16/d51/d27/f5c 0 2024-02-15T22:40:48.046 INFO:tasks.workunit.client.0.smithi033.stdout:6/329: creat d12/d1b/d3f/d4b/f6e x:0 0 0 2024-02-15T22:40:48.050 INFO:tasks.workunit.client.0.smithi033.stdout:1/340: mknod d1/de/d27/d28/d2d/d36/c6b 0 2024-02-15T22:40:48.050 INFO:tasks.workunit.client.0.smithi033.stdout:1/341: fsync d1/de/d27/d28/d2d/f48 0 2024-02-15T22:40:48.052 INFO:tasks.workunit.client.0.smithi033.stdout:1/342: dread d1/f8 [0,4194304] 0 2024-02-15T22:40:48.053 INFO:tasks.workunit.client.0.smithi033.stdout:4/322: creat d8/d18/d37/d23/d61/f65 x:0 0 0 2024-02-15T22:40:48.053 INFO:tasks.workunit.client.0.smithi033.stdout:4/323: write f5 [1409473,118800] 0 2024-02-15T22:40:48.053 INFO:tasks.workunit.client.0.smithi033.stdout:4/324: truncate d8/d18/d37/f55 719953 0 2024-02-15T22:40:48.058 INFO:tasks.workunit.client.0.smithi033.stdout:6/330: truncate d12/d2c/d30/d19/f26 1322794 0 2024-02-15T22:40:48.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/325: link d8/d16/d51/d1c/d3c/d49/f62 d8/d18/d37/d23/d61/f66 0 2024-02-15T22:40:48.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/326: chown d8/d18/d37/d23/d61 3 1 2024-02-15T22:40:48.062 INFO:tasks.workunit.client.0.smithi033.stdout:6/331: mkdir d12/d1b/d3f/d4b/d6f 0 2024-02-15T22:40:48.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/327: mknod d8/d16/c67 0 2024-02-15T22:40:48.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/328: write d8/d16/d51/f44 [1523181,37313] 0 2024-02-15T22:40:48.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/329: write d8/d16/d51/d1c/f32 [1831197,64835] 0 2024-02-15T22:40:48.066 INFO:tasks.workunit.client.0.smithi033.stdout:6/332: symlink d12/d1b/l70 0 2024-02-15T22:40:48.066 INFO:tasks.workunit.client.0.smithi033.stdout:7/388: dwrite d5/d6/d10/f6d [0,4194304] 0 2024-02-15T22:40:48.067 INFO:tasks.workunit.client.0.smithi033.stdout:4/330: creat d8/d18/f68 x:0 0 0 2024-02-15T22:40:48.074 INFO:tasks.workunit.client.0.smithi033.stdout:3/396: dwrite d0/d3/f44 [0,4194304] 0 2024-02-15T22:40:48.079 INFO:tasks.workunit.client.0.smithi033.stdout:1/343: dwrite d1/d20/d42/d2c/f31 [0,4194304] 0 2024-02-15T22:40:48.079 INFO:tasks.workunit.client.0.smithi033.stdout:1/344: write d1/de/d27/d28/f29 [692451,53120] 0 2024-02-15T22:40:48.079 INFO:tasks.workunit.client.0.smithi033.stdout:3/397: symlink d0/d3/l7b 0 2024-02-15T22:40:48.079 INFO:tasks.workunit.client.0.smithi033.stdout:4/331: write f4 [158328,34658] 0 2024-02-15T22:40:48.079 INFO:tasks.workunit.client.0.smithi033.stdout:3/398: write d0/d3/d2c/d43/f75 [575792,25587] 0 2024-02-15T22:40:48.082 INFO:tasks.workunit.client.0.smithi033.stdout:1/345: mknod d1/d20/d42/d2c/c6c 0 2024-02-15T22:40:48.082 INFO:tasks.workunit.client.0.smithi033.stdout:1/346: dread - d1/de/d27/d28/d37/f66 zero size 2024-02-15T22:40:48.083 INFO:tasks.workunit.client.0.smithi033.stdout:1/347: stat d1/de/d27/d28/d37/f3e 0 2024-02-15T22:40:48.083 INFO:tasks.workunit.client.0.smithi033.stdout:1/348: dread - d1/d20/d42/d25/f60 zero size 2024-02-15T22:40:48.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/399: truncate d0/d3/dd/f18 623293 0 2024-02-15T22:40:48.088 INFO:tasks.workunit.client.0.smithi033.stdout:6/333: dwrite d12/f18 [4194304,4194304] 0 2024-02-15T22:40:48.091 INFO:tasks.workunit.client.0.smithi033.stdout:6/334: unlink d12/d2c/d30/d1d/c59 0 2024-02-15T22:40:48.091 INFO:tasks.workunit.client.0.smithi033.stdout:6/335: chown d12/d2c/d30/d1d/f22 854514 1 2024-02-15T22:40:48.094 INFO:tasks.workunit.client.0.smithi033.stdout:6/336: mknod d12/d2c/d30/d1d/c71 0 2024-02-15T22:40:48.094 INFO:tasks.workunit.client.0.smithi033.stdout:6/337: write d12/d2c/d30/d1d/d35/f47 [839458,117697] 0 2024-02-15T22:40:48.094 INFO:tasks.workunit.client.0.smithi033.stdout:6/338: creat d12/d2c/d30/f72 x:0 0 0 2024-02-15T22:40:48.096 INFO:tasks.workunit.client.0.smithi033.stdout:4/332: getdents d8/d18/d37/d23/d61 0 2024-02-15T22:40:48.097 INFO:tasks.workunit.client.0.smithi033.stdout:6/339: creat d12/f73 x:0 0 0 2024-02-15T22:40:48.099 INFO:tasks.workunit.client.0.smithi033.stdout:4/333: mkdir d8/d69 0 2024-02-15T22:40:48.099 INFO:tasks.workunit.client.0.smithi033.stdout:3/400: dread d0/f56 [0,4194304] 0 2024-02-15T22:40:48.099 INFO:tasks.workunit.client.0.smithi033.stdout:3/401: readlink d0/d3/l60 0 2024-02-15T22:40:48.101 INFO:tasks.workunit.client.0.smithi033.stdout:4/334: creat d8/d18/d37/d23/d61/f6a x:0 0 0 2024-02-15T22:40:48.101 INFO:tasks.workunit.client.0.smithi033.stdout:4/335: write d8/d18/f68 [312983,13490] 0 2024-02-15T22:40:48.101 INFO:tasks.workunit.client.0.smithi033.stdout:4/336: read - d8/d18/d37/d23/f5b zero size 2024-02-15T22:40:48.101 INFO:tasks.workunit.client.0.smithi033.stdout:6/340: dread d12/d2c/d30/d19/f26 [0,4194304] 0 2024-02-15T22:40:48.101 INFO:tasks.workunit.client.0.smithi033.stdout:6/341: dread - d12/d2c/d30/f72 zero size 2024-02-15T22:40:48.102 INFO:tasks.workunit.client.0.smithi033.stdout:3/402: mknod d0/d3/dd/c7c 0 2024-02-15T22:40:48.104 INFO:tasks.workunit.client.0.smithi033.stdout:4/337: creat d8/d16/d51/d1c/d3c/d49/f6b x:0 0 0 2024-02-15T22:40:48.106 INFO:tasks.workunit.client.0.smithi033.stdout:6/342: rename d12/d2c/d30/d1d/d35/l64 to d12/d2c/d30/d1d/d35/l74 0 2024-02-15T22:40:48.108 INFO:tasks.workunit.client.0.smithi033.stdout:4/338: creat d8/d16/d51/d1c/f6c x:0 0 0 2024-02-15T22:40:48.109 INFO:tasks.workunit.client.0.smithi033.stdout:6/343: write d12/d2c/d30/d19/f26 [761652,49976] 0 2024-02-15T22:40:48.109 INFO:tasks.workunit.client.0.smithi033.stdout:6/344: write d12/d2c/d30/d19/f67 [604410,7542] 0 2024-02-15T22:40:48.109 INFO:tasks.workunit.client.0.smithi033.stdout:4/339: symlink d8/d16/d45/l6d 0 2024-02-15T22:40:48.110 INFO:tasks.workunit.client.0.smithi033.stdout:6/345: mknod d12/d2c/d30/d1d/d35/c75 0 2024-02-15T22:40:48.113 INFO:tasks.workunit.client.0.smithi033.stdout:4/340: rename d8/d1a/l20 to d8/d18/d37/l6e 0 2024-02-15T22:40:48.113 INFO:tasks.workunit.client.0.smithi033.stdout:4/341: chown d8/d16/d51/c46 3198191 1 2024-02-15T22:40:48.114 INFO:tasks.workunit.client.0.smithi033.stdout:6/346: getdents d12/d3c 0 2024-02-15T22:40:48.116 INFO:tasks.workunit.client.0.smithi033.stdout:4/342: creat d8/d16/d51/d1c/d3c/d3f/f6f x:0 0 0 2024-02-15T22:40:48.116 INFO:tasks.workunit.client.0.smithi033.stdout:4/343: chown d8/d18/d37/d31/f48 3982 1 2024-02-15T22:40:48.116 INFO:tasks.workunit.client.0.smithi033.stdout:4/344: fsync d8/d18/d37/f55 0 2024-02-15T22:40:48.117 INFO:tasks.workunit.client.0.smithi033.stdout:6/347: rename d12/c1e to d12/d2c/d30/c76 0 2024-02-15T22:40:48.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/345: mknod d8/d16/d51/c70 0 2024-02-15T22:40:48.122 INFO:tasks.workunit.client.0.smithi033.stdout:4/346: mkdir d8/d16/d51/d71 0 2024-02-15T22:40:48.122 INFO:tasks.workunit.client.0.smithi033.stdout:3/403: dwrite d0/f36 [0,4194304] 0 2024-02-15T22:40:48.122 INFO:tasks.workunit.client.0.smithi033.stdout:4/347: truncate d8/d16/d51/d1c/f32 2923467 0 2024-02-15T22:40:48.143 INFO:tasks.workunit.client.0.smithi033.stdout:4/348: dwrite d8/d18/d37/d23/d61/f65 [0,4194304] 0 2024-02-15T22:40:48.143 INFO:tasks.workunit.client.0.smithi033.stdout:4/349: write f4 [2916470,22782] 0 2024-02-15T22:40:48.145 INFO:tasks.workunit.client.0.smithi033.stdout:4/350: mknod d8/d16/d51/d1c/c72 0 2024-02-15T22:40:48.145 INFO:tasks.workunit.client.0.smithi033.stdout:3/404: dwrite d0/d1c/f66 [0,4194304] 0 2024-02-15T22:40:48.145 INFO:tasks.workunit.client.0.smithi033.stdout:3/405: fsync d0/d1c/f25 0 2024-02-15T22:40:48.146 INFO:tasks.workunit.client.0.smithi033.stdout:4/351: rename d8/d18/d37/d23/d61/f66 to d8/d16/d45/f73 0 2024-02-15T22:40:48.149 INFO:tasks.workunit.client.0.smithi033.stdout:3/406: mknod d0/d3/d3b/c7d 0 2024-02-15T22:40:48.150 INFO:tasks.workunit.client.0.smithi033.stdout:4/352: symlink d8/d18/d37/d23/d61/l74 0 2024-02-15T22:40:48.150 INFO:tasks.workunit.client.0.smithi033.stdout:4/353: fsync d8/d18/d37/d31/f34 0 2024-02-15T22:40:48.151 INFO:tasks.workunit.client.0.smithi033.stdout:4/354: mkdir d8/d16/d51/d1c/d3c/d3f/d75 0 2024-02-15T22:40:48.154 INFO:tasks.workunit.client.0.smithi033.stdout:3/407: dread d0/f1f [0,4194304] 0 2024-02-15T22:40:48.154 INFO:tasks.workunit.client.0.smithi033.stdout:4/355: unlink d8/d18/d37/d31/f3e 0 2024-02-15T22:40:48.156 INFO:tasks.workunit.client.0.smithi033.stdout:3/408: rename d0/d3/dd/f6d to d0/d3/dd/f7e 0 2024-02-15T22:40:48.158 INFO:tasks.workunit.client.0.smithi033.stdout:4/356: rename d8/d18/d37/d23/d61/f6a to d8/d18/d37/d23/d61/f76 0 2024-02-15T22:40:48.159 INFO:tasks.workunit.client.0.smithi033.stdout:4/357: mkdir d8/d16/d51/d77 0 2024-02-15T22:40:48.162 INFO:tasks.workunit.client.0.smithi033.stdout:3/409: read d0/d3/d2c/f2f [2713350,15202] 0 2024-02-15T22:40:48.170 INFO:tasks.workunit.client.0.smithi033.stdout:4/358: dread d8/d16/d45/f73 [0,4194304] 0 2024-02-15T22:40:48.170 INFO:tasks.workunit.client.0.smithi033.stdout:4/359: fsync d8/d18/d37/f55 0 2024-02-15T22:40:48.172 INFO:tasks.workunit.client.0.smithi033.stdout:4/360: getdents d8 0 2024-02-15T22:40:48.172 INFO:tasks.workunit.client.0.smithi033.stdout:4/361: truncate d8/d16/d51/d27/f5e 654093 0 2024-02-15T22:40:48.173 INFO:tasks.workunit.client.0.smithi033.stdout:4/362: symlink d8/d16/d51/d1c/d50/l78 0 2024-02-15T22:40:48.174 INFO:tasks.workunit.client.0.smithi033.stdout:4/363: symlink d8/d16/d51/d1c/d3c/d3f/l79 0 2024-02-15T22:40:48.175 INFO:tasks.workunit.client.0.smithi033.stdout:4/364: mknod d8/d16/d51/d77/c7a 0 2024-02-15T22:40:48.175 INFO:tasks.workunit.client.0.smithi033.stdout:4/365: chown d8/d16/c67 1969 1 2024-02-15T22:40:48.176 INFO:tasks.workunit.client.0.smithi033.stdout:4/366: mknod d8/d16/d51/d1c/d3c/d3f/c7b 0 2024-02-15T22:40:48.176 INFO:tasks.workunit.client.0.smithi033.stdout:4/367: chown d8/d16/d45/l6d 100456 1 2024-02-15T22:40:48.181 INFO:tasks.workunit.client.0.smithi033.stdout:4/368: dread d8/d16/d51/d1c/d3c/d49/f62 [0,4194304] 0 2024-02-15T22:40:48.181 INFO:tasks.workunit.client.0.smithi033.stdout:3/410: dwrite d0/d1c/f6b [0,4194304] 0 2024-02-15T22:40:48.185 INFO:tasks.workunit.client.0.smithi033.stdout:4/369: truncate d8/d18/d37/f55 479444 0 2024-02-15T22:40:48.187 INFO:tasks.workunit.client.0.smithi033.stdout:4/370: link d8/d16/l3a d8/d16/d51/d1c/d3c/d49/l7c 0 2024-02-15T22:40:48.189 INFO:tasks.workunit.client.0.smithi033.stdout:4/371: mknod d8/d16/d51/d1c/d3c/d3f/c7d 0 2024-02-15T22:40:48.189 INFO:tasks.workunit.client.0.smithi033.stdout:4/372: read d8/d16/d51/d1c/d3c/f4d [3243123,80277] 0 2024-02-15T22:40:48.189 INFO:tasks.workunit.client.0.smithi033.stdout:4/373: chown f4 674717 1 2024-02-15T22:40:48.197 INFO:tasks.workunit.client.0.smithi033.stdout:3/411: dwrite d0/f53 [0,4194304] 0 2024-02-15T22:40:48.197 INFO:tasks.workunit.client.0.smithi033.stdout:3/412: write d0/f56 [3742189,87602] 0 2024-02-15T22:40:48.199 INFO:tasks.workunit.client.0.smithi033.stdout:4/374: dread d8/d18/d37/d23/f30 [0,4194304] 0 2024-02-15T22:40:48.199 INFO:tasks.workunit.client.0.smithi033.stdout:4/375: creat d8/d16/d51/d1c/f7e x:0 0 0 2024-02-15T22:40:48.203 INFO:tasks.workunit.client.0.smithi033.stdout:4/376: mknod d8/d16/d51/d1c/d3c/c7f 0 2024-02-15T22:40:48.204 INFO:tasks.workunit.client.0.smithi033.stdout:4/377: mkdir d8/d18/d37/d31/d80 0 2024-02-15T22:40:48.204 INFO:tasks.workunit.client.0.smithi033.stdout:4/378: chown d8/d16/f4e 30507 1 2024-02-15T22:40:48.205 INFO:tasks.workunit.client.0.smithi033.stdout:4/379: creat d8/d16/d4f/f81 x:0 0 0 2024-02-15T22:40:48.205 INFO:tasks.workunit.client.0.smithi033.stdout:4/380: dread - d8/d18/d37/d23/f5b zero size 2024-02-15T22:40:48.219 INFO:tasks.workunit.client.0.smithi033.stdout:3/413: dwrite d0/d3/dd/f7e [0,4194304] 0 2024-02-15T22:40:48.219 INFO:tasks.workunit.client.0.smithi033.stdout:3/414: write d0/d3/f44 [5004372,116529] 0 2024-02-15T22:40:48.233 INFO:tasks.workunit.client.0.smithi033.stdout:3/415: write d0/d3/d3b/f71 [3736215,47968] 0 2024-02-15T22:40:48.242 INFO:tasks.workunit.client.0.smithi033.stdout:3/416: read d0/d1c/f66 [3238682,49680] 0 2024-02-15T22:40:48.243 INFO:tasks.workunit.client.0.smithi033.stdout:3/417: symlink d0/d3/d2c/d5d/d3d/l7f 0 2024-02-15T22:40:48.282 INFO:tasks.workunit.client.0.smithi033.stdout:4/381: dwrite f5 [0,4194304] 0 2024-02-15T22:40:48.283 INFO:tasks.workunit.client.0.smithi033.stdout:4/382: truncate d8/d16/d51/d1c/f7e 462255 0 2024-02-15T22:40:48.283 INFO:tasks.workunit.client.0.smithi033.stdout:4/383: mknod d8/d16/d4f/c82 0 2024-02-15T22:40:48.284 INFO:tasks.workunit.client.0.smithi033.stdout:4/384: link d8/d16/d51/d1c/d3c/d49/f62 d8/d18/d37/d31/f83 0 2024-02-15T22:40:48.284 INFO:tasks.workunit.client.0.smithi033.stdout:4/385: readlink d8/d16/d51/d1c/d50/l78 0 2024-02-15T22:40:48.285 INFO:tasks.workunit.client.0.smithi033.stdout:4/386: link d8/d16/d51/c70 d8/d18/d37/d31/d47/c84 0 2024-02-15T22:40:48.286 INFO:tasks.workunit.client.0.smithi033.stdout:4/387: stat d8/d16/d51/d1c/d3c/d49/l7c 0 2024-02-15T22:40:48.287 INFO:tasks.workunit.client.0.smithi033.stdout:4/388: dread d8/d18/f68 [0,4194304] 0 2024-02-15T22:40:48.310 INFO:tasks.workunit.client.0.smithi033.stdout:3/418: dread d0/d1c/f25 [0,4194304] 0 2024-02-15T22:40:48.311 INFO:tasks.workunit.client.0.smithi033.stdout:3/419: creat d0/d3/d3b/d47/f80 x:0 0 0 2024-02-15T22:40:48.313 INFO:tasks.workunit.client.0.smithi033.stdout:3/420: symlink d0/d3/d2c/d5d/d3d/d57/d74/l81 0 2024-02-15T22:40:48.313 INFO:tasks.workunit.client.0.smithi033.stdout:4/389: dwrite d8/d16/d51/d27/f5c [0,4194304] 0 2024-02-15T22:40:48.313 INFO:tasks.workunit.client.0.smithi033.stdout:4/390: write f5 [4809941,111331] 0 2024-02-15T22:40:48.314 INFO:tasks.workunit.client.0.smithi033.stdout:4/391: fsync d8/d16/d51/d1c/d3c/f4d 0 2024-02-15T22:40:48.323 INFO:tasks.workunit.client.0.smithi033.stdout:3/421: dread d0/d1c/f6b [0,4194304] 0 2024-02-15T22:40:48.324 INFO:tasks.workunit.client.0.smithi033.stdout:3/422: truncate d0/d3/d2c/d43/f75 229424 0 2024-02-15T22:40:48.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/423: write d0/f1f [2918261,13131] 0 2024-02-15T22:40:48.332 INFO:tasks.workunit.client.0.smithi033.stdout:3/424: write d0/d3/dd/f7e [1381249,57708] 0 2024-02-15T22:40:48.332 INFO:tasks.workunit.client.0.smithi033.stdout:3/425: readlink d0/l2e 0 2024-02-15T22:40:48.348 INFO:tasks.workunit.client.0.smithi033.stdout:3/426: dwrite d0/d3/d2c/d43/f61 [0,4194304] 0 2024-02-15T22:40:48.350 INFO:tasks.workunit.client.0.smithi033.stdout:3/427: unlink d0/d1c/c3f 0 2024-02-15T22:40:48.350 INFO:tasks.workunit.client.0.smithi033.stdout:3/428: fdatasync d0/d1c/f67 0 2024-02-15T22:40:48.351 INFO:tasks.workunit.client.0.smithi033.stdout:3/429: read d0/d1c/f59 [33232,21389] 0 2024-02-15T22:40:48.357 INFO:tasks.workunit.client.0.smithi033.stdout:3/430: write d0/f53 [1824933,53580] 0 2024-02-15T22:40:48.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/431: dread d0/d3/dd/f18 [0,4194304] 0 2024-02-15T22:40:48.360 INFO:tasks.workunit.client.0.smithi033.stdout:3/432: mkdir d0/d3/d2c/d5d/d3d/d82 0 2024-02-15T22:40:48.360 INFO:tasks.workunit.client.0.smithi033.stdout:3/433: symlink d0/d3/d5f/l83 0 2024-02-15T22:40:48.362 INFO:tasks.workunit.client.0.smithi033.stdout:3/434: fdatasync d0/f1f 0 2024-02-15T22:40:48.362 INFO:tasks.workunit.client.0.smithi033.stdout:3/435: creat d0/d3/d3b/d47/f84 x:0 0 0 2024-02-15T22:40:48.362 INFO:tasks.workunit.client.0.smithi033.stdout:3/436: write d0/d3/dd/f7e [3375772,89706] 0 2024-02-15T22:40:48.363 INFO:tasks.workunit.client.0.smithi033.stdout:3/437: symlink d0/d3/d2c/d5d/d3d/d82/l85 0 2024-02-15T22:40:48.364 INFO:tasks.workunit.client.0.smithi033.stdout:3/438: creat d0/d3/f86 x:0 0 0 2024-02-15T22:40:48.365 INFO:tasks.workunit.client.0.smithi033.stdout:3/439: mknod d0/d3/d2c/d5d/d3d/d82/c87 0 2024-02-15T22:40:48.367 INFO:tasks.workunit.client.0.smithi033.stdout:3/440: link d0/d3/d2c/f34 d0/d1c/f88 0 2024-02-15T22:40:48.369 INFO:tasks.workunit.client.0.smithi033.stdout:3/441: unlink d0/d3/d2c/d5d/l79 0 2024-02-15T22:40:48.387 INFO:tasks.workunit.client.0.smithi033.stdout:3/442: dwrite d0/f53 [0,4194304] 0 2024-02-15T22:40:48.389 INFO:tasks.workunit.client.0.smithi033.stdout:3/443: creat d0/d3/d3b/f89 x:0 0 0 2024-02-15T22:40:48.389 INFO:tasks.workunit.client.0.smithi033.stdout:3/444: chown d0/d1c/f67 7610720 1 2024-02-15T22:40:48.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/445: rename d0/d3/l60 to d0/d3/d3b/d47/l8a 0 2024-02-15T22:40:48.392 INFO:tasks.workunit.client.0.smithi033.stdout:3/446: rename d0/d1c/l6c to d0/d3/d2c/d43/l8b 0 2024-02-15T22:40:48.456 INFO:tasks.workunit.client.0.smithi033.stdout:3/447: mkdir d0/d8c 0 2024-02-15T22:40:48.458 INFO:tasks.workunit.client.0.smithi033.stdout:3/448: mknod d0/d3/c8d 0 2024-02-15T22:40:48.460 INFO:tasks.workunit.client.0.smithi033.stdout:3/449: creat d0/d3/d65/f8e x:0 0 0 2024-02-15T22:40:48.469 INFO:tasks.workunit.client.0.smithi033.stdout:3/450: rmdir d0 39 2024-02-15T22:40:48.470 INFO:tasks.workunit.client.0.smithi033.stdout:3/451: mkdir d0/d3/d2c/d5d/d3d/d8f 0 2024-02-15T22:40:48.471 INFO:tasks.workunit.client.0.smithi033.stdout:3/452: symlink d0/d3/d2c/d5d/d3d/d57/d68/l90 0 2024-02-15T22:40:48.471 INFO:tasks.workunit.client.0.smithi033.stdout:3/453: mkdir d0/d91 0 2024-02-15T22:40:48.472 INFO:tasks.workunit.client.0.smithi033.stdout:3/454: mkdir d0/d3/d92 0 2024-02-15T22:40:48.472 INFO:tasks.workunit.client.0.smithi033.stdout:3/455: write d0/f1f [2807341,113715] 0 2024-02-15T22:40:48.492 INFO:tasks.workunit.client.0.smithi033.stdout:3/456: dwrite d0/d1c/f29 [4194304,4194304] 0 2024-02-15T22:40:48.492 INFO:tasks.workunit.client.0.smithi033.stdout:3/457: chown d0/d1c 3 1 2024-02-15T22:40:48.494 INFO:tasks.workunit.client.0.smithi033.stdout:3/458: unlink d0/d3/d2c/d5d/d3d/d57/d68/l90 0 2024-02-15T22:40:48.511 INFO:tasks.workunit.client.0.smithi033.stdout:0/371: sync 2024-02-15T22:40:48.512 INFO:tasks.workunit.client.0.smithi033.stdout:0/372: truncate db/d19/f3f 3117173 0 2024-02-15T22:40:48.513 INFO:tasks.workunit.client.0.smithi033.stdout:0/373: chown db/d2a/d6c 169 1 2024-02-15T22:40:48.532 INFO:tasks.workunit.client.0.smithi033.stdout:0/374: dwrite db/d19/d32/d46/f4f [0,4194304] 0 2024-02-15T22:40:48.547 INFO:tasks.workunit.client.0.smithi033.stdout:0/375: dwrite db/f63 [0,4194304] 0 2024-02-15T22:40:48.548 INFO:tasks.workunit.client.0.smithi033.stdout:0/376: chown db/d19/f1e 66240 1 2024-02-15T22:40:48.548 INFO:tasks.workunit.client.0.smithi033.stdout:0/377: truncate db/d19/f34 454481 0 2024-02-15T22:40:48.560 INFO:tasks.workunit.client.0.smithi033.stdout:0/378: dwrite db/d19/f21 [0,4194304] 0 2024-02-15T22:40:48.560 INFO:tasks.workunit.client.0.smithi033.stdout:0/379: truncate db/d19/d32/f3c 1623707 0 2024-02-15T22:40:48.561 INFO:tasks.workunit.client.0.smithi033.stdout:0/380: mknod db/d2a/d6e/c79 0 2024-02-15T22:40:48.562 INFO:tasks.workunit.client.0.smithi033.stdout:0/381: mkdir db/d2a/d6e/d7a 0 2024-02-15T22:40:48.562 INFO:tasks.workunit.client.0.smithi033.stdout:0/382: write db/d19/d32/d3d/f45 [686234,79350] 0 2024-02-15T22:40:48.562 INFO:tasks.workunit.client.0.smithi033.stdout:0/383: write db/d19/d32/d3d/f74 [911320,100155] 0 2024-02-15T22:40:48.563 INFO:tasks.workunit.client.0.smithi033.stdout:0/384: symlink db/d19/l7b 0 2024-02-15T22:40:48.563 INFO:tasks.workunit.client.0.smithi033.stdout:0/385: creat db/d2a/d6e/f7c x:0 0 0 2024-02-15T22:40:48.627 INFO:tasks.workunit.client.0.smithi033.stdout:5/455: sync 2024-02-15T22:40:48.627 INFO:tasks.workunit.client.0.smithi033.stdout:5/456: write d6/d14/d31/d48/d59/f54 [5228319,91329] 0 2024-02-15T22:40:48.628 INFO:tasks.workunit.client.0.smithi033.stdout:5/457: mknod d6/d14/d31/d48/d56/d90/c93 0 2024-02-15T22:40:48.628 INFO:tasks.workunit.client.0.smithi033.stdout:5/458: dread - d6/d14/d31/d64/f8a zero size 2024-02-15T22:40:48.628 INFO:tasks.workunit.client.0.smithi033.stdout:5/459: creat d6/d14/d43/f94 x:0 0 0 2024-02-15T22:40:48.630 INFO:tasks.workunit.client.0.smithi033.stdout:5/460: mknod d6/d25/c95 0 2024-02-15T22:40:48.648 INFO:tasks.workunit.client.0.smithi033.stdout:5/461: dwrite d6/ff [0,4194304] 0 2024-02-15T22:40:48.650 INFO:tasks.workunit.client.0.smithi033.stdout:5/462: dread d6/f10 [4194304,4194304] 0 2024-02-15T22:40:48.652 INFO:tasks.workunit.client.0.smithi033.stdout:5/463: rename d6/d14/d31/f37 to d6/d14/f96 0 2024-02-15T22:40:48.652 INFO:tasks.workunit.client.0.smithi033.stdout:5/464: creat d6/d14/d31/d50/d5c/f97 x:0 0 0 2024-02-15T22:40:48.654 INFO:tasks.workunit.client.0.smithi033.stdout:5/465: getdents d6/d14/d31/d48/d56 0 2024-02-15T22:40:48.656 INFO:tasks.workunit.client.0.smithi033.stdout:5/466: unlink d6/ff 0 2024-02-15T22:40:48.656 INFO:tasks.workunit.client.0.smithi033.stdout:5/467: readlink d6/d14/d31/d48/d59/l62 0 2024-02-15T22:40:48.672 INFO:tasks.workunit.client.0.smithi033.stdout:5/468: dwrite d6/d14/d31/d48/f69 [0,4194304] 0 2024-02-15T22:40:48.685 INFO:tasks.workunit.client.0.smithi033.stdout:9/309: sync 2024-02-15T22:40:48.686 INFO:tasks.workunit.client.0.smithi033.stdout:8/276: sync 2024-02-15T22:40:48.686 INFO:tasks.workunit.client.0.smithi033.stdout:8/277: mknod d1/df/d1d/d4a/c67 0 2024-02-15T22:40:48.687 INFO:tasks.workunit.client.0.smithi033.stdout:5/469: dwrite d6/d14/d31/d50/d5c/f97 [0,4194304] 0 2024-02-15T22:40:48.694 INFO:tasks.workunit.client.0.smithi033.stdout:9/310: write d4/f43 [823174,54998] 0 2024-02-15T22:40:48.694 INFO:tasks.workunit.client.0.smithi033.stdout:8/278: rename d1/df to d1/d68 0 2024-02-15T22:40:48.694 INFO:tasks.workunit.client.0.smithi033.stdout:9/311: creat d4/d1d/d23/d32/d3e/f56 x:0 0 0 2024-02-15T22:40:48.694 INFO:tasks.workunit.client.0.smithi033.stdout:9/312: write d4/d1d/d23/d32/d3e/f56 [177112,96703] 0 2024-02-15T22:40:48.694 INFO:tasks.workunit.client.0.smithi033.stdout:9/313: chown f2 271487949 1 2024-02-15T22:40:48.695 INFO:tasks.workunit.client.0.smithi033.stdout:8/279: write d1/d68/d1d/f35 [4622343,7023] 0 2024-02-15T22:40:48.696 INFO:tasks.workunit.client.0.smithi033.stdout:8/280: dread d1/de/d1a/f20 [0,4194304] 0 2024-02-15T22:40:48.696 INFO:tasks.workunit.client.0.smithi033.stdout:8/281: creat d1/de/d1a/f69 x:0 0 0 2024-02-15T22:40:48.696 INFO:tasks.workunit.client.0.smithi033.stdout:8/282: chown d1/d6/d14/d5d 497 1 2024-02-15T22:40:48.696 INFO:tasks.workunit.client.0.smithi033.stdout:8/283: chown d1/d68/d1d/d4a/c67 5073548 1 2024-02-15T22:40:48.702 INFO:tasks.workunit.client.0.smithi033.stdout:8/284: rmdir d1/de/d1a/d2a 39 2024-02-15T22:40:48.702 INFO:tasks.workunit.client.0.smithi033.stdout:8/285: truncate d1/de/f37 680499 0 2024-02-15T22:40:48.702 INFO:tasks.workunit.client.0.smithi033.stdout:8/286: dread - d1/de/d1a/f66 zero size 2024-02-15T22:40:48.702 INFO:tasks.workunit.client.0.smithi033.stdout:8/287: chown d1/d6/c5e 530393512 1 2024-02-15T22:40:48.703 INFO:tasks.workunit.client.0.smithi033.stdout:5/470: getdents d6/d14/d31/d38/d3f/d86 0 2024-02-15T22:40:48.705 INFO:tasks.workunit.client.0.smithi033.stdout:5/471: rename d6/c27 to d6/d14/d31/d48/d59/c98 0 2024-02-15T22:40:48.707 INFO:tasks.workunit.client.0.smithi033.stdout:5/472: unlink d6/d14/d31/d48/c58 0 2024-02-15T22:40:48.707 INFO:tasks.workunit.client.0.smithi033.stdout:8/288: dread d1/f10 [0,4194304] 0 2024-02-15T22:40:48.708 INFO:tasks.workunit.client.0.smithi033.stdout:9/314: dwrite d4/fc [4194304,4194304] 0 2024-02-15T22:40:48.708 INFO:tasks.workunit.client.0.smithi033.stdout:9/315: write d4/d1d/f4c [415697,69778] 0 2024-02-15T22:40:48.728 INFO:tasks.workunit.client.0.smithi033.stdout:9/316: dwrite d4/f16 [0,4194304] 0 2024-02-15T22:40:48.728 INFO:tasks.workunit.client.0.smithi033.stdout:8/289: dwrite d1/de/d13/f29 [0,4194304] 0 2024-02-15T22:40:48.729 INFO:tasks.workunit.client.0.smithi033.stdout:8/290: dread d1/de/d1a/d27/d55/f59 [0,4194304] 0 2024-02-15T22:40:48.729 INFO:tasks.workunit.client.0.smithi033.stdout:8/291: write d1/de/d1a/d2a/f3b [844956,70270] 0 2024-02-15T22:40:48.734 INFO:tasks.workunit.client.0.smithi033.stdout:8/292: unlink d1/f10 0 2024-02-15T22:40:48.736 INFO:tasks.workunit.client.0.smithi033.stdout:8/293: mknod d1/de/d1a/d27/d55/c6a 0 2024-02-15T22:40:48.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/317: dread d4/d1d/d23/d24/f2b [0,4194304] 0 2024-02-15T22:40:48.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/294: dread d1/de/d1a/d2a/f3c [0,4194304] 0 2024-02-15T22:40:48.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/295: chown d1/de/d1a/f69 141662 1 2024-02-15T22:40:48.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/296: rmdir d1/d68/d2e 39 2024-02-15T22:40:48.748 INFO:tasks.workunit.client.0.smithi033.stdout:8/297: rename d1/de/d1a/d2a/f51 to d1/d68/d1d/d4a/f6b 0 2024-02-15T22:40:48.748 INFO:tasks.workunit.client.0.smithi033.stdout:8/298: dread d1/de/d1a/d2a/f30 [0,4194304] 0 2024-02-15T22:40:48.750 INFO:tasks.workunit.client.0.smithi033.stdout:8/299: unlink d1/d6/cd 0 2024-02-15T22:40:48.750 INFO:tasks.workunit.client.0.smithi033.stdout:8/300: chown d1/c62 3847 1 2024-02-15T22:40:48.751 INFO:tasks.workunit.client.0.smithi033.stdout:8/301: unlink d1/d68/d1d/d4a/d4c/c4f 0 2024-02-15T22:40:48.751 INFO:tasks.workunit.client.0.smithi033.stdout:8/302: chown d1/d68/d57 633354339 1 2024-02-15T22:40:48.751 INFO:tasks.workunit.client.0.smithi033.stdout:8/303: chown d1/d68/d1d/f35 7372719 1 2024-02-15T22:40:48.752 INFO:tasks.workunit.client.0.smithi033.stdout:9/318: dwrite d4/d1d/d23/d32/f4f [0,4194304] 0 2024-02-15T22:40:48.752 INFO:tasks.workunit.client.0.smithi033.stdout:9/319: dread - d4/d1d/d42/f4e zero size 2024-02-15T22:40:48.752 INFO:tasks.workunit.client.0.smithi033.stdout:9/320: fdatasync d4/d1d/f21 0 2024-02-15T22:40:48.752 INFO:tasks.workunit.client.0.smithi033.stdout:9/321: chown d4/fc 233580667 1 2024-02-15T22:40:48.752 INFO:tasks.workunit.client.0.smithi033.stdout:8/304: creat d1/d6/f6c x:0 0 0 2024-02-15T22:40:48.754 INFO:tasks.workunit.client.0.smithi033.stdout:8/305: link d1/de/d1a/f20 d1/de/d5c/f6d 0 2024-02-15T22:40:48.754 INFO:tasks.workunit.client.0.smithi033.stdout:8/306: creat d1/de/d1a/f6e x:0 0 0 2024-02-15T22:40:48.754 INFO:tasks.workunit.client.0.smithi033.stdout:8/307: readlink d1/d6/l38 0 2024-02-15T22:40:48.757 INFO:tasks.workunit.client.0.smithi033.stdout:8/308: creat d1/de/d1a/d2a/f6f x:0 0 0 2024-02-15T22:40:48.758 INFO:tasks.workunit.client.0.smithi033.stdout:8/309: dread d1/de/d1a/f20 [0,4194304] 0 2024-02-15T22:40:48.758 INFO:tasks.workunit.client.0.smithi033.stdout:8/310: stat d1/d68/d44 0 2024-02-15T22:40:48.760 INFO:tasks.workunit.client.0.smithi033.stdout:8/311: mkdir d1/de/d1a/d27/d70 0 2024-02-15T22:40:48.760 INFO:tasks.workunit.client.0.smithi033.stdout:8/312: creat d1/d36/f71 x:0 0 0 2024-02-15T22:40:48.762 INFO:tasks.workunit.client.0.smithi033.stdout:8/313: mkdir d1/d6/d14/d5d/d72 0 2024-02-15T22:40:48.763 INFO:tasks.workunit.client.0.smithi033.stdout:8/314: unlink d1/l2d 0 2024-02-15T22:40:48.763 INFO:tasks.workunit.client.0.smithi033.stdout:8/315: symlink d1/d6/d14/d5d/d72/l73 0 2024-02-15T22:40:48.764 INFO:tasks.workunit.client.0.smithi033.stdout:8/316: dread - d1/de/d1a/f66 zero size 2024-02-15T22:40:48.764 INFO:tasks.workunit.client.0.smithi033.stdout:8/317: mkdir d1/d74 0 2024-02-15T22:40:48.765 INFO:tasks.workunit.client.0.smithi033.stdout:8/318: unlink d1/de/f61 0 2024-02-15T22:40:48.770 INFO:tasks.workunit.client.0.smithi033.stdout:1/349: sync 2024-02-15T22:40:48.770 INFO:tasks.workunit.client.0.smithi033.stdout:6/348: sync 2024-02-15T22:40:48.770 INFO:tasks.workunit.client.0.smithi033.stdout:4/392: sync 2024-02-15T22:40:48.770 INFO:tasks.workunit.client.0.smithi033.stdout:7/389: sync 2024-02-15T22:40:48.770 INFO:tasks.workunit.client.0.smithi033.stdout:2/387: sync 2024-02-15T22:40:48.770 INFO:tasks.workunit.client.0.smithi033.stdout:3/459: sync 2024-02-15T22:40:48.771 INFO:tasks.workunit.client.0.smithi033.stdout:4/393: dread - d8/d16/d4f/f81 zero size 2024-02-15T22:40:48.771 INFO:tasks.workunit.client.0.smithi033.stdout:0/386: sync 2024-02-15T22:40:48.771 INFO:tasks.workunit.client.0.smithi033.stdout:3/460: getdents d0/d3/d2c/d5d/d3d/d82 0 2024-02-15T22:40:48.771 INFO:tasks.workunit.client.0.smithi033.stdout:3/461: fsync d0/fe 0 2024-02-15T22:40:48.771 INFO:tasks.workunit.client.0.smithi033.stdout:3/462: fdatasync d0/d1c/f66 0 2024-02-15T22:40:48.774 INFO:tasks.workunit.client.0.smithi033.stdout:4/394: mkdir d8/d18/d37/d31/d47/d85 0 2024-02-15T22:40:48.775 INFO:tasks.workunit.client.0.smithi033.stdout:1/350: dread d1/d20/d42/f49 [0,4194304] 0 2024-02-15T22:40:48.776 INFO:tasks.workunit.client.0.smithi033.stdout:2/388: dread d1/d8/d2b/d2f/d38/f5c [0,4194304] 0 2024-02-15T22:40:48.778 INFO:tasks.workunit.client.0.smithi033.stdout:1/351: symlink d1/d20/d42/l6d 0 2024-02-15T22:40:48.778 INFO:tasks.workunit.client.0.smithi033.stdout:1/352: stat d1/de/l59 0 2024-02-15T22:40:48.778 INFO:tasks.workunit.client.0.smithi033.stdout:1/353: readlink d1/d20/d42/l2e 0 2024-02-15T22:40:48.778 INFO:tasks.workunit.client.0.smithi033.stdout:1/354: write d1/d20/f65 [909524,39409] 0 2024-02-15T22:40:48.779 INFO:tasks.workunit.client.0.smithi033.stdout:1/355: truncate d1/de/f63 496782 0 2024-02-15T22:40:48.780 INFO:tasks.workunit.client.0.smithi033.stdout:9/322: dwrite d4/f9 [0,4194304] 0 2024-02-15T22:40:48.780 INFO:tasks.workunit.client.0.smithi033.stdout:9/323: write d4/d1d/d23/d35/f50 [67287,90534] 0 2024-02-15T22:40:48.780 INFO:tasks.workunit.client.0.smithi033.stdout:7/390: dread d5/f18 [0,4194304] 0 2024-02-15T22:40:48.781 INFO:tasks.workunit.client.0.smithi033.stdout:2/389: mkdir d1/d8/d2b/d2f/d13/d6f 0 2024-02-15T22:40:48.781 INFO:tasks.workunit.client.0.smithi033.stdout:0/387: getdents db/d19/d32/d46 0 2024-02-15T22:40:48.784 INFO:tasks.workunit.client.0.smithi033.stdout:1/356: symlink d1/de/d27/d28/l6e 0 2024-02-15T22:40:48.784 INFO:tasks.workunit.client.0.smithi033.stdout:1/357: chown d1/de/d27/d28/d2d/d36 1733506 1 2024-02-15T22:40:48.784 INFO:tasks.workunit.client.0.smithi033.stdout:1/358: chown d1/de/l59 17886560 1 2024-02-15T22:40:48.784 INFO:tasks.workunit.client.0.smithi033.stdout:9/324: truncate d4/fe 2305217 0 2024-02-15T22:40:48.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/391: symlink d5/dc/l7e 0 2024-02-15T22:40:48.786 INFO:tasks.workunit.client.0.smithi033.stdout:2/390: getdents d1/d8/d2b/d2f/d24/d5d 0 2024-02-15T22:40:48.786 INFO:tasks.workunit.client.0.smithi033.stdout:2/391: readlink d1/l1f 0 2024-02-15T22:40:48.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/388: mkdir db/d19/d32/d43/d7d 0 2024-02-15T22:40:48.789 INFO:tasks.workunit.client.0.smithi033.stdout:7/392: mkdir d5/df/d56/d7f 0 2024-02-15T22:40:48.789 INFO:tasks.workunit.client.0.smithi033.stdout:7/393: read d5/d6/f7 [946876,92952] 0 2024-02-15T22:40:48.791 INFO:tasks.workunit.client.0.smithi033.stdout:2/392: rename d1/d8/d2b/d2f/d12/f15 to d1/d16/d5a/d67/f70 0 2024-02-15T22:40:48.792 INFO:tasks.workunit.client.0.smithi033.stdout:2/393: chown d1 3956013 1 2024-02-15T22:40:48.793 INFO:tasks.workunit.client.0.smithi033.stdout:0/389: symlink db/d19/d32/d46/l7e 0 2024-02-15T22:40:48.793 INFO:tasks.workunit.client.0.smithi033.stdout:0/390: chown db/d19/f21 133341 1 2024-02-15T22:40:48.794 INFO:tasks.workunit.client.0.smithi033.stdout:7/394: mknod d5/df/d40/c80 0 2024-02-15T22:40:48.794 INFO:tasks.workunit.client.0.smithi033.stdout:7/395: dread - d5/df/d56/d60/d59/f62 zero size 2024-02-15T22:40:48.794 INFO:tasks.workunit.client.0.smithi033.stdout:7/396: write d5/df/d56/f6c [3127582,40574] 0 2024-02-15T22:40:48.794 INFO:tasks.workunit.client.0.smithi033.stdout:2/394: mknod d1/d16/d57/c71 0 2024-02-15T22:40:48.796 INFO:tasks.workunit.client.0.smithi033.stdout:0/391: symlink db/d2a/d6e/d7a/l7f 0 2024-02-15T22:40:48.796 INFO:tasks.workunit.client.0.smithi033.stdout:3/463: dwrite d0/d3/d2c/d43/f45 [0,4194304] 0 2024-02-15T22:40:48.796 INFO:tasks.workunit.client.0.smithi033.stdout:3/464: stat d0/d3/d3b 0 2024-02-15T22:40:48.796 INFO:tasks.workunit.client.0.smithi033.stdout:8/319: dwrite d1/de/d1a/d27/d55/f59 [0,4194304] 0 2024-02-15T22:40:48.796 INFO:tasks.workunit.client.0.smithi033.stdout:8/320: write d1/de/d13/f4d [4421171,119771] 0 2024-02-15T22:40:48.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/395: dwrite d8/d16/d51/d1c/f32 [0,4194304] 0 2024-02-15T22:40:48.798 INFO:tasks.workunit.client.0.smithi033.stdout:7/397: mkdir d5/df/d40/d81 0 2024-02-15T22:40:48.800 INFO:tasks.workunit.client.0.smithi033.stdout:2/395: truncate d1/d8/d2b/d2f/d13/f1c 1394787 0 2024-02-15T22:40:48.800 INFO:tasks.workunit.client.0.smithi033.stdout:9/325: dread d4/d1d/d23/d35/f50 [0,4194304] 0 2024-02-15T22:40:48.804 INFO:tasks.workunit.client.0.smithi033.stdout:3/465: mkdir d0/d3/d2c/d5d/d3d/d8f/d93 0 2024-02-15T22:40:48.805 INFO:tasks.workunit.client.0.smithi033.stdout:3/466: write d0/d3/f40 [2880105,87512] 0 2024-02-15T22:40:48.809 INFO:tasks.workunit.client.0.smithi033.stdout:8/321: unlink d1/de/d13/f4d 0 2024-02-15T22:40:48.810 INFO:tasks.workunit.client.0.smithi033.stdout:4/396: creat d8/d16/d51/f86 x:0 0 0 2024-02-15T22:40:48.811 INFO:tasks.workunit.client.0.smithi033.stdout:7/398: symlink d5/l82 0 2024-02-15T22:40:48.811 INFO:tasks.workunit.client.0.smithi033.stdout:7/399: read d5/dc/d5f/f75 [31304,45346] 0 2024-02-15T22:40:48.812 INFO:tasks.workunit.client.0.smithi033.stdout:2/396: mknod d1/d8/d34/c72 0 2024-02-15T22:40:48.815 INFO:tasks.workunit.client.0.smithi033.stdout:9/326: unlink d4/f13 0 2024-02-15T22:40:48.815 INFO:tasks.workunit.client.0.smithi033.stdout:9/327: chown d4/d1d/f52 164378 1 2024-02-15T22:40:48.815 INFO:tasks.workunit.client.0.smithi033.stdout:9/328: readlink d4/d1d/d23/d35/d38/l48 0 2024-02-15T22:40:48.816 INFO:tasks.workunit.client.0.smithi033.stdout:0/392: getdents db/d19 0 2024-02-15T22:40:48.818 INFO:tasks.workunit.client.0.smithi033.stdout:3/467: symlink d0/d3/d2c/d5d/d3d/d57/d74/l94 0 2024-02-15T22:40:48.819 INFO:tasks.workunit.client.0.smithi033.stdout:0/393: dread db/d19/d32/d3d/f45 [0,4194304] 0 2024-02-15T22:40:48.820 INFO:tasks.workunit.client.0.smithi033.stdout:8/322: mkdir d1/de/d13/d75 0 2024-02-15T22:40:48.823 INFO:tasks.workunit.client.0.smithi033.stdout:4/397: creat d8/d1a/f87 x:0 0 0 2024-02-15T22:40:48.823 INFO:tasks.workunit.client.0.smithi033.stdout:4/398: write d8/d18/f68 [341133,51052] 0 2024-02-15T22:40:48.823 INFO:tasks.workunit.client.0.smithi033.stdout:4/399: dread - d8/d18/d37/d23/d61/f76 zero size 2024-02-15T22:40:48.825 INFO:tasks.workunit.client.0.smithi033.stdout:2/397: rename d1/d8/d2b/d2f/d38/c3c to d1/d8/d2b/d2f/d13/d6f/c73 0 2024-02-15T22:40:48.828 INFO:tasks.workunit.client.0.smithi033.stdout:3/468: link d0/d3/d2c/d5d/d3d/d57/d74/l94 d0/d3/d77/l95 0 2024-02-15T22:40:48.828 INFO:tasks.workunit.client.0.smithi033.stdout:3/469: chown d0/d3/d2c/d5d/d3d/l7f 14572465 1 2024-02-15T22:40:48.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/329: write d4/d1d/d23/d24/f25 [2811291,60784] 0 2024-02-15T22:40:48.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/330: creat d4/d1d/f57 x:0 0 0 2024-02-15T22:40:48.830 INFO:tasks.workunit.client.0.smithi033.stdout:8/323: dread d1/de/d1a/d2a/f3c [0,4194304] 0 2024-02-15T22:40:48.834 INFO:tasks.workunit.client.0.smithi033.stdout:4/400: symlink d8/d16/d45/l88 0 2024-02-15T22:40:48.836 INFO:tasks.workunit.client.0.smithi033.stdout:2/398: link d1/d50/c4c d1/d8/d2b/d2f/d24/c74 0 2024-02-15T22:40:48.837 INFO:tasks.workunit.client.0.smithi033.stdout:2/399: write d1/d8/d2b/d2f/fb [12806880,77313] 0 2024-02-15T22:40:48.842 INFO:tasks.workunit.client.0.smithi033.stdout:7/400: dwrite d5/f19 [0,4194304] 0 2024-02-15T22:40:48.845 INFO:tasks.workunit.client.0.smithi033.stdout:3/470: dwrite d0/f53 [0,4194304] 0 2024-02-15T22:40:48.846 INFO:tasks.workunit.client.0.smithi033.stdout:4/401: dread f4 [0,4194304] 0 2024-02-15T22:40:48.846 INFO:tasks.workunit.client.0.smithi033.stdout:9/331: read d4/f16 [719201,103425] 0 2024-02-15T22:40:48.861 INFO:tasks.workunit.client.0.smithi033.stdout:9/332: dwrite d4/fe [0,4194304] 0 2024-02-15T22:40:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:2/400: mkdir d1/d66/d75 0 2024-02-15T22:40:48.915 INFO:tasks.workunit.client.0.smithi033.stdout:2/401: write d1/d8/d2b/d2f/d13/f49 [2623141,101721] 0 2024-02-15T22:40:48.920 INFO:tasks.workunit.client.0.smithi033.stdout:7/401: creat d5/d6/d10/d16/f83 x:0 0 0 2024-02-15T22:40:48.921 INFO:tasks.workunit.client.0.smithi033.stdout:7/402: write d5/d6/d10/d16/d26/f2a [3686151,103631] 0 2024-02-15T22:40:48.922 INFO:tasks.workunit.client.0.smithi033.stdout:3/471: creat d0/d3/d2c/d43/f96 x:0 0 0 2024-02-15T22:40:48.923 INFO:tasks.workunit.client.0.smithi033.stdout:4/402: creat d8/d18/d37/d31/d47/d85/f89 x:0 0 0 2024-02-15T22:40:48.923 INFO:tasks.workunit.client.0.smithi033.stdout:8/324: rmdir d1 39 2024-02-15T22:40:48.930 INFO:tasks.workunit.client.0.smithi033.stdout:4/403: dread d8/d18/d37/d31/f59 [0,4194304] 0 2024-02-15T22:40:48.930 INFO:tasks.workunit.client.0.smithi033.stdout:4/404: dread - d8/d16/d51/d1c/d3c/d49/f6b zero size 2024-02-15T22:40:48.931 INFO:tasks.workunit.client.0.smithi033.stdout:9/333: symlink d4/d1d/d23/d32/l58 0 2024-02-15T22:40:48.931 INFO:tasks.workunit.client.0.smithi033.stdout:9/334: truncate d4/d1d/d23/d32/d3e/f4d 961470 0 2024-02-15T22:40:48.933 INFO:tasks.workunit.client.0.smithi033.stdout:8/325: write d1/d6/d14/f1b [7338636,24602] 0 2024-02-15T22:40:48.933 INFO:tasks.workunit.client.0.smithi033.stdout:8/326: write d1/d68/d2e/f53 [86865,15164] 0 2024-02-15T22:40:48.935 INFO:tasks.workunit.client.0.smithi033.stdout:2/402: mkdir d1/d8/d2b/d2f/d13/d59/d76 0 2024-02-15T22:40:48.935 INFO:tasks.workunit.client.0.smithi033.stdout:2/403: chown d1/d50 3466063 1 2024-02-15T22:40:48.935 INFO:tasks.workunit.client.0.smithi033.stdout:2/404: stat d1/d8/d2b/d2f/d13/c32 0 2024-02-15T22:40:48.935 INFO:tasks.workunit.client.0.smithi033.stdout:2/405: write d1/f48 [746645,16918] 0 2024-02-15T22:40:48.936 INFO:tasks.workunit.client.0.smithi033.stdout:7/403: mkdir d5/df/d56/d84 0 2024-02-15T22:40:48.936 INFO:tasks.workunit.client.0.smithi033.stdout:7/404: creat d5/df/d56/d60/d59/f85 x:0 0 0 2024-02-15T22:40:48.938 INFO:tasks.workunit.client.0.smithi033.stdout:2/406: read d1/d8/d2b/d2f/d13/f1c [335520,31640] 0 2024-02-15T22:40:48.939 INFO:tasks.workunit.client.0.smithi033.stdout:3/472: unlink d0/d1c/f66 0 2024-02-15T22:40:48.940 INFO:tasks.workunit.client.0.smithi033.stdout:9/335: truncate d4/d1d/d23/d24/f2b 2767887 0 2024-02-15T22:40:48.942 INFO:tasks.workunit.client.0.smithi033.stdout:8/327: mkdir d1/d68/d1d/d4a/d76 0 2024-02-15T22:40:48.942 INFO:tasks.workunit.client.0.smithi033.stdout:8/328: fsync d1/de/d1a/d2a/d40/f4e 0 2024-02-15T22:40:48.945 INFO:tasks.workunit.client.0.smithi033.stdout:8/329: dread d1/f33 [0,4194304] 0 2024-02-15T22:40:48.946 INFO:tasks.workunit.client.0.smithi033.stdout:7/405: symlink d5/dc/d5f/l86 0 2024-02-15T22:40:48.947 INFO:tasks.workunit.client.0.smithi033.stdout:2/407: rmdir d1/d8/d2b/d2f/d13/d6f 39 2024-02-15T22:40:48.950 INFO:tasks.workunit.client.0.smithi033.stdout:3/473: rename d0/d3/d2c/d5d/d3d/d82 to d0/d3/d65/d97 0 2024-02-15T22:40:48.951 INFO:tasks.workunit.client.0.smithi033.stdout:8/330: creat d1/d36/f77 x:0 0 0 2024-02-15T22:40:48.954 INFO:tasks.workunit.client.0.smithi033.stdout:2/408: mknod d1/d8/d2b/c77 0 2024-02-15T22:40:48.954 INFO:tasks.workunit.client.0.smithi033.stdout:2/409: fsync d1/d8/d2b/d2f/d13/f17 0 2024-02-15T22:40:48.956 INFO:tasks.workunit.client.0.smithi033.stdout:3/474: creat d0/d3/d3b/f98 x:0 0 0 2024-02-15T22:40:48.956 INFO:tasks.workunit.client.0.smithi033.stdout:3/475: write d0/d3/f70 [547538,123382] 0 2024-02-15T22:40:48.956 INFO:tasks.workunit.client.0.smithi033.stdout:9/336: dwrite d4/d1d/d23/f3d [0,4194304] 0 2024-02-15T22:40:48.957 INFO:tasks.workunit.client.0.smithi033.stdout:4/405: dwrite d8/d16/d45/f73 [0,4194304] 0 2024-02-15T22:40:48.957 INFO:tasks.workunit.client.0.smithi033.stdout:4/406: chown d8/d16/d45/l63 77 1 2024-02-15T22:40:48.958 INFO:tasks.workunit.client.0.smithi033.stdout:8/331: mknod d1/d68/d2e/c78 0 2024-02-15T22:40:48.962 INFO:tasks.workunit.client.0.smithi033.stdout:3/476: creat d0/d3/dd/f99 x:0 0 0 2024-02-15T22:40:48.962 INFO:tasks.workunit.client.0.smithi033.stdout:3/477: write d0/d3/d2c/f2f [425107,68324] 0 2024-02-15T22:40:48.968 INFO:tasks.workunit.client.0.smithi033.stdout:9/337: rename d4/f18 to d4/d1d/d23/d24/f59 0 2024-02-15T22:40:48.971 INFO:tasks.workunit.client.0.smithi033.stdout:3/478: rmdir d0/d3/d2c 39 2024-02-15T22:40:48.976 INFO:tasks.workunit.client.0.smithi033.stdout:7/406: getdents d5/df/d56/d60/d59 0 2024-02-15T22:40:48.983 INFO:tasks.workunit.client.0.smithi033.stdout:9/338: mkdir d4/d1d/d23/d24/d5a 0 2024-02-15T22:40:48.983 INFO:tasks.workunit.client.0.smithi033.stdout:9/339: read d4/d1d/d23/d24/f25 [67855,13574] 0 2024-02-15T22:40:48.985 INFO:tasks.workunit.client.0.smithi033.stdout:9/340: mknod d4/d1d/d23/c5b 0 2024-02-15T22:40:48.986 INFO:tasks.workunit.client.0.smithi033.stdout:9/341: symlink d4/d1d/d23/d35/l5c 0 2024-02-15T22:40:48.988 INFO:tasks.workunit.client.0.smithi033.stdout:9/342: mkdir d4/d1d/d23/d24/d51/d5d 0 2024-02-15T22:40:48.989 INFO:tasks.workunit.client.0.smithi033.stdout:9/343: truncate d4/fd 552695 0 2024-02-15T22:40:48.990 INFO:tasks.workunit.client.0.smithi033.stdout:9/344: mkdir d4/d1d/d23/d24/d5e 0 2024-02-15T22:40:48.991 INFO:tasks.workunit.client.0.smithi033.stdout:9/345: mkdir d4/d1d/d23/d24/d5f 0 2024-02-15T22:40:48.991 INFO:tasks.workunit.client.0.smithi033.stdout:9/346: chown d4/d1d/d23/f47 10 1 2024-02-15T22:40:48.992 INFO:tasks.workunit.client.0.smithi033.stdout:9/347: truncate d4/d1d/d23/d32/d3e/f56 464974 0 2024-02-15T22:40:48.992 INFO:tasks.workunit.client.0.smithi033.stdout:2/410: dwrite d1/d16/d5a/d67/f70 [0,4194304] 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:3/479: dwrite d0/d3/f40 [0,4194304] 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:3/480: fdatasync d0/d3/d65/f8e 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/407: dwrite d8/d16/d51/f44 [0,4194304] 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/408: creat d8/d16/d51/d1c/d3c/d3f/f8a x:0 0 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/409: fsync d8/f39 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/410: truncate d8/d16/d51/d1c/d3c/d3f/f8a 904574 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/411: fsync d8/d16/d51/d27/f5c 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/412: write d8/d16/d51/d1c/f6c [984682,63672] 0 2024-02-15T22:40:48.994 INFO:tasks.workunit.client.0.smithi033.stdout:8/332: dwrite d1/d36/f71 [0,4194304] 0 2024-02-15T22:40:48.999 INFO:tasks.workunit.client.0.smithi033.stdout:2/411: rename d1/d8/d2b/d2f/d38/f5c to d1/d16/d5a/d67/f78 0 2024-02-15T22:40:49.005 INFO:tasks.workunit.client.0.smithi033.stdout:4/413: mknod d8/d16/d45/c8b 0 2024-02-15T22:40:49.009 INFO:tasks.workunit.client.0.smithi033.stdout:2/412: rename d1/d16/d3f/d4e to d1/d8/d2b/d2f/d24/d31/d79 0 2024-02-15T22:40:49.010 INFO:tasks.workunit.client.0.smithi033.stdout:2/413: mkdir d1/d8/d2b/d2f/d24/d7a 0 2024-02-15T22:40:49.011 INFO:tasks.workunit.client.0.smithi033.stdout:2/414: creat d1/d16/d5a/f7b x:0 0 0 2024-02-15T22:40:49.011 INFO:tasks.workunit.client.0.smithi033.stdout:2/415: fdatasync d1/f2 0 2024-02-15T22:40:49.011 INFO:tasks.workunit.client.0.smithi033.stdout:2/416: chown d1/d8/d2b/d2f/d13/c32 10439243 1 2024-02-15T22:40:49.012 INFO:tasks.workunit.client.0.smithi033.stdout:2/417: creat d1/d8/d2b/d2f/d24/d69/f7c x:0 0 0 2024-02-15T22:40:49.014 INFO:tasks.workunit.client.0.smithi033.stdout:2/418: creat d1/d8/d2b/d2f/d13/d59/f7d x:0 0 0 2024-02-15T22:40:49.019 INFO:tasks.workunit.client.0.smithi033.stdout:5/473: sync 2024-02-15T22:40:49.020 INFO:tasks.workunit.client.0.smithi033.stdout:8/333: dwrite d1/de/d1a/d2a/f3b [0,4194304] 0 2024-02-15T22:40:49.020 INFO:tasks.workunit.client.0.smithi033.stdout:3/481: dwrite d0/d3/d3b/f63 [0,4194304] 0 2024-02-15T22:40:49.020 INFO:tasks.workunit.client.0.smithi033.stdout:8/334: write d1/de/d1a/f20 [800939,73797] 0 2024-02-15T22:40:49.021 INFO:tasks.workunit.client.0.smithi033.stdout:5/474: mkdir d6/d25/d99 0 2024-02-15T22:40:49.022 INFO:tasks.workunit.client.0.smithi033.stdout:9/348: dwrite d4/d1d/f52 [0,4194304] 0 2024-02-15T22:40:49.022 INFO:tasks.workunit.client.0.smithi033.stdout:9/349: chown d4/d1d/f4c 1827 1 2024-02-15T22:40:49.025 INFO:tasks.workunit.client.0.smithi033.stdout:2/419: write d1/d16/d5a/d67/f70 [1321169,112529] 0 2024-02-15T22:40:49.026 INFO:tasks.workunit.client.0.smithi033.stdout:3/482: mknod d0/d3/d5f/c9a 0 2024-02-15T22:40:49.028 INFO:tasks.workunit.client.0.smithi033.stdout:8/335: rename d1/d68/d2e to d1/d68/d1d/d4a/d76/d79 0 2024-02-15T22:40:49.028 INFO:tasks.workunit.client.0.smithi033.stdout:8/336: write d1/f33 [1964257,61923] 0 2024-02-15T22:40:49.032 INFO:tasks.workunit.client.0.smithi033.stdout:2/420: fsync d1/d8/d2b/d2f/d24/d69/f7c 0 2024-02-15T22:40:49.034 INFO:tasks.workunit.client.0.smithi033.stdout:3/483: symlink d0/d3/d2c/l9b 0 2024-02-15T22:40:49.037 INFO:tasks.workunit.client.0.smithi033.stdout:9/350: rename d4/d1d/d42/f4e to d4/f60 0 2024-02-15T22:40:49.039 INFO:tasks.workunit.client.0.smithi033.stdout:8/337: unlink d1/de/d1a/d27/c45 0 2024-02-15T22:40:49.040 INFO:tasks.workunit.client.0.smithi033.stdout:8/338: creat d1/d36/f7a x:0 0 0 2024-02-15T22:40:49.042 INFO:tasks.workunit.client.0.smithi033.stdout:5/475: getdents d6/d14/d43 0 2024-02-15T22:40:49.044 INFO:tasks.workunit.client.0.smithi033.stdout:3/484: getdents d0/d3/d2c/d5d/d3d/d8f 0 2024-02-15T22:40:49.044 INFO:tasks.workunit.client.0.smithi033.stdout:3/485: write d0/d1c/f32 [3461876,18457] 0 2024-02-15T22:40:49.044 INFO:tasks.workunit.client.0.smithi033.stdout:3/486: read d0/d3/d2c/d5d/d3d/f48 [58809,93595] 0 2024-02-15T22:40:49.044 INFO:tasks.workunit.client.0.smithi033.stdout:3/487: dread - d0/d3/d2c/d5d/d3d/d57/f6e zero size 2024-02-15T22:40:49.047 INFO:tasks.workunit.client.0.smithi033.stdout:8/339: creat d1/d68/d44/d49/f7b x:0 0 0 2024-02-15T22:40:49.048 INFO:tasks.workunit.client.0.smithi033.stdout:3/488: dread d0/d3/d3b/d47/f50 [0,4194304] 0 2024-02-15T22:40:49.056 INFO:tasks.workunit.client.0.smithi033.stdout:3/489: write d0/d1c/f25 [2177497,21060] 0 2024-02-15T22:40:49.059 INFO:tasks.workunit.client.0.smithi033.stdout:3/490: creat d0/d3/d2c/d5d/d3d/d8f/f9c x:0 0 0 2024-02-15T22:40:49.059 INFO:tasks.workunit.client.0.smithi033.stdout:3/491: stat d0/f53 0 2024-02-15T22:40:49.059 INFO:tasks.workunit.client.0.smithi033.stdout:3/492: chown d0/d3/d2c 363874 1 2024-02-15T22:40:49.060 INFO:tasks.workunit.client.0.smithi033.stdout:2/421: dwrite d1/d8/d2b/d2f/d13/d59/f7d [0,4194304] 0 2024-02-15T22:40:49.062 INFO:tasks.workunit.client.0.smithi033.stdout:8/340: write d1/d36/f71 [3643485,124508] 0 2024-02-15T22:40:49.062 INFO:tasks.workunit.client.0.smithi033.stdout:9/351: dwrite d4/d1d/d23/d24/f2b [0,4194304] 0 2024-02-15T22:40:49.062 INFO:tasks.workunit.client.0.smithi033.stdout:8/341: chown d1/de/c2f 102 1 2024-02-15T22:40:49.083 INFO:tasks.workunit.client.0.smithi033.stdout:8/342: fdatasync d1/de/d5c/f6d 0 2024-02-15T22:40:49.083 INFO:tasks.workunit.client.0.smithi033.stdout:8/343: getdents d1/de/d1a/d2a 0 2024-02-15T22:40:49.083 INFO:tasks.workunit.client.0.smithi033.stdout:8/344: getdents d1/de/d63 0 2024-02-15T22:40:49.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/493: truncate d0/d3/d2c/f2f 1355050 0 2024-02-15T22:40:49.087 INFO:tasks.workunit.client.0.smithi033.stdout:5/476: dwrite d6/d14/d31/d48/f5e [0,4194304] 0 2024-02-15T22:40:49.087 INFO:tasks.workunit.client.0.smithi033.stdout:2/422: dread d1/f7 [12582912,4194304] 0 2024-02-15T22:40:49.088 INFO:tasks.workunit.client.0.smithi033.stdout:2/423: chown d1/d16/d5a/d67/l68 228142087 1 2024-02-15T22:40:49.088 INFO:tasks.workunit.client.0.smithi033.stdout:2/424: readlink d1/l5f 0 2024-02-15T22:40:49.089 INFO:tasks.workunit.client.0.smithi033.stdout:9/352: dread d4/d1d/f52 [0,4194304] 0 2024-02-15T22:40:49.091 INFO:tasks.workunit.client.0.smithi033.stdout:5/477: unlink d6/d14/d31/d48/d56/d90/c93 0 2024-02-15T22:40:49.092 INFO:tasks.workunit.client.0.smithi033.stdout:5/478: creat d6/d14/d31/d48/d56/f9a x:0 0 0 2024-02-15T22:40:49.092 INFO:tasks.workunit.client.0.smithi033.stdout:5/479: read d6/d14/f22 [2449213,93636] 0 2024-02-15T22:40:49.095 INFO:tasks.workunit.client.0.smithi033.stdout:8/345: write d1/de/d1a/d27/d55/f59 [4137195,117845] 0 2024-02-15T22:40:49.096 INFO:tasks.workunit.client.0.smithi033.stdout:5/480: rename d6/d14/d31/d48/d59 to d6/d14/d31/d38/d9b 0 2024-02-15T22:40:49.097 INFO:tasks.workunit.client.0.smithi033.stdout:3/494: dread d0/d3/d2c/d43/f61 [0,4194304] 0 2024-02-15T22:40:49.098 INFO:tasks.workunit.client.0.smithi033.stdout:9/353: dread d4/d1d/d23/f47 [0,4194304] 0 2024-02-15T22:40:49.099 INFO:tasks.workunit.client.0.smithi033.stdout:9/354: read d4/f16 [4018909,28203] 0 2024-02-15T22:40:49.101 INFO:tasks.workunit.client.0.smithi033.stdout:5/481: rename d6/d14/d31/d50/c76 to d6/d14/d43/d70/c9c 0 2024-02-15T22:40:49.103 INFO:tasks.workunit.client.0.smithi033.stdout:3/495: mkdir d0/d9d 0 2024-02-15T22:40:49.104 INFO:tasks.workunit.client.0.smithi033.stdout:3/496: chown d0/d3/d2c/l9b 14993161 1 2024-02-15T22:40:49.104 INFO:tasks.workunit.client.0.smithi033.stdout:3/497: write d0/d3/f41 [1021988,90749] 0 2024-02-15T22:40:49.104 INFO:tasks.workunit.client.0.smithi033.stdout:2/425: dread d1/d8/d2b/d2f/d12/f42 [0,4194304] 0 2024-02-15T22:40:49.105 INFO:tasks.workunit.client.0.smithi033.stdout:8/346: write d1/de/d1a/d2a/f3c [2273638,53784] 0 2024-02-15T22:40:49.107 INFO:tasks.workunit.client.0.smithi033.stdout:2/426: link d1/d8/fe d1/d8/d2b/d2f/d24/d69/f7e 0 2024-02-15T22:40:49.108 INFO:tasks.workunit.client.0.smithi033.stdout:2/427: creat d1/d8/d2b/d2f/d13/d61/f7f x:0 0 0 2024-02-15T22:40:49.108 INFO:tasks.workunit.client.0.smithi033.stdout:2/428: write d1/d8/d2b/d2f/d24/d31/f43 [4866312,129537] 0 2024-02-15T22:40:49.108 INFO:tasks.workunit.client.0.smithi033.stdout:9/355: write d4/d1d/d23/d32/f4f [947882,56348] 0 2024-02-15T22:40:49.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:48 smithi082 ceph-mon[37153]: pgmap v7: 65 pgs: 65 active+clean; 784 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 105 MiB/s rd, 120 MiB/s wr, 199 op/s 2024-02-15T22:40:49.127 INFO:tasks.workunit.client.0.smithi033.stdout:2/429: write d1/d8/d2b/d2f/d12/f42 [3503799,121412] 0 2024-02-15T22:40:49.129 INFO:tasks.workunit.client.0.smithi033.stdout:2/430: creat d1/d16/d5a/d67/f80 x:0 0 0 2024-02-15T22:40:49.131 INFO:tasks.workunit.client.0.smithi033.stdout:2/431: link d1/d8/d2b/d2f/d24/d31/f43 d1/d8/d2b/d2f/d24/d31/f81 0 2024-02-15T22:40:49.132 INFO:tasks.workunit.client.0.smithi033.stdout:2/432: dread d1/d8/d2b/d2f/d24/d31/f58 [0,4194304] 0 2024-02-15T22:40:49.133 INFO:tasks.workunit.client.0.smithi033.stdout:2/433: readlink d1/d16/d5a/d67/l68 0 2024-02-15T22:40:49.133 INFO:tasks.workunit.client.0.smithi033.stdout:2/434: fsync d1/d16/d3f/f4b 0 2024-02-15T22:40:49.133 INFO:tasks.workunit.client.0.smithi033.stdout:2/435: creat d1/d50/f82 x:0 0 0 2024-02-15T22:40:49.135 INFO:tasks.workunit.client.0.smithi033.stdout:2/436: creat d1/d66/d75/f83 x:0 0 0 2024-02-15T22:40:49.135 INFO:tasks.workunit.client.0.smithi033.stdout:2/437: chown d1/d8/d2b/d2f/d13/f49 29 1 2024-02-15T22:40:49.137 INFO:tasks.workunit.client.0.smithi033.stdout:2/438: rename d1/d16/l18 to d1/d8/d2b/d2f/d3d/l84 0 2024-02-15T22:40:49.138 INFO:tasks.workunit.client.0.smithi033.stdout:5/482: dwrite d6/d14/d31/d64/f8a [0,4194304] 0 2024-02-15T22:40:49.138 INFO:tasks.workunit.client.0.smithi033.stdout:5/483: readlink d6/l18 0 2024-02-15T22:40:49.139 INFO:tasks.workunit.client.0.smithi033.stdout:9/356: dwrite d4/d1d/d23/d24/f4b [0,4194304] 0 2024-02-15T22:40:49.139 INFO:tasks.workunit.client.0.smithi033.stdout:2/439: creat d1/d8/d2b/f85 x:0 0 0 2024-02-15T22:40:49.140 INFO:tasks.workunit.client.0.smithi033.stdout:3/498: dwrite d0/d3/d3b/f98 [0,4194304] 0 2024-02-15T22:40:49.142 INFO:tasks.workunit.client.0.smithi033.stdout:8/347: dwrite d1/de/d1a/d2a/f6f [0,4194304] 0 2024-02-15T22:40:49.142 INFO:tasks.workunit.client.0.smithi033.stdout:8/348: fsync d1/de/f56 0 2024-02-15T22:40:49.149 INFO:tasks.workunit.client.0.smithi033.stdout:3/499: creat d0/d3/d2c/f9e x:0 0 0 2024-02-15T22:40:49.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/349: rename d1/d36/f43 to d1/de/d1a/d27/f7c 0 2024-02-15T22:40:49.158 INFO:tasks.workunit.client.0.smithi033.stdout:8/350: rename d1/d6/d14/l3d to d1/de/d1a/d27/d55/l7d 0 2024-02-15T22:40:49.160 INFO:tasks.workunit.client.0.smithi033.stdout:3/500: getdents d0/d3/d2c/d5d/d3d/d8f 0 2024-02-15T22:40:49.167 INFO:tasks.workunit.client.0.smithi033.stdout:2/440: dwrite d1/d16/d5a/d67/f80 [0,4194304] 0 2024-02-15T22:40:49.170 INFO:tasks.workunit.client.0.smithi033.stdout:3/501: dread d0/d3/d3b/f71 [0,4194304] 0 2024-02-15T22:40:49.170 INFO:tasks.workunit.client.0.smithi033.stdout:3/502: write d0/d3/d2c/d43/f75 [528413,23626] 0 2024-02-15T22:40:49.171 INFO:tasks.workunit.client.0.smithi033.stdout:3/503: dread - d0/d3/d3b/d47/f84 zero size 2024-02-15T22:40:49.171 INFO:tasks.workunit.client.0.smithi033.stdout:5/484: dwrite d6/d25/f35 [4194304,4194304] 0 2024-02-15T22:40:49.171 INFO:tasks.workunit.client.0.smithi033.stdout:9/357: dwrite d4/fb [4194304,4194304] 0 2024-02-15T22:40:49.171 INFO:tasks.workunit.client.0.smithi033.stdout:9/358: dread - d4/d1d/f57 zero size 2024-02-15T22:40:49.174 INFO:tasks.workunit.client.0.smithi033.stdout:5/485: symlink d6/d14/d31/d50/l9d 0 2024-02-15T22:40:49.179 INFO:tasks.workunit.client.0.smithi033.stdout:5/486: rename d6/d14/d43/f6c to d6/d14/d31/d50/d5c/f9e 0 2024-02-15T22:40:49.180 INFO:tasks.workunit.client.0.smithi033.stdout:5/487: symlink d6/d14/d31/d50/d5c/l9f 0 2024-02-15T22:40:49.189 INFO:tasks.workunit.client.0.smithi033.stdout:3/504: truncate d0/d3/d2c/d43/f75 74492 0 2024-02-15T22:40:49.190 INFO:tasks.workunit.client.0.smithi033.stdout:1/359: sync 2024-02-15T22:40:49.190 INFO:tasks.workunit.client.0.smithi033.stdout:6/349: sync 2024-02-15T22:40:49.190 INFO:tasks.workunit.client.0.smithi033.stdout:9/359: dread d4/d1d/d23/d24/f2b [0,4194304] 0 2024-02-15T22:40:49.191 INFO:tasks.workunit.client.0.smithi033.stdout:8/351: dwrite d1/d36/f71 [0,4194304] 0 2024-02-15T22:40:49.191 INFO:tasks.workunit.client.0.smithi033.stdout:2/441: dwrite d1/f2 [0,4194304] 0 2024-02-15T22:40:49.191 INFO:tasks.workunit.client.0.smithi033.stdout:2/442: readlink d1/l1f 0 2024-02-15T22:40:49.191 INFO:tasks.workunit.client.0.smithi033.stdout:2/443: stat d1/d16/d5a/f7b 0 2024-02-15T22:40:49.191 INFO:tasks.workunit.client.0.smithi033.stdout:3/505: mknod d0/c9f 0 2024-02-15T22:40:49.193 INFO:tasks.workunit.client.0.smithi033.stdout:9/360: unlink d4/d1d/d23/d24/f59 0 2024-02-15T22:40:49.193 INFO:tasks.workunit.client.0.smithi033.stdout:1/360: dread d1/de/d27/d28/f29 [0,4194304] 0 2024-02-15T22:40:49.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/361: write d1/d20/f65 [225694,35178] 0 2024-02-15T22:40:49.196 INFO:tasks.workunit.client.0.smithi033.stdout:8/352: creat d1/de/d5c/f7e x:0 0 0 2024-02-15T22:40:49.196 INFO:tasks.workunit.client.0.smithi033.stdout:8/353: truncate d1/d36/f77 951482 0 2024-02-15T22:40:49.196 INFO:tasks.workunit.client.0.smithi033.stdout:8/354: chown d1/d68/d1d/d4a/d76/d79/c3e 2 1 2024-02-15T22:40:49.199 INFO:tasks.workunit.client.0.smithi033.stdout:3/506: creat d0/d8c/fa0 x:0 0 0 2024-02-15T22:40:49.202 INFO:tasks.workunit.client.0.smithi033.stdout:9/361: rename d4/fb to d4/d1d/d23/f61 0 2024-02-15T22:40:49.202 INFO:tasks.workunit.client.0.smithi033.stdout:2/444: rmdir d1/d8/d34 39 2024-02-15T22:40:49.204 INFO:tasks.workunit.client.0.smithi033.stdout:5/488: dwrite d6/d14/f2e [0,4194304] 0 2024-02-15T22:40:49.205 INFO:tasks.workunit.client.0.smithi033.stdout:2/445: mknod d1/d8/d2b/d2f/d24/c86 0 2024-02-15T22:40:49.205 INFO:tasks.workunit.client.0.smithi033.stdout:2/446: creat d1/d16/d5a/f87 x:0 0 0 2024-02-15T22:40:49.205 INFO:tasks.workunit.client.0.smithi033.stdout:2/447: fdatasync d1/d16/d5a/d67/f70 0 2024-02-15T22:40:49.206 INFO:tasks.workunit.client.0.smithi033.stdout:5/489: mknod d6/d14/d31/d64/d7a/ca0 0 2024-02-15T22:40:49.206 INFO:tasks.workunit.client.0.smithi033.stdout:5/490: read d6/d14/f1d [7125461,83303] 0 2024-02-15T22:40:49.210 INFO:tasks.workunit.client.0.smithi033.stdout:2/448: mkdir d1/d8/d2b/d2f/d24/d2a/d88 0 2024-02-15T22:40:49.210 INFO:tasks.workunit.client.0.smithi033.stdout:2/449: creat d1/d8/d2b/d2f/d24/d69/f89 x:0 0 0 2024-02-15T22:40:49.210 INFO:tasks.workunit.client.0.smithi033.stdout:2/450: write d1/d8/d2b/d2f/fb [4951457,92691] 0 2024-02-15T22:40:49.210 INFO:tasks.workunit.client.0.smithi033.stdout:1/362: write d1/d20/d42/d2c/d30/f40 [1510853,73084] 0 2024-02-15T22:40:49.210 INFO:tasks.workunit.client.0.smithi033.stdout:2/451: stat d1/d16/c29 0 2024-02-15T22:40:49.210 INFO:tasks.workunit.client.0.smithi033.stdout:1/363: creat d1/d20/d42/d25/f6f x:0 0 0 2024-02-15T22:40:49.214 INFO:tasks.workunit.client.0.smithi033.stdout:2/452: truncate d1/d16/d5a/d67/f80 785995 0 2024-02-15T22:40:49.214 INFO:tasks.workunit.client.0.smithi033.stdout:2/453: readlink d1/d16/d3f/l44 0 2024-02-15T22:40:49.217 INFO:tasks.workunit.client.0.smithi033.stdout:2/454: rename d1/d8/d34/c72 to d1/d8/d2b/d2f/d12/c8a 0 2024-02-15T22:40:49.220 INFO:tasks.workunit.client.0.smithi033.stdout:2/455: getdents d1/d66/d75 0 2024-02-15T22:40:49.222 INFO:tasks.workunit.client.0.smithi033.stdout:1/364: dread d1/d20/d42/d2c/f31 [0,4194304] 0 2024-02-15T22:40:49.222 INFO:tasks.workunit.client.0.smithi033.stdout:2/456: mknod d1/d16/d5a/d67/c8b 0 2024-02-15T22:40:49.222 INFO:tasks.workunit.client.0.smithi033.stdout:2/457: fsync d1/d8/d2b/d2f/d24/d31/f43 0 2024-02-15T22:40:49.223 INFO:tasks.workunit.client.0.smithi033.stdout:1/365: creat d1/d20/d42/d25/d4d/f70 x:0 0 0 2024-02-15T22:40:49.223 INFO:tasks.workunit.client.0.smithi033.stdout:1/366: write d1/f64 [988474,23475] 0 2024-02-15T22:40:49.223 INFO:tasks.workunit.client.0.smithi033.stdout:1/367: creat d1/de/d27/d39/d3a/f71 x:0 0 0 2024-02-15T22:40:49.224 INFO:tasks.workunit.client.0.smithi033.stdout:2/458: creat d1/d8/d2b/d2f/f8c x:0 0 0 2024-02-15T22:40:49.227 INFO:tasks.workunit.client.0.smithi033.stdout:1/368: symlink d1/de/d27/d39/d3a/l72 0 2024-02-15T22:40:49.227 INFO:tasks.workunit.client.0.smithi033.stdout:2/459: mkdir d1/d8/d2b/d2f/d13/d61/d8d 0 2024-02-15T22:40:49.229 INFO:tasks.workunit.client.0.smithi033.stdout:2/460: unlink d1/d8/d2b/d2f/d13/d61/f7f 0 2024-02-15T22:40:49.230 INFO:tasks.workunit.client.0.smithi033.stdout:2/461: mkdir d1/d8/d2b/d2f/d24/d2a/d88/d8e 0 2024-02-15T22:40:49.230 INFO:tasks.workunit.client.0.smithi033.stdout:2/462: readlink d1/d8/d2b/d2f/d24/d2a/l3a 0 2024-02-15T22:40:49.230 INFO:tasks.workunit.client.0.smithi033.stdout:2/463: chown d1/d8/d34/f53 16674661 1 2024-02-15T22:40:49.231 INFO:tasks.workunit.client.0.smithi033.stdout:6/350: dwrite d12/d2c/d30/f1f [4194304,4194304] 0 2024-02-15T22:40:49.231 INFO:tasks.workunit.client.0.smithi033.stdout:2/464: symlink d1/d50/l8f 0 2024-02-15T22:40:49.232 INFO:tasks.workunit.client.0.smithi033.stdout:9/362: dwrite d4/d1d/d23/d32/f4f [0,4194304] 0 2024-02-15T22:40:49.233 INFO:tasks.workunit.client.0.smithi033.stdout:8/355: dwrite d1/d6/d14/f1b [4194304,4194304] 0 2024-02-15T22:40:49.233 INFO:tasks.workunit.client.0.smithi033.stdout:3/507: dwrite d0/d3/d2c/d5d/d3d/d57/f6e [0,4194304] 0 2024-02-15T22:40:49.234 INFO:tasks.workunit.client.0.smithi033.stdout:9/363: rmdir d4/d1d/d23/d35/d38/d3f 39 2024-02-15T22:40:49.242 INFO:tasks.workunit.client.0.smithi033.stdout:2/465: dread d1/d16/d5a/d67/f70 [0,4194304] 0 2024-02-15T22:40:49.245 INFO:tasks.workunit.client.0.smithi033.stdout:2/466: write d1/d8/d2b/d2f/d13/f3b [102274,61982] 0 2024-02-15T22:40:49.245 INFO:tasks.workunit.client.0.smithi033.stdout:2/467: write d1/d8/d2b/d2f/d13/d61/f63 [454441,91352] 0 2024-02-15T22:40:49.253 INFO:tasks.workunit.client.0.smithi033.stdout:3/508: mknod d0/d3/d2c/d43/ca1 0 2024-02-15T22:40:49.253 INFO:tasks.workunit.client.0.smithi033.stdout:3/509: rename d0 to d0/d3/d2c/d5d/d3d/d57/da2 22 2024-02-15T22:40:49.254 INFO:tasks.workunit.client.0.smithi033.stdout:2/468: creat d1/d8/d2b/d2f/d24/d31/f90 x:0 0 0 2024-02-15T22:40:49.254 INFO:tasks.workunit.client.0.smithi033.stdout:2/469: creat d1/d16/d5a/f91 x:0 0 0 2024-02-15T22:40:49.254 INFO:tasks.workunit.client.0.smithi033.stdout:2/470: chown d1/d16/c47 232688 1 2024-02-15T22:40:49.255 INFO:tasks.workunit.client.0.smithi033.stdout:3/510: rename d0/d3/f70 to d0/d3/d3b/d47/fa3 0 2024-02-15T22:40:49.256 INFO:tasks.workunit.client.0.smithi033.stdout:2/471: mknod d1/d8/d2b/d2f/d13/d59/d76/c92 0 2024-02-15T22:40:49.257 INFO:tasks.workunit.client.0.smithi033.stdout:3/511: link d0/d3/d2c/f9e d0/d3/d2c/d5d/d3d/d8f/fa4 0 2024-02-15T22:40:49.257 INFO:tasks.workunit.client.0.smithi033.stdout:3/512: creat d0/d3/dd/fa5 x:0 0 0 2024-02-15T22:40:49.258 INFO:tasks.workunit.client.0.smithi033.stdout:2/472: rename d1/d16/f22 to d1/d16/d57/f93 0 2024-02-15T22:40:49.260 INFO:tasks.workunit.client.0.smithi033.stdout:2/473: creat d1/d8/d2b/d2f/d12/d52/f94 x:0 0 0 2024-02-15T22:40:49.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/474: rmdir d1/d8/d2b/d2f/d24/d2a 39 2024-02-15T22:40:49.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/475: read d1/d8/d2b/d2f/d24/d31/f3e [2978934,54692] 0 2024-02-15T22:40:49.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/476: truncate d1/d16/d5a/f91 721706 0 2024-02-15T22:40:49.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/477: chown d1/d16/c29 8822485 1 2024-02-15T22:40:49.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/478: getdents d1/d8/d2b/d2f/d13/d61/d8d 0 2024-02-15T22:40:49.262 INFO:tasks.workunit.client.0.smithi033.stdout:2/479: creat d1/d8/d2b/d2f/d38/f95 x:0 0 0 2024-02-15T22:40:49.264 INFO:tasks.workunit.client.0.smithi033.stdout:2/480: mknod d1/d8/d2b/d2f/d12/d52/c96 0 2024-02-15T22:40:49.264 INFO:tasks.workunit.client.0.smithi033.stdout:2/481: write d1/d8/d2b/d2f/d24/d31/f3e [3158277,128489] 0 2024-02-15T22:40:49.265 INFO:tasks.workunit.client.0.smithi033.stdout:1/369: dwrite d1/fa [0,4194304] 0 2024-02-15T22:40:49.265 INFO:tasks.workunit.client.0.smithi033.stdout:1/370: stat d1/d20/d42/d2c/d30 0 2024-02-15T22:40:49.265 INFO:tasks.workunit.client.0.smithi033.stdout:6/351: dwrite d12/d2c/d30/f20 [0,4194304] 0 2024-02-15T22:40:49.265 INFO:tasks.workunit.client.0.smithi033.stdout:9/364: dwrite d4/f16 [0,4194304] 0 2024-02-15T22:40:49.266 INFO:tasks.workunit.client.0.smithi033.stdout:9/365: readlink d4/d1d/d23/d32/d3e/l54 0 2024-02-15T22:40:49.266 INFO:tasks.workunit.client.0.smithi033.stdout:8/356: dwrite d1/de/d1a/d2a/f3b [0,4194304] 0 2024-02-15T22:40:49.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:48 smithi033 ceph-mon[29033]: pgmap v7: 65 pgs: 65 active+clean; 784 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 105 MiB/s rd, 120 MiB/s wr, 199 op/s 2024-02-15T22:40:49.270 INFO:tasks.workunit.client.0.smithi033.stdout:9/366: write d4/d1d/f3c [7069202,31469] 0 2024-02-15T22:40:49.272 INFO:tasks.workunit.client.0.smithi033.stdout:6/352: dread d12/d3c/f4d [0,4194304] 0 2024-02-15T22:40:49.276 INFO:tasks.workunit.client.0.smithi033.stdout:9/367: unlink d4/l2e 0 2024-02-15T22:40:49.278 INFO:tasks.workunit.client.0.smithi033.stdout:2/482: dread d1/f20 [0,4194304] 0 2024-02-15T22:40:49.278 INFO:tasks.workunit.client.0.smithi033.stdout:2/483: creat d1/d16/d5a/f97 x:0 0 0 2024-02-15T22:40:49.280 INFO:tasks.workunit.client.0.smithi033.stdout:9/368: unlink d4/d1d/d23/d24/l2f 0 2024-02-15T22:40:49.280 INFO:tasks.workunit.client.0.smithi033.stdout:9/369: readlink d4/d1d/d23/d24/l28 0 2024-02-15T22:40:49.281 INFO:tasks.workunit.client.0.smithi033.stdout:9/370: stat d4/d1d/d23/d32/d3e/f44 0 2024-02-15T22:40:49.282 INFO:tasks.workunit.client.0.smithi033.stdout:2/484: mknod d1/d16/d5a/c98 0 2024-02-15T22:40:49.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/371: symlink d4/d1d/d23/l62 0 2024-02-15T22:40:49.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/372: creat d4/d1d/d23/d35/f63 x:0 0 0 2024-02-15T22:40:49.285 INFO:tasks.workunit.client.0.smithi033.stdout:2/485: rmdir d1/d8/d2b/d2f/d38/d62 39 2024-02-15T22:40:49.288 INFO:tasks.workunit.client.0.smithi033.stdout:2/486: mkdir d1/d50/d99 0 2024-02-15T22:40:49.288 INFO:tasks.workunit.client.0.smithi033.stdout:2/487: dread - d1/d16/d5a/f7b zero size 2024-02-15T22:40:49.290 INFO:tasks.workunit.client.0.smithi033.stdout:3/513: dwrite d0/d3/d3b/d47/f50 [0,4194304] 0 2024-02-15T22:40:49.290 INFO:tasks.workunit.client.0.smithi033.stdout:8/357: dwrite d1/f33 [0,4194304] 0 2024-02-15T22:40:49.290 INFO:tasks.workunit.client.0.smithi033.stdout:8/358: fdatasync d1/de/d5c/f7e 0 2024-02-15T22:40:49.290 INFO:tasks.workunit.client.0.smithi033.stdout:1/371: dwrite d1/d20/d42/d25/f60 [0,4194304] 0 2024-02-15T22:40:49.290 INFO:tasks.workunit.client.0.smithi033.stdout:2/488: mkdir d1/d8/d2b/d2f/d38/d9a 0 2024-02-15T22:40:49.293 INFO:tasks.workunit.client.0.smithi033.stdout:3/514: symlink d0/d3/d2c/d5d/d3d/la6 0 2024-02-15T22:40:49.293 INFO:tasks.workunit.client.0.smithi033.stdout:3/515: read - d0/d1c/f67 zero size 2024-02-15T22:40:49.294 INFO:tasks.workunit.client.0.smithi033.stdout:3/516: write d0/d1c/f88 [340243,12383] 0 2024-02-15T22:40:49.297 INFO:tasks.workunit.client.0.smithi033.stdout:8/359: unlink d1/de/d1a/d2a/d40/f4e 0 2024-02-15T22:40:49.297 INFO:tasks.workunit.client.0.smithi033.stdout:8/360: stat d1/d68/d44/d49 0 2024-02-15T22:40:49.297 INFO:tasks.workunit.client.0.smithi033.stdout:8/361: readlink d1/de/d1a/d2a/l39 0 2024-02-15T22:40:49.297 INFO:tasks.workunit.client.0.smithi033.stdout:8/362: write d1/de/d1a/d27/d55/f59 [4789969,45588] 0 2024-02-15T22:40:49.301 INFO:tasks.workunit.client.0.smithi033.stdout:2/489: write d1/d8/d34/f53 [2699152,26344] 0 2024-02-15T22:40:49.304 INFO:tasks.workunit.client.0.smithi033.stdout:0/394: sync 2024-02-15T22:40:49.304 INFO:tasks.workunit.client.0.smithi033.stdout:0/395: chown db/d2a/l4d 7 1 2024-02-15T22:40:49.306 INFO:tasks.workunit.client.0.smithi033.stdout:1/372: symlink d1/de/d27/d39/l73 0 2024-02-15T22:40:49.306 INFO:tasks.workunit.client.0.smithi033.stdout:1/373: chown d1/f5b 4797243 1 2024-02-15T22:40:49.311 INFO:tasks.workunit.client.0.smithi033.stdout:3/517: unlink d0/d3/d2c/d43/c58 0 2024-02-15T22:40:49.311 INFO:tasks.workunit.client.0.smithi033.stdout:3/518: getdents d0/d3/d2c/d5d/d3d/d8f/d93 0 2024-02-15T22:40:49.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/353: truncate d12/d2c/d30/f20 3852456 0 2024-02-15T22:40:49.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/354: truncate d12/d2c/d30/f36 5151567 0 2024-02-15T22:40:49.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/355: stat d12/f5e 0 2024-02-15T22:40:49.319 INFO:tasks.workunit.client.0.smithi033.stdout:6/356: unlink d12/d1b/l70 0 2024-02-15T22:40:49.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/357: creat d12/d1b/d3f/d5b/f77 x:0 0 0 2024-02-15T22:40:49.323 INFO:tasks.workunit.client.0.smithi033.stdout:6/358: unlink d12/f73 0 2024-02-15T22:40:49.324 INFO:tasks.workunit.client.0.smithi033.stdout:6/359: creat d12/f78 x:0 0 0 2024-02-15T22:40:49.325 INFO:tasks.workunit.client.0.smithi033.stdout:6/360: write d12/d2c/d30/f16 [1620312,21045] 0 2024-02-15T22:40:49.325 INFO:tasks.workunit.client.0.smithi033.stdout:2/490: dwrite d1/d8/d2b/d2f/d24/d69/f7e [0,4194304] 0 2024-02-15T22:40:49.326 INFO:tasks.workunit.client.0.smithi033.stdout:9/373: truncate d4/f16 27323 0 2024-02-15T22:40:49.328 INFO:tasks.workunit.client.0.smithi033.stdout:2/491: creat d1/d8/f9b x:0 0 0 2024-02-15T22:40:49.328 INFO:tasks.workunit.client.0.smithi033.stdout:2/492: read d1/d8/d2b/d2f/d13/f3b [339508,36538] 0 2024-02-15T22:40:49.331 INFO:tasks.workunit.client.0.smithi033.stdout:2/493: link d1/d16/d5a/f87 d1/d50/f9c 0 2024-02-15T22:40:49.332 INFO:tasks.workunit.client.0.smithi033.stdout:2/494: read - d1/d8/d2b/d2f/d24/d31/f90 zero size 2024-02-15T22:40:49.333 INFO:tasks.workunit.client.0.smithi033.stdout:9/374: getdents d4/d1d/d23/d35/d38 0 2024-02-15T22:40:49.333 INFO:tasks.workunit.client.0.smithi033.stdout:9/375: creat d4/d1d/d23/d32/d3e/f64 x:0 0 0 2024-02-15T22:40:49.333 INFO:tasks.workunit.client.0.smithi033.stdout:0/396: dwrite db/d19/d32/d3d/f59 [0,4194304] 0 2024-02-15T22:40:49.333 INFO:tasks.workunit.client.0.smithi033.stdout:0/397: chown fa 14 1 2024-02-15T22:40:49.333 INFO:tasks.workunit.client.0.smithi033.stdout:3/519: dwrite d0/d3/f44 [0,4194304] 0 2024-02-15T22:40:49.334 INFO:tasks.workunit.client.0.smithi033.stdout:8/363: truncate d1/f33 3508670 0 2024-02-15T22:40:49.335 INFO:tasks.workunit.client.0.smithi033.stdout:9/376: dread d4/f15 [0,4194304] 0 2024-02-15T22:40:49.335 INFO:tasks.workunit.client.0.smithi033.stdout:3/520: dread d0/d1c/f88 [0,4194304] 0 2024-02-15T22:40:49.335 INFO:tasks.workunit.client.0.smithi033.stdout:3/521: truncate d0/d3/d2c/d43/f75 978861 0 2024-02-15T22:40:49.336 INFO:tasks.workunit.client.0.smithi033.stdout:8/364: dread d1/d68/d1d/d4a/d76/d79/f53 [0,4194304] 0 2024-02-15T22:40:49.339 INFO:tasks.workunit.client.0.smithi033.stdout:9/377: read d4/d1d/d23/f47 [2654721,34284] 0 2024-02-15T22:40:49.339 INFO:tasks.workunit.client.0.smithi033.stdout:0/398: symlink db/d2a/d68/l80 0 2024-02-15T22:40:49.340 INFO:tasks.workunit.client.0.smithi033.stdout:3/522: mkdir d0/d3/d5f/da7 0 2024-02-15T22:40:49.340 INFO:tasks.workunit.client.0.smithi033.stdout:3/523: fdatasync d0/d3/d2c/f5c 0 2024-02-15T22:40:49.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/524: write d0/d3/dd/fa5 [594519,85381] 0 2024-02-15T22:40:49.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/525: chown d0/d3/d5f/l83 3 1 2024-02-15T22:40:49.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/526: chown d0/d3 6813 1 2024-02-15T22:40:49.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/527: chown d0/d3/d2c/d5d/d3d/d57/f6f 59 1 2024-02-15T22:40:49.342 INFO:tasks.workunit.client.0.smithi033.stdout:9/378: mknod d4/d1d/d23/d32/c65 0 2024-02-15T22:40:49.346 INFO:tasks.workunit.client.0.smithi033.stdout:0/399: unlink db/d2a/d68/l80 0 2024-02-15T22:40:49.348 INFO:tasks.workunit.client.0.smithi033.stdout:8/365: dread d1/de/d1a/d27/d55/f59 [0,4194304] 0 2024-02-15T22:40:49.348 INFO:tasks.workunit.client.0.smithi033.stdout:8/366: write d1/de/f56 [77457,39887] 0 2024-02-15T22:40:49.348 INFO:tasks.workunit.client.0.smithi033.stdout:3/528: creat d0/d3/d65/d97/fa8 x:0 0 0 2024-02-15T22:40:49.349 INFO:tasks.workunit.client.0.smithi033.stdout:3/529: chown d0/d3/d2c/d5d/d3d/d57/f6f 1167 1 2024-02-15T22:40:49.352 INFO:tasks.workunit.client.0.smithi033.stdout:0/400: mknod db/d2a/d6c/c81 0 2024-02-15T22:40:49.356 INFO:tasks.workunit.client.0.smithi033.stdout:0/401: truncate f5 1397937 0 2024-02-15T22:40:49.356 INFO:tasks.workunit.client.0.smithi033.stdout:6/361: getdents d12/d1b 0 2024-02-15T22:40:49.356 INFO:tasks.workunit.client.0.smithi033.stdout:6/362: chown d12/d2c/d30/d1d/c32 99518 1 2024-02-15T22:40:49.357 INFO:tasks.workunit.client.0.smithi033.stdout:0/402: creat db/d19/d32/d43/d7d/f82 x:0 0 0 2024-02-15T22:40:49.358 INFO:tasks.workunit.client.0.smithi033.stdout:8/367: dread d1/de/d1a/d2a/f3b [0,4194304] 0 2024-02-15T22:40:49.359 INFO:tasks.workunit.client.0.smithi033.stdout:6/363: mkdir d12/d2c/d30/d19/d79 0 2024-02-15T22:40:49.361 INFO:tasks.workunit.client.0.smithi033.stdout:0/403: link db/d19/d32/f3c db/d19/d32/d46/f83 0 2024-02-15T22:40:49.361 INFO:tasks.workunit.client.0.smithi033.stdout:0/404: dread - db/d2a/f5c zero size 2024-02-15T22:40:49.362 INFO:tasks.workunit.client.0.smithi033.stdout:8/368: truncate d1/d68/d1d/f35 2209366 0 2024-02-15T22:40:49.362 INFO:tasks.workunit.client.0.smithi033.stdout:8/369: stat d1/de/d1a/d2a/d40/l5f 0 2024-02-15T22:40:49.363 INFO:tasks.workunit.client.0.smithi033.stdout:6/364: unlink d12/l23 0 2024-02-15T22:40:49.363 INFO:tasks.workunit.client.0.smithi033.stdout:7/407: sync 2024-02-15T22:40:49.364 INFO:tasks.workunit.client.0.smithi033.stdout:4/414: sync 2024-02-15T22:40:49.364 INFO:tasks.workunit.client.0.smithi033.stdout:4/415: dread - d8/d16/d51/d1c/d3c/d3f/f6f zero size 2024-02-15T22:40:49.365 INFO:tasks.workunit.client.0.smithi033.stdout:0/405: rename db/c65 to db/d2a/d6e/c84 0 2024-02-15T22:40:49.365 INFO:tasks.workunit.client.0.smithi033.stdout:0/406: chown db/d2a/d6e/d7a/l7f 14514385 1 2024-02-15T22:40:49.365 INFO:tasks.workunit.client.0.smithi033.stdout:8/370: link d1/de/d1a/d2a/d40/l5f d1/de/d1a/d27/d70/l7f 0 2024-02-15T22:40:49.367 INFO:tasks.workunit.client.0.smithi033.stdout:7/408: mknod d5/dc/d5f/d48/c87 0 2024-02-15T22:40:49.367 INFO:tasks.workunit.client.0.smithi033.stdout:4/416: getdents d8/d16/d51/d77 0 2024-02-15T22:40:49.368 INFO:tasks.workunit.client.0.smithi033.stdout:4/417: write d8/d18/d37/f5f [252443,23968] 0 2024-02-15T22:40:49.368 INFO:tasks.workunit.client.0.smithi033.stdout:4/418: read - d8/d16/d51/d1c/d3c/d3f/f6f zero size 2024-02-15T22:40:49.368 INFO:tasks.workunit.client.0.smithi033.stdout:4/419: chown d8/d18/d37/d23/d61/f65 1310594 1 2024-02-15T22:40:49.369 INFO:tasks.workunit.client.0.smithi033.stdout:0/407: rename db/d19/d32/f77 to db/d19/d32/d43/d7d/f85 0 2024-02-15T22:40:49.369 INFO:tasks.workunit.client.0.smithi033.stdout:0/408: readlink db/d19/d32/d46/l7e 0 2024-02-15T22:40:49.369 INFO:tasks.workunit.client.0.smithi033.stdout:6/365: rmdir d12/d1b/d3f/d50 39 2024-02-15T22:40:49.369 INFO:tasks.workunit.client.0.smithi033.stdout:6/366: chown d12/d3c/f4d 891863276 1 2024-02-15T22:40:49.370 INFO:tasks.workunit.client.0.smithi033.stdout:7/409: symlink d5/df/d40/l88 0 2024-02-15T22:40:49.371 INFO:tasks.workunit.client.0.smithi033.stdout:4/420: mkdir d8/d16/d4f/d8c 0 2024-02-15T22:40:49.372 INFO:tasks.workunit.client.0.smithi033.stdout:4/421: rmdir d8/d16/d51/d27 39 2024-02-15T22:40:49.373 INFO:tasks.workunit.client.0.smithi033.stdout:4/422: creat d8/d16/d51/d56/f8d x:0 0 0 2024-02-15T22:40:49.379 INFO:tasks.workunit.client.0.smithi033.stdout:8/371: read d1/de/d1a/d2a/f30 [406406,101461] 0 2024-02-15T22:40:49.381 INFO:tasks.workunit.client.0.smithi033.stdout:8/372: creat d1/d6/d14/d5d/d72/f80 x:0 0 0 2024-02-15T22:40:49.385 INFO:tasks.workunit.client.0.smithi033.stdout:7/410: dread d5/d6/d10/d16/d26/f2a [0,4194304] 0 2024-02-15T22:40:49.386 INFO:tasks.workunit.client.0.smithi033.stdout:7/411: truncate d5/df/d40/f45 3139879 0 2024-02-15T22:40:49.386 INFO:tasks.workunit.client.0.smithi033.stdout:7/412: write d5/f30 [410061,60085] 0 2024-02-15T22:40:49.386 INFO:tasks.workunit.client.0.smithi033.stdout:7/413: readlink d5/d6/l13 0 2024-02-15T22:40:49.386 INFO:tasks.workunit.client.0.smithi033.stdout:7/414: mkdir d5/df/d40/d89 0 2024-02-15T22:40:49.420 INFO:tasks.workunit.client.0.smithi033.stdout:7/415: dread d5/d6/d10/d16/d26/d3f/f65 [0,4194304] 0 2024-02-15T22:40:49.420 INFO:tasks.workunit.client.0.smithi033.stdout:7/416: chown d5/d6/d10/l2b 99000 1 2024-02-15T22:40:49.422 INFO:tasks.workunit.client.0.smithi033.stdout:7/417: rmdir d5/d78 39 2024-02-15T22:40:49.425 INFO:tasks.workunit.client.0.smithi033.stdout:7/418: mkdir d5/d78/d8a 0 2024-02-15T22:40:49.435 INFO:tasks.workunit.client.0.smithi033.stdout:2/495: dwrite d1/d8/d2b/d2f/d12/f42 [0,4194304] 0 2024-02-15T22:40:49.436 INFO:tasks.workunit.client.0.smithi033.stdout:9/379: dwrite d4/ff [8388608,4194304] 0 2024-02-15T22:40:49.436 INFO:tasks.workunit.client.0.smithi033.stdout:9/380: stat d4/d1d/d23/d35/f63 0 2024-02-15T22:40:49.436 INFO:tasks.workunit.client.0.smithi033.stdout:3/530: dwrite d0/d3/d2c/f9e [0,4194304] 0 2024-02-15T22:40:49.436 INFO:tasks.workunit.client.0.smithi033.stdout:4/423: dwrite d8/d16/f4e [0,4194304] 0 2024-02-15T22:40:49.437 INFO:tasks.workunit.client.0.smithi033.stdout:2/496: rename d1/d8/d34/f53 to d1/d8/d2b/d2f/d12/d52/f9d 0 2024-02-15T22:40:49.437 INFO:tasks.workunit.client.0.smithi033.stdout:2/497: stat d1/d8/d2b/d2f/d24/d31 0 2024-02-15T22:40:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:3/531: rmdir d0/d3/d5f 39 2024-02-15T22:40:49.442 INFO:tasks.workunit.client.0.smithi033.stdout:7/419: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:49.444 INFO:tasks.workunit.client.0.smithi033.stdout:9/381: read d4/d1d/d23/d24/f4b [2112935,33602] 0 2024-02-15T22:40:49.453 INFO:tasks.workunit.client.0.smithi033.stdout:0/409: getdents db/d19/d32/d46 0 2024-02-15T22:40:49.457 INFO:tasks.workunit.client.0.smithi033.stdout:4/424: truncate d8/f54 2613546 0 2024-02-15T22:40:49.458 INFO:tasks.workunit.client.0.smithi033.stdout:4/425: write d8/d18/f25 [195906,85688] 0 2024-02-15T22:40:49.458 INFO:tasks.workunit.client.0.smithi033.stdout:4/426: chown d8/d18/d37/d31/f48 8763 1 2024-02-15T22:40:49.459 INFO:tasks.workunit.client.0.smithi033.stdout:2/498: symlink d1/d50/d99/l9e 0 2024-02-15T22:40:49.459 INFO:tasks.workunit.client.0.smithi033.stdout:2/499: fdatasync d1/d8/d2b/d2f/d38/f95 0 2024-02-15T22:40:49.461 INFO:tasks.workunit.client.0.smithi033.stdout:3/532: symlink d0/d3/d5f/da7/la9 0 2024-02-15T22:40:49.464 INFO:tasks.workunit.client.0.smithi033.stdout:7/420: mkdir d5/dc/d5f/d8b 0 2024-02-15T22:40:49.464 INFO:tasks.workunit.client.0.smithi033.stdout:7/421: write d5/df/d40/f79 [724453,46934] 0 2024-02-15T22:40:49.466 INFO:tasks.workunit.client.0.smithi033.stdout:9/382: symlink d4/d1d/d23/d35/l66 0 2024-02-15T22:40:49.466 INFO:tasks.workunit.client.0.smithi033.stdout:9/383: write d4/d1d/f4c [591349,117162] 0 2024-02-15T22:40:49.468 INFO:tasks.workunit.client.0.smithi033.stdout:0/410: creat db/d19/d32/d43/d5a/d76/f86 x:0 0 0 2024-02-15T22:40:49.469 INFO:tasks.workunit.client.0.smithi033.stdout:4/427: symlink d8/d18/d37/d31/l8e 0 2024-02-15T22:40:49.471 INFO:tasks.workunit.client.0.smithi033.stdout:2/500: symlink d1/d8/d2b/d2f/d12/d52/l9f 0 2024-02-15T22:40:49.471 INFO:tasks.workunit.client.0.smithi033.stdout:2/501: creat d1/d8/d2b/d2f/d12/fa0 x:0 0 0 2024-02-15T22:40:49.473 INFO:tasks.workunit.client.0.smithi033.stdout:3/533: creat d0/d3/d5f/da7/faa x:0 0 0 2024-02-15T22:40:49.474 INFO:tasks.workunit.client.0.smithi033.stdout:7/422: mknod d5/dc/c8c 0 2024-02-15T22:40:49.474 INFO:tasks.workunit.client.0.smithi033.stdout:7/423: dread - d5/df/d56/d60/f6b zero size 2024-02-15T22:40:49.477 INFO:tasks.workunit.client.0.smithi033.stdout:9/384: unlink d4/d1d/f4c 0 2024-02-15T22:40:49.479 INFO:tasks.workunit.client.0.smithi033.stdout:0/411: rename db/d19/d32/d3d/f62 to db/f87 0 2024-02-15T22:40:49.479 INFO:tasks.workunit.client.0.smithi033.stdout:0/412: chown db/d19/l49 2714119 1 2024-02-15T22:40:49.479 INFO:tasks.workunit.client.0.smithi033.stdout:9/385: write d4/fd [384977,22343] 0 2024-02-15T22:40:49.480 INFO:tasks.workunit.client.0.smithi033.stdout:9/386: chown d4/d1d/d23/d35/f63 20443923 1 2024-02-15T22:40:49.480 INFO:tasks.workunit.client.0.smithi033.stdout:4/428: mkdir d8/d16/d45/d8f 0 2024-02-15T22:40:49.484 INFO:tasks.workunit.client.0.smithi033.stdout:3/534: mknod d0/d3/d5f/cab 0 2024-02-15T22:40:49.484 INFO:tasks.workunit.client.0.smithi033.stdout:3/535: stat d0/f53 0 2024-02-15T22:40:49.489 INFO:tasks.workunit.client.0.smithi033.stdout:8/373: dwrite d1/de/f37 [0,4194304] 0 2024-02-15T22:40:49.490 INFO:tasks.workunit.client.0.smithi033.stdout:7/424: link d5/d6/d10/d16/f83 d5/df/d56/d60/d59/f8d 0 2024-02-15T22:40:49.492 INFO:tasks.workunit.client.0.smithi033.stdout:0/413: unlink db/d19/d32/l3e 0 2024-02-15T22:40:49.492 INFO:tasks.workunit.client.0.smithi033.stdout:8/374: dread d1/de/f56 [0,4194304] 0 2024-02-15T22:40:49.492 INFO:tasks.workunit.client.0.smithi033.stdout:0/414: truncate db/d19/d32/d3d/f44 462451 0 2024-02-15T22:40:49.495 INFO:tasks.workunit.client.0.smithi033.stdout:4/429: mknod d8/d16/d51/d71/c90 0 2024-02-15T22:40:49.496 INFO:tasks.workunit.client.0.smithi033.stdout:3/536: mkdir d0/d3/d2c/d5d/d3d/d57/d68/dac 0 2024-02-15T22:40:49.500 INFO:tasks.workunit.client.0.smithi033.stdout:9/387: dwrite d4/d1d/d23/f47 [0,4194304] 0 2024-02-15T22:40:49.500 INFO:tasks.workunit.client.0.smithi033.stdout:9/388: creat d4/d1d/d23/d32/f67 x:0 0 0 2024-02-15T22:40:49.501 INFO:tasks.workunit.client.0.smithi033.stdout:7/425: link d5/dc/d5f/d48/l77 d5/l8e 0 2024-02-15T22:40:49.501 INFO:tasks.workunit.client.0.smithi033.stdout:7/426: write d5/df/d56/d60/d59/f85 [578331,79865] 0 2024-02-15T22:40:49.505 INFO:tasks.workunit.client.0.smithi033.stdout:8/375: dread d1/de/d1a/d27/f7c [0,4194304] 0 2024-02-15T22:40:49.505 INFO:tasks.workunit.client.0.smithi033.stdout:8/376: write d1/de/d1a/d2a/f6f [5240786,18080] 0 2024-02-15T22:40:49.505 INFO:tasks.workunit.client.0.smithi033.stdout:3/537: rename d0/d3/d5f/cab to d0/d3/dd/cad 0 2024-02-15T22:40:49.505 INFO:tasks.workunit.client.0.smithi033.stdout:3/538: stat d0/c9f 0 2024-02-15T22:40:49.508 INFO:tasks.workunit.client.0.smithi033.stdout:4/430: dread d8/d18/d37/d23/d61/f65 [0,4194304] 0 2024-02-15T22:40:49.509 INFO:tasks.workunit.client.0.smithi033.stdout:9/389: mknod d4/d1d/c68 0 2024-02-15T22:40:49.509 INFO:tasks.workunit.client.0.smithi033.stdout:9/390: fdatasync d4/f43 0 2024-02-15T22:40:49.509 INFO:tasks.workunit.client.0.smithi033.stdout:9/391: readlink d4/d1d/l33 0 2024-02-15T22:40:49.509 INFO:tasks.workunit.client.0.smithi033.stdout:9/392: chown d4/d1d/d23/f61 313245463 1 2024-02-15T22:40:49.509 INFO:tasks.workunit.client.0.smithi033.stdout:9/393: fdatasync d4/fc 0 2024-02-15T22:40:49.509 INFO:tasks.workunit.client.0.smithi033.stdout:9/394: chown d4/d1d/d23/d32/d3e 42817672 1 2024-02-15T22:40:49.509 INFO:tasks.workunit.client.0.smithi033.stdout:7/427: link d5/d6/f7 d5/d6/d10/d16/f8f 0 2024-02-15T22:40:49.510 INFO:tasks.workunit.client.0.smithi033.stdout:8/377: write d1/d6/f6c [1035499,113883] 0 2024-02-15T22:40:49.511 INFO:tasks.workunit.client.0.smithi033.stdout:8/378: read - d1/de/d1a/f69 zero size 2024-02-15T22:40:49.511 INFO:tasks.workunit.client.0.smithi033.stdout:8/379: readlink d1/de/d1a/l26 0 2024-02-15T22:40:49.511 INFO:tasks.workunit.client.0.smithi033.stdout:8/380: chown d1/de/d1a/d27/f7c 39675278 1 2024-02-15T22:40:49.511 INFO:tasks.workunit.client.0.smithi033.stdout:0/415: dwrite f4 [4194304,4194304] 0 2024-02-15T22:40:49.512 INFO:tasks.workunit.client.0.smithi033.stdout:3/539: mknod d0/d8c/cae 0 2024-02-15T22:40:49.513 INFO:tasks.workunit.client.0.smithi033.stdout:4/431: dread d8/d18/d37/d23/f30 [0,4194304] 0 2024-02-15T22:40:49.513 INFO:tasks.workunit.client.0.smithi033.stdout:4/432: creat d8/d1a/f91 x:0 0 0 2024-02-15T22:40:49.513 INFO:tasks.workunit.client.0.smithi033.stdout:4/433: fsync d8/d18/f68 0 2024-02-15T22:40:49.519 INFO:tasks.workunit.client.0.smithi033.stdout:8/381: dread d1/f33 [0,4194304] 0 2024-02-15T22:40:49.519 INFO:tasks.workunit.client.0.smithi033.stdout:8/382: readlink d1/de/d1a/d2a/l39 0 2024-02-15T22:40:49.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/395: write d4/f19 [2191354,94540] 0 2024-02-15T22:40:49.520 INFO:tasks.workunit.client.0.smithi033.stdout:7/428: creat d5/dc/f90 x:0 0 0 2024-02-15T22:40:49.522 INFO:tasks.workunit.client.0.smithi033.stdout:8/383: dread d1/f33 [0,4194304] 0 2024-02-15T22:40:49.524 INFO:tasks.workunit.client.0.smithi033.stdout:0/416: unlink db/d19/d32/d43/d5a/l75 0 2024-02-15T22:40:49.527 INFO:tasks.workunit.client.0.smithi033.stdout:4/434: link d8/d16/d45/l6d d8/d1a/l92 0 2024-02-15T22:40:49.531 INFO:tasks.workunit.client.0.smithi033.stdout:9/396: creat d4/d1d/d23/d24/d5e/f69 x:0 0 0 2024-02-15T22:40:49.533 INFO:tasks.workunit.client.0.smithi033.stdout:7/429: dwrite d5/d6/d10/f34 [0,4194304] 0 2024-02-15T22:40:49.534 INFO:tasks.workunit.client.0.smithi033.stdout:8/384: link d1/d68/d1d/d4a/c67 d1/de/c81 0 2024-02-15T22:40:49.537 INFO:tasks.workunit.client.0.smithi033.stdout:0/417: link db/d19/l27 db/d19/l88 0 2024-02-15T22:40:49.537 INFO:tasks.workunit.client.0.smithi033.stdout:0/418: write db/d19/d32/d43/d7d/f85 [1006961,69464] 0 2024-02-15T22:40:49.538 INFO:tasks.workunit.client.0.smithi033.stdout:4/435: mkdir d8/d16/d45/d8f/d93 0 2024-02-15T22:40:49.540 INFO:tasks.workunit.client.0.smithi033.stdout:7/430: unlink d5/df/d40/f45 0 2024-02-15T22:40:49.541 INFO:tasks.workunit.client.0.smithi033.stdout:8/385: symlink d1/d68/d1d/d4a/d4c/l82 0 2024-02-15T22:40:49.542 INFO:tasks.workunit.client.0.smithi033.stdout:0/419: mknod db/d19/d32/d43/d7d/c89 0 2024-02-15T22:40:49.543 INFO:tasks.workunit.client.0.smithi033.stdout:4/436: rename d8/d16/d51/d1c/d3c/d3f/d75 to d8/d16/d51/d1c/d94 0 2024-02-15T22:40:49.545 INFO:tasks.workunit.client.0.smithi033.stdout:9/397: dwrite d4/d1d/d23/f3d [0,4194304] 0 2024-02-15T22:40:49.546 INFO:tasks.workunit.client.0.smithi033.stdout:8/386: rmdir d1/d68/d1d/d4a 39 2024-02-15T22:40:49.549 INFO:tasks.workunit.client.0.smithi033.stdout:0/420: link db/d19/d32/f23 db/d2a/d6e/d7a/f8a 0 2024-02-15T22:40:49.549 INFO:tasks.workunit.client.0.smithi033.stdout:0/421: fsync db/d19/d32/d46/f4f 0 2024-02-15T22:40:49.551 INFO:tasks.workunit.client.0.smithi033.stdout:4/437: mknod d8/d16/d51/d77/c95 0 2024-02-15T22:40:49.554 INFO:tasks.workunit.client.0.smithi033.stdout:9/398: creat d4/d1d/d23/d24/f6a x:0 0 0 2024-02-15T22:40:49.558 INFO:tasks.workunit.client.0.smithi033.stdout:0/422: unlink db/d19/f21 0 2024-02-15T22:40:49.558 INFO:tasks.workunit.client.0.smithi033.stdout:0/423: fsync db/d19/d32/d43/d7d/f82 0 2024-02-15T22:40:49.558 INFO:tasks.workunit.client.0.smithi033.stdout:8/387: dread d1/d6/f7 [0,4194304] 0 2024-02-15T22:40:49.562 INFO:tasks.workunit.client.0.smithi033.stdout:9/399: link d4/d1d/d23/d32/c40 d4/d1d/d23/d35/c6b 0 2024-02-15T22:40:49.563 INFO:tasks.workunit.client.0.smithi033.stdout:8/388: mkdir d1/de/d13/d75/d83 0 2024-02-15T22:40:49.564 INFO:tasks.workunit.client.0.smithi033.stdout:8/389: getdents d1/de/d13/d75/d83 0 2024-02-15T22:40:49.568 INFO:tasks.workunit.client.0.smithi033.stdout:9/400: mknod d4/d1d/d23/d32/d3e/c6c 0 2024-02-15T22:40:49.571 INFO:tasks.workunit.client.0.smithi033.stdout:4/438: rename d8/d16/d4f to d8/d16/d51/d1c/d96 0 2024-02-15T22:40:49.572 INFO:tasks.workunit.client.0.smithi033.stdout:4/439: unlink d8/d16/d51/d1c/d3c/d3f/f8a 0 2024-02-15T22:40:49.575 INFO:tasks.workunit.client.0.smithi033.stdout:9/401: write d4/d1d/d23/d24/f2b [3056157,82857] 0 2024-02-15T22:40:49.577 INFO:tasks.workunit.client.0.smithi033.stdout:9/402: rename d4/d1d/d23/f3d to d4/d1d/d23/d24/d5f/f6d 0 2024-02-15T22:40:49.580 INFO:tasks.workunit.client.0.smithi033.stdout:9/403: link d4/d1d/d23/d32/d3e/f4d d4/d1d/d23/d35/d38/d3f/f6e 0 2024-02-15T22:40:49.580 INFO:tasks.workunit.client.0.smithi033.stdout:9/404: creat d4/f6f x:0 0 0 2024-02-15T22:40:49.581 INFO:tasks.workunit.client.0.smithi033.stdout:9/405: creat d4/d1d/f70 x:0 0 0 2024-02-15T22:40:49.589 INFO:tasks.workunit.client.0.smithi033.stdout:7/431: getdents d5/df/d40 0 2024-02-15T22:40:49.591 INFO:tasks.workunit.client.0.smithi033.stdout:4/440: dwrite d8/f54 [0,4194304] 0 2024-02-15T22:40:49.592 INFO:tasks.workunit.client.0.smithi033.stdout:4/441: mkdir d8/d16/d97 0 2024-02-15T22:40:49.595 INFO:tasks.workunit.client.0.smithi033.stdout:7/432: dread d5/df/d56/f63 [0,4194304] 0 2024-02-15T22:40:49.595 INFO:tasks.workunit.client.0.smithi033.stdout:9/406: dread d4/ff [8388608,4194304] 0 2024-02-15T22:40:49.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/407: mkdir d4/d1d/d23/d32/d71 0 2024-02-15T22:40:49.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/408: truncate d4/d1d/f57 933248 0 2024-02-15T22:40:49.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/409: truncate d4/d1d/d23/d35/d38/d3f/f6e 1946372 0 2024-02-15T22:40:49.601 INFO:tasks.workunit.client.0.smithi033.stdout:4/442: dread d8/d16/d51/f44 [0,4194304] 0 2024-02-15T22:40:49.603 INFO:tasks.workunit.client.0.smithi033.stdout:4/443: write d8/d18/d37/d31/f42 [560761,10148] 0 2024-02-15T22:40:49.606 INFO:tasks.workunit.client.0.smithi033.stdout:9/410: rename d4/d1d/d23/d24/d5f to d4/d1d/d23/d24/d5a/d72 0 2024-02-15T22:40:49.606 INFO:tasks.workunit.client.0.smithi033.stdout:9/411: fdatasync d4/f3b 0 2024-02-15T22:40:49.611 INFO:tasks.workunit.client.0.smithi033.stdout:9/412: symlink d4/d1d/d23/d24/d51/l73 0 2024-02-15T22:40:49.612 INFO:tasks.workunit.client.0.smithi033.stdout:4/444: rmdir d8/d1a 39 2024-02-15T22:40:49.614 INFO:tasks.workunit.client.0.smithi033.stdout:9/413: mknod d4/d1d/d23/d32/d3e/c74 0 2024-02-15T22:40:49.617 INFO:tasks.workunit.client.0.smithi033.stdout:9/414: link d4/d1d/d23/d35/d38/d3f/f6e d4/f75 0 2024-02-15T22:40:49.623 INFO:tasks.workunit.client.0.smithi033.stdout:4/445: rmdir d8/d18/d37 39 2024-02-15T22:40:49.624 INFO:tasks.workunit.client.0.smithi033.stdout:4/446: creat d8/d69/f98 x:0 0 0 2024-02-15T22:40:49.626 INFO:tasks.workunit.client.0.smithi033.stdout:4/447: mkdir d8/d16/d51/d1c/d99 0 2024-02-15T22:40:49.626 INFO:tasks.workunit.client.0.smithi033.stdout:4/448: read d8/d16/d51/d1c/f7e [400266,47070] 0 2024-02-15T22:40:49.634 INFO:tasks.workunit.client.0.smithi033.stdout:9/415: dwrite d4/d1d/d23/f47 [0,4194304] 0 2024-02-15T22:40:49.639 INFO:tasks.workunit.client.0.smithi033.stdout:4/449: dread d8/d18/d37/d31/f42 [0,4194304] 0 2024-02-15T22:40:49.639 INFO:tasks.workunit.client.0.smithi033.stdout:4/450: chown d8/d16/d45/d8f 1259459135 1 2024-02-15T22:40:49.639 INFO:tasks.workunit.client.0.smithi033.stdout:4/451: truncate f5 5795908 0 2024-02-15T22:40:49.639 INFO:tasks.workunit.client.0.smithi033.stdout:4/452: readlink d8/d18/d37/d31/l8e 0 2024-02-15T22:40:49.641 INFO:tasks.workunit.client.0.smithi033.stdout:4/453: rename d8/d16/l3a to d8/d1a/l9a 0 2024-02-15T22:40:49.659 INFO:tasks.workunit.client.0.smithi033.stdout:4/454: dwrite d8/d69/f98 [0,4194304] 0 2024-02-15T22:40:49.659 INFO:tasks.workunit.client.0.smithi033.stdout:4/455: truncate d8/d1a/f87 658012 0 2024-02-15T22:40:49.660 INFO:tasks.workunit.client.0.smithi033.stdout:4/456: chown d8/d16/d45/c8b 1 1 2024-02-15T22:40:49.660 INFO:tasks.workunit.client.0.smithi033.stdout:9/416: dwrite d4/f60 [0,4194304] 0 2024-02-15T22:40:49.660 INFO:tasks.workunit.client.0.smithi033.stdout:9/417: creat d4/d1d/d23/d32/d3e/f76 x:0 0 0 2024-02-15T22:40:49.660 INFO:tasks.workunit.client.0.smithi033.stdout:9/418: truncate d4/d1d/d23/d35/f50 461839 0 2024-02-15T22:40:49.662 INFO:tasks.workunit.client.0.smithi033.stdout:4/457: mknod d8/d18/c9b 0 2024-02-15T22:40:49.662 INFO:tasks.workunit.client.0.smithi033.stdout:4/458: creat d8/d69/f9c x:0 0 0 2024-02-15T22:40:49.664 INFO:tasks.workunit.client.0.smithi033.stdout:9/419: link d4/ff d4/d1d/d23/d35/f77 0 2024-02-15T22:40:49.665 INFO:tasks.workunit.client.0.smithi033.stdout:9/420: dread d4/f15 [0,4194304] 0 2024-02-15T22:40:49.667 INFO:tasks.workunit.client.0.smithi033.stdout:4/459: mknod d8/d18/d37/d23/c9d 0 2024-02-15T22:40:49.668 INFO:tasks.workunit.client.0.smithi033.stdout:4/460: creat d8/d16/f9e x:0 0 0 2024-02-15T22:40:49.670 INFO:tasks.workunit.client.0.smithi033.stdout:4/461: mkdir d8/d16/d45/d8f/d93/d9f 0 2024-02-15T22:40:49.670 INFO:tasks.workunit.client.0.smithi033.stdout:4/462: chown d8/f54 979769 1 2024-02-15T22:40:49.676 INFO:tasks.workunit.client.0.smithi033.stdout:4/463: rename d8/d18/d37/d31/f59 to d8/d16/d51/d77/fa0 0 2024-02-15T22:40:49.677 INFO:tasks.workunit.client.0.smithi033.stdout:4/464: truncate d8/d16/d51/d1c/d3c/f4d 2647123 0 2024-02-15T22:40:49.683 INFO:tasks.workunit.client.0.smithi033.stdout:9/421: dwrite d4/d1d/f3c [4194304,4194304] 0 2024-02-15T22:40:49.683 INFO:tasks.workunit.client.0.smithi033.stdout:9/422: write d4/d1d/d23/d35/f63 [747434,57991] 0 2024-02-15T22:40:49.683 INFO:tasks.workunit.client.0.smithi033.stdout:9/423: dread - d4/d1d/d23/d35/d38/f53 zero size 2024-02-15T22:40:49.705 INFO:tasks.workunit.client.0.smithi033.stdout:4/465: dwrite d8/d16/d51/d1c/f32 [0,4194304] 0 2024-02-15T22:40:49.705 INFO:tasks.workunit.client.0.smithi033.stdout:4/466: write f4 [1239499,92826] 0 2024-02-15T22:40:49.707 INFO:tasks.workunit.client.0.smithi033.stdout:9/424: dwrite d4/fd [0,4194304] 0 2024-02-15T22:40:49.735 INFO:tasks.workunit.client.0.smithi033.stdout:9/425: dwrite d4/d1d/d23/d35/f63 [0,4194304] 0 2024-02-15T22:40:49.735 INFO:tasks.workunit.client.0.smithi033.stdout:4/467: dwrite d8/d16/d51/d1c/f32 [0,4194304] 0 2024-02-15T22:40:49.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/426: creat d4/d1d/d23/d35/d38/f78 x:0 0 0 2024-02-15T22:40:49.738 INFO:tasks.workunit.client.0.smithi033.stdout:9/427: creat d4/d1d/d23/d32/f79 x:0 0 0 2024-02-15T22:40:49.738 INFO:tasks.workunit.client.0.smithi033.stdout:9/428: creat d4/d1d/f7a x:0 0 0 2024-02-15T22:40:49.738 INFO:tasks.workunit.client.0.smithi033.stdout:4/468: mkdir d8/d16/d51/d1c/d50/da1 0 2024-02-15T22:40:49.743 INFO:tasks.workunit.client.0.smithi033.stdout:9/429: unlink d4/d1d/d23/d24/l28 0 2024-02-15T22:40:49.744 INFO:tasks.workunit.client.0.smithi033.stdout:4/469: mknod d8/ca2 0 2024-02-15T22:40:49.746 INFO:tasks.workunit.client.0.smithi033.stdout:9/430: mkdir d4/d1d/d23/d7b 0 2024-02-15T22:40:49.748 INFO:tasks.workunit.client.0.smithi033.stdout:9/431: rename d4/d1d/f57 to d4/d1d/d23/f7c 0 2024-02-15T22:40:49.749 INFO:tasks.workunit.client.0.smithi033.stdout:9/432: mknod d4/d1d/d23/d24/d5a/c7d 0 2024-02-15T22:40:49.749 INFO:tasks.workunit.client.0.smithi033.stdout:9/433: chown d4/d1d/d23/d7b 2804 1 2024-02-15T22:40:49.765 INFO:tasks.workunit.client.0.smithi033.stdout:9/434: dwrite d4/d1d/d23/d32/d3e/f64 [0,4194304] 0 2024-02-15T22:40:49.765 INFO:tasks.workunit.client.0.smithi033.stdout:9/435: readlink d4/l17 0 2024-02-15T22:40:49.765 INFO:tasks.workunit.client.0.smithi033.stdout:4/470: dwrite d8/d18/d37/d31/f83 [0,4194304] 0 2024-02-15T22:40:49.770 INFO:tasks.workunit.client.0.smithi033.stdout:4/471: dread d8/d18/d37/d23/f30 [0,4194304] 0 2024-02-15T22:40:49.771 INFO:tasks.workunit.client.0.smithi033.stdout:4/472: chown d8/f54 18 1 2024-02-15T22:40:49.774 INFO:tasks.workunit.client.0.smithi033.stdout:9/436: read d4/d1d/d23/d32/f4f [4075088,36840] 0 2024-02-15T22:40:49.776 INFO:tasks.workunit.client.0.smithi033.stdout:9/437: creat d4/d1d/d23/d24/d5a/d72/f7e x:0 0 0 2024-02-15T22:40:49.776 INFO:tasks.workunit.client.0.smithi033.stdout:4/473: dread d8/d18/d37/d23/d61/f65 [0,4194304] 0 2024-02-15T22:40:49.776 INFO:tasks.workunit.client.0.smithi033.stdout:9/438: symlink d4/d1d/d23/d7b/l7f 0 2024-02-15T22:40:49.778 INFO:tasks.workunit.client.0.smithi033.stdout:4/474: mknod d8/d1a/ca3 0 2024-02-15T22:40:49.778 INFO:tasks.workunit.client.0.smithi033.stdout:4/475: creat d8/d16/d51/d1c/d3c/d49/fa4 x:0 0 0 2024-02-15T22:40:49.781 INFO:tasks.workunit.client.0.smithi033.stdout:9/439: rename d4/d1d/f52 to d4/d1d/d23/d24/d5a/f80 0 2024-02-15T22:40:49.784 INFO:tasks.workunit.client.0.smithi033.stdout:9/440: dread d4/d1d/d23/d32/f4f [0,4194304] 0 2024-02-15T22:40:49.784 INFO:tasks.workunit.client.0.smithi033.stdout:4/476: getdents d8/d18/d37/d23/d61 0 2024-02-15T22:40:49.805 INFO:tasks.workunit.client.0.smithi033.stdout:2/502: sync 2024-02-15T22:40:49.805 INFO:tasks.workunit.client.0.smithi033.stdout:5/491: sync 2024-02-15T22:40:49.805 INFO:tasks.workunit.client.0.smithi033.stdout:6/367: sync 2024-02-15T22:40:49.805 INFO:tasks.workunit.client.0.smithi033.stdout:1/374: sync 2024-02-15T22:40:49.805 INFO:tasks.workunit.client.0.smithi033.stdout:5/492: stat d6/d14/d31/d50/d6a 0 2024-02-15T22:40:49.806 INFO:tasks.workunit.client.0.smithi033.stdout:6/368: readlink d12/d2c/d30/l51 0 2024-02-15T22:40:49.806 INFO:tasks.workunit.client.0.smithi033.stdout:6/369: fdatasync d12/d2c/d30/f3d 0 2024-02-15T22:40:49.806 INFO:tasks.workunit.client.0.smithi033.stdout:4/477: dwrite d8/ff [0,4194304] 0 2024-02-15T22:40:49.806 INFO:tasks.workunit.client.0.smithi033.stdout:4/478: readlink d8/d16/d51/d1c/d3c/d49/l7c 0 2024-02-15T22:40:49.806 INFO:tasks.workunit.client.0.smithi033.stdout:6/370: symlink d12/d3c/l7a 0 2024-02-15T22:40:49.807 INFO:tasks.workunit.client.0.smithi033.stdout:9/441: dwrite d4/d1d/d23/f61 [0,4194304] 0 2024-02-15T22:40:49.807 INFO:tasks.workunit.client.0.smithi033.stdout:9/442: dread - d4/d1d/d23/d24/f6a zero size 2024-02-15T22:40:49.819 INFO:tasks.workunit.client.0.smithi033.stdout:4/479: dread d8/d16/d51/d27/f5c [0,4194304] 0 2024-02-15T22:40:49.819 INFO:tasks.workunit.client.0.smithi033.stdout:4/480: readlink d8/d16/l33 0 2024-02-15T22:40:49.822 INFO:tasks.workunit.client.0.smithi033.stdout:9/443: write d4/d1d/f3c [6287100,80027] 0 2024-02-15T22:40:49.823 INFO:tasks.workunit.client.0.smithi033.stdout:4/481: read d8/d18/f68 [56307,123435] 0 2024-02-15T22:40:49.824 INFO:tasks.workunit.client.0.smithi033.stdout:9/444: symlink d4/d1d/d23/d32/l81 0 2024-02-15T22:40:49.824 INFO:tasks.workunit.client.0.smithi033.stdout:5/493: read d6/d14/d31/d48/f69 [2838557,20963] 0 2024-02-15T22:40:49.824 INFO:tasks.workunit.client.0.smithi033.stdout:5/494: write d6/d14/d31/d48/d49/d53/d57/f61 [1869300,126122] 0 2024-02-15T22:40:49.824 INFO:tasks.workunit.client.0.smithi033.stdout:5/495: fsync d6/d14/f1c 0 2024-02-15T22:40:49.824 INFO:tasks.workunit.client.0.smithi033.stdout:5/496: write d6/f42 [1546041,27611] 0 2024-02-15T22:40:49.825 INFO:tasks.workunit.client.0.smithi033.stdout:4/482: mkdir d8/d18/d37/d31/da5 0 2024-02-15T22:40:49.825 INFO:tasks.workunit.client.0.smithi033.stdout:9/445: symlink d4/d1d/d23/d32/d71/l82 0 2024-02-15T22:40:49.827 INFO:tasks.workunit.client.0.smithi033.stdout:5/497: mkdir d6/d14/d31/d48/d49/d53/d57/da1 0 2024-02-15T22:40:49.827 INFO:tasks.workunit.client.0.smithi033.stdout:4/483: creat d8/fa6 x:0 0 0 2024-02-15T22:40:49.829 INFO:tasks.workunit.client.0.smithi033.stdout:9/446: unlink d4/d1d/d23/d35/f50 0 2024-02-15T22:40:49.831 INFO:tasks.workunit.client.0.smithi033.stdout:9/447: mkdir d4/d1d/d83 0 2024-02-15T22:40:49.831 INFO:tasks.workunit.client.0.smithi033.stdout:5/498: write d6/d25/f55 [732895,72482] 0 2024-02-15T22:40:49.832 INFO:tasks.workunit.client.0.smithi033.stdout:9/448: symlink d4/d1d/d23/d35/l84 0 2024-02-15T22:40:49.832 INFO:tasks.workunit.client.0.smithi033.stdout:9/449: write d4/f75 [2273516,19912] 0 2024-02-15T22:40:49.833 INFO:tasks.workunit.client.0.smithi033.stdout:5/499: rename d6/d14/d31/d38/d3f/d86 to d6/d14/d31/d48/da2 0 2024-02-15T22:40:49.833 INFO:tasks.workunit.client.0.smithi033.stdout:5/500: dread - d6/d14/d43/f94 zero size 2024-02-15T22:40:49.834 INFO:tasks.workunit.client.0.smithi033.stdout:1/375: dwrite d1/de/d27/d39/d3a/f71 [0,4194304] 0 2024-02-15T22:40:49.834 INFO:tasks.workunit.client.0.smithi033.stdout:1/376: fdatasync d1/fa 0 2024-02-15T22:40:49.834 INFO:tasks.workunit.client.0.smithi033.stdout:6/371: dwrite d12/d1b/f52 [0,4194304] 0 2024-02-15T22:40:49.834 INFO:tasks.workunit.client.0.smithi033.stdout:6/372: dread - d12/d2c/d30/f72 zero size 2024-02-15T22:40:49.835 INFO:tasks.workunit.client.0.smithi033.stdout:2/503: dwrite d1/d16/d5a/f7b [0,4194304] 0 2024-02-15T22:40:49.838 INFO:tasks.workunit.client.0.smithi033.stdout:6/373: symlink d12/d3c/l7b 0 2024-02-15T22:40:49.838 INFO:tasks.workunit.client.0.smithi033.stdout:6/374: creat d12/d1b/d3f/d5b/f7c x:0 0 0 2024-02-15T22:40:49.838 INFO:tasks.workunit.client.0.smithi033.stdout:6/375: dread - d12/d1b/f6c zero size 2024-02-15T22:40:49.841 INFO:tasks.workunit.client.0.smithi033.stdout:9/450: dread d4/d1d/f2c [0,4194304] 0 2024-02-15T22:40:49.844 INFO:tasks.workunit.client.0.smithi033.stdout:2/504: mknod d1/d66/ca1 0 2024-02-15T22:40:49.846 INFO:tasks.workunit.client.0.smithi033.stdout:1/377: write d1/f7 [1358795,5653] 0 2024-02-15T22:40:49.846 INFO:tasks.workunit.client.0.smithi033.stdout:5/501: write d6/d14/f6e [1945331,61580] 0 2024-02-15T22:40:49.847 INFO:tasks.workunit.client.0.smithi033.stdout:6/376: rename d12/d2c/l5a to d12/d2c/d30/d19/d79/l7d 0 2024-02-15T22:40:49.847 INFO:tasks.workunit.client.0.smithi033.stdout:6/377: chown d12/f41 419084628 1 2024-02-15T22:40:49.847 INFO:tasks.workunit.client.0.smithi033.stdout:4/484: dwrite d8/d16/d45/f73 [0,4194304] 0 2024-02-15T22:40:49.849 INFO:tasks.workunit.client.0.smithi033.stdout:4/485: dread d8/d16/d51/d1c/f7e [0,4194304] 0 2024-02-15T22:40:49.849 INFO:tasks.workunit.client.0.smithi033.stdout:4/486: write d8/d18/d37/d23/f5b [940533,105029] 0 2024-02-15T22:40:49.851 INFO:tasks.workunit.client.0.smithi033.stdout:2/505: write d1/d8/d2b/d2f/d13/f17 [1126378,100874] 0 2024-02-15T22:40:49.853 INFO:tasks.workunit.client.0.smithi033.stdout:9/451: write d4/d1d/d23/f61 [59199,89530] 0 2024-02-15T22:40:49.856 INFO:tasks.workunit.client.0.smithi033.stdout:6/378: unlink d12/d3c/f69 0 2024-02-15T22:40:49.856 INFO:tasks.workunit.client.0.smithi033.stdout:6/379: creat d12/d2c/d30/f7e x:0 0 0 2024-02-15T22:40:49.856 INFO:tasks.workunit.client.0.smithi033.stdout:6/380: dread - d12/f28 zero size 2024-02-15T22:40:49.860 INFO:tasks.workunit.client.0.smithi033.stdout:5/502: write d6/fe [5010887,106267] 0 2024-02-15T22:40:49.860 INFO:tasks.workunit.client.0.smithi033.stdout:5/503: stat d6/lc 0 2024-02-15T22:40:49.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/487: unlink d8/d18/d37/d31/d47/c84 0 2024-02-15T22:40:49.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/488: fsync d8/d16/d51/d1c/d3c/d3f/f6f 0 2024-02-15T22:40:49.863 INFO:tasks.workunit.client.0.smithi033.stdout:9/452: unlink d4/d1d/d23/c5b 0 2024-02-15T22:40:49.865 INFO:tasks.workunit.client.0.smithi033.stdout:4/489: dread d8/d18/d37/d31/f48 [0,4194304] 0 2024-02-15T22:40:49.865 INFO:tasks.workunit.client.0.smithi033.stdout:4/490: creat d8/d16/d51/fa7 x:0 0 0 2024-02-15T22:40:49.866 INFO:tasks.workunit.client.0.smithi033.stdout:6/381: unlink d12/d2c/d30/f62 0 2024-02-15T22:40:49.867 INFO:tasks.workunit.client.0.smithi033.stdout:9/453: mknod d4/d1d/d23/d32/d71/c85 0 2024-02-15T22:40:49.869 INFO:tasks.workunit.client.0.smithi033.stdout:4/491: mknod d8/d16/d51/d1c/d96/ca8 0 2024-02-15T22:40:49.869 INFO:tasks.workunit.client.0.smithi033.stdout:4/492: chown d8/d16/d45 924 1 2024-02-15T22:40:49.871 INFO:tasks.workunit.client.0.smithi033.stdout:9/454: rename d4/d1d/d23/d35/d38 to d4/d1d/d23/d32/d3e/d86 0 2024-02-15T22:40:49.871 INFO:tasks.workunit.client.0.smithi033.stdout:9/455: creat d4/d1d/d23/d35/f87 x:0 0 0 2024-02-15T22:40:49.871 INFO:tasks.workunit.client.0.smithi033.stdout:9/456: chown d4/d1d/d23/d24/d5e/f69 1508388 1 2024-02-15T22:40:49.872 INFO:tasks.workunit.client.0.smithi033.stdout:4/493: mkdir d8/d18/d37/d31/da5/da9 0 2024-02-15T22:40:49.873 INFO:tasks.workunit.client.0.smithi033.stdout:1/378: dwrite d1/d20/d42/f49 [0,4194304] 0 2024-02-15T22:40:49.873 INFO:tasks.workunit.client.0.smithi033.stdout:1/379: chown d1/de/d27/d28/d2d/l50 3037397 1 2024-02-15T22:40:49.873 INFO:tasks.workunit.client.0.smithi033.stdout:2/506: dwrite d1/d50/f82 [0,4194304] 0 2024-02-15T22:40:49.875 INFO:tasks.workunit.client.0.smithi033.stdout:9/457: unlink d4/d1d/d23/d24/d51/l73 0 2024-02-15T22:40:49.876 INFO:tasks.workunit.client.0.smithi033.stdout:4/494: creat d8/d18/d37/faa x:0 0 0 2024-02-15T22:40:49.878 INFO:tasks.workunit.client.0.smithi033.stdout:5/504: dread d6/d14/f2e [0,4194304] 0 2024-02-15T22:40:49.878 INFO:tasks.workunit.client.0.smithi033.stdout:5/505: read d6/d14/f45 [268368,97360] 0 2024-02-15T22:40:49.878 INFO:tasks.workunit.client.0.smithi033.stdout:1/380: symlink d1/d20/d42/d25/l74 0 2024-02-15T22:40:49.880 INFO:tasks.workunit.client.0.smithi033.stdout:6/382: getdents d12/d1b/d3f/d5b 0 2024-02-15T22:40:49.880 INFO:tasks.workunit.client.0.smithi033.stdout:6/383: write d12/d2c/d30/f72 [811049,60219] 0 2024-02-15T22:40:49.884 INFO:tasks.workunit.client.0.smithi033.stdout:6/384: dread d12/d2c/d30/f49 [0,4194304] 0 2024-02-15T22:40:49.885 INFO:tasks.workunit.client.0.smithi033.stdout:2/507: dread d1/d8/d2b/d2f/d24/d31/f81 [0,4194304] 0 2024-02-15T22:40:49.890 INFO:tasks.workunit.client.0.smithi033.stdout:3/540: sync 2024-02-15T22:40:49.890 INFO:tasks.workunit.client.0.smithi033.stdout:0/424: sync 2024-02-15T22:40:49.891 INFO:tasks.workunit.client.0.smithi033.stdout:6/385: link d12/f28 d12/d2c/d30/d1d/f7f 0 2024-02-15T22:40:49.893 INFO:tasks.workunit.client.0.smithi033.stdout:6/386: dread d12/d2c/d30/d1d/f22 [0,4194304] 0 2024-02-15T22:40:49.893 INFO:tasks.workunit.client.0.smithi033.stdout:7/433: sync 2024-02-15T22:40:49.893 INFO:tasks.workunit.client.0.smithi033.stdout:7/434: write d5/d78/d7b/f7c [167996,110564] 0 2024-02-15T22:40:49.893 INFO:tasks.workunit.client.0.smithi033.stdout:8/390: sync 2024-02-15T22:40:49.894 INFO:tasks.workunit.client.0.smithi033.stdout:2/508: creat d1/fa2 x:0 0 0 2024-02-15T22:40:49.894 INFO:tasks.workunit.client.0.smithi033.stdout:2/509: readlink d1/l6d 0 2024-02-15T22:40:49.894 INFO:tasks.workunit.client.0.smithi033.stdout:2/510: chown d1/l6d 87 1 2024-02-15T22:40:49.894 INFO:tasks.workunit.client.0.smithi033.stdout:2/511: truncate d1/d8/d2b/d2f/d12/fa0 114126 0 2024-02-15T22:40:49.895 INFO:tasks.workunit.client.0.smithi033.stdout:1/381: dread d1/f7 [8388608,4194304] 0 2024-02-15T22:40:49.895 INFO:tasks.workunit.client.0.smithi033.stdout:1/382: creat d1/de/d27/d39/d3a/f75 x:0 0 0 2024-02-15T22:40:49.898 INFO:tasks.workunit.client.0.smithi033.stdout:3/541: creat d0/d3/d2c/d5d/d3d/d8f/faf x:0 0 0 2024-02-15T22:40:49.898 INFO:tasks.workunit.client.0.smithi033.stdout:9/458: dwrite d4/d1d/d23/d32/d3e/f44 [0,4194304] 0 2024-02-15T22:40:49.899 INFO:tasks.workunit.client.0.smithi033.stdout:0/425: mkdir db/d2a/d68/d8b 0 2024-02-15T22:40:49.900 INFO:tasks.workunit.client.0.smithi033.stdout:7/435: symlink d5/dc/l91 0 2024-02-15T22:40:49.900 INFO:tasks.workunit.client.0.smithi033.stdout:7/436: chown d5/d6/d10/d16/d26 767720 1 2024-02-15T22:40:49.901 INFO:tasks.workunit.client.0.smithi033.stdout:5/506: dwrite d6/d14/d31/f36 [0,4194304] 0 2024-02-15T22:40:49.901 INFO:tasks.workunit.client.0.smithi033.stdout:5/507: dread - d6/d14/d43/d70/f78 zero size 2024-02-15T22:40:49.901 INFO:tasks.workunit.client.0.smithi033.stdout:5/508: dread - d6/d14/d43/d70/f78 zero size 2024-02-15T22:40:49.902 INFO:tasks.workunit.client.0.smithi033.stdout:5/509: fsync d6/f16 0 2024-02-15T22:40:49.902 INFO:tasks.workunit.client.0.smithi033.stdout:5/510: write d6/d14/d31/d50/d5c/f9e [712088,73296] 0 2024-02-15T22:40:49.902 INFO:tasks.workunit.client.0.smithi033.stdout:5/511: write d6/d14/f1d [506742,112081] 0 2024-02-15T22:40:49.902 INFO:tasks.workunit.client.0.smithi033.stdout:0/426: dread fa [0,4194304] 0 2024-02-15T22:40:49.902 INFO:tasks.workunit.client.0.smithi033.stdout:0/427: chown db/d19/d32/d3d/l38 5454 1 2024-02-15T22:40:49.903 INFO:tasks.workunit.client.0.smithi033.stdout:0/428: fdatasync db/d2a/f5c 0 2024-02-15T22:40:49.903 INFO:tasks.workunit.client.0.smithi033.stdout:6/387: symlink d12/d1b/d3f/d5b/d5c/l80 0 2024-02-15T22:40:49.903 INFO:tasks.workunit.client.0.smithi033.stdout:0/429: creat db/d2a/f8c x:0 0 0 2024-02-15T22:40:49.903 INFO:tasks.workunit.client.0.smithi033.stdout:0/430: chown db/d19/d32 2 1 2024-02-15T22:40:49.903 INFO:tasks.workunit.client.0.smithi033.stdout:8/391: symlink d1/d6/d14/l84 0 2024-02-15T22:40:49.903 INFO:tasks.workunit.client.0.smithi033.stdout:8/392: write d1/de/d13/f50 [4229515,818] 0 2024-02-15T22:40:49.905 INFO:tasks.workunit.client.0.smithi033.stdout:2/512: rename d1/d8/d2b/d2f/d12/d52/f9d to d1/d16/d5a/fa3 0 2024-02-15T22:40:49.905 INFO:tasks.workunit.client.0.smithi033.stdout:2/513: readlink d1/d16/l6c 0 2024-02-15T22:40:49.911 INFO:tasks.workunit.client.0.smithi033.stdout:5/512: dread d6/d14/d31/d38/d9b/f71 [0,4194304] 0 2024-02-15T22:40:49.918 INFO:tasks.workunit.client.0.smithi033.stdout:9/459: dread d4/d1d/d23/d32/d3e/d86/d3f/f45 [0,4194304] 0 2024-02-15T22:40:49.920 INFO:tasks.workunit.client.0.smithi033.stdout:0/431: link db/d2a/l73 db/d2a/d6e/l8d 0 2024-02-15T22:40:49.922 INFO:tasks.workunit.client.0.smithi033.stdout:8/393: link d1/de/d1a/d2a/l39 d1/de/d13/d75/d83/l85 0 2024-02-15T22:40:49.922 INFO:tasks.workunit.client.0.smithi033.stdout:0/432: dread db/d19/d32/d43/d7d/f85 [0,4194304] 0 2024-02-15T22:40:49.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/437: rename d5/df/d40/d4a/l69 to d5/d6/d10/l92 0 2024-02-15T22:40:49.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/438: stat d5/df/d56/d84 0 2024-02-15T22:40:49.925 INFO:tasks.workunit.client.0.smithi033.stdout:2/514: mknod d1/d8/d2b/d2f/d24/d2a/ca4 0 2024-02-15T22:40:49.925 INFO:tasks.workunit.client.0.smithi033.stdout:1/383: rmdir d1/de/d27/d28/d37 39 2024-02-15T22:40:49.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/384: creat d1/de/d27/d28/d2d/f76 x:0 0 0 2024-02-15T22:40:49.927 INFO:tasks.workunit.client.0.smithi033.stdout:5/513: creat d6/d14/d31/d48/d49/d53/fa3 x:0 0 0 2024-02-15T22:40:49.927 INFO:tasks.workunit.client.0.smithi033.stdout:5/514: getdents d6/d14/d31/d48/da2 0 2024-02-15T22:40:49.928 INFO:tasks.workunit.client.0.smithi033.stdout:9/460: mknod d4/d1d/d23/d7b/c88 0 2024-02-15T22:40:49.930 INFO:tasks.workunit.client.0.smithi033.stdout:6/388: rename d12/d2c/d30/f1f to d12/d1b/d3f/d50/f81 0 2024-02-15T22:40:49.931 INFO:tasks.workunit.client.0.smithi033.stdout:2/515: creat d1/d8/d2b/d2f/d24/d7a/fa5 x:0 0 0 2024-02-15T22:40:49.931 INFO:tasks.workunit.client.0.smithi033.stdout:2/516: dread - d1/d8/d2b/d2f/f8c zero size 2024-02-15T22:40:49.931 INFO:tasks.workunit.client.0.smithi033.stdout:2/517: dread - d1/d50/f9c zero size 2024-02-15T22:40:49.932 INFO:tasks.workunit.client.0.smithi033.stdout:9/461: mknod d4/d1d/d23/d32/d3e/d86/d3f/c89 0 2024-02-15T22:40:49.933 INFO:tasks.workunit.client.0.smithi033.stdout:5/515: write d6/d14/d31/d38/d9b/f71 [1849178,98247] 0 2024-02-15T22:40:49.933 INFO:tasks.workunit.client.0.smithi033.stdout:5/516: write d6/d14/d31/d48/d49/d53/d57/f8c [72881,66931] 0 2024-02-15T22:40:49.935 INFO:tasks.workunit.client.0.smithi033.stdout:8/394: rename d1/d68/d1d/d4a/d76/d79/f53 to d1/d68/d1d/d4a/d4c/f86 0 2024-02-15T22:40:49.936 INFO:tasks.workunit.client.0.smithi033.stdout:6/389: creat d12/d2c/d30/d1d/f82 x:0 0 0 2024-02-15T22:40:49.937 INFO:tasks.workunit.client.0.smithi033.stdout:0/433: dread db/d19/d32/d46/f4f [0,4194304] 0 2024-02-15T22:40:49.938 INFO:tasks.workunit.client.0.smithi033.stdout:7/439: rename d5/d6/d10/d16/f49 to d5/d78/f93 0 2024-02-15T22:40:49.939 INFO:tasks.workunit.client.0.smithi033.stdout:2/518: rename d1 to d1/d8/d2b/d2f/d3d/da6 22 2024-02-15T22:40:49.940 INFO:tasks.workunit.client.0.smithi033.stdout:6/390: mknod d12/d1b/d3f/d50/c83 0 2024-02-15T22:40:49.941 INFO:tasks.workunit.client.0.smithi033.stdout:0/434: mknod db/d19/d32/d43/d5a/d76/c8e 0 2024-02-15T22:40:49.941 INFO:tasks.workunit.client.0.smithi033.stdout:0/435: chown db/d19/f72 4564 1 2024-02-15T22:40:49.941 INFO:tasks.workunit.client.0.smithi033.stdout:0/436: write db/d19/d32/d3d/f45 [724180,8436] 0 2024-02-15T22:40:49.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/519: creat d1/d8/d2b/d2f/d24/fa7 x:0 0 0 2024-02-15T22:40:49.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/520: creat d1/d50/fa8 x:0 0 0 2024-02-15T22:40:49.943 INFO:tasks.workunit.client.0.smithi033.stdout:0/437: write db/d19/d32/d46/f54 [13030004,57272] 0 2024-02-15T22:40:49.944 INFO:tasks.workunit.client.0.smithi033.stdout:8/395: dread d1/de/d13/f29 [0,4194304] 0 2024-02-15T22:40:49.945 INFO:tasks.workunit.client.0.smithi033.stdout:0/438: unlink db/d19/d32/l26 0 2024-02-15T22:40:49.946 INFO:tasks.workunit.client.0.smithi033.stdout:0/439: write db/d2a/f8c [955111,92888] 0 2024-02-15T22:40:49.948 INFO:tasks.workunit.client.0.smithi033.stdout:1/385: dwrite d1/de/d27/d28/d2d/f3d [0,4194304] 0 2024-02-15T22:40:49.951 INFO:tasks.workunit.client.0.smithi033.stdout:1/386: rename d1/de/d27/d28/l6e to d1/de/d27/d28/l77 0 2024-02-15T22:40:49.952 INFO:tasks.workunit.client.0.smithi033.stdout:1/387: chown d1/de/d27/d28/d37/c4b 915431 1 2024-02-15T22:40:49.952 INFO:tasks.workunit.client.0.smithi033.stdout:1/388: stat d1/de/d27/d28/d37/f66 0 2024-02-15T22:40:49.952 INFO:tasks.workunit.client.0.smithi033.stdout:1/389: chown d1/de/d27/d28/f2a 0 1 2024-02-15T22:40:49.952 INFO:tasks.workunit.client.0.smithi033.stdout:1/390: fsync d1/d20/d42/d25/f60 0 2024-02-15T22:40:49.956 INFO:tasks.workunit.client.0.smithi033.stdout:2/521: dread d1/d8/d2b/d2f/d13/d59/f7d [0,4194304] 0 2024-02-15T22:40:49.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/522: rmdir d1/d8/d2b/d2f/d13/d6f 39 2024-02-15T22:40:49.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/523: dread - d1/d16/d5a/f97 zero size 2024-02-15T22:40:49.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/524: read d1/d16/f1a [3206727,45754] 0 2024-02-15T22:40:49.961 INFO:tasks.workunit.client.0.smithi033.stdout:7/440: dread d5/dc/d5f/d48/f6a [8388608,4194304] 0 2024-02-15T22:40:49.961 INFO:tasks.workunit.client.0.smithi033.stdout:7/441: readlink d5/dc/d5f/l33 0 2024-02-15T22:40:49.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/442: rmdir d5/df/d40 39 2024-02-15T22:40:49.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/443: chown c3 56709 1 2024-02-15T22:40:49.971 INFO:tasks.workunit.client.0.smithi033.stdout:0/440: write f4 [7132845,79275] 0 2024-02-15T22:40:49.971 INFO:tasks.workunit.client.0.smithi033.stdout:0/441: write db/d19/d32/d46/f4f [4758257,98256] 0 2024-02-15T22:40:49.971 INFO:tasks.workunit.client.0.smithi033.stdout:7/444: write d5/df/d56/f63 [346326,98116] 0 2024-02-15T22:40:49.972 INFO:tasks.workunit.client.0.smithi033.stdout:9/462: dwrite d4/d1d/f3c [8388608,4194304] 0 2024-02-15T22:40:49.972 INFO:tasks.workunit.client.0.smithi033.stdout:9/463: dread - d4/d1d/d23/d32/f79 zero size 2024-02-15T22:40:49.972 INFO:tasks.workunit.client.0.smithi033.stdout:9/464: chown d4/d1d/d23/d32/d3e/d86/d3f/f6e 454 1 2024-02-15T22:40:49.972 INFO:tasks.workunit.client.0.smithi033.stdout:9/465: fsync d4/d1d/d23/f47 0 2024-02-15T22:40:49.973 INFO:tasks.workunit.client.0.smithi033.stdout:7/445: creat d5/df/f94 x:0 0 0 2024-02-15T22:40:49.978 INFO:tasks.workunit.client.0.smithi033.stdout:8/396: dwrite d1/d6/d14/f1b [0,4194304] 0 2024-02-15T22:40:49.978 INFO:tasks.workunit.client.0.smithi033.stdout:5/517: dwrite d6/d14/d31/d38/d3f/f92 [0,4194304] 0 2024-02-15T22:40:49.986 INFO:tasks.workunit.client.0.smithi033.stdout:9/466: dread d4/f9 [0,4194304] 0 2024-02-15T22:40:49.986 INFO:tasks.workunit.client.0.smithi033.stdout:7/446: rename d5/d6/d10/l92 to d5/df/d56/d60/d59/l95 0 2024-02-15T22:40:49.987 INFO:tasks.workunit.client.0.smithi033.stdout:0/442: dwrite db/d19/d32/d3d/f59 [0,4194304] 0 2024-02-15T22:40:49.987 INFO:tasks.workunit.client.0.smithi033.stdout:2/525: dwrite d1/d8/d2b/d2f/d24/fa7 [0,4194304] 0 2024-02-15T22:40:49.992 INFO:tasks.workunit.client.0.smithi033.stdout:5/518: rename d6/f1e to d6/d25/d99/fa4 0 2024-02-15T22:40:49.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/391: getdents d1/de/d27/d28/d2d 0 2024-02-15T22:40:49.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/392: fdatasync d1/de/d27/d28/d37/f45 0 2024-02-15T22:40:50.004 INFO:tasks.workunit.client.0.smithi033.stdout:8/397: dwrite d1/de/f37 [0,4194304] 0 2024-02-15T22:40:50.004 INFO:tasks.workunit.client.0.smithi033.stdout:8/398: stat d1/d6/d14/d5d/d72 0 2024-02-15T22:40:50.004 INFO:tasks.workunit.client.0.smithi033.stdout:9/467: dread d4/d1d/d23/d24/f25 [0,4194304] 0 2024-02-15T22:40:50.012 INFO:tasks.workunit.client.0.smithi033.stdout:8/399: getdents d1/d68/d44 0 2024-02-15T22:40:50.012 INFO:tasks.workunit.client.0.smithi033.stdout:7/447: dwrite d5/df/d56/f6c [0,4194304] 0 2024-02-15T22:40:50.013 INFO:tasks.workunit.client.0.smithi033.stdout:0/443: dwrite f5 [0,4194304] 0 2024-02-15T22:40:50.013 INFO:tasks.workunit.client.0.smithi033.stdout:0/444: creat db/d2a/d6e/f8f x:0 0 0 2024-02-15T22:40:50.013 INFO:tasks.workunit.client.0.smithi033.stdout:9/468: write d4/d1d/d23/d32/d3e/d86/f53 [497695,58394] 0 2024-02-15T22:40:50.014 INFO:tasks.workunit.client.0.smithi033.stdout:5/519: write d6/f10 [1138848,15762] 0 2024-02-15T22:40:50.014 INFO:tasks.workunit.client.0.smithi033.stdout:5/520: truncate d6/d14/f45 1059688 0 2024-02-15T22:40:50.015 INFO:tasks.workunit.client.0.smithi033.stdout:2/526: rename d1/d8/d2b/d2f/d13/d61 to d1/d8/d2b/d2f/d13/da9 0 2024-02-15T22:40:50.015 INFO:tasks.workunit.client.0.smithi033.stdout:2/527: write d1/d16/d3f/f4b [1165098,106411] 0 2024-02-15T22:40:50.016 INFO:tasks.workunit.client.0.smithi033.stdout:1/393: getdents d1/de/d27/d28/d2d/d36 0 2024-02-15T22:40:50.016 INFO:tasks.workunit.client.0.smithi033.stdout:5/521: write d6/d14/d31/d50/d5c/f9e [538644,31356] 0 2024-02-15T22:40:50.022 INFO:tasks.workunit.client.0.smithi033.stdout:7/448: mknod d5/d78/d7b/c96 0 2024-02-15T22:40:50.024 INFO:tasks.workunit.client.0.smithi033.stdout:9/469: unlink d4/d1d/d23/d32/d71/c85 0 2024-02-15T22:40:50.024 INFO:tasks.workunit.client.0.smithi033.stdout:2/528: rmdir d1/d16/d57 39 2024-02-15T22:40:50.026 INFO:tasks.workunit.client.0.smithi033.stdout:0/445: truncate db/d19/d32/d46/f53 769419 0 2024-02-15T22:40:50.028 INFO:tasks.workunit.client.0.smithi033.stdout:5/522: rmdir d6/d14/d31/d48/d56 39 2024-02-15T22:40:50.028 INFO:tasks.workunit.client.0.smithi033.stdout:5/523: readlink d6/d14/d31/d38/d9b/l65 0 2024-02-15T22:40:50.028 INFO:tasks.workunit.client.0.smithi033.stdout:5/524: getdents d6/d14/d31/d48/d49/d53/d57/da1 0 2024-02-15T22:40:50.029 INFO:tasks.workunit.client.0.smithi033.stdout:9/470: dread d4/f75 [0,4194304] 0 2024-02-15T22:40:50.030 INFO:tasks.workunit.client.0.smithi033.stdout:7/449: mknod d5/df/c97 0 2024-02-15T22:40:50.031 INFO:tasks.workunit.client.0.smithi033.stdout:5/525: rmdir d6/d14/d31/d64/d7a 39 2024-02-15T22:40:50.032 INFO:tasks.workunit.client.0.smithi033.stdout:9/471: mkdir d4/d1d/d23/d24/d51/d8a 0 2024-02-15T22:40:50.032 INFO:tasks.workunit.client.0.smithi033.stdout:9/472: chown d4/f15 98 1 2024-02-15T22:40:50.033 INFO:tasks.workunit.client.0.smithi033.stdout:7/450: dread d5/f15 [0,4194304] 0 2024-02-15T22:40:50.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/451: unlink d5/df/d56/f63 0 2024-02-15T22:40:50.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/452: readlink d5/d6/l41 0 2024-02-15T22:40:50.041 INFO:tasks.workunit.client.0.smithi033.stdout:8/400: dwrite d1/d68/d44/d49/f7b [0,4194304] 0 2024-02-15T22:40:50.049 INFO:tasks.workunit.client.0.smithi033.stdout:7/453: rename d5/d78 to d5/d6/d10/d16/d98 0 2024-02-15T22:40:50.049 INFO:tasks.workunit.client.0.smithi033.stdout:5/526: dread d6/d14/d31/d64/f8a [0,4194304] 0 2024-02-15T22:40:50.049 INFO:tasks.workunit.client.0.smithi033.stdout:5/527: creat d6/d14/d31/d50/d5c/fa5 x:0 0 0 2024-02-15T22:40:50.052 INFO:tasks.workunit.client.0.smithi033.stdout:7/454: rename d5/df/d47 to d5/df/d56/d99 0 2024-02-15T22:40:50.052 INFO:tasks.workunit.client.0.smithi033.stdout:2/529: write d1/d8/d2b/d2f/d24/fa7 [977797,7841] 0 2024-02-15T22:40:50.054 INFO:tasks.workunit.client.0.smithi033.stdout:1/394: dwrite d1/de/d27/d28/d2d/f3d [0,4194304] 0 2024-02-15T22:40:50.054 INFO:tasks.workunit.client.0.smithi033.stdout:0/446: dwrite db/d2a/f8c [0,4194304] 0 2024-02-15T22:40:50.055 INFO:tasks.workunit.client.0.smithi033.stdout:7/455: creat d5/df/d40/d89/f9a x:0 0 0 2024-02-15T22:40:50.057 INFO:tasks.workunit.client.0.smithi033.stdout:8/401: write d1/d68/d44/d49/f7b [419656,59884] 0 2024-02-15T22:40:50.059 INFO:tasks.workunit.client.0.smithi033.stdout:1/395: rename d1/de/d27/d39/d3a/f75 to d1/de/d27/d39/d3a/f78 0 2024-02-15T22:40:50.059 INFO:tasks.workunit.client.0.smithi033.stdout:1/396: readlink d1/d20/d42/d25/l74 0 2024-02-15T22:40:50.061 INFO:tasks.workunit.client.0.smithi033.stdout:7/456: creat d5/f9b x:0 0 0 2024-02-15T22:40:50.066 INFO:tasks.workunit.client.0.smithi033.stdout:8/402: truncate d1/de/d1a/d2a/f3b 2147609 0 2024-02-15T22:40:50.066 INFO:tasks.workunit.client.0.smithi033.stdout:2/530: write d1/d16/d5a/f7b [2240791,91351] 0 2024-02-15T22:40:50.070 INFO:tasks.workunit.client.0.smithi033.stdout:7/457: rename d5/dc/d5f/d48 to d5/df/d56/d60/d59/d9c 0 2024-02-15T22:40:50.070 INFO:tasks.workunit.client.0.smithi033.stdout:7/458: stat d5/df/d40/f79 0 2024-02-15T22:40:50.070 INFO:tasks.workunit.client.0.smithi033.stdout:7/459: truncate d5/d6/d10/f6d 5005937 0 2024-02-15T22:40:50.070 INFO:tasks.workunit.client.0.smithi033.stdout:7/460: dread - d5/dc/f90 zero size 2024-02-15T22:40:50.070 INFO:tasks.workunit.client.0.smithi033.stdout:9/473: dwrite d4/d1d/d23/d24/d5a/f80 [0,4194304] 0 2024-02-15T22:40:50.071 INFO:tasks.workunit.client.0.smithi033.stdout:8/403: link d1/d68/d57/l5b d1/d36/l87 0 2024-02-15T22:40:50.073 INFO:tasks.workunit.client.0.smithi033.stdout:2/531: unlink d1/d8/d2b/d2f/d24/d2a/l3a 0 2024-02-15T22:40:50.076 INFO:tasks.workunit.client.0.smithi033.stdout:7/461: unlink d5/d6/d10/d16/d26/l37 0 2024-02-15T22:40:50.076 INFO:tasks.workunit.client.0.smithi033.stdout:7/462: write d5/f30 [504448,60754] 0 2024-02-15T22:40:50.078 INFO:tasks.workunit.client.0.smithi033.stdout:8/404: mknod d1/d74/c88 0 2024-02-15T22:40:50.081 INFO:tasks.workunit.client.0.smithi033.stdout:7/463: symlink d5/d6/d10/d16/d98/d8a/l9d 0 2024-02-15T22:40:50.081 INFO:tasks.workunit.client.0.smithi033.stdout:7/464: fsync d5/d6/d10/d16/d26/f3c 0 2024-02-15T22:40:50.081 INFO:tasks.workunit.client.0.smithi033.stdout:7/465: truncate d5/d6/d10/d16/d98/f93 129473 0 2024-02-15T22:40:50.083 INFO:tasks.workunit.client.0.smithi033.stdout:0/447: dwrite db/d19/f1f [0,4194304] 0 2024-02-15T22:40:50.084 INFO:tasks.workunit.client.0.smithi033.stdout:7/466: unlink d5/d6/l13 0 2024-02-15T22:40:50.085 INFO:tasks.workunit.client.0.smithi033.stdout:2/532: write d1/f20 [2779353,106468] 0 2024-02-15T22:40:50.085 INFO:tasks.workunit.client.0.smithi033.stdout:2/533: stat d1/d8/d2b/d2f/d12/d52/l9f 0 2024-02-15T22:40:50.085 INFO:tasks.workunit.client.0.smithi033.stdout:1/397: dwrite d1/de/f1b [0,4194304] 0 2024-02-15T22:40:50.089 INFO:tasks.workunit.client.0.smithi033.stdout:0/448: link db/d19/d32/d43/d7d/c89 db/d2a/c90 0 2024-02-15T22:40:50.090 INFO:tasks.workunit.client.0.smithi033.stdout:7/467: creat d5/df/d56/d84/f9e x:0 0 0 2024-02-15T22:40:50.094 INFO:tasks.workunit.client.0.smithi033.stdout:9/474: dwrite d4/f9 [0,4194304] 0 2024-02-15T22:40:50.094 INFO:tasks.workunit.client.0.smithi033.stdout:2/534: creat d1/d8/d2b/d2f/d3d/faa x:0 0 0 2024-02-15T22:40:50.096 INFO:tasks.workunit.client.0.smithi033.stdout:0/449: rename db/d19/d32/d3d/c5b to db/d19/d32/d43/d5a/d76/c91 0 2024-02-15T22:40:50.096 INFO:tasks.workunit.client.0.smithi033.stdout:7/468: symlink d5/df/d40/d89/l9f 0 2024-02-15T22:40:50.097 INFO:tasks.workunit.client.0.smithi033.stdout:8/405: dwrite d1/de/d1a/d2a/f30 [0,4194304] 0 2024-02-15T22:40:50.099 INFO:tasks.workunit.client.0.smithi033.stdout:9/475: unlink d4/f3b 0 2024-02-15T22:40:50.100 INFO:tasks.workunit.client.0.smithi033.stdout:2/535: symlink d1/d8/d2b/d2f/d38/d9a/lab 0 2024-02-15T22:40:50.102 INFO:tasks.workunit.client.0.smithi033.stdout:0/450: unlink db/d19/d32/l35 0 2024-02-15T22:40:50.103 INFO:tasks.workunit.client.0.smithi033.stdout:7/469: mkdir d5/dc/d5f/d8b/da0 0 2024-02-15T22:40:50.103 INFO:tasks.workunit.client.0.smithi033.stdout:7/470: stat d5/df/d56/d60/d59/d9c/c87 0 2024-02-15T22:40:50.112 INFO:tasks.workunit.client.0.smithi033.stdout:8/406: unlink d1/de/d1a/d2a/c42 0 2024-02-15T22:40:50.113 INFO:tasks.workunit.client.0.smithi033.stdout:9/476: truncate d4/d1d/d23/d32/d3e/f44 865123 0 2024-02-15T22:40:50.113 INFO:tasks.workunit.client.0.smithi033.stdout:9/477: creat d4/d1d/d23/d35/f8b x:0 0 0 2024-02-15T22:40:50.117 INFO:tasks.workunit.client.0.smithi033.stdout:0/451: symlink db/d19/d32/d43/d7d/l92 0 2024-02-15T22:40:50.117 INFO:tasks.workunit.client.0.smithi033.stdout:0/452: readlink db/ld 0 2024-02-15T22:40:50.118 INFO:tasks.workunit.client.0.smithi033.stdout:2/536: getdents d1/d8/d2b/d2f/d13/d59 0 2024-02-15T22:40:50.120 INFO:tasks.workunit.client.0.smithi033.stdout:0/453: creat db/d2a/d6c/f93 x:0 0 0 2024-02-15T22:40:50.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/454: chown db/d19/c4e 129013 1 2024-02-15T22:40:50.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/455: write db/d19/d32/f6f [955520,123113] 0 2024-02-15T22:40:50.121 INFO:tasks.workunit.client.0.smithi033.stdout:2/537: mknod d1/d8/d2b/d2f/d12/d52/cac 0 2024-02-15T22:40:50.122 INFO:tasks.workunit.client.0.smithi033.stdout:9/478: read f2 [2262926,53033] 0 2024-02-15T22:40:50.122 INFO:tasks.workunit.client.0.smithi033.stdout:0/456: mkdir db/d19/d32/d43/d94 0 2024-02-15T22:40:50.124 INFO:tasks.workunit.client.0.smithi033.stdout:2/538: truncate d1/d8/d2b/d2f/d13/f3b 123951 0 2024-02-15T22:40:50.125 INFO:tasks.workunit.client.0.smithi033.stdout:0/457: mkdir db/d2a/d6e/d7a/d95 0 2024-02-15T22:40:50.126 INFO:tasks.workunit.client.0.smithi033.stdout:7/471: dwrite d5/d6/d10/d16/d98/d7b/f7c [0,4194304] 0 2024-02-15T22:40:50.127 INFO:tasks.workunit.client.0.smithi033.stdout:2/539: rename d1/d8/d2b/d2f/d3d/l84 to d1/d16/d3f/lad 0 2024-02-15T22:40:50.128 INFO:tasks.workunit.client.0.smithi033.stdout:8/407: dwrite d1/de/d1a/f66 [0,4194304] 0 2024-02-15T22:40:50.128 INFO:tasks.workunit.client.0.smithi033.stdout:0/458: creat db/d2a/d68/d8b/f96 x:0 0 0 2024-02-15T22:40:50.128 INFO:tasks.workunit.client.0.smithi033.stdout:0/459: write db/d2a/d6e/f7c [183028,62383] 0 2024-02-15T22:40:50.134 INFO:tasks.workunit.client.0.smithi033.stdout:2/540: mkdir d1/d8/d2b/d2f/d12/dae 0 2024-02-15T22:40:50.134 INFO:tasks.workunit.client.0.smithi033.stdout:2/541: creat d1/d8/d2b/d2f/d3d/faf x:0 0 0 2024-02-15T22:40:50.136 INFO:tasks.workunit.client.0.smithi033.stdout:8/408: mknod d1/de/d1a/d2a/c89 0 2024-02-15T22:40:50.137 INFO:tasks.workunit.client.0.smithi033.stdout:0/460: rename db/d19/l49 to db/d2a/d68/l97 0 2024-02-15T22:40:50.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/472: getdents d5/d6/d10/d16 0 2024-02-15T22:40:50.140 INFO:tasks.workunit.client.0.smithi033.stdout:9/479: dwrite d4/d1d/f7a [0,4194304] 0 2024-02-15T22:40:50.141 INFO:tasks.workunit.client.0.smithi033.stdout:8/409: dread d1/d6/f6c [0,4194304] 0 2024-02-15T22:40:50.149 INFO:tasks.workunit.client.0.smithi033.stdout:8/410: unlink d1/d68/d1d/d4a/f6b 0 2024-02-15T22:40:50.149 INFO:tasks.workunit.client.0.smithi033.stdout:8/411: stat d1/de/f37 0 2024-02-15T22:40:50.151 INFO:tasks.workunit.client.0.smithi033.stdout:0/461: rmdir db/d19/d32/d3d 39 2024-02-15T22:40:50.154 INFO:tasks.workunit.client.0.smithi033.stdout:8/412: dread d1/de/d1a/f20 [0,4194304] 0 2024-02-15T22:40:50.154 INFO:tasks.workunit.client.0.smithi033.stdout:2/542: rename d1/d50 to d1/d8/d2b/d2f/d38/db0 0 2024-02-15T22:40:50.154 INFO:tasks.workunit.client.0.smithi033.stdout:2/543: read - d1/d8/d2b/d2f/d12/d52/f94 zero size 2024-02-15T22:40:50.154 INFO:tasks.workunit.client.0.smithi033.stdout:2/544: dread - d1/d8/d2b/d2f/d12/d52/f94 zero size 2024-02-15T22:40:50.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/413: stat d1/de/d13/d75/d83/l85 0 2024-02-15T22:40:50.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/414: chown d1/d68/d1d/d4a/d76/d79 6557245 1 2024-02-15T22:40:50.158 INFO:tasks.workunit.client.0.smithi033.stdout:9/480: dread d4/d1d/d23/d32/d3e/f64 [0,4194304] 0 2024-02-15T22:40:50.163 INFO:tasks.workunit.client.0.smithi033.stdout:9/481: unlink d4/d1d/d23/d32/d3e/f76 0 2024-02-15T22:40:50.166 INFO:tasks.workunit.client.0.smithi033.stdout:7/473: rename d5/d6/d10/d16 to d5/dc/d5f/d8b/da1 0 2024-02-15T22:40:50.169 INFO:tasks.workunit.client.0.smithi033.stdout:7/474: link d5/df/d40/l72 d5/d6/la2 0 2024-02-15T22:40:50.172 INFO:tasks.workunit.client.0.smithi033.stdout:9/482: write d4/d1d/f7a [5159253,61746] 0 2024-02-15T22:40:50.173 INFO:tasks.workunit.client.0.smithi033.stdout:7/475: dread d5/f30 [0,4194304] 0 2024-02-15T22:40:50.173 INFO:tasks.workunit.client.0.smithi033.stdout:0/462: dwrite db/d19/d32/d43/d5a/d76/f86 [0,4194304] 0 2024-02-15T22:40:50.174 INFO:tasks.workunit.client.0.smithi033.stdout:7/476: mkdir d5/df/d56/d7f/da3 0 2024-02-15T22:40:50.175 INFO:tasks.workunit.client.0.smithi033.stdout:0/463: write db/d2a/f40 [377496,86969] 0 2024-02-15T22:40:50.179 INFO:tasks.workunit.client.0.smithi033.stdout:2/545: dwrite d1/d8/d2b/d2f/d24/d31/f58 [0,4194304] 0 2024-02-15T22:40:50.182 INFO:tasks.workunit.client.0.smithi033.stdout:8/415: dwrite d1/de/d1a/f69 [0,4194304] 0 2024-02-15T22:40:50.183 INFO:tasks.workunit.client.0.smithi033.stdout:8/416: getdents d1/de/d1a/d2a/d40 0 2024-02-15T22:40:50.190 INFO:tasks.workunit.client.0.smithi033.stdout:8/417: dread d1/d68/d44/d49/f7b [0,4194304] 0 2024-02-15T22:40:50.192 INFO:tasks.workunit.client.0.smithi033.stdout:7/477: write d5/dc/d5f/d8b/da1/d98/f93 [628162,112900] 0 2024-02-15T22:40:50.194 INFO:tasks.workunit.client.0.smithi033.stdout:7/478: unlink d5/df/d56/d84/f9e 0 2024-02-15T22:40:50.195 INFO:tasks.workunit.client.0.smithi033.stdout:7/479: unlink d5/dc/d5f/l86 0 2024-02-15T22:40:50.197 INFO:tasks.workunit.client.0.smithi033.stdout:7/480: dread d5/f30 [0,4194304] 0 2024-02-15T22:40:50.198 INFO:tasks.workunit.client.0.smithi033.stdout:7/481: stat d5/f15 0 2024-02-15T22:40:50.199 INFO:tasks.workunit.client.0.smithi033.stdout:7/482: mknod d5/dc/d5f/ca4 0 2024-02-15T22:40:50.200 INFO:tasks.workunit.client.0.smithi033.stdout:7/483: link d5/f9b d5/d6/d10/fa5 0 2024-02-15T22:40:50.201 INFO:tasks.workunit.client.0.smithi033.stdout:0/464: dwrite db/d2a/d6c/f93 [0,4194304] 0 2024-02-15T22:40:50.201 INFO:tasks.workunit.client.0.smithi033.stdout:0/465: creat db/d2a/d68/d8b/f98 x:0 0 0 2024-02-15T22:40:50.203 INFO:tasks.workunit.client.0.smithi033.stdout:0/466: symlink db/d2a/d6e/d7a/d95/l99 0 2024-02-15T22:40:50.217 INFO:tasks.workunit.client.0.smithi033.stdout:7/484: write d5/dc/d5f/d8b/da1/d98/d7b/f7c [3290224,81817] 0 2024-02-15T22:40:50.217 INFO:tasks.workunit.client.0.smithi033.stdout:2/546: dwrite d1/d8/d2b/d2f/d12/f42 [0,4194304] 0 2024-02-15T22:40:50.217 INFO:tasks.workunit.client.0.smithi033.stdout:7/485: dread - d5/d6/d10/fa5 zero size 2024-02-15T22:40:50.217 INFO:tasks.workunit.client.0.smithi033.stdout:7/486: truncate d5/dc/f90 943128 0 2024-02-15T22:40:50.217 INFO:tasks.workunit.client.0.smithi033.stdout:7/487: fdatasync d5/df/d56/d60/d59/f8d 0 2024-02-15T22:40:50.220 INFO:tasks.workunit.client.0.smithi033.stdout:2/547: link d1/d8/d2b/c77 d1/d66/d75/cb1 0 2024-02-15T22:40:50.220 INFO:tasks.workunit.client.0.smithi033.stdout:2/548: chown d1/d8/d34/c37 3816 1 2024-02-15T22:40:50.220 INFO:tasks.workunit.client.0.smithi033.stdout:2/549: dread - d1/d8/d2b/d2f/d38/f95 zero size 2024-02-15T22:40:50.220 INFO:tasks.workunit.client.0.smithi033.stdout:8/418: dwrite d1/de/d13/f50 [0,4194304] 0 2024-02-15T22:40:50.220 INFO:tasks.workunit.client.0.smithi033.stdout:0/467: dread db/d2a/d6e/d7a/f8a [0,4194304] 0 2024-02-15T22:40:50.220 INFO:tasks.workunit.client.0.smithi033.stdout:0/468: dread - db/d2a/f5c zero size 2024-02-15T22:40:50.225 INFO:tasks.workunit.client.0.smithi033.stdout:8/419: unlink d1/d6/d14/l84 0 2024-02-15T22:40:50.227 INFO:tasks.workunit.client.0.smithi033.stdout:0/469: mknod db/d19/d32/d43/c9a 0 2024-02-15T22:40:50.227 INFO:tasks.workunit.client.0.smithi033.stdout:0/470: chown db/d2a/f8c 968 1 2024-02-15T22:40:50.227 INFO:tasks.workunit.client.0.smithi033.stdout:0/471: truncate db/d19/d32/d3d/f74 1114520 0 2024-02-15T22:40:50.227 INFO:tasks.workunit.client.0.smithi033.stdout:0/472: readlink db/d2a/d68/l97 0 2024-02-15T22:40:50.227 INFO:tasks.workunit.client.0.smithi033.stdout:0/473: creat db/d2a/d6e/f9b x:0 0 0 2024-02-15T22:40:50.233 INFO:tasks.workunit.client.0.smithi033.stdout:0/474: mkdir db/d19/d32/d43/d7d/d9c 0 2024-02-15T22:40:50.234 INFO:tasks.workunit.client.0.smithi033.stdout:0/475: mknod db/d19/d32/d46/c9d 0 2024-02-15T22:40:50.235 INFO:tasks.workunit.client.0.smithi033.stdout:0/476: symlink db/d19/d32/d46/l9e 0 2024-02-15T22:40:50.241 INFO:tasks.workunit.client.0.smithi033.stdout:7/488: dwrite d5/df/d40/f79 [0,4194304] 0 2024-02-15T22:40:50.242 INFO:tasks.workunit.client.0.smithi033.stdout:8/420: dwrite d1/de/d1a/d2a/f3b [0,4194304] 0 2024-02-15T22:40:50.242 INFO:tasks.workunit.client.0.smithi033.stdout:8/421: fdatasync d1/de/d1a/f66 0 2024-02-15T22:40:50.245 INFO:tasks.workunit.client.0.smithi033.stdout:8/422: symlink d1/d68/d1d/d4a/d76/l8a 0 2024-02-15T22:40:50.247 INFO:tasks.workunit.client.0.smithi033.stdout:0/477: dread db/d19/d32/d43/d5a/d76/f86 [0,4194304] 0 2024-02-15T22:40:50.247 INFO:tasks.workunit.client.0.smithi033.stdout:0/478: stat db/d2a/d6e/f7c 0 2024-02-15T22:40:50.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/479: mkdir db/d19/d32/d43/d9f 0 2024-02-15T22:40:50.251 INFO:tasks.workunit.client.0.smithi033.stdout:0/480: symlink db/d19/d32/d43/d5a/la0 0 2024-02-15T22:40:50.252 INFO:tasks.workunit.client.0.smithi033.stdout:0/481: mkdir db/d19/d32/d43/d5a/d76/da1 0 2024-02-15T22:40:50.253 INFO:tasks.workunit.client.0.smithi033.stdout:0/482: symlink db/d60/la2 0 2024-02-15T22:40:50.253 INFO:tasks.workunit.client.0.smithi033.stdout:0/483: getdents db/d19/d32/d43/d7d/d9c 0 2024-02-15T22:40:50.256 INFO:tasks.workunit.client.0.smithi033.stdout:8/423: read d1/de/d13/f50 [1133786,64998] 0 2024-02-15T22:40:50.256 INFO:tasks.workunit.client.0.smithi033.stdout:8/424: chown d1/d68/d1d/d4a/d76/d79/c21 250349 1 2024-02-15T22:40:50.257 INFO:tasks.workunit.client.0.smithi033.stdout:8/425: symlink d1/d36/l8b 0 2024-02-15T22:40:50.258 INFO:tasks.workunit.client.0.smithi033.stdout:8/426: link d1/de/c2f d1/d68/d44/c8c 0 2024-02-15T22:40:50.258 INFO:tasks.workunit.client.0.smithi033.stdout:8/427: truncate d1/de/d1a/f6e 214623 0 2024-02-15T22:40:50.263 INFO:tasks.workunit.client.0.smithi033.stdout:8/428: dread d1/de/d1a/d27/f7c [0,4194304] 0 2024-02-15T22:40:50.263 INFO:tasks.workunit.client.0.smithi033.stdout:7/489: dwrite d5/dc/d5f/f2f [0,4194304] 0 2024-02-15T22:40:50.263 INFO:tasks.workunit.client.0.smithi033.stdout:8/429: chown d1/d36/l8b 0 1 2024-02-15T22:40:50.264 INFO:tasks.workunit.client.0.smithi033.stdout:7/490: mkdir d5/df/d56/d60/d59/d9c/da6 0 2024-02-15T22:40:50.266 INFO:tasks.workunit.client.0.smithi033.stdout:7/491: symlink d5/df/d56/d60/la7 0 2024-02-15T22:40:50.266 INFO:tasks.workunit.client.0.smithi033.stdout:7/492: dread - d5/df/d56/d60/d59/f74 zero size 2024-02-15T22:40:50.266 INFO:tasks.workunit.client.0.smithi033.stdout:7/493: truncate d5/df/d40/d89/f9a 188074 0 2024-02-15T22:40:50.267 INFO:tasks.workunit.client.0.smithi033.stdout:0/484: dread db/d2a/f2b [0,4194304] 0 2024-02-15T22:40:50.268 INFO:tasks.workunit.client.0.smithi033.stdout:7/494: truncate d5/d6/f7 2155145 0 2024-02-15T22:40:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:49 smithi033 ceph-mon[29033]: Standby manager daemon smithi033.swohxi started 2024-02-15T22:40:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:49 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/crt"}]: dispatch 2024-02-15T22:40:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:49 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:40:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:49 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/key"}]: dispatch 2024-02-15T22:40:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:49 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:40:50.270 INFO:tasks.workunit.client.0.smithi033.stdout:0/485: rename db/d19/c4e to db/d19/d32/d43/d9f/ca3 0 2024-02-15T22:40:50.271 INFO:tasks.workunit.client.0.smithi033.stdout:7/495: mknod d5/dc/d5f/d8b/da1/d98/ca8 0 2024-02-15T22:40:50.284 INFO:tasks.workunit.client.0.smithi033.stdout:8/430: dwrite d1/de/d1a/f20 [0,4194304] 0 2024-02-15T22:40:50.286 INFO:tasks.workunit.client.0.smithi033.stdout:8/431: creat d1/d68/d44/f8d x:0 0 0 2024-02-15T22:40:50.287 INFO:tasks.workunit.client.0.smithi033.stdout:8/432: symlink d1/de/d1a/d27/d70/l8e 0 2024-02-15T22:40:50.287 INFO:tasks.workunit.client.0.smithi033.stdout:8/433: fdatasync d1/de/d1a/f20 0 2024-02-15T22:40:50.288 INFO:tasks.workunit.client.0.smithi033.stdout:8/434: getdents d1/d68/d57 0 2024-02-15T22:40:50.289 INFO:tasks.workunit.client.0.smithi033.stdout:8/435: mkdir d1/d6/d14/d8f 0 2024-02-15T22:40:50.289 INFO:tasks.workunit.client.0.smithi033.stdout:8/436: truncate d1/de/d1a/d2a/f3b 2942627 0 2024-02-15T22:40:50.290 INFO:tasks.workunit.client.0.smithi033.stdout:8/437: rename d1/de/d13 to d1/de/d5c/d90 0 2024-02-15T22:40:50.294 INFO:tasks.workunit.client.0.smithi033.stdout:7/496: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:50.301 INFO:tasks.workunit.client.0.smithi033.stdout:7/497: read d5/d6/d10/f6d [1506241,120412] 0 2024-02-15T22:40:50.303 INFO:tasks.workunit.client.0.smithi033.stdout:7/498: creat d5/df/d56/d60/d59/d9c/fa9 x:0 0 0 2024-02-15T22:40:50.303 INFO:tasks.workunit.client.0.smithi033.stdout:7/499: write d5/df/d56/d60/d59/f62 [479860,99895] 0 2024-02-15T22:40:50.304 INFO:tasks.workunit.client.0.smithi033.stdout:7/500: unlink d5/f50 0 2024-02-15T22:40:50.313 INFO:tasks.workunit.client.0.smithi033.stdout:3/542: sync 2024-02-15T22:40:50.314 INFO:tasks.workunit.client.0.smithi033.stdout:4/495: sync 2024-02-15T22:40:50.314 INFO:tasks.workunit.client.0.smithi033.stdout:3/543: fdatasync d0/d3/d2c/d5d/f49 0 2024-02-15T22:40:50.314 INFO:tasks.workunit.client.0.smithi033.stdout:4/496: fsync d8/d18/d37/f40 0 2024-02-15T22:40:50.314 INFO:tasks.workunit.client.0.smithi033.stdout:3/544: write d0/d3/f41 [1171689,39410] 0 2024-02-15T22:40:50.314 INFO:tasks.workunit.client.0.smithi033.stdout:4/497: write d8/fd [5165230,79841] 0 2024-02-15T22:40:50.314 INFO:tasks.workunit.client.0.smithi033.stdout:4/498: dread - d8/d16/d51/d1c/d3c/d3f/f6f zero size 2024-02-15T22:40:50.314 INFO:tasks.workunit.client.0.smithi033.stdout:3/545: write d0/d3/d65/d97/fa8 [768112,129154] 0 2024-02-15T22:40:50.315 INFO:tasks.workunit.client.0.smithi033.stdout:4/499: mkdir d8/d16/d51/d1c/d96/d8c/dab 0 2024-02-15T22:40:50.315 INFO:tasks.workunit.client.0.smithi033.stdout:4/500: write d8/d16/d51/f86 [316208,13686] 0 2024-02-15T22:40:50.316 INFO:tasks.workunit.client.0.smithi033.stdout:4/501: mkdir d8/d16/d51/d1c/d3c/d49/dac 0 2024-02-15T22:40:50.316 INFO:tasks.workunit.client.0.smithi033.stdout:4/502: write d8/d69/f9c [589282,47992] 0 2024-02-15T22:40:50.336 INFO:tasks.workunit.client.0.smithi033.stdout:3/546: dwrite d0/d3/d2c/d5d/d3d/d8f/faf [0,4194304] 0 2024-02-15T22:40:50.336 INFO:tasks.workunit.client.0.smithi033.stdout:4/503: dwrite d8/d16/d51/d1c/f6c [0,4194304] 0 2024-02-15T22:40:50.337 INFO:tasks.workunit.client.0.smithi033.stdout:3/547: mknod d0/d3/d2c/d5d/d3d/d57/d74/cb0 0 2024-02-15T22:40:50.339 INFO:tasks.workunit.client.0.smithi033.stdout:4/504: symlink d8/d69/lad 0 2024-02-15T22:40:50.339 INFO:tasks.workunit.client.0.smithi033.stdout:4/505: write d8/d69/f98 [4654804,99646] 0 2024-02-15T22:40:50.339 INFO:tasks.workunit.client.0.smithi033.stdout:4/506: fdatasync d8/d18/d37/d31/f48 0 2024-02-15T22:40:50.345 INFO:tasks.workunit.client.0.smithi033.stdout:4/507: truncate d8/d16/d51/d1c/d3c/d49/f62 3066742 0 2024-02-15T22:40:50.347 INFO:tasks.workunit.client.0.smithi033.stdout:4/508: link d8/d16/d51/d27/f5e d8/d16/d51/d1c/d96/d8c/dab/fae 0 2024-02-15T22:40:50.348 INFO:tasks.workunit.client.0.smithi033.stdout:3/548: rename d0/d8c to d0/d3/d3b/db1 0 2024-02-15T22:40:50.367 INFO:tasks.workunit.client.0.smithi033.stdout:4/509: dwrite d8/fe [4194304,4194304] 0 2024-02-15T22:40:50.368 INFO:tasks.workunit.client.0.smithi033.stdout:3/549: dwrite d0/d3/dd/f52 [0,4194304] 0 2024-02-15T22:40:50.370 INFO:tasks.workunit.client.0.smithi033.stdout:3/550: rename d0/d3/dd/l15 to d0/lb2 0 2024-02-15T22:40:50.373 INFO:tasks.workunit.client.0.smithi033.stdout:3/551: mknod d0/d3/d2c/d5d/d3d/d57/d74/cb3 0 2024-02-15T22:40:50.373 INFO:tasks.workunit.client.0.smithi033.stdout:3/552: dread - d0/d3/d2c/d5d/d3d/d8f/f9c zero size 2024-02-15T22:40:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:49 smithi082 ceph-mon[37153]: Standby manager daemon smithi033.swohxi started 2024-02-15T22:40:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:49 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/crt"}]: dispatch 2024-02-15T22:40:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:49 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:40:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:49 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/key"}]: dispatch 2024-02-15T22:40:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:49 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/2942160864' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:40:50.378 INFO:tasks.workunit.client.0.smithi033.stdout:4/510: dread f7 [0,4194304] 0 2024-02-15T22:40:50.382 INFO:tasks.workunit.client.0.smithi033.stdout:3/553: dread d0/f13 [0,4194304] 0 2024-02-15T22:40:50.382 INFO:tasks.workunit.client.0.smithi033.stdout:3/554: dread - d0/d1c/f67 zero size 2024-02-15T22:40:50.382 INFO:tasks.workunit.client.0.smithi033.stdout:3/555: rmdir d0/d3/d65 39 2024-02-15T22:40:50.383 INFO:tasks.workunit.client.0.smithi033.stdout:3/556: truncate d0/d1c/f6b 2856810 0 2024-02-15T22:40:50.383 INFO:tasks.workunit.client.0.smithi033.stdout:3/557: readlink d0/l5e 0 2024-02-15T22:40:50.384 INFO:tasks.workunit.client.0.smithi033.stdout:3/558: truncate d0/d3/d3b/d47/fa3 448771 0 2024-02-15T22:40:50.384 INFO:tasks.workunit.client.0.smithi033.stdout:3/559: fdatasync d0/d3/d2c/f5c 0 2024-02-15T22:40:50.551 INFO:tasks.workunit.client.0.smithi033.stdout:6/391: sync 2024-02-15T22:40:50.551 INFO:tasks.workunit.client.0.smithi033.stdout:5/528: sync 2024-02-15T22:40:50.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/392: unlink d12/d2c/d30/d19/d79/l7d 0 2024-02-15T22:40:50.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/393: write fa [3834472,44134] 0 2024-02-15T22:40:50.553 INFO:tasks.workunit.client.0.smithi033.stdout:5/529: truncate d6/d14/d31/d48/d49/d53/d57/f61 605954 0 2024-02-15T22:40:50.553 INFO:tasks.workunit.client.0.smithi033.stdout:6/394: dread d12/d2c/d30/f36 [4194304,4194304] 0 2024-02-15T22:40:50.554 INFO:tasks.workunit.client.0.smithi033.stdout:5/530: rmdir d6/d25 39 2024-02-15T22:40:50.554 INFO:tasks.workunit.client.0.smithi033.stdout:5/531: dread - d6/d14/d43/d70/f78 zero size 2024-02-15T22:40:50.555 INFO:tasks.workunit.client.0.smithi033.stdout:6/395: creat d12/d2c/d30/d19/f84 x:0 0 0 2024-02-15T22:40:50.555 INFO:tasks.workunit.client.0.smithi033.stdout:5/532: mknod d6/d14/d31/d48/d49/d53/d57/da1/ca6 0 2024-02-15T22:40:50.556 INFO:tasks.workunit.client.0.smithi033.stdout:6/396: mknod d12/d2c/d30/d1d/c85 0 2024-02-15T22:40:50.556 INFO:tasks.workunit.client.0.smithi033.stdout:6/397: chown d12/d2c/d30/d1d/f39 3 1 2024-02-15T22:40:50.556 INFO:tasks.workunit.client.0.smithi033.stdout:6/398: chown d12/d1b/d3f/d5b/f77 14 1 2024-02-15T22:40:50.557 INFO:tasks.workunit.client.0.smithi033.stdout:5/533: mknod d6/d14/d31/d48/d49/ca7 0 2024-02-15T22:40:50.557 INFO:tasks.workunit.client.0.smithi033.stdout:5/534: chown d6/d14/f19 27819009 1 2024-02-15T22:40:50.558 INFO:tasks.workunit.client.0.smithi033.stdout:5/535: dread d6/d14/d31/d48/d56/f5b [0,4194304] 0 2024-02-15T22:40:50.558 INFO:tasks.workunit.client.0.smithi033.stdout:6/399: mknod d12/d2c/d30/d19/d79/c86 0 2024-02-15T22:40:50.573 INFO:tasks.workunit.client.0.smithi033.stdout:5/536: dwrite d6/d14/d31/d50/d5c/fa5 [0,4194304] 0 2024-02-15T22:40:51.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:50 smithi033 ceph-mon[29033]: mgrmap e24: smithi082.mjhlse(active, since 9s), standbys: smithi033.swohxi 2024-02-15T22:40:51.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:50 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:40:51.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:50 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:51.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:50 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:51.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:50 smithi033 ceph-mon[29033]: pgmap v8: 65 pgs: 65 active+clean; 784 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 82 MiB/s rd, 94 MiB/s wr, 154 op/s 2024-02-15T22:40:51.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:50 smithi082 ceph-mon[37153]: mgrmap e24: smithi082.mjhlse(active, since 9s), standbys: smithi033.swohxi 2024-02-15T22:40:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:50 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:40:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:50 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:50 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:50 smithi082 ceph-mon[37153]: pgmap v8: 65 pgs: 65 active+clean; 784 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 82 MiB/s rd, 94 MiB/s wr, 154 op/s 2024-02-15T22:40:51.386 INFO:tasks.workunit.client.0.smithi033.stdout:4/511: sync 2024-02-15T22:40:51.386 INFO:tasks.workunit.client.0.smithi033.stdout:5/537: sync 2024-02-15T22:40:51.386 INFO:tasks.workunit.client.0.smithi033.stdout:3/560: sync 2024-02-15T22:40:51.386 INFO:tasks.workunit.client.0.smithi033.stdout:8/438: sync 2024-02-15T22:40:51.386 INFO:tasks.workunit.client.0.smithi033.stdout:2/550: sync 2024-02-15T22:40:51.386 INFO:tasks.workunit.client.0.smithi033.stdout:0/486: sync 2024-02-15T22:40:51.387 INFO:tasks.workunit.client.0.smithi033.stdout:7/501: sync 2024-02-15T22:40:51.387 INFO:tasks.workunit.client.0.smithi033.stdout:7/502: fdatasync d5/df/d56/d60/d59/f74 0 2024-02-15T22:40:51.388 INFO:tasks.workunit.client.0.smithi033.stdout:1/398: sync 2024-02-15T22:40:51.388 INFO:tasks.workunit.client.0.smithi033.stdout:6/400: sync 2024-02-15T22:40:51.388 INFO:tasks.workunit.client.0.smithi033.stdout:9/483: sync 2024-02-15T22:40:51.388 INFO:tasks.workunit.client.0.smithi033.stdout:9/484: stat d4/d1d/d23/f47 0 2024-02-15T22:40:51.389 INFO:tasks.workunit.client.0.smithi033.stdout:4/512: truncate f4 1642489 0 2024-02-15T22:40:51.392 INFO:tasks.workunit.client.0.smithi033.stdout:3/561: mkdir d0/d3/d2c/d5d/d3d/db4 0 2024-02-15T22:40:51.393 INFO:tasks.workunit.client.0.smithi033.stdout:8/439: creat d1/d68/f91 x:0 0 0 2024-02-15T22:40:51.395 INFO:tasks.workunit.client.0.smithi033.stdout:2/551: mknod d1/d8/d2b/d2f/d13/da9/cb2 0 2024-02-15T22:40:51.397 INFO:tasks.workunit.client.0.smithi033.stdout:6/401: rmdir d12/d1b/d3f/d5b/d5c 39 2024-02-15T22:40:51.397 INFO:tasks.workunit.client.0.smithi033.stdout:6/402: truncate d12/f5d 614456 0 2024-02-15T22:40:51.399 INFO:tasks.workunit.client.0.smithi033.stdout:9/485: truncate d4/d1d/d23/d32/d3e/f4d 1177012 0 2024-02-15T22:40:51.399 INFO:tasks.workunit.client.0.smithi033.stdout:4/513: mknod d8/caf 0 2024-02-15T22:40:51.405 INFO:tasks.workunit.client.0.smithi033.stdout:2/552: mknod d1/d8/d2b/d2f/d13/da9/cb3 0 2024-02-15T22:40:51.405 INFO:tasks.workunit.client.0.smithi033.stdout:2/553: creat d1/d8/d2b/d2f/d12/d52/fb4 x:0 0 0 2024-02-15T22:40:51.405 INFO:tasks.workunit.client.0.smithi033.stdout:8/440: mknod d1/d68/d1d/d4a/d76/c92 0 2024-02-15T22:40:51.406 INFO:tasks.workunit.client.0.smithi033.stdout:8/441: chown d1/d6/d14/c19 493 1 2024-02-15T22:40:51.406 INFO:tasks.workunit.client.0.smithi033.stdout:9/486: mknod d4/d1d/d23/c8c 0 2024-02-15T22:40:51.410 INFO:tasks.workunit.client.0.smithi033.stdout:4/514: creat d8/d16/d51/d1c/d3c/d49/dac/fb0 x:0 0 0 2024-02-15T22:40:51.410 INFO:tasks.workunit.client.0.smithi033.stdout:4/515: chown d8/d16/d51/d1c/c2f 0 1 2024-02-15T22:40:51.412 INFO:tasks.workunit.client.0.smithi033.stdout:2/554: mkdir d1/d8/d2b/d2f/d13/d6f/db5 0 2024-02-15T22:40:51.413 INFO:tasks.workunit.client.0.smithi033.stdout:2/555: write d1/d8/d2b/d2f/d24/d69/f89 [144821,106123] 0 2024-02-15T22:40:51.413 INFO:tasks.workunit.client.0.smithi033.stdout:8/442: rename d1/d36/f77 to d1/d68/d1d/d4a/f93 0 2024-02-15T22:40:51.415 INFO:tasks.workunit.client.0.smithi033.stdout:6/403: link cc d12/d3c/c87 0 2024-02-15T22:40:51.416 INFO:tasks.workunit.client.0.smithi033.stdout:9/487: symlink d4/d1d/d23/d32/d3e/l8d 0 2024-02-15T22:40:51.417 INFO:tasks.workunit.client.0.smithi033.stdout:2/556: mknod d1/d8/d2b/d2f/d12/d52/cb6 0 2024-02-15T22:40:51.419 INFO:tasks.workunit.client.0.smithi033.stdout:8/443: mkdir d1/d68/d1d/d4a/d76/d79/d94 0 2024-02-15T22:40:51.419 INFO:tasks.workunit.client.0.smithi033.stdout:3/562: dread d0/f36 [0,4194304] 0 2024-02-15T22:40:51.419 INFO:tasks.workunit.client.0.smithi033.stdout:3/563: dread - d0/d3/dd/f76 zero size 2024-02-15T22:40:51.420 INFO:tasks.workunit.client.0.smithi033.stdout:6/404: read d12/d2c/d30/d19/f67 [393414,4334] 0 2024-02-15T22:40:51.420 INFO:tasks.workunit.client.0.smithi033.stdout:2/557: mkdir d1/d8/d2b/d2f/d38/d62/db7 0 2024-02-15T22:40:51.423 INFO:tasks.workunit.client.0.smithi033.stdout:3/564: mknod d0/d3/d2c/cb5 0 2024-02-15T22:40:51.425 INFO:tasks.workunit.client.0.smithi033.stdout:6/405: unlink d12/d2c/d30/d19/f2f 0 2024-02-15T22:40:51.431 INFO:tasks.workunit.client.0.smithi033.stdout:6/406: creat d12/d1b/d3f/f88 x:0 0 0 2024-02-15T22:40:51.434 INFO:tasks.workunit.client.0.smithi033.stdout:6/407: getdents d12/d2c 0 2024-02-15T22:40:51.440 INFO:tasks.workunit.client.0.smithi033.stdout:2/558: dread d1/d8/d2b/d2f/d24/d31/f58 [0,4194304] 0 2024-02-15T22:40:51.440 INFO:tasks.workunit.client.0.smithi033.stdout:2/559: write d1/d8/f9b [444395,103723] 0 2024-02-15T22:40:51.443 INFO:tasks.workunit.client.0.smithi033.stdout:2/560: link d1/d8/d2b/d2f/d38/db0/c4c d1/d66/d75/cb8 0 2024-02-15T22:40:51.443 INFO:tasks.workunit.client.0.smithi033.stdout:2/561: write d1/d16/d5a/d67/f70 [3657622,12068] 0 2024-02-15T22:40:51.447 INFO:tasks.workunit.client.0.smithi033.stdout:2/562: creat d1/d8/d2b/d2f/d38/d9a/fb9 x:0 0 0 2024-02-15T22:40:51.452 INFO:tasks.workunit.client.0.smithi033.stdout:2/563: link d1/d16/d3f/c55 d1/d8/d2b/d2f/d13/d59/d76/cba 0 2024-02-15T22:40:51.452 INFO:tasks.workunit.client.0.smithi033.stdout:2/564: chown d1/c14 35179 1 2024-02-15T22:40:51.456 INFO:tasks.workunit.client.0.smithi033.stdout:2/565: rename d1/d66/ca1 to d1/d8/d2b/d2f/d13/d6f/db5/cbb 0 2024-02-15T22:40:51.456 INFO:tasks.workunit.client.0.smithi033.stdout:2/566: read - d1/d16/d5a/f97 zero size 2024-02-15T22:40:51.459 INFO:tasks.workunit.client.0.smithi033.stdout:1/399: dread d1/de/d27/d28/d2d/f3d [0,4194304] 0 2024-02-15T22:40:51.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/400: mkdir d1/de/d27/d28/d79 0 2024-02-15T22:40:51.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/401: fsync d1/de/f13 0 2024-02-15T22:40:51.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/402: dread - d1/de/d27/d28/d2d/d36/f54 zero size 2024-02-15T22:40:51.464 INFO:tasks.workunit.client.0.smithi033.stdout:1/403: creat d1/de/d27/d28/d2d/f7a x:0 0 0 2024-02-15T22:40:51.464 INFO:tasks.workunit.client.0.smithi033.stdout:1/404: stat d1/c12 0 2024-02-15T22:40:51.465 INFO:tasks.workunit.client.0.smithi033.stdout:1/405: mkdir d1/d20/d42/d2c/d7b 0 2024-02-15T22:40:51.489 INFO:tasks.workunit.client.0.smithi033.stdout:1/406: read d1/de/d27/d28/d37/f3e [918119,100188] 0 2024-02-15T22:40:51.490 INFO:tasks.workunit.client.0.smithi033.stdout:1/407: mknod d1/d20/d42/d25/c7c 0 2024-02-15T22:40:51.490 INFO:tasks.workunit.client.0.smithi033.stdout:1/408: truncate d1/de/d27/d28/d2d/d36/f62 221221 0 2024-02-15T22:40:51.490 INFO:tasks.workunit.client.0.smithi033.stdout:1/409: getdents d1/de/d27/d28/d2d/d36 0 2024-02-15T22:40:51.492 INFO:tasks.workunit.client.0.smithi033.stdout:1/410: unlink d1/d20/d42/d2c/f31 0 2024-02-15T22:40:51.494 INFO:tasks.workunit.client.0.smithi033.stdout:1/411: mknod d1/d57/c7d 0 2024-02-15T22:40:51.494 INFO:tasks.workunit.client.0.smithi033.stdout:1/412: chown d1/de/d27/l47 100 1 2024-02-15T22:40:51.547 INFO:tasks.workunit.client.0.smithi033.stdout:1/413: dread d1/fa [0,4194304] 0 2024-02-15T22:40:51.549 INFO:tasks.workunit.client.0.smithi033.stdout:1/414: truncate d1/d20/d42/f33 481566 0 2024-02-15T22:40:51.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/415: symlink d1/d57/l7e 0 2024-02-15T22:40:51.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/416: write d1/de/d27/d28/d2d/f48 [997117,44619] 0 2024-02-15T22:40:51.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/417: write d1/f64 [1002486,6582] 0 2024-02-15T22:40:51.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/418: stat d1/d20/d42/d2c/d4e/l52 0 2024-02-15T22:40:51.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/419: fsync d1/de/d27/d28/d37/f66 0 2024-02-15T22:40:51.559 INFO:tasks.workunit.client.0.smithi033.stdout:5/538: dwrite d6/fe [8388608,4194304] 0 2024-02-15T22:40:51.562 INFO:tasks.workunit.client.0.smithi033.stdout:5/539: mkdir d6/d25/d99/da8 0 2024-02-15T22:40:51.564 INFO:tasks.workunit.client.0.smithi033.stdout:5/540: creat d6/d14/d31/d48/da2/fa9 x:0 0 0 2024-02-15T22:40:51.615 INFO:tasks.workunit.client.0.smithi033.stdout:2/567: write d1/d8/d2b/d2f/d13/da9/f63 [376108,53914] 0 2024-02-15T22:40:51.620 INFO:tasks.workunit.client.0.smithi033.stdout:2/568: unlink d1/d8/d2b/d2f/f8c 0 2024-02-15T22:40:51.620 INFO:tasks.workunit.client.0.smithi033.stdout:2/569: readlink d1/d16/l6c 0 2024-02-15T22:40:51.622 INFO:tasks.workunit.client.0.smithi033.stdout:8/444: dwrite d1/d6/d14/f1b [4194304,4194304] 0 2024-02-15T22:40:51.639 INFO:tasks.workunit.client.0.smithi033.stdout:2/570: dread d1/d8/fe [0,4194304] 0 2024-02-15T22:40:51.639 INFO:tasks.workunit.client.0.smithi033.stdout:2/571: dread - d1/d66/d75/f83 zero size 2024-02-15T22:40:51.676 INFO:tasks.workunit.client.0.smithi033.stdout:9/488: write d4/f9 [2509325,123453] 0 2024-02-15T22:40:51.686 INFO:tasks.workunit.client.0.smithi033.stdout:9/489: rename d4/d1d/l33 to d4/d1d/d23/d32/d3e/d86/l8e 0 2024-02-15T22:40:51.691 INFO:tasks.workunit.client.0.smithi033.stdout:9/490: mknod d4/d1d/d23/d24/d51/c8f 0 2024-02-15T22:40:51.701 INFO:tasks.workunit.client.0.smithi033.stdout:8/445: dread d1/de/d1a/d2a/f30 [0,4194304] 0 2024-02-15T22:40:51.703 INFO:tasks.workunit.client.0.smithi033.stdout:8/446: rmdir d1/d68/d1d/d4a/d4c 39 2024-02-15T22:40:51.712 INFO:tasks.workunit.client.0.smithi033.stdout:9/491: dread d4/d1d/d23/d32/d3e/f4d [0,4194304] 0 2024-02-15T22:40:51.713 INFO:tasks.workunit.client.0.smithi033.stdout:9/492: write d4/d1d/d23/d32/d3e/d86/f53 [708043,30994] 0 2024-02-15T22:40:51.715 INFO:tasks.workunit.client.0.smithi033.stdout:9/493: mkdir d4/d1d/d23/d24/d51/d5d/d90 0 2024-02-15T22:40:51.715 INFO:tasks.workunit.client.0.smithi033.stdout:9/494: stat d4/d1d/d23/d24/d51/d8a 0 2024-02-15T22:40:51.723 INFO:tasks.workunit.client.0.smithi033.stdout:4/516: dwrite d8/d16/d51/f44 [0,4194304] 0 2024-02-15T22:40:51.726 INFO:tasks.workunit.client.0.smithi033.stdout:4/517: rename d8/d16/d45/d8f/d93/d9f to d8/d16/d45/db1 0 2024-02-15T22:40:51.727 INFO:tasks.workunit.client.0.smithi033.stdout:4/518: rename d8/d69/f98 to d8/d16/d97/fb2 0 2024-02-15T22:40:51.729 INFO:tasks.workunit.client.0.smithi033.stdout:4/519: rename d8/d16/d51/d1c/d99 to d8/d69/db3 0 2024-02-15T22:40:51.729 INFO:tasks.workunit.client.0.smithi033.stdout:4/520: fsync d8/d16/d51/d1c/f7e 0 2024-02-15T22:40:51.730 INFO:tasks.workunit.client.0.smithi033.stdout:4/521: unlink d8/d16/d51/d1c/c60 0 2024-02-15T22:40:51.822 INFO:tasks.workunit.client.0.smithi033.stdout:4/522: unlink d8/d18/d37/d23/d61/f76 0 2024-02-15T22:40:51.846 INFO:tasks.workunit.client.0.smithi033.stdout:5/541: truncate d6/fe 3596811 0 2024-02-15T22:40:51.848 INFO:tasks.workunit.client.0.smithi033.stdout:5/542: creat d6/faa x:0 0 0 2024-02-15T22:40:51.850 INFO:tasks.workunit.client.0.smithi033.stdout:5/543: mkdir d6/d14/d31/d50/d6a/dab 0 2024-02-15T22:40:51.850 INFO:tasks.workunit.client.0.smithi033.stdout:5/544: fsync d6/d25/f35 0 2024-02-15T22:40:51.851 INFO:tasks.workunit.client.0.smithi033.stdout:4/523: read d8/d16/d51/d1c/d96/d8c/dab/fae [245968,127178] 0 2024-02-15T22:40:51.853 INFO:tasks.workunit.client.0.smithi033.stdout:4/524: truncate d8/d18/d37/f5f 198743 0 2024-02-15T22:40:51.853 INFO:tasks.workunit.client.0.smithi033.stdout:4/525: write d8/f4a [102295,69661] 0 2024-02-15T22:40:51.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/526: creat d8/d18/d37/d31/d47/d85/fb4 x:0 0 0 2024-02-15T22:40:51.856 INFO:tasks.workunit.client.0.smithi033.stdout:4/527: dread - d8/d16/d51/d1c/d3c/d49/fa4 zero size 2024-02-15T22:40:51.857 INFO:tasks.workunit.client.0.smithi033.stdout:4/528: mknod d8/d16/d45/db1/cb5 0 2024-02-15T22:40:51.857 INFO:tasks.workunit.client.0.smithi033.stdout:4/529: chown d8/fe 32073737 1 2024-02-15T22:40:51.985 INFO:tasks.workunit.client.0.smithi033.stdout:2/572: getdents d1/d8/d2b/d2f 0 2024-02-15T22:40:51.987 INFO:tasks.workunit.client.0.smithi033.stdout:2/573: link d1/d8/d2b/f85 d1/d8/d2b/d2f/d13/d59/fbc 0 2024-02-15T22:40:51.987 INFO:tasks.workunit.client.0.smithi033.stdout:2/574: readlink d1/d8/d2b/d2f/d38/l60 0 2024-02-15T22:40:51.987 INFO:tasks.workunit.client.0.smithi033.stdout:2/575: write d1/d8/d2b/d2f/d24/d69/f7c [1047366,41182] 0 2024-02-15T22:40:51.987 INFO:tasks.workunit.client.0.smithi033.stdout:2/576: write d1/d8/d2b/d2f/f1e [5120834,64286] 0 2024-02-15T22:40:51.988 INFO:tasks.workunit.client.0.smithi033.stdout:8/447: read d1/d68/d1d/d4a/f93 [333561,106724] 0 2024-02-15T22:40:51.993 INFO:tasks.workunit.client.0.smithi033.stdout:2/577: unlink d1/d16/d5a/d67/f78 0 2024-02-15T22:40:51.993 INFO:tasks.workunit.client.0.smithi033.stdout:2/578: chown d1/d16/d5a/d67/c8b 191939810 1 2024-02-15T22:40:51.995 INFO:tasks.workunit.client.0.smithi033.stdout:8/448: unlink d1/d68/d1d/d4a/d76/c92 0 2024-02-15T22:40:51.999 INFO:tasks.workunit.client.0.smithi033.stdout:8/449: symlink d1/de/d1a/d27/l95 0 2024-02-15T22:40:52.003 INFO:tasks.workunit.client.0.smithi033.stdout:8/450: link d1/d6/d14/c46 d1/de/d5c/d90/c96 0 2024-02-15T22:40:52.003 INFO:tasks.workunit.client.0.smithi033.stdout:8/451: chown d1/de/d1a/f20 14265 1 2024-02-15T22:40:52.081 INFO:tasks.workunit.client.0.smithi033.stdout:8/452: dread d1/d68/d1d/d4a/f93 [0,4194304] 0 2024-02-15T22:40:52.229 INFO:tasks.workunit.client.0.smithi033.stdout:8/453: dread d1/de/d1a/f66 [0,4194304] 0 2024-02-15T22:40:52.229 INFO:tasks.workunit.client.0.smithi033.stdout:8/454: truncate d1/de/d1a/f20 4605003 0 2024-02-15T22:40:52.231 INFO:tasks.workunit.client.0.smithi033.stdout:8/455: truncate d1/d68/d1d/d4a/d4c/f86 582740 0 2024-02-15T22:40:52.562 INFO:tasks.workunit.client.0.smithi033.stdout:2/579: dread d1/d8/d2b/d2f/d13/da9/f63 [0,4194304] 0 2024-02-15T22:40:52.562 INFO:tasks.workunit.client.0.smithi033.stdout:2/580: chown d1/d8/c35 1738279 1 2024-02-15T22:40:52.564 INFO:tasks.workunit.client.0.smithi033.stdout:2/581: link d1/d8/d2b/d2f/d12/d52/fb4 d1/d16/d3f/fbd 0 2024-02-15T22:40:52.564 INFO:tasks.workunit.client.0.smithi033.stdout:2/582: write d1/d8/d2b/d2f/d24/d7a/fa5 [949187,128643] 0 2024-02-15T22:40:52.564 INFO:tasks.workunit.client.0.smithi033.stdout:2/583: readlink d1/l5f 0 2024-02-15T22:40:52.568 INFO:tasks.workunit.client.0.smithi033.stdout:2/584: mknod d1/d8/d2b/d2f/d24/d31/cbe 0 2024-02-15T22:40:52.568 INFO:tasks.workunit.client.0.smithi033.stdout:2/585: chown d1/d16/c47 7179 1 2024-02-15T22:40:52.602 INFO:tasks.workunit.client.0.smithi033.stdout:0/487: dwrite db/d19/d32/f48 [8388608,4194304] 0 2024-02-15T22:40:52.602 INFO:tasks.workunit.client.0.smithi033.stdout:0/488: symlink db/d19/d32/d43/d94/la4 0 2024-02-15T22:40:52.602 INFO:tasks.workunit.client.0.smithi033.stdout:0/489: write db/d2a/f40 [1121832,1370] 0 2024-02-15T22:40:52.602 INFO:tasks.workunit.client.0.smithi033.stdout:0/490: chown db/d19/l7b 4265513 1 2024-02-15T22:40:52.602 INFO:tasks.workunit.client.0.smithi033.stdout:0/491: dread - db/d2a/f5c zero size 2024-02-15T22:40:52.629 INFO:tasks.workunit.client.0.smithi033.stdout:5/545: write d6/d25/f40 [2616436,53719] 0 2024-02-15T22:40:52.636 INFO:tasks.workunit.client.0.smithi033.stdout:4/530: write d8/d16/d51/d1c/f6c [2553919,69112] 0 2024-02-15T22:40:52.636 INFO:tasks.workunit.client.0.smithi033.stdout:4/531: fsync d8/d16/d51/f86 0 2024-02-15T22:40:52.654 INFO:tasks.workunit.client.0.smithi033.stdout:8/456: write d1/de/d1a/d27/f7c [1060511,18417] 0 2024-02-15T22:40:52.655 INFO:tasks.workunit.client.0.smithi033.stdout:0/492: write db/d19/d32/f6f [442739,15853] 0 2024-02-15T22:40:52.655 INFO:tasks.workunit.client.0.smithi033.stdout:6/408: dwrite d12/d2c/d30/d19/f84 [0,4194304] 0 2024-02-15T22:40:52.656 INFO:tasks.workunit.client.0.smithi033.stdout:8/457: rmdir d1/d6 39 2024-02-15T22:40:52.657 INFO:tasks.workunit.client.0.smithi033.stdout:6/409: getdents d12/d2c/d30/d1d 0 2024-02-15T22:40:52.658 INFO:tasks.workunit.client.0.smithi033.stdout:6/410: creat d12/d1b/d3f/f89 x:0 0 0 2024-02-15T22:40:52.658 INFO:tasks.workunit.client.0.smithi033.stdout:4/532: dread d8/d16/d45/f73 [0,4194304] 0 2024-02-15T22:40:52.658 INFO:tasks.workunit.client.0.smithi033.stdout:4/533: link d8/d18/d37/faa d8/d18/d37/d31/d47/d85/fb6 0 2024-02-15T22:40:52.658 INFO:tasks.workunit.client.0.smithi033.stdout:4/534: link d8/d18/d37/d23/d61/l64 d8/d18/d37/d31/d47/d85/lb7 0 2024-02-15T22:40:52.658 INFO:tasks.workunit.client.0.smithi033.stdout:4/535: symlink d8/d16/d51/d1c/d96/d8c/lb8 0 2024-02-15T22:40:52.658 INFO:tasks.workunit.client.0.smithi033.stdout:6/411: write d12/d1b/d3f/d50/f81 [6608025,11128] 0 2024-02-15T22:40:52.659 INFO:tasks.workunit.client.0.smithi033.stdout:6/412: creat d12/d1b/d3f/d4b/f8a x:0 0 0 2024-02-15T22:40:52.659 INFO:tasks.workunit.client.0.smithi033.stdout:6/413: dread - d12/d1b/d3f/f88 zero size 2024-02-15T22:40:52.659 INFO:tasks.workunit.client.0.smithi033.stdout:6/414: stat d12/d1b/d3f/d50/f81 0 2024-02-15T22:40:52.659 INFO:tasks.workunit.client.0.smithi033.stdout:7/503: dwrite d5/dc/d5f/d8b/da1/f8f [0,4194304] 0 2024-02-15T22:40:52.661 INFO:tasks.workunit.client.0.smithi033.stdout:7/504: mkdir d5/dc/d5f/daa 0 2024-02-15T22:40:52.661 INFO:tasks.workunit.client.0.smithi033.stdout:7/505: dread - d5/df/d56/d60/d59/f8d zero size 2024-02-15T22:40:52.661 INFO:tasks.workunit.client.0.smithi033.stdout:7/506: readlink d5/df/d56/d60/d59/l95 0 2024-02-15T22:40:52.662 INFO:tasks.workunit.client.0.smithi033.stdout:7/507: truncate d5/df/d56/f6c 1463265 0 2024-02-15T22:40:52.664 INFO:tasks.workunit.client.0.smithi033.stdout:7/508: truncate d5/f18 624707 0 2024-02-15T22:40:52.664 INFO:tasks.workunit.client.0.smithi033.stdout:7/509: write d5/dc/d5f/d8b/da1/d98/d7b/f7c [3224967,111999] 0 2024-02-15T22:40:52.664 INFO:tasks.workunit.client.0.smithi033.stdout:7/510: write d5/df/d56/d60/f6b [829801,45766] 0 2024-02-15T22:40:52.665 INFO:tasks.workunit.client.0.smithi033.stdout:7/511: creat d5/df/d56/d60/d59/fab x:0 0 0 2024-02-15T22:40:52.670 INFO:tasks.workunit.client.0.smithi033.stdout:6/415: dread d12/f13 [0,4194304] 0 2024-02-15T22:40:52.670 INFO:tasks.workunit.client.0.smithi033.stdout:6/416: chown d12/d1b/d3f/d50/c6a 197805 1 2024-02-15T22:40:52.671 INFO:tasks.workunit.client.0.smithi033.stdout:7/512: dread d5/f15 [0,4194304] 0 2024-02-15T22:40:52.674 INFO:tasks.workunit.client.0.smithi033.stdout:6/417: dread d12/d2c/d30/d19/f3e [0,4194304] 0 2024-02-15T22:40:52.676 INFO:tasks.workunit.client.0.smithi033.stdout:6/418: rename d12/d1b/d3f/d50/c6a to d12/d1b/d3f/d5b/c8b 0 2024-02-15T22:40:52.677 INFO:tasks.workunit.client.0.smithi033.stdout:6/419: symlink d12/d2c/d30/d19/d79/l8c 0 2024-02-15T22:40:52.677 INFO:tasks.workunit.client.0.smithi033.stdout:6/420: fsync d12/f29 0 2024-02-15T22:40:52.677 INFO:tasks.workunit.client.0.smithi033.stdout:6/421: mknod d12/d2c/d30/d19/d79/c8d 0 2024-02-15T22:40:52.679 INFO:tasks.workunit.client.0.smithi033.stdout:6/422: creat d12/d1b/d3f/d50/f8e x:0 0 0 2024-02-15T22:40:52.679 INFO:tasks.workunit.client.0.smithi033.stdout:6/423: creat d12/d2c/d30/d19/f8f x:0 0 0 2024-02-15T22:40:52.679 INFO:tasks.workunit.client.0.smithi033.stdout:6/424: chown d12/d2c/f4a 501 1 2024-02-15T22:40:52.680 INFO:tasks.workunit.client.0.smithi033.stdout:8/458: dwrite d1/de/d5c/d90/f29 [4194304,4194304] 0 2024-02-15T22:40:52.680 INFO:tasks.workunit.client.0.smithi033.stdout:6/425: mkdir d12/d2c/d30/d90 0 2024-02-15T22:40:52.685 INFO:tasks.workunit.client.0.smithi033.stdout:5/546: dwrite d6/d14/d31/d48/d49/f84 [0,4194304] 0 2024-02-15T22:40:52.686 INFO:tasks.workunit.client.0.smithi033.stdout:5/547: getdents d6/d25/d99 0 2024-02-15T22:40:52.686 INFO:tasks.workunit.client.0.smithi033.stdout:5/548: chown d6/f33 5878 1 2024-02-15T22:40:52.690 INFO:tasks.workunit.client.0.smithi033.stdout:2/586: dwrite d1/d8/fe [4194304,4194304] 0 2024-02-15T22:40:52.690 INFO:tasks.workunit.client.0.smithi033.stdout:4/536: write d8/d16/d51/d1c/f38 [2902492,86800] 0 2024-02-15T22:40:52.693 INFO:tasks.workunit.client.0.smithi033.stdout:8/459: dread d1/d6/f6c [0,4194304] 0 2024-02-15T22:40:52.693 INFO:tasks.workunit.client.0.smithi033.stdout:8/460: readlink d1/d6/d14/l3f 0 2024-02-15T22:40:52.694 INFO:tasks.workunit.client.0.smithi033.stdout:6/426: write d12/d1b/d3f/d50/f81 [3071720,23523] 0 2024-02-15T22:40:52.696 INFO:tasks.workunit.client.0.smithi033.stdout:2/587: dread d1/d8/d2b/d2f/d13/d59/f7d [0,4194304] 0 2024-02-15T22:40:52.697 INFO:tasks.workunit.client.0.smithi033.stdout:8/461: rename d1/de/c81 to d1/d6/d14/c97 0 2024-02-15T22:40:52.697 INFO:tasks.workunit.client.0.smithi033.stdout:8/462: readlink d1/de/d5c/d90/d75/d83/l85 0 2024-02-15T22:40:52.697 INFO:tasks.workunit.client.0.smithi033.stdout:8/463: truncate d1/d68/f91 928167 0 2024-02-15T22:40:52.698 INFO:tasks.workunit.client.0.smithi033.stdout:6/427: creat d12/d3c/f91 x:0 0 0 2024-02-15T22:40:52.700 INFO:tasks.workunit.client.0.smithi033.stdout:8/464: mknod d1/d68/d1d/d4a/d76/c98 0 2024-02-15T22:40:52.702 INFO:tasks.workunit.client.0.smithi033.stdout:6/428: link d12/d1b/d3f/d5b/d5c/l80 d12/l92 0 2024-02-15T22:40:52.703 INFO:tasks.workunit.client.0.smithi033.stdout:8/465: dread d1/de/d1a/f66 [0,4194304] 0 2024-02-15T22:40:52.703 INFO:tasks.workunit.client.0.smithi033.stdout:8/466: chown d1/de/d5c/d90/d75 640 1 2024-02-15T22:40:52.703 INFO:tasks.workunit.client.0.smithi033.stdout:6/429: truncate d12/d2c/d30/f49 809960 0 2024-02-15T22:40:52.705 INFO:tasks.workunit.client.0.smithi033.stdout:6/430: truncate d12/d2c/f63 3573086 0 2024-02-15T22:40:52.705 INFO:tasks.workunit.client.0.smithi033.stdout:6/431: fdatasync d12/d2c/d30/d19/f3e 0 2024-02-15T22:40:52.705 INFO:tasks.workunit.client.0.smithi033.stdout:6/432: readlink d12/d3c/l7a 0 2024-02-15T22:40:52.706 INFO:tasks.workunit.client.0.smithi033.stdout:8/467: getdents d1/d68/d44/d49 0 2024-02-15T22:40:52.706 INFO:tasks.workunit.client.0.smithi033.stdout:8/468: chown d1/de/d1a/d2a/c89 17674 1 2024-02-15T22:40:52.706 INFO:tasks.workunit.client.0.smithi033.stdout:8/469: write d1/d36/f7a [701723,67989] 0 2024-02-15T22:40:52.708 INFO:tasks.workunit.client.0.smithi033.stdout:6/433: symlink d12/d1b/d3f/d4b/l93 0 2024-02-15T22:40:52.709 INFO:tasks.workunit.client.0.smithi033.stdout:8/470: mkdir d1/d68/d1d/d4a/d4c/d99 0 2024-02-15T22:40:52.711 INFO:tasks.workunit.client.0.smithi033.stdout:1/420: dwrite d1/f8 [0,4194304] 0 2024-02-15T22:40:52.721 INFO:tasks.workunit.client.0.smithi033.stdout:1/421: symlink d1/de/d27/l7f 0 2024-02-15T22:40:52.764 INFO:tasks.workunit.client.0.smithi033.stdout:3/565: sync 2024-02-15T22:40:52.776 INFO:tasks.workunit.client.0.smithi033.stdout:7/513: dwrite d5/d6/d10/fa5 [0,4194304] 0 2024-02-15T22:40:52.779 INFO:tasks.workunit.client.0.smithi033.stdout:7/514: symlink d5/df/d56/d99/lac 0 2024-02-15T22:40:52.780 INFO:tasks.workunit.client.0.smithi033.stdout:7/515: creat d5/df/fad x:0 0 0 2024-02-15T22:40:52.786 INFO:tasks.workunit.client.0.smithi033.stdout:7/516: dread d5/df/d56/f6c [0,4194304] 0 2024-02-15T22:40:52.787 INFO:tasks.workunit.client.0.smithi033.stdout:7/517: symlink d5/dc/d5f/d8b/da1/d98/lae 0 2024-02-15T22:40:52.787 INFO:tasks.workunit.client.0.smithi033.stdout:7/518: readlink d5/df/d40/l88 0 2024-02-15T22:40:52.787 INFO:tasks.workunit.client.0.smithi033.stdout:7/519: chown d5/df/d56/d60/d59/f74 239264628 1 2024-02-15T22:40:52.787 INFO:tasks.workunit.client.0.smithi033.stdout:7/520: fdatasync d5/df/d56/d60/d59/fab 0 2024-02-15T22:40:52.787 INFO:tasks.workunit.client.0.smithi033.stdout:7/521: chown d5/dc/d5f/d8b/da1/d98/d8a 48 1 2024-02-15T22:40:52.790 INFO:tasks.workunit.client.0.smithi033.stdout:2/588: dwrite d1/d8/d2b/d2f/d24/f39 [0,4194304] 0 2024-02-15T22:40:52.791 INFO:tasks.workunit.client.0.smithi033.stdout:7/522: dread d5/d6/f68 [0,4194304] 0 2024-02-15T22:40:52.791 INFO:tasks.workunit.client.0.smithi033.stdout:7/523: chown d5/df/d56/d60/d59/d9c 43013725 1 2024-02-15T22:40:52.793 INFO:tasks.workunit.client.0.smithi033.stdout:2/589: unlink d1/fa2 0 2024-02-15T22:40:52.794 INFO:tasks.workunit.client.0.smithi033.stdout:8/471: dwrite d1/de/d1a/d2a/f3b [0,4194304] 0 2024-02-15T22:40:52.794 INFO:tasks.workunit.client.0.smithi033.stdout:8/472: chown d1/de/d5c/f7e 8 1 2024-02-15T22:40:52.794 INFO:tasks.workunit.client.0.smithi033.stdout:7/524: creat d5/df/d40/d73/faf x:0 0 0 2024-02-15T22:40:52.795 INFO:tasks.workunit.client.0.smithi033.stdout:2/590: mknod d1/d8/d2b/d2f/d12/cbf 0 2024-02-15T22:40:52.796 INFO:tasks.workunit.client.0.smithi033.stdout:3/566: dwrite d0/f56 [0,4194304] 0 2024-02-15T22:40:52.796 INFO:tasks.workunit.client.0.smithi033.stdout:3/567: dread - d0/d3/dd/f99 zero size 2024-02-15T22:40:52.797 INFO:tasks.workunit.client.0.smithi033.stdout:8/473: rename d1/d68/d1d/d4a/d4c/c54 to d1/de/d1a/d2a/d40/c9a 0 2024-02-15T22:40:52.797 INFO:tasks.workunit.client.0.smithi033.stdout:8/474: creat d1/d68/d44/f9b x:0 0 0 2024-02-15T22:40:52.798 INFO:tasks.workunit.client.0.smithi033.stdout:2/591: mknod d1/d66/d75/cc0 0 2024-02-15T22:40:52.799 INFO:tasks.workunit.client.0.smithi033.stdout:8/475: creat d1/de/d1a/d2a/f9c x:0 0 0 2024-02-15T22:40:52.801 INFO:tasks.workunit.client.0.smithi033.stdout:7/525: rename d5/df/d40/d89/l9f to d5/dc/d5f/daa/lb0 0 2024-02-15T22:40:52.802 INFO:tasks.workunit.client.0.smithi033.stdout:7/526: dread d5/d6/f68 [0,4194304] 0 2024-02-15T22:40:52.803 INFO:tasks.workunit.client.0.smithi033.stdout:2/592: symlink d1/d8/d2b/d2f/d24/d5d/lc1 0 2024-02-15T22:40:52.803 INFO:tasks.workunit.client.0.smithi033.stdout:2/593: write d1/d8/d2b/d2f/d12/d52/f94 [859003,120443] 0 2024-02-15T22:40:52.805 INFO:tasks.workunit.client.0.smithi033.stdout:7/527: mkdir d5/dc/d5f/d8b/da1/d98/d7b/db1 0 2024-02-15T22:40:52.806 INFO:tasks.workunit.client.0.smithi033.stdout:7/528: dread d5/dc/d5f/f75 [0,4194304] 0 2024-02-15T22:40:52.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/529: dread - d5/df/f5e zero size 2024-02-15T22:40:52.808 INFO:tasks.workunit.client.0.smithi033.stdout:7/530: mkdir d5/d6/d10/db2 0 2024-02-15T22:40:52.808 INFO:tasks.workunit.client.0.smithi033.stdout:8/476: write d1/de/d1a/d2a/f3b [2836279,110211] 0 2024-02-15T22:40:52.808 INFO:tasks.workunit.client.0.smithi033.stdout:8/477: getdents d1/de/d1a/d27/d60 0 2024-02-15T22:40:52.810 INFO:tasks.workunit.client.0.smithi033.stdout:7/531: rename d5/dc/f90 to d5/d6/d10/db2/fb3 0 2024-02-15T22:40:52.810 INFO:tasks.workunit.client.0.smithi033.stdout:8/478: mkdir d1/de/d1a/d9d 0 2024-02-15T22:40:52.811 INFO:tasks.workunit.client.0.smithi033.stdout:7/532: symlink d5/df/d56/d84/lb4 0 2024-02-15T22:40:52.814 INFO:tasks.workunit.client.0.smithi033.stdout:8/479: write d1/de/d1a/f66 [3016072,94842] 0 2024-02-15T22:40:52.815 INFO:tasks.workunit.client.0.smithi033.stdout:2/594: write d1/d8/d2b/d2f/d12/f42 [863406,94351] 0 2024-02-15T22:40:52.819 INFO:tasks.workunit.client.0.smithi033.stdout:2/595: read d1/d8/d2b/d2f/d13/d59/f7d [1140102,95101] 0 2024-02-15T22:40:52.819 INFO:tasks.workunit.client.0.smithi033.stdout:2/596: mknod d1/d8/cc2 0 2024-02-15T22:40:52.820 INFO:tasks.workunit.client.0.smithi033.stdout:1/422: dwrite d1/de/d27/d28/d37/f66 [0,4194304] 0 2024-02-15T22:40:52.821 INFO:tasks.workunit.client.0.smithi033.stdout:2/597: mknod d1/d8/d2b/d2f/d24/d2a/cc3 0 2024-02-15T22:40:52.825 INFO:tasks.workunit.client.0.smithi033.stdout:1/423: mkdir d1/de/d27/d28/d2d/d36/d80 0 2024-02-15T22:40:52.825 INFO:tasks.workunit.client.0.smithi033.stdout:1/424: write d1/f7 [11068430,90563] 0 2024-02-15T22:40:52.835 INFO:tasks.workunit.client.0.smithi033.stdout:3/568: dwrite d0/f13 [4194304,4194304] 0 2024-02-15T22:40:52.835 INFO:tasks.workunit.client.0.smithi033.stdout:8/480: dread d1/de/d1a/f69 [0,4194304] 0 2024-02-15T22:40:52.835 INFO:tasks.workunit.client.0.smithi033.stdout:8/481: chown d1/de 741670 1 2024-02-15T22:40:52.836 INFO:tasks.workunit.client.0.smithi033.stdout:1/425: dread d1/d20/d42/d2c/d30/f40 [0,4194304] 0 2024-02-15T22:40:52.840 INFO:tasks.workunit.client.0.smithi033.stdout:3/569: mkdir d0/d3/d2c/d5d/d3d/db6 0 2024-02-15T22:40:52.840 INFO:tasks.workunit.client.0.smithi033.stdout:3/570: write d0/d3/d2c/d5d/f49 [945869,37736] 0 2024-02-15T22:40:52.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/571: mknod d0/d3/d5f/cb7 0 2024-02-15T22:40:52.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/572: write d0/d1c/f32 [1737486,120538] 0 2024-02-15T22:40:52.843 INFO:tasks.workunit.client.0.smithi033.stdout:3/573: fdatasync d0/d3/d2c/d5d/d3d/d8f/fa4 0 2024-02-15T22:40:52.844 INFO:tasks.workunit.client.0.smithi033.stdout:3/574: creat d0/d3/d2c/d5d/d3d/db6/fb8 x:0 0 0 2024-02-15T22:40:52.845 INFO:tasks.workunit.client.0.smithi033.stdout:3/575: rename d0/d3/d65/d97/fa8 to d0/d3/d2c/d5d/d3d/d8f/fb9 0 2024-02-15T22:40:52.846 INFO:tasks.workunit.client.0.smithi033.stdout:3/576: readlink d0/d3/d2c/d5d/d3d/d57/d74/l81 0 2024-02-15T22:40:52.846 INFO:tasks.workunit.client.0.smithi033.stdout:3/577: symlink d0/d91/lba 0 2024-02-15T22:40:52.850 INFO:tasks.workunit.client.0.smithi033.stdout:9/495: sync 2024-02-15T22:40:52.851 INFO:tasks.workunit.client.0.smithi033.stdout:1/426: dread d1/de/f38 [0,4194304] 0 2024-02-15T22:40:52.851 INFO:tasks.workunit.client.0.smithi033.stdout:2/598: dwrite d1/d16/d5a/f97 [0,4194304] 0 2024-02-15T22:40:52.851 INFO:tasks.workunit.client.0.smithi033.stdout:2/599: chown d1/d8/d2b/d2f/d38/db0/f6e 5880 1 2024-02-15T22:40:52.855 INFO:tasks.workunit.client.0.smithi033.stdout:2/600: mknod d1/d8/d2b/d2f/d24/cc4 0 2024-02-15T22:40:52.855 INFO:tasks.workunit.client.0.smithi033.stdout:2/601: creat d1/d8/d2b/d2f/d12/fc5 x:0 0 0 2024-02-15T22:40:52.859 INFO:tasks.workunit.client.0.smithi033.stdout:0/493: dread db/d19/d32/f23 [4194304,4194304] 0 2024-02-15T22:40:52.861 INFO:tasks.workunit.client.0.smithi033.stdout:0/494: unlink db/d19/d32/d46/l9e 0 2024-02-15T22:40:52.861 INFO:tasks.workunit.client.0.smithi033.stdout:0/495: dread - db/d19/f72 zero size 2024-02-15T22:40:52.861 INFO:tasks.workunit.client.0.smithi033.stdout:0/496: chown db/d2a/d6e/f8f 3295 1 2024-02-15T22:40:52.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/602: dread d1/d16/d5a/f7b [0,4194304] 0 2024-02-15T22:40:52.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/603: chown d1/d8/d2b/d2f/d24/d7a 1420981791 1 2024-02-15T22:40:52.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/604: chown d1/d8/d2b/d2f/d38/db0/l8f 6 1 2024-02-15T22:40:52.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/605: truncate d1/d8/d2b/d2f/d12/f42 4667211 0 2024-02-15T22:40:52.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/606: write d1/d8/d2b/d2f/d3d/faa [779810,66597] 0 2024-02-15T22:40:52.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/607: fsync d1/d8/fe 0 2024-02-15T22:40:52.864 INFO:tasks.workunit.client.0.smithi033.stdout:2/608: chown d1/d8/d2b/c77 1 1 2024-02-15T22:40:52.867 INFO:tasks.workunit.client.0.smithi033.stdout:8/482: dwrite d1/d68/d44/f9b [0,4194304] 0 2024-02-15T22:40:52.867 INFO:tasks.workunit.client.0.smithi033.stdout:9/496: dread d4/d1d/d23/d24/d5a/f80 [0,4194304] 0 2024-02-15T22:40:52.873 INFO:tasks.workunit.client.0.smithi033.stdout:8/483: creat d1/de/d1a/d9d/f9e x:0 0 0 2024-02-15T22:40:52.873 INFO:tasks.workunit.client.0.smithi033.stdout:1/427: dwrite d1/de/f63 [0,4194304] 0 2024-02-15T22:40:52.874 INFO:tasks.workunit.client.0.smithi033.stdout:8/484: mknod d1/de/c9f 0 2024-02-15T22:40:52.874 INFO:tasks.workunit.client.0.smithi033.stdout:8/485: chown d1/d68/d1d/d4a/d4c/d99 695399 1 2024-02-15T22:40:52.883 INFO:tasks.workunit.client.0.smithi033.stdout:5/549: write d6/fe [2907486,30177] 0 2024-02-15T22:40:52.884 INFO:tasks.workunit.client.0.smithi033.stdout:5/550: stat d6/d14/d31/d50/d5c/l91 0 2024-02-15T22:40:52.885 INFO:tasks.workunit.client.0.smithi033.stdout:5/551: symlink d6/d14/d31/d38/d3f/lac 0 2024-02-15T22:40:52.889 INFO:tasks.workunit.client.0.smithi033.stdout:8/486: write d1/de/d1a/d2a/f6f [814530,74910] 0 2024-02-15T22:40:52.889 INFO:tasks.workunit.client.0.smithi033.stdout:2/609: dwrite d1/d8/d2b/d2f/d24/d7a/fa5 [0,4194304] 0 2024-02-15T22:40:52.889 INFO:tasks.workunit.client.0.smithi033.stdout:2/610: truncate d1/d8/d2b/d2f/d12/d52/fb4 941670 0 2024-02-15T22:40:52.889 INFO:tasks.workunit.client.0.smithi033.stdout:2/611: stat d1/d16/d5a/f7b 0 2024-02-15T22:40:52.896 INFO:tasks.workunit.client.0.smithi033.stdout:2/612: write d1/d8/d2b/d2f/d24/d31/f43 [2176032,102287] 0 2024-02-15T22:40:52.897 INFO:tasks.workunit.client.0.smithi033.stdout:8/487: dread d1/de/d5c/d90/f29 [4194304,4194304] 0 2024-02-15T22:40:52.898 INFO:tasks.workunit.client.0.smithi033.stdout:1/428: dwrite d1/de/d27/d28/d2d/f76 [0,4194304] 0 2024-02-15T22:40:52.898 INFO:tasks.workunit.client.0.smithi033.stdout:2/613: creat d1/d8/d34/fc6 x:0 0 0 2024-02-15T22:40:52.899 INFO:tasks.workunit.client.0.smithi033.stdout:8/488: unlink d1/de/d5c/d90/c96 0 2024-02-15T22:40:52.903 INFO:tasks.workunit.client.0.smithi033.stdout:1/429: unlink d1/de/c1e 0 2024-02-15T22:40:52.904 INFO:tasks.workunit.client.0.smithi033.stdout:2/614: creat d1/d8/d2b/d2f/d13/fc7 x:0 0 0 2024-02-15T22:40:52.906 INFO:tasks.workunit.client.0.smithi033.stdout:8/489: symlink d1/de/d5c/d90/d75/d83/la0 0 2024-02-15T22:40:52.906 INFO:tasks.workunit.client.0.smithi033.stdout:8/490: chown d1/d68/d1d/d4a/f93 6819 1 2024-02-15T22:40:52.907 INFO:tasks.workunit.client.0.smithi033.stdout:2/615: mkdir d1/d8/d2b/d2f/d13/d59/dc8 0 2024-02-15T22:40:52.908 INFO:tasks.workunit.client.0.smithi033.stdout:1/430: dread d1/de/d27/d28/d2d/f3d [0,4194304] 0 2024-02-15T22:40:52.908 INFO:tasks.workunit.client.0.smithi033.stdout:8/491: creat d1/d74/fa1 x:0 0 0 2024-02-15T22:40:52.909 INFO:tasks.workunit.client.0.smithi033.stdout:2/616: mknod d1/d66/d75/cc9 0 2024-02-15T22:40:52.910 INFO:tasks.workunit.client.0.smithi033.stdout:8/492: creat d1/de/d1a/d27/d70/fa2 x:0 0 0 2024-02-15T22:40:52.910 INFO:tasks.workunit.client.0.smithi033.stdout:8/493: dread - d1/de/d1a/d9d/f9e zero size 2024-02-15T22:40:52.912 INFO:tasks.workunit.client.0.smithi033.stdout:2/617: creat d1/d8/d2b/d2f/d13/d6f/fca x:0 0 0 2024-02-15T22:40:52.912 INFO:tasks.workunit.client.0.smithi033.stdout:2/618: write d1/f20 [2290217,85654] 0 2024-02-15T22:40:52.912 INFO:tasks.workunit.client.0.smithi033.stdout:8/494: unlink d1/de/d1a/d27/l95 0 2024-02-15T22:40:52.913 INFO:tasks.workunit.client.0.smithi033.stdout:2/619: mknod d1/d8/d2b/d2f/d24/d2a/d88/d8e/ccb 0 2024-02-15T22:40:52.915 INFO:tasks.workunit.client.0.smithi033.stdout:8/495: unlink d1/d68/f91 0 2024-02-15T22:40:52.918 INFO:tasks.workunit.client.0.smithi033.stdout:1/431: write d1/de/d27/d28/d37/f45 [1207666,94236] 0 2024-02-15T22:40:52.927 INFO:tasks.workunit.client.0.smithi033.stdout:1/432: write d1/de/d27/d28/d2d/f76 [3720569,75552] 0 2024-02-15T22:40:52.945 INFO:tasks.workunit.client.0.smithi033.stdout:2/620: dwrite d1/d8/d2b/d2f/d38/db0/f9c [0,4194304] 0 2024-02-15T22:40:52.947 INFO:tasks.workunit.client.0.smithi033.stdout:2/621: symlink d1/d66/d75/lcc 0 2024-02-15T22:40:52.947 INFO:tasks.workunit.client.0.smithi033.stdout:2/622: fdatasync d1/d8/d2b/d2f/d24/f39 0 2024-02-15T22:40:52.948 INFO:tasks.workunit.client.0.smithi033.stdout:1/433: dwrite d1/f7 [4194304,4194304] 0 2024-02-15T22:40:52.949 INFO:tasks.workunit.client.0.smithi033.stdout:2/623: rename d1/d8/d2b/d2f/d12/d52/f94 to d1/d16/d57/fcd 0 2024-02-15T22:40:52.949 INFO:tasks.workunit.client.0.smithi033.stdout:2/624: creat d1/d8/fce x:0 0 0 2024-02-15T22:40:52.951 INFO:tasks.workunit.client.0.smithi033.stdout:1/434: rename d1/d20/d42/f2f to d1/de/f81 0 2024-02-15T22:40:52.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/625: rmdir d1/d8/d2b/d2f/d3d 39 2024-02-15T22:40:52.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/626: chown d1/d16/d57 25510742 1 2024-02-15T22:40:52.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/627: readlink l0 0 2024-02-15T22:40:52.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/628: write d1/d8/d2b/d2f/d24/d69/f89 [212744,19132] 0 2024-02-15T22:40:52.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/629: read d1/d8/d2b/d2f/d13/f17 [499202,116] 0 2024-02-15T22:40:52.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/630: chown d1/d8/d2b/d2f/d3d/faa 19 1 2024-02-15T22:40:52.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/631: truncate d1/d8/d2b/d2f/d38/d9a/fb9 659571 0 2024-02-15T22:40:52.974 INFO:tasks.workunit.client.0.smithi033.stdout:2/632: dwrite d1/d8/d2b/d2f/f1e [4194304,4194304] 0 2024-02-15T22:40:52.974 INFO:tasks.workunit.client.0.smithi033.stdout:2/633: chown d1/d8/d2b/d2f/d24/c74 6311 1 2024-02-15T22:40:52.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/435: dwrite d1/d20/d42/d25/f60 [0,4194304] 0 2024-02-15T22:40:52.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/436: chown d1/d20/l56 693560 1 2024-02-15T22:40:52.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/437: write d1/d20/d42/f33 [646394,71360] 0 2024-02-15T22:40:52.975 INFO:tasks.workunit.client.0.smithi033.stdout:2/634: creat d1/d8/d2b/d2f/d13/d6f/db5/fcf x:0 0 0 2024-02-15T22:40:52.995 INFO:tasks.workunit.client.0.smithi033.stdout:1/438: dwrite d1/de/d27/d28/d2d/d36/f54 [0,4194304] 0 2024-02-15T22:40:52.995 INFO:tasks.workunit.client.0.smithi033.stdout:1/439: chown d1/d20 71880 1 2024-02-15T22:40:52.997 INFO:tasks.workunit.client.0.smithi033.stdout:1/440: mknod d1/d20/d42/d2c/d4e/c82 0 2024-02-15T22:40:52.997 INFO:tasks.workunit.client.0.smithi033.stdout:2/635: dwrite d1/d8/d2b/d2f/d38/db0/f82 [0,4194304] 0 2024-02-15T22:40:52.997 INFO:tasks.workunit.client.0.smithi033.stdout:2/636: chown d1/d66 363 1 2024-02-15T22:40:52.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/441: link d1/d20/d42/d25/f6f d1/de/d27/d28/f83 0 2024-02-15T22:40:53.000 INFO:tasks.workunit.client.0.smithi033.stdout:2/637: rename d1/d8/d2b/d2f/d24/c86 to d1/d8/d2b/d2f/d24/d2a/d88/d8e/cd0 0 2024-02-15T22:40:53.001 INFO:tasks.workunit.client.0.smithi033.stdout:1/442: unlink d1/fa 0 2024-02-15T22:40:53.001 INFO:tasks.workunit.client.0.smithi033.stdout:2/638: rmdir d1/d66 39 2024-02-15T22:40:53.003 INFO:tasks.workunit.client.0.smithi033.stdout:1/443: rename d1/de/d27/d28/d2d/d36/d80 to d1/de/d27/d28/d2d/d3b/d84 0 2024-02-15T22:40:53.003 INFO:tasks.workunit.client.0.smithi033.stdout:1/444: creat d1/de/d27/d39/d3a/f85 x:0 0 0 2024-02-15T22:40:53.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:52 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:53.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:52 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:53.114 INFO:tasks.workunit.client.0.smithi033.stdout:2/639: dwrite d1/d8/d2b/d2f/d13/f17 [0,4194304] 0 2024-02-15T22:40:53.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:52 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:53.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:52 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:53.132 INFO:tasks.workunit.client.0.smithi033.stdout:2/640: dwrite d1/d8/f9b [0,4194304] 0 2024-02-15T22:40:53.132 INFO:tasks.workunit.client.0.smithi033.stdout:2/641: fdatasync d1/d8/d2b/d2f/d24/d31/f43 0 2024-02-15T22:40:53.544 INFO:tasks.workunit.client.0.smithi033.stdout:4/537: sync 2024-02-15T22:40:53.546 INFO:tasks.workunit.client.0.smithi033.stdout:4/538: rename d8/d18 to d8/d16/d51/d1c/db9 0 2024-02-15T22:40:53.546 INFO:tasks.workunit.client.0.smithi033.stdout:4/539: read d8/d16/d51/d1c/db9/d37/d31/f48 [64256,15431] 0 2024-02-15T22:40:53.547 INFO:tasks.workunit.client.0.smithi033.stdout:4/540: creat d8/d16/d51/d1c/d3c/d3f/fba x:0 0 0 2024-02-15T22:40:53.549 INFO:tasks.workunit.client.0.smithi033.stdout:4/541: symlink d8/d16/d51/d1c/d3c/d49/dac/lbb 0 2024-02-15T22:40:53.549 INFO:tasks.workunit.client.0.smithi033.stdout:4/542: truncate d8/f54 2298914 0 2024-02-15T22:40:53.550 INFO:tasks.workunit.client.0.smithi033.stdout:4/543: truncate d8/d16/d51/d77/fa0 1271755 0 2024-02-15T22:40:53.551 INFO:tasks.workunit.client.0.smithi033.stdout:4/544: unlink d8/d16/d51/d1c/d96/ca8 0 2024-02-15T22:40:53.554 INFO:tasks.workunit.client.0.smithi033.stdout:4/545: creat d8/d16/d51/d1c/db9/d37/d31/d47/d85/fbc x:0 0 0 2024-02-15T22:40:53.725 INFO:tasks.workunit.client.0.smithi033.stdout:4/546: dwrite d8/d16/d51/d1c/db9/d37/d31/d47/d85/fb6 [0,4194304] 0 2024-02-15T22:40:53.726 INFO:tasks.workunit.client.0.smithi033.stdout:4/547: dread d8/d16/d51/d1c/db9/d37/d31/f48 [0,4194304] 0 2024-02-15T22:40:53.731 INFO:tasks.workunit.client.0.smithi033.stdout:4/548: creat d8/d16/d51/d1c/db9/fbd x:0 0 0 2024-02-15T22:40:53.732 INFO:tasks.workunit.client.0.smithi033.stdout:4/549: mkdir d8/d16/d51/d1c/db9/d37/dbe 0 2024-02-15T22:40:53.733 INFO:tasks.workunit.client.0.smithi033.stdout:4/550: mkdir d8/d16/d97/dbf 0 2024-02-15T22:40:53.734 INFO:tasks.workunit.client.0.smithi033.stdout:4/551: link d8/d16/d51/d1c/d96/c82 d8/d16/cc0 0 2024-02-15T22:40:53.734 INFO:tasks.workunit.client.0.smithi033.stdout:4/552: chown d8/d16/d51/d1c/db9/d37/d31 109208 1 2024-02-15T22:40:53.736 INFO:tasks.workunit.client.0.smithi033.stdout:4/553: rename d8/d16/d51/d1c/d96/d8c to d8/d16/d51/d1c/d50/da1/dc1 0 2024-02-15T22:40:53.736 INFO:tasks.workunit.client.0.smithi033.stdout:4/554: dread - d8/d16/d51/d1c/db9/d37/d31/d47/d85/f89 zero size 2024-02-15T22:40:53.736 INFO:tasks.workunit.client.0.smithi033.stdout:4/555: symlink d8/d16/d51/d1c/db9/d37/d31/d80/lc2 0 2024-02-15T22:40:53.737 INFO:tasks.workunit.client.0.smithi033.stdout:4/556: creat d8/d16/d51/d1c/d50/da1/dc1/fc3 x:0 0 0 2024-02-15T22:40:53.741 INFO:tasks.workunit.client.0.smithi033.stdout:4/557: dread d8/d16/d51/d1c/db9/d37/d31/f42 [0,4194304] 0 2024-02-15T22:40:53.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/558: creat d8/d16/d51/d71/fc4 x:0 0 0 2024-02-15T22:40:53.743 INFO:tasks.workunit.client.0.smithi033.stdout:4/559: mkdir d8/dc5 0 2024-02-15T22:40:53.744 INFO:tasks.workunit.client.0.smithi033.stdout:4/560: truncate d8/d1a/f87 129209 0 2024-02-15T22:40:53.745 INFO:tasks.workunit.client.0.smithi033.stdout:4/561: creat d8/d16/d51/d1c/db9/d37/d31/fc6 x:0 0 0 2024-02-15T22:40:53.748 INFO:tasks.workunit.client.0.smithi033.stdout:4/562: unlink d8/d16/d51/d27/f5c 0 2024-02-15T22:40:53.755 INFO:tasks.workunit.client.0.smithi033.stdout:4/563: dread d8/d16/d51/d1c/db9/d37/d31/d47/d85/fb6 [0,4194304] 0 2024-02-15T22:40:53.762 INFO:tasks.workunit.client.0.smithi033.stdout:4/564: dread d8/f39 [0,4194304] 0 2024-02-15T22:40:53.762 INFO:tasks.workunit.client.0.smithi033.stdout:4/565: read d8/d16/d51/d1c/db9/f25 [57214,41516] 0 2024-02-15T22:40:53.765 INFO:tasks.workunit.client.0.smithi033.stdout:4/566: dread d8/d16/d51/d1c/db9/d37/d23/f5b [0,4194304] 0 2024-02-15T22:40:53.765 INFO:tasks.workunit.client.0.smithi033.stdout:4/567: truncate d8/d16/d51/d1c/db9/d37/f55 1042742 0 2024-02-15T22:40:53.785 INFO:tasks.workunit.client.0.smithi033.stdout:4/568: dwrite d8/d16/d51/d1c/d3c/d49/f62 [0,4194304] 0 2024-02-15T22:40:53.785 INFO:tasks.workunit.client.0.smithi033.stdout:4/569: chown d8/d16/d51/d1c/d96/f81 1305965108 1 2024-02-15T22:40:53.799 INFO:tasks.workunit.client.0.smithi033.stdout:4/570: dwrite d8/d16/d97/fb2 [4194304,4194304] 0 2024-02-15T22:40:53.799 INFO:tasks.workunit.client.0.smithi033.stdout:4/571: fsync d8/d16/d51/d1c/db9/d37/d23/d61/f65 0 2024-02-15T22:40:53.805 INFO:tasks.workunit.client.0.smithi033.stdout:4/572: dread d8/d16/d51/d1c/d3c/f4d [0,4194304] 0 2024-02-15T22:40:53.805 INFO:tasks.workunit.client.0.smithi033.stdout:4/573: truncate d8/d16/d51/d1c/db9/d37/f40 140503 0 2024-02-15T22:40:53.806 INFO:tasks.workunit.client.0.smithi033.stdout:4/574: read - d8/d16/d51/d1c/d3c/d49/fa4 zero size 2024-02-15T22:40:53.806 INFO:tasks.workunit.client.0.smithi033.stdout:4/575: mkdir d8/d16/d51/d1c/d50/da1/dc1/dab/dc7 0 2024-02-15T22:40:53.807 INFO:tasks.workunit.client.0.smithi033.stdout:4/576: creat d8/d16/d51/fc8 x:0 0 0 2024-02-15T22:40:53.807 INFO:tasks.workunit.client.0.smithi033.stdout:4/577: write d8/d1a/f87 [311503,4108] 0 2024-02-15T22:40:53.808 INFO:tasks.workunit.client.0.smithi033.stdout:4/578: unlink d8/d16/d51/d77/c95 0 2024-02-15T22:40:53.808 INFO:tasks.workunit.client.0.smithi033.stdout:4/579: chown d8/d16/d51/d1c/d3c/d3f/c7d 25190655 1 2024-02-15T22:40:53.810 INFO:tasks.workunit.client.0.smithi033.stdout:0/497: sync 2024-02-15T22:40:53.810 INFO:tasks.workunit.client.0.smithi033.stdout:8/496: sync 2024-02-15T22:40:53.810 INFO:tasks.workunit.client.0.smithi033.stdout:3/578: sync 2024-02-15T22:40:53.810 INFO:tasks.workunit.client.0.smithi033.stdout:7/533: sync 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:6/434: sync 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:2/642: sync 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:9/497: sync 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:3/579: read - d0/d3/d2c/d5d/d3d/db6/fb8 zero size 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:5/552: sync 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:3/580: chown d0/d3/d2c/d5d/d3d/d8f/faf 119750 1 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:3/581: fdatasync d0/d3/d3b/f98 0 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:1/445: sync 2024-02-15T22:40:53.811 INFO:tasks.workunit.client.0.smithi033.stdout:3/582: write d0/d3/d2c/d5d/d3d/db6/fb8 [243391,121900] 0 2024-02-15T22:40:53.812 INFO:tasks.workunit.client.0.smithi033.stdout:8/497: mknod d1/de/d5c/ca3 0 2024-02-15T22:40:53.812 INFO:tasks.workunit.client.0.smithi033.stdout:4/580: dread d8/d16/d51/d1c/f32 [0,4194304] 0 2024-02-15T22:40:53.814 INFO:tasks.workunit.client.0.smithi033.stdout:0/498: link db/d19/d32/d43/l64 db/d2a/la5 0 2024-02-15T22:40:53.814 INFO:tasks.workunit.client.0.smithi033.stdout:0/499: readlink db/d19/l88 0 2024-02-15T22:40:53.814 INFO:tasks.workunit.client.0.smithi033.stdout:0/500: chown db/d19/d32/d43/d5a/d76/f86 24078 1 2024-02-15T22:40:53.815 INFO:tasks.workunit.client.0.smithi033.stdout:9/498: mknod d4/d1d/d23/c91 0 2024-02-15T22:40:53.815 INFO:tasks.workunit.client.0.smithi033.stdout:9/499: write d4/d1d/d23/d32/f4f [1538186,126719] 0 2024-02-15T22:40:53.815 INFO:tasks.workunit.client.0.smithi033.stdout:9/500: chown d4/d1d/d23/d7b 0 1 2024-02-15T22:40:53.816 INFO:tasks.workunit.client.0.smithi033.stdout:1/446: symlink d1/de/d27/d28/d2d/l86 0 2024-02-15T22:40:53.816 INFO:tasks.workunit.client.0.smithi033.stdout:1/447: fdatasync d1/de/d27/d28/f29 0 2024-02-15T22:40:53.817 INFO:tasks.workunit.client.0.smithi033.stdout:3/583: rename d0/d3/d5f/c9a to d0/d3/d2c/d5d/d3d/db6/cbb 0 2024-02-15T22:40:53.818 INFO:tasks.workunit.client.0.smithi033.stdout:8/498: creat d1/d6/d14/fa4 x:0 0 0 2024-02-15T22:40:53.820 INFO:tasks.workunit.client.0.smithi033.stdout:4/581: symlink d8/d16/d51/d1c/d50/da1/dc1/dab/lc9 0 2024-02-15T22:40:53.820 INFO:tasks.workunit.client.0.smithi033.stdout:4/582: fdatasync d8/d16/d51/d1c/d96/f81 0 2024-02-15T22:40:53.821 INFO:tasks.workunit.client.0.smithi033.stdout:2/643: dread d1/d16/d57/f93 [0,4194304] 0 2024-02-15T22:40:53.821 INFO:tasks.workunit.client.0.smithi033.stdout:2/644: truncate d1/d8/d2b/d2f/d38/db0/fa8 742862 0 2024-02-15T22:40:53.822 INFO:tasks.workunit.client.0.smithi033.stdout:0/501: symlink db/d19/d32/d43/d5a/d76/la6 0 2024-02-15T22:40:53.822 INFO:tasks.workunit.client.0.smithi033.stdout:0/502: chown db/d19/f3f 5 1 2024-02-15T22:40:53.822 INFO:tasks.workunit.client.0.smithi033.stdout:0/503: creat db/d2a/d68/d8b/fa7 x:0 0 0 2024-02-15T22:40:53.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/504: truncate db/d19/d32/d43/d7d/f85 2034903 0 2024-02-15T22:40:53.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/505: chown db/d19/f1a 2565 1 2024-02-15T22:40:53.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/506: truncate db/d2a/f40 2158981 0 2024-02-15T22:40:53.823 INFO:tasks.workunit.client.0.smithi033.stdout:1/448: dread - d1/d20/d42/d25/d4d/f70 zero size 2024-02-15T22:40:53.824 INFO:tasks.workunit.client.0.smithi033.stdout:3/584: rmdir d0/d3/d2c/d5d/d3d/d57/d74 39 2024-02-15T22:40:53.824 INFO:tasks.workunit.client.0.smithi033.stdout:7/534: write d5/f19 [1568107,109885] 0 2024-02-15T22:40:53.825 INFO:tasks.workunit.client.0.smithi033.stdout:7/535: readlink d5/d6/la2 0 2024-02-15T22:40:53.826 INFO:tasks.workunit.client.0.smithi033.stdout:8/499: rmdir d1/d6/d14/d5d 39 2024-02-15T22:40:53.826 INFO:tasks.workunit.client.0.smithi033.stdout:8/500: readlink d1/d6/d14/l3f 0 2024-02-15T22:40:53.827 INFO:tasks.workunit.client.0.smithi033.stdout:9/501: dread d4/d1d/d23/d24/f4b [0,4194304] 0 2024-02-15T22:40:53.827 INFO:tasks.workunit.client.0.smithi033.stdout:4/583: symlink d8/d16/d45/lca 0 2024-02-15T22:40:53.828 INFO:tasks.workunit.client.0.smithi033.stdout:0/507: creat db/fa8 x:0 0 0 2024-02-15T22:40:53.829 INFO:tasks.workunit.client.0.smithi033.stdout:1/449: rmdir d1/d20/d42 39 2024-02-15T22:40:53.829 INFO:tasks.workunit.client.0.smithi033.stdout:1/450: creat d1/d20/d42/d25/d4d/f87 x:0 0 0 2024-02-15T22:40:53.831 INFO:tasks.workunit.client.0.smithi033.stdout:3/585: link d0/d3/d3b/d47/f50 d0/d3/d2c/d5d/d3d/d57/fbc 0 2024-02-15T22:40:53.834 INFO:tasks.workunit.client.0.smithi033.stdout:7/536: mknod d5/df/d56/d84/cb5 0 2024-02-15T22:40:53.835 INFO:tasks.workunit.client.0.smithi033.stdout:8/501: mkdir d1/d68/d1d/d4a/d76/d79/da5 0 2024-02-15T22:40:53.837 INFO:tasks.workunit.client.0.smithi033.stdout:9/502: creat d4/f92 x:0 0 0 2024-02-15T22:40:53.838 INFO:tasks.workunit.client.0.smithi033.stdout:0/508: write db/d19/d32/d3d/f59 [2459349,26846] 0 2024-02-15T22:40:53.838 INFO:tasks.workunit.client.0.smithi033.stdout:4/584: rmdir d8/d16/d51/d1c/d50/da1/dc1/dab/dc7 0 2024-02-15T22:40:53.838 INFO:tasks.workunit.client.0.smithi033.stdout:4/585: truncate d8/d16/d51/d1c/d3c/d49/f6b 521814 0 2024-02-15T22:40:53.840 INFO:tasks.workunit.client.0.smithi033.stdout:1/451: truncate d1/de/d27/d28/d37/f66 2050661 0 2024-02-15T22:40:53.841 INFO:tasks.workunit.client.0.smithi033.stdout:3/586: creat d0/d1c/fbd x:0 0 0 2024-02-15T22:40:53.841 INFO:tasks.workunit.client.0.smithi033.stdout:3/587: fsync d0/d3/d3b/f98 0 2024-02-15T22:40:53.842 INFO:tasks.workunit.client.0.smithi033.stdout:8/502: symlink d1/de/la6 0 2024-02-15T22:40:53.843 INFO:tasks.workunit.client.0.smithi033.stdout:9/503: creat d4/d1d/d23/d24/d5a/f93 x:0 0 0 2024-02-15T22:40:53.844 INFO:tasks.workunit.client.0.smithi033.stdout:0/509: rmdir db/d19/d32/d3d 39 2024-02-15T22:40:53.845 INFO:tasks.workunit.client.0.smithi033.stdout:6/435: dwrite d12/d2c/d30/d1d/f39 [0,4194304] 0 2024-02-15T22:40:53.845 INFO:tasks.workunit.client.0.smithi033.stdout:6/436: creat d12/d2c/d30/d19/f94 x:0 0 0 2024-02-15T22:40:53.845 INFO:tasks.workunit.client.0.smithi033.stdout:0/510: dread db/d19/d32/d3d/f44 [0,4194304] 0 2024-02-15T22:40:53.845 INFO:tasks.workunit.client.0.smithi033.stdout:6/437: write d12/d2c/d30/f7e [949772,34361] 0 2024-02-15T22:40:53.846 INFO:tasks.workunit.client.0.smithi033.stdout:4/586: mknod d8/d16/d51/d1c/d50/da1/ccb 0 2024-02-15T22:40:53.846 INFO:tasks.workunit.client.0.smithi033.stdout:1/452: creat d1/d20/d42/d25/d67/f88 x:0 0 0 2024-02-15T22:40:53.847 INFO:tasks.workunit.client.0.smithi033.stdout:5/553: dwrite d6/d14/f1c [0,4194304] 0 2024-02-15T22:40:53.847 INFO:tasks.workunit.client.0.smithi033.stdout:3/588: mknod d0/d3/d3b/d47/cbe 0 2024-02-15T22:40:53.847 INFO:tasks.workunit.client.0.smithi033.stdout:3/589: chown d0/d3/d2c/d43/c4c 0 1 2024-02-15T22:40:53.847 INFO:tasks.workunit.client.0.smithi033.stdout:2/645: dwrite d1/d8/d2b/d2f/f1e [0,4194304] 0 2024-02-15T22:40:53.847 INFO:tasks.workunit.client.0.smithi033.stdout:2/646: readlink d1/d8/d2b/d2f/d24/d5d/l6a 0 2024-02-15T22:40:53.848 INFO:tasks.workunit.client.0.smithi033.stdout:7/537: symlink d5/df/lb6 0 2024-02-15T22:40:53.851 INFO:tasks.workunit.client.0.smithi033.stdout:8/503: mknod d1/d68/d44/ca7 0 2024-02-15T22:40:53.854 INFO:tasks.workunit.client.0.smithi033.stdout:9/504: mkdir d4/d1d/d23/d32/d3e/d86/d3f/d94 0 2024-02-15T22:40:53.859 INFO:tasks.workunit.client.0.smithi033.stdout:6/438: read d12/d2c/d30/f20 [2634962,38914] 0 2024-02-15T22:40:53.863 INFO:tasks.workunit.client.0.smithi033.stdout:0/511: unlink db/d19/d32/d43/l64 0 2024-02-15T22:40:53.864 INFO:tasks.workunit.client.0.smithi033.stdout:4/587: creat d8/d16/d51/d1c/d94/fcc x:0 0 0 2024-02-15T22:40:53.864 INFO:tasks.workunit.client.0.smithi033.stdout:4/588: write d8/d16/d51/d1c/f7e [201003,97196] 0 2024-02-15T22:40:53.867 INFO:tasks.workunit.client.0.smithi033.stdout:1/453: rename d1/c46 to d1/d20/d42/d2c/d7b/c89 0 2024-02-15T22:40:53.874 INFO:tasks.workunit.client.0.smithi033.stdout:5/554: rmdir d6/d14/d31/d50/d6a 39 2024-02-15T22:40:53.874 INFO:tasks.workunit.client.0.smithi033.stdout:5/555: truncate d6/d14/d31/d48/da2/fa9 466671 0 2024-02-15T22:40:53.876 INFO:tasks.workunit.client.0.smithi033.stdout:2/647: dwrite d1/d16/d3f/fbd [0,4194304] 0 2024-02-15T22:40:53.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/504: creat d1/fa8 x:0 0 0 2024-02-15T22:40:53.880 INFO:tasks.workunit.client.0.smithi033.stdout:9/505: symlink d4/d1d/d23/d24/d51/d5d/l95 0 2024-02-15T22:40:53.882 INFO:tasks.workunit.client.0.smithi033.stdout:7/538: dwrite d5/df/fad [0,4194304] 0 2024-02-15T22:40:53.885 INFO:tasks.workunit.client.0.smithi033.stdout:0/512: chown db/d19/d32/d46/l70 6 1 2024-02-15T22:40:53.885 INFO:tasks.workunit.client.0.smithi033.stdout:0/513: dread - db/fa8 zero size 2024-02-15T22:40:53.889 INFO:tasks.workunit.client.0.smithi033.stdout:5/556: creat d6/d14/d31/d50/d6a/fad x:0 0 0 2024-02-15T22:40:53.889 INFO:tasks.workunit.client.0.smithi033.stdout:5/557: write d6/d14/d31/d48/d49/d53/fa3 [703658,118997] 0 2024-02-15T22:40:53.889 INFO:tasks.workunit.client.0.smithi033.stdout:5/558: stat d6/d14/d31/d48/da2/fa9 0 2024-02-15T22:40:53.892 INFO:tasks.workunit.client.0.smithi033.stdout:1/454: dwrite d1/d20/d42/d25/d67/f88 [0,4194304] 0 2024-02-15T22:40:53.892 INFO:tasks.workunit.client.0.smithi033.stdout:4/589: dwrite d8/d16/d51/fa7 [0,4194304] 0 2024-02-15T22:40:53.892 INFO:tasks.workunit.client.0.smithi033.stdout:2/648: dread d1/d16/d3f/fbd [0,4194304] 0 2024-02-15T22:40:53.893 INFO:tasks.workunit.client.0.smithi033.stdout:2/649: write d1/d8/d2b/d2f/d12/f42 [4200283,8800] 0 2024-02-15T22:40:53.893 INFO:tasks.workunit.client.0.smithi033.stdout:2/650: creat d1/d16/d5a/d67/fd1 x:0 0 0 2024-02-15T22:40:53.893 INFO:tasks.workunit.client.0.smithi033.stdout:9/506: dread d4/d1d/d23/d24/d5a/d72/f6d [0,4194304] 0 2024-02-15T22:40:53.894 INFO:tasks.workunit.client.0.smithi033.stdout:4/590: dread d8/d16/d51/d1c/db9/d37/f40 [0,4194304] 0 2024-02-15T22:40:53.896 INFO:tasks.workunit.client.0.smithi033.stdout:7/539: symlink d5/dc/d5f/d8b/da1/d26/d3f/lb7 0 2024-02-15T22:40:53.898 INFO:tasks.workunit.client.0.smithi033.stdout:6/439: rename d12/d1b to d12/d3c/d95 0 2024-02-15T22:40:53.904 INFO:tasks.workunit.client.0.smithi033.stdout:9/507: truncate d4/d1d/d23/d24/f2b 1399815 0 2024-02-15T22:40:53.905 INFO:tasks.workunit.client.0.smithi033.stdout:8/505: dwrite d1/de/d1a/d27/f7c [0,4194304] 0 2024-02-15T22:40:53.905 INFO:tasks.workunit.client.0.smithi033.stdout:1/455: dread d1/f64 [0,4194304] 0 2024-02-15T22:40:53.906 INFO:tasks.workunit.client.0.smithi033.stdout:4/591: creat d8/d16/d51/d1c/d50/da1/dc1/dab/fcd x:0 0 0 2024-02-15T22:40:53.906 INFO:tasks.workunit.client.0.smithi033.stdout:4/592: write d8/d69/f9c [1498182,45462] 0 2024-02-15T22:40:53.907 INFO:tasks.workunit.client.0.smithi033.stdout:6/440: symlink d12/d2c/d30/l96 0 2024-02-15T22:40:53.912 INFO:tasks.workunit.client.0.smithi033.stdout:8/506: link d1/de/d1a/d27/d70/fa2 d1/de/d5c/d90/d75/d83/fa9 0 2024-02-15T22:40:53.912 INFO:tasks.workunit.client.0.smithi033.stdout:8/507: chown d1/de/d1a/d2a/f30 26531374 1 2024-02-15T22:40:53.912 INFO:tasks.workunit.client.0.smithi033.stdout:8/508: chown d1/de/d1a/d27/d70 6741705 1 2024-02-15T22:40:53.913 INFO:tasks.workunit.client.0.smithi033.stdout:8/509: chown d1/de/d1a/d27/d70 126 1 2024-02-15T22:40:53.914 INFO:tasks.workunit.client.0.smithi033.stdout:8/510: dread - d1/de/d5c/d90/d75/d83/fa9 zero size 2024-02-15T22:40:53.915 INFO:tasks.workunit.client.0.smithi033.stdout:4/593: mkdir d8/d16/d51/d1c/db9/d37/dce 0 2024-02-15T22:40:53.915 INFO:tasks.workunit.client.0.smithi033.stdout:4/594: write d8/d16/d51/f86 [1352915,116640] 0 2024-02-15T22:40:53.916 INFO:tasks.workunit.client.0.smithi033.stdout:6/441: truncate d12/d2c/d30/d1d/f39 3667076 0 2024-02-15T22:40:53.916 INFO:tasks.workunit.client.0.smithi033.stdout:6/442: readlink d12/d2c/d30/l96 0 2024-02-15T22:40:53.916 INFO:tasks.workunit.client.0.smithi033.stdout:6/443: creat d12/d2c/d30/d19/f97 x:0 0 0 2024-02-15T22:40:53.921 INFO:tasks.workunit.client.0.smithi033.stdout:1/456: mkdir d1/d20/d8a 0 2024-02-15T22:40:53.923 INFO:tasks.workunit.client.0.smithi033.stdout:6/444: symlink d12/d2c/d30/d19/l98 0 2024-02-15T22:40:53.923 INFO:tasks.workunit.client.0.smithi033.stdout:6/445: readlink d12/d3c/l7b 0 2024-02-15T22:40:53.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/457: mkdir d1/de/d27/d28/d2d/d36/d8b 0 2024-02-15T22:40:53.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/458: truncate d1/de/d27/d28/f83 426461 0 2024-02-15T22:40:53.924 INFO:tasks.workunit.client.0.smithi033.stdout:4/595: symlink d8/d16/d51/d27/lcf 0 2024-02-15T22:40:53.924 INFO:tasks.workunit.client.0.smithi033.stdout:4/596: truncate d8/d16/d51/d1c/db9/d37/d23/f5b 1269771 0 2024-02-15T22:40:53.927 INFO:tasks.workunit.client.0.smithi033.stdout:6/446: link c8 d12/d2c/d30/d19/c99 0 2024-02-15T22:40:53.927 INFO:tasks.workunit.client.0.smithi033.stdout:6/447: stat d12/d2c/d30/f36 0 2024-02-15T22:40:53.928 INFO:tasks.workunit.client.0.smithi033.stdout:8/511: dread d1/d6/d14/f1b [0,4194304] 0 2024-02-15T22:40:53.928 INFO:tasks.workunit.client.0.smithi033.stdout:8/512: stat d1/de/d1a/d2a/f3c 0 2024-02-15T22:40:53.928 INFO:tasks.workunit.client.0.smithi033.stdout:8/513: chown d1/de/d5c/d90 0 1 2024-02-15T22:40:53.929 INFO:tasks.workunit.client.0.smithi033.stdout:7/540: dwrite d5/f15 [0,4194304] 0 2024-02-15T22:40:53.929 INFO:tasks.workunit.client.0.smithi033.stdout:4/597: rename d8/d16/d51/d1c/db9/d37/d23/c9d to d8/d16/d51/d1c/db9/d37/cd0 0 2024-02-15T22:40:53.929 INFO:tasks.workunit.client.0.smithi033.stdout:4/598: write d8/d16/d51/d1c/db9/d37/d31/f42 [315055,7680] 0 2024-02-15T22:40:53.930 INFO:tasks.workunit.client.0.smithi033.stdout:8/514: read d1/d36/f7a [7676,22300] 0 2024-02-15T22:40:53.930 INFO:tasks.workunit.client.0.smithi033.stdout:5/559: dwrite d6/d14/f2e [0,4194304] 0 2024-02-15T22:40:53.931 INFO:tasks.workunit.client.0.smithi033.stdout:4/599: creat d8/dc5/fd1 x:0 0 0 2024-02-15T22:40:53.932 INFO:tasks.workunit.client.0.smithi033.stdout:0/514: dwrite db/d19/d32/d46/f54 [0,4194304] 0 2024-02-15T22:40:53.932 INFO:tasks.workunit.client.0.smithi033.stdout:1/459: dread d1/de/f38 [0,4194304] 0 2024-02-15T22:40:53.933 INFO:tasks.workunit.client.0.smithi033.stdout:8/515: link d1/de/d1a/l26 d1/de/d5c/d90/d75/laa 0 2024-02-15T22:40:53.934 INFO:tasks.workunit.client.0.smithi033.stdout:5/560: mknod d6/d14/d31/d50/d6a/cae 0 2024-02-15T22:40:53.936 INFO:tasks.workunit.client.0.smithi033.stdout:7/541: getdents d5/df/d56/d60/d59 0 2024-02-15T22:40:53.938 INFO:tasks.workunit.client.0.smithi033.stdout:4/600: creat d8/d16/d51/d1c/d96/fd2 x:0 0 0 2024-02-15T22:40:53.938 INFO:tasks.workunit.client.0.smithi033.stdout:4/601: write d8/d16/d51/d1c/db9/f68 [1292414,79384] 0 2024-02-15T22:40:53.940 INFO:tasks.workunit.client.0.smithi033.stdout:0/515: fsync db/d2a/f40 0 2024-02-15T22:40:53.941 INFO:tasks.workunit.client.0.smithi033.stdout:1/460: truncate d1/de/d27/d28/f29 837971 0 2024-02-15T22:40:53.941 INFO:tasks.workunit.client.0.smithi033.stdout:1/461: creat d1/de/d27/d28/d2d/f8c x:0 0 0 2024-02-15T22:40:53.942 INFO:tasks.workunit.client.0.smithi033.stdout:8/516: creat d1/de/d1a/d27/d60/fab x:0 0 0 2024-02-15T22:40:53.944 INFO:tasks.workunit.client.0.smithi033.stdout:5/561: mkdir d6/d14/d31/d50/d6a/daf 0 2024-02-15T22:40:53.948 INFO:tasks.workunit.client.0.smithi033.stdout:7/542: symlink d5/df/d40/lb8 0 2024-02-15T22:40:53.948 INFO:tasks.workunit.client.0.smithi033.stdout:7/543: fsync d5/df/d56/f6f 0 2024-02-15T22:40:53.950 INFO:tasks.workunit.client.0.smithi033.stdout:8/517: write d1/de/d5c/d90/f29 [456812,93836] 0 2024-02-15T22:40:53.950 INFO:tasks.workunit.client.0.smithi033.stdout:4/602: symlink d8/d16/d51/d1c/db9/d37/d23/ld3 0 2024-02-15T22:40:53.955 INFO:tasks.workunit.client.0.smithi033.stdout:5/562: dread d6/fb [0,4194304] 0 2024-02-15T22:40:53.956 INFO:tasks.workunit.client.0.smithi033.stdout:1/462: dwrite d1/de/d27/d28/d2d/f8c [0,4194304] 0 2024-02-15T22:40:53.959 INFO:tasks.workunit.client.0.smithi033.stdout:7/544: rmdir d5/df/d56 39 2024-02-15T22:40:53.960 INFO:tasks.workunit.client.0.smithi033.stdout:4/603: creat d8/d16/d45/d8f/d93/fd4 x:0 0 0 2024-02-15T22:40:53.962 INFO:tasks.workunit.client.0.smithi033.stdout:0/516: mkdir db/d2a/d68/da9 0 2024-02-15T22:40:53.964 INFO:tasks.workunit.client.0.smithi033.stdout:7/545: symlink d5/df/d56/d7f/lb9 0 2024-02-15T22:40:53.967 INFO:tasks.workunit.client.0.smithi033.stdout:4/604: unlink d8/d16/f4e 0 2024-02-15T22:40:53.968 INFO:tasks.workunit.client.0.smithi033.stdout:0/517: dread - db/d2a/d6e/f9b zero size 2024-02-15T22:40:53.971 INFO:tasks.workunit.client.0.smithi033.stdout:7/546: rename d5/f19 to d5/d6/fba 0 2024-02-15T22:40:53.971 INFO:tasks.workunit.client.0.smithi033.stdout:1/463: write d1/de/d27/d39/d3a/f71 [1681283,66027] 0 2024-02-15T22:40:53.971 INFO:tasks.workunit.client.0.smithi033.stdout:1/464: chown d1/de/d27/l7f 786780 1 2024-02-15T22:40:53.972 INFO:tasks.workunit.client.0.smithi033.stdout:8/518: dwrite d1/d68/d44/f8d [0,4194304] 0 2024-02-15T22:40:53.973 INFO:tasks.workunit.client.0.smithi033.stdout:1/465: mknod d1/d20/d42/d25/c8d 0 2024-02-15T22:40:53.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/466: chown d1/de/d27/d39/d3a/f85 48 1 2024-02-15T22:40:53.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/547: getdents d5/df/d40/d73 0 2024-02-15T22:40:53.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/548: stat d5/d6/d10/l5c 0 2024-02-15T22:40:53.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/549: fsync d5/d6/d10/f34 0 2024-02-15T22:40:53.979 INFO:tasks.workunit.client.0.smithi033.stdout:6/448: dwrite d12/d2c/f63 [0,4194304] 0 2024-02-15T22:40:53.980 INFO:tasks.workunit.client.0.smithi033.stdout:8/519: getdents d1/d68 0 2024-02-15T22:40:54.000 INFO:tasks.workunit.client.0.smithi033.stdout:0/518: rmdir db/d2a/d68 39 2024-02-15T22:40:54.001 INFO:tasks.workunit.client.0.smithi033.stdout:0/519: write db/d19/f3f [3589892,7377] 0 2024-02-15T22:40:54.001 INFO:tasks.workunit.client.0.smithi033.stdout:0/520: chown db/d19/d32/d43/d94/la4 1496 1 2024-02-15T22:40:54.001 INFO:tasks.workunit.client.0.smithi033.stdout:0/521: creat db/d19/d32/d43/d5a/d76/faa x:0 0 0 2024-02-15T22:40:54.001 INFO:tasks.workunit.client.0.smithi033.stdout:0/522: write db/d19/d32/d3d/f59 [1397527,19909] 0 2024-02-15T22:40:54.009 INFO:tasks.workunit.client.0.smithi033.stdout:4/605: dwrite d8/d16/d51/d1c/db9/d37/f5f [0,4194304] 0 2024-02-15T22:40:54.010 INFO:tasks.workunit.client.0.smithi033.stdout:4/606: mkdir d8/d16/d51/d1c/d3c/d49/dac/dd5 0 2024-02-15T22:40:54.011 INFO:tasks.workunit.client.0.smithi033.stdout:4/607: fsync d8/d16/d51/d1c/f32 0 2024-02-15T22:40:54.011 INFO:tasks.workunit.client.0.smithi033.stdout:4/608: mknod d8/d16/d45/d8f/cd6 0 2024-02-15T22:40:54.017 INFO:tasks.workunit.client.0.smithi033.stdout:7/550: dwrite d5/df/f44 [4194304,4194304] 0 2024-02-15T22:40:54.017 INFO:tasks.workunit.client.0.smithi033.stdout:1/467: dwrite d1/de/d27/d28/f83 [0,4194304] 0 2024-02-15T22:40:54.017 INFO:tasks.workunit.client.0.smithi033.stdout:1/468: write d1/de/d27/d28/d2d/f48 [1906114,70512] 0 2024-02-15T22:40:54.018 INFO:tasks.workunit.client.0.smithi033.stdout:8/520: dwrite d1/de/d1a/f20 [0,4194304] 0 2024-02-15T22:40:54.018 INFO:tasks.workunit.client.0.smithi033.stdout:8/521: creat d1/d36/fac x:0 0 0 2024-02-15T22:40:54.018 INFO:tasks.workunit.client.0.smithi033.stdout:8/522: write d1/de/d1a/d27/d70/fa2 [114926,23869] 0 2024-02-15T22:40:54.019 INFO:tasks.workunit.client.0.smithi033.stdout:7/551: creat d5/df/d56/d60/d59/fbb x:0 0 0 2024-02-15T22:40:54.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:53 smithi033 ceph-mon[29033]: pgmap v9: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 130 MiB/s rd, 150 MiB/s wr, 239 op/s 2024-02-15T22:40:54.020 INFO:tasks.workunit.client.0.smithi033.stdout:6/449: dwrite d12/d3c/d95/d3f/d4b/f6e [0,4194304] 0 2024-02-15T22:40:54.020 INFO:tasks.workunit.client.0.smithi033.stdout:6/450: truncate d12/d2c/d30/d19/f67 1475512 0 2024-02-15T22:40:54.024 INFO:tasks.workunit.client.0.smithi033.stdout:1/469: rmdir d1/de/d27/d28/d2d/d3b 39 2024-02-15T22:40:54.025 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:53 smithi082 ceph-mon[37153]: pgmap v9: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 130 MiB/s rd, 150 MiB/s wr, 239 op/s 2024-02-15T22:40:54.026 INFO:tasks.workunit.client.0.smithi033.stdout:7/552: truncate d5/df/d56/d60/d59/d9c/f6a 3483711 0 2024-02-15T22:40:54.035 INFO:tasks.workunit.client.0.smithi033.stdout:1/470: creat d1/de/d27/d28/d37/f8e x:0 0 0 2024-02-15T22:40:54.036 INFO:tasks.workunit.client.0.smithi033.stdout:1/471: readlink d1/de/l59 0 2024-02-15T22:40:54.036 INFO:tasks.workunit.client.0.smithi033.stdout:1/472: write d1/de/f16 [970597,1345] 0 2024-02-15T22:40:54.039 INFO:tasks.workunit.client.0.smithi033.stdout:7/553: symlink d5/df/lbc 0 2024-02-15T22:40:54.039 INFO:tasks.workunit.client.0.smithi033.stdout:4/609: dwrite d8/d16/d51/d1c/db9/f25 [0,4194304] 0 2024-02-15T22:40:54.039 INFO:tasks.workunit.client.0.smithi033.stdout:4/610: fsync d8/d16/d45/d8f/d93/fd4 0 2024-02-15T22:40:54.039 INFO:tasks.workunit.client.0.smithi033.stdout:4/611: creat d8/d16/d51/d1c/db9/fd7 x:0 0 0 2024-02-15T22:40:54.040 INFO:tasks.workunit.client.0.smithi033.stdout:7/554: mkdir d5/df/d56/d60/dbd 0 2024-02-15T22:40:54.040 INFO:tasks.workunit.client.0.smithi033.stdout:7/555: creat d5/d6/d10/fbe x:0 0 0 2024-02-15T22:40:54.044 INFO:tasks.workunit.client.0.smithi033.stdout:4/612: symlink d8/d16/d51/d1c/db9/d37/d31/ld8 0 2024-02-15T22:40:54.044 INFO:tasks.workunit.client.0.smithi033.stdout:7/556: dread d5/df/d56/d60/d59/f62 [0,4194304] 0 2024-02-15T22:40:54.046 INFO:tasks.workunit.client.0.smithi033.stdout:4/613: mkdir d8/dd9 0 2024-02-15T22:40:54.046 INFO:tasks.workunit.client.0.smithi033.stdout:7/557: mknod d5/dc/d5f/d8b/da0/cbf 0 2024-02-15T22:40:54.049 INFO:tasks.workunit.client.0.smithi033.stdout:7/558: rename d5/dc/d5f/d8b/da1/d98/ca8 to d5/dc/d5f/d8b/da1/d98/d7b/db1/cc0 0 2024-02-15T22:40:54.049 INFO:tasks.workunit.client.0.smithi033.stdout:4/614: dread d8/f4a [0,4194304] 0 2024-02-15T22:40:54.050 INFO:tasks.workunit.client.0.smithi033.stdout:7/559: truncate d5/d6/f54 4057729 0 2024-02-15T22:40:54.051 INFO:tasks.workunit.client.0.smithi033.stdout:7/560: mknod d5/dc/d5f/d8b/da1/d98/d8a/cc1 0 2024-02-15T22:40:54.051 INFO:tasks.workunit.client.0.smithi033.stdout:7/561: stat d5/dc/d5f/d8b/da1/f21 0 2024-02-15T22:40:54.051 INFO:tasks.workunit.client.0.smithi033.stdout:7/562: creat d5/dc/fc2 x:0 0 0 2024-02-15T22:40:54.069 INFO:tasks.workunit.client.0.smithi033.stdout:6/451: dwrite d12/d3c/f4d [0,4194304] 0 2024-02-15T22:40:54.069 INFO:tasks.workunit.client.0.smithi033.stdout:6/452: chown d12/f28 746452 1 2024-02-15T22:40:54.069 INFO:tasks.workunit.client.0.smithi033.stdout:0/523: dwrite db/d19/f3f [0,4194304] 0 2024-02-15T22:40:54.069 INFO:tasks.workunit.client.0.smithi033.stdout:8/523: dwrite d1/de/d5c/f7e [0,4194304] 0 2024-02-15T22:40:54.069 INFO:tasks.workunit.client.0.smithi033.stdout:8/524: chown d1/d68/d1d/d4a/d76/d79/c78 164325 1 2024-02-15T22:40:54.070 INFO:tasks.workunit.client.0.smithi033.stdout:6/453: creat d12/f9a x:0 0 0 2024-02-15T22:40:54.073 INFO:tasks.workunit.client.0.smithi033.stdout:0/524: rename f5 to db/d19/d32/d43/d5a/fab 0 2024-02-15T22:40:54.076 INFO:tasks.workunit.client.0.smithi033.stdout:0/525: mkdir db/d2a/d6e/d7a/d95/dac 0 2024-02-15T22:40:54.076 INFO:tasks.workunit.client.0.smithi033.stdout:0/526: fsync db/d19/f3a 0 2024-02-15T22:40:54.078 INFO:tasks.workunit.client.0.smithi033.stdout:8/525: write d1/de/f37 [3281158,9020] 0 2024-02-15T22:40:54.080 INFO:tasks.workunit.client.0.smithi033.stdout:0/527: creat db/d2a/d68/da9/fad x:0 0 0 2024-02-15T22:40:54.080 INFO:tasks.workunit.client.0.smithi033.stdout:1/473: dwrite d1/de/d27/d39/d3a/f51 [0,4194304] 0 2024-02-15T22:40:54.080 INFO:tasks.workunit.client.0.smithi033.stdout:1/474: fsync d1/de/d27/d28/d2d/d5e/f61 0 2024-02-15T22:40:54.082 INFO:tasks.workunit.client.0.smithi033.stdout:0/528: symlink db/d60/lae 0 2024-02-15T22:40:54.087 INFO:tasks.workunit.client.0.smithi033.stdout:7/563: dwrite d5/f18 [0,4194304] 0 2024-02-15T22:40:54.087 INFO:tasks.workunit.client.0.smithi033.stdout:0/529: mkdir db/d19/d32/d46/daf 0 2024-02-15T22:40:54.087 INFO:tasks.workunit.client.0.smithi033.stdout:7/564: write d5/f30 [583964,109737] 0 2024-02-15T22:40:54.088 INFO:tasks.workunit.client.0.smithi033.stdout:4/615: dwrite d8/d16/d51/d1c/db9/d37/f5f [4194304,4194304] 0 2024-02-15T22:40:54.089 INFO:tasks.workunit.client.0.smithi033.stdout:1/475: dread d1/de/f1b [0,4194304] 0 2024-02-15T22:40:54.089 INFO:tasks.workunit.client.0.smithi033.stdout:0/530: mknod db/d19/d32/d43/d94/cb0 0 2024-02-15T22:40:54.090 INFO:tasks.workunit.client.0.smithi033.stdout:7/565: mknod d5/df/d56/d99/cc3 0 2024-02-15T22:40:54.090 INFO:tasks.workunit.client.0.smithi033.stdout:7/566: write d5/d6/f68 [1094158,27803] 0 2024-02-15T22:40:54.091 INFO:tasks.workunit.client.0.smithi033.stdout:4/616: link d8/d16/d51/d1c/db9/d37/d31/c57 d8/d16/d51/d1c/db9/d37/d23/cda 0 2024-02-15T22:40:54.095 INFO:tasks.workunit.client.0.smithi033.stdout:6/454: dwrite d12/d3c/d95/d3f/d50/f8e [0,4194304] 0 2024-02-15T22:40:54.096 INFO:tasks.workunit.client.0.smithi033.stdout:1/476: dread d1/d20/f65 [0,4194304] 0 2024-02-15T22:40:54.100 INFO:tasks.workunit.client.0.smithi033.stdout:6/455: creat d12/d2c/d30/d90/f9b x:0 0 0 2024-02-15T22:40:54.101 INFO:tasks.workunit.client.0.smithi033.stdout:8/526: dwrite d1/de/d5c/f7e [0,4194304] 0 2024-02-15T22:40:54.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/477: mkdir d1/d20/d8a/d8f 0 2024-02-15T22:40:54.103 INFO:tasks.workunit.client.0.smithi033.stdout:6/456: creat d12/d3c/d95/d3f/d4b/d6f/f9c x:0 0 0 2024-02-15T22:40:54.103 INFO:tasks.workunit.client.0.smithi033.stdout:6/457: read - d12/d3c/d95/d3f/d5b/f77 zero size 2024-02-15T22:40:54.104 INFO:tasks.workunit.client.0.smithi033.stdout:6/458: read d12/d2c/d30/d1d/f33 [2535269,5933] 0 2024-02-15T22:40:54.105 INFO:tasks.workunit.client.0.smithi033.stdout:8/527: symlink d1/de/lad 0 2024-02-15T22:40:54.106 INFO:tasks.workunit.client.0.smithi033.stdout:4/617: read d8/f54 [1923901,47482] 0 2024-02-15T22:40:54.106 INFO:tasks.workunit.client.0.smithi033.stdout:1/478: link d1/de/cf d1/d20/d42/d25/d67/c90 0 2024-02-15T22:40:54.106 INFO:tasks.workunit.client.0.smithi033.stdout:1/479: readlink d1/de/d27/d28/d2d/l86 0 2024-02-15T22:40:54.107 INFO:tasks.workunit.client.0.smithi033.stdout:7/567: read d5/df/fad [391232,96034] 0 2024-02-15T22:40:54.107 INFO:tasks.workunit.client.0.smithi033.stdout:7/568: fsync d5/dc/d5f/d8b/da1/d98/f93 0 2024-02-15T22:40:54.107 INFO:tasks.workunit.client.0.smithi033.stdout:6/459: getdents d12/d3c/d95/d3f/d5b/d5c 0 2024-02-15T22:40:54.108 INFO:tasks.workunit.client.0.smithi033.stdout:8/528: mkdir d1/dae 0 2024-02-15T22:40:54.112 INFO:tasks.workunit.client.0.smithi033.stdout:1/480: rmdir d1/de/d27/d28/d2d/d5e 39 2024-02-15T22:40:54.112 INFO:tasks.workunit.client.0.smithi033.stdout:1/481: truncate d1/de/d27/d28/d2d/f7a 352671 0 2024-02-15T22:40:54.112 INFO:tasks.workunit.client.0.smithi033.stdout:1/482: fdatasync d1/de/f81 0 2024-02-15T22:40:54.118 INFO:tasks.workunit.client.0.smithi033.stdout:0/531: dwrite db/d19/d32/d46/f83 [0,4194304] 0 2024-02-15T22:40:54.119 INFO:tasks.workunit.client.0.smithi033.stdout:4/618: read d8/d16/d97/fb2 [3836615,21957] 0 2024-02-15T22:40:54.119 INFO:tasks.workunit.client.0.smithi033.stdout:4/619: read f4 [990554,48816] 0 2024-02-15T22:40:54.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/620: dread - d8/d16/d51/d1c/d96/fd2 zero size 2024-02-15T22:40:54.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/621: readlink d8/d16/d51/d1c/db9/l5a 0 2024-02-15T22:40:54.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/622: dread d8/f4a [0,4194304] 0 2024-02-15T22:40:54.122 INFO:tasks.workunit.client.0.smithi033.stdout:6/460: dread d12/d2c/d30/d19/f26 [0,4194304] 0 2024-02-15T22:40:54.122 INFO:tasks.workunit.client.0.smithi033.stdout:1/483: dread d1/f64 [0,4194304] 0 2024-02-15T22:40:54.123 INFO:tasks.workunit.client.0.smithi033.stdout:6/461: write d12/d2c/d30/d1d/d35/f47 [99339,59006] 0 2024-02-15T22:40:54.123 INFO:tasks.workunit.client.0.smithi033.stdout:6/462: getdents d12/d2c 0 2024-02-15T22:40:54.124 INFO:tasks.workunit.client.0.smithi033.stdout:0/532: rename db/d19/c1b to db/d19/d32/d46/daf/cb1 0 2024-02-15T22:40:54.124 INFO:tasks.workunit.client.0.smithi033.stdout:0/533: readlink db/d19/l27 0 2024-02-15T22:40:54.124 INFO:tasks.workunit.client.0.smithi033.stdout:0/534: creat db/d2a/d6e/fb2 x:0 0 0 2024-02-15T22:40:54.125 INFO:tasks.workunit.client.0.smithi033.stdout:6/463: truncate f5 62269 0 2024-02-15T22:40:54.127 INFO:tasks.workunit.client.0.smithi033.stdout:0/535: chown db/d2a/c50 104 1 2024-02-15T22:40:54.132 INFO:tasks.workunit.client.0.smithi033.stdout:7/569: dwrite d5/df/d56/d60/d59/f8d [0,4194304] 0 2024-02-15T22:40:54.132 INFO:tasks.workunit.client.0.smithi033.stdout:8/529: dwrite d1/de/d1a/f69 [0,4194304] 0 2024-02-15T22:40:54.137 INFO:tasks.workunit.client.0.smithi033.stdout:4/623: write d8/d16/d51/d1c/d3c/d49/f62 [1141324,112739] 0 2024-02-15T22:40:54.138 INFO:tasks.workunit.client.0.smithi033.stdout:8/530: unlink d1/d36/f7a 0 2024-02-15T22:40:54.140 INFO:tasks.workunit.client.0.smithi033.stdout:6/464: dread d12/d3c/d95/f52 [0,4194304] 0 2024-02-15T22:40:54.142 INFO:tasks.workunit.client.0.smithi033.stdout:1/484: dread d1/de/d27/d28/f83 [0,4194304] 0 2024-02-15T22:40:54.143 INFO:tasks.workunit.client.0.smithi033.stdout:8/531: getdents d1/d68/d1d/d4a/d76/d79 0 2024-02-15T22:40:54.146 INFO:tasks.workunit.client.0.smithi033.stdout:1/485: link d1/de/d27/d28/f83 d1/d20/d42/d2c/f91 0 2024-02-15T22:40:54.147 INFO:tasks.workunit.client.0.smithi033.stdout:8/532: mknod d1/de/d1a/caf 0 2024-02-15T22:40:54.148 INFO:tasks.workunit.client.0.smithi033.stdout:6/465: symlink d12/l9d 0 2024-02-15T22:40:54.149 INFO:tasks.workunit.client.0.smithi033.stdout:1/486: mkdir d1/d20/d8a/d92 0 2024-02-15T22:40:54.151 INFO:tasks.workunit.client.0.smithi033.stdout:8/533: symlink d1/de/d1a/d27/d55/lb0 0 2024-02-15T22:40:54.154 INFO:tasks.workunit.client.0.smithi033.stdout:0/536: dwrite db/d19/d32/f48 [12582912,4194304] 0 2024-02-15T22:40:54.155 INFO:tasks.workunit.client.0.smithi033.stdout:1/487: rename d1/d20/d42/l44 to d1/d20/d42/l93 0 2024-02-15T22:40:54.155 INFO:tasks.workunit.client.0.smithi033.stdout:7/570: dwrite d5/d6/d10/f6d [0,4194304] 0 2024-02-15T22:40:54.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/534: mkdir d1/de/d5c/d90/d75/db1 0 2024-02-15T22:40:54.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/535: fdatasync d1/d36/f71 0 2024-02-15T22:40:54.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/536: write d1/d74/fa1 [1034926,120167] 0 2024-02-15T22:40:54.159 INFO:tasks.workunit.client.0.smithi033.stdout:0/537: getdents db/d19 0 2024-02-15T22:40:54.162 INFO:tasks.workunit.client.0.smithi033.stdout:1/488: creat d1/d20/d42/d2c/f94 x:0 0 0 2024-02-15T22:40:54.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/489: truncate d1/de/d27/d28/d2d/d36/f54 5189119 0 2024-02-15T22:40:54.165 INFO:tasks.workunit.client.0.smithi033.stdout:7/571: mkdir d5/df/d56/dc4 0 2024-02-15T22:40:54.166 INFO:tasks.workunit.client.0.smithi033.stdout:8/537: readlink d1/d6/l38 0 2024-02-15T22:40:54.166 INFO:tasks.workunit.client.0.smithi033.stdout:8/538: write d1/de/d5c/d90/f29 [1660091,27039] 0 2024-02-15T22:40:54.168 INFO:tasks.workunit.client.0.smithi033.stdout:1/490: mknod d1/de/d27/d39/c95 0 2024-02-15T22:40:54.169 INFO:tasks.workunit.client.0.smithi033.stdout:7/572: truncate d5/dc/d5f/d8b/da1/f21 1349105 0 2024-02-15T22:40:54.172 INFO:tasks.workunit.client.0.smithi033.stdout:8/539: symlink d1/d68/d1d/d4a/d76/lb2 0 2024-02-15T22:40:54.172 INFO:tasks.workunit.client.0.smithi033.stdout:4/624: dwrite d8/d16/d51/d1c/d96/f81 [0,4194304] 0 2024-02-15T22:40:54.173 INFO:tasks.workunit.client.0.smithi033.stdout:4/625: truncate d8/d16/d51/d1c/db9/d37/d31/d47/d85/fb4 385952 0 2024-02-15T22:40:54.173 INFO:tasks.workunit.client.0.smithi033.stdout:6/466: dwrite d12/f5e [4194304,4194304] 0 2024-02-15T22:40:54.176 INFO:tasks.workunit.client.0.smithi033.stdout:1/491: mkdir d1/d96 0 2024-02-15T22:40:54.180 INFO:tasks.workunit.client.0.smithi033.stdout:8/540: creat d1/d68/d44/d49/fb3 x:0 0 0 2024-02-15T22:40:54.181 INFO:tasks.workunit.client.0.smithi033.stdout:4/626: creat d8/d16/d51/d1c/db9/d37/fdb x:0 0 0 2024-02-15T22:40:54.183 INFO:tasks.workunit.client.0.smithi033.stdout:6/467: link d12/d2c/d30/l96 d12/d2c/d30/d19/d79/l9e 0 2024-02-15T22:40:54.184 INFO:tasks.workunit.client.0.smithi033.stdout:1/492: truncate d1/d20/d42/f49 785614 0 2024-02-15T22:40:54.187 INFO:tasks.workunit.client.0.smithi033.stdout:8/541: link d1/d6/d14/c19 d1/d6/d14/d8f/cb4 0 2024-02-15T22:40:54.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/627: creat d8/d16/d51/d77/fdc x:0 0 0 2024-02-15T22:40:54.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/628: truncate d8/d16/d45/d8f/d93/fd4 629618 0 2024-02-15T22:40:54.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/629: fsync d8/d16/d51/d1c/f38 0 2024-02-15T22:40:54.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/630: write d8/d16/d51/d1c/d50/da1/dc1/dab/fae [875667,82078] 0 2024-02-15T22:40:54.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/631: write d8/d16/d45/f73 [4678788,43293] 0 2024-02-15T22:40:54.192 INFO:tasks.workunit.client.0.smithi033.stdout:4/632: read d8/d16/d51/d1c/d3c/d49/f6b [445501,37262] 0 2024-02-15T22:40:54.192 INFO:tasks.workunit.client.0.smithi033.stdout:4/633: chown d8/d16/d51/d1c/db9/d37/d31/ld8 0 1 2024-02-15T22:40:54.198 INFO:tasks.workunit.client.0.smithi033.stdout:1/493: write d1/d57/f5f [616684,42573] 0 2024-02-15T22:40:54.204 INFO:tasks.workunit.client.0.smithi033.stdout:8/542: write d1/de/d1a/d2a/f30 [1762203,31837] 0 2024-02-15T22:40:54.204 INFO:tasks.workunit.client.0.smithi033.stdout:7/573: dwrite d5/dc/d5f/d8b/da1/d98/f93 [0,4194304] 0 2024-02-15T22:40:54.204 INFO:tasks.workunit.client.0.smithi033.stdout:8/543: truncate d1/f33 2841188 0 2024-02-15T22:40:54.204 INFO:tasks.workunit.client.0.smithi033.stdout:7/574: mknod d5/df/d56/d84/cc5 0 2024-02-15T22:40:54.204 INFO:tasks.workunit.client.0.smithi033.stdout:7/575: chown d5/df/d56/d99 158517 1 2024-02-15T22:40:54.206 INFO:tasks.workunit.client.0.smithi033.stdout:8/544: mkdir d1/de/d5c/d90/d75/db1/db5 0 2024-02-15T22:40:54.207 INFO:tasks.workunit.client.0.smithi033.stdout:7/576: truncate d5/f18 3915036 0 2024-02-15T22:40:54.207 INFO:tasks.workunit.client.0.smithi033.stdout:7/577: write d5/df/d56/d60/d59/d9c/fa9 [715050,37679] 0 2024-02-15T22:40:54.207 INFO:tasks.workunit.client.0.smithi033.stdout:7/578: read - d5/dc/d5f/d8b/da1/f53 zero size 2024-02-15T22:40:54.207 INFO:tasks.workunit.client.0.smithi033.stdout:7/579: fdatasync d5/df/d40/d73/faf 0 2024-02-15T22:40:54.208 INFO:tasks.workunit.client.0.smithi033.stdout:1/494: write d1/d20/d42/d2c/f91 [3225445,37534] 0 2024-02-15T22:40:54.208 INFO:tasks.workunit.client.0.smithi033.stdout:0/538: dwrite db/d19/d32/d43/d5a/fab [0,4194304] 0 2024-02-15T22:40:54.210 INFO:tasks.workunit.client.0.smithi033.stdout:6/468: dwrite d12/d2c/d30/d19/f3e [0,4194304] 0 2024-02-15T22:40:54.218 INFO:tasks.workunit.client.0.smithi033.stdout:7/580: write d5/df/d40/f79 [3577839,12234] 0 2024-02-15T22:40:54.219 INFO:tasks.workunit.client.0.smithi033.stdout:0/539: dread db/d19/d32/d43/d7d/f85 [0,4194304] 0 2024-02-15T22:40:54.222 INFO:tasks.workunit.client.0.smithi033.stdout:1/495: write d1/de/f1f [2725767,52348] 0 2024-02-15T22:40:54.224 INFO:tasks.workunit.client.0.smithi033.stdout:6/469: symlink d12/d2c/d30/l9f 0 2024-02-15T22:40:54.226 INFO:tasks.workunit.client.0.smithi033.stdout:8/545: dwrite d1/d68/d44/f9b [4194304,4194304] 0 2024-02-15T22:40:54.227 INFO:tasks.workunit.client.0.smithi033.stdout:7/581: unlink d5/dc/d5f/d8b/da1/f8f 0 2024-02-15T22:40:54.227 INFO:tasks.workunit.client.0.smithi033.stdout:4/634: dwrite d8/d16/d51/d1c/f6c [4194304,4194304] 0 2024-02-15T22:40:54.227 INFO:tasks.workunit.client.0.smithi033.stdout:4/635: chown d8/d16/d51/d1c/db9/d37/d31/d47/d85/fbc 40138496 1 2024-02-15T22:40:54.228 INFO:tasks.workunit.client.0.smithi033.stdout:4/636: stat d8/d16/d51/d1c/db9/d37/d23/ld3 0 2024-02-15T22:40:54.229 INFO:tasks.workunit.client.0.smithi033.stdout:1/496: rmdir d1/d20/d42/d2c/d7b 39 2024-02-15T22:40:54.229 INFO:tasks.workunit.client.0.smithi033.stdout:6/470: dread d12/f13 [0,4194304] 0 2024-02-15T22:40:54.232 INFO:tasks.workunit.client.0.smithi033.stdout:1/497: fdatasync d1/d20/d42/d2c/f91 0 2024-02-15T22:40:54.232 INFO:tasks.workunit.client.0.smithi033.stdout:1/498: dread - d1/de/d27/d28/d37/f8e zero size 2024-02-15T22:40:54.232 INFO:tasks.workunit.client.0.smithi033.stdout:1/499: fsync d1/de/d27/d28/d2d/f48 0 2024-02-15T22:40:54.233 INFO:tasks.workunit.client.0.smithi033.stdout:8/546: mknod d1/de/cb6 0 2024-02-15T22:40:54.233 INFO:tasks.workunit.client.0.smithi033.stdout:8/547: creat d1/d6/d14/fb7 x:0 0 0 2024-02-15T22:40:54.233 INFO:tasks.workunit.client.0.smithi033.stdout:8/548: creat d1/fb8 x:0 0 0 2024-02-15T22:40:54.233 INFO:tasks.workunit.client.0.smithi033.stdout:8/549: dread - d1/d68/d44/d49/fb3 zero size 2024-02-15T22:40:54.234 INFO:tasks.workunit.client.0.smithi033.stdout:7/582: dread d5/d6/d10/f6d [0,4194304] 0 2024-02-15T22:40:54.236 INFO:tasks.workunit.client.0.smithi033.stdout:4/637: mkdir d8/d16/d51/d1c/d3c/ddd 0 2024-02-15T22:40:54.239 INFO:tasks.workunit.client.0.smithi033.stdout:6/471: creat d12/d3c/d95/d3f/d4b/fa0 x:0 0 0 2024-02-15T22:40:54.240 INFO:tasks.workunit.client.0.smithi033.stdout:1/500: truncate d1/de/d27/d28/f29 415240 0 2024-02-15T22:40:54.240 INFO:tasks.workunit.client.0.smithi033.stdout:1/501: fsync d1/de/f38 0 2024-02-15T22:40:54.242 INFO:tasks.workunit.client.0.smithi033.stdout:3/590: sync 2024-02-15T22:40:54.242 INFO:tasks.workunit.client.0.smithi033.stdout:2/651: sync 2024-02-15T22:40:54.242 INFO:tasks.workunit.client.0.smithi033.stdout:9/508: sync 2024-02-15T22:40:54.242 INFO:tasks.workunit.client.0.smithi033.stdout:2/652: rename d1/d8/d2b/d2f/d13/da9 to d1/d8/d2b/d2f/d13/da9/dd2 22 2024-02-15T22:40:54.242 INFO:tasks.workunit.client.0.smithi033.stdout:2/653: write d1/d16/d57/fcd [1576131,60905] 0 2024-02-15T22:40:54.243 INFO:tasks.workunit.client.0.smithi033.stdout:4/638: mknod d8/d16/d51/d1c/d3c/d49/dac/dd5/cde 0 2024-02-15T22:40:54.244 INFO:tasks.workunit.client.0.smithi033.stdout:6/472: mkdir d12/d3c/da1 0 2024-02-15T22:40:54.245 INFO:tasks.workunit.client.0.smithi033.stdout:5/563: sync 2024-02-15T22:40:54.249 INFO:tasks.workunit.client.0.smithi033.stdout:6/473: rename d12/f5e to d12/d3c/fa2 0 2024-02-15T22:40:54.249 INFO:tasks.workunit.client.0.smithi033.stdout:6/474: fsync d12/d3c/d95/d3f/d5b/f7c 0 2024-02-15T22:40:54.249 INFO:tasks.workunit.client.0.smithi033.stdout:6/475: read - d12/d3c/f91 zero size 2024-02-15T22:40:54.249 INFO:tasks.workunit.client.0.smithi033.stdout:6/476: write d12/d2c/d30/f7e [1520607,115769] 0 2024-02-15T22:40:54.251 INFO:tasks.workunit.client.0.smithi033.stdout:2/654: dread d1/d16/d57/f93 [0,4194304] 0 2024-02-15T22:40:54.251 INFO:tasks.workunit.client.0.smithi033.stdout:2/655: write d1/d16/d5a/fa3 [4229943,77467] 0 2024-02-15T22:40:54.251 INFO:tasks.workunit.client.0.smithi033.stdout:2/656: truncate d1/d8/d2b/d2f/d13/fc7 175544 0 2024-02-15T22:40:54.253 INFO:tasks.workunit.client.0.smithi033.stdout:5/564: rename d6/d14/d43 to d6/db0 0 2024-02-15T22:40:54.254 INFO:tasks.workunit.client.0.smithi033.stdout:1/502: dread d1/f6 [0,4194304] 0 2024-02-15T22:40:54.257 INFO:tasks.workunit.client.0.smithi033.stdout:3/591: dread d0/d3/d2c/f46 [0,4194304] 0 2024-02-15T22:40:54.257 INFO:tasks.workunit.client.0.smithi033.stdout:0/540: dwrite db/d2a/f8c [0,4194304] 0 2024-02-15T22:40:54.257 INFO:tasks.workunit.client.0.smithi033.stdout:1/503: truncate d1/d20/d42/d2c/f91 2101945 0 2024-02-15T22:40:54.257 INFO:tasks.workunit.client.0.smithi033.stdout:0/541: chown db/d2a/d68 328 1 2024-02-15T22:40:54.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/592: creat d0/d3/d2c/d5d/d3d/d8f/d93/fbf x:0 0 0 2024-02-15T22:40:54.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/593: write d0/d3/dd/f76 [710062,73017] 0 2024-02-15T22:40:54.264 INFO:tasks.workunit.client.0.smithi033.stdout:1/504: truncate d1/de/f81 2380089 0 2024-02-15T22:40:54.266 INFO:tasks.workunit.client.0.smithi033.stdout:6/477: dread d12/d2c/d30/d19/f84 [0,4194304] 0 2024-02-15T22:40:54.267 INFO:tasks.workunit.client.0.smithi033.stdout:0/542: mknod db/d2a/d6e/d7a/d95/cb3 0 2024-02-15T22:40:54.267 INFO:tasks.workunit.client.0.smithi033.stdout:9/509: write d4/fd [159294,41814] 0 2024-02-15T22:40:54.267 INFO:tasks.workunit.client.0.smithi033.stdout:9/510: chown d4/d1d/d23/d24/d5e 31884938 1 2024-02-15T22:40:54.270 INFO:tasks.workunit.client.0.smithi033.stdout:3/594: unlink d0/f53 0 2024-02-15T22:40:54.272 INFO:tasks.workunit.client.0.smithi033.stdout:1/505: creat d1/d20/d42/d2c/d4e/f97 x:0 0 0 2024-02-15T22:40:54.272 INFO:tasks.workunit.client.0.smithi033.stdout:1/506: fdatasync d1/de/d27/d28/d2d/f48 0 2024-02-15T22:40:54.272 INFO:tasks.workunit.client.0.smithi033.stdout:4/639: dwrite d8/f54 [0,4194304] 0 2024-02-15T22:40:54.272 INFO:tasks.workunit.client.0.smithi033.stdout:4/640: readlink d8/d16/d51/d1c/db9/d37/d31/ld8 0 2024-02-15T22:40:54.273 INFO:tasks.workunit.client.0.smithi033.stdout:4/641: dread d8/d16/d51/d1c/db9/d37/d31/f48 [0,4194304] 0 2024-02-15T22:40:54.274 INFO:tasks.workunit.client.0.smithi033.stdout:6/478: truncate d12/d3c/d95/f52 1079160 0 2024-02-15T22:40:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:0/543: creat db/d19/d32/d43/d5a/d76/da1/fb4 x:0 0 0 2024-02-15T22:40:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:5/565: dwrite d6/d14/d31/d48/da2/fa9 [0,4194304] 0 2024-02-15T22:40:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:5/566: fsync d6/d14/d31/d64/f8a 0 2024-02-15T22:40:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:5/567: chown d6/d14/d31/d38/d9b/c4b 638 1 2024-02-15T22:40:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:5/568: creat d6/fb1 x:0 0 0 2024-02-15T22:40:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:5/569: chown d6/d14/d31/d48/d49/d53/d57/l85 265750777 1 2024-02-15T22:40:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:9/511: truncate d4/d1d/d23/d35/f77 8687644 0 2024-02-15T22:40:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:2/657: dwrite d1/d66/d75/f83 [0,4194304] 0 2024-02-15T22:40:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:3/595: mkdir d0/dc0 0 2024-02-15T22:40:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:1/507: mknod d1/d20/d8a/d92/c98 0 2024-02-15T22:40:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:1/508: fsync d1/d20/d42/f33 0 2024-02-15T22:40:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:6/479: mkdir d12/d3c/d95/d3f/da3 0 2024-02-15T22:40:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:6/480: fsync d12/d2c/d30/d1d/f22 0 2024-02-15T22:40:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:6/481: fdatasync d12/d3c/fa2 0 2024-02-15T22:40:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:1/509: write d1/d20/d42/d2c/f91 [2084197,33770] 0 2024-02-15T22:40:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:4/642: dwrite d8/d16/d51/f86 [0,4194304] 0 2024-02-15T22:40:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:5/570: mknod d6/d14/d31/d50/d6a/cb2 0 2024-02-15T22:40:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:9/512: link d4/d1d/d23/d24/d5a/f93 d4/d1d/d23/d24/d51/d8a/f96 0 2024-02-15T22:40:54.295 INFO:tasks.workunit.client.0.smithi033.stdout:2/658: mknod d1/d8/d2b/d2f/d13/d59/d76/cd3 0 2024-02-15T22:40:54.297 INFO:tasks.workunit.client.0.smithi033.stdout:3/596: truncate d0/d3/f44 2355158 0 2024-02-15T22:40:54.297 INFO:tasks.workunit.client.0.smithi033.stdout:3/597: readlink d0/d3/d65/d97/l85 0 2024-02-15T22:40:54.297 INFO:tasks.workunit.client.0.smithi033.stdout:3/598: fdatasync d0/d3/d2c/d5d/d3d/d57/f6f 0 2024-02-15T22:40:54.300 INFO:tasks.workunit.client.0.smithi033.stdout:5/571: write d6/d14/d31/d38/d3f/f92 [1398529,9556] 0 2024-02-15T22:40:54.300 INFO:tasks.workunit.client.0.smithi033.stdout:5/572: readlink d6/l75 0 2024-02-15T22:40:54.300 INFO:tasks.workunit.client.0.smithi033.stdout:5/573: creat d6/d14/d31/d48/d49/d53/d57/fb3 x:0 0 0 2024-02-15T22:40:54.301 INFO:tasks.workunit.client.0.smithi033.stdout:6/482: truncate d12/f5d 370456 0 2024-02-15T22:40:54.301 INFO:tasks.workunit.client.0.smithi033.stdout:6/483: dread - d12/d3c/d95/d3f/d50/f65 zero size 2024-02-15T22:40:54.301 INFO:tasks.workunit.client.0.smithi033.stdout:6/484: write d12/d3c/d95/d3f/f43 [137301,38930] 0 2024-02-15T22:40:54.302 INFO:tasks.workunit.client.0.smithi033.stdout:0/544: truncate db/d2a/f2b 6492077 0 2024-02-15T22:40:54.302 INFO:tasks.workunit.client.0.smithi033.stdout:6/485: dread d12/d2c/d30/f36 [4194304,4194304] 0 2024-02-15T22:40:54.304 INFO:tasks.workunit.client.0.smithi033.stdout:1/510: dwrite d1/de/d27/d28/d37/f66 [0,4194304] 0 2024-02-15T22:40:54.307 INFO:tasks.workunit.client.0.smithi033.stdout:4/643: truncate d8/d16/d97/fb2 1830198 0 2024-02-15T22:40:54.307 INFO:tasks.workunit.client.0.smithi033.stdout:4/644: dread - d8/d16/d51/d71/fc4 zero size 2024-02-15T22:40:54.307 INFO:tasks.workunit.client.0.smithi033.stdout:4/645: chown d8/d16/d51/d1c/db9/d37/dce 2824 1 2024-02-15T22:40:54.308 INFO:tasks.workunit.client.0.smithi033.stdout:3/599: dread d0/d3/dd/f52 [0,4194304] 0 2024-02-15T22:40:54.308 INFO:tasks.workunit.client.0.smithi033.stdout:3/600: dread - d0/d3/dd/f99 zero size 2024-02-15T22:40:54.308 INFO:tasks.workunit.client.0.smithi033.stdout:3/601: stat d0/d1c/l3e 0 2024-02-15T22:40:54.308 INFO:tasks.workunit.client.0.smithi033.stdout:9/513: write d4/f43 [2696251,109834] 0 2024-02-15T22:40:54.310 INFO:tasks.workunit.client.0.smithi033.stdout:2/659: symlink d1/d16/d5a/d67/ld4 0 2024-02-15T22:40:54.313 INFO:tasks.workunit.client.0.smithi033.stdout:5/574: creat d6/db0/fb4 x:0 0 0 2024-02-15T22:40:54.313 INFO:tasks.workunit.client.0.smithi033.stdout:5/575: dread - d6/d14/d31/d50/d6a/fad zero size 2024-02-15T22:40:54.315 INFO:tasks.workunit.client.0.smithi033.stdout:0/545: rename db/l25 to db/d2a/d6e/d7a/lb5 0 2024-02-15T22:40:54.318 INFO:tasks.workunit.client.0.smithi033.stdout:6/486: creat d12/d2c/fa4 x:0 0 0 2024-02-15T22:40:54.318 INFO:tasks.workunit.client.0.smithi033.stdout:6/487: truncate d12/d2c/d30/d90/f9b 834795 0 2024-02-15T22:40:54.324 INFO:tasks.workunit.client.0.smithi033.stdout:1/511: dwrite d1/de/d27/d28/d2d/f76 [4194304,4194304] 0 2024-02-15T22:40:54.328 INFO:tasks.workunit.client.0.smithi033.stdout:5/576: write d6/d14/d31/d48/f5e [856073,109715] 0 2024-02-15T22:40:54.334 INFO:tasks.workunit.client.0.smithi033.stdout:4/646: unlink d8/d16/d51/d1c/db9/d37/l3d 0 2024-02-15T22:40:54.334 INFO:tasks.workunit.client.0.smithi033.stdout:4/647: readlink d8/d16/d51/d1c/d50/l78 0 2024-02-15T22:40:54.336 INFO:tasks.workunit.client.0.smithi033.stdout:3/602: creat d0/d3/d2c/d5d/d3d/d57/d68/dac/fc1 x:0 0 0 2024-02-15T22:40:54.336 INFO:tasks.workunit.client.0.smithi033.stdout:9/514: readlink d4/l39 0 2024-02-15T22:40:54.338 INFO:tasks.workunit.client.0.smithi033.stdout:0/546: dwrite db/d19/d32/d43/f78 [0,4194304] 0 2024-02-15T22:40:54.338 INFO:tasks.workunit.client.0.smithi033.stdout:0/547: chown db/d19/d32/d3d/f44 465297 1 2024-02-15T22:40:54.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/660: creat d1/d8/d2b/d2f/fd5 x:0 0 0 2024-02-15T22:40:54.339 INFO:tasks.workunit.client.0.smithi033.stdout:6/488: mkdir d12/d2c/d30/da5 0 2024-02-15T22:40:54.344 INFO:tasks.workunit.client.0.smithi033.stdout:1/512: rmdir d1/de/d27/d28/d2d/d3b 39 2024-02-15T22:40:54.344 INFO:tasks.workunit.client.0.smithi033.stdout:9/515: dread d4/d1d/d23/f61 [4194304,4194304] 0 2024-02-15T22:40:54.346 INFO:tasks.workunit.client.0.smithi033.stdout:5/577: truncate d6/d14/f45 1003136 0 2024-02-15T22:40:54.347 INFO:tasks.workunit.client.0.smithi033.stdout:4/648: truncate d8/d16/d51/d1c/db9/d37/d23/f30 2067151 0 2024-02-15T22:40:54.347 INFO:tasks.workunit.client.0.smithi033.stdout:4/649: write d8/d16/d51/d1c/db9/d37/fdb [789330,103227] 0 2024-02-15T22:40:54.347 INFO:tasks.workunit.client.0.smithi033.stdout:4/650: read d8/d16/d51/d1c/d50/da1/dc1/dab/fae [355371,50051] 0 2024-02-15T22:40:54.348 INFO:tasks.workunit.client.0.smithi033.stdout:4/651: fdatasync d8/d16/d51/d1c/d96/f81 0 2024-02-15T22:40:54.349 INFO:tasks.workunit.client.0.smithi033.stdout:3/603: mkdir d0/d3/d2c/d5d/d3d/d57/d68/dc2 0 2024-02-15T22:40:54.349 INFO:tasks.workunit.client.0.smithi033.stdout:0/548: write db/d19/d32/f48 [8848533,27168] 0 2024-02-15T22:40:54.349 INFO:tasks.workunit.client.0.smithi033.stdout:0/549: chown db/d19/c5d 7155 1 2024-02-15T22:40:54.351 INFO:tasks.workunit.client.0.smithi033.stdout:4/652: dread d8/d16/d51/d1c/db9/d37/d23/f5b [0,4194304] 0 2024-02-15T22:40:54.353 INFO:tasks.workunit.client.0.smithi033.stdout:9/516: creat d4/d1d/d23/d32/d3e/d86/d3f/d94/f97 x:0 0 0 2024-02-15T22:40:54.353 INFO:tasks.workunit.client.0.smithi033.stdout:9/517: chown d4/d1d/d23/d32/d3e/f64 14086 1 2024-02-15T22:40:54.353 INFO:tasks.workunit.client.0.smithi033.stdout:1/513: creat d1/d57/f99 x:0 0 0 2024-02-15T22:40:54.354 INFO:tasks.workunit.client.0.smithi033.stdout:1/514: write d1/de/d27/d28/f83 [494971,771] 0 2024-02-15T22:40:54.355 INFO:tasks.workunit.client.0.smithi033.stdout:3/604: mknod d0/d3/d2c/d5d/d3d/db6/cc3 0 2024-02-15T22:40:54.355 INFO:tasks.workunit.client.0.smithi033.stdout:3/605: fsync d0/d3/d2c/f9e 0 2024-02-15T22:40:54.355 INFO:tasks.workunit.client.0.smithi033.stdout:2/661: dwrite d1/d8/d2b/d2f/d38/f95 [0,4194304] 0 2024-02-15T22:40:54.357 INFO:tasks.workunit.client.0.smithi033.stdout:0/550: symlink db/d19/d32/d43/lb6 0 2024-02-15T22:40:54.357 INFO:tasks.workunit.client.0.smithi033.stdout:0/551: getdents db/d19/d32/d43/d7d/d9c 0 2024-02-15T22:40:54.359 INFO:tasks.workunit.client.0.smithi033.stdout:1/515: mknod d1/de/d27/d28/d37/c9a 0 2024-02-15T22:40:54.360 INFO:tasks.workunit.client.0.smithi033.stdout:5/578: dread d6/d14/d31/d48/d49/f84 [0,4194304] 0 2024-02-15T22:40:54.360 INFO:tasks.workunit.client.0.smithi033.stdout:5/579: write d6/d14/d31/d48/d49/d53/fa3 [1762158,2105] 0 2024-02-15T22:40:54.360 INFO:tasks.workunit.client.0.smithi033.stdout:3/606: symlink d0/d3/d2c/d5d/d3d/db4/lc4 0 2024-02-15T22:40:54.360 INFO:tasks.workunit.client.0.smithi033.stdout:3/607: fdatasync d0/d3/d2c/d5d/d3d/d8f/faf 0 2024-02-15T22:40:54.363 INFO:tasks.workunit.client.0.smithi033.stdout:0/552: creat db/d19/d32/fb7 x:0 0 0 2024-02-15T22:40:54.363 INFO:tasks.workunit.client.0.smithi033.stdout:0/553: chown db/d19/d32/d46/f83 551 1 2024-02-15T22:40:54.364 INFO:tasks.workunit.client.0.smithi033.stdout:0/554: stat db/d2a/d6e/c79 0 2024-02-15T22:40:54.365 INFO:tasks.workunit.client.0.smithi033.stdout:9/518: link d4/f15 d4/d1d/d23/f98 0 2024-02-15T22:40:54.365 INFO:tasks.workunit.client.0.smithi033.stdout:9/519: fsync d4/d1d/d23/d32/d3e/f64 0 2024-02-15T22:40:54.365 INFO:tasks.workunit.client.0.smithi033.stdout:9/520: write d4/d1d/f70 [355356,37389] 0 2024-02-15T22:40:54.366 INFO:tasks.workunit.client.0.smithi033.stdout:9/521: write d4/d1d/d23/d32/d3e/d86/d3f/d94/f97 [98356,67713] 0 2024-02-15T22:40:54.366 INFO:tasks.workunit.client.0.smithi033.stdout:9/522: truncate d4/d1d/d23/d32/f79 891635 0 2024-02-15T22:40:54.368 INFO:tasks.workunit.client.0.smithi033.stdout:5/580: mkdir d6/d14/d31/d50/d6a/daf/db5 0 2024-02-15T22:40:54.369 INFO:tasks.workunit.client.0.smithi033.stdout:0/555: chown db/d2a/c31 0 1 2024-02-15T22:40:54.369 INFO:tasks.workunit.client.0.smithi033.stdout:3/608: dread d0/d3/d2c/d43/f61 [0,4194304] 0 2024-02-15T22:40:54.371 INFO:tasks.workunit.client.0.smithi033.stdout:1/516: getdents d1 0 2024-02-15T22:40:54.373 INFO:tasks.workunit.client.0.smithi033.stdout:5/581: creat d6/d14/d31/d50/fb6 x:0 0 0 2024-02-15T22:40:54.375 INFO:tasks.workunit.client.0.smithi033.stdout:4/653: rename d8/d16/d51/d1c/db9/d37/d23/f30 to d8/d16/d97/dbf/fdf 0 2024-02-15T22:40:54.375 INFO:tasks.workunit.client.0.smithi033.stdout:4/654: chown d8/d16/d51/d1c/d50/da1/ccb 20088 1 2024-02-15T22:40:54.377 INFO:tasks.workunit.client.0.smithi033.stdout:0/556: chown db/d2a/c41 3 1 2024-02-15T22:40:54.377 INFO:tasks.workunit.client.0.smithi033.stdout:0/557: chown db/d60/lae 14527583 1 2024-02-15T22:40:54.377 INFO:tasks.workunit.client.0.smithi033.stdout:0/558: readlink db/l16 0 2024-02-15T22:40:54.377 INFO:tasks.workunit.client.0.smithi033.stdout:0/559: creat db/d19/d32/d43/d5a/d76/fb8 x:0 0 0 2024-02-15T22:40:54.378 INFO:tasks.workunit.client.0.smithi033.stdout:2/662: dwrite d1/d8/d2b/d2f/d24/d31/f81 [4194304,4194304] 0 2024-02-15T22:40:54.378 INFO:tasks.workunit.client.0.smithi033.stdout:4/655: mkdir d8/d16/d51/d1c/db9/d37/dbe/de0 0 2024-02-15T22:40:54.378 INFO:tasks.workunit.client.0.smithi033.stdout:4/656: dread - d8/d1a/f91 zero size 2024-02-15T22:40:54.381 INFO:tasks.workunit.client.0.smithi033.stdout:9/523: rename d4/d1d/c68 to d4/d1d/d83/c99 0 2024-02-15T22:40:54.385 INFO:tasks.workunit.client.0.smithi033.stdout:2/663: truncate d1/f7 2703632 0 2024-02-15T22:40:54.385 INFO:tasks.workunit.client.0.smithi033.stdout:2/664: chown d1/d8/d2b/d2f/fd5 16498372 1 2024-02-15T22:40:54.386 INFO:tasks.workunit.client.0.smithi033.stdout:2/665: creat d1/d16/d5a/fd6 x:0 0 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/609: rename d0/d3/d2c/d5d/f49 to d0/d3/d2c/d43/fc5 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/610: truncate d0/d3/d3b/f71 4971376 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/611: creat d0/d3/d2c/d43/fc6 x:0 0 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:4/657: write d8/d16/d51/d1c/db9/f25 [3493589,40369] 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:4/658: read d8/d16/d51/d27/f5e [252146,102129] 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:4/659: truncate d8/d16/d51/d1c/db9/d37/d31/f34 5180626 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:4/660: getdents d8/d16/d51/d1c/db9/d37/dce 0 2024-02-15T22:40:54.390 INFO:tasks.workunit.client.0.smithi033.stdout:4/661: write d8/fa6 [219845,81714] 0 2024-02-15T22:40:54.391 INFO:tasks.workunit.client.0.smithi033.stdout:2/666: creat d1/d16/d3f/fd7 x:0 0 0 2024-02-15T22:40:54.392 INFO:tasks.workunit.client.0.smithi033.stdout:3/612: creat d0/d3/d3b/d47/fc7 x:0 0 0 2024-02-15T22:40:54.392 INFO:tasks.workunit.client.0.smithi033.stdout:3/613: creat d0/d3/d2c/d5d/d3d/db6/fc8 x:0 0 0 2024-02-15T22:40:54.393 INFO:tasks.workunit.client.0.smithi033.stdout:3/614: creat d0/d3/dd/fc9 x:0 0 0 2024-02-15T22:40:54.393 INFO:tasks.workunit.client.0.smithi033.stdout:1/517: dwrite d1/de/d27/d28/f2a [0,4194304] 0 2024-02-15T22:40:54.393 INFO:tasks.workunit.client.0.smithi033.stdout:4/662: creat d8/d16/d51/d1c/d50/fe1 x:0 0 0 2024-02-15T22:40:54.394 INFO:tasks.workunit.client.0.smithi033.stdout:4/663: truncate d8/d16/d51/d1c/db9/d37/fdb 1718380 0 2024-02-15T22:40:54.396 INFO:tasks.workunit.client.0.smithi033.stdout:9/524: write d4/d1d/d23/d35/f63 [861830,82046] 0 2024-02-15T22:40:54.396 INFO:tasks.workunit.client.0.smithi033.stdout:9/525: readlink d4/d1d/d23/d35/l5c 0 2024-02-15T22:40:54.396 INFO:tasks.workunit.client.0.smithi033.stdout:3/615: write d0/d3/d2c/d43/f75 [734939,34624] 0 2024-02-15T22:40:54.399 INFO:tasks.workunit.client.0.smithi033.stdout:2/667: dread d1/d16/d3f/f4b [0,4194304] 0 2024-02-15T22:40:54.399 INFO:tasks.workunit.client.0.smithi033.stdout:0/560: dwrite db/d19/f72 [0,4194304] 0 2024-02-15T22:40:54.399 INFO:tasks.workunit.client.0.smithi033.stdout:0/561: fsync db/f63 0 2024-02-15T22:40:54.401 INFO:tasks.workunit.client.0.smithi033.stdout:4/664: rename d8/d16/d51/d1c/d3c/f4d to d8/d16/d51/d1c/db9/d37/d31/da5/da9/fe2 0 2024-02-15T22:40:54.401 INFO:tasks.workunit.client.0.smithi033.stdout:4/665: chown d8/d16/d51/d1c/d3c/d3f/fba 16570 1 2024-02-15T22:40:54.403 INFO:tasks.workunit.client.0.smithi033.stdout:9/526: symlink d4/d1d/d23/d24/d5a/d72/l9a 0 2024-02-15T22:40:54.406 INFO:tasks.workunit.client.0.smithi033.stdout:3/616: mknod d0/d3/d2c/d5d/d3d/d8f/cca 0 2024-02-15T22:40:54.411 INFO:tasks.workunit.client.0.smithi033.stdout:2/668: dread d1/d8/d2b/d2f/d38/db0/f82 [0,4194304] 0 2024-02-15T22:40:54.411 INFO:tasks.workunit.client.0.smithi033.stdout:2/669: fdatasync d1/d8/d2b/d2f/d12/f42 0 2024-02-15T22:40:54.412 INFO:tasks.workunit.client.0.smithi033.stdout:4/666: symlink d8/d16/d45/d8f/le3 0 2024-02-15T22:40:54.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/617: dread d0/d3/f44 [0,4194304] 0 2024-02-15T22:40:54.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/618: truncate d0/d3/dd/f76 842263 0 2024-02-15T22:40:54.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/619: truncate d0/d3/d2c/d43/fc6 302272 0 2024-02-15T22:40:54.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/620: chown d0/d3/dd/l4f 83195952 1 2024-02-15T22:40:54.421 INFO:tasks.workunit.client.0.smithi033.stdout:2/670: link d1/d16/d57/fcd d1/d16/d5a/d67/fd8 0 2024-02-15T22:40:54.422 INFO:tasks.workunit.client.0.smithi033.stdout:4/667: link d8/d16/d45/db1/cb5 d8/d16/d51/d1c/d50/ce4 0 2024-02-15T22:40:54.423 INFO:tasks.workunit.client.0.smithi033.stdout:4/668: link d8/d16/d51/d1c/db9/l1e d8/d16/d51/d1c/db9/d37/d31/da5/le5 0 2024-02-15T22:40:54.423 INFO:tasks.workunit.client.0.smithi033.stdout:4/669: chown d8/f54 562 1 2024-02-15T22:40:54.424 INFO:tasks.workunit.client.0.smithi033.stdout:2/671: getdents d1/d8/d2b/d2f/d12/d52 0 2024-02-15T22:40:54.424 INFO:tasks.workunit.client.0.smithi033.stdout:2/672: chown d1/d8/d2b/d2f/d13/da9 203144682 1 2024-02-15T22:40:54.425 INFO:tasks.workunit.client.0.smithi033.stdout:4/670: unlink d8/d16/d51/d1c/db9/d37/f55 0 2024-02-15T22:40:54.425 INFO:tasks.workunit.client.0.smithi033.stdout:4/671: fdatasync d8/d16/d51/d27/f5e 0 2024-02-15T22:40:54.425 INFO:tasks.workunit.client.0.smithi033.stdout:2/673: mknod d1/d8/d2b/d2f/d13/da9/cd9 0 2024-02-15T22:40:54.427 INFO:tasks.workunit.client.0.smithi033.stdout:4/672: creat d8/d16/d51/d1c/db9/d37/d31/d47/fe6 x:0 0 0 2024-02-15T22:40:54.427 INFO:tasks.workunit.client.0.smithi033.stdout:4/673: chown d8/d1a/l9a 276538 1 2024-02-15T22:40:54.427 INFO:tasks.workunit.client.0.smithi033.stdout:2/674: getdents d1/d8/d2b/d2f/d38/db0/d99 0 2024-02-15T22:40:54.428 INFO:tasks.workunit.client.0.smithi033.stdout:4/674: creat d8/d16/d51/d1c/db9/d37/d31/d80/fe7 x:0 0 0 2024-02-15T22:40:54.429 INFO:tasks.workunit.client.0.smithi033.stdout:2/675: creat d1/d8/d2b/d2f/d24/d2a/fda x:0 0 0 2024-02-15T22:40:54.429 INFO:tasks.workunit.client.0.smithi033.stdout:2/676: write d1/d8/d2b/d2f/fd5 [289749,114213] 0 2024-02-15T22:40:54.429 INFO:tasks.workunit.client.0.smithi033.stdout:2/677: getdents d1/d8/d2b/d2f/d38/d62/db7 0 2024-02-15T22:40:54.429 INFO:tasks.workunit.client.0.smithi033.stdout:4/675: link d8/ca d8/d16/d45/d8f/ce8 0 2024-02-15T22:40:54.430 INFO:tasks.workunit.client.0.smithi033.stdout:2/678: truncate d1/d8/d2b/d2f/d24/d7a/fa5 676782 0 2024-02-15T22:40:54.433 INFO:tasks.workunit.client.0.smithi033.stdout:0/562: dwrite db/d19/f1e [0,4194304] 0 2024-02-15T22:40:54.433 INFO:tasks.workunit.client.0.smithi033.stdout:9/527: dwrite d4/f92 [0,4194304] 0 2024-02-15T22:40:54.433 INFO:tasks.workunit.client.0.smithi033.stdout:1/518: dwrite d1/de/d27/d39/d3a/f51 [4194304,4194304] 0 2024-02-15T22:40:54.434 INFO:tasks.workunit.client.0.smithi033.stdout:1/519: dread d1/de/d27/d28/f29 [0,4194304] 0 2024-02-15T22:40:54.435 INFO:tasks.workunit.client.0.smithi033.stdout:0/563: rmdir db/d60 39 2024-02-15T22:40:54.438 INFO:tasks.workunit.client.0.smithi033.stdout:2/679: write d1/d8/d2b/d2f/d24/d31/f58 [2045572,29668] 0 2024-02-15T22:40:54.440 INFO:tasks.workunit.client.0.smithi033.stdout:1/520: rename d1/d20/d42/d25/d4d/f87 to d1/d20/f9b 0 2024-02-15T22:40:54.441 INFO:tasks.workunit.client.0.smithi033.stdout:2/680: rmdir d1/d66 39 2024-02-15T22:40:54.441 INFO:tasks.workunit.client.0.smithi033.stdout:2/681: chown d1/d8/d2b/d2f/d13/da9/cd9 1 1 2024-02-15T22:40:54.455 INFO:tasks.workunit.client.0.smithi033.stdout:4/676: rmdir d8/d16/d51/d1c/d50 39 2024-02-15T22:40:54.455 INFO:tasks.workunit.client.0.smithi033.stdout:4/677: write d8/d16/d51/d1c/f6c [278311,12522] 0 2024-02-15T22:40:54.464 INFO:tasks.workunit.client.0.smithi033.stdout:9/528: dwrite d4/f43 [4194304,4194304] 0 2024-02-15T22:40:54.464 INFO:tasks.workunit.client.0.smithi033.stdout:9/529: fsync d4/fd 0 2024-02-15T22:40:54.464 INFO:tasks.workunit.client.0.smithi033.stdout:9/530: chown d4/d1d/d23/d24/d51/d5d 4881533 1 2024-02-15T22:40:54.464 INFO:tasks.workunit.client.0.smithi033.stdout:9/531: fsync d4/d1d/f2c 0 2024-02-15T22:40:54.478 INFO:tasks.workunit.client.0.smithi033.stdout:1/521: dwrite d1/de/d27/d28/d2d/f8c [0,4194304] 0 2024-02-15T22:40:54.478 INFO:tasks.workunit.client.0.smithi033.stdout:1/522: chown d1 1 1 2024-02-15T22:40:54.479 INFO:tasks.workunit.client.0.smithi033.stdout:0/564: dwrite db/d19/d32/f48 [8388608,4194304] 0 2024-02-15T22:40:54.484 INFO:tasks.workunit.client.0.smithi033.stdout:2/682: dwrite d1/d8/d2b/d2f/fd5 [0,4194304] 0 2024-02-15T22:40:54.484 INFO:tasks.workunit.client.0.smithi033.stdout:4/678: dwrite d8/d16/d51/d1c/d3c/d49/dac/fb0 [0,4194304] 0 2024-02-15T22:40:54.484 INFO:tasks.workunit.client.0.smithi033.stdout:4/679: read - d8/d16/d51/d1c/db9/d37/d31/d80/fe7 zero size 2024-02-15T22:40:54.487 INFO:tasks.workunit.client.0.smithi033.stdout:4/680: creat d8/d16/d51/d1c/db9/d37/dce/fe9 x:0 0 0 2024-02-15T22:40:54.487 INFO:tasks.workunit.client.0.smithi033.stdout:4/681: stat d8/d16/d45/l88 0 2024-02-15T22:40:54.490 INFO:tasks.workunit.client.0.smithi033.stdout:1/523: write d1/de/d27/d39/d3a/f51 [4468838,110376] 0 2024-02-15T22:40:54.499 INFO:tasks.workunit.client.0.smithi033.stdout:9/532: dwrite d4/d1d/d23/d24/d5a/f80 [0,4194304] 0 2024-02-15T22:40:54.502 INFO:tasks.workunit.client.0.smithi033.stdout:1/524: dread d1/de/f63 [0,4194304] 0 2024-02-15T22:40:54.505 INFO:tasks.workunit.client.0.smithi033.stdout:9/533: dread f2 [0,4194304] 0 2024-02-15T22:40:54.507 INFO:tasks.workunit.client.0.smithi033.stdout:9/534: mknod d4/d1d/d42/c9b 0 2024-02-15T22:40:54.507 INFO:tasks.workunit.client.0.smithi033.stdout:9/535: fdatasync d4/d1d/d23/d35/f63 0 2024-02-15T22:40:54.507 INFO:tasks.workunit.client.0.smithi033.stdout:9/536: write d4/fd [1406968,2312] 0 2024-02-15T22:40:54.507 INFO:tasks.workunit.client.0.smithi033.stdout:2/683: dwrite d1/d8/d2b/d2f/d3d/faf [0,4194304] 0 2024-02-15T22:40:54.507 INFO:tasks.workunit.client.0.smithi033.stdout:4/682: dwrite d8/d16/d51/d1c/d50/da1/dc1/dab/fae [0,4194304] 0 2024-02-15T22:40:54.507 INFO:tasks.workunit.client.0.smithi033.stdout:4/683: fdatasync d8/fe 0 2024-02-15T22:40:54.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/537: mkdir d4/d1d/d23/d32/d3e/d86/d3f/d94/d9c 0 2024-02-15T22:40:54.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/538: write d4/d1d/d23/d35/f87 [19750,126538] 0 2024-02-15T22:40:54.508 INFO:tasks.workunit.client.0.smithi033.stdout:2/684: stat d1/d8/d2b/c77 0 2024-02-15T22:40:54.512 INFO:tasks.workunit.client.0.smithi033.stdout:9/539: mknod d4/d1d/d23/d24/d51/d5d/d90/c9d 0 2024-02-15T22:40:54.512 INFO:tasks.workunit.client.0.smithi033.stdout:1/525: dread d1/de/f1f [4194304,4194304] 0 2024-02-15T22:40:54.513 INFO:tasks.workunit.client.0.smithi033.stdout:2/685: dread d1/f48 [0,4194304] 0 2024-02-15T22:40:54.514 INFO:tasks.workunit.client.0.smithi033.stdout:9/540: symlink d4/d1d/d23/d24/l9e 0 2024-02-15T22:40:54.515 INFO:tasks.workunit.client.0.smithi033.stdout:1/526: truncate d1/de/d27/d28/d2d/d36/f62 922095 0 2024-02-15T22:40:54.515 INFO:tasks.workunit.client.0.smithi033.stdout:1/527: fsync d1/de/d27/d28/d2d/f48 0 2024-02-15T22:40:54.517 INFO:tasks.workunit.client.0.smithi033.stdout:9/541: symlink d4/d1d/d23/d32/d3e/d86/d3f/l9f 0 2024-02-15T22:40:54.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/542: link d4/d1d/d23/f98 d4/d1d/d42/fa0 0 2024-02-15T22:40:54.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/543: getdents d4/d1d/d23/d32/d3e/d86/d3f/d94/d9c 0 2024-02-15T22:40:54.522 INFO:tasks.workunit.client.0.smithi033.stdout:9/544: getdents d4/d1d/d23/d24/d51 0 2024-02-15T22:40:54.522 INFO:tasks.workunit.client.0.smithi033.stdout:8/550: sync 2024-02-15T22:40:54.522 INFO:tasks.workunit.client.0.smithi033.stdout:7/583: sync 2024-02-15T22:40:54.522 INFO:tasks.workunit.client.0.smithi033.stdout:8/551: chown d1/de/d1a/d9d/f9e 651 1 2024-02-15T22:40:54.522 INFO:tasks.workunit.client.0.smithi033.stdout:8/552: write d1/de/d1a/d2a/f3b [5052748,94312] 0 2024-02-15T22:40:54.522 INFO:tasks.workunit.client.0.smithi033.stdout:8/553: creat d1/d68/d44/fb9 x:0 0 0 2024-02-15T22:40:54.523 INFO:tasks.workunit.client.0.smithi033.stdout:7/584: mkdir d5/dc/d5f/d8b/da0/dc6 0 2024-02-15T22:40:54.525 INFO:tasks.workunit.client.0.smithi033.stdout:1/528: dread d1/de/d27/d28/d2d/f76 [4194304,4194304] 0 2024-02-15T22:40:54.525 INFO:tasks.workunit.client.0.smithi033.stdout:1/529: readlink d1/d57/l6a 0 2024-02-15T22:40:54.525 INFO:tasks.workunit.client.0.smithi033.stdout:7/585: symlink d5/df/d40/d4a/lc7 0 2024-02-15T22:40:54.525 INFO:tasks.workunit.client.0.smithi033.stdout:7/586: fsync d5/dc/fc2 0 2024-02-15T22:40:54.526 INFO:tasks.workunit.client.0.smithi033.stdout:1/530: link d1/de/d27/l7f d1/de/d27/l9c 0 2024-02-15T22:40:54.526 INFO:tasks.workunit.client.0.smithi033.stdout:1/531: fdatasync d1/de/d27/d39/d3a/f78 0 2024-02-15T22:40:54.528 INFO:tasks.workunit.client.0.smithi033.stdout:1/532: rename d1/d57/l7e to d1/d20/d42/d2c/d30/l9d 0 2024-02-15T22:40:54.530 INFO:tasks.workunit.client.0.smithi033.stdout:1/533: mknod d1/de/d27/d28/d2d/c9e 0 2024-02-15T22:40:54.530 INFO:tasks.workunit.client.0.smithi033.stdout:1/534: read - d1/d57/f99 zero size 2024-02-15T22:40:54.530 INFO:tasks.workunit.client.0.smithi033.stdout:4/684: dwrite d8/d16/d51/d1c/d3c/d3f/fba [0,4194304] 0 2024-02-15T22:40:54.530 INFO:tasks.workunit.client.0.smithi033.stdout:2/686: dwrite d1/d16/d57/f93 [0,4194304] 0 2024-02-15T22:40:54.530 INFO:tasks.workunit.client.0.smithi033.stdout:2/687: write d1/d8/d2b/d2f/d13/fc7 [1170196,125239] 0 2024-02-15T22:40:54.530 INFO:tasks.workunit.client.0.smithi033.stdout:1/535: mkdir d1/de/d27/d28/d79/d9f 0 2024-02-15T22:40:54.533 INFO:tasks.workunit.client.0.smithi033.stdout:2/688: mknod d1/d8/d2b/d2f/d24/d31/cdb 0 2024-02-15T22:40:54.534 INFO:tasks.workunit.client.0.smithi033.stdout:9/545: write d4/d1d/d23/d24/d5a/f80 [108808,47795] 0 2024-02-15T22:40:54.535 INFO:tasks.workunit.client.0.smithi033.stdout:2/689: rename d1/d16/d3f/fbd to d1/d8/d2b/d2f/d3d/fdc 0 2024-02-15T22:40:54.536 INFO:tasks.workunit.client.0.smithi033.stdout:1/536: rmdir d1/d20/d42/d25/d67 39 2024-02-15T22:40:54.536 INFO:tasks.workunit.client.0.smithi033.stdout:1/537: chown d1/de/d27/l7f 251 1 2024-02-15T22:40:54.538 INFO:tasks.workunit.client.0.smithi033.stdout:9/546: creat d4/d1d/d23/d24/d51/d5d/d90/fa1 x:0 0 0 2024-02-15T22:40:54.539 INFO:tasks.workunit.client.0.smithi033.stdout:1/538: truncate d1/d20/d42/d25/f60 1149823 0 2024-02-15T22:40:54.540 INFO:tasks.workunit.client.0.smithi033.stdout:9/547: write d4/ff [562485,73096] 0 2024-02-15T22:40:54.542 INFO:tasks.workunit.client.0.smithi033.stdout:9/548: creat d4/d1d/d23/d24/d51/d5d/fa2 x:0 0 0 2024-02-15T22:40:54.543 INFO:tasks.workunit.client.0.smithi033.stdout:8/554: dread d1/d6/d14/f1b [0,4194304] 0 2024-02-15T22:40:54.543 INFO:tasks.workunit.client.0.smithi033.stdout:8/555: creat d1/d6/d14/d5d/d72/fba x:0 0 0 2024-02-15T22:40:54.545 INFO:tasks.workunit.client.0.smithi033.stdout:7/587: dwrite d5/d6/d10/fa5 [4194304,4194304] 0 2024-02-15T22:40:54.545 INFO:tasks.workunit.client.0.smithi033.stdout:4/685: dread d8/d16/d51/f44 [0,4194304] 0 2024-02-15T22:40:54.545 INFO:tasks.workunit.client.0.smithi033.stdout:7/588: chown d5/df/d40/d4a/c5a 432754 1 2024-02-15T22:40:54.549 INFO:tasks.workunit.client.0.smithi033.stdout:8/556: creat d1/d68/d1d/d4a/fbb x:0 0 0 2024-02-15T22:40:54.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/589: write d5/dc/d5f/d8b/da1/d98/f93 [398206,51871] 0 2024-02-15T22:40:54.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/590: write d5/df/d40/d89/f9a [1068015,121501] 0 2024-02-15T22:40:54.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/591: chown d5/df/d56 1 1 2024-02-15T22:40:54.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/592: fdatasync d5/d6/fba 0 2024-02-15T22:40:54.561 INFO:tasks.workunit.client.0.smithi033.stdout:7/593: rename d5/df/d56/c4f to d5/d6/cc8 0 2024-02-15T22:40:54.564 INFO:tasks.workunit.client.0.smithi033.stdout:2/690: dwrite d1/f2 [4194304,4194304] 0 2024-02-15T22:40:54.570 INFO:tasks.workunit.client.0.smithi033.stdout:7/594: mknod d5/dc/d5f/d8b/da1/d98/d7b/db1/cc9 0 2024-02-15T22:40:54.570 INFO:tasks.workunit.client.0.smithi033.stdout:2/691: creat d1/d8/d2b/d2f/d12/dae/fdd x:0 0 0 2024-02-15T22:40:54.571 INFO:tasks.workunit.client.0.smithi033.stdout:7/595: getdents d5/dc/d5f 0 2024-02-15T22:40:54.572 INFO:tasks.workunit.client.0.smithi033.stdout:7/596: rmdir d5/dc/d5f/d8b/da1/d26 39 2024-02-15T22:40:54.572 INFO:tasks.workunit.client.0.smithi033.stdout:7/597: write d5/df/d40/d73/faf [522613,45898] 0 2024-02-15T22:40:54.572 INFO:tasks.workunit.client.0.smithi033.stdout:7/598: fsync d5/df/d56/d60/d59/d9c/fa9 0 2024-02-15T22:40:54.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/599: truncate d5/dc/d5f/d8b/da1/f83 2076823 0 2024-02-15T22:40:54.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/600: creat d5/df/d56/d84/fca x:0 0 0 2024-02-15T22:40:54.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/601: truncate d5/df/f94 645 0 2024-02-15T22:40:54.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/602: truncate d5/dc/d5f/d8b/da1/d26/d3f/f65 2239425 0 2024-02-15T22:40:54.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/603: chown d5/df/d40/d89 40748 1 2024-02-15T22:40:54.574 INFO:tasks.workunit.client.0.smithi033.stdout:9/549: dwrite d4/f92 [0,4194304] 0 2024-02-15T22:40:54.574 INFO:tasks.workunit.client.0.smithi033.stdout:9/550: write d4/d1d/d23/d24/f25 [5196541,118298] 0 2024-02-15T22:40:54.574 INFO:tasks.workunit.client.0.smithi033.stdout:9/551: read - d4/d1d/d23/d24/d5e/f69 zero size 2024-02-15T22:40:54.575 INFO:tasks.workunit.client.0.smithi033.stdout:7/604: creat d5/dc/d5f/d8b/da1/d98/fcb x:0 0 0 2024-02-15T22:40:54.575 INFO:tasks.workunit.client.0.smithi033.stdout:7/605: fsync d5/dc/d5f/d8b/da1/d26/d3f/f65 0 2024-02-15T22:40:54.577 INFO:tasks.workunit.client.0.smithi033.stdout:4/686: dwrite f4 [0,4194304] 0 2024-02-15T22:40:54.579 INFO:tasks.workunit.client.0.smithi033.stdout:7/606: creat d5/df/d40/d73/fcc x:0 0 0 2024-02-15T22:40:54.582 INFO:tasks.workunit.client.0.smithi033.stdout:7/607: rename d5/d6/d10/db2 to d5/dc/d5f/d8b/da0/dc6/dcd 0 2024-02-15T22:40:54.583 INFO:tasks.workunit.client.0.smithi033.stdout:8/557: rmdir d1 39 2024-02-15T22:40:54.585 INFO:tasks.workunit.client.0.smithi033.stdout:8/558: truncate d1/de/d1a/d2a/f3c 1690231 0 2024-02-15T22:40:54.585 INFO:tasks.workunit.client.0.smithi033.stdout:8/559: dread - d1/d36/fac zero size 2024-02-15T22:40:54.587 INFO:tasks.workunit.client.0.smithi033.stdout:2/692: write d1/d8/d2b/d2f/d24/f39 [3151069,65448] 0 2024-02-15T22:40:54.589 INFO:tasks.workunit.client.0.smithi033.stdout:2/693: creat d1/d8/d2b/d2f/d24/d5d/fde x:0 0 0 2024-02-15T22:40:54.589 INFO:tasks.workunit.client.0.smithi033.stdout:2/694: truncate d1/d8/d2b/d2f/d38/db0/f82 4236060 0 2024-02-15T22:40:54.589 INFO:tasks.workunit.client.0.smithi033.stdout:2/695: read d1/d8/d2b/d2f/d24/d31/f3e [3272039,76921] 0 2024-02-15T22:40:54.590 INFO:tasks.workunit.client.0.smithi033.stdout:8/560: write d1/de/d5c/d90/f29 [7133195,91463] 0 2024-02-15T22:40:54.591 INFO:tasks.workunit.client.0.smithi033.stdout:2/696: creat d1/d66/fdf x:0 0 0 2024-02-15T22:40:54.591 INFO:tasks.workunit.client.0.smithi033.stdout:2/697: chown d1/d8/d2b/d2f/d38/db0/d99 982046 1 2024-02-15T22:40:54.592 INFO:tasks.workunit.client.0.smithi033.stdout:9/552: dread d4/d1d/d23/d24/f25 [0,4194304] 0 2024-02-15T22:40:54.592 INFO:tasks.workunit.client.0.smithi033.stdout:9/553: write d4/d1d/d23/d32/d3e/d86/d3f/d94/f97 [466117,113347] 0 2024-02-15T22:40:54.592 INFO:tasks.workunit.client.0.smithi033.stdout:9/554: dread - d4/d1d/d23/d24/d5e/f69 zero size 2024-02-15T22:40:54.592 INFO:tasks.workunit.client.0.smithi033.stdout:9/555: creat d4/d1d/d23/d24/fa3 x:0 0 0 2024-02-15T22:40:54.593 INFO:tasks.workunit.client.0.smithi033.stdout:8/561: creat d1/de/d1a/d27/fbc x:0 0 0 2024-02-15T22:40:54.594 INFO:tasks.workunit.client.0.smithi033.stdout:8/562: readlink d1/d36/l87 0 2024-02-15T22:40:54.594 INFO:tasks.workunit.client.0.smithi033.stdout:8/563: truncate d1/d6/d14/fa4 996820 0 2024-02-15T22:40:54.596 INFO:tasks.workunit.client.0.smithi033.stdout:8/564: dread d1/de/d5c/d90/d75/d83/fa9 [0,4194304] 0 2024-02-15T22:40:54.597 INFO:tasks.workunit.client.0.smithi033.stdout:2/698: unlink d1/d8/d2b/d2f/d12/d52/fb4 0 2024-02-15T22:40:54.597 INFO:tasks.workunit.client.0.smithi033.stdout:2/699: chown d1/d8/d2b/d2f/cf 110482 1 2024-02-15T22:40:54.598 INFO:tasks.workunit.client.0.smithi033.stdout:4/687: dwrite d8/fa6 [0,4194304] 0 2024-02-15T22:40:54.599 INFO:tasks.workunit.client.0.smithi033.stdout:4/688: chown d8/d16/d51/d1c/db9/d37/d23 0 1 2024-02-15T22:40:54.599 INFO:tasks.workunit.client.0.smithi033.stdout:4/689: dread - d8/d16/d51/d1c/d3c/d49/fa4 zero size 2024-02-15T22:40:54.600 INFO:tasks.workunit.client.0.smithi033.stdout:9/556: symlink d4/d1d/d23/d32/d71/la4 0 2024-02-15T22:40:54.602 INFO:tasks.workunit.client.0.smithi033.stdout:8/565: mkdir d1/d68/d1d/d4a/d4c/dbd 0 2024-02-15T22:40:54.602 INFO:tasks.workunit.client.0.smithi033.stdout:8/566: truncate d1/d68/d44/d49/f7b 4496685 0 2024-02-15T22:40:54.602 INFO:tasks.workunit.client.0.smithi033.stdout:7/608: dread d5/f31 [0,4194304] 0 2024-02-15T22:40:54.602 INFO:tasks.workunit.client.0.smithi033.stdout:7/609: dread - d5/df/f5e zero size 2024-02-15T22:40:54.602 INFO:tasks.workunit.client.0.smithi033.stdout:7/610: truncate d5/df/d40/d73/fcc 719640 0 2024-02-15T22:40:54.606 INFO:tasks.workunit.client.0.smithi033.stdout:4/690: creat d8/d16/d45/fea x:0 0 0 2024-02-15T22:40:54.607 INFO:tasks.workunit.client.0.smithi033.stdout:9/557: mknod d4/d1d/d23/d32/ca5 0 2024-02-15T22:40:54.611 INFO:tasks.workunit.client.0.smithi033.stdout:8/567: rename d1/de/d1a/caf to d1/de/d5c/cbe 0 2024-02-15T22:40:54.612 INFO:tasks.workunit.client.0.smithi033.stdout:7/611: symlink d5/df/d40/lce 0 2024-02-15T22:40:54.612 INFO:tasks.workunit.client.0.smithi033.stdout:7/612: readlink d5/d6/d10/l23 0 2024-02-15T22:40:54.613 INFO:tasks.workunit.client.0.smithi033.stdout:2/700: getdents d1/d8/d2b/d2f/d13/d6f 0 2024-02-15T22:40:54.613 INFO:tasks.workunit.client.0.smithi033.stdout:2/701: truncate d1/d8/d2b/d2f/d3d/faa 1711063 0 2024-02-15T22:40:54.614 INFO:tasks.workunit.client.0.smithi033.stdout:4/691: symlink d8/d16/d51/d1c/db9/d37/leb 0 2024-02-15T22:40:54.615 INFO:tasks.workunit.client.0.smithi033.stdout:1/539: dwrite d1/de/d27/d28/d2d/d36/f62 [0,4194304] 0 2024-02-15T22:40:54.617 INFO:tasks.workunit.client.0.smithi033.stdout:8/568: rename d1/d68/d1d/d4a/d76 to d1/de/d5c/d90/d75/dbf 0 2024-02-15T22:40:54.619 INFO:tasks.workunit.client.0.smithi033.stdout:4/692: creat d8/d16/d51/d1c/db9/d37/d31/da5/da9/fec x:0 0 0 2024-02-15T22:40:54.624 INFO:tasks.workunit.client.0.smithi033.stdout:1/540: rmdir d1/de/d27/d39 39 2024-02-15T22:40:54.624 INFO:tasks.workunit.client.0.smithi033.stdout:1/541: chown d1/d20/d42/d2c/d4e/l52 667 1 2024-02-15T22:40:54.630 INFO:tasks.workunit.client.0.smithi033.stdout:8/569: dwrite d1/de/f56 [0,4194304] 0 2024-02-15T22:40:54.640 INFO:tasks.workunit.client.0.smithi033.stdout:7/613: rename d5/df/d40/d73/faf to d5/df/d56/d60/d59/d9c/da6/fcf 0 2024-02-15T22:40:54.641 INFO:tasks.workunit.client.0.smithi033.stdout:4/693: truncate d8/d16/d51/d1c/db9/d37/d31/da5/da9/fe2 561160 0 2024-02-15T22:40:54.641 INFO:tasks.workunit.client.0.smithi033.stdout:4/694: creat d8/d16/d51/fed x:0 0 0 2024-02-15T22:40:54.643 INFO:tasks.workunit.client.0.smithi033.stdout:1/542: mknod d1/d57/ca0 0 2024-02-15T22:40:54.647 INFO:tasks.workunit.client.0.smithi033.stdout:8/570: dwrite d1/de/d1a/f66 [0,4194304] 0 2024-02-15T22:40:54.647 INFO:tasks.workunit.client.0.smithi033.stdout:8/571: chown d1/de/d1a/f6e 3630 1 2024-02-15T22:40:54.647 INFO:tasks.workunit.client.0.smithi033.stdout:2/702: rename d1/d8/d2b/d2f/d13/f49 to d1/d8/d2b/d2f/d24/d31/d79/fe0 0 2024-02-15T22:40:54.650 INFO:tasks.workunit.client.0.smithi033.stdout:4/695: unlink d8/d16/d51/d1c/d96/fd2 0 2024-02-15T22:40:54.652 INFO:tasks.workunit.client.0.smithi033.stdout:7/614: dread d5/dc/d5f/d8b/da1/d26/f3c [0,4194304] 0 2024-02-15T22:40:54.652 INFO:tasks.workunit.client.0.smithi033.stdout:7/615: truncate d5/dc/d5f/d8b/da1/d26/f3c 5049741 0 2024-02-15T22:40:54.652 INFO:tasks.workunit.client.0.smithi033.stdout:2/703: dread d1/d8/d2b/d2f/d13/fc7 [0,4194304] 0 2024-02-15T22:40:54.652 INFO:tasks.workunit.client.0.smithi033.stdout:2/704: write d1/d8/d2b/d2f/d38/f51 [319206,118765] 0 2024-02-15T22:40:54.653 INFO:tasks.workunit.client.0.smithi033.stdout:8/572: creat d1/d6/d14/d5d/fc0 x:0 0 0 2024-02-15T22:40:54.654 INFO:tasks.workunit.client.0.smithi033.stdout:4/696: getdents d8/d16/d51/d1c/d94 0 2024-02-15T22:40:54.656 INFO:tasks.workunit.client.0.smithi033.stdout:7/616: creat d5/df/d56/d99/fd0 x:0 0 0 2024-02-15T22:40:54.656 INFO:tasks.workunit.client.0.smithi033.stdout:1/543: dread d1/f7 [0,4194304] 0 2024-02-15T22:40:54.658 INFO:tasks.workunit.client.0.smithi033.stdout:8/573: truncate d1/d68/d1d/f35 1510925 0 2024-02-15T22:40:54.658 INFO:tasks.workunit.client.0.smithi033.stdout:8/574: chown d1/de/d1a/d2a/f6f 14996 1 2024-02-15T22:40:54.660 INFO:tasks.workunit.client.0.smithi033.stdout:1/544: dread d1/d57/f5f [0,4194304] 0 2024-02-15T22:40:54.664 INFO:tasks.workunit.client.0.smithi033.stdout:7/617: write d5/d6/d10/f34 [974571,30964] 0 2024-02-15T22:40:54.664 INFO:tasks.workunit.client.0.smithi033.stdout:8/575: rename d1/de/d5c/d90 to d1/d74/dc1 0 2024-02-15T22:40:54.666 INFO:tasks.workunit.client.0.smithi033.stdout:2/705: dread d1/d8/d2b/d2f/d3d/fdc [0,4194304] 0 2024-02-15T22:40:54.671 INFO:tasks.workunit.client.0.smithi033.stdout:8/576: dread d1/de/f37 [0,4194304] 0 2024-02-15T22:40:54.675 INFO:tasks.workunit.client.0.smithi033.stdout:1/545: rmdir d1/de 39 2024-02-15T22:40:54.677 INFO:tasks.workunit.client.0.smithi033.stdout:7/618: symlink d5/df/ld1 0 2024-02-15T22:40:54.677 INFO:tasks.workunit.client.0.smithi033.stdout:7/619: readlink d5/df/d56/d99/lac 0 2024-02-15T22:40:54.678 INFO:tasks.workunit.client.0.smithi033.stdout:8/577: symlink d1/d68/d1d/d4a/d4c/dbd/lc2 0 2024-02-15T22:40:54.680 INFO:tasks.workunit.client.0.smithi033.stdout:8/578: mkdir d1/d68/d44/dc3 0 2024-02-15T22:40:54.681 INFO:tasks.workunit.client.0.smithi033.stdout:7/620: dread d5/d6/f54 [0,4194304] 0 2024-02-15T22:40:54.681 INFO:tasks.workunit.client.0.smithi033.stdout:8/579: creat d1/de/d1a/d27/d70/fc4 x:0 0 0 2024-02-15T22:40:54.681 INFO:tasks.workunit.client.0.smithi033.stdout:8/580: chown d1/d68/d44/c8c 12803 1 2024-02-15T22:40:54.682 INFO:tasks.workunit.client.0.smithi033.stdout:7/621: mkdir d5/df/d40/d73/dd2 0 2024-02-15T22:40:54.682 INFO:tasks.workunit.client.0.smithi033.stdout:7/622: fsync d5/f31 0 2024-02-15T22:40:54.683 INFO:tasks.workunit.client.0.smithi033.stdout:8/581: creat d1/d68/d57/fc5 x:0 0 0 2024-02-15T22:40:54.684 INFO:tasks.workunit.client.0.smithi033.stdout:8/582: creat d1/d74/fc6 x:0 0 0 2024-02-15T22:40:54.685 INFO:tasks.workunit.client.0.smithi033.stdout:8/583: mknod d1/d68/d44/cc7 0 2024-02-15T22:40:54.686 INFO:tasks.workunit.client.0.smithi033.stdout:8/584: link d1/d36/fac d1/d68/d1d/d4a/fc8 0 2024-02-15T22:40:54.688 INFO:tasks.workunit.client.0.smithi033.stdout:8/585: creat d1/de/d1a/d27/d60/fc9 x:0 0 0 2024-02-15T22:40:54.688 INFO:tasks.workunit.client.0.smithi033.stdout:8/586: write d1/de/d1a/d27/fbc [709007,72862] 0 2024-02-15T22:40:54.688 INFO:tasks.workunit.client.0.smithi033.stdout:8/587: chown d1/d74/dc1/d75/d83/l85 232 1 2024-02-15T22:40:54.690 INFO:tasks.workunit.client.0.smithi033.stdout:2/706: dwrite d1/d8/d2b/d2f/d3d/faf [4194304,4194304] 0 2024-02-15T22:40:54.690 INFO:tasks.workunit.client.0.smithi033.stdout:2/707: chown d1/d8/d2b/d2f/d12/f42 2 1 2024-02-15T22:40:54.693 INFO:tasks.workunit.client.0.smithi033.stdout:2/708: rename d1/d8/d2b/d2f/d38/d9a/lab to d1/d8/d2b/le1 0 2024-02-15T22:40:54.697 INFO:tasks.workunit.client.0.smithi033.stdout:8/588: dread d1/de/d5c/f7e [0,4194304] 0 2024-02-15T22:40:54.697 INFO:tasks.workunit.client.0.smithi033.stdout:8/589: dread - d1/fa8 zero size 2024-02-15T22:40:54.704 INFO:tasks.workunit.client.0.smithi033.stdout:6/489: sync 2024-02-15T22:40:54.704 INFO:tasks.workunit.client.0.smithi033.stdout:6/490: fsync d12/d3c/d95/d3f/d4b/d6f/f9c 0 2024-02-15T22:40:54.704 INFO:tasks.workunit.client.0.smithi033.stdout:6/491: stat d12/d3c/l7b 0 2024-02-15T22:40:54.704 INFO:tasks.workunit.client.0.smithi033.stdout:6/492: readlink d12/d2c/l3a 0 2024-02-15T22:40:54.705 INFO:tasks.workunit.client.0.smithi033.stdout:1/546: dwrite d1/de/d27/d28/d2d/f48 [0,4194304] 0 2024-02-15T22:40:54.705 INFO:tasks.workunit.client.0.smithi033.stdout:6/493: creat d12/d2c/d30/d1d/fa6 x:0 0 0 2024-02-15T22:40:54.705 INFO:tasks.workunit.client.0.smithi033.stdout:6/494: stat d12/d2c/d30/d1d/d35/c38 0 2024-02-15T22:40:54.708 INFO:tasks.workunit.client.0.smithi033.stdout:1/547: unlink d1/d20/d42/d25/d67/c90 0 2024-02-15T22:40:54.708 INFO:tasks.workunit.client.0.smithi033.stdout:1/548: read d1/de/d27/d28/d37/f45 [3654050,48840] 0 2024-02-15T22:40:54.708 INFO:tasks.workunit.client.0.smithi033.stdout:7/623: dwrite d5/d6/d10/f6d [4194304,4194304] 0 2024-02-15T22:40:54.709 INFO:tasks.workunit.client.0.smithi033.stdout:7/624: chown d5/dc/l71 0 1 2024-02-15T22:40:54.711 INFO:tasks.workunit.client.0.smithi033.stdout:1/549: write d1/de/f63 [2197183,75018] 0 2024-02-15T22:40:54.712 INFO:tasks.workunit.client.0.smithi033.stdout:1/550: fdatasync d1/d20/f9b 0 2024-02-15T22:40:54.715 INFO:tasks.workunit.client.0.smithi033.stdout:7/625: dread d5/f30 [0,4194304] 0 2024-02-15T22:40:54.717 INFO:tasks.workunit.client.0.smithi033.stdout:7/626: mknod d5/dc/d5f/d8b/da1/d98/cd3 0 2024-02-15T22:40:54.719 INFO:tasks.workunit.client.0.smithi033.stdout:7/627: rename d5/dc/d5f/ca4 to d5/df/d40/d4a/cd4 0 2024-02-15T22:40:54.719 INFO:tasks.workunit.client.0.smithi033.stdout:7/628: fsync d5/dc/d5f/d8b/da1/d26/f2a 0 2024-02-15T22:40:54.720 INFO:tasks.workunit.client.0.smithi033.stdout:7/629: creat d5/dc/d5f/d8b/da1/d98/d7b/fd5 x:0 0 0 2024-02-15T22:40:54.720 INFO:tasks.workunit.client.0.smithi033.stdout:7/630: rename d5/dc to d5/dc/d5f/d8b/da1/dd6 22 2024-02-15T22:40:54.721 INFO:tasks.workunit.client.0.smithi033.stdout:7/631: getdents d5/df/d56/d60 0 2024-02-15T22:40:54.722 INFO:tasks.workunit.client.0.smithi033.stdout:7/632: mknod d5/df/d56/d99/cd7 0 2024-02-15T22:40:54.722 INFO:tasks.workunit.client.0.smithi033.stdout:7/633: fdatasync d5/df/fad 0 2024-02-15T22:40:54.724 INFO:tasks.workunit.client.0.smithi033.stdout:1/551: dread d1/de/d27/d28/d2d/f3d [0,4194304] 0 2024-02-15T22:40:54.724 INFO:tasks.workunit.client.0.smithi033.stdout:1/552: dread - d1/de/d27/d39/d3a/f85 zero size 2024-02-15T22:40:54.727 INFO:tasks.workunit.client.0.smithi033.stdout:1/553: dread d1/d20/d42/f49 [0,4194304] 0 2024-02-15T22:40:54.727 INFO:tasks.workunit.client.0.smithi033.stdout:1/554: chown d1/d20/d8a/d8f 2587 1 2024-02-15T22:40:54.728 INFO:tasks.workunit.client.0.smithi033.stdout:7/634: dread d5/dc/d5f/d8b/da1/f83 [0,4194304] 0 2024-02-15T22:40:54.732 INFO:tasks.workunit.client.0.smithi033.stdout:2/709: dwrite d1/d16/d5a/d67/fd8 [0,4194304] 0 2024-02-15T22:40:54.732 INFO:tasks.workunit.client.0.smithi033.stdout:8/590: dwrite d1/d74/dc1/f29 [8388608,4194304] 0 2024-02-15T22:40:54.732 INFO:tasks.workunit.client.0.smithi033.stdout:8/591: truncate d1/d68/d1d/d4a/fc8 907317 0 2024-02-15T22:40:54.732 INFO:tasks.workunit.client.0.smithi033.stdout:8/592: write d1/d68/d1d/d4a/fbb [264204,6479] 0 2024-02-15T22:40:54.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/495: dwrite d12/d2c/d30/d19/f26 [0,4194304] 0 2024-02-15T22:40:54.738 INFO:tasks.workunit.client.0.smithi033.stdout:2/710: creat d1/d8/d2b/d2f/d13/d59/d76/fe2 x:0 0 0 2024-02-15T22:40:54.738 INFO:tasks.workunit.client.0.smithi033.stdout:2/711: read d1/d8/d2b/d2f/d24/d31/f58 [1732450,5548] 0 2024-02-15T22:40:54.739 INFO:tasks.workunit.client.0.smithi033.stdout:8/593: creat d1/d74/dc1/d75/dbf/d79/fca x:0 0 0 2024-02-15T22:40:54.740 INFO:tasks.workunit.client.0.smithi033.stdout:8/594: rename d1/d36 to d1/d36/dcb 22 2024-02-15T22:40:54.745 INFO:tasks.workunit.client.0.smithi033.stdout:2/712: mkdir d1/d8/d2b/d2f/d24/d31/d79/de3 0 2024-02-15T22:40:54.745 INFO:tasks.workunit.client.0.smithi033.stdout:2/713: dread - d1/d8/d34/fc6 zero size 2024-02-15T22:40:54.745 INFO:tasks.workunit.client.0.smithi033.stdout:2/714: fdatasync d1/f2 0 2024-02-15T22:40:54.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/595: creat d1/dae/fcc x:0 0 0 2024-02-15T22:40:54.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/596: chown d1/d74/dc1/d75/dbf/l8a 22019 1 2024-02-15T22:40:54.748 INFO:tasks.workunit.client.0.smithi033.stdout:8/597: creat d1/de/d1a/d2a/fcd x:0 0 0 2024-02-15T22:40:54.749 INFO:tasks.workunit.client.0.smithi033.stdout:8/598: rmdir d1/d6/d14/d8f 39 2024-02-15T22:40:54.755 INFO:tasks.workunit.client.0.smithi033.stdout:8/599: write d1/f33 [2034617,97188] 0 2024-02-15T22:40:54.755 INFO:tasks.workunit.client.0.smithi033.stdout:1/555: dwrite d1/de/d27/d28/d2d/f76 [8388608,4194304] 0 2024-02-15T22:40:54.755 INFO:tasks.workunit.client.0.smithi033.stdout:8/600: mknod d1/de/d1a/cce 0 2024-02-15T22:40:54.756 INFO:tasks.workunit.client.0.smithi033.stdout:7/635: dwrite d5/d6/d10/f6d [0,4194304] 0 2024-02-15T22:40:54.756 INFO:tasks.workunit.client.0.smithi033.stdout:7/636: chown d5/df/d56 7 1 2024-02-15T22:40:54.756 INFO:tasks.workunit.client.0.smithi033.stdout:7/637: creat d5/df/d56/d84/fd8 x:0 0 0 2024-02-15T22:40:54.756 INFO:tasks.workunit.client.0.smithi033.stdout:8/601: mkdir d1/dae/dcf 0 2024-02-15T22:40:54.759 INFO:tasks.workunit.client.0.smithi033.stdout:7/638: rename d5/df/d56/f6f to d5/dc/d5f/d8b/da1/d26/fd9 0 2024-02-15T22:40:54.761 INFO:tasks.workunit.client.0.smithi033.stdout:8/602: creat d1/d68/d1d/fd0 x:0 0 0 2024-02-15T22:40:54.763 INFO:tasks.workunit.client.0.smithi033.stdout:2/715: dwrite d1/d8/d2b/d2f/fd5 [0,4194304] 0 2024-02-15T22:40:54.765 INFO:tasks.workunit.client.0.smithi033.stdout:2/716: dread d1/d8/d2b/d2f/d13/fc7 [0,4194304] 0 2024-02-15T22:40:54.765 INFO:tasks.workunit.client.0.smithi033.stdout:2/717: fdatasync d1/d16/d5a/f91 0 2024-02-15T22:40:54.765 INFO:tasks.workunit.client.0.smithi033.stdout:2/718: fdatasync d1/d8/d2b/d2f/d12/f42 0 2024-02-15T22:40:54.769 INFO:tasks.workunit.client.0.smithi033.stdout:1/556: dread d1/de/d27/d28/d2d/d36/f62 [0,4194304] 0 2024-02-15T22:40:54.773 INFO:tasks.workunit.client.0.smithi033.stdout:1/557: read d1/f64 [2585,27215] 0 2024-02-15T22:40:54.774 INFO:tasks.workunit.client.0.smithi033.stdout:1/558: creat d1/d20/fa1 x:0 0 0 2024-02-15T22:40:54.775 INFO:tasks.workunit.client.0.smithi033.stdout:2/719: dread d1/d8/d2b/d2f/d24/d31/f3e [0,4194304] 0 2024-02-15T22:40:54.777 INFO:tasks.workunit.client.0.smithi033.stdout:1/559: unlink d1/de/d27/d28/d2d/d36/l58 0 2024-02-15T22:40:54.778 INFO:tasks.workunit.client.0.smithi033.stdout:2/720: mkdir d1/d8/d2b/d2f/d24/d2a/d88/de4 0 2024-02-15T22:40:54.781 INFO:tasks.workunit.client.0.smithi033.stdout:7/639: dwrite d5/dc/d5f/d8b/da1/d98/d7b/f7c [4194304,4194304] 0 2024-02-15T22:40:54.783 INFO:tasks.workunit.client.0.smithi033.stdout:1/560: dread d1/d20/d42/f33 [0,4194304] 0 2024-02-15T22:40:54.783 INFO:tasks.workunit.client.0.smithi033.stdout:1/561: fsync d1/d20/d42/d2c/d30/f68 0 2024-02-15T22:40:54.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/640: mknod d5/df/d40/d89/cda 0 2024-02-15T22:40:54.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/641: write d5/df/d56/d60/d59/d9c/f6a [1946152,39364] 0 2024-02-15T22:40:54.787 INFO:tasks.workunit.client.0.smithi033.stdout:7/642: rmdir d5/df/d56/dc4 0 2024-02-15T22:40:54.790 INFO:tasks.workunit.client.0.smithi033.stdout:7/643: dread d5/df/d56/d60/f6b [0,4194304] 0 2024-02-15T22:40:54.791 INFO:tasks.workunit.client.0.smithi033.stdout:8/603: dwrite d1/d6/d14/d5d/d72/f80 [0,4194304] 0 2024-02-15T22:40:54.791 INFO:tasks.workunit.client.0.smithi033.stdout:8/604: dread - d1/fa8 zero size 2024-02-15T22:40:54.791 INFO:tasks.workunit.client.0.smithi033.stdout:8/605: read - d1/fb8 zero size 2024-02-15T22:40:54.791 INFO:tasks.workunit.client.0.smithi033.stdout:8/606: chown d1/d36 11936966 1 2024-02-15T22:40:54.793 INFO:tasks.workunit.client.0.smithi033.stdout:7/644: rename d5/dc/d5f/d8b/da1/f83 to d5/df/d40/fdb 0 2024-02-15T22:40:54.796 INFO:tasks.workunit.client.0.smithi033.stdout:8/607: mkdir d1/d74/dc1/d75/dbf/d79/d94/dd1 0 2024-02-15T22:40:54.805 INFO:tasks.workunit.client.0.smithi033.stdout:8/608: creat d1/de/d5c/fd2 x:0 0 0 2024-02-15T22:40:54.806 INFO:tasks.workunit.client.0.smithi033.stdout:1/562: dwrite d1/d57/f5f [0,4194304] 0 2024-02-15T22:40:54.806 INFO:tasks.workunit.client.0.smithi033.stdout:1/563: write d1/de/f16 [3693541,50631] 0 2024-02-15T22:40:54.806 INFO:tasks.workunit.client.0.smithi033.stdout:1/564: chown d1/d20/d42/d25/c4f 811 1 2024-02-15T22:40:54.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/645: rmdir d5/dc/d5f/d8b/da1/d98 39 2024-02-15T22:40:54.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/646: stat d5/df/f44 0 2024-02-15T22:40:54.809 INFO:tasks.workunit.client.0.smithi033.stdout:8/609: mkdir d1/d68/d44/dd3 0 2024-02-15T22:40:54.812 INFO:tasks.workunit.client.0.smithi033.stdout:1/565: creat d1/d20/d8a/d8f/fa2 x:0 0 0 2024-02-15T22:40:54.813 INFO:tasks.workunit.client.0.smithi033.stdout:7/647: unlink d5/d6/la2 0 2024-02-15T22:40:54.813 INFO:tasks.workunit.client.0.smithi033.stdout:7/648: stat d5/df/d56/f6c 0 2024-02-15T22:40:54.814 INFO:tasks.workunit.client.0.smithi033.stdout:7/649: chown d5/d6/d10/c1c 53214400 1 2024-02-15T22:40:54.814 INFO:tasks.workunit.client.0.smithi033.stdout:8/610: stat d1/de/d1a/d27/d55/l7d 0 2024-02-15T22:40:54.819 INFO:tasks.workunit.client.0.smithi033.stdout:1/566: rename d1/d20/d42/d25/d4d to d1/de/d27/d39/d3a/da3 0 2024-02-15T22:40:54.821 INFO:tasks.workunit.client.0.smithi033.stdout:5/582: sync 2024-02-15T22:40:54.821 INFO:tasks.workunit.client.0.smithi033.stdout:7/650: dread d5/f31 [0,4194304] 0 2024-02-15T22:40:54.823 INFO:tasks.workunit.client.0.smithi033.stdout:5/583: rename d6/d14/d31/d50/d6a/fad to d6/d14/d31/d48/da2/fb7 0 2024-02-15T22:40:54.823 INFO:tasks.workunit.client.0.smithi033.stdout:5/584: write d6/d14/d31/d48/d49/d53/d57/f8c [534289,5651] 0 2024-02-15T22:40:54.825 INFO:tasks.workunit.client.0.smithi033.stdout:7/651: symlink d5/df/d56/d84/ldc 0 2024-02-15T22:40:54.826 INFO:tasks.workunit.client.0.smithi033.stdout:1/567: dread d1/de/f38 [0,4194304] 0 2024-02-15T22:40:54.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/585: creat d6/d14/d31/d48/d49/d53/fb8 x:0 0 0 2024-02-15T22:40:54.828 INFO:tasks.workunit.client.0.smithi033.stdout:1/568: mkdir d1/d20/d8a/d8f/da4 0 2024-02-15T22:40:54.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/586: dread d6/d14/d31/d48/d56/f5b [0,4194304] 0 2024-02-15T22:40:54.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/587: fdatasync d6/db0/f94 0 2024-02-15T22:40:54.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/588: write d6/d14/d31/d38/f82 [3731838,107699] 0 2024-02-15T22:40:54.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/589: readlink d6/l18 0 2024-02-15T22:40:54.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/590: chown d6/d14/f6b 5 1 2024-02-15T22:40:54.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/591: readlink d6/d14/d31/d48/d49/l6f 0 2024-02-15T22:40:54.829 INFO:tasks.workunit.client.0.smithi033.stdout:1/569: creat d1/de/fa5 x:0 0 0 2024-02-15T22:40:54.829 INFO:tasks.workunit.client.0.smithi033.stdout:1/570: stat d1/d20/d42/d2c/d4e/c82 0 2024-02-15T22:40:54.830 INFO:tasks.workunit.client.0.smithi033.stdout:5/592: mkdir d6/d14/d31/d64/d7a/db9 0 2024-02-15T22:40:54.830 INFO:tasks.workunit.client.0.smithi033.stdout:5/593: write d6/d14/d31/d38/f82 [145475,123098] 0 2024-02-15T22:40:54.830 INFO:tasks.workunit.client.0.smithi033.stdout:5/594: read d6/d14/d31/d50/d5c/f9e [406773,4347] 0 2024-02-15T22:40:54.830 INFO:tasks.workunit.client.0.smithi033.stdout:5/595: write d6/d14/d31/d50/fb6 [747086,120262] 0 2024-02-15T22:40:54.830 INFO:tasks.workunit.client.0.smithi033.stdout:5/596: fsync d6/d14/f19 0 2024-02-15T22:40:54.830 INFO:tasks.workunit.client.0.smithi033.stdout:1/571: rename d1/de/d27/d28/d37/l5a to d1/de/d27/d39/d3a/da3/la6 0 2024-02-15T22:40:54.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/572: mknod d1/d20/ca7 0 2024-02-15T22:40:54.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/573: truncate d1/de/d27/d28/f83 1207908 0 2024-02-15T22:40:54.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/574: truncate d1/de/d27/d28/d2d/f3d 4606656 0 2024-02-15T22:40:54.834 INFO:tasks.workunit.client.0.smithi033.stdout:1/575: getdents d1/d20/d42/d2c 0 2024-02-15T22:40:54.837 INFO:tasks.workunit.client.0.smithi033.stdout:7/652: dread d5/d6/d10/f6d [4194304,4194304] 0 2024-02-15T22:40:54.838 INFO:tasks.workunit.client.0.smithi033.stdout:7/653: rename d5/dc/d5f/d8b/da1/d98/cd3 to d5/dc/d5f/daa/cdd 0 2024-02-15T22:40:54.841 INFO:tasks.workunit.client.0.smithi033.stdout:8/611: dwrite d1/de/d5c/f6d [0,4194304] 0 2024-02-15T22:40:54.843 INFO:tasks.workunit.client.0.smithi033.stdout:8/612: symlink d1/d74/dc1/ld4 0 2024-02-15T22:40:54.843 INFO:tasks.workunit.client.0.smithi033.stdout:8/613: truncate d1/dae/fcc 927087 0 2024-02-15T22:40:54.844 INFO:tasks.workunit.client.0.smithi033.stdout:8/614: dread d1/d68/d1d/d4a/fbb [0,4194304] 0 2024-02-15T22:40:54.846 INFO:tasks.workunit.client.0.smithi033.stdout:8/615: link d1/de/d1a/c34 d1/d6/d14/cd5 0 2024-02-15T22:40:54.847 INFO:tasks.workunit.client.0.smithi033.stdout:8/616: read d1/de/d1a/f6e [24553,14353] 0 2024-02-15T22:40:54.849 INFO:tasks.workunit.client.0.smithi033.stdout:8/617: creat d1/d74/dc1/d75/dbf/fd6 x:0 0 0 2024-02-15T22:40:54.849 INFO:tasks.workunit.client.0.smithi033.stdout:8/618: write d1/de/d1a/d2a/f6f [6239604,3365] 0 2024-02-15T22:40:54.849 INFO:tasks.workunit.client.0.smithi033.stdout:5/597: dread d6/d14/d31/d50/d5c/f97 [0,4194304] 0 2024-02-15T22:40:54.851 INFO:tasks.workunit.client.0.smithi033.stdout:8/619: creat d1/d74/dc1/d75/dbf/d79/d94/dd1/fd7 x:0 0 0 2024-02-15T22:40:54.855 INFO:tasks.workunit.client.0.smithi033.stdout:5/598: rename d6/d14/d31/d38/d9b/c98 to d6/d14/d31/d64/cba 0 2024-02-15T22:40:54.855 INFO:tasks.workunit.client.0.smithi033.stdout:5/599: fsync d6/d14/f45 0 2024-02-15T22:40:54.855 INFO:tasks.workunit.client.0.smithi033.stdout:5/600: chown d6/d14/d31/d38/d9b/l65 126715 1 2024-02-15T22:40:54.856 INFO:tasks.workunit.client.0.smithi033.stdout:8/620: symlink d1/d74/dc1/d75/dbf/d79/d94/ld8 0 2024-02-15T22:40:54.858 INFO:tasks.workunit.client.0.smithi033.stdout:8/621: symlink d1/de/d5c/ld9 0 2024-02-15T22:40:54.859 INFO:tasks.workunit.client.0.smithi033.stdout:5/601: rename d6/d14/d31/d50/d5c/c8e to d6/d25/cbb 0 2024-02-15T22:40:54.859 INFO:tasks.workunit.client.0.smithi033.stdout:5/602: write d6/d14/f45 [1283441,112814] 0 2024-02-15T22:40:54.861 INFO:tasks.workunit.client.0.smithi033.stdout:8/622: rename d1/d68/d1d/f35 to d1/de/d1a/d9d/fda 0 2024-02-15T22:40:54.861 INFO:tasks.workunit.client.0.smithi033.stdout:8/623: readlink d1/de/lad 0 2024-02-15T22:40:54.863 INFO:tasks.workunit.client.0.smithi033.stdout:5/603: symlink d6/d14/d31/d50/d6a/daf/lbc 0 2024-02-15T22:40:54.863 INFO:tasks.workunit.client.0.smithi033.stdout:1/576: dwrite d1/de/f81 [0,4194304] 0 2024-02-15T22:40:54.863 INFO:tasks.workunit.client.0.smithi033.stdout:7/654: dwrite d5/df/d56/d60/d59/d9c/f6a [0,4194304] 0 2024-02-15T22:40:54.863 INFO:tasks.workunit.client.0.smithi033.stdout:7/655: fsync d5/dc/d5f/d8b/da1/d26/f3c 0 2024-02-15T22:40:54.864 INFO:tasks.workunit.client.0.smithi033.stdout:8/624: truncate d1/d6/f7 1312588 0 2024-02-15T22:40:54.866 INFO:tasks.workunit.client.0.smithi033.stdout:1/577: unlink d1/de/d27/d28/d2d/d3b/c5c 0 2024-02-15T22:40:54.866 INFO:tasks.workunit.client.0.smithi033.stdout:1/578: chown d1/de/d27/l47 956512167 1 2024-02-15T22:40:54.866 INFO:tasks.workunit.client.0.smithi033.stdout:7/656: dread d5/dc/d5f/d8b/da1/d26/f3c [0,4194304] 0 2024-02-15T22:40:54.868 INFO:tasks.workunit.client.0.smithi033.stdout:8/625: mknod d1/cdb 0 2024-02-15T22:40:54.869 INFO:tasks.workunit.client.0.smithi033.stdout:8/626: write d1/d68/d44/d49/f7b [5069442,69597] 0 2024-02-15T22:40:54.869 INFO:tasks.workunit.client.0.smithi033.stdout:8/627: chown d1/d6/d14 4014517 1 2024-02-15T22:40:54.869 INFO:tasks.workunit.client.0.smithi033.stdout:8/628: chown d1/d68/d44/c8c 8187 1 2024-02-15T22:40:54.872 INFO:tasks.workunit.client.0.smithi033.stdout:1/579: rename d1/d20/d42/d25/c7c to d1/de/d27/d28/ca8 0 2024-02-15T22:40:54.872 INFO:tasks.workunit.client.0.smithi033.stdout:5/604: write d6/d14/d31/d50/d5c/fa5 [2476730,16614] 0 2024-02-15T22:40:54.872 INFO:tasks.workunit.client.0.smithi033.stdout:5/605: chown d6/d14/d31/d50/d5c/f97 802 1 2024-02-15T22:40:54.872 INFO:tasks.workunit.client.0.smithi033.stdout:5/606: chown d6/d14/c4c 37445175 1 2024-02-15T22:40:54.873 INFO:tasks.workunit.client.0.smithi033.stdout:5/607: write d6/d14/f1c [5818875,124793] 0 2024-02-15T22:40:54.876 INFO:tasks.workunit.client.0.smithi033.stdout:1/580: creat d1/d20/fa9 x:0 0 0 2024-02-15T22:40:54.881 INFO:tasks.workunit.client.0.smithi033.stdout:7/657: dread d5/f15 [0,4194304] 0 2024-02-15T22:40:54.886 INFO:tasks.workunit.client.0.smithi033.stdout:1/581: rename d1/d20/d42/d25/c4f to d1/caa 0 2024-02-15T22:40:54.886 INFO:tasks.workunit.client.0.smithi033.stdout:1/582: write d1/de/f16 [4884951,18382] 0 2024-02-15T22:40:54.896 INFO:tasks.workunit.client.0.smithi033.stdout:8/629: dwrite d1/d68/d44/f8d [0,4194304] 0 2024-02-15T22:40:54.904 INFO:tasks.workunit.client.0.smithi033.stdout:5/608: dwrite d6/d14/d31/d48/d49/d53/d57/f61 [0,4194304] 0 2024-02-15T22:40:54.904 INFO:tasks.workunit.client.0.smithi033.stdout:5/609: read d6/f1b [3979230,37166] 0 2024-02-15T22:40:54.905 INFO:tasks.workunit.client.0.smithi033.stdout:5/610: fdatasync d6/d14/d31/d50/fb6 0 2024-02-15T22:40:54.909 INFO:tasks.workunit.client.0.smithi033.stdout:5/611: write d6/d14/d31/d50/d5c/f97 [498904,87543] 0 2024-02-15T22:40:54.911 INFO:tasks.workunit.client.0.smithi033.stdout:1/583: dwrite d1/f5b [0,4194304] 0 2024-02-15T22:40:54.911 INFO:tasks.workunit.client.0.smithi033.stdout:8/630: dwrite d1/d74/fa1 [0,4194304] 0 2024-02-15T22:40:54.912 INFO:tasks.workunit.client.0.smithi033.stdout:8/631: write d1/dae/fcc [472614,47083] 0 2024-02-15T22:40:54.912 INFO:tasks.workunit.client.0.smithi033.stdout:5/612: creat d6/d14/fbd x:0 0 0 2024-02-15T22:40:54.916 INFO:tasks.workunit.client.0.smithi033.stdout:1/584: symlink d1/d20/d42/d2c/d4e/lab 0 2024-02-15T22:40:54.923 INFO:tasks.workunit.client.0.smithi033.stdout:5/613: dread d6/d14/d31/d48/f69 [0,4194304] 0 2024-02-15T22:40:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 -- 172.21.15.33:0/1704263136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 msgr2=0x7f4a2c0fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 --2- 172.21.15.33:0/1704263136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c0fb630 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c004940 tx=0x7f4a1c009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 -- 172.21.15.33:0/1704263136 shutdown_connections 2024-02-15T22:40:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 --2- 172.21.15.33:0/1704263136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a2c0fe2b0 0x7f4a2c0fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 --2- 172.21.15.33:0/1704263136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c0fb630 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 -- 172.21.15.33:0/1704263136 >> 172.21.15.33:0/1704263136 conn(0x7f4a2c0f6ca0 msgr2=0x7f4a2c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:54.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 -- 172.21.15.33:0/1704263136 shutdown_connections 2024-02-15T22:40:54.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.922+0000 7f4a32785700 1 -- 172.21.15.33:0/1704263136 wait complete. 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.923+0000 7f4a32785700 1 Processor -- start 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.923+0000 7f4a32785700 1 -- start start 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.923+0000 7f4a32785700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.923+0000 7f4a32785700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a2c0fe2b0 0x7f4a2c110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.923+0000 7f4a32785700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c110fd0 con 0x7f4a2c0fb220 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.923+0000 7f4a32785700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c111140 con 0x7f4a2c0fe2b0 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c10fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40542/0 (socket says 172.21.15.33:40542) 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2bfff700 1 -- 172.21.15.33:0/1488550794 learned_addr learned my addr 172.21.15.33:0/1488550794 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2b7fe700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a2c0fe2b0 0x7f4a2c110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2bfff700 1 -- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a2c0fe2b0 msgr2=0x7f4a2c110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2bfff700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a2c0fe2b0 0x7f4a2c110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2bfff700 1 -- 172.21.15.33:0/1488550794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c005040 con 0x7f4a2c0fb220 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.924+0000 7f4a2bfff700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c10fd30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009150 tx=0x7f4a1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.925+0000 7f4a28ff9700 1 -- 172.21.15.33:0/1488550794 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a1c00e040 con 0x7f4a2c0fb220 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.925+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c1113c0 con 0x7f4a2c0fb220 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.925+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c111900 con 0x7f4a2c0fb220 2024-02-15T22:40:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.925+0000 7f4a28ff9700 1 -- 172.21.15.33:0/1488550794 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a1c00bbf0 con 0x7f4a2c0fb220 2024-02-15T22:40:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.926+0000 7f4a28ff9700 1 -- 172.21.15.33:0/1488550794 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a1c01c3f0 con 0x7f4a2c0fb220 2024-02-15T22:40:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.926+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a180052e0 con 0x7f4a2c0fb220 2024-02-15T22:40:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.927+0000 7f4a28ff9700 1 -- 172.21.15.33:0/1488550794 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f4a1c00bd60 con 0x7f4a2c0fb220 2024-02-15T22:40:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.927+0000 7f4a28ff9700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f4a1406b2e0 0x7f4a1406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.927+0000 7f4a28ff9700 1 -- 172.21.15.33:0/1488550794 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f4a1c08b000 con 0x7f4a2c0fb220 2024-02-15T22:40:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.928+0000 7f4a2b7fe700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f4a1406b2e0 0x7f4a1406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:54.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.928+0000 7f4a2b7fe700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f4a1406b2e0 0x7f4a1406d790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a20006fd0 tx=0x7f4a20008040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:54.932+0000 7f4a28ff9700 1 -- 172.21.15.33:0/1488550794 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4a1c058c30 con 0x7f4a2c0fb220 2024-02-15T22:40:54.947 INFO:tasks.workunit.client.0.smithi033.stdout:8/632: dwrite d1/d6/d14/d5d/fc0 [0,4194304] 0 2024-02-15T22:40:54.947 INFO:tasks.workunit.client.0.smithi033.stdout:1/585: dwrite d1/de/f81 [4194304,4194304] 0 2024-02-15T22:40:54.949 INFO:tasks.workunit.client.0.smithi033.stdout:5/614: dwrite d6/d14/d31/d38/d9b/f54 [0,4194304] 0 2024-02-15T22:40:54.949 INFO:tasks.workunit.client.0.smithi033.stdout:8/633: mknod d1/d74/cdc 0 2024-02-15T22:40:54.959 INFO:tasks.workunit.client.0.smithi033.stdout:3/621: sync 2024-02-15T22:40:54.961 INFO:tasks.workunit.client.0.smithi033.stdout:3/622: creat d0/d3/d5f/fcb x:0 0 0 2024-02-15T22:40:54.961 INFO:tasks.workunit.client.0.smithi033.stdout:3/623: write d0/d3/d3b/d47/f80 [1002302,32920] 0 2024-02-15T22:40:54.961 INFO:tasks.workunit.client.0.smithi033.stdout:3/624: stat d0/d3/c3a 0 2024-02-15T22:40:54.961 INFO:tasks.workunit.client.0.smithi033.stdout:3/625: creat d0/d3/d5f/fcc x:0 0 0 2024-02-15T22:40:54.962 INFO:tasks.workunit.client.0.smithi033.stdout:3/626: creat d0/d3/d2c/d5d/d3d/fcd x:0 0 0 2024-02-15T22:40:54.963 INFO:tasks.workunit.client.0.smithi033.stdout:3/627: chown d0/c9f 31217 1 2024-02-15T22:40:54.964 INFO:tasks.workunit.client.0.smithi033.stdout:8/634: dread d1/de/d1a/d2a/f3b [0,4194304] 0 2024-02-15T22:40:54.964 INFO:tasks.workunit.client.0.smithi033.stdout:8/635: dread - d1/d68/d57/fc5 zero size 2024-02-15T22:40:54.964 INFO:tasks.workunit.client.0.smithi033.stdout:8/636: fdatasync d1/d68/d44/fb9 0 2024-02-15T22:40:54.965 INFO:tasks.workunit.client.0.smithi033.stdout:8/637: getdents d1/de/d5c 0 2024-02-15T22:40:54.966 INFO:tasks.workunit.client.0.smithi033.stdout:8/638: creat d1/de/d1a/fdd x:0 0 0 2024-02-15T22:40:54.966 INFO:tasks.workunit.client.0.smithi033.stdout:8/639: write d1/de/d1a/d27/d60/fc9 [881124,71027] 0 2024-02-15T22:40:54.968 INFO:tasks.workunit.client.0.smithi033.stdout:8/640: mkdir d1/d74/dc1/d75/db1/dde 0 2024-02-15T22:40:54.970 INFO:tasks.workunit.client.0.smithi033.stdout:5/615: dwrite d6/d25/d99/fa4 [0,4194304] 0 2024-02-15T22:40:54.970 INFO:tasks.workunit.client.0.smithi033.stdout:5/616: creat d6/d14/d31/d48/da2/fbe x:0 0 0 2024-02-15T22:40:54.970 INFO:tasks.workunit.client.0.smithi033.stdout:5/617: creat d6/d14/d31/d48/d49/d53/d57/fbf x:0 0 0 2024-02-15T22:40:54.972 INFO:tasks.workunit.client.0.smithi033.stdout:1/586: dwrite d1/f6 [0,4194304] 0 2024-02-15T22:40:54.973 INFO:tasks.workunit.client.0.smithi033.stdout:1/587: truncate d1/de/d27/d28/d2d/d36/f5d 6266685 0 2024-02-15T22:40:54.980 INFO:tasks.workunit.client.0.smithi033.stdout:5/618: dread d6/d25/d99/fa4 [0,4194304] 0 2024-02-15T22:40:54.982 INFO:tasks.workunit.client.0.smithi033.stdout:8/641: dread d1/de/d1a/d27/d55/f59 [0,4194304] 0 2024-02-15T22:40:54.982 INFO:tasks.workunit.client.0.smithi033.stdout:5/619: mknod d6/db0/cc0 0 2024-02-15T22:40:54.982 INFO:tasks.workunit.client.0.smithi033.stdout:5/620: chown d6/d14/d31/d50/d5c 23 1 2024-02-15T22:40:54.982 INFO:tasks.workunit.client.0.smithi033.stdout:5/621: write d6/d14/d31/d38/d9b/f71 [3798239,58954] 0 2024-02-15T22:40:54.982 INFO:tasks.workunit.client.0.smithi033.stdout:8/642: mkdir d1/de/d1a/d27/ddf 0 2024-02-15T22:40:54.984 INFO:tasks.workunit.client.0.smithi033.stdout:3/628: dwrite d0/f1f [0,4194304] 0 2024-02-15T22:40:54.985 INFO:tasks.workunit.client.0.smithi033.stdout:5/622: mkdir d6/d14/d31/d48/d49/d53/d57/dc1 0 2024-02-15T22:40:54.985 INFO:tasks.workunit.client.0.smithi033.stdout:5/623: write d6/d14/d31/d50/d5c/fa5 [3659888,68065] 0 2024-02-15T22:40:54.985 INFO:tasks.workunit.client.0.smithi033.stdout:5/624: read - d6/db0/f94 zero size 2024-02-15T22:40:54.994 INFO:tasks.workunit.client.0.smithi033.stdout:1/588: dwrite d1/de/d27/d39/d3a/f51 [4194304,4194304] 0 2024-02-15T22:40:54.995 INFO:tasks.workunit.client.0.smithi033.stdout:1/589: write d1/de/d27/d28/f83 [432015,74884] 0 2024-02-15T22:40:54.997 INFO:tasks.workunit.client.0.smithi033.stdout:1/590: rename d1/f5b to d1/d20/d8a/d92/fac 0 2024-02-15T22:40:54.997 INFO:tasks.workunit.client.0.smithi033.stdout:1/591: readlink d1/de/d27/d28/l77 0 2024-02-15T22:40:54.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/592: creat d1/d96/fad x:0 0 0 2024-02-15T22:40:54.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/593: dread - d1/d20/f9b zero size 2024-02-15T22:40:54.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/594: getdents d1/d20/d42/d2c/d7b 0 2024-02-15T22:40:55.007 INFO:tasks.workunit.client.0.smithi033.stdout:8/643: dwrite d1/de/d5c/f7e [0,4194304] 0 2024-02-15T22:40:55.010 INFO:tasks.workunit.client.0.smithi033.stdout:5/625: dwrite d6/d25/f29 [0,4194304] 0 2024-02-15T22:40:55.014 INFO:tasks.workunit.client.0.smithi033.stdout:1/595: dread d1/d20/f24 [0,4194304] 0 2024-02-15T22:40:55.014 INFO:tasks.workunit.client.0.smithi033.stdout:1/596: write d1/d20/d42/f33 [1575733,61760] 0 2024-02-15T22:40:55.017 INFO:tasks.workunit.client.0.smithi033.stdout:1/597: mkdir d1/de/d27/d39/d3a/dae 0 2024-02-15T22:40:55.019 INFO:tasks.workunit.client.0.smithi033.stdout:5/626: write d6/d14/d31/f36 [3045292,25507] 0 2024-02-15T22:40:55.021 INFO:tasks.workunit.client.0.smithi033.stdout:5/627: link d6/d14/d31/d48/d49/d53/d57/fb3 d6/d14/d31/d48/d49/d53/d57/da1/fc2 0 2024-02-15T22:40:55.027 INFO:tasks.workunit.client.0.smithi033.stdout:1/598: write d1/f17 [2893207,85863] 0 2024-02-15T22:40:55.027 INFO:tasks.workunit.client.0.smithi033.stdout:1/599: write d1/de/d27/d39/d3a/f85 [809094,81643] 0 2024-02-15T22:40:55.027 INFO:tasks.workunit.client.0.smithi033.stdout:1/600: truncate d1/d20/d42/f49 1713196 0 2024-02-15T22:40:55.028 INFO:tasks.workunit.client.0.smithi033.stdout:8/644: dwrite d1/d6/d14/d5d/fc0 [0,4194304] 0 2024-02-15T22:40:55.030 INFO:tasks.workunit.client.0.smithi033.stdout:8/645: unlink d1/de/d1a/d2a/f9c 0 2024-02-15T22:40:55.032 INFO:tasks.workunit.client.0.smithi033.stdout:8/646: mknod d1/de/d1a/d27/d60/ce0 0 2024-02-15T22:40:55.033 INFO:tasks.workunit.client.0.smithi033.stdout:5/628: dread d6/f33 [0,4194304] 0 2024-02-15T22:40:55.033 INFO:tasks.workunit.client.0.smithi033.stdout:5/629: write d6/d14/f6e [4752222,56787] 0 2024-02-15T22:40:55.034 INFO:tasks.workunit.client.0.smithi033.stdout:8/647: creat d1/d68/d44/fe1 x:0 0 0 2024-02-15T22:40:55.036 INFO:tasks.workunit.client.0.smithi033.stdout:5/630: rename d6/d14/f96 to d6/db0/fc3 0 2024-02-15T22:40:55.038 INFO:tasks.workunit.client.0.smithi033.stdout:5/631: rmdir d6/d14/d31/d50/d6a/daf/db5 0 2024-02-15T22:40:55.038 INFO:tasks.workunit.client.0.smithi033.stdout:5/632: chown d6/d14/d31/f36 511043255 1 2024-02-15T22:40:55.039 INFO:tasks.workunit.client.0.smithi033.stdout:5/633: readlink d6/d25/l34 0 2024-02-15T22:40:55.039 INFO:tasks.workunit.client.0.smithi033.stdout:5/634: write d6/d14/d31/f47 [1039289,7349] 0 2024-02-15T22:40:55.043 INFO:tasks.workunit.client.0.smithi033.stdout:1/601: dwrite d1/d20/d42/f49 [0,4194304] 0 2024-02-15T22:40:55.046 INFO:tasks.workunit.client.0.smithi033.stdout:8/648: dread d1/d68/d44/f9b [0,4194304] 0 2024-02-15T22:40:55.048 INFO:tasks.workunit.client.0.smithi033.stdout:8/649: unlink d1/de/d1a/d27/d55/l7d 0 2024-02-15T22:40:55.051 INFO:tasks.workunit.client.0.smithi033.stdout:5/635: dread d6/d14/d31/d64/f8a [0,4194304] 0 2024-02-15T22:40:55.051 INFO:tasks.workunit.client.0.smithi033.stdout:5/636: truncate d6/fb1 157109 0 2024-02-15T22:40:55.051 INFO:tasks.workunit.client.0.smithi033.stdout:8/650: link d1/d36/fac d1/d74/dc1/fe2 0 2024-02-15T22:40:55.051 INFO:tasks.workunit.client.0.smithi033.stdout:8/651: chown d1/d74/dc1/d75/dbf/d79/l1f 368 1 2024-02-15T22:40:55.051 INFO:tasks.workunit.client.0.smithi033.stdout:8/652: fsync d1/de/f37 0 2024-02-15T22:40:55.054 INFO:tasks.workunit.client.0.smithi033.stdout:1/602: dread d1/d57/f5f [0,4194304] 0 2024-02-15T22:40:55.061 INFO:tasks.workunit.client.0.smithi033.stdout:1/603: read d1/d20/d42/d25/d67/f88 [3743500,123684] 0 2024-02-15T22:40:55.064 INFO:tasks.workunit.client.0.smithi033.stdout:1/604: link d1/d20/d42/l26 d1/de/d27/d39/d3a/da3/laf 0 2024-02-15T22:40:55.067 INFO:tasks.workunit.client.0.smithi033.stdout:1/605: mkdir d1/d20/d42/d2c/db0 0 2024-02-15T22:40:55.067 INFO:tasks.workunit.client.0.smithi033.stdout:1/606: getdents d1/d20/d8a/d8f/da4 0 2024-02-15T22:40:55.069 INFO:tasks.workunit.client.0.smithi033.stdout:5/637: rmdir d6/d14/d31/d50/d6a 39 2024-02-15T22:40:55.069 INFO:tasks.workunit.client.0.smithi033.stdout:5/638: chown d6/l11 14030 1 2024-02-15T22:40:55.069 INFO:tasks.workunit.client.0.smithi033.stdout:5/639: chown d6/d25 25048 1 2024-02-15T22:40:55.071 INFO:tasks.workunit.client.0.smithi033.stdout:1/607: mkdir d1/d57/db1 0 2024-02-15T22:40:55.071 INFO:tasks.workunit.client.0.smithi033.stdout:1/608: write d1/d20/d8a/d8f/fa2 [311985,126055] 0 2024-02-15T22:40:55.072 INFO:tasks.workunit.client.0.smithi033.stdout:8/653: dwrite d1/de/d1a/d2a/fcd [0,4194304] 0 2024-02-15T22:40:55.079 INFO:tasks.workunit.client.0.smithi033.stdout:5/640: getdents d6/d14/d31/d50 0 2024-02-15T22:40:55.079 INFO:tasks.workunit.client.0.smithi033.stdout:5/641: creat d6/d14/d31/d64/fc4 x:0 0 0 2024-02-15T22:40:55.079 INFO:tasks.workunit.client.0.smithi033.stdout:5/642: write d6/fb1 [609550,117656] 0 2024-02-15T22:40:55.084 INFO:tasks.workunit.client.0.smithi033.stdout:5/643: creat d6/d14/d31/d64/d7a/fc5 x:0 0 0 2024-02-15T22:40:55.092 INFO:tasks.workunit.client.0.smithi033.stdout:1/609: dwrite d1/d20/d42/d2c/d4e/f97 [0,4194304] 0 2024-02-15T22:40:55.094 INFO:tasks.workunit.client.0.smithi033.stdout:1/610: truncate d1/d20/d42/d25/d67/f88 2186324 0 2024-02-15T22:40:55.095 INFO:tasks.workunit.client.0.smithi033.stdout:8/654: dwrite d1/de/d1a/f69 [0,4194304] 0 2024-02-15T22:40:55.096 INFO:tasks.workunit.client.0.smithi033.stdout:8/655: chown d1/d68/d44/f8d 1965600077 1 2024-02-15T22:40:55.098 INFO:tasks.workunit.client.0.smithi033.stdout:1/611: dread d1/d57/f5f [0,4194304] 0 2024-02-15T22:40:55.099 INFO:tasks.workunit.client.0.smithi033.stdout:1/612: unlink d1/de/d27/d28/d37/c4b 0 2024-02-15T22:40:55.103 INFO:tasks.workunit.client.0.smithi033.stdout:5/644: dwrite d6/d14/d31/d38/f82 [0,4194304] 0 2024-02-15T22:40:55.112 INFO:tasks.workunit.client.0.smithi033.stdout:8/656: read d1/de/d1a/d2a/fcd [1469618,44163] 0 2024-02-15T22:40:55.114 INFO:tasks.workunit.client.0.smithi033.stdout:5/645: dread d6/d14/f19 [0,4194304] 0 2024-02-15T22:40:55.116 INFO:tasks.workunit.client.0.smithi033.stdout:5/646: unlink d6/db0/d70/f79 0 2024-02-15T22:40:55.118 INFO:tasks.workunit.client.0.smithi033.stdout:1/613: dwrite d1/de/f81 [0,4194304] 0 2024-02-15T22:40:55.119 INFO:tasks.workunit.client.0.smithi033.stdout:5/647: rename d6/d14/d31/d48/d49/d53/c7d to d6/d14/d31/d48/d49/d53/d57/da1/cc6 0 2024-02-15T22:40:55.121 INFO:tasks.workunit.client.0.smithi033.stdout:5/648: symlink d6/lc7 0 2024-02-15T22:40:55.124 INFO:tasks.workunit.client.0.smithi033.stdout:5/649: rename d6/d14/f30 to d6/d14/d31/d38/d9b/fc8 0 2024-02-15T22:40:55.124 INFO:tasks.workunit.client.0.smithi033.stdout:5/650: chown d6/d14/d31/d50/d6a/daf 212 1 2024-02-15T22:40:55.126 INFO:tasks.workunit.client.0.smithi033.stdout:5/651: getdents d6/d14/d31 0 2024-02-15T22:40:55.126 INFO:tasks.workunit.client.0.smithi033.stdout:5/652: write d6/db0/f94 [485595,13031] 0 2024-02-15T22:40:55.126 INFO:tasks.workunit.client.0.smithi033.stdout:5/653: rmdir d6/d14/d31/d38/d9b 39 2024-02-15T22:40:55.132 INFO:tasks.workunit.client.0.smithi033.stdout:5/654: dread d6/f10 [0,4194304] 0 2024-02-15T22:40:55.133 INFO:tasks.workunit.client.0.smithi033.stdout:5/655: mknod d6/d14/d31/d50/cc9 0 2024-02-15T22:40:55.134 INFO:tasks.workunit.client.0.smithi033.stdout:8/657: dwrite d1/d68/d44/d49/fb3 [0,4194304] 0 2024-02-15T22:40:55.134 INFO:tasks.workunit.client.0.smithi033.stdout:8/658: chown d1/d68/d44/d49 799 1 2024-02-15T22:40:55.135 INFO:tasks.workunit.client.0.smithi033.stdout:8/659: fsync d1/de/d1a/d2a/f3b 0 2024-02-15T22:40:55.135 INFO:tasks.workunit.client.0.smithi033.stdout:5/656: rename d6/lc7 to d6/d14/d31/d64/d7a/lca 0 2024-02-15T22:40:55.135 INFO:tasks.workunit.client.0.smithi033.stdout:5/657: read d6/d14/d31/d38/d9b/f71 [624625,32548] 0 2024-02-15T22:40:55.135 INFO:tasks.workunit.client.0.smithi033.stdout:8/660: read d1/d36/fac [644569,123838] 0 2024-02-15T22:40:55.136 INFO:tasks.workunit.client.0.smithi033.stdout:5/658: unlink d6/lc 0 2024-02-15T22:40:55.136 INFO:tasks.workunit.client.0.smithi033.stdout:1/614: dwrite d1/de/f13 [4194304,4194304] 0 2024-02-15T22:40:55.137 INFO:tasks.workunit.client.0.smithi033.stdout:5/659: creat d6/d14/d31/d38/fcb x:0 0 0 2024-02-15T22:40:55.137 INFO:tasks.workunit.client.0.smithi033.stdout:5/660: write d6/d14/d31/d38/d9b/f54 [5370061,112613] 0 2024-02-15T22:40:55.138 INFO:tasks.workunit.client.0.smithi033.stdout:1/615: symlink d1/d20/d8a/lb2 0 2024-02-15T22:40:55.139 INFO:tasks.workunit.client.0.smithi033.stdout:1/616: chown d1/de/d27/d28/d2d/d36/d8b 36140624 1 2024-02-15T22:40:55.139 INFO:tasks.workunit.client.0.smithi033.stdout:5/661: mkdir d6/d14/d31/d48/d56/dcc 0 2024-02-15T22:40:55.144 INFO:tasks.workunit.client.0.smithi033.stdout:8/661: dread d1/d68/d44/d49/f7b [0,4194304] 0 2024-02-15T22:40:55.146 INFO:tasks.workunit.client.0.smithi033.stdout:8/662: mknod d1/d68/d1d/d4a/d4c/ce3 0 2024-02-15T22:40:55.148 INFO:tasks.workunit.client.0.smithi033.stdout:0/565: sync 2024-02-15T22:40:55.148 INFO:tasks.workunit.client.0.smithi033.stdout:4/697: sync 2024-02-15T22:40:55.148 INFO:tasks.workunit.client.0.smithi033.stdout:9/558: sync 2024-02-15T22:40:55.148 INFO:tasks.workunit.client.0.smithi033.stdout:2/721: sync 2024-02-15T22:40:55.149 INFO:tasks.workunit.client.0.smithi033.stdout:6/496: sync 2024-02-15T22:40:55.149 INFO:tasks.workunit.client.0.smithi033.stdout:9/559: write d4/d1d/d23/d32/d3e/f56 [1302564,12779] 0 2024-02-15T22:40:55.149 INFO:tasks.workunit.client.0.smithi033.stdout:4/698: creat d8/d16/d51/d1c/d3c/d49/fee x:0 0 0 2024-02-15T22:40:55.149 INFO:tasks.workunit.client.0.smithi033.stdout:9/560: write d4/f43 [801657,14194] 0 2024-02-15T22:40:55.149 INFO:tasks.workunit.client.0.smithi033.stdout:0/566: readlink db/d19/d32/d46/l7e 0 2024-02-15T22:40:55.149 INFO:tasks.workunit.client.0.smithi033.stdout:0/567: truncate db/d19/d32/f6f 1230610 0 2024-02-15T22:40:55.151 INFO:tasks.workunit.client.0.smithi033.stdout:9/561: read d4/d1d/d42/fa0 [340266,103488] 0 2024-02-15T22:40:55.151 INFO:tasks.workunit.client.0.smithi033.stdout:9/562: creat d4/d1d/d23/d24/fa6 x:0 0 0 2024-02-15T22:40:55.151 INFO:tasks.workunit.client.0.smithi033.stdout:2/722: link d1/d16/d3f/fd7 d1/d8/d2b/d2f/d24/d2a/d88/d8e/fe5 0 2024-02-15T22:40:55.153 INFO:tasks.workunit.client.0.smithi033.stdout:6/497: truncate d12/d2c/f4a 1658353 0 2024-02-15T22:40:55.153 INFO:tasks.workunit.client.0.smithi033.stdout:6/498: fdatasync d12/d2c/d30/f72 0 2024-02-15T22:40:55.153 INFO:tasks.workunit.client.0.smithi033.stdout:5/662: dread d6/fb [0,4194304] 0 2024-02-15T22:40:55.157 INFO:tasks.workunit.client.0.smithi033.stdout:8/663: dread d1/de/d1a/d27/fbc [0,4194304] 0 2024-02-15T22:40:55.157 INFO:tasks.workunit.client.0.smithi033.stdout:4/699: dread d8/d16/d51/d1c/db9/d37/faa [0,4194304] 0 2024-02-15T22:40:55.157 INFO:tasks.workunit.client.0.smithi033.stdout:6/499: symlink d12/d3c/d95/d3f/d50/la7 0 2024-02-15T22:40:55.158 INFO:tasks.workunit.client.0.smithi033.stdout:2/723: dread d1/d8/d2b/d2f/d24/d7a/fa5 [0,4194304] 0 2024-02-15T22:40:55.158 INFO:tasks.workunit.client.0.smithi033.stdout:2/724: chown d1/d8/d2b/d2f/d24/d2a/d88/de4 63747000 1 2024-02-15T22:40:55.158 INFO:tasks.workunit.client.0.smithi033.stdout:1/617: dwrite d1/de/d27/d39/d3a/f85 [0,4194304] 0 2024-02-15T22:40:55.160 INFO:tasks.workunit.client.0.smithi033.stdout:5/663: rename d6/d14/d31/d48/d49/d53/fb8 to d6/d14/d31/d48/d49/d53/fcd 0 2024-02-15T22:40:55.161 INFO:tasks.workunit.client.0.smithi033.stdout:8/664: creat d1/d74/dc1/d75/db1/dde/fe4 x:0 0 0 2024-02-15T22:40:55.161 INFO:tasks.workunit.client.0.smithi033.stdout:8/665: write d1/dae/fcc [514374,89986] 0 2024-02-15T22:40:55.162 INFO:tasks.workunit.client.0.smithi033.stdout:6/500: truncate d12/d3c/d95/d3f/d4b/f6e 608820 0 2024-02-15T22:40:55.164 INFO:tasks.workunit.client.0.smithi033.stdout:4/700: rename d8/d16/d51/d1c/c72 to d8/d16/d51/d1c/db9/d37/dbe/de0/cef 0 2024-02-15T22:40:55.167 INFO:tasks.workunit.client.0.smithi033.stdout:1/618: truncate d1/d20/d42/d2c/d30/f40 3516729 0 2024-02-15T22:40:55.167 INFO:tasks.workunit.client.0.smithi033.stdout:1/619: chown d1/d20/d42/d2c 26222226 1 2024-02-15T22:40:55.168 INFO:tasks.workunit.client.0.smithi033.stdout:4/701: mknod d8/d16/d51/d56/cf0 0 2024-02-15T22:40:55.168 INFO:tasks.workunit.client.0.smithi033.stdout:4/702: fsync d8/d16/d51/d77/fa0 0 2024-02-15T22:40:55.172 INFO:tasks.workunit.client.0.smithi033.stdout:4/703: symlink d8/d16/d51/d1c/d3c/ddd/lf1 0 2024-02-15T22:40:55.172 INFO:tasks.workunit.client.0.smithi033.stdout:2/725: dread d1/d8/d2b/d2f/d38/f95 [0,4194304] 0 2024-02-15T22:40:55.172 INFO:tasks.workunit.client.0.smithi033.stdout:2/726: fdatasync d1/d16/d5a/f87 0 2024-02-15T22:40:55.172 INFO:tasks.workunit.client.0.smithi033.stdout:1/620: getdents d1/d20 0 2024-02-15T22:40:55.172 INFO:tasks.workunit.client.0.smithi033.stdout:1/621: fsync d1/de/f13 0 2024-02-15T22:40:55.174 INFO:tasks.workunit.client.0.smithi033.stdout:4/704: unlink d8/d16/d51/d1c/db9/d37/d31/fc6 0 2024-02-15T22:40:55.176 INFO:tasks.workunit.client.0.smithi033.stdout:2/727: mkdir d1/d8/d2b/d2f/d24/d31/de6 0 2024-02-15T22:40:55.176 INFO:tasks.workunit.client.0.smithi033.stdout:2/728: chown d1/d66/d75/lcc 424807198 1 2024-02-15T22:40:55.177 INFO:tasks.workunit.client.0.smithi033.stdout:0/568: dwrite db/d19/d32/d46/f83 [0,4194304] 0 2024-02-15T22:40:55.180 INFO:tasks.workunit.client.0.smithi033.stdout:1/622: unlink d1/d20/d42/d2c/d4e/l52 0 2024-02-15T22:40:55.180 INFO:tasks.workunit.client.0.smithi033.stdout:5/664: dwrite d6/d14/fbd [0,4194304] 0 2024-02-15T22:40:55.180 INFO:tasks.workunit.client.0.smithi033.stdout:5/665: write d6/db0/f94 [834316,5069] 0 2024-02-15T22:40:55.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/666: dread d1/d68/d44/f9b [4194304,4194304] 0 2024-02-15T22:40:55.183 INFO:tasks.workunit.client.0.smithi033.stdout:2/729: link d1/d8/c35 d1/d8/d2b/d2f/d24/d31/de6/ce7 0 2024-02-15T22:40:55.183 INFO:tasks.workunit.client.0.smithi033.stdout:2/730: truncate d1/d8/d2b/d2f/d24/d2a/d88/d8e/fe5 823446 0 2024-02-15T22:40:55.186 INFO:tasks.workunit.client.0.smithi033.stdout:0/569: symlink db/d19/d32/d43/d7d/lb9 0 2024-02-15T22:40:55.189 INFO:tasks.workunit.client.0.smithi033.stdout:1/623: mknod d1/de/d27/d28/d2d/d36/cb3 0 2024-02-15T22:40:55.193 INFO:tasks.workunit.client.0.smithi033.stdout:5/666: mkdir d6/d14/d31/dce 0 2024-02-15T22:40:55.196 INFO:tasks.workunit.client.0.smithi033.stdout:2/731: getdents d1/d8/d2b/d2f/d38/d62 0 2024-02-15T22:40:55.199 INFO:tasks.workunit.client.0.smithi033.stdout:0/570: rmdir db/d2a/d6e/d7a/d95/dac 0 2024-02-15T22:40:55.199 INFO:tasks.workunit.client.0.smithi033.stdout:0/571: fsync db/f87 0 2024-02-15T22:40:55.200 INFO:tasks.workunit.client.0.smithi033.stdout:4/705: dwrite d8/d16/d51/d1c/d3c/d49/fa4 [0,4194304] 0 2024-02-15T22:40:55.201 INFO:tasks.workunit.client.0.smithi033.stdout:1/624: link d1/de/d27/d39/c95 d1/d20/d42/d2c/d30/cb4 0 2024-02-15T22:40:55.202 INFO:tasks.workunit.client.0.smithi033.stdout:5/667: dread d6/d14/d31/d48/d49/d53/fa3 [0,4194304] 0 2024-02-15T22:40:55.203 INFO:tasks.workunit.client.0.smithi033.stdout:8/667: link d1/d6/d14/l3f d1/d6/le5 0 2024-02-15T22:40:55.203 INFO:tasks.workunit.client.0.smithi033.stdout:8/668: write d1/d68/d44/d49/f7b [1808490,6940] 0 2024-02-15T22:40:55.204 INFO:tasks.workunit.client.0.smithi033.stdout:8/669: chown d1/de/d1a/d2a/fcd 299192067 1 2024-02-15T22:40:55.204 INFO:tasks.workunit.client.0.smithi033.stdout:2/732: mkdir d1/d8/d2b/d2f/d38/db0/de8 0 2024-02-15T22:40:55.206 INFO:tasks.workunit.client.0.smithi033.stdout:0/572: unlink db/l13 0 2024-02-15T22:40:55.206 INFO:tasks.workunit.client.0.smithi033.stdout:0/573: chown db/d2a 173371959 1 2024-02-15T22:40:55.209 INFO:tasks.workunit.client.0.smithi033.stdout:5/668: mknod d6/d14/d31/d50/d5c/ccf 0 2024-02-15T22:40:55.209 INFO:tasks.workunit.client.0.smithi033.stdout:5/669: chown d6/d14/d31/d50/d5c/l91 105 1 2024-02-15T22:40:55.209 INFO:tasks.workunit.client.0.smithi033.stdout:5/670: write d6/d25/f55 [1844780,68064] 0 2024-02-15T22:40:55.210 INFO:tasks.workunit.client.0.smithi033.stdout:8/670: truncate d1/d74/dc1/fe2 184784 0 2024-02-15T22:40:55.210 INFO:tasks.workunit.client.0.smithi033.stdout:8/671: truncate d1/de/d1a/f20 4816189 0 2024-02-15T22:40:55.210 INFO:tasks.workunit.client.0.smithi033.stdout:4/706: dread d8/d16/d51/d1c/f6c [4194304,4194304] 0 2024-02-15T22:40:55.210 INFO:tasks.workunit.client.0.smithi033.stdout:1/625: write d1/de/d27/d28/d2d/f8c [3786477,42280] 0 2024-02-15T22:40:55.212 INFO:tasks.workunit.client.0.smithi033.stdout:1/626: write d1/d20/d42/f33 [367939,24275] 0 2024-02-15T22:40:55.216 INFO:tasks.workunit.client.0.smithi033.stdout:5/671: dread d6/d14/d31/d50/d5c/f97 [0,4194304] 0 2024-02-15T22:40:55.224 INFO:tasks.workunit.client.0.smithi033.stdout:8/672: mkdir d1/de/d1a/d27/ddf/de6 0 2024-02-15T22:40:55.224 INFO:tasks.workunit.client.0.smithi033.stdout:8/673: chown d1/de/d1a/d27/d55/lb0 16825 1 2024-02-15T22:40:55.224 INFO:tasks.workunit.client.0.smithi033.stdout:8/674: truncate d1/d6/d14/fb7 842499 0 2024-02-15T22:40:55.225 INFO:tasks.workunit.client.0.smithi033.stdout:4/707: getdents d8/d16/d51/d1c/d3c/d49/dac/dd5 0 2024-02-15T22:40:55.229 INFO:tasks.workunit.client.0.smithi033.stdout:2/733: rmdir d1/d8/d2b/d2f/d12 39 2024-02-15T22:40:55.229 INFO:tasks.workunit.client.0.smithi033.stdout:2/734: stat d1/d8/d2b/d2f/d13/da9/cb3 0 2024-02-15T22:40:55.231 INFO:tasks.workunit.client.0.smithi033.stdout:0/574: symlink db/d2a/lba 0 2024-02-15T22:40:55.233 INFO:tasks.workunit.client.0.smithi033.stdout:1/627: rename d1/de/d27/d28/d2d/l86 to d1/de/d27/d28/d79/lb5 0 2024-02-15T22:40:55.235 INFO:tasks.workunit.client.0.smithi033.stdout:5/672: rmdir d6/d14/d31/d48/d49/d53/d57/dc1 0 2024-02-15T22:40:55.237 INFO:tasks.workunit.client.0.smithi033.stdout:8/675: link d1/d6/d14/f1b d1/de/d1a/d27/fe7 0 2024-02-15T22:40:55.238 INFO:tasks.workunit.client.0.smithi033.stdout:3/629: sync 2024-02-15T22:40:55.238 INFO:tasks.workunit.client.0.smithi033.stdout:7/658: sync 2024-02-15T22:40:55.238 INFO:tasks.workunit.client.0.smithi033.stdout:7/659: chown d5/df/f44 1578 1 2024-02-15T22:40:55.239 INFO:tasks.workunit.client.0.smithi033.stdout:2/735: dread d1/d8/d2b/d2f/d13/f17 [0,4194304] 0 2024-02-15T22:40:55.239 INFO:tasks.workunit.client.0.smithi033.stdout:2/736: creat d1/d8/d2b/d2f/d38/d9a/fe9 x:0 0 0 2024-02-15T22:40:55.239 INFO:tasks.workunit.client.0.smithi033.stdout:2/737: creat d1/d16/d5a/fea x:0 0 0 2024-02-15T22:40:55.240 INFO:tasks.workunit.client.0.smithi033.stdout:3/630: write d0/d3/f41 [30544,10943] 0 2024-02-15T22:40:55.241 INFO:tasks.workunit.client.0.smithi033.stdout:4/708: rename d8/d16/d51/d1c/d96/f81 to d8/d16/d51/d1c/db9/d37/d23/d61/ff2 0 2024-02-15T22:40:55.241 INFO:tasks.workunit.client.0.smithi033.stdout:4/709: stat f7 0 2024-02-15T22:40:55.241 INFO:tasks.workunit.client.0.smithi033.stdout:4/710: dread - d8/d16/d51/d1c/d50/da1/dc1/fc3 zero size 2024-02-15T22:40:55.241 INFO:tasks.workunit.client.0.smithi033.stdout:1/628: creat d1/d20/d42/d25/d67/fb6 x:0 0 0 2024-02-15T22:40:55.242 INFO:tasks.workunit.client.0.smithi033.stdout:8/676: symlink d1/d68/d1d/d4a/d4c/le8 0 2024-02-15T22:40:55.242 INFO:tasks.workunit.client.0.smithi033.stdout:8/677: fsync d1/de/d1a/d27/d70/fa2 0 2024-02-15T22:40:55.243 INFO:tasks.workunit.client.0.smithi033.stdout:7/660: mkdir d5/df/d56/d99/dde 0 2024-02-15T22:40:55.246 INFO:tasks.workunit.client.0.smithi033.stdout:2/738: symlink d1/d8/d2b/d2f/d24/d69/leb 0 2024-02-15T22:40:55.247 INFO:tasks.workunit.client.0.smithi033.stdout:3/631: symlink d0/d3/dd/lce 0 2024-02-15T22:40:55.249 INFO:tasks.workunit.client.0.smithi033.stdout:4/711: mkdir d8/d16/d51/d1c/db9/d37/d23/d61/df3 0 2024-02-15T22:40:55.249 INFO:tasks.workunit.client.0.smithi033.stdout:4/712: fdatasync d8/d16/d97/dbf/fdf 0 2024-02-15T22:40:55.249 INFO:tasks.workunit.client.0.smithi033.stdout:4/713: fdatasync d8/d16/d51/d1c/db9/d37/d31/d47/fe6 0 2024-02-15T22:40:55.249 INFO:tasks.workunit.client.0.smithi033.stdout:1/629: mknod d1/de/d27/d28/d2d/cb7 0 2024-02-15T22:40:55.250 INFO:tasks.workunit.client.0.smithi033.stdout:8/678: symlink d1/dae/le9 0 2024-02-15T22:40:55.252 INFO:tasks.workunit.client.0.smithi033.stdout:7/661: link d5/df/d56/l3b d5/dc/d5f/d8b/da1/d26/d3f/ldf 0 2024-02-15T22:40:55.254 INFO:tasks.workunit.client.0.smithi033.stdout:2/739: mkdir d1/d8/d2b/d2f/d13/da9/d8d/dec 0 2024-02-15T22:40:55.255 INFO:tasks.workunit.client.0.smithi033.stdout:4/714: truncate d8/d16/d51/f86 1202389 0 2024-02-15T22:40:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.254+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a18000bf0 con 0x7f4a1406b2e0 2024-02-15T22:40:55.256 INFO:tasks.workunit.client.0.smithi033.stdout:1/630: creat d1/de/d27/d39/d3a/dae/fb8 x:0 0 0 2024-02-15T22:40:55.257 INFO:tasks.workunit.client.0.smithi033.stdout:7/662: creat d5/dc/d5f/d8b/da1/d98/d7b/db1/fe0 x:0 0 0 2024-02-15T22:40:55.257 INFO:tasks.workunit.client.0.smithi033.stdout:7/663: chown d5/df/d56/d60/dbd 1800 1 2024-02-15T22:40:55.258 INFO:tasks.workunit.client.0.smithi033.stdout:2/740: mkdir d1/d8/d2b/d2f/d13/d59/dc8/ded 0 2024-02-15T22:40:55.261 INFO:tasks.workunit.client.0.smithi033.stdout:4/715: symlink d8/d16/d51/d1c/db9/d37/d31/da5/da9/lf4 0 2024-02-15T22:40:55.261 INFO:tasks.workunit.client.0.smithi033.stdout:4/716: write d8/d16/d51/d1c/db9/f25 [1485177,32155] 0 2024-02-15T22:40:55.261 INFO:tasks.workunit.client.0.smithi033.stdout:4/717: readlink l0 0 2024-02-15T22:40:55.261 INFO:tasks.workunit.client.0.smithi033.stdout:4/718: truncate d8/d16/d51/fc8 907062 0 2024-02-15T22:40:55.261 INFO:tasks.workunit.client.0.smithi033.stdout:8/679: dread d1/de/d1a/f69 [0,4194304] 0 2024-02-15T22:40:55.261 INFO:tasks.workunit.client.0.smithi033.stdout:8/680: write d1/de/d1a/d2a/f30 [2483364,116133] 0 2024-02-15T22:40:55.261 INFO:tasks.workunit.client.0.smithi033.stdout:8/681: fsync d1/de/d1a/d27/d70/fa2 0 2024-02-15T22:40:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.259+0000 7f4a28ff9700 1 -- 172.21.15.33:0/1488550794 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4a18000bf0 con 0x7f4a1406b2e0 2024-02-15T22:40:55.262 INFO:tasks.workunit.client.0.smithi033.stdout:7/664: mkdir d5/dc/d5f/d8b/de1 0 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f4a1406b2e0 msgr2=0x7f4a1406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f4a1406b2e0 0x7f4a1406d790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a20006fd0 tx=0x7f4a20008040 comp rx=0 tx=0).stop 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 msgr2=0x7f4a2c10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c10fd30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009150 tx=0x7f4a1c009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 shutdown_connections 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f4a1406b2e0 0x7f4a1406d790 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2c0fb220 0x7f4a2c10fd30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 --2- 172.21.15.33:0/1488550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a2c0fe2b0 0x7f4a2c110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 >> 172.21.15.33:0/1488550794 conn(0x7f4a2c0f6ca0 msgr2=0x7f4a2c0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 shutdown_connections 2024-02-15T22:40:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.262+0000 7f4a32785700 1 -- 172.21.15.33:0/1488550794 wait complete. 2024-02-15T22:40:55.265 INFO:tasks.workunit.client.0.smithi033.stdout:4/719: symlink d8/d69/lf5 0 2024-02-15T22:40:55.266 INFO:tasks.workunit.client.0.smithi033.stdout:8/682: creat d1/d68/d44/dd3/fea x:0 0 0 2024-02-15T22:40:55.266 INFO:tasks.workunit.client.0.smithi033.stdout:1/631: dread d1/de/d27/d28/d37/f66 [0,4194304] 0 2024-02-15T22:40:55.266 INFO:tasks.workunit.client.0.smithi033.stdout:1/632: fdatasync d1/de/d27/d39/d3a/f51 0 2024-02-15T22:40:55.268 INFO:tasks.workunit.client.0.smithi033.stdout:2/741: dread d1/d8/fe [0,4194304] 0 2024-02-15T22:40:55.268 INFO:tasks.workunit.client.0.smithi033.stdout:4/720: link d8/d16/d51/d1c/d50/fe1 d8/d16/d51/d77/ff6 0 2024-02-15T22:40:55.268 INFO:tasks.workunit.client.0.smithi033.stdout:4/721: chown d8/d16/d51/d1c/db9/f68 0 1 2024-02-15T22:40:55.270 INFO:tasks.workunit.client.0.smithi033.stdout:8/683: link d1/d74/dc1/d75/dbf/d79/c78 d1/d74/dc1/d75/d83/ceb 0 2024-02-15T22:40:55.270 INFO:tasks.workunit.client.0.smithi033.stdout:8/684: fsync d1/de/d1a/d27/d60/fab 0 2024-02-15T22:40:55.271 INFO:tasks.workunit.client.0.smithi033.stdout:2/742: write d1/d8/d2b/d2f/d13/fc7 [477623,6380] 0 2024-02-15T22:40:55.271 INFO:tasks.workunit.client.0.smithi033.stdout:3/632: dwrite d0/d3/dd/f7e [0,4194304] 0 2024-02-15T22:40:55.272 INFO:tasks.workunit.client.0.smithi033.stdout:2/743: dread d1/d8/d2b/d2f/d38/db0/fa8 [0,4194304] 0 2024-02-15T22:40:55.272 INFO:tasks.workunit.client.0.smithi033.stdout:1/633: symlink d1/d20/d42/d2c/d7b/lb9 0 2024-02-15T22:40:55.273 INFO:tasks.workunit.client.0.smithi033.stdout:7/665: getdents d5/dc 0 2024-02-15T22:40:55.274 INFO:tasks.workunit.client.0.smithi033.stdout:8/685: creat d1/dae/dcf/fec x:0 0 0 2024-02-15T22:40:55.275 INFO:tasks.workunit.client.0.smithi033.stdout:8/686: write d1/d6/d14/fa4 [434374,56427] 0 2024-02-15T22:40:55.277 INFO:tasks.workunit.client.0.smithi033.stdout:2/744: mknod d1/d8/d2b/d2f/d38/db0/de8/cee 0 2024-02-15T22:40:55.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/634: mknod d1/de/d27/cba 0 2024-02-15T22:40:55.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/635: getdents d1/de/d27/d28/d2d/d5e/d69 0 2024-02-15T22:40:55.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/636: fsync d1/de/d27/d28/d2d/d36/f54 0 2024-02-15T22:40:55.279 INFO:tasks.workunit.client.0.smithi033.stdout:7/666: creat d5/df/d40/d73/dd2/fe2 x:0 0 0 2024-02-15T22:40:55.279 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:40:55.280 INFO:tasks.workunit.client.0.smithi033.stdout:3/633: dread d0/d3/f44 [0,4194304] 0 2024-02-15T22:40:55.282 INFO:tasks.workunit.client.0.smithi033.stdout:8/687: symlink d1/de/d1a/d27/d70/led 0 2024-02-15T22:40:55.285 INFO:tasks.workunit.client.0.smithi033.stdout:2/745: creat d1/d8/d2b/d2f/d13/da9/fef x:0 0 0 2024-02-15T22:40:55.285 INFO:tasks.workunit.client.0.smithi033.stdout:2/746: fdatasync d1/d66/fdf 0 2024-02-15T22:40:55.286 INFO:tasks.workunit.client.0.smithi033.stdout:1/637: dread d1/d20/d42/d2c/d4e/f97 [0,4194304] 0 2024-02-15T22:40:55.288 INFO:tasks.workunit.client.0.smithi033.stdout:3/634: mkdir d0/d3/d2c/d5d/d3d/d8f/dcf 0 2024-02-15T22:40:55.289 INFO:tasks.workunit.client.0.smithi033.stdout:1/638: dread d1/d20/d42/d25/f6f [0,4194304] 0 2024-02-15T22:40:55.289 INFO:tasks.workunit.client.0.smithi033.stdout:1/639: creat d1/de/d27/d39/d3a/dae/fbb x:0 0 0 2024-02-15T22:40:55.291 INFO:tasks.workunit.client.0.smithi033.stdout:8/688: write d1/d6/d14/d5d/fc0 [2972883,50614] 0 2024-02-15T22:40:55.292 INFO:tasks.workunit.client.0.smithi033.stdout:2/747: truncate d1/d8/d2b/d2f/d24/d69/f7c 915547 0 2024-02-15T22:40:55.293 INFO:tasks.workunit.client.0.smithi033.stdout:3/635: mknod d0/d3/d2c/d5d/d3d/cd0 0 2024-02-15T22:40:55.296 INFO:tasks.workunit.client.0.smithi033.stdout:1/640: symlink d1/lbc 0 2024-02-15T22:40:55.297 INFO:tasks.workunit.client.0.smithi033.stdout:1/641: write d1/de/d27/d39/d3a/da3/f70 [900344,79729] 0 2024-02-15T22:40:55.299 INFO:tasks.workunit.client.0.smithi033.stdout:8/689: link d1/cdb d1/d6/d14/d5d/cee 0 2024-02-15T22:40:55.300 INFO:tasks.workunit.client.0.smithi033.stdout:2/748: truncate d1/d8/d2b/d2f/d24/d31/f81 5263029 0 2024-02-15T22:40:55.301 INFO:tasks.workunit.client.0.smithi033.stdout:3/636: symlink d0/d3/dd/ld1 0 2024-02-15T22:40:55.303 INFO:tasks.workunit.client.0.smithi033.stdout:1/642: rename d1/d20/d8a/d92/c98 to d1/de/d27/d28/d2d/d36/cbd 0 2024-02-15T22:40:55.304 INFO:tasks.workunit.client.0.smithi033.stdout:1/643: stat d1/de/d27/l47 0 2024-02-15T22:40:55.304 INFO:tasks.workunit.client.0.smithi033.stdout:8/690: mknod d1/d74/dc1/d75/dbf/d79/d94/dd1/cef 0 2024-02-15T22:40:55.306 INFO:tasks.workunit.client.0.smithi033.stdout:2/749: mknod d1/d8/d2b/d2f/d13/cf0 0 2024-02-15T22:40:55.308 INFO:tasks.workunit.client.0.smithi033.stdout:3/637: creat d0/d3/d2c/d5d/fd2 x:0 0 0 2024-02-15T22:40:55.311 INFO:tasks.workunit.client.0.smithi033.stdout:8/691: symlink d1/lf0 0 2024-02-15T22:40:55.311 INFO:tasks.workunit.client.0.smithi033.stdout:8/692: stat d1/de/d5c/f7e 0 2024-02-15T22:40:55.311 INFO:tasks.workunit.client.0.smithi033.stdout:8/693: creat d1/de/d1a/d2a/ff1 x:0 0 0 2024-02-15T22:40:55.312 INFO:tasks.workunit.client.0.smithi033.stdout:1/644: dread d1/de/f1f [4194304,4194304] 0 2024-02-15T22:40:55.312 INFO:tasks.workunit.client.0.smithi033.stdout:2/750: creat d1/d8/d2b/d2f/d24/d31/de6/ff1 x:0 0 0 2024-02-15T22:40:55.317 INFO:tasks.workunit.client.0.smithi033.stdout:3/638: rmdir d0/d3/d92 0 2024-02-15T22:40:55.320 INFO:tasks.workunit.client.0.smithi033.stdout:8/694: mkdir d1/d68/d57/df2 0 2024-02-15T22:40:55.320 INFO:tasks.workunit.client.0.smithi033.stdout:1/645: write d1/de/f81 [8370857,42101] 0 2024-02-15T22:40:55.321 INFO:tasks.workunit.client.0.smithi033.stdout:1/646: chown d1/de/d27/d39/d3a/da3/laf 93 1 2024-02-15T22:40:55.322 INFO:tasks.workunit.client.0.smithi033.stdout:2/751: rename d1/d8/d2b/d2f/d24/d31/de6/ce7 to d1/d8/d2b/d2f/d38/d62/db7/cf2 0 2024-02-15T22:40:55.323 INFO:tasks.workunit.client.0.smithi033.stdout:3/639: creat d0/d3/d3b/fd3 x:0 0 0 2024-02-15T22:40:55.326 INFO:tasks.workunit.client.0.smithi033.stdout:3/640: dread d0/d3/d2c/d43/f75 [0,4194304] 0 2024-02-15T22:40:55.326 INFO:tasks.workunit.client.0.smithi033.stdout:3/641: write d0/d3/d2c/d5d/d3d/d8f/f9c [993038,120307] 0 2024-02-15T22:40:55.327 INFO:tasks.workunit.client.0.smithi033.stdout:1/647: mkdir d1/de/d27/d39/d3a/dbe 0 2024-02-15T22:40:55.332 INFO:tasks.workunit.client.0.smithi033.stdout:1/648: rmdir d1/d20/d42/d25 39 2024-02-15T22:40:55.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/752: rename d1/d8/d2b/d2f/d38 to d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3 0 2024-02-15T22:40:55.339 INFO:tasks.workunit.client.0.smithi033.stdout:1/649: write d1/de/f38 [1089538,119623] 0 2024-02-15T22:40:55.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/650: rename d1/d20/d42/d2c/f91 to d1/d20/d42/fbf 0 2024-02-15T22:40:55.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/651: chown d1/d20/d42/l93 5765599 1 2024-02-15T22:40:55.343 INFO:tasks.workunit.client.0.smithi033.stdout:3/642: dwrite d0/d3/dd/f99 [0,4194304] 0 2024-02-15T22:40:55.348 INFO:tasks.workunit.client.0.smithi033.stdout:1/652: write d1/d20/d8a/d8f/fa2 [148721,83761] 0 2024-02-15T22:40:55.352 INFO:tasks.workunit.client.0.smithi033.stdout:1/653: creat d1/de/d27/d28/d37/fc0 x:0 0 0 2024-02-15T22:40:55.368 INFO:tasks.workunit.client.0.smithi033.stdout:8/695: dwrite d1/de/d1a/d9d/fda [0,4194304] 0 2024-02-15T22:40:55.371 INFO:tasks.workunit.client.0.smithi033.stdout:2/753: dwrite d1/d16/d5a/f7b [0,4194304] 0 2024-02-15T22:40:55.371 INFO:tasks.workunit.client.0.smithi033.stdout:3/643: dwrite d0/d3/d2c/d5d/d3d/d57/fbc [0,4194304] 0 2024-02-15T22:40:55.371 INFO:tasks.workunit.client.0.smithi033.stdout:3/644: fsync d0/d1c/f25 0 2024-02-15T22:40:55.372 INFO:tasks.workunit.client.0.smithi033.stdout:3/645: dread - d0/d1c/fbd zero size 2024-02-15T22:40:55.373 INFO:tasks.workunit.client.0.smithi033.stdout:8/696: symlink d1/d68/d57/lf3 0 2024-02-15T22:40:55.373 INFO:tasks.workunit.client.0.smithi033.stdout:8/697: stat d1/d6/d14 0 2024-02-15T22:40:55.376 INFO:tasks.workunit.client.0.smithi033.stdout:3/646: creat d0/d91/fd4 x:0 0 0 2024-02-15T22:40:55.377 INFO:tasks.workunit.client.0.smithi033.stdout:1/654: dwrite d1/d20/fa1 [0,4194304] 0 2024-02-15T22:40:55.378 INFO:tasks.workunit.client.0.smithi033.stdout:1/655: write d1/d20/f65 [1941055,115086] 0 2024-02-15T22:40:55.379 INFO:tasks.workunit.client.0.smithi033.stdout:1/656: readlink d1/ld 0 2024-02-15T22:40:55.391 INFO:tasks.workunit.client.0.smithi033.stdout:1/657: dread d1/de/d27/d28/d2d/f76 [4194304,4194304] 0 2024-02-15T22:40:55.395 INFO:tasks.workunit.client.0.smithi033.stdout:2/754: dwrite d1/d8/d2b/d2f/d13/fc7 [0,4194304] 0 2024-02-15T22:40:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 -- 172.21.15.33:0/743008066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fc180 msgr2=0x7fbe200fc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 --2- 172.21.15.33:0/743008066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fc180 0x7fbe200fc5f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbe14004940 tx=0x7fbe14009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 -- 172.21.15.33:0/743008066 shutdown_connections 2024-02-15T22:40:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 --2- 172.21.15.33:0/743008066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fc180 0x7fbe200fc5f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 --2- 172.21.15.33:0/743008066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe200fd470 0x7fbe200fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 -- 172.21.15.33:0/743008066 >> 172.21.15.33:0/743008066 conn(0x7fbe200f6ca0 msgr2=0x7fbe200f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 -- 172.21.15.33:0/743008066 shutdown_connections 2024-02-15T22:40:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.398+0000 7fbe250fb700 1 -- 172.21.15.33:0/743008066 wait complete. 2024-02-15T22:40:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe250fb700 1 Processor -- start 2024-02-15T22:40:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe250fb700 1 -- start start 2024-02-15T22:40:55.401 INFO:tasks.workunit.client.0.smithi033.stdout:1/658: write d1/de/d27/d39/d3a/f51 [4774298,4712] 0 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe250fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe200fc180 0x7fbe2010d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe250fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fd470 0x7fbe2010de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe250fb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2010e490 con 0x7fbe200fd470 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe250fb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2010ed30 con 0x7fbe200fc180 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe1e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fd470 0x7fbe2010de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe1e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fd470 0x7fbe2010de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40548/0 (socket says 172.21.15.33:40548) 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe1ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe200fc180 0x7fbe2010d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.399+0000 7fbe1e59c700 1 -- 172.21.15.33:0/158944923 learned_addr learned my addr 172.21.15.33:0/158944923 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe1e59c700 1 -- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe200fc180 msgr2=0x7fbe2010d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe1e59c700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe200fc180 0x7fbe2010d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe1e59c700 1 -- 172.21.15.33:0/158944923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe10005040 con 0x7fbe200fd470 2024-02-15T22:40:55.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe1e59c700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fd470 0x7fbe2010de90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbe14013420 tx=0x7fbe14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:55.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe077fe700 1 -- 172.21.15.33:0/158944923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe14021070 con 0x7fbe200fd470 2024-02-15T22:40:55.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe077fe700 1 -- 172.21.15.33:0/158944923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe14013de0 con 0x7fbe200fd470 2024-02-15T22:40:55.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14005040 con 0x7fbe200fd470 2024-02-15T22:40:55.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.400+0000 7fbe077fe700 1 -- 172.21.15.33:0/158944923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe1400e070 con 0x7fbe200fd470 2024-02-15T22:40:55.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.401+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2010f300 con 0x7fbe200fd470 2024-02-15T22:40:55.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.402+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2004bed0 con 0x7fbe200fd470 2024-02-15T22:40:55.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.402+0000 7fbe077fe700 1 -- 172.21.15.33:0/158944923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7fbe14026410 con 0x7fbe200fd470 2024-02-15T22:40:55.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.403+0000 7fbe077fe700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fbe0806b2e0 0x7fbe0806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:55.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.403+0000 7fbe077fe700 1 -- 172.21.15.33:0/158944923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fbe1408aef0 con 0x7fbe200fd470 2024-02-15T22:40:55.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/647: dwrite d0/d3/d3b/f89 [0,4194304] 0 2024-02-15T22:40:55.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.403+0000 7fbe1ed9d700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fbe0806b2e0 0x7fbe0806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:55.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.404+0000 7fbe1ed9d700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fbe0806b2e0 0x7fbe0806d790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbe20065400 tx=0x7fbe1000b040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:55.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.409+0000 7fbe077fe700 1 -- 172.21.15.33:0/158944923 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fbe14058c00 con 0x7fbe200fd470 2024-02-15T22:40:55.411 INFO:tasks.workunit.client.0.smithi033.stdout:3/648: read d0/d3/d2c/f5c [127099,82663] 0 2024-02-15T22:40:55.411 INFO:tasks.workunit.client.0.smithi033.stdout:3/649: dread - d0/d3/d2c/d5d/d3d/d57/f6f zero size 2024-02-15T22:40:55.414 INFO:tasks.workunit.client.0.smithi033.stdout:2/755: dread d1/d8/d2b/d2f/d3d/faf [4194304,4194304] 0 2024-02-15T22:40:55.414 INFO:tasks.workunit.client.0.smithi033.stdout:2/756: dread d1/d16/d5a/f91 [0,4194304] 0 2024-02-15T22:40:55.415 INFO:tasks.workunit.client.0.smithi033.stdout:2/757: readlink l0 0 2024-02-15T22:40:55.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/650: dread d0/d3/d2c/d5d/d3d/d57/f6e [0,4194304] 0 2024-02-15T22:40:55.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/758: dread d1/d8/d2b/d2f/d13/f3b [0,4194304] 0 2024-02-15T22:40:55.420 INFO:tasks.workunit.client.0.smithi033.stdout:3/651: creat d0/d3/d2c/d5d/d3d/d57/d68/fd5 x:0 0 0 2024-02-15T22:40:55.420 INFO:tasks.workunit.client.0.smithi033.stdout:3/652: readlink d0/d3/d77/l95 0 2024-02-15T22:40:55.420 INFO:tasks.workunit.client.0.smithi033.stdout:3/653: write d0/d3/d2c/d5d/d3d/d8f/fb9 [1692601,67774] 0 2024-02-15T22:40:55.420 INFO:tasks.workunit.client.0.smithi033.stdout:3/654: write d0/d1c/f25 [11497,40318] 0 2024-02-15T22:40:55.420 INFO:tasks.workunit.client.0.smithi033.stdout:3/655: write d0/d91/fd4 [117133,12783] 0 2024-02-15T22:40:55.420 INFO:tasks.workunit.client.0.smithi033.stdout:3/656: creat d0/d3/d2c/d5d/fd6 x:0 0 0 2024-02-15T22:40:55.427 INFO:tasks.workunit.client.0.smithi033.stdout:1/659: dwrite d1/d20/fa1 [0,4194304] 0 2024-02-15T22:40:55.430 INFO:tasks.workunit.client.0.smithi033.stdout:2/759: read d1/d16/d57/fcd [456793,11098] 0 2024-02-15T22:40:55.434 INFO:tasks.workunit.client.0.smithi033.stdout:1/660: write d1/de/d27/d28/f2a [238691,66922] 0 2024-02-15T22:40:55.454 INFO:tasks.workunit.client.0.smithi033.stdout:3/657: mkdir d0/d3/d2c/d5d/d3d/d8f/dd7 0 2024-02-15T22:40:55.455 INFO:tasks.workunit.client.0.smithi033.stdout:1/661: truncate d1/de/d27/d28/d2d/d5e/f61 9993490 0 2024-02-15T22:40:55.456 INFO:tasks.workunit.client.0.smithi033.stdout:1/662: fdatasync d1/d20/d42/f49 0 2024-02-15T22:40:55.456 INFO:tasks.workunit.client.0.smithi033.stdout:2/760: dwrite d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/fa8 [0,4194304] 0 2024-02-15T22:40:55.457 INFO:tasks.workunit.client.0.smithi033.stdout:3/658: mkdir d0/d3/d3b/db1/dd8 0 2024-02-15T22:40:55.458 INFO:tasks.workunit.client.0.smithi033.stdout:1/663: truncate d1/f7 1106146 0 2024-02-15T22:40:55.458 INFO:tasks.workunit.client.0.smithi033.stdout:1/664: chown d1/de/d27/l47 27610893 1 2024-02-15T22:40:55.458 INFO:tasks.workunit.client.0.smithi033.stdout:1/665: fdatasync d1/d57/f99 0 2024-02-15T22:40:55.463 INFO:tasks.workunit.client.0.smithi033.stdout:3/659: symlink d0/d3/d3b/db1/ld9 0 2024-02-15T22:40:55.464 INFO:tasks.workunit.client.0.smithi033.stdout:3/660: write d0/d3/dd/f76 [235258,35938] 0 2024-02-15T22:40:55.465 INFO:tasks.workunit.client.0.smithi033.stdout:3/661: dread - d0/d3/d3b/db1/fa0 zero size 2024-02-15T22:40:55.465 INFO:tasks.workunit.client.0.smithi033.stdout:3/662: write d0/d3/d2c/d5d/d3d/db6/fc8 [1008803,38645] 0 2024-02-15T22:40:55.465 INFO:tasks.workunit.client.0.smithi033.stdout:3/663: write d0/d3/dd/f99 [4806864,91701] 0 2024-02-15T22:40:55.469 INFO:tasks.workunit.client.0.smithi033.stdout:1/666: creat d1/d20/d42/d2c/d7b/fc1 x:0 0 0 2024-02-15T22:40:55.469 INFO:tasks.workunit.client.0.smithi033.stdout:1/667: write d1/de/f38 [1488866,117420] 0 2024-02-15T22:40:55.470 INFO:tasks.workunit.client.0.smithi033.stdout:2/761: getdents d1/d8/d2b/d2f/d24/d31/de6 0 2024-02-15T22:40:55.473 INFO:tasks.workunit.client.0.smithi033.stdout:3/664: symlink d0/d3/d2c/d5d/d3d/d57/d68/dc2/lda 0 2024-02-15T22:40:55.476 INFO:tasks.workunit.client.0.smithi033.stdout:3/665: mkdir d0/d3/d77/ddb 0 2024-02-15T22:40:55.477 INFO:tasks.workunit.client.0.smithi033.stdout:2/762: rmdir d1/d8/d2b/d2f/d13/d59/d76 39 2024-02-15T22:40:55.477 INFO:tasks.workunit.client.0.smithi033.stdout:2/763: stat d1/d8/d2b/d2f/d12/dae 0 2024-02-15T22:40:55.477 INFO:tasks.workunit.client.0.smithi033.stdout:2/764: stat d1/d8/d2b/d2f/d13/fc7 0 2024-02-15T22:40:55.477 INFO:tasks.workunit.client.0.smithi033.stdout:2/765: read - d1/d8/fce zero size 2024-02-15T22:40:55.478 INFO:tasks.workunit.client.0.smithi033.stdout:2/766: fdatasync d1/d8/d2b/d2f/d24/d2a/d88/d8e/fe5 0 2024-02-15T22:40:55.478 INFO:tasks.workunit.client.0.smithi033.stdout:2/767: write d1/d8/d2b/d2f/d12/dae/fdd [746415,89915] 0 2024-02-15T22:40:55.478 INFO:tasks.workunit.client.0.smithi033.stdout:3/666: dread d0/d3/d2c/d5d/d3d/d8f/f9c [0,4194304] 0 2024-02-15T22:40:55.478 INFO:tasks.workunit.client.0.smithi033.stdout:3/667: chown d0/d3/d2c/d5d/d3d/cd0 0 1 2024-02-15T22:40:55.478 INFO:tasks.workunit.client.0.smithi033.stdout:3/668: chown d0/d3/d2c/d5d/d3d 220399 1 2024-02-15T22:40:55.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/768: unlink d1/d8/d2b/d2f/d24/d2a/d88/d8e/cd0 0 2024-02-15T22:40:55.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/769: readlink d1/d8/d2b/d2f/d24/d5d/lc1 0 2024-02-15T22:40:55.480 INFO:tasks.workunit.client.0.smithi033.stdout:3/669: mkdir d0/d3/d2c/d5d/d3d/db6/ddc 0 2024-02-15T22:40:55.480 INFO:tasks.workunit.client.0.smithi033.stdout:3/670: write d0/fe [4471896,113000] 0 2024-02-15T22:40:55.480 INFO:tasks.workunit.client.0.smithi033.stdout:3/671: creat d0/d3/d5f/fdd x:0 0 0 2024-02-15T22:40:55.480 INFO:tasks.workunit.client.0.smithi033.stdout:3/672: readlink d0/d3/d2c/d5d/d3d/la6 0 2024-02-15T22:40:55.487 INFO:tasks.workunit.client.0.smithi033.stdout:2/770: dread d1/f7 [0,4194304] 0 2024-02-15T22:40:55.488 INFO:tasks.workunit.client.0.smithi033.stdout:2/771: rename d1/d8/d2b/d2f/d13/c32 to d1/d16/d57/cf4 0 2024-02-15T22:40:55.488 INFO:tasks.workunit.client.0.smithi033.stdout:2/772: write d1/d8/d2b/d2f/d24/d5d/fde [83550,14308] 0 2024-02-15T22:40:55.495 INFO:tasks.workunit.client.0.smithi033.stdout:3/673: dwrite d0/d3/d2c/d5d/d3d/d57/f6e [0,4194304] 0 2024-02-15T22:40:55.495 INFO:tasks.workunit.client.0.smithi033.stdout:3/674: dread - d0/d3/d2c/d5d/d3d/fcd zero size 2024-02-15T22:40:55.495 INFO:tasks.workunit.client.0.smithi033.stdout:3/675: write d0/d3/f41 [974232,90542] 0 2024-02-15T22:40:55.496 INFO:tasks.workunit.client.0.smithi033.stdout:3/676: symlink d0/d3/d65/d97/lde 0 2024-02-15T22:40:55.496 INFO:tasks.workunit.client.0.smithi033.stdout:3/677: creat d0/d3/d2c/d5d/d3d/d57/d68/dac/fdf x:0 0 0 2024-02-15T22:40:55.498 INFO:tasks.workunit.client.0.smithi033.stdout:3/678: mknod d0/d3/d2c/d5d/d3d/d57/ce0 0 2024-02-15T22:40:55.498 INFO:tasks.workunit.client.0.smithi033.stdout:3/679: fdatasync d0/d3/d2c/d5d/d3d/db6/fc8 0 2024-02-15T22:40:55.498 INFO:tasks.workunit.client.0.smithi033.stdout:3/680: readlink d0/d3/d3b/d47/l8a 0 2024-02-15T22:40:55.498 INFO:tasks.workunit.client.0.smithi033.stdout:3/681: getdents d0/d3/dd 0 2024-02-15T22:40:55.500 INFO:tasks.workunit.client.0.smithi033.stdout:3/682: rename d0/d3/d2c/d5d/d3d/db4/lc4 to d0/d3/d2c/d5d/d3d/db6/le1 0 2024-02-15T22:40:55.501 INFO:tasks.workunit.client.0.smithi033.stdout:3/683: dread d0/d1c/f59 [0,4194304] 0 2024-02-15T22:40:55.501 INFO:tasks.workunit.client.0.smithi033.stdout:3/684: stat d0/d3/d5f/fdd 0 2024-02-15T22:40:55.502 INFO:tasks.workunit.client.0.smithi033.stdout:3/685: mknod d0/d3/d2c/d5d/d3d/d57/d68/ce2 0 2024-02-15T22:40:55.502 INFO:tasks.workunit.client.0.smithi033.stdout:3/686: chown d0/d3/d3b/d47/cbe 0 1 2024-02-15T22:40:55.502 INFO:tasks.workunit.client.0.smithi033.stdout:3/687: rename d0/d3/dd/ld1 to d0/d1c/le3 0 2024-02-15T22:40:55.505 INFO:tasks.workunit.client.0.smithi033.stdout:3/688: dread d0/d3/d2c/d5d/d3d/f48 [0,4194304] 0 2024-02-15T22:40:55.505 INFO:tasks.workunit.client.0.smithi033.stdout:3/689: creat d0/d3/d65/d97/fe4 x:0 0 0 2024-02-15T22:40:55.505 INFO:tasks.workunit.client.0.smithi033.stdout:3/690: readlink d0/d3/d65/d97/lde 0 2024-02-15T22:40:55.505 INFO:tasks.workunit.client.0.smithi033.stdout:3/691: truncate d0/d3/d3b/fd3 912130 0 2024-02-15T22:40:55.505 INFO:tasks.workunit.client.0.smithi033.stdout:2/773: dwrite d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f6e [0,4194304] 0 2024-02-15T22:40:55.510 INFO:tasks.workunit.client.0.smithi033.stdout:2/774: mkdir d1/d16/d3f/df5 0 2024-02-15T22:40:55.518 INFO:tasks.workunit.client.0.smithi033.stdout:3/692: rmdir d0/d3/d2c/d5d/d3d/d8f/d93 39 2024-02-15T22:40:55.519 INFO:tasks.workunit.client.0.smithi033.stdout:2/775: symlink d1/d8/d2b/d2f/d12/lf6 0 2024-02-15T22:40:55.521 INFO:tasks.workunit.client.0.smithi033.stdout:2/776: mknod d1/d16/d57/cf7 0 2024-02-15T22:40:55.521 INFO:tasks.workunit.client.0.smithi033.stdout:2/777: write d1/d8/d2b/d2f/d13/f3b [534,63402] 0 2024-02-15T22:40:55.527 INFO:tasks.workunit.client.0.smithi033.stdout:3/693: rmdir d0/d3/d2c/d5d 39 2024-02-15T22:40:55.527 INFO:tasks.workunit.client.0.smithi033.stdout:3/694: write d0/d3/dd/f76 [459200,78530] 0 2024-02-15T22:40:55.529 INFO:tasks.workunit.client.0.smithi033.stdout:2/778: creat d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d9a/ff8 x:0 0 0 2024-02-15T22:40:55.531 INFO:tasks.workunit.client.0.smithi033.stdout:2/779: symlink d1/d8/d2b/d2f/d24/d31/de6/lf9 0 2024-02-15T22:40:55.531 INFO:tasks.workunit.client.0.smithi033.stdout:2/780: readlink d1/d8/d2b/le1 0 2024-02-15T22:40:55.532 INFO:tasks.workunit.client.0.smithi033.stdout:2/781: creat d1/d66/d75/ffa x:0 0 0 2024-02-15T22:40:55.534 INFO:tasks.workunit.client.0.smithi033.stdout:2/782: mkdir d1/d16/d3f/df5/dfb 0 2024-02-15T22:40:55.534 INFO:tasks.workunit.client.0.smithi033.stdout:2/783: fsync d1/d8/d2b/d2f/d24/d31/de6/ff1 0 2024-02-15T22:40:55.534 INFO:tasks.workunit.client.0.smithi033.stdout:2/784: write d1/d8/d2b/d2f/d12/fa0 [648623,116115] 0 2024-02-15T22:40:55.534 INFO:tasks.workunit.client.0.smithi033.stdout:2/785: creat d1/d8/d2b/d2f/d13/d6f/db5/ffc x:0 0 0 2024-02-15T22:40:55.534 INFO:tasks.workunit.client.0.smithi033.stdout:2/786: readlink d1/d16/d3f/lad 0 2024-02-15T22:40:55.543 INFO:tasks.workunit.client.0.smithi033.stdout:2/787: dread d1/d8/d2b/d2f/f1e [0,4194304] 0 2024-02-15T22:40:55.543 INFO:tasks.workunit.client.0.smithi033.stdout:2/788: fsync d1/d8/d2b/d2f/d24/d31/d79/fe0 0 2024-02-15T22:40:55.547 INFO:tasks.workunit.client.0.smithi033.stdout:3/695: dwrite d0/d3/d2c/f9e [0,4194304] 0 2024-02-15T22:40:55.548 INFO:tasks.workunit.client.0.smithi033.stdout:3/696: symlink d0/d3/d2c/d5d/d3d/le5 0 2024-02-15T22:40:55.548 INFO:tasks.workunit.client.0.smithi033.stdout:3/697: write d0/d3/d2c/d5d/d3d/d57/fbc [5189784,88901] 0 2024-02-15T22:40:55.552 INFO:tasks.workunit.client.0.smithi033.stdout:2/789: dread d1/d16/d5a/f97 [0,4194304] 0 2024-02-15T22:40:55.558 INFO:tasks.workunit.client.0.smithi033.stdout:9/563: sync 2024-02-15T22:40:55.559 INFO:tasks.workunit.client.0.smithi033.stdout:6/501: sync 2024-02-15T22:40:55.560 INFO:tasks.workunit.client.0.smithi033.stdout:9/564: mkdir d4/d1d/d23/d32/da7 0 2024-02-15T22:40:55.560 INFO:tasks.workunit.client.0.smithi033.stdout:9/565: chown d4/d1d/d23/c46 0 1 2024-02-15T22:40:55.560 INFO:tasks.workunit.client.0.smithi033.stdout:9/566: write d4/f9 [2333002,24019] 0 2024-02-15T22:40:55.562 INFO:tasks.workunit.client.0.smithi033.stdout:6/502: mknod d12/d3c/d95/d3f/d4b/ca8 0 2024-02-15T22:40:55.562 INFO:tasks.workunit.client.0.smithi033.stdout:6/503: getdents d12/d2c/d30/da5 0 2024-02-15T22:40:55.563 INFO:tasks.workunit.client.0.smithi033.stdout:9/567: link d4/d1d/d23/d32/d3e/f56 d4/d1d/d23/d24/d51/d5d/d90/fa8 0 2024-02-15T22:40:55.564 INFO:tasks.workunit.client.0.smithi033.stdout:6/504: symlink d12/d3c/d95/la9 0 2024-02-15T22:40:55.570 INFO:tasks.workunit.client.0.smithi033.stdout:3/698: dwrite d0/d3/d3b/d47/f80 [0,4194304] 0 2024-02-15T22:40:55.574 INFO:tasks.workunit.client.0.smithi033.stdout:6/505: dread d12/f41 [0,4194304] 0 2024-02-15T22:40:55.575 INFO:tasks.workunit.client.0.smithi033.stdout:6/506: creat d12/d3c/d95/d3f/da3/faa x:0 0 0 2024-02-15T22:40:55.575 INFO:tasks.workunit.client.0.smithi033.stdout:9/568: dread d4/d1d/d23/d24/d5a/f80 [0,4194304] 0 2024-02-15T22:40:55.576 INFO:tasks.workunit.client.0.smithi033.stdout:9/569: symlink d4/d1d/d23/d35/la9 0 2024-02-15T22:40:55.579 INFO:tasks.workunit.client.0.smithi033.stdout:2/790: dwrite d1/d16/d5a/d67/f70 [0,4194304] 0 2024-02-15T22:40:55.580 INFO:tasks.workunit.client.0.smithi033.stdout:3/699: getdents d0/d3/d2c/d5d/d3d 0 2024-02-15T22:40:55.584 INFO:tasks.workunit.client.0.smithi033.stdout:3/700: symlink d0/d3/d2c/d5d/d3d/db4/le6 0 2024-02-15T22:40:55.585 INFO:tasks.workunit.client.0.smithi033.stdout:3/701: symlink d0/d3/d77/le7 0 2024-02-15T22:40:55.588 INFO:tasks.workunit.client.0.smithi033.stdout:3/702: rmdir d0/d91 39 2024-02-15T22:40:55.588 INFO:tasks.workunit.client.0.smithi033.stdout:3/703: truncate d0/d3/d2c/d5d/d3d/db6/fb8 837447 0 2024-02-15T22:40:55.595 INFO:tasks.workunit.client.0.smithi033.stdout:9/570: dwrite d4/d1d/d23/f7c [0,4194304] 0 2024-02-15T22:40:55.599 INFO:tasks.workunit.client.0.smithi033.stdout:9/571: rename d4/c1e to d4/d1d/d23/d32/d3e/d86/d3f/d94/caa 0 2024-02-15T22:40:55.599 INFO:tasks.workunit.client.0.smithi033.stdout:9/572: chown d4/d1d/d23/d7b 1409706 1 2024-02-15T22:40:55.600 INFO:tasks.workunit.client.0.smithi033.stdout:9/573: mkdir d4/d1d/d23/d32/d71/dab 0 2024-02-15T22:40:55.601 INFO:tasks.workunit.client.0.smithi033.stdout:9/574: mkdir d4/dac 0 2024-02-15T22:40:55.602 INFO:tasks.workunit.client.0.smithi033.stdout:3/704: write d0/f36 [250264,108927] 0 2024-02-15T22:40:55.602 INFO:tasks.workunit.client.0.smithi033.stdout:3/705: read - d0/d1c/f67 zero size 2024-02-15T22:40:55.602 INFO:tasks.workunit.client.0.smithi033.stdout:9/575: symlink d4/d1d/d23/d32/d3e/d86/d3f/lad 0 2024-02-15T22:40:55.628 INFO:tasks.workunit.client.0.smithi033.stdout:3/706: dwrite d0/d3/d2c/f34 [0,4194304] 0 2024-02-15T22:40:55.629 INFO:tasks.workunit.client.0.smithi033.stdout:3/707: chown d0/d3/d5f/cb7 26432 1 2024-02-15T22:40:55.629 INFO:tasks.workunit.client.0.smithi033.stdout:3/708: read - d0/d3/d2c/d5d/d3d/d57/f6f zero size 2024-02-15T22:40:55.629 INFO:tasks.workunit.client.0.smithi033.stdout:9/576: dwrite d4/d1d/f2c [0,4194304] 0 2024-02-15T22:40:55.632 INFO:tasks.workunit.client.0.smithi033.stdout:3/709: getdents d0 0 2024-02-15T22:40:55.634 INFO:tasks.workunit.client.0.smithi033.stdout:3/710: unlink d0/d3/d2c/d5d/c31 0 2024-02-15T22:40:55.635 INFO:tasks.workunit.client.0.smithi033.stdout:3/711: creat d0/d3/d2c/d5d/d3d/fe8 x:0 0 0 2024-02-15T22:40:55.636 INFO:tasks.workunit.client.0.smithi033.stdout:3/712: write d0/d3/dd/f76 [302606,105006] 0 2024-02-15T22:40:55.637 INFO:tasks.workunit.client.0.smithi033.stdout:3/713: symlink d0/d3/d77/le9 0 2024-02-15T22:40:55.653 INFO:tasks.workunit.client.0.smithi033.stdout:3/714: dwrite d0/d1c/f25 [0,4194304] 0 2024-02-15T22:40:55.653 INFO:tasks.workunit.client.0.smithi033.stdout:3/715: write d0/d3/d3b/db1/fa0 [783666,80194] 0 2024-02-15T22:40:55.655 INFO:tasks.workunit.client.0.smithi033.stdout:3/716: dread d0/d3/dd/f18 [0,4194304] 0 2024-02-15T22:40:55.668 INFO:tasks.workunit.client.0.smithi033.stdout:3/717: dwrite d0/d3/dd/f52 [0,4194304] 0 2024-02-15T22:40:55.668 INFO:tasks.workunit.client.0.smithi033.stdout:3/718: creat d0/d3/d3b/fea x:0 0 0 2024-02-15T22:40:55.670 INFO:tasks.workunit.client.0.smithi033.stdout:3/719: symlink d0/d3/d77/leb 0 2024-02-15T22:40:55.670 INFO:tasks.workunit.client.0.smithi033.stdout:3/720: chown d0/d3/f40 537834 1 2024-02-15T22:40:55.670 INFO:tasks.workunit.client.0.smithi033.stdout:3/721: chown d0/d9d 123666 1 2024-02-15T22:40:55.671 INFO:tasks.workunit.client.0.smithi033.stdout:3/722: rmdir d0/d3/d2c/d5d/d3d/d57 39 2024-02-15T22:40:55.672 INFO:tasks.workunit.client.0.smithi033.stdout:3/723: mkdir d0/d3/d2c/d5d/d3d/d8f/dd7/dec 0 2024-02-15T22:40:55.672 INFO:tasks.workunit.client.0.smithi033.stdout:3/724: truncate d0/d3/dd/f6a 564570 0 2024-02-15T22:40:55.674 INFO:tasks.workunit.client.0.smithi033.stdout:3/725: truncate d0/d3/d3b/d47/f50 676475 0 2024-02-15T22:40:55.674 INFO:tasks.workunit.client.0.smithi033.stdout:3/726: write d0/d3/dd/f18 [924191,35783] 0 2024-02-15T22:40:55.675 INFO:tasks.workunit.client.0.smithi033.stdout:3/727: write d0/f36 [154327,72477] 0 2024-02-15T22:40:55.675 INFO:tasks.workunit.client.0.smithi033.stdout:3/728: fsync d0/d3/d2c/d5d/d3d/fcd 0 2024-02-15T22:40:55.675 INFO:tasks.workunit.client.0.smithi033.stdout:3/729: creat d0/d3/d5f/da7/fed x:0 0 0 2024-02-15T22:40:55.688 INFO:tasks.workunit.client.0.smithi033.stdout:3/730: dwrite d0/d3/d5f/da7/fed [0,4194304] 0 2024-02-15T22:40:55.691 INFO:tasks.workunit.client.0.smithi033.stdout:0/575: sync 2024-02-15T22:40:55.691 INFO:tasks.workunit.client.0.smithi033.stdout:0/576: chown db/d2a/d68/d8b 2821 1 2024-02-15T22:40:55.695 INFO:tasks.workunit.client.0.smithi033.stdout:0/577: creat db/d19/d32/d43/fbb x:0 0 0 2024-02-15T22:40:55.698 INFO:tasks.workunit.client.0.smithi033.stdout:3/731: rename d0/d3/d2c/d5d/d3d/d57/d74/l81 to d0/d3/d77/ddb/lee 0 2024-02-15T22:40:55.703 INFO:tasks.workunit.client.0.smithi033.stdout:0/578: creat db/d2a/d6e/d7a/fbc x:0 0 0 2024-02-15T22:40:55.707 INFO:tasks.workunit.client.0.smithi033.stdout:0/579: link db/d19/d32/d43/d7d/l92 db/d2a/lbd 0 2024-02-15T22:40:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.707+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe2010f7a0 con 0x7fbe0806b2e0 2024-02-15T22:40:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.709+0000 7fbe077fe700 1 -- 172.21.15.33:0/158944923 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fbe2010f7a0 con 0x7fbe0806b2e0 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fbe0806b2e0 msgr2=0x7fbe0806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fbe0806b2e0 0x7fbe0806d790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbe20065400 tx=0x7fbe1000b040 comp rx=0 tx=0).stop 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fd470 msgr2=0x7fbe2010de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fd470 0x7fbe2010de90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbe14013420 tx=0x7fbe14009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 shutdown_connections 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fbe0806b2e0 0x7fbe0806d790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe200fc180 0x7fbe2010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 --2- 172.21.15.33:0/158944923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe200fd470 0x7fbe2010de90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 >> 172.21.15.33:0/158944923 conn(0x7fbe200f6ca0 msgr2=0x7fbe200fb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 shutdown_connections 2024-02-15T22:40:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.711+0000 7fbe250fb700 1 -- 172.21.15.33:0/158944923 wait complete. 2024-02-15T22:40:55.719 INFO:tasks.workunit.client.0.smithi033.stdout:0/580: dread db/d2a/f2b [0,4194304] 0 2024-02-15T22:40:55.720 INFO:tasks.workunit.client.0.smithi033.stdout:0/581: symlink db/d19/d32/d3d/lbe 0 2024-02-15T22:40:55.722 INFO:tasks.workunit.client.0.smithi033.stdout:3/732: dwrite d0/d3/d5f/da7/faa [0,4194304] 0 2024-02-15T22:40:55.722 INFO:tasks.workunit.client.0.smithi033.stdout:0/582: mkdir db/d2a/d68/d8b/dbf 0 2024-02-15T22:40:55.723 INFO:tasks.workunit.client.0.smithi033.stdout:3/733: mknod d0/d3/d2c/d5d/d3d/d8f/dcf/cef 0 2024-02-15T22:40:55.725 INFO:tasks.workunit.client.0.smithi033.stdout:0/583: mkdir db/dc0 0 2024-02-15T22:40:55.725 INFO:tasks.workunit.client.0.smithi033.stdout:0/584: readlink db/d19/d32/d43/d5a/la0 0 2024-02-15T22:40:55.725 INFO:tasks.workunit.client.0.smithi033.stdout:0/585: chown db/d19/d32/d3d/l47 1 1 2024-02-15T22:40:55.725 INFO:tasks.workunit.client.0.smithi033.stdout:0/586: readlink db/d19/l27 0 2024-02-15T22:40:55.725 INFO:tasks.workunit.client.0.smithi033.stdout:0/587: chown db/d2a/c41 596 1 2024-02-15T22:40:55.725 INFO:tasks.workunit.client.0.smithi033.stdout:0/588: write db/d19/d32/fb7 [554159,121798] 0 2024-02-15T22:40:55.725 INFO:tasks.workunit.client.0.smithi033.stdout:0/589: chown db/c51 3072 1 2024-02-15T22:40:55.728 INFO:tasks.workunit.client.0.smithi033.stdout:0/590: unlink db/d2a/l4d 0 2024-02-15T22:40:55.728 INFO:tasks.workunit.client.0.smithi033.stdout:0/591: write db/fa8 [925273,128866] 0 2024-02-15T22:40:55.728 INFO:tasks.workunit.client.0.smithi033.stdout:0/592: fdatasync db/d19/f1a 0 2024-02-15T22:40:55.728 INFO:tasks.workunit.client.0.smithi033.stdout:0/593: creat db/d19/d32/d43/d5a/d76/fc1 x:0 0 0 2024-02-15T22:40:55.728 INFO:tasks.workunit.client.0.smithi033.stdout:0/594: chown db/ld 2536 1 2024-02-15T22:40:55.731 INFO:tasks.workunit.client.0.smithi033.stdout:0/595: truncate db/d19/d32/d43/f78 795487 0 2024-02-15T22:40:55.751 INFO:tasks.workunit.client.0.smithi033.stdout:0/596: dwrite db/f87 [0,4194304] 0 2024-02-15T22:40:55.756 INFO:tasks.workunit.client.0.smithi033.stdout:0/597: link db/d2a/d6c/c71 db/d2a/d6e/cc2 0 2024-02-15T22:40:55.757 INFO:tasks.workunit.client.0.smithi033.stdout:0/598: mkdir db/d2a/d6e/dc3 0 2024-02-15T22:40:55.760 INFO:tasks.workunit.client.0.smithi033.stdout:0/599: creat db/d19/d32/d43/d7d/d9c/fc4 x:0 0 0 2024-02-15T22:40:55.762 INFO:tasks.workunit.client.0.smithi033.stdout:0/600: creat db/d19/d32/d43/d94/fc5 x:0 0 0 2024-02-15T22:40:55.762 INFO:tasks.workunit.client.0.smithi033.stdout:0/601: creat db/d2a/d68/da9/fc6 x:0 0 0 2024-02-15T22:40:55.770 INFO:tasks.workunit.client.0.smithi033.stdout:4/722: sync 2024-02-15T22:40:55.770 INFO:tasks.workunit.client.0.smithi033.stdout:5/673: sync 2024-02-15T22:40:55.771 INFO:tasks.workunit.client.0.smithi033.stdout:4/723: rmdir d8/d1a 39 2024-02-15T22:40:55.772 INFO:tasks.workunit.client.0.smithi033.stdout:5/674: symlink d6/d14/d31/d38/d9b/ld0 0 2024-02-15T22:40:55.772 INFO:tasks.workunit.client.0.smithi033.stdout:5/675: truncate d6/d14/d31/d64/d7a/fc5 9885 0 2024-02-15T22:40:55.772 INFO:tasks.workunit.client.0.smithi033.stdout:4/724: creat d8/d16/d51/d1c/d3c/ddd/ff7 x:0 0 0 2024-02-15T22:40:55.773 INFO:tasks.workunit.client.0.smithi033.stdout:5/676: mknod d6/d14/d31/d48/d56/d90/cd1 0 2024-02-15T22:40:55.773 INFO:tasks.workunit.client.0.smithi033.stdout:5/677: read - d6/faa zero size 2024-02-15T22:40:55.774 INFO:tasks.workunit.client.0.smithi033.stdout:4/725: link d8/d16/d51/d1c/db9/d37/f40 d8/d16/d51/d1c/d50/da1/dc1/ff8 0 2024-02-15T22:40:55.775 INFO:tasks.workunit.client.0.smithi033.stdout:4/726: write f5 [4866223,106952] 0 2024-02-15T22:40:55.775 INFO:tasks.workunit.client.0.smithi033.stdout:4/727: chown d8/d16/d51/d1c/db9/d37/d31/f42 3028545 1 2024-02-15T22:40:55.777 INFO:tasks.workunit.client.0.smithi033.stdout:4/728: rmdir d8/d69 39 2024-02-15T22:40:55.778 INFO:tasks.workunit.client.0.smithi033.stdout:0/602: dwrite db/d19/d32/d43/fbb [0,4194304] 0 2024-02-15T22:40:55.778 INFO:tasks.workunit.client.0.smithi033.stdout:0/603: write db/d2a/d6e/d7a/f8a [360581,86905] 0 2024-02-15T22:40:55.778 INFO:tasks.workunit.client.0.smithi033.stdout:5/678: rename d6/d14/d31/d48/da2 to d6/d14/d31/d38/d9b/dd2 0 2024-02-15T22:40:55.779 INFO:tasks.workunit.client.0.smithi033.stdout:4/729: truncate f4 871089 0 2024-02-15T22:40:55.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/604: mkdir db/d2a/dc7 0 2024-02-15T22:40:55.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/605: fdatasync db/f87 0 2024-02-15T22:40:55.794 INFO:tasks.workunit.client.0.smithi033.stdout:5/679: rename d6/d14/d31/d64 to d6/d14/d31/d38/d9b/dd3 0 2024-02-15T22:40:55.797 INFO:tasks.workunit.client.0.smithi033.stdout:0/606: rmdir db/d19/d32/d43 39 2024-02-15T22:40:55.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/730: dwrite d8/d16/d51/fc8 [0,4194304] 0 2024-02-15T22:40:55.798 INFO:tasks.workunit.client.0.smithi033.stdout:5/680: mknod d6/d14/d31/d50/d6a/dab/cd4 0 2024-02-15T22:40:55.801 INFO:tasks.workunit.client.0.smithi033.stdout:0/607: mknod db/d2a/d6c/cc8 0 2024-02-15T22:40:55.802 INFO:tasks.workunit.client.0.smithi033.stdout:4/731: link d8/d16/d51/d1c/db9/fd7 d8/d16/d51/d1c/db9/ff9 0 2024-02-15T22:40:55.802 INFO:tasks.workunit.client.0.smithi033.stdout:4/732: stat d8/d16/d51/d1c/db9/d37/d31/d47/d85/fbc 0 2024-02-15T22:40:55.802 INFO:tasks.workunit.client.0.smithi033.stdout:4/733: dread - d8/d1a/f91 zero size 2024-02-15T22:40:55.805 INFO:tasks.workunit.client.0.smithi033.stdout:0/608: creat db/d19/d32/d43/fc9 x:0 0 0 2024-02-15T22:40:55.806 INFO:tasks.workunit.client.0.smithi033.stdout:0/609: creat db/d2a/d6c/fca x:0 0 0 2024-02-15T22:40:55.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/681: dwrite d6/d14/d31/d38/d9b/f54 [0,4194304] 0 2024-02-15T22:40:55.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/682: fsync d6/d14/d31/d48/d49/d53/fa3 0 2024-02-15T22:40:55.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/683: chown d6/d14/d31/d48/d49/f84 22508 1 2024-02-15T22:40:55.826 INFO:tasks.workunit.client.0.smithi033.stdout:4/734: dwrite d8/d16/d51/fc8 [0,4194304] 0 2024-02-15T22:40:55.826 INFO:tasks.workunit.client.0.smithi033.stdout:4/735: chown d8/ca2 84432030 1 2024-02-15T22:40:55.827 INFO:tasks.workunit.client.0.smithi033.stdout:5/684: dread d6/d14/d31/d48/d56/f5b [0,4194304] 0 2024-02-15T22:40:55.827 INFO:tasks.workunit.client.0.smithi033.stdout:5/685: write d6/d14/d31/d48/d49/d53/d57/f8c [1331140,28124] 0 2024-02-15T22:40:55.827 INFO:tasks.workunit.client.0.smithi033.stdout:5/686: chown d6/d25/d99/da8 20551931 1 2024-02-15T22:40:55.827 INFO:tasks.workunit.client.0.smithi033.stdout:4/736: truncate d8/d16/d51/d1c/d3c/d49/f6b 845732 0 2024-02-15T22:40:55.828 INFO:tasks.workunit.client.0.smithi033.stdout:4/737: fsync d8/d16/d45/fea 0 2024-02-15T22:40:55.828 INFO:tasks.workunit.client.0.smithi033.stdout:4/738: chown d8/d16/d45/l63 196327 1 2024-02-15T22:40:55.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/687: mknod d6/d14/d31/d38/d9b/dd3/d7a/cd5 0 2024-02-15T22:40:55.829 INFO:tasks.workunit.client.0.smithi033.stdout:5/688: mkdir d6/d14/d31/d50/d5c/dd6 0 2024-02-15T22:40:55.837 INFO:tasks.workunit.client.0.smithi033.stdout:4/739: write d8/fa6 [936241,46414] 0 2024-02-15T22:40:55.838 INFO:tasks.workunit.client.0.smithi033.stdout:4/740: mknod d8/d16/d51/d1c/d3c/ddd/cfa 0 2024-02-15T22:40:55.847 INFO:tasks.workunit.client.0.smithi033.stdout:5/689: dwrite d6/d14/f22 [0,4194304] 0 2024-02-15T22:40:55.848 INFO:tasks.workunit.client.0.smithi033.stdout:5/690: chown d6/d25/c95 2426 1 2024-02-15T22:40:55.848 INFO:tasks.workunit.client.0.smithi033.stdout:5/691: truncate d6/d25/f55 2602218 0 2024-02-15T22:40:55.848 INFO:tasks.workunit.client.0.smithi033.stdout:5/692: truncate d6/d14/d31/d38/d9b/dd3/d7a/fc5 217079 0 2024-02-15T22:40:55.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 -- 172.21.15.33:0/2061878000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fe2b0 msgr2=0x7fd9dc0fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 --2- 172.21.15.33:0/2061878000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fe2b0 0x7fd9dc0fe700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0004940 tx=0x7fd9d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:55.849 INFO:tasks.workunit.client.0.smithi033.stdout:5/693: mkdir d6/d14/d31/d48/d49/d53/dd7 0 2024-02-15T22:40:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 -- 172.21.15.33:0/2061878000 shutdown_connections 2024-02-15T22:40:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 --2- 172.21.15.33:0/2061878000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fe2b0 0x7fd9dc0fe700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 --2- 172.21.15.33:0/2061878000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc0fb220 0x7fd9dc0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 -- 172.21.15.33:0/2061878000 >> 172.21.15.33:0/2061878000 conn(0x7fd9dc0f6ca0 msgr2=0x7fd9dc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 -- 172.21.15.33:0/2061878000 shutdown_connections 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.847+0000 7fd9e3420700 1 -- 172.21.15.33:0/2061878000 wait complete. 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e3420700 1 Processor -- start 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e3420700 1 -- start start 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e3420700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fb220 0x7fd9dc10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e3420700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc0fe2b0 0x7fd9dc10df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e3420700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc10e5e0 con 0x7fd9dc0fb220 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e3420700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc10ee20 con 0x7fd9dc0fe2b0 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e11bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fb220 0x7fd9dc10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e11bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fb220 0x7fd9dc10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40576/0 (socket says 172.21.15.33:40576) 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e11bc700 1 -- 172.21.15.33:0/392497494 learned_addr learned my addr 172.21.15.33:0/392497494 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e09bb700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc0fe2b0 0x7fd9dc10df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e11bc700 1 -- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc0fe2b0 msgr2=0x7fd9dc10df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e11bc700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc0fe2b0 0x7fd9dc10df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.848+0000 7fd9e11bc700 1 -- 172.21.15.33:0/392497494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d0005040 con 0x7fd9dc0fb220 2024-02-15T22:40:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.849+0000 7fd9e11bc700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fb220 0x7fd9dc10da10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00bae0 tx=0x7fd9cc009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.849+0000 7fd9d9ffb700 1 -- 172.21.15.33:0/392497494 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc00c8c0 con 0x7fd9dc0fb220 2024-02-15T22:40:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.849+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc10f100 con 0x7fd9dc0fb220 2024-02-15T22:40:55.852 INFO:tasks.workunit.client.0.smithi033.stdout:5/694: rename d6/d14/d31/c5a to d6/d14/d31/d48/d49/d53/dd7/cd8 0 2024-02-15T22:40:55.852 INFO:tasks.workunit.client.0.smithi033.stdout:5/695: readlink d6/d14/d31/d48/l4a 0 2024-02-15T22:40:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.849+0000 7fd9d9ffb700 1 -- 172.21.15.33:0/392497494 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9cc014410 con 0x7fd9dc0fb220 2024-02-15T22:40:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.849+0000 7fd9d9ffb700 1 -- 172.21.15.33:0/392497494 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc007610 con 0x7fd9dc0fb220 2024-02-15T22:40:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.849+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc10f640 con 0x7fd9dc0fb220 2024-02-15T22:40:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.850+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc04bed0 con 0x7fd9dc0fb220 2024-02-15T22:40:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.851+0000 7fd9d9ffb700 1 -- 172.21.15.33:0/392497494 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7fd9cc00ca20 con 0x7fd9dc0fb220 2024-02-15T22:40:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.852+0000 7fd9d9ffb700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fd9c406b2e0 0x7fd9c406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.852+0000 7fd9d9ffb700 1 -- 172.21.15.33:0/392497494 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd9cc089e40 con 0x7fd9dc0fb220 2024-02-15T22:40:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.852+0000 7fd9e09bb700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fd9c406b2e0 0x7fd9c406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.853+0000 7fd9e09bb700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fd9c406b2e0 0x7fd9c406d790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0004f90 tx=0x7fd9d0009e30 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:55.858 INFO:tasks.workunit.client.0.smithi033.stdout:4/741: dwrite d8/d16/d51/d1c/db9/d37/f40 [0,4194304] 0 2024-02-15T22:40:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:55.858+0000 7fd9d9ffb700 1 -- 172.21.15.33:0/392497494 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd9cc04e620 con 0x7fd9dc0fb220 2024-02-15T22:40:55.865 INFO:tasks.workunit.client.0.smithi033.stdout:5/696: dwrite d6/db0/fb4 [0,4194304] 0 2024-02-15T22:40:55.865 INFO:tasks.workunit.client.0.smithi033.stdout:5/697: write d6/d14/d31/d38/f8f [3551352,2454] 0 2024-02-15T22:40:55.868 INFO:tasks.workunit.client.0.smithi033.stdout:4/742: read f7 [1672223,126523] 0 2024-02-15T22:40:55.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/698: creat d6/d14/d31/d50/d6a/daf/fd9 x:0 0 0 2024-02-15T22:40:55.871 INFO:tasks.workunit.client.0.smithi033.stdout:4/743: creat d8/d16/d51/d1c/d50/da1/dc1/ffb x:0 0 0 2024-02-15T22:40:55.873 INFO:tasks.workunit.client.0.smithi033.stdout:5/699: creat d6/d14/d31/d48/d49/d53/d57/da1/fda x:0 0 0 2024-02-15T22:40:55.873 INFO:tasks.workunit.client.0.smithi033.stdout:4/744: creat d8/d16/d51/d1c/db9/d37/d31/da5/ffc x:0 0 0 2024-02-15T22:40:55.874 INFO:tasks.workunit.client.0.smithi033.stdout:5/700: symlink d6/d14/d31/d38/d3f/ldb 0 2024-02-15T22:40:55.874 INFO:tasks.workunit.client.0.smithi033.stdout:5/701: fsync d6/d14/d31/d48/d49/d53/fa3 0 2024-02-15T22:40:55.874 INFO:tasks.workunit.client.0.smithi033.stdout:5/702: fsync d6/d14/d31/d48/d49/d53/d57/fbf 0 2024-02-15T22:40:55.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/745: truncate d8/d69/f9c 1389915 0 2024-02-15T22:40:55.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/746: chown d8/d16/d51/d1c/db9/d37/d31/d47/d85/lb7 4 1 2024-02-15T22:40:55.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/747: write d8/d16/d51/d1c/db9/d37/d31/d80/fe7 [399661,32933] 0 2024-02-15T22:40:55.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/748: chown d8/d69/f9c 170096609 1 2024-02-15T22:40:55.900 INFO:tasks.workunit.client.0.smithi033.stdout:4/749: dwrite d8/d1a/f87 [0,4194304] 0 2024-02-15T22:40:55.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/703: dwrite d6/d14/d31/d48/d49/f84 [0,4194304] 0 2024-02-15T22:40:55.904 INFO:tasks.workunit.client.0.smithi033.stdout:4/750: rename d8/d16/d51/d77 to d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd 0 2024-02-15T22:40:55.906 INFO:tasks.workunit.client.0.smithi033.stdout:5/704: rename d6/d14/d31/d48/d49/d53/fa3 to d6/d14/d31/d48/d49/fdc 0 2024-02-15T22:40:55.906 INFO:tasks.workunit.client.0.smithi033.stdout:5/705: chown d6/d14/d31/d38/d9b/c60 221241372 1 2024-02-15T22:40:55.906 INFO:tasks.workunit.client.0.smithi033.stdout:5/706: write d6/fe [1563356,4046] 0 2024-02-15T22:40:55.908 INFO:tasks.workunit.client.0.smithi033.stdout:4/751: unlink d8/d16/d51/d1c/db9/d37/d31/da5/le5 0 2024-02-15T22:40:55.911 INFO:tasks.workunit.client.0.smithi033.stdout:5/707: rename d6/d14/d31/d38/d9b/l65 to d6/ldd 0 2024-02-15T22:40:55.913 INFO:tasks.workunit.client.0.smithi033.stdout:4/752: link d8/d16/d51/d1c/d3c/d3f/l5d d8/d16/d51/d1c/db9/d37/dbe/lfe 0 2024-02-15T22:40:55.913 INFO:tasks.workunit.client.0.smithi033.stdout:4/753: write d8/d16/d51/d1c/db9/d37/d31/f83 [5716347,74540] 0 2024-02-15T22:40:55.913 INFO:tasks.workunit.client.0.smithi033.stdout:4/754: fsync d8/d16/d51/d27/f5e 0 2024-02-15T22:40:55.922 INFO:tasks.workunit.client.0.smithi033.stdout:4/755: dread d8/d1a/f87 [0,4194304] 0 2024-02-15T22:40:55.923 INFO:tasks.workunit.client.0.smithi033.stdout:4/756: mknod d8/d16/d51/d1c/db9/d37/d31/d80/cff 0 2024-02-15T22:40:55.924 INFO:tasks.workunit.client.0.smithi033.stdout:4/757: symlink d8/d16/d51/d1c/d94/l100 0 2024-02-15T22:40:55.927 INFO:tasks.workunit.client.0.smithi033.stdout:8/698: sync 2024-02-15T22:40:55.928 INFO:tasks.workunit.client.0.smithi033.stdout:7/667: sync 2024-02-15T22:40:55.929 INFO:tasks.workunit.client.0.smithi033.stdout:8/699: mkdir d1/de/d5c/df4 0 2024-02-15T22:40:55.930 INFO:tasks.workunit.client.0.smithi033.stdout:7/668: creat d5/dc/d5f/d8b/da1/d98/d7b/fe3 x:0 0 0 2024-02-15T22:40:55.934 INFO:tasks.workunit.client.0.smithi033.stdout:7/669: unlink d5/df/c4b 0 2024-02-15T22:40:55.935 INFO:tasks.workunit.client.0.smithi033.stdout:7/670: dread d5/df/d40/d73/fcc [0,4194304] 0 2024-02-15T22:40:55.938 INFO:tasks.workunit.client.0.smithi033.stdout:7/671: mkdir d5/dc/d5f/d8b/da0/dc6/de4 0 2024-02-15T22:40:55.940 INFO:tasks.workunit.client.0.smithi033.stdout:7/672: write d5/dc/d5f/f2f [316069,59701] 0 2024-02-15T22:40:55.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/700: dwrite d1/d74/dc1/d75/dbf/d79/fca [0,4194304] 0 2024-02-15T22:40:55.959 INFO:tasks.workunit.client.0.smithi033.stdout:7/673: rename d5/dc/d5f/d8b/da1/d98 to d5/dc/d5f/d8b/da0/dc6/de4/de5 0 2024-02-15T22:40:55.959 INFO:tasks.workunit.client.0.smithi033.stdout:7/674: stat d5/l12 0 2024-02-15T22:40:55.959 INFO:tasks.workunit.client.0.smithi033.stdout:7/675: chown d5/dc/d5f/d8b/da1/l7a 492360641 1 2024-02-15T22:40:55.959 INFO:tasks.workunit.client.0.smithi033.stdout:7/676: write d5/df/d40/d73/dd2/fe2 [213771,103155] 0 2024-02-15T22:40:55.962 INFO:tasks.workunit.client.0.smithi033.stdout:8/701: dread d1/de/d1a/f66 [0,4194304] 0 2024-02-15T22:40:55.964 INFO:tasks.workunit.client.0.smithi033.stdout:7/677: rename d5/df/d40/d4a to d5/dc/d5f/d8b/da0/dc6/de4/de5/d8a/de6 0 2024-02-15T22:40:55.966 INFO:tasks.workunit.client.0.smithi033.stdout:7/678: dread d5/dc/d5f/f2f [0,4194304] 0 2024-02-15T22:40:55.967 INFO:tasks.workunit.client.0.smithi033.stdout:8/702: rename d1/dae/le9 to d1/d74/dc1/d75/dbf/lf5 0 2024-02-15T22:40:55.967 INFO:tasks.workunit.client.0.smithi033.stdout:7/679: chown d5/df/d40/d73/fcc 59942 1 2024-02-15T22:40:55.969 INFO:tasks.workunit.client.0.smithi033.stdout:7/680: unlink d5/df/d40/lb8 0 2024-02-15T22:40:55.969 INFO:tasks.workunit.client.0.smithi033.stdout:7/681: dread - d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/fe3 zero size 2024-02-15T22:40:55.969 INFO:tasks.workunit.client.0.smithi033.stdout:7/682: fsync d5/df/d56/d60/d59/f74 0 2024-02-15T22:40:55.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/683: write d5/f9b [7271795,128455] 0 2024-02-15T22:40:55.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/684: symlink d5/df/d40/d73/le7 0 2024-02-15T22:40:55.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/685: stat d5/f15 0 2024-02-15T22:40:55.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/686: mknod d5/df/d56/d99/ce8 0 2024-02-15T22:40:55.981 INFO:tasks.workunit.client.0.smithi033.stdout:7/687: unlink d5/df/d56/d60/d59/d9c/fa9 0 2024-02-15T22:40:55.982 INFO:tasks.workunit.client.0.smithi033.stdout:7/688: rename d5/dc/d5f/d8b/da0/dc6/de4/de5/d8a to d5/dc/d5f/d8b/da0/dc6/de4/de9 0 2024-02-15T22:40:55.988 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:55 smithi082 ceph-mon[37153]: pgmap v10: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 119 MiB/s rd, 137 MiB/s wr, 219 op/s 2024-02-15T22:40:55.988 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:55 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:55.997 INFO:tasks.workunit.client.0.smithi033.stdout:7/689: dwrite d5/dc/fc2 [0,4194304] 0 2024-02-15T22:40:56.000 INFO:tasks.workunit.client.0.smithi033.stdout:7/690: mknod d5/dc/d5f/d8b/cea 0 2024-02-15T22:40:56.001 INFO:tasks.workunit.client.0.smithi033.stdout:7/691: symlink d5/dc/d5f/d8b/da0/dc6/leb 0 2024-02-15T22:40:56.002 INFO:tasks.workunit.client.0.smithi033.stdout:7/692: write d5/df/d56/d60/d59/d9c/da6/fcf [132916,21744] 0 2024-02-15T22:40:56.011 INFO:tasks.workunit.client.0.smithi033.stdout:7/693: rmdir d5/df 39 2024-02-15T22:40:56.014 INFO:tasks.workunit.client.0.smithi033.stdout:7/694: mknod d5/dc/d5f/d8b/da0/dc6/de4/de9/de6/cec 0 2024-02-15T22:40:56.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:55 smithi033 ceph-mon[29033]: pgmap v10: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 119 MiB/s rd, 137 MiB/s wr, 219 op/s 2024-02-15T22:40:56.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:55 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:40:56.029 INFO:tasks.workunit.client.0.smithi033.stdout:7/695: dwrite d5/df/d56/d60/d59/d9c/f6a [4194304,4194304] 0 2024-02-15T22:40:56.043 INFO:tasks.workunit.client.0.smithi033.stdout:7/696: dwrite d5/df/d56/d84/fd8 [0,4194304] 0 2024-02-15T22:40:56.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/697: truncate d5/dc/d5f/d8b/da1/f21 266263 0 2024-02-15T22:40:56.096 INFO:tasks.workunit.client.0.smithi033.stdout:1/668: sync 2024-02-15T22:40:56.097 INFO:tasks.workunit.client.0.smithi033.stdout:1/669: getdents d1/de/d27/d28/d2d 0 2024-02-15T22:40:56.099 INFO:tasks.workunit.client.0.smithi033.stdout:1/670: creat d1/de/d27/d28/d2d/d5e/d69/fc2 x:0 0 0 2024-02-15T22:40:56.099 INFO:tasks.workunit.client.0.smithi033.stdout:1/671: creat d1/de/d27/d28/d79/d9f/fc3 x:0 0 0 2024-02-15T22:40:56.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/672: mkdir d1/de/d27/d28/d79/dc4 0 2024-02-15T22:40:56.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/673: chown d1/de/d27/d28/d2d/f8c 48703001 1 2024-02-15T22:40:56.110 INFO:tasks.workunit.client.0.smithi033.stdout:1/674: write d1/de/d27/d39/d3a/f51 [2330957,111964] 0 2024-02-15T22:40:56.111 INFO:tasks.workunit.client.0.smithi033.stdout:1/675: mknod d1/de/d27/d28/d2d/d36/cc5 0 2024-02-15T22:40:56.111 INFO:tasks.workunit.client.0.smithi033.stdout:1/676: rename d1/d20 to d1/d20/d42/d2c/d30/dc6 22 2024-02-15T22:40:56.111 INFO:tasks.workunit.client.0.smithi033.stdout:1/677: symlink d1/de/d27/d28/d79/dc4/lc7 0 2024-02-15T22:40:56.114 INFO:tasks.workunit.client.0.smithi033.stdout:1/678: read d1/d57/f5f [834677,84678] 0 2024-02-15T22:40:56.116 INFO:tasks.workunit.client.0.smithi033.stdout:1/679: mkdir d1/d20/dc8 0 2024-02-15T22:40:56.116 INFO:tasks.workunit.client.0.smithi033.stdout:1/680: creat d1/d57/fc9 x:0 0 0 2024-02-15T22:40:56.116 INFO:tasks.workunit.client.0.smithi033.stdout:1/681: truncate d1/d96/fad 314469 0 2024-02-15T22:40:56.117 INFO:tasks.workunit.client.0.smithi033.stdout:1/682: mkdir d1/de/d27/d28/d2d/d5e/d69/dca 0 2024-02-15T22:40:56.117 INFO:tasks.workunit.client.0.smithi033.stdout:1/683: mkdir d1/d20/d42/d25/dcb 0 2024-02-15T22:40:56.118 INFO:tasks.workunit.client.0.smithi033.stdout:1/684: truncate d1/d20/d42/f49 3782685 0 2024-02-15T22:40:56.118 INFO:tasks.workunit.client.0.smithi033.stdout:1/685: readlink d1/de/d27/l47 0 2024-02-15T22:40:56.119 INFO:tasks.workunit.client.0.smithi033.stdout:1/686: truncate d1/f7 1073654 0 2024-02-15T22:40:56.121 INFO:tasks.workunit.client.0.smithi033.stdout:1/687: symlink d1/d20/d42/lcc 0 2024-02-15T22:40:56.121 INFO:tasks.workunit.client.0.smithi033.stdout:1/688: dread - d1/d20/d42/d25/d67/fb6 zero size 2024-02-15T22:40:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.124+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9dc10fa50 con 0x7fd9c406b2e0 2024-02-15T22:40:56.129 INFO:tasks.workunit.client.0.smithi033.stdout:1/689: write d1/de/f13 [5713134,113475] 0 2024-02-15T22:40:56.130 INFO:tasks.workunit.client.0.smithi033.stdout:1/690: rename d1/d20/d42/c55 to d1/de/d27/d28/ccd 0 2024-02-15T22:40:56.131 INFO:tasks.workunit.client.0.smithi033.stdout:1/691: dread d1/d96/fad [0,4194304] 0 2024-02-15T22:40:56.131 INFO:tasks.workunit.client.0.smithi033.stdout:1/692: write d1/de/f1f [3780120,113448] 0 2024-02-15T22:40:56.133 INFO:tasks.workunit.client.0.smithi033.stdout:1/693: getdents d1/de 0 2024-02-15T22:40:56.133 INFO:tasks.workunit.client.0.smithi033.stdout:1/694: readlink d1/d20/d42/l26 0 2024-02-15T22:40:56.134 INFO:tasks.workunit.client.0.smithi033.stdout:1/695: truncate d1/d20/f24 1166259 0 2024-02-15T22:40:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.140+0000 7fd9d9ffb700 1 -- 172.21.15.33:0/392497494 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd9dc10fa50 con 0x7fd9c406b2e0 2024-02-15T22:40:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:40:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 2m ago 8m 25.4M - 0.25.0 c8568f914cd2 229a38709f4a 2024-02-15T22:40:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (8m) 2m ago 8m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:40:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (7m) 5s ago 7m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (6m) 2m ago 7m 81.5M - 9.4.7 954c08fa6188 4e1a6363851b 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (2m) 2m ago 2m 14.9M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (2m) 2m ago 2m 15.5M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (2m) 5s ago 2m 66.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (2m) 5s ago 2m 54.7M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:9283 running (9m) 2m ago 9m 481M - 17.2.7-509-g9aa52330 61c0ec9cd187 4de1acba28ab 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283 running (32s) 5s ago 7m 488M - 19.0.0-1450-gf78a58c0 f081f847070a 0cbd0d048cce 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (9m) 2m ago 9m 47.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (6m) 5s ago 6m 39.4M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (8m) 2m ago 8m 16.1M - 1.5.0 0da6a335fe13 edf3c832a7c2 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 5s ago 7m 16.8M - 1.5.0 0da6a335fe13 e8b1514d760c 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (6m) 2m ago 6m 46.7M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (5m) 2m ago 5m 46.4M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:40:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (5m) 2m ago 5m 44.0M 4289M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (4m) 5s ago 4m 200M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (4m) 5s ago 4m 145M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (3m) 5s ago 3m 178M 5312M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (6m) 2m ago 7m 54.6M - 2.43.0 a07b618ecd1d fcda9c48f34e 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fd9c406b2e0 msgr2=0x7fd9c406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fd9c406b2e0 0x7fd9c406d790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0004f90 tx=0x7fd9d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fb220 msgr2=0x7fd9dc10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fb220 0x7fd9dc10da10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00bae0 tx=0x7fd9cc009810 comp rx=0 tx=0).stop 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 shutdown_connections 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fd9c406b2e0 0x7fd9c406d790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9dc0fb220 0x7fd9dc10da10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 --2- 172.21.15.33:0/392497494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc0fe2b0 0x7fd9dc10df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 >> 172.21.15.33:0/392497494 conn(0x7fd9dc0f6ca0 msgr2=0x7fd9dc1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 shutdown_connections 2024-02-15T22:40:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.142+0000 7fd9e3420700 1 -- 172.21.15.33:0/392497494 wait complete. 2024-02-15T22:40:56.153 INFO:tasks.workunit.client.0.smithi033.stdout:1/696: dwrite d1/de/d27/d39/d3a/dae/fb8 [0,4194304] 0 2024-02-15T22:40:56.155 INFO:tasks.workunit.client.0.smithi033.stdout:1/697: creat d1/de/d27/d28/d79/dc4/fce x:0 0 0 2024-02-15T22:40:56.171 INFO:tasks.workunit.client.0.smithi033.stdout:1/698: dwrite d1/d20/d42/d25/d67/f88 [0,4194304] 0 2024-02-15T22:40:56.171 INFO:tasks.workunit.client.0.smithi033.stdout:1/699: readlink d1/de/d27/d28/d79/dc4/lc7 0 2024-02-15T22:40:56.172 INFO:tasks.workunit.client.0.smithi033.stdout:1/700: rmdir d1/de/d27/d28 39 2024-02-15T22:40:56.177 INFO:tasks.workunit.client.0.smithi033.stdout:1/701: dread d1/d20/d42/d25/f6f [0,4194304] 0 2024-02-15T22:40:56.177 INFO:tasks.workunit.client.0.smithi033.stdout:1/702: read - d1/d20/d42/d25/d67/fb6 zero size 2024-02-15T22:40:56.186 INFO:tasks.workunit.client.0.smithi033.stdout:1/703: dread d1/d20/fa1 [0,4194304] 0 2024-02-15T22:40:56.187 INFO:tasks.workunit.client.0.smithi033.stdout:1/704: rmdir d1/de/d27/d39 39 2024-02-15T22:40:56.205 INFO:tasks.workunit.client.0.smithi033.stdout:1/705: dwrite d1/d20/f24 [0,4194304] 0 2024-02-15T22:40:56.223 INFO:tasks.workunit.client.0.smithi033.stdout:1/706: dwrite d1/de/f81 [0,4194304] 0 2024-02-15T22:40:56.223 INFO:tasks.workunit.client.0.smithi033.stdout:1/707: write d1/de/d27/d28/f29 [840308,74802] 0 2024-02-15T22:40:56.225 INFO:tasks.workunit.client.0.smithi033.stdout:1/708: unlink d1/de/d27/d28/d2d/d36/f62 0 2024-02-15T22:40:56.225 INFO:tasks.workunit.client.0.smithi033.stdout:1/709: read d1/d20/f65 [823327,114544] 0 2024-02-15T22:40:56.225 INFO:tasks.workunit.client.0.smithi033.stdout:1/710: write d1/de/f1f [693402,106670] 0 2024-02-15T22:40:56.225 INFO:tasks.workunit.client.0.smithi033.stdout:1/711: write d1/de/f63 [3983498,71001] 0 2024-02-15T22:40:56.227 INFO:tasks.workunit.client.0.smithi033.stdout:1/712: getdents d1/d20 0 2024-02-15T22:40:56.227 INFO:tasks.workunit.client.0.smithi033.stdout:1/713: chown d1/d20/d42/d2c/d30/f68 324 1 2024-02-15T22:40:56.232 INFO:tasks.workunit.client.0.smithi033.stdout:2/791: sync 2024-02-15T22:40:56.232 INFO:tasks.workunit.client.0.smithi033.stdout:9/577: sync 2024-02-15T22:40:56.232 INFO:tasks.workunit.client.0.smithi033.stdout:6/507: sync 2024-02-15T22:40:56.234 INFO:tasks.workunit.client.0.smithi033.stdout:9/578: unlink f2 0 2024-02-15T22:40:56.235 INFO:tasks.workunit.client.0.smithi033.stdout:1/714: write d1/de/d27/d28/d2d/f48 [2091704,126808] 0 2024-02-15T22:40:56.235 INFO:tasks.workunit.client.0.smithi033.stdout:6/508: symlink d12/d3c/d95/d3f/lab 0 2024-02-15T22:40:56.238 INFO:tasks.workunit.client.0.smithi033.stdout:1/715: truncate d1/de/f1f 2361382 0 2024-02-15T22:40:56.239 INFO:tasks.workunit.client.0.smithi033.stdout:6/509: rename d12/d3c/d95/d3f/d5b to d12/d3c/d95/d3f/d4b/dac 0 2024-02-15T22:40:56.240 INFO:tasks.workunit.client.0.smithi033.stdout:6/510: creat d12/fad x:0 0 0 2024-02-15T22:40:56.240 INFO:tasks.workunit.client.0.smithi033.stdout:6/511: stat l1 0 2024-02-15T22:40:56.242 INFO:tasks.workunit.client.0.smithi033.stdout:6/512: symlink d12/d2c/d30/d19/lae 0 2024-02-15T22:40:56.242 INFO:tasks.workunit.client.0.smithi033.stdout:2/792: write d1/d66/d75/f83 [3656794,72751] 0 2024-02-15T22:40:56.242 INFO:tasks.workunit.client.0.smithi033.stdout:2/793: chown d1/d8/d2b/d2f/l21 448 1 2024-02-15T22:40:56.243 INFO:tasks.workunit.client.0.smithi033.stdout:6/513: mknod d12/d3c/caf 0 2024-02-15T22:40:56.243 INFO:tasks.workunit.client.0.smithi033.stdout:6/514: readlink d12/d3c/l7a 0 2024-02-15T22:40:56.243 INFO:tasks.workunit.client.0.smithi033.stdout:6/515: chown d12/d2c/d30/d19/d79/c86 0 1 2024-02-15T22:40:56.243 INFO:tasks.workunit.client.0.smithi033.stdout:6/516: write d12/d2c/d30/d19/f97 [251318,101442] 0 2024-02-15T22:40:56.246 INFO:tasks.workunit.client.0.smithi033.stdout:2/794: mkdir d1/d8/d2b/d2f/d24/d2a/dfd 0 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:1/716: dread d1/de/d27/d28/d37/f45 [0,4194304] 0 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:1/717: chown d1/de/d27/d28/d2d/f76 12794142 1 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:1/718: creat d1/de/d27/d28/d2d/d5e/d69/fcf x:0 0 0 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:1/719: dread - d1/d20/d42/d2c/d30/f68 zero size 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:1/720: write d1/d20/d42/d2c/d7b/fc1 [263715,78354] 0 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:6/517: unlink d12/f41 0 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:6/518: write d12/d2c/d30/d19/f8f [262687,30775] 0 2024-02-15T22:40:56.248 INFO:tasks.workunit.client.0.smithi033.stdout:6/519: chown d12/d2c/d30/f16 55 1 2024-02-15T22:40:56.251 INFO:tasks.workunit.client.0.smithi033.stdout:2/795: mkdir d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d62/dfe 0 2024-02-15T22:40:56.251 INFO:tasks.workunit.client.0.smithi033.stdout:2/796: write d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/f95 [4785299,75143] 0 2024-02-15T22:40:56.259 INFO:tasks.workunit.client.0.smithi033.stdout:2/797: dread d1/d8/d2b/d2f/d13/fc7 [0,4194304] 0 2024-02-15T22:40:56.259 INFO:tasks.workunit.client.0.smithi033.stdout:2/798: creat d1/d8/d2b/d2f/d24/d7a/fff x:0 0 0 2024-02-15T22:40:56.259 INFO:tasks.workunit.client.0.smithi033.stdout:2/799: chown d1/d16/d5a 0 1 2024-02-15T22:40:56.261 INFO:tasks.workunit.client.0.smithi033.stdout:2/800: rename d1/d8/d2b/d2f/d24/d2a/c2e to d1/d8/d2b/d2f/d13/da9/d8d/c100 0 2024-02-15T22:40:56.264 INFO:tasks.workunit.client.0.smithi033.stdout:2/801: read d1/d8/d2b/d2f/d24/d31/f81 [4564926,72033] 0 2024-02-15T22:40:56.265 INFO:tasks.workunit.client.0.smithi033.stdout:2/802: truncate d1/d8/d2b/d2f/d24/d31/f3e 2212414 0 2024-02-15T22:40:56.267 INFO:tasks.workunit.client.0.smithi033.stdout:2/803: link d1/d8/d2b/d2f/d24/d2a/d88/d8e/fe5 d1/d8/d2b/d2f/d3d/f101 0 2024-02-15T22:40:56.269 INFO:tasks.workunit.client.0.smithi033.stdout:2/804: creat d1/d8/d2b/d2f/d24/d2a/d88/f102 x:0 0 0 2024-02-15T22:40:56.269 INFO:tasks.workunit.client.0.smithi033.stdout:2/805: fdatasync d1/d8/d2b/d2f/d13/d59/f7d 0 2024-02-15T22:40:56.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/520: dread d12/d2c/d30/d1d/f39 [0,4194304] 0 2024-02-15T22:40:56.270 INFO:tasks.workunit.client.0.smithi033.stdout:6/521: chown d12/d2c/d30/d19/l98 29 1 2024-02-15T22:40:56.271 INFO:tasks.workunit.client.0.smithi033.stdout:2/806: creat d1/d8/d2b/d2f/d12/dae/f103 x:0 0 0 2024-02-15T22:40:56.272 INFO:tasks.workunit.client.0.smithi033.stdout:6/522: mknod d12/d3c/da1/cb0 0 2024-02-15T22:40:56.273 INFO:tasks.workunit.client.0.smithi033.stdout:6/523: mknod d12/d2c/d30/cb1 0 2024-02-15T22:40:56.274 INFO:tasks.workunit.client.0.smithi033.stdout:6/524: creat d12/d3c/d95/d3f/d50/fb2 x:0 0 0 2024-02-15T22:40:56.276 INFO:tasks.workunit.client.0.smithi033.stdout:6/525: symlink d12/d2c/d30/d19/d79/lb3 0 2024-02-15T22:40:56.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 -- 172.21.15.33:0/829668925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 msgr2=0x7fde180fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 --2- 172.21.15.33:0/829668925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde180fe550 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde08004940 tx=0x7fde08009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:56.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 -- 172.21.15.33:0/829668925 shutdown_connections 2024-02-15T22:40:56.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 --2- 172.21.15.33:0/829668925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde180fe550 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 --2- 172.21.15.33:0/829668925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde180fcef0 0x7fde180fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 -- 172.21.15.33:0/829668925 >> 172.21.15.33:0/829668925 conn(0x7fde180f8620 msgr2=0x7fde180faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 -- 172.21.15.33:0/829668925 shutdown_connections 2024-02-15T22:40:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.276+0000 7fde2034c700 1 -- 172.21.15.33:0/829668925 wait complete. 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde2034c700 1 Processor -- start 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde2034c700 1 -- start start 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde2034c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde180fcef0 0x7fde1806ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde2034c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde1806f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde2034c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1806faa0 con 0x7fde180fe0e0 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde2034c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18117490 con 0x7fde180fcef0 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde1d8e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde1806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde1d8e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde1806f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40596/0 (socket says 172.21.15.33:40596) 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde1d8e7700 1 -- 172.21.15.33:0/4034308337 learned_addr learned my addr 172.21.15.33:0/4034308337 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde1e0e8700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde180fcef0 0x7fde1806ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.277+0000 7fde1d8e7700 1 -- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde180fcef0 msgr2=0x7fde1806ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.278+0000 7fde1d8e7700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde180fcef0 0x7fde1806ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.278+0000 7fde1d8e7700 1 -- 172.21.15.33:0/4034308337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08005040 con 0x7fde180fe0e0 2024-02-15T22:40:56.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.278+0000 7fde1e0e8700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde180fcef0 0x7fde1806ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:40:56.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.278+0000 7fde1d8e7700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde1806f450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde08009fd0 tx=0x7fde08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:56.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.278+0000 7fde0effd700 1 -- 172.21.15.33:0/4034308337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0800e040 con 0x7fde180fe0e0 2024-02-15T22:40:56.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.278+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde181176c0 con 0x7fde180fe0e0 2024-02-15T22:40:56.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.278+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde18117c00 con 0x7fde180fe0e0 2024-02-15T22:40:56.282 INFO:tasks.workunit.client.0.smithi033.stdout:2/807: dread d1/d16/d5a/f7b [0,4194304] 0 2024-02-15T22:40:56.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.279+0000 7fde0effd700 1 -- 172.21.15.33:0/4034308337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde08004290 con 0x7fde180fe0e0 2024-02-15T22:40:56.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.279+0000 7fde0effd700 1 -- 172.21.15.33:0/4034308337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0801c3f0 con 0x7fde180fe0e0 2024-02-15T22:40:56.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.280+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc0052e0 con 0x7fde180fe0e0 2024-02-15T22:40:56.283 INFO:tasks.workunit.client.0.smithi033.stdout:2/808: mknod d1/d8/d2b/d2f/d13/da9/c104 0 2024-02-15T22:40:56.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.280+0000 7fde0effd700 1 -- 172.21.15.33:0/4034308337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7fde08025400 con 0x7fde180fe0e0 2024-02-15T22:40:56.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.281+0000 7fde0effd700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fde0406b330 0x7fde0406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:56.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.281+0000 7fde0effd700 1 -- 172.21.15.33:0/4034308337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fde0808b130 con 0x7fde180fe0e0 2024-02-15T22:40:56.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.281+0000 7fde1e0e8700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fde0406b330 0x7fde0406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:56.284 INFO:tasks.workunit.client.0.smithi033.stdout:2/809: creat d1/d8/d2b/d2f/d24/d2a/d88/d8e/f105 x:0 0 0 2024-02-15T22:40:56.287 INFO:tasks.workunit.client.0.smithi033.stdout:2/810: write d1/d8/d2b/d2f/d24/d31/f81 [4186721,100113] 0 2024-02-15T22:40:56.287 INFO:tasks.workunit.client.0.smithi033.stdout:2/811: fdatasync d1/d8/d2b/d2f/d24/d69/f89 0 2024-02-15T22:40:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.282+0000 7fde1e0e8700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fde0406b330 0x7fde0406d7e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde14007fd0 tx=0x7fde1400b040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:56.288 INFO:tasks.workunit.client.0.smithi033.stdout:6/526: dread d12/f18 [0,4194304] 0 2024-02-15T22:40:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.289+0000 7fde0effd700 1 -- 172.21.15.33:0/4034308337 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fde08055230 con 0x7fde180fe0e0 2024-02-15T22:40:56.314 INFO:tasks.workunit.client.0.smithi033.stdout:2/812: creat d1/d8/d2b/d2f/d24/d31/d79/f106 x:0 0 0 2024-02-15T22:40:56.316 INFO:tasks.workunit.client.0.smithi033.stdout:6/527: creat d12/d3c/da1/fb4 x:0 0 0 2024-02-15T22:40:56.392 INFO:tasks.workunit.client.0.smithi033.stdout:2/813: getdents d1/d8/d2b/d2f/d24 0 2024-02-15T22:40:56.393 INFO:tasks.workunit.client.0.smithi033.stdout:2/814: chown d1/d8/d2b/d2f/d24/d31/cdb 44 1 2024-02-15T22:40:56.393 INFO:tasks.workunit.client.0.smithi033.stdout:2/815: chown d1/d16/d3f/df5/dfb 2852529 1 2024-02-15T22:40:56.394 INFO:tasks.workunit.client.0.smithi033.stdout:6/528: creat d12/d3c/d95/fb5 x:0 0 0 2024-02-15T22:40:56.402 INFO:tasks.workunit.client.0.smithi033.stdout:6/529: mkdir d12/d3c/d95/d3f/db6 0 2024-02-15T22:40:56.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/816: dwrite d1/f20 [0,4194304] 0 2024-02-15T22:40:56.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/817: write d1/d66/fdf [5490,92169] 0 2024-02-15T22:40:56.419 INFO:tasks.workunit.client.0.smithi033.stdout:6/530: dwrite d12/d3c/d95/d3f/d50/f65 [0,4194304] 0 2024-02-15T22:40:56.419 INFO:tasks.workunit.client.0.smithi033.stdout:6/531: chown l0 43923 1 2024-02-15T22:40:56.420 INFO:tasks.workunit.client.0.smithi033.stdout:2/818: getdents d1/d8/d2b/d2f/d24/d2a 0 2024-02-15T22:40:56.424 INFO:tasks.workunit.client.0.smithi033.stdout:6/532: mkdir d12/d2c/d30/d19/d79/db7 0 2024-02-15T22:40:56.426 INFO:tasks.workunit.client.0.smithi033.stdout:2/819: truncate d1/d16/d5a/d67/f70 1032494 0 2024-02-15T22:40:56.426 INFO:tasks.workunit.client.0.smithi033.stdout:2/820: creat d1/d16/d5a/d67/f107 x:0 0 0 2024-02-15T22:40:56.428 INFO:tasks.workunit.client.0.smithi033.stdout:6/533: link d12/d3c/d95/d3f/d4b/dac/d5c/l80 d12/d3c/d95/d3f/d4b/dac/d5c/lb8 0 2024-02-15T22:40:56.429 INFO:tasks.workunit.client.0.smithi033.stdout:6/534: dread d12/d2c/d30/d1d/f22 [0,4194304] 0 2024-02-15T22:40:56.431 INFO:tasks.workunit.client.0.smithi033.stdout:2/821: mkdir d1/d16/d3f/df5/d108 0 2024-02-15T22:40:56.432 INFO:tasks.workunit.client.0.smithi033.stdout:2/822: chown d1/d8/d2b/d2f/fb 3944579 1 2024-02-15T22:40:56.433 INFO:tasks.workunit.client.0.smithi033.stdout:2/823: creat d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f109 x:0 0 0 2024-02-15T22:40:56.435 INFO:tasks.workunit.client.0.smithi033.stdout:2/824: mkdir d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/de8/d10a 0 2024-02-15T22:40:56.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/734: sync 2024-02-15T22:40:56.451 INFO:tasks.workunit.client.0.smithi033.stdout:6/535: dwrite d12/d3c/d95/d3f/d50/f8e [0,4194304] 0 2024-02-15T22:40:56.451 INFO:tasks.workunit.client.0.smithi033.stdout:6/536: truncate d12/d2c/d30/d1d/f46 757815 0 2024-02-15T22:40:56.456 INFO:tasks.workunit.client.0.smithi033.stdout:3/735: rename d0/d3/d2c/d5d/l33 to d0/d3/d3b/db1/dd8/lf0 0 2024-02-15T22:40:56.457 INFO:tasks.workunit.client.0.smithi033.stdout:6/537: rename d12/d2c/d30/d1d/f22 to d12/d2c/d30/d19/d79/fb9 0 2024-02-15T22:40:56.457 INFO:tasks.workunit.client.0.smithi033.stdout:6/538: chown d12/d2c/d30/d1d/d35/f47 21861 1 2024-02-15T22:40:56.458 INFO:tasks.workunit.client.0.smithi033.stdout:3/736: unlink d0/d3/f40 0 2024-02-15T22:40:56.459 INFO:tasks.workunit.client.0.smithi033.stdout:3/737: chown d0/d3/c5b 460107 1 2024-02-15T22:40:56.459 INFO:tasks.workunit.client.0.smithi033.stdout:6/539: creat d12/d3c/d95/d3f/d4b/dac/d5c/fba x:0 0 0 2024-02-15T22:40:56.460 INFO:tasks.workunit.client.0.smithi033.stdout:6/540: mknod d12/d2c/d30/da5/cbb 0 2024-02-15T22:40:56.460 INFO:tasks.workunit.client.0.smithi033.stdout:6/541: fdatasync d12/d3c/d95/f52 0 2024-02-15T22:40:56.461 INFO:tasks.workunit.client.0.smithi033.stdout:2/825: dwrite d1/d8/d2b/d2f/d12/f42 [0,4194304] 0 2024-02-15T22:40:56.461 INFO:tasks.workunit.client.0.smithi033.stdout:2/826: write d1/d16/d5a/d67/fd8 [809365,46072] 0 2024-02-15T22:40:56.471 INFO:tasks.workunit.client.0.smithi033.stdout:2/827: dread d1/d8/d2b/d2f/d24/fa7 [0,4194304] 0 2024-02-15T22:40:56.472 INFO:tasks.workunit.client.0.smithi033.stdout:6/542: rename d12/d2c/d30/d19 to d12/d2c/dbc 0 2024-02-15T22:40:56.472 INFO:tasks.workunit.client.0.smithi033.stdout:6/543: write d12/d3c/d95/d3f/d50/f81 [7235099,48796] 0 2024-02-15T22:40:56.472 INFO:tasks.workunit.client.0.smithi033.stdout:6/544: dread - d12/d2c/d30/d1d/fa6 zero size 2024-02-15T22:40:56.473 INFO:tasks.workunit.client.0.smithi033.stdout:2/828: creat d1/d8/d2b/f10b x:0 0 0 2024-02-15T22:40:56.475 INFO:tasks.workunit.client.0.smithi033.stdout:6/545: mkdir d12/d3c/d95/d3f/d50/dbd 0 2024-02-15T22:40:56.475 INFO:tasks.workunit.client.0.smithi033.stdout:6/546: chown d12/d2c/d30/da5 526446888 1 2024-02-15T22:40:56.476 INFO:tasks.workunit.client.0.smithi033.stdout:2/829: dread d1/d16/d5a/d67/f70 [0,4194304] 0 2024-02-15T22:40:56.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/830: dread d1/f48 [0,4194304] 0 2024-02-15T22:40:56.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/831: truncate d1/d8/d2b/d2f/d24/d31/f81 5625274 0 2024-02-15T22:40:56.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/832: write d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d9a/ff8 [879210,93405] 0 2024-02-15T22:40:56.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/833: write d1/d8/d2b/d2f/d12/dae/f103 [1027437,27178] 0 2024-02-15T22:40:56.480 INFO:tasks.workunit.client.0.smithi033.stdout:0/610: sync 2024-02-15T22:40:56.480 INFO:tasks.workunit.client.0.smithi033.stdout:0/611: write db/d19/d32/d3d/f45 [1227290,29478] 0 2024-02-15T22:40:56.480 INFO:tasks.workunit.client.0.smithi033.stdout:0/612: write db/d2a/d68/da9/fc6 [1034761,58115] 0 2024-02-15T22:40:56.480 INFO:tasks.workunit.client.0.smithi033.stdout:0/613: fsync db/d19/d32/d43/f78 0 2024-02-15T22:40:56.480 INFO:tasks.workunit.client.0.smithi033.stdout:0/614: creat db/d2a/d6e/dc3/fcb x:0 0 0 2024-02-15T22:40:56.481 INFO:tasks.workunit.client.0.smithi033.stdout:6/547: write d12/f5d [1176749,49106] 0 2024-02-15T22:40:56.484 INFO:tasks.workunit.client.0.smithi033.stdout:6/548: rmdir d12/d3c/d95/d3f/d4b/dac/d5c 39 2024-02-15T22:40:56.486 INFO:tasks.workunit.client.0.smithi033.stdout:2/834: dread d1/d16/d5a/f97 [0,4194304] 0 2024-02-15T22:40:56.487 INFO:tasks.workunit.client.0.smithi033.stdout:6/549: creat d12/d2c/d30/fbe x:0 0 0 2024-02-15T22:40:56.489 INFO:tasks.workunit.client.0.smithi033.stdout:2/835: rmdir d1/d8/d2b/d2f/d24 39 2024-02-15T22:40:56.489 INFO:tasks.workunit.client.0.smithi033.stdout:6/550: rmdir d12/d2c/d30/da5 39 2024-02-15T22:40:56.489 INFO:tasks.workunit.client.0.smithi033.stdout:6/551: chown d12/d3c/d95/fb5 465 1 2024-02-15T22:40:56.491 INFO:tasks.workunit.client.0.smithi033.stdout:2/836: mknod d1/d8/d2b/d2f/d12/d52/c10c 0 2024-02-15T22:40:56.491 INFO:tasks.workunit.client.0.smithi033.stdout:2/837: write d1/d8/d2b/d2f/d24/d31/f58 [2347462,47126] 0 2024-02-15T22:40:56.493 INFO:tasks.workunit.client.0.smithi033.stdout:6/552: rename d12/d2c/d30/d1d/f7f to d12/d2c/fbf 0 2024-02-15T22:40:56.496 INFO:tasks.workunit.client.0.smithi033.stdout:2/838: unlink d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d9a/fe9 0 2024-02-15T22:40:56.496 INFO:tasks.workunit.client.0.smithi033.stdout:2/839: readlink d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/d99/l9e 0 2024-02-15T22:40:56.496 INFO:tasks.workunit.client.0.smithi033.stdout:2/840: dread - d1/d16/d5a/fea zero size 2024-02-15T22:40:56.497 INFO:tasks.workunit.client.0.smithi033.stdout:2/841: truncate d1/d8/d2b/d2f/d24/d7a/fa5 958737 0 2024-02-15T22:40:56.509 INFO:tasks.workunit.client.0.smithi033.stdout:2/842: dread d1/d8/d2b/d2f/d12/f42 [0,4194304] 0 2024-02-15T22:40:56.509 INFO:tasks.workunit.client.0.smithi033.stdout:2/843: chown d1/d8/d2b/d2f/d13/da9/fef 6733907 1 2024-02-15T22:40:56.510 INFO:tasks.workunit.client.0.smithi033.stdout:0/615: dwrite db/d19/f72 [0,4194304] 0 2024-02-15T22:40:56.510 INFO:tasks.workunit.client.0.smithi033.stdout:2/844: dread d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d9a/fb9 [0,4194304] 0 2024-02-15T22:40:56.511 INFO:tasks.workunit.client.0.smithi033.stdout:6/553: dwrite d12/d2c/d30/d1d/f60 [0,4194304] 0 2024-02-15T22:40:56.512 INFO:tasks.workunit.client.0.smithi033.stdout:0/616: rename db/d19/d32/d46/daf/cb1 to db/d19/d32/d3d/ccc 0 2024-02-15T22:40:56.515 INFO:tasks.workunit.client.0.smithi033.stdout:2/845: symlink d1/d8/d2b/d2f/d13/d59/d76/l10d 0 2024-02-15T22:40:56.518 INFO:tasks.workunit.client.0.smithi033.stdout:6/554: rename d12/d2c/dbc/d79 to d12/d2c/dc0 0 2024-02-15T22:40:56.519 INFO:tasks.workunit.client.0.smithi033.stdout:2/846: mknod d1/d16/d57/c10e 0 2024-02-15T22:40:56.519 INFO:tasks.workunit.client.0.smithi033.stdout:2/847: chown d1/d8/d2b/d2f/d13/d6f/db5/ffc 18524 1 2024-02-15T22:40:56.519 INFO:tasks.workunit.client.0.smithi033.stdout:2/848: fdatasync d1/d8/d2b/d2f/f1e 0 2024-02-15T22:40:56.535 INFO:tasks.workunit.client.0.smithi033.stdout:2/849: dwrite d1/d8/d2b/d2f/d24/d2a/d88/d8e/fe5 [0,4194304] 0 2024-02-15T22:40:56.538 INFO:tasks.workunit.client.0.smithi033.stdout:2/850: rmdir d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d62 39 2024-02-15T22:40:56.542 INFO:tasks.workunit.client.0.smithi033.stdout:2/851: dread d1/d8/d2b/d2f/d12/dae/fdd [0,4194304] 0 2024-02-15T22:40:56.542 INFO:tasks.workunit.client.0.smithi033.stdout:2/852: readlink d1/d8/d2b/d2f/d24/d5d/l6a 0 2024-02-15T22:40:56.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.683+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddfc005860 con 0x7fde180fe0e0 2024-02-15T22:40:56.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.684+0000 7fde0effd700 1 -- 172.21.15.33:0/4034308337 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fde080588f0 con 0x7fde180fe0e0 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 1, 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:56.685 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:40:56.686 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:40:56.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:40:56.686 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:40:56.686 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 13, 2024-02-15T22:40:56.686 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:40:56.686 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:40:56.686 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fde0406b330 msgr2=0x7fde0406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fde0406b330 0x7fde0406d7e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde14007fd0 tx=0x7fde1400b040 comp rx=0 tx=0).stop 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 msgr2=0x7fde1806f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde1806f450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde08009fd0 tx=0x7fde08009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 shutdown_connections 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fde0406b330 0x7fde0406d7e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde180fcef0 0x7fde1806ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 --2- 172.21.15.33:0/4034308337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde180fe0e0 0x7fde1806f450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 >> 172.21.15.33:0/4034308337 conn(0x7fde180f8620 msgr2=0x7fde181013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 shutdown_connections 2024-02-15T22:40:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.686+0000 7fde2034c700 1 -- 172.21.15.33:0/4034308337 wait complete. 2024-02-15T22:40:56.694 INFO:tasks.workunit.client.0.smithi033.stdout:5/708: sync 2024-02-15T22:40:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:8/703: sync 2024-02-15T22:40:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:1/721: sync 2024-02-15T22:40:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:7/698: sync 2024-02-15T22:40:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:4/758: sync 2024-02-15T22:40:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:9/579: sync 2024-02-15T22:40:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:7/699: write d5/d6/d10/fbe [588035,104248] 0 2024-02-15T22:40:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:9/580: creat d4/d1d/d23/d32/d3e/d86/d3f/d94/fae x:0 0 0 2024-02-15T22:40:56.697 INFO:tasks.workunit.client.0.smithi033.stdout:5/709: rename d6/d14/d31/d48/d49/d53/d57/da1/cc6 to d6/d14/d31/d48/cde 0 2024-02-15T22:40:56.697 INFO:tasks.workunit.client.0.smithi033.stdout:5/710: fsync d6/d14/d31/d48/d49/f84 0 2024-02-15T22:40:56.697 INFO:tasks.workunit.client.0.smithi033.stdout:5/711: stat d6/d25/d99/fa4 0 2024-02-15T22:40:56.706 INFO:tasks.workunit.client.0.smithi033.stdout:4/759: truncate d8/d16/d45/d8f/d93/fd4 475738 0 2024-02-15T22:40:56.706 INFO:tasks.workunit.client.0.smithi033.stdout:5/712: creat d6/d14/d31/d48/d49/fdf x:0 0 0 2024-02-15T22:40:56.706 INFO:tasks.workunit.client.0.smithi033.stdout:1/722: getdents d1/de/d27/d28/d79/dc4 0 2024-02-15T22:40:56.707 INFO:tasks.workunit.client.0.smithi033.stdout:5/713: write d6/d14/d31/d38/d9b/dd3/fc4 [41323,18722] 0 2024-02-15T22:40:56.709 INFO:tasks.workunit.client.0.smithi033.stdout:5/714: symlink d6/d25/d99/da8/le0 0 2024-02-15T22:40:56.713 INFO:tasks.workunit.client.0.smithi033.stdout:5/715: link d6/l75 d6/d25/le1 0 2024-02-15T22:40:56.714 INFO:tasks.workunit.client.0.smithi033.stdout:5/716: link d6/d14/d31/d48/cde d6/d14/d31/d50/d6a/dab/ce2 0 2024-02-15T22:40:56.716 INFO:tasks.workunit.client.0.smithi033.stdout:5/717: unlink d6/d14/d31/d48/d49/f84 0 2024-02-15T22:40:56.716 INFO:tasks.workunit.client.0.smithi033.stdout:5/718: truncate d6/d14/d31/d38/d9b/dd2/f8d 380760 0 2024-02-15T22:40:56.716 INFO:tasks.workunit.client.0.smithi033.stdout:5/719: chown d6/d14/f2e 15938 1 2024-02-15T22:40:56.717 INFO:tasks.workunit.client.0.smithi033.stdout:5/720: creat d6/d14/d31/d50/d6a/dab/fe3 x:0 0 0 2024-02-15T22:40:56.719 INFO:tasks.workunit.client.0.smithi033.stdout:5/721: link d6/d14/d31/d38/d9b/fc8 d6/db0/d70/fe4 0 2024-02-15T22:40:56.720 INFO:tasks.workunit.client.0.smithi033.stdout:4/760: dread d8/d16/d51/d1c/db9/d37/d31/f34 [0,4194304] 0 2024-02-15T22:40:56.721 INFO:tasks.workunit.client.0.smithi033.stdout:4/761: rmdir d8/d16/d45/db1 39 2024-02-15T22:40:56.721 INFO:tasks.workunit.client.0.smithi033.stdout:4/762: truncate d8/d16/d51/d56/f8d 599818 0 2024-02-15T22:40:56.723 INFO:tasks.workunit.client.0.smithi033.stdout:4/763: symlink d8/d16/d51/d1c/d94/l101 0 2024-02-15T22:40:56.729 INFO:tasks.workunit.client.0.smithi033.stdout:7/700: dwrite d5/dc/d5f/d8b/da0/dc6/dcd/fb3 [0,4194304] 0 2024-02-15T22:40:56.729 INFO:tasks.workunit.client.0.smithi033.stdout:7/701: chown d5/dc/d5f/d8b/da0/cbf 425 1 2024-02-15T22:40:56.730 INFO:tasks.workunit.client.0.smithi033.stdout:8/704: dwrite d1/de/d1a/f20 [0,4194304] 0 2024-02-15T22:40:56.733 INFO:tasks.workunit.client.0.smithi033.stdout:8/705: truncate d1/d6/f6c 378632 0 2024-02-15T22:40:56.735 INFO:tasks.workunit.client.0.smithi033.stdout:9/581: dwrite d4/d1d/f7a [4194304,4194304] 0 2024-02-15T22:40:56.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/582: mkdir d4/d1d/daf 0 2024-02-15T22:40:56.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/583: chown d4/d1d/d23/d7b/l7f 7333513 1 2024-02-15T22:40:56.738 INFO:tasks.workunit.client.0.smithi033.stdout:9/584: write d4/d1d/d23/d32/d3e/d86/f53 [1072058,20897] 0 2024-02-15T22:40:56.739 INFO:tasks.workunit.client.0.smithi033.stdout:9/585: mkdir d4/dac/db0 0 2024-02-15T22:40:56.739 INFO:tasks.workunit.client.0.smithi033.stdout:9/586: readlink d4/d1d/l26 0 2024-02-15T22:40:56.740 INFO:tasks.workunit.client.0.smithi033.stdout:9/587: creat d4/d1d/d23/d32/d3e/d86/d3f/fb1 x:0 0 0 2024-02-15T22:40:56.741 INFO:tasks.workunit.client.0.smithi033.stdout:7/702: write d5/f31 [1471869,14745] 0 2024-02-15T22:40:56.743 INFO:tasks.workunit.client.0.smithi033.stdout:7/703: write d5/df/d56/d60/f6b [399937,87883] 0 2024-02-15T22:40:56.743 INFO:tasks.workunit.client.0.smithi033.stdout:5/722: dwrite d6/d14/f6e [0,4194304] 0 2024-02-15T22:40:56.743 INFO:tasks.workunit.client.0.smithi033.stdout:9/588: rename d4/d1d/d23/d32/d3e/d86/d3f/f45 to d4/d1d/d23/d32/d71/dab/fb2 0 2024-02-15T22:40:56.744 INFO:tasks.workunit.client.0.smithi033.stdout:9/589: dread - d4/d1d/d23/d24/d51/d5d/fa2 zero size 2024-02-15T22:40:56.745 INFO:tasks.workunit.client.0.smithi033.stdout:4/764: dwrite d8/fe [4194304,4194304] 0 2024-02-15T22:40:56.748 INFO:tasks.workunit.client.0.smithi033.stdout:9/590: creat d4/d1d/d23/d32/d71/fb3 x:0 0 0 2024-02-15T22:40:56.751 INFO:tasks.workunit.client.0.smithi033.stdout:4/765: creat d8/d16/d45/db1/f102 x:0 0 0 2024-02-15T22:40:56.751 INFO:tasks.workunit.client.0.smithi033.stdout:4/766: chown d8/d16/d51/d1c/d50/da1/dc1/lb8 913649047 1 2024-02-15T22:40:56.751 INFO:tasks.workunit.client.0.smithi033.stdout:4/767: creat d8/d16/d51/d1c/d3c/d49/dac/f103 x:0 0 0 2024-02-15T22:40:56.753 INFO:tasks.workunit.client.0.smithi033.stdout:9/591: stat d4/f16 0 2024-02-15T22:40:56.754 INFO:tasks.workunit.client.0.smithi033.stdout:8/706: dwrite d1/de/f56 [0,4194304] 0 2024-02-15T22:40:56.761 INFO:tasks.workunit.client.0.smithi033.stdout:5/723: dread d6/f1b [0,4194304] 0 2024-02-15T22:40:56.762 INFO:tasks.workunit.client.0.smithi033.stdout:5/724: mknod d6/d14/d31/d38/ce5 0 2024-02-15T22:40:56.764 INFO:tasks.workunit.client.0.smithi033.stdout:7/704: dwrite d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/f7c [0,4194304] 0 2024-02-15T22:40:56.766 INFO:tasks.workunit.client.0.smithi033.stdout:7/705: rename d5/df/d56/d60/d59/d9c/da6/fcf to d5/dc/d5f/d8b/da0/dc6/fed 0 2024-02-15T22:40:56.767 INFO:tasks.workunit.client.0.smithi033.stdout:7/706: link d5/df/d40/f79 d5/df/d40/d73/fee 0 2024-02-15T22:40:56.767 INFO:tasks.workunit.client.0.smithi033.stdout:7/707: getdents d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b 0 2024-02-15T22:40:56.769 INFO:tasks.workunit.client.0.smithi033.stdout:7/708: rename d5/df/d40/f79 to d5/dc/d5f/d8b/fef 0 2024-02-15T22:40:56.769 INFO:tasks.workunit.client.0.smithi033.stdout:7/709: chown l2 1510042 1 2024-02-15T22:40:56.776 INFO:tasks.workunit.client.0.smithi033.stdout:8/707: read d1/de/f56 [1516000,59091] 0 2024-02-15T22:40:56.776 INFO:tasks.workunit.client.0.smithi033.stdout:5/725: dread d6/d14/d31/d48/f5e [0,4194304] 0 2024-02-15T22:40:56.776 INFO:tasks.workunit.client.0.smithi033.stdout:9/592: dwrite d4/d1d/d23/d32/f4f [0,4194304] 0 2024-02-15T22:40:56.777 INFO:tasks.workunit.client.0.smithi033.stdout:9/593: creat d4/d1d/d23/d24/d5e/fb4 x:0 0 0 2024-02-15T22:40:56.777 INFO:tasks.workunit.client.0.smithi033.stdout:9/594: dread - d4/d1d/d23/d32/f67 zero size 2024-02-15T22:40:56.778 INFO:tasks.workunit.client.0.smithi033.stdout:9/595: chown d4/c1c 3653 1 2024-02-15T22:40:56.778 INFO:tasks.workunit.client.0.smithi033.stdout:9/596: chown d4/d1d/d23/d24/f25 12 1 2024-02-15T22:40:56.780 INFO:tasks.workunit.client.0.smithi033.stdout:5/726: dread d6/f1b [0,4194304] 0 2024-02-15T22:40:56.781 INFO:tasks.workunit.client.0.smithi033.stdout:9/597: mknod d4/d1d/d23/d32/d3e/d86/cb5 0 2024-02-15T22:40:56.784 INFO:tasks.workunit.client.0.smithi033.stdout:5/727: rename d6/d14/d31/d38/f8f to d6/d14/d31/d50/fe6 0 2024-02-15T22:40:56.784 INFO:tasks.workunit.client.0.smithi033.stdout:5/728: fdatasync d6/d14/d31/d50/d5c/f97 0 2024-02-15T22:40:56.785 INFO:tasks.workunit.client.0.smithi033.stdout:5/729: chown d6/c26 210819 1 2024-02-15T22:40:56.785 INFO:tasks.workunit.client.0.smithi033.stdout:5/730: read - d6/d14/d31/d38/d9b/dd2/fb7 zero size 2024-02-15T22:40:56.786 INFO:tasks.workunit.client.0.smithi033.stdout:5/731: mknod d6/d14/d31/d50/ce7 0 2024-02-15T22:40:56.786 INFO:tasks.workunit.client.0.smithi033.stdout:5/732: chown d6/d14/d31/d50/l9d 27667369 1 2024-02-15T22:40:56.791 INFO:tasks.workunit.client.0.smithi033.stdout:9/598: dread d4/d1d/d23/d35/f63 [0,4194304] 0 2024-02-15T22:40:56.792 INFO:tasks.workunit.client.0.smithi033.stdout:9/599: write d4/f15 [765151,15143] 0 2024-02-15T22:40:56.792 INFO:tasks.workunit.client.0.smithi033.stdout:5/733: mknod d6/d25/d99/da8/ce8 0 2024-02-15T22:40:56.792 INFO:tasks.workunit.client.0.smithi033.stdout:5/734: chown d6/d14/d31/d50/d6a/dab/cd4 611 1 2024-02-15T22:40:56.792 INFO:tasks.workunit.client.0.smithi033.stdout:5/735: readlink d6/d14/d31/d50/d6a/daf/lbc 0 2024-02-15T22:40:56.793 INFO:tasks.workunit.client.0.smithi033.stdout:9/600: link d4/d1d/d23/d32/d3e/c6c d4/d1d/d23/d24/d5a/cb6 0 2024-02-15T22:40:56.794 INFO:tasks.workunit.client.0.smithi033.stdout:5/736: symlink d6/d14/d31/d48/d49/d53/le9 0 2024-02-15T22:40:56.796 INFO:tasks.workunit.client.0.smithi033.stdout:9/601: mknod d4/d1d/d23/d24/d5a/d72/cb7 0 2024-02-15T22:40:56.796 INFO:tasks.workunit.client.0.smithi033.stdout:9/602: fsync d4/d1d/d23/d35/f8b 0 2024-02-15T22:40:56.796 INFO:tasks.workunit.client.0.smithi033.stdout:9/603: write d4/d1d/f3c [5532707,123293] 0 2024-02-15T22:40:56.797 INFO:tasks.workunit.client.0.smithi033.stdout:8/708: dwrite d1/de/d5c/f6d [0,4194304] 0 2024-02-15T22:40:56.799 INFO:tasks.workunit.client.0.smithi033.stdout:8/709: mknod d1/de/d1a/d27/d60/cf6 0 2024-02-15T22:40:56.800 INFO:tasks.workunit.client.0.smithi033.stdout:8/710: mkdir d1/de/d1a/d27/ddf/de6/df7 0 2024-02-15T22:40:56.801 INFO:tasks.workunit.client.0.smithi033.stdout:8/711: creat d1/d68/d44/dd3/ff8 x:0 0 0 2024-02-15T22:40:56.801 INFO:tasks.workunit.client.0.smithi033.stdout:8/712: readlink d1/de/d1a/d27/d70/l7f 0 2024-02-15T22:40:56.804 INFO:tasks.workunit.client.0.smithi033.stdout:8/713: truncate d1/d68/d44/d49/f7b 4609903 0 2024-02-15T22:40:56.817 INFO:tasks.workunit.client.0.smithi033.stdout:9/604: dwrite d4/d1d/d23/d24/d51/d5d/d90/fa8 [0,4194304] 0 2024-02-15T22:40:56.828 INFO:tasks.workunit.client.0.smithi033.stdout:9/605: dread d4/d1d/d23/d24/f25 [0,4194304] 0 2024-02-15T22:40:56.828 INFO:tasks.workunit.client.0.smithi033.stdout:5/737: dwrite d6/d25/f5d [0,4194304] 0 2024-02-15T22:40:56.829 INFO:tasks.workunit.client.0.smithi033.stdout:8/714: dwrite d1/d68/d44/f9b [4194304,4194304] 0 2024-02-15T22:40:56.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/606: dread d4/f16 [0,4194304] 0 2024-02-15T22:40:56.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/607: write d4/d1d/d23/d35/f77 [3207446,300] 0 2024-02-15T22:40:56.830 INFO:tasks.workunit.client.0.smithi033.stdout:5/738: rename d6/d14/d31/d50/ce7 to d6/d14/d31/d38/d9b/dd3/d7a/cea 0 2024-02-15T22:40:56.836 INFO:tasks.workunit.client.0.smithi033.stdout:8/715: mknod d1/d74/cf9 0 2024-02-15T22:40:56.842 INFO:tasks.workunit.client.0.smithi033.stdout:9/608: dread d4/d1d/d23/f7c [0,4194304] 0 2024-02-15T22:40:56.842 INFO:tasks.workunit.client.0.smithi033.stdout:9/609: chown d4/d1d/d23/d32/d3e/l8d 659999 1 2024-02-15T22:40:56.843 INFO:tasks.workunit.client.0.smithi033.stdout:9/610: symlink d4/d1d/d23/d24/d51/lb8 0 2024-02-15T22:40:56.843 INFO:tasks.workunit.client.0.smithi033.stdout:9/611: fdatasync d4/d1d/d23/d24/d51/d5d/d90/fa1 0 2024-02-15T22:40:56.843 INFO:tasks.workunit.client.0.smithi033.stdout:9/612: creat d4/dac/db0/fb9 x:0 0 0 2024-02-15T22:40:56.846 INFO:tasks.workunit.client.0.smithi033.stdout:9/613: dread d4/f15 [0,4194304] 0 2024-02-15T22:40:56.846 INFO:tasks.workunit.client.0.smithi033.stdout:9/614: write d4/d1d/d23/d35/f77 [2614597,121221] 0 2024-02-15T22:40:56.847 INFO:tasks.workunit.client.0.smithi033.stdout:9/615: mkdir d4/d1d/daf/dba 0 2024-02-15T22:40:56.847 INFO:tasks.workunit.client.0.smithi033.stdout:5/739: dwrite d6/d14/f6b [0,4194304] 0 2024-02-15T22:40:56.848 INFO:tasks.workunit.client.0.smithi033.stdout:9/616: mkdir d4/d1d/d23/d24/d5a/dbb 0 2024-02-15T22:40:56.850 INFO:tasks.workunit.client.0.smithi033.stdout:5/740: truncate d6/d14/f2e 741463 0 2024-02-15T22:40:56.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.853+0000 7f70e9922700 1 -- 172.21.15.33:0/3705556760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406eeb0 msgr2=0x7f70e4108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.853+0000 7f70e9922700 1 --2- 172.21.15.33:0/3705556760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406eeb0 0x7f70e4108fb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f70d8004940 tx=0x7f70d8009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:56.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.853+0000 7f70e9922700 1 -- 172.21.15.33:0/3705556760 shutdown_connections 2024-02-15T22:40:56.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.853+0000 7f70e9922700 1 --2- 172.21.15.33:0/3705556760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406eeb0 0x7f70e4108fb0 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f70d8004940 tx=0x7f70d8009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:56.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.853+0000 7f70e9922700 1 --2- 172.21.15.33:0/3705556760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e406e560 0x7f70e406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.853+0000 7f70e9922700 1 -- 172.21.15.33:0/3705556760 >> 172.21.15.33:0/3705556760 conn(0x7f70e4069e70 msgr2=0x7f70e406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:56.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.854+0000 7f70e9922700 1 -- 172.21.15.33:0/3705556760 shutdown_connections 2024-02-15T22:40:56.856 INFO:tasks.workunit.client.0.smithi033.stdout:5/741: dread d6/d25/f55 [0,4194304] 0 2024-02-15T22:40:56.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.854+0000 7f70e9922700 1 -- 172.21.15.33:0/3705556760 wait complete. 2024-02-15T22:40:56.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.855+0000 7f70e9922700 1 Processor -- start 2024-02-15T22:40:56.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.855+0000 7f70e9922700 1 -- start start 2024-02-15T22:40:56.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.856+0000 7f70e9922700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406e560 0x7f70e411c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:56.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.856+0000 7f70e9922700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e411cd60 0x7f70e411dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:56.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.856+0000 7f70e9922700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e411d240 con 0x7f70e406e560 2024-02-15T22:40:56.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.856+0000 7f70e9922700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e411d3b0 con 0x7f70e411cd60 2024-02-15T22:40:56.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.857+0000 7f70e27fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e411cd60 0x7f70e411dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:56.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.857+0000 7f70e2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406e560 0x7f70e411c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:56.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.857+0000 7f70e2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406e560 0x7f70e411c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48644/0 (socket says 172.21.15.33:48644) 2024-02-15T22:40:56.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.857+0000 7f70e2ffd700 1 -- 172.21.15.33:0/2090164967 learned_addr learned my addr 172.21.15.33:0/2090164967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:40:56.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.858+0000 7f70e2ffd700 1 -- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e411cd60 msgr2=0x7f70e411dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:56.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.858+0000 7f70e2ffd700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e411cd60 0x7f70e411dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:56.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.858+0000 7f70e2ffd700 1 -- 172.21.15.33:0/2090164967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8005040 con 0x7f70e406e560 2024-02-15T22:40:56.860 INFO:tasks.workunit.client.0.smithi033.stdout:5/742: creat d6/feb x:0 0 0 2024-02-15T22:40:56.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.859+0000 7f70e2ffd700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406e560 0x7f70e411c820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70d4002a80 tx=0x7f70d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:56.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.859+0000 7f70cb7fe700 1 -- 172.21.15.33:0/2090164967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d4007cc0 con 0x7f70e406e560 2024-02-15T22:40:56.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.859+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e411e2a0 con 0x7f70e406e560 2024-02-15T22:40:56.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.859+0000 7f70cb7fe700 1 -- 172.21.15.33:0/2090164967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70d400f040 con 0x7f70e406e560 2024-02-15T22:40:56.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.859+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e411e7e0 con 0x7f70e406e560 2024-02-15T22:40:56.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.859+0000 7f70cb7fe700 1 -- 172.21.15.33:0/2090164967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d400da30 con 0x7f70e406e560 2024-02-15T22:40:56.862 INFO:tasks.workunit.client.0.smithi033.stdout:5/743: unlink d6/d14/d31/d38/l89 0 2024-02-15T22:40:56.862 INFO:tasks.workunit.client.0.smithi033.stdout:5/744: read - d6/d14/d31/d38/fcb zero size 2024-02-15T22:40:56.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.861+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d00052e0 con 0x7f70e406e560 2024-02-15T22:40:56.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.862+0000 7f70cb7fe700 1 -- 172.21.15.33:0/2090164967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f70d400db90 con 0x7f70e406e560 2024-02-15T22:40:56.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.862+0000 7f70cb7fe700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f70cc06b3b0 0x7f70cc06d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:40:56.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.862+0000 7f70cb7fe700 1 -- 172.21.15.33:0/2090164967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f70d4089a30 con 0x7f70e406e560 2024-02-15T22:40:56.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.863+0000 7f70e27fc700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f70cc06b3b0 0x7f70cc06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:40:56.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.864+0000 7f70e27fc700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f70cc06b3b0 0x7f70cc06d860 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c00 tx=0x7f70d8009e30 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:40:56.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:56.868+0000 7f70cb7fe700 1 -- 172.21.15.33:0/2090164967 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f70d4053a70 con 0x7f70e406e560 2024-02-15T22:40:56.871 INFO:tasks.workunit.client.0.smithi033.stdout:8/716: dwrite d1/de/d1a/d2a/fcd [0,4194304] 0 2024-02-15T22:40:56.871 INFO:tasks.workunit.client.0.smithi033.stdout:8/717: read d1/d74/dc1/d75/d83/fa9 [129613,118424] 0 2024-02-15T22:40:56.871 INFO:tasks.workunit.client.0.smithi033.stdout:9/617: dwrite d4/d1d/d23/d35/f77 [0,4194304] 0 2024-02-15T22:40:56.873 INFO:tasks.workunit.client.0.smithi033.stdout:8/718: creat d1/d68/d44/d49/ffa x:0 0 0 2024-02-15T22:40:56.876 INFO:tasks.workunit.client.0.smithi033.stdout:8/719: rename d1/d6 to d1/d74/dc1/d75/db1/db5/dfb 0 2024-02-15T22:40:56.878 INFO:tasks.workunit.client.0.smithi033.stdout:8/720: getdents d1/dae 0 2024-02-15T22:40:56.880 INFO:tasks.workunit.client.0.smithi033.stdout:8/721: creat d1/de/d5c/df4/ffc x:0 0 0 2024-02-15T22:40:56.880 INFO:tasks.workunit.client.0.smithi033.stdout:8/722: creat d1/de/d1a/ffd x:0 0 0 2024-02-15T22:40:56.881 INFO:tasks.workunit.client.0.smithi033.stdout:5/745: dwrite d6/d14/d31/d50/d5c/f9e [0,4194304] 0 2024-02-15T22:40:56.882 INFO:tasks.workunit.client.0.smithi033.stdout:8/723: mknod d1/d74/dc1/d75/db1/dde/cfe 0 2024-02-15T22:40:56.884 INFO:tasks.workunit.client.0.smithi033.stdout:9/618: dread d4/d1d/d23/d32/d3e/f56 [0,4194304] 0 2024-02-15T22:40:56.884 INFO:tasks.workunit.client.0.smithi033.stdout:9/619: write d4/d1d/d23/d35/f8b [416924,76976] 0 2024-02-15T22:40:56.886 INFO:tasks.workunit.client.0.smithi033.stdout:5/746: symlink d6/d14/d31/d38/d3f/lec 0 2024-02-15T22:40:56.887 INFO:tasks.workunit.client.0.smithi033.stdout:8/724: rename d1/de/d1a/f69 to d1/de/d1a/d27/fff 0 2024-02-15T22:40:56.889 INFO:tasks.workunit.client.0.smithi033.stdout:8/725: read d1/de/d1a/d27/d60/fc9 [521294,1636] 0 2024-02-15T22:40:56.889 INFO:tasks.workunit.client.0.smithi033.stdout:3/738: sync 2024-02-15T22:40:56.890 INFO:tasks.workunit.client.0.smithi033.stdout:3/739: dread d0/d3/d2c/d5d/d3d/f48 [0,4194304] 0 2024-02-15T22:40:56.891 INFO:tasks.workunit.client.0.smithi033.stdout:8/726: mknod d1/de/d1a/d27/d60/c100 0 2024-02-15T22:40:56.893 INFO:tasks.workunit.client.0.smithi033.stdout:5/747: getdents d6/d14/d31/d48/d49 0 2024-02-15T22:40:56.893 INFO:tasks.workunit.client.0.smithi033.stdout:5/748: chown d6/d14/d31/d38/d9b/dd2/fbe 200636 1 2024-02-15T22:40:56.893 INFO:tasks.workunit.client.0.smithi033.stdout:9/620: dread d4/d1d/d23/d35/f77 [0,4194304] 0 2024-02-15T22:40:56.893 INFO:tasks.workunit.client.0.smithi033.stdout:9/621: chown d4/d1d/l34 612831676 1 2024-02-15T22:40:56.894 INFO:tasks.workunit.client.0.smithi033.stdout:3/740: rename d0/d3/dd/f76 to d0/d3/d5f/da7/ff1 0 2024-02-15T22:40:56.899 INFO:tasks.workunit.client.0.smithi033.stdout:8/727: creat d1/d74/dc1/d75/db1/db5/dfb/d14/d5d/d72/f101 x:0 0 0 2024-02-15T22:40:56.899 INFO:tasks.workunit.client.0.smithi033.stdout:8/728: creat d1/de/d1a/d2a/f102 x:0 0 0 2024-02-15T22:40:56.899 INFO:tasks.workunit.client.0.smithi033.stdout:8/729: read d1/d74/dc1/f50 [2791566,42456] 0 2024-02-15T22:40:56.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/749: stat d6/d14/f1c 0 2024-02-15T22:40:56.904 INFO:tasks.workunit.client.0.smithi033.stdout:5/750: symlink d6/d14/d31/d50/d6a/daf/led 0 2024-02-15T22:40:56.904 INFO:tasks.workunit.client.0.smithi033.stdout:5/751: chown d6/d14/d31/d38/c6d 42072 1 2024-02-15T22:40:56.918 INFO:tasks.workunit.client.0.smithi033.stdout:5/752: write d6/db0/d70/fe4 [2033307,122076] 0 2024-02-15T22:40:56.919 INFO:tasks.workunit.client.0.smithi033.stdout:9/622: dwrite d4/d1d/d23/d32/d3e/f44 [0,4194304] 0 2024-02-15T22:40:56.919 INFO:tasks.workunit.client.0.smithi033.stdout:3/741: dwrite d0/d3/d5f/fcc [0,4194304] 0 2024-02-15T22:40:56.919 INFO:tasks.workunit.client.0.smithi033.stdout:5/753: stat d6/d14/d31/d50/d6a/daf/led 0 2024-02-15T22:40:56.919 INFO:tasks.workunit.client.0.smithi033.stdout:9/623: stat d4/d1d/d23/d32/d3e/f44 0 2024-02-15T22:40:56.921 INFO:tasks.workunit.client.0.smithi033.stdout:3/742: rename d0/d3/c62 to d0/d3/d2c/d5d/d3d/db6/cf2 0 2024-02-15T22:40:56.922 INFO:tasks.workunit.client.0.smithi033.stdout:9/624: mkdir d4/d1d/d23/d24/d51/d5d/dbc 0 2024-02-15T22:40:56.922 INFO:tasks.workunit.client.0.smithi033.stdout:9/625: creat d4/d1d/d42/fbd x:0 0 0 2024-02-15T22:40:56.923 INFO:tasks.workunit.client.0.smithi033.stdout:9/626: getdents d4/d1d/daf 0 2024-02-15T22:40:56.924 INFO:tasks.workunit.client.0.smithi033.stdout:9/627: mknod d4/d1d/d83/cbe 0 2024-02-15T22:40:56.926 INFO:tasks.workunit.client.0.smithi033.stdout:9/628: mknod d4/d1d/d23/d32/d3e/cbf 0 2024-02-15T22:40:56.927 INFO:tasks.workunit.client.0.smithi033.stdout:9/629: readlink d4/l31 0 2024-02-15T22:40:56.929 INFO:tasks.workunit.client.0.smithi033.stdout:9/630: link d4/f19 d4/d1d/d23/d35/fc0 0 2024-02-15T22:40:56.929 INFO:tasks.workunit.client.0.smithi033.stdout:9/631: fsync d4/d1d/d23/d32/d3e/f44 0 2024-02-15T22:40:56.929 INFO:tasks.workunit.client.0.smithi033.stdout:9/632: fdatasync d4/f19 0 2024-02-15T22:40:56.930 INFO:tasks.workunit.client.0.smithi033.stdout:9/633: chown d4/d1d/d23/f98 44975491 1 2024-02-15T22:40:56.930 INFO:tasks.workunit.client.0.smithi033.stdout:9/634: write d4/d1d/d23/d35/f87 [289817,102017] 0 2024-02-15T22:40:56.931 INFO:tasks.workunit.client.0.smithi033.stdout:9/635: mknod d4/d1d/d23/d32/d3e/d86/d3f/cc1 0 2024-02-15T22:40:56.931 INFO:tasks.workunit.client.0.smithi033.stdout:9/636: chown d4/dac 161 1 2024-02-15T22:40:56.931 INFO:tasks.workunit.client.0.smithi033.stdout:3/743: dread d0/d3/d2c/d43/f61 [0,4194304] 0 2024-02-15T22:40:56.933 INFO:tasks.workunit.client.0.smithi033.stdout:9/637: write d4/d1d/d23/d24/f25 [4295315,75271] 0 2024-02-15T22:40:56.934 INFO:tasks.workunit.client.0.smithi033.stdout:9/638: mknod d4/d1d/d23/d24/d5e/cc2 0 2024-02-15T22:40:56.941 INFO:tasks.workunit.client.0.smithi033.stdout:3/744: write d0/d1c/f6b [1388486,15742] 0 2024-02-15T22:40:56.942 INFO:tasks.workunit.client.0.smithi033.stdout:5/754: dwrite d6/d14/d31/d38/d9b/dd3/f8a [4194304,4194304] 0 2024-02-15T22:40:56.942 INFO:tasks.workunit.client.0.smithi033.stdout:5/755: creat d6/d14/d31/d50/d6a/daf/fee x:0 0 0 2024-02-15T22:40:56.943 INFO:tasks.workunit.client.0.smithi033.stdout:3/745: creat d0/dc0/ff3 x:0 0 0 2024-02-15T22:40:56.949 INFO:tasks.workunit.client.0.smithi033.stdout:9/639: write d4/d1d/d23/d32/d3e/f64 [1750960,44564] 0 2024-02-15T22:40:56.949 INFO:tasks.workunit.client.0.smithi033.stdout:3/746: mknod d0/d3/d5f/da7/cf4 0 2024-02-15T22:40:56.951 INFO:tasks.workunit.client.0.smithi033.stdout:3/747: dread d0/d3/d3b/d47/f50 [0,4194304] 0 2024-02-15T22:40:56.954 INFO:tasks.workunit.client.0.smithi033.stdout:3/748: creat d0/d3/d2c/d5d/d3d/d57/d68/ff5 x:0 0 0 2024-02-15T22:40:56.954 INFO:tasks.workunit.client.0.smithi033.stdout:3/749: dread - d0/d3/dd/fc9 zero size 2024-02-15T22:40:56.954 INFO:tasks.workunit.client.0.smithi033.stdout:3/750: readlink d0/l2e 0 2024-02-15T22:40:56.954 INFO:tasks.workunit.client.0.smithi033.stdout:3/751: dread - d0/d3/d3b/d47/f84 zero size 2024-02-15T22:40:56.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/752: read d0/d3/d3b/f71 [305374,5621] 0 2024-02-15T22:40:56.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/753: truncate d0/d3/d3b/d47/f84 670928 0 2024-02-15T22:40:56.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/754: chown d0/d3/d65/f8e 5605916 1 2024-02-15T22:40:56.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/755: dread - d0/d3/dd/fc9 zero size 2024-02-15T22:40:56.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/756: readlink d0/d91/lba 0 2024-02-15T22:40:56.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/757: dread - d0/d3/d2c/d5d/fd6 zero size 2024-02-15T22:40:56.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/758: write d0/d1c/fbd [691137,90607] 0 2024-02-15T22:40:56.956 INFO:tasks.workunit.client.0.smithi033.stdout:3/759: write d0/d3/d2c/d5d/d3d/d8f/fb9 [564265,55815] 0 2024-02-15T22:40:56.956 INFO:tasks.workunit.client.0.smithi033.stdout:3/760: truncate d0/d3/d2c/d5d/d3d/db6/fb8 1493681 0 2024-02-15T22:40:56.957 INFO:tasks.workunit.client.0.smithi033.stdout:0/617: sync 2024-02-15T22:40:56.957 INFO:tasks.workunit.client.0.smithi033.stdout:0/618: dread - db/d2a/d6e/d7a/fbc zero size 2024-02-15T22:40:56.957 INFO:tasks.workunit.client.0.smithi033.stdout:0/619: fsync db/d19/d32/d3d/f74 0 2024-02-15T22:40:56.957 INFO:tasks.workunit.client.0.smithi033.stdout:0/620: read - db/d19/d32/d43/fc9 zero size 2024-02-15T22:40:56.958 INFO:tasks.workunit.client.0.smithi033.stdout:0/621: getdents db/d2a/d68/d8b 0 2024-02-15T22:40:56.962 INFO:tasks.workunit.client.0.smithi033.stdout:0/622: mkdir db/d2a/d6e/d7a/d95/dcd 0 2024-02-15T22:40:56.962 INFO:tasks.workunit.client.0.smithi033.stdout:0/623: stat db/d19/d32 0 2024-02-15T22:40:56.962 INFO:tasks.workunit.client.0.smithi033.stdout:5/756: dwrite d6/d14/d31/d38/d9b/dd2/fa9 [0,4194304] 0 2024-02-15T22:40:56.962 INFO:tasks.workunit.client.0.smithi033.stdout:5/757: stat d6/fb 0 2024-02-15T22:40:56.964 INFO:tasks.workunit.client.0.smithi033.stdout:5/758: mkdir d6/d14/d31/d48/d56/def 0 2024-02-15T22:40:56.965 INFO:tasks.workunit.client.0.smithi033.stdout:5/759: mknod d6/d14/d31/d38/d9b/dd3/d7a/db9/cf0 0 2024-02-15T22:40:56.972 INFO:tasks.workunit.client.0.smithi033.stdout:3/761: dwrite d0/d3/d2c/d5d/d3d/d57/d68/fd5 [0,4194304] 0 2024-02-15T22:40:56.974 INFO:tasks.workunit.client.0.smithi033.stdout:0/624: read db/d19/d32/d43/d5a/d76/f86 [2956840,35473] 0 2024-02-15T22:40:56.974 INFO:tasks.workunit.client.0.smithi033.stdout:0/625: chown db/d19/d32/l57 56 1 2024-02-15T22:40:56.976 INFO:tasks.workunit.client.0.smithi033.stdout:0/626: truncate db/d19/d32/d43/d5a/d76/f86 2577578 0 2024-02-15T22:40:56.982 INFO:tasks.workunit.client.0.smithi033.stdout:0/627: symlink db/d19/d32/d43/d7d/lce 0 2024-02-15T22:40:56.983 INFO:tasks.workunit.client.0.smithi033.stdout:0/628: readlink db/l15 0 2024-02-15T22:40:56.983 INFO:tasks.workunit.client.0.smithi033.stdout:0/629: dread - db/d2a/d68/d8b/fa7 zero size 2024-02-15T22:40:56.994 INFO:tasks.workunit.client.0.smithi033.stdout:3/762: dwrite d0/d3/d2c/d5d/d3d/d8f/f9c [0,4194304] 0 2024-02-15T22:40:56.996 INFO:tasks.workunit.client.0.smithi033.stdout:0/630: write db/d2a/f8c [3743521,27746] 0 2024-02-15T22:40:56.997 INFO:tasks.workunit.client.0.smithi033.stdout:5/760: dwrite d6/f42 [0,4194304] 0 2024-02-15T22:40:57.001 INFO:tasks.workunit.client.0.smithi033.stdout:0/631: creat db/d19/d32/d43/d9f/fcf x:0 0 0 2024-02-15T22:40:57.002 INFO:tasks.workunit.client.0.smithi033.stdout:5/761: symlink d6/d14/d31/d38/d9b/dd3/d7a/db9/lf1 0 2024-02-15T22:40:57.003 INFO:tasks.workunit.client.0.smithi033.stdout:0/632: symlink db/d2a/d6e/dc3/ld0 0 2024-02-15T22:40:57.005 INFO:tasks.workunit.client.0.smithi033.stdout:5/762: rename d6/d25/l34 to d6/d14/d31/d50/d6a/dab/lf2 0 2024-02-15T22:40:57.006 INFO:tasks.workunit.client.0.smithi033.stdout:0/633: rmdir db/d2a 39 2024-02-15T22:40:57.007 INFO:tasks.workunit.client.0.smithi033.stdout:5/763: creat d6/d14/d31/d48/ff3 x:0 0 0 2024-02-15T22:40:57.007 INFO:tasks.workunit.client.0.smithi033.stdout:5/764: stat d6/d14/d31/d38/d9b/f71 0 2024-02-15T22:40:57.008 INFO:tasks.workunit.client.0.smithi033.stdout:5/765: read d6/d25/f55 [991127,72266] 0 2024-02-15T22:40:57.010 INFO:tasks.workunit.client.0.smithi033.stdout:0/634: symlink db/d19/d32/d46/ld1 0 2024-02-15T22:40:57.011 INFO:tasks.workunit.client.0.smithi033.stdout:0/635: fsync db/d19/f3a 0 2024-02-15T22:40:57.011 INFO:tasks.workunit.client.0.smithi033.stdout:0/636: write db/d19/f3a [3849344,9189] 0 2024-02-15T22:40:57.013 INFO:tasks.workunit.client.0.smithi033.stdout:5/766: dread d6/d14/f2e [0,4194304] 0 2024-02-15T22:40:57.015 INFO:tasks.workunit.client.0.smithi033.stdout:5/767: truncate d6/d14/d31/d50/fb6 495332 0 2024-02-15T22:40:57.016 INFO:tasks.workunit.client.0.smithi033.stdout:3/763: dwrite d0/d3/dd/f7e [0,4194304] 0 2024-02-15T22:40:57.017 INFO:tasks.workunit.client.0.smithi033.stdout:5/768: mkdir d6/d25/df4 0 2024-02-15T22:40:57.017 INFO:tasks.workunit.client.0.smithi033.stdout:5/769: fdatasync d6/d14/d31/d48/f69 0 2024-02-15T22:40:57.017 INFO:tasks.workunit.client.0.smithi033.stdout:5/770: chown d6/d14/d31/d48 957403 1 2024-02-15T22:40:57.017 INFO:tasks.workunit.client.0.smithi033.stdout:5/771: chown d6/l75 0 1 2024-02-15T22:40:57.018 INFO:tasks.workunit.client.0.smithi033.stdout:3/764: mkdir d0/d3/d2c/d5d/d3d/d57/d68/df6 0 2024-02-15T22:40:57.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:56 smithi033 ceph-mon[29033]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:57.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:56 smithi033 ceph-mon[29033]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:57.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/772: rmdir d6/d14/d31/d48/d49/d53/d57 39 2024-02-15T22:40:57.028 INFO:tasks.workunit.client.0.smithi033.stdout:3/765: truncate d0/d3/d3b/d47/f80 3785595 0 2024-02-15T22:40:57.037 INFO:tasks.workunit.client.0.smithi033.stdout:0/637: dwrite db/d19/f3a [0,4194304] 0 2024-02-15T22:40:57.038 INFO:tasks.workunit.client.0.smithi033.stdout:0/638: link db/d2a/lba db/d2a/d68/d8b/dbf/ld2 0 2024-02-15T22:40:57.038 INFO:tasks.workunit.client.0.smithi033.stdout:0/639: chown db/d2a/d6e/cc2 10 1 2024-02-15T22:40:57.038 INFO:tasks.workunit.client.0.smithi033.stdout:0/640: readlink db/l16 0 2024-02-15T22:40:57.039 INFO:tasks.workunit.client.0.smithi033.stdout:0/641: mknod db/d19/d32/d43/d7d/d9c/cd3 0 2024-02-15T22:40:57.039 INFO:tasks.workunit.client.0.smithi033.stdout:0/642: readlink db/l16 0 2024-02-15T22:40:57.040 INFO:tasks.workunit.client.0.smithi033.stdout:0/643: mknod db/d19/d32/d43/d5a/cd4 0 2024-02-15T22:40:57.045 INFO:tasks.workunit.client.0.smithi033.stdout:5/773: dwrite d6/d14/d31/d48/d56/f5b [0,4194304] 0 2024-02-15T22:40:57.047 INFO:tasks.workunit.client.0.smithi033.stdout:5/774: mkdir d6/d14/df5 0 2024-02-15T22:40:57.053 INFO:tasks.workunit.client.0.smithi033.stdout:3/766: dwrite d0/d3/d2c/d43/fc6 [0,4194304] 0 2024-02-15T22:40:57.063 INFO:tasks.workunit.client.0.smithi033.stdout:5/775: dwrite d6/d14/d31/d48/d49/d53/d57/fb3 [0,4194304] 0 2024-02-15T22:40:57.063 INFO:tasks.workunit.client.0.smithi033.stdout:5/776: fsync d6/d14/f45 0 2024-02-15T22:40:57.064 INFO:tasks.workunit.client.0.smithi033.stdout:3/767: rmdir d0/d3/d2c/d43 39 2024-02-15T22:40:57.068 INFO:tasks.workunit.client.0.smithi033.stdout:3/768: unlink d0/d3/d5f/l83 0 2024-02-15T22:40:57.071 INFO:tasks.workunit.client.0.smithi033.stdout:3/769: mkdir d0/d3/d65/df7 0 2024-02-15T22:40:57.072 INFO:tasks.workunit.client.0.smithi033.stdout:5/777: write d6/d14/d31/d48/d49/d53/d57/fb3 [234797,31524] 0 2024-02-15T22:40:57.073 INFO:tasks.workunit.client.0.smithi033.stdout:3/770: creat d0/d3/d2c/d5d/d3d/db4/ff8 x:0 0 0 2024-02-15T22:40:57.075 INFO:tasks.workunit.client.0.smithi033.stdout:5/778: symlink d6/d25/df4/lf6 0 2024-02-15T22:40:57.075 INFO:tasks.workunit.client.0.smithi033.stdout:3/771: rmdir d0/d3/dd 39 2024-02-15T22:40:57.084 INFO:tasks.workunit.client.0.smithi033.stdout:3/772: write d0/d1c/f88 [1457627,10554] 0 2024-02-15T22:40:57.088 INFO:tasks.workunit.client.0.smithi033.stdout:3/773: unlink d0/d3/d3b/f63 0 2024-02-15T22:40:57.088 INFO:tasks.workunit.client.0.smithi033.stdout:5/779: dwrite d6/d14/d31/f47 [0,4194304] 0 2024-02-15T22:40:57.088 INFO:tasks.workunit.client.0.smithi033.stdout:5/780: truncate d6/d25/f5d 5416527 0 2024-02-15T22:40:57.093 INFO:tasks.workunit.client.0.smithi033.stdout:3/774: write d0/d3/dd/f6a [1059184,41347] 0 2024-02-15T22:40:57.093 INFO:tasks.workunit.client.0.smithi033.stdout:3/775: fdatasync d0/d1c/fbd 0 2024-02-15T22:40:57.094 INFO:tasks.workunit.client.0.smithi033.stdout:3/776: symlink d0/d3/d2c/d5d/d3d/db6/lf9 0 2024-02-15T22:40:57.098 INFO:tasks.workunit.client.0.smithi033.stdout:5/781: dread d6/d14/d31/d38/d9b/f71 [0,4194304] 0 2024-02-15T22:40:57.098 INFO:tasks.workunit.client.0.smithi033.stdout:5/782: creat d6/d14/d31/d48/d49/d53/ff7 x:0 0 0 2024-02-15T22:40:57.101 INFO:tasks.workunit.client.0.smithi033.stdout:5/783: creat d6/d14/d31/d38/d9b/dd3/d7a/db9/ff8 x:0 0 0 2024-02-15T22:40:57.101 INFO:tasks.workunit.client.0.smithi033.stdout:5/784: write d6/f10 [328147,68770] 0 2024-02-15T22:40:57.103 INFO:tasks.workunit.client.0.smithi033.stdout:5/785: mkdir d6/d14/d31/d38/df9 0 2024-02-15T22:40:57.116 INFO:tasks.workunit.client.0.smithi033.stdout:3/777: dwrite d0/d1c/f29 [0,4194304] 0 2024-02-15T22:40:57.116 INFO:tasks.workunit.client.0.smithi033.stdout:3/778: chown d0/d3/d5f 5235 1 2024-02-15T22:40:57.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:56 smithi082 ceph-mon[37153]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:57.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:56 smithi082 ceph-mon[37153]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:57.124 INFO:tasks.workunit.client.0.smithi033.stdout:5/786: dwrite d6/d14/d31/d48/ff3 [0,4194304] 0 2024-02-15T22:40:57.128 INFO:tasks.workunit.client.0.smithi033.stdout:3/779: truncate d0/d3/dd/f6a 775828 0 2024-02-15T22:40:57.129 INFO:tasks.workunit.client.0.smithi033.stdout:3/780: creat d0/d3/d2c/d5d/d3d/d57/d68/df6/ffa x:0 0 0 2024-02-15T22:40:57.134 INFO:tasks.workunit.client.0.smithi033.stdout:3/781: dread d0/d3/dd/f6a [0,4194304] 0 2024-02-15T22:40:57.135 INFO:tasks.workunit.client.0.smithi033.stdout:3/782: mknod d0/d3/dd/cfb 0 2024-02-15T22:40:57.135 INFO:tasks.workunit.client.0.smithi033.stdout:3/783: symlink d0/d3/d5f/da7/lfc 0 2024-02-15T22:40:57.136 INFO:tasks.workunit.client.0.smithi033.stdout:3/784: stat d0/d3/d5f/da7/cf4 0 2024-02-15T22:40:57.136 INFO:tasks.workunit.client.0.smithi033.stdout:3/785: creat d0/d3/d2c/d5d/d3d/db6/ffd x:0 0 0 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:7/710: sync 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:4/768: sync 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:1/723: sync 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:7/711: readlink d5/l82 0 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:2/853: sync 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:6/555: sync 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:4/769: fsync d8/d16/d51/f86 0 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:7/712: dread - d5/dc/d5f/d8b/da1/d26/fd9 zero size 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:2/854: truncate d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f109 226829 0 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:4/770: write d8/d16/d51/d1c/db9/d37/fdb [1979707,21770] 0 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:2/855: dread - d1/d8/d34/fc6 zero size 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:2/856: write d1/d8/d2b/d2f/d24/d31/f90 [395587,104375] 0 2024-02-15T22:40:57.139 INFO:tasks.workunit.client.0.smithi033.stdout:2/857: stat d1/d8/d2b/f85 0 2024-02-15T22:40:57.141 INFO:tasks.workunit.client.0.smithi033.stdout:6/556: dread d12/d3c/d95/f52 [0,4194304] 0 2024-02-15T22:40:57.141 INFO:tasks.workunit.client.0.smithi033.stdout:7/713: link d5/dc/l7e d5/dc/d5f/d8b/da0/dc6/de4/de9/lf0 0 2024-02-15T22:40:57.141 INFO:tasks.workunit.client.0.smithi033.stdout:6/557: creat d12/d2c/fc1 x:0 0 0 2024-02-15T22:40:57.144 INFO:tasks.workunit.client.0.smithi033.stdout:4/771: unlink d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/ff6 0 2024-02-15T22:40:57.148 INFO:tasks.workunit.client.0.smithi033.stdout:2/858: rename d1/d8/d2b/f85 to d1/d8/d2b/d2f/d24/d7a/f10f 0 2024-02-15T22:40:57.148 INFO:tasks.workunit.client.0.smithi033.stdout:2/859: stat d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d62 0 2024-02-15T22:40:57.150 INFO:tasks.workunit.client.0.smithi033.stdout:7/714: creat d5/df/d40/d73/dd2/ff1 x:0 0 0 2024-02-15T22:40:57.151 INFO:tasks.workunit.client.0.smithi033.stdout:6/558: mknod d12/d2c/d30/cc2 0 2024-02-15T22:40:57.154 INFO:tasks.workunit.client.0.smithi033.stdout:2/860: rename d1/f20 to d1/d66/f110 0 2024-02-15T22:40:57.155 INFO:tasks.workunit.client.0.smithi033.stdout:1/724: dwrite d1/de/f13 [4194304,4194304] 0 2024-02-15T22:40:57.156 INFO:tasks.workunit.client.0.smithi033.stdout:1/725: stat d1/d20/d42/d25/c8d 0 2024-02-15T22:40:57.156 INFO:tasks.workunit.client.0.smithi033.stdout:6/559: unlink d12/d2c/d30/f20 0 2024-02-15T22:40:57.156 INFO:tasks.workunit.client.0.smithi033.stdout:6/560: chown fa 115239268 1 2024-02-15T22:40:57.158 INFO:tasks.workunit.client.0.smithi033.stdout:2/861: unlink d1/d8/d2b/d2f/d13/d59/d76/c92 0 2024-02-15T22:40:57.158 INFO:tasks.workunit.client.0.smithi033.stdout:2/862: chown d1/d8/d2b/d2f/d13/d6f/fca 297 1 2024-02-15T22:40:57.161 INFO:tasks.workunit.client.0.smithi033.stdout:7/715: rename d5/dc/d5f/d8b/da1/d26/d3f/lb7 to d5/df/d40/d73/lf2 0 2024-02-15T22:40:57.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/726: symlink d1/de/d27/d28/d37/ld0 0 2024-02-15T22:40:57.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/727: write d1/de/f16 [1163550,87764] 0 2024-02-15T22:40:57.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/728: dread - d1/d20/d42/d2c/f94 zero size 2024-02-15T22:40:57.166 INFO:tasks.workunit.client.0.smithi033.stdout:2/863: link d1/d16/d5a/f97 d1/d16/d3f/df5/f111 0 2024-02-15T22:40:57.166 INFO:tasks.workunit.client.0.smithi033.stdout:2/864: chown d1/d8/d2b/d2f/d24/d2a 184427250 1 2024-02-15T22:40:57.168 INFO:tasks.workunit.client.0.smithi033.stdout:7/716: creat d5/df/d56/d84/ff3 x:0 0 0 2024-02-15T22:40:57.169 INFO:tasks.workunit.client.0.smithi033.stdout:7/717: dread - d5/dc/d5f/d8b/da1/d26/fd9 zero size 2024-02-15T22:40:57.172 INFO:tasks.workunit.client.0.smithi033.stdout:4/772: dwrite d8/ff [0,4194304] 0 2024-02-15T22:40:57.172 INFO:tasks.workunit.client.0.smithi033.stdout:7/718: creat d5/dc/d5f/ff4 x:0 0 0 2024-02-15T22:40:57.172 INFO:tasks.workunit.client.0.smithi033.stdout:7/719: stat d5/df/d56/d99/cc3 0 2024-02-15T22:40:57.173 INFO:tasks.workunit.client.0.smithi033.stdout:7/720: readlink d5/df/d56/d7f/lb9 0 2024-02-15T22:40:57.173 INFO:tasks.workunit.client.0.smithi033.stdout:7/721: chown d5/df/d56/d99/cc3 3716 1 2024-02-15T22:40:57.174 INFO:tasks.workunit.client.0.smithi033.stdout:4/773: rmdir d8/d16/d51/d1c/db9/d37/d31/da5 39 2024-02-15T22:40:57.186 INFO:tasks.workunit.client.0.smithi033.stdout:6/561: dwrite d12/f78 [0,4194304] 0 2024-02-15T22:40:57.188 INFO:tasks.workunit.client.0.smithi033.stdout:6/562: unlink d12/d2c/fc1 0 2024-02-15T22:40:57.190 INFO:tasks.workunit.client.0.smithi033.stdout:6/563: write d12/d2c/dbc/f8f [202229,117242] 0 2024-02-15T22:40:57.190 INFO:tasks.workunit.client.0.smithi033.stdout:6/564: unlink d12/d2c/d30/d1d/d35/c38 0 2024-02-15T22:40:57.192 INFO:tasks.workunit.client.0.smithi033.stdout:2/865: dwrite d1/d8/d2b/d2f/d24/d2a/d88/d8e/fe5 [4194304,4194304] 0 2024-02-15T22:40:57.192 INFO:tasks.workunit.client.0.smithi033.stdout:1/729: dwrite d1/de/d27/d28/d37/f8e [0,4194304] 0 2024-02-15T22:40:57.196 INFO:tasks.workunit.client.0.smithi033.stdout:4/774: dwrite d8/d16/d51/d1c/db9/d37/faa [4194304,4194304] 0 2024-02-15T22:40:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.203+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70d0000bf0 con 0x7f70cc06b3b0 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.205+0000 7f70cb7fe700 1 -- 172.21.15.33:0/2090164967 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f70d0000bf0 con 0x7f70cc06b3b0 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "1/2 daemons upgraded", 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T22:40:57.206 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:40:57.207 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:40:57.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f70cc06b3b0 msgr2=0x7f70cc06d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f70cc06b3b0 0x7f70cc06d860 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c00 tx=0x7f70d8009e30 comp rx=0 tx=0).stop 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406e560 msgr2=0x7f70e411c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406e560 0x7f70e411c820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70d4002a80 tx=0x7f70d4004600 comp rx=0 tx=0).stop 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 shutdown_connections 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f70cc06b3b0 0x7f70cc06d860 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e406e560 0x7f70e411c820 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 --2- 172.21.15.33:0/2090164967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e411cd60 0x7f70e411dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 >> 172.21.15.33:0/2090164967 conn(0x7f70e4069e70 msgr2=0x7f70e4107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 shutdown_connections 2024-02-15T22:40:57.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:40:57.208+0000 7f70e9922700 1 -- 172.21.15.33:0/2090164967 wait complete. 2024-02-15T22:40:57.215 INFO:tasks.workunit.client.0.smithi033.stdout:4/775: dread f7 [0,4194304] 0 2024-02-15T22:40:57.215 INFO:tasks.workunit.client.0.smithi033.stdout:4/776: write d8/d16/d51/d1c/db9/d37/d31/d80/fe7 [925128,90338] 0 2024-02-15T22:40:57.215 INFO:tasks.workunit.client.0.smithi033.stdout:4/777: dread - d8/d16/d45/fea zero size 2024-02-15T22:40:57.215 INFO:tasks.workunit.client.0.smithi033.stdout:4/778: chown d8/d1a 304 1 2024-02-15T22:40:57.220 INFO:tasks.workunit.client.0.smithi033.stdout:2/866: dwrite d1/d8/d2b/f10b [0,4194304] 0 2024-02-15T22:40:57.221 INFO:tasks.workunit.client.0.smithi033.stdout:1/730: dwrite d1/f17 [0,4194304] 0 2024-02-15T22:40:57.221 INFO:tasks.workunit.client.0.smithi033.stdout:1/731: write d1/d20/d42/d25/d67/fb6 [524010,90271] 0 2024-02-15T22:40:57.225 INFO:tasks.workunit.client.0.smithi033.stdout:4/779: dread d8/d16/d51/f44 [0,4194304] 0 2024-02-15T22:40:57.241 INFO:tasks.workunit.client.0.smithi033.stdout:6/565: mkdir d12/d2c/dc3 0 2024-02-15T22:40:57.255 INFO:tasks.workunit.client.0.smithi033.stdout:2/867: creat d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/de8/f112 x:0 0 0 2024-02-15T22:40:57.255 INFO:tasks.workunit.client.0.smithi033.stdout:6/566: dwrite d12/d2c/d30/f3d [0,4194304] 0 2024-02-15T22:40:57.257 INFO:tasks.workunit.client.0.smithi033.stdout:1/732: creat d1/d20/fd1 x:0 0 0 2024-02-15T22:40:57.259 INFO:tasks.workunit.client.0.smithi033.stdout:4/780: rmdir d8/d16/d97 39 2024-02-15T22:40:57.259 INFO:tasks.workunit.client.0.smithi033.stdout:4/781: readlink d8/d16/d51/d1c/d3c/d49/dac/lbb 0 2024-02-15T22:40:57.259 INFO:tasks.workunit.client.0.smithi033.stdout:4/782: chown d8/d16/d51/f44 24967652 1 2024-02-15T22:40:57.259 INFO:tasks.workunit.client.0.smithi033.stdout:4/783: chown d8/c58 396211 1 2024-02-15T22:40:57.259 INFO:tasks.workunit.client.0.smithi033.stdout:4/784: write d8/d16/d51/d1c/d3c/d49/dac/f103 [765194,102055] 0 2024-02-15T22:40:57.260 INFO:tasks.workunit.client.0.smithi033.stdout:1/733: write d1/d20/d42/d25/f60 [927475,77528] 0 2024-02-15T22:40:57.260 INFO:tasks.workunit.client.0.smithi033.stdout:1/734: truncate d1/d20/fa9 112340 0 2024-02-15T22:40:57.268 INFO:tasks.workunit.client.0.smithi033.stdout:2/868: creat d1/d16/d5a/f113 x:0 0 0 2024-02-15T22:40:57.270 INFO:tasks.workunit.client.0.smithi033.stdout:6/567: symlink d12/d3c/d95/d3f/lc4 0 2024-02-15T22:40:57.271 INFO:tasks.workunit.client.0.smithi033.stdout:4/785: mknod d8/d16/d51/d1c/db9/d37/d31/d47/c104 0 2024-02-15T22:40:57.272 INFO:tasks.workunit.client.0.smithi033.stdout:1/735: creat d1/d20/d42/d2c/fd2 x:0 0 0 2024-02-15T22:40:57.275 INFO:tasks.workunit.client.0.smithi033.stdout:1/736: creat d1/de/d27/fd3 x:0 0 0 2024-02-15T22:40:57.276 INFO:tasks.workunit.client.0.smithi033.stdout:1/737: creat d1/d20/fd4 x:0 0 0 2024-02-15T22:40:57.283 INFO:tasks.workunit.client.0.smithi033.stdout:6/568: dread d12/d2c/f4a [0,4194304] 0 2024-02-15T22:40:57.286 INFO:tasks.workunit.client.0.smithi033.stdout:6/569: write d12/f5d [1081456,80488] 0 2024-02-15T22:40:57.287 INFO:tasks.workunit.client.0.smithi033.stdout:6/570: rmdir d12/d3c/d95/d3f/d4b/dac/d5c 39 2024-02-15T22:40:57.301 INFO:tasks.workunit.client.0.smithi033.stdout:4/786: dwrite d8/d16/d51/d1c/db9/d37/d23/f5b [0,4194304] 0 2024-02-15T22:40:57.301 INFO:tasks.workunit.client.0.smithi033.stdout:4/787: write d8/d16/d51/d1c/d3c/d49/fa4 [5136050,59876] 0 2024-02-15T22:40:57.301 INFO:tasks.workunit.client.0.smithi033.stdout:4/788: truncate d8/d16/d51/d1c/d50/da1/dc1/ffb 864553 0 2024-02-15T22:40:57.301 INFO:tasks.workunit.client.0.smithi033.stdout:4/789: chown d8/d16/d51/d1c/db9/d37/d31 13 1 2024-02-15T22:40:57.304 INFO:tasks.workunit.client.0.smithi033.stdout:9/640: sync 2024-02-15T22:40:57.304 INFO:tasks.workunit.client.0.smithi033.stdout:8/730: sync 2024-02-15T22:40:57.304 INFO:tasks.workunit.client.0.smithi033.stdout:8/731: stat d1/de/d1a/d27/fbc 0 2024-02-15T22:40:57.310 INFO:tasks.workunit.client.0.smithi033.stdout:9/641: mknod d4/d1d/d23/d32/d3e/cc3 0 2024-02-15T22:40:57.311 INFO:tasks.workunit.client.0.smithi033.stdout:9/642: creat d4/d1d/d23/d24/d5a/fc4 x:0 0 0 2024-02-15T22:40:57.312 INFO:tasks.workunit.client.0.smithi033.stdout:9/643: rename d4/d1d/d23/d32/d71/la4 to d4/d1d/d23/d32/d71/lc5 0 2024-02-15T22:40:57.313 INFO:tasks.workunit.client.0.smithi033.stdout:9/644: rmdir d4/d1d 39 2024-02-15T22:40:57.313 INFO:tasks.workunit.client.0.smithi033.stdout:1/738: dwrite d1/de/d27/d39/d3a/f78 [0,4194304] 0 2024-02-15T22:40:57.313 INFO:tasks.workunit.client.0.smithi033.stdout:1/739: readlink d1/d20/l56 0 2024-02-15T22:40:57.313 INFO:tasks.workunit.client.0.smithi033.stdout:2/869: dwrite d1/d8/d2b/d2f/d3d/faa [0,4194304] 0 2024-02-15T22:40:57.314 INFO:tasks.workunit.client.0.smithi033.stdout:6/571: dwrite d12/d3c/f91 [0,4194304] 0 2024-02-15T22:40:57.314 INFO:tasks.workunit.client.0.smithi033.stdout:6/572: fsync d12/d3c/d95/d3f/f43 0 2024-02-15T22:40:57.318 INFO:tasks.workunit.client.0.smithi033.stdout:4/790: rmdir d8/d16/d51 39 2024-02-15T22:40:57.319 INFO:tasks.workunit.client.0.smithi033.stdout:4/791: fsync d8/d16/d51/d1c/db9/d37/dce/fe9 0 2024-02-15T22:40:57.321 INFO:tasks.workunit.client.0.smithi033.stdout:1/740: creat d1/de/fd5 x:0 0 0 2024-02-15T22:40:57.322 INFO:tasks.workunit.client.0.smithi033.stdout:2/870: mkdir d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d9a/d114 0 2024-02-15T22:40:57.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/741: unlink d1/de/d27/d28/l77 0 2024-02-15T22:40:57.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/742: write d1/de/d27/d39/d3a/da3/f70 [1856339,82440] 0 2024-02-15T22:40:57.331 INFO:tasks.workunit.client.0.smithi033.stdout:1/743: rmdir d1/de/d27/d28/d2d/d5e 39 2024-02-15T22:40:57.332 INFO:tasks.workunit.client.0.smithi033.stdout:9/645: dwrite d4/d1d/d23/d24/f2b [0,4194304] 0 2024-02-15T22:40:57.333 INFO:tasks.workunit.client.0.smithi033.stdout:1/744: creat d1/de/d27/d28/d2d/d5e/d69/dca/fd6 x:0 0 0 2024-02-15T22:40:57.333 INFO:tasks.workunit.client.0.smithi033.stdout:1/745: readlink d1/d20/d42/d2c/d7b/lb9 0 2024-02-15T22:40:57.334 INFO:tasks.workunit.client.0.smithi033.stdout:1/746: getdents d1/de/d27/d39/d3a/da3 0 2024-02-15T22:40:57.334 INFO:tasks.workunit.client.0.smithi033.stdout:1/747: write d1/de/d27/d28/d2d/f8c [2352413,104187] 0 2024-02-15T22:40:57.335 INFO:tasks.workunit.client.0.smithi033.stdout:2/871: write d1/d16/d5a/f87 [3628291,10249] 0 2024-02-15T22:40:57.335 INFO:tasks.workunit.client.0.smithi033.stdout:2/872: creat d1/d8/d2b/d2f/d24/d5d/f115 x:0 0 0 2024-02-15T22:40:57.335 INFO:tasks.workunit.client.0.smithi033.stdout:1/748: symlink d1/d57/db1/ld7 0 2024-02-15T22:40:57.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/873: mkdir d1/d8/d116 0 2024-02-15T22:40:57.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/874: fdatasync d1/d8/fe 0 2024-02-15T22:40:57.339 INFO:tasks.workunit.client.0.smithi033.stdout:1/749: symlink d1/de/d27/d28/ld8 0 2024-02-15T22:40:57.339 INFO:tasks.workunit.client.0.smithi033.stdout:1/750: chown d1/de/d27 0 1 2024-02-15T22:40:57.339 INFO:tasks.workunit.client.0.smithi033.stdout:2/875: symlink d1/d8/l117 0 2024-02-15T22:40:57.340 INFO:tasks.workunit.client.0.smithi033.stdout:1/751: mkdir d1/d20/d42/d2c/dd9 0 2024-02-15T22:40:57.341 INFO:tasks.workunit.client.0.smithi033.stdout:2/876: dread d1/d8/d2b/d2f/d12/dae/fdd [0,4194304] 0 2024-02-15T22:40:57.341 INFO:tasks.workunit.client.0.smithi033.stdout:2/877: chown d1/d8/d2b/d2f/d13/da9/cb3 450 1 2024-02-15T22:40:57.341 INFO:tasks.workunit.client.0.smithi033.stdout:6/573: dwrite d12/d3c/d95/d3f/d4b/f8a [0,4194304] 0 2024-02-15T22:40:57.341 INFO:tasks.workunit.client.0.smithi033.stdout:6/574: chown c8 178472 1 2024-02-15T22:40:57.342 INFO:tasks.workunit.client.0.smithi033.stdout:2/878: mkdir d1/d8/d2b/d2f/d13/d59/d76/d118 0 2024-02-15T22:40:57.342 INFO:tasks.workunit.client.0.smithi033.stdout:2/879: fsync d1/d8/d2b/d2f/d24/fa7 0 2024-02-15T22:40:57.343 INFO:tasks.workunit.client.0.smithi033.stdout:2/880: chown d1/d16/d5a/d67/fd1 7151 1 2024-02-15T22:40:57.343 INFO:tasks.workunit.client.0.smithi033.stdout:2/881: dread d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f109 [0,4194304] 0 2024-02-15T22:40:57.347 INFO:tasks.workunit.client.0.smithi033.stdout:9/646: write d4/fc [438824,67153] 0 2024-02-15T22:40:57.347 INFO:tasks.workunit.client.0.smithi033.stdout:9/647: fdatasync d4/d1d/f21 0 2024-02-15T22:40:57.347 INFO:tasks.workunit.client.0.smithi033.stdout:9/648: chown d4/d1d/d23/d32/f67 7 1 2024-02-15T22:40:57.349 INFO:tasks.workunit.client.0.smithi033.stdout:6/575: mkdir d12/d3c/d95/d3f/d4b/d6f/dc5 0 2024-02-15T22:40:57.350 INFO:tasks.workunit.client.0.smithi033.stdout:9/649: rename d4/d1d/d23/d32/d71/fb3 to d4/d1d/d23/d32/d71/dab/fc6 0 2024-02-15T22:40:57.350 INFO:tasks.workunit.client.0.smithi033.stdout:9/650: chown d4/d1d/f2c 3076435 1 2024-02-15T22:40:57.351 INFO:tasks.workunit.client.0.smithi033.stdout:1/752: write d1/d20/d42/d25/d67/f88 [2933758,64106] 0 2024-02-15T22:40:57.351 INFO:tasks.workunit.client.0.smithi033.stdout:1/753: write d1/de/d27/d28/d2d/d5e/d69/fc2 [205433,120613] 0 2024-02-15T22:40:57.351 INFO:tasks.workunit.client.0.smithi033.stdout:9/651: unlink d4/d1d/d23/d24/d51/d5d/d90/fa8 0 2024-02-15T22:40:57.356 INFO:tasks.workunit.client.0.smithi033.stdout:1/754: mknod d1/d20/cda 0 2024-02-15T22:40:57.357 INFO:tasks.workunit.client.0.smithi033.stdout:1/755: mkdir d1/de/d27/d39/ddb 0 2024-02-15T22:40:57.359 INFO:tasks.workunit.client.0.smithi033.stdout:1/756: mknod d1/de/d27/d28/d2d/d5e/cdc 0 2024-02-15T22:40:57.359 INFO:tasks.workunit.client.0.smithi033.stdout:1/757: write d1/de/d27/d28/d79/dc4/fce [341466,8980] 0 2024-02-15T22:40:57.360 INFO:tasks.workunit.client.0.smithi033.stdout:1/758: symlink d1/d20/d42/ldd 0 2024-02-15T22:40:57.360 INFO:tasks.workunit.client.0.smithi033.stdout:1/759: truncate d1/d20/d42/fbf 1932194 0 2024-02-15T22:40:57.361 INFO:tasks.workunit.client.0.smithi033.stdout:1/760: mknod d1/d20/d42/d25/cde 0 2024-02-15T22:40:57.362 INFO:tasks.workunit.client.0.smithi033.stdout:1/761: creat d1/fdf x:0 0 0 2024-02-15T22:40:57.363 INFO:tasks.workunit.client.0.smithi033.stdout:1/762: chown d1/de/d27/fd3 186769 1 2024-02-15T22:40:57.364 INFO:tasks.workunit.client.0.smithi033.stdout:0/644: sync 2024-02-15T22:40:57.365 INFO:tasks.workunit.client.0.smithi033.stdout:0/645: fdatasync db/d2a/f8c 0 2024-02-15T22:40:57.366 INFO:tasks.workunit.client.0.smithi033.stdout:0/646: link db/d19/d32/d43/d7d/l92 db/d2a/d68/d8b/ld5 0 2024-02-15T22:40:57.366 INFO:tasks.workunit.client.0.smithi033.stdout:0/647: chown db/d19/d32/d43/c56 1464 1 2024-02-15T22:40:57.366 INFO:tasks.workunit.client.0.smithi033.stdout:0/648: chown db/d2a/d68/d8b/dbf/ld2 496489 1 2024-02-15T22:40:57.367 INFO:tasks.workunit.client.0.smithi033.stdout:0/649: rename db/d19/d32/d43/d7d/lb9 to db/d19/d32/d43/d7d/ld6 0 2024-02-15T22:40:57.368 INFO:tasks.workunit.client.0.smithi033.stdout:0/650: creat db/d2a/d68/d8b/fd7 x:0 0 0 2024-02-15T22:40:57.369 INFO:tasks.workunit.client.0.smithi033.stdout:0/651: write db/d19/d32/d3d/f74 [1771343,25143] 0 2024-02-15T22:40:57.369 INFO:tasks.workunit.client.0.smithi033.stdout:0/652: write db/d2a/d6e/f7c [409738,63443] 0 2024-02-15T22:40:57.369 INFO:tasks.workunit.client.0.smithi033.stdout:0/653: mkdir db/d19/dd8 0 2024-02-15T22:40:57.461 INFO:tasks.workunit.client.0.smithi033.stdout:1/763: fdatasync d1/de/d27/d28/d2d/d5e/d69/fc2 0 2024-02-15T22:40:57.461 INFO:tasks.workunit.client.0.smithi033.stdout:1/764: write d1/de/d27/d28/f2a [1998085,88300] 0 2024-02-15T22:40:57.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/765: fdatasync d1/f8 0 2024-02-15T22:40:57.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/766: readlink d1/d20/d42/d2c/d4e/lab 0 2024-02-15T22:40:57.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/767: creat d1/de/d27/d28/d37/fe0 x:0 0 0 2024-02-15T22:40:57.463 INFO:tasks.workunit.client.0.smithi033.stdout:1/768: unlink d1/de/d27/d39/d3a/f85 0 2024-02-15T22:40:57.463 INFO:tasks.workunit.client.0.smithi033.stdout:1/769: truncate d1/d20/f9b 846082 0 2024-02-15T22:40:57.474 INFO:tasks.workunit.client.0.smithi033.stdout:1/770: dread d1/de/f81 [0,4194304] 0 2024-02-15T22:40:57.481 INFO:tasks.workunit.client.0.smithi033.stdout:1/771: write d1/de/d27/d28/d2d/f76 [5813408,36441] 0 2024-02-15T22:40:57.482 INFO:tasks.workunit.client.0.smithi033.stdout:1/772: truncate d1/f6 4559094 0 2024-02-15T22:40:57.482 INFO:tasks.workunit.client.0.smithi033.stdout:1/773: chown d1/ld 1 1 2024-02-15T22:40:57.484 INFO:tasks.workunit.client.0.smithi033.stdout:1/774: dread d1/f64 [0,4194304] 0 2024-02-15T22:40:57.484 INFO:tasks.workunit.client.0.smithi033.stdout:1/775: readlink d1/de/d27/d28/ld8 0 2024-02-15T22:40:57.534 INFO:tasks.workunit.client.0.smithi033.stdout:9/652: dwrite d4/ff [4194304,4194304] 0 2024-02-15T22:40:57.544 INFO:tasks.workunit.client.0.smithi033.stdout:9/653: dread d4/d1d/d23/d32/d71/dab/fb2 [4194304,4194304] 0 2024-02-15T22:40:57.546 INFO:tasks.workunit.client.0.smithi033.stdout:1/776: rename d1/de/d27/d28 to d1/de/d27/d39/ddb/de1 0 2024-02-15T22:40:57.546 INFO:tasks.workunit.client.0.smithi033.stdout:1/777: chown d1/de/d27/d39/ddb/de1/d79/d9f 218708 1 2024-02-15T22:40:57.546 INFO:tasks.workunit.client.0.smithi033.stdout:1/778: dread - d1/de/d27/d39/ddb/de1/d79/d9f/fc3 zero size 2024-02-15T22:40:57.548 INFO:tasks.workunit.client.0.smithi033.stdout:9/654: mkdir d4/d1d/d23/d32/d3e/d86/d3f/dc7 0 2024-02-15T22:40:57.569 INFO:tasks.workunit.client.0.smithi033.stdout:1/779: dwrite d1/de/f38 [0,4194304] 0 2024-02-15T22:40:57.569 INFO:tasks.workunit.client.0.smithi033.stdout:1/780: fsync d1/de/d27/d39/ddb/de1/d2d/d36/f5d 0 2024-02-15T22:40:57.569 INFO:tasks.workunit.client.0.smithi033.stdout:9/655: dwrite d4/f75 [0,4194304] 0 2024-02-15T22:40:57.569 INFO:tasks.workunit.client.0.smithi033.stdout:1/781: truncate d1/de/d27/d39/d3a/f78 3777833 0 2024-02-15T22:40:57.570 INFO:tasks.workunit.client.0.smithi033.stdout:1/782: mknod d1/de/d27/d39/ddb/de1/d2d/d3b/ce2 0 2024-02-15T22:40:57.571 INFO:tasks.workunit.client.0.smithi033.stdout:9/656: dread d4/d1d/d23/d35/f87 [0,4194304] 0 2024-02-15T22:40:57.571 INFO:tasks.workunit.client.0.smithi033.stdout:1/783: stat d1/de/d27/d39/ddb/de1/d2d/d36/cbd 0 2024-02-15T22:40:57.572 INFO:tasks.workunit.client.0.smithi033.stdout:9/657: unlink d4/f16 0 2024-02-15T22:40:57.573 INFO:tasks.workunit.client.0.smithi033.stdout:1/784: getdents d1/d20/d42/d25 0 2024-02-15T22:40:57.574 INFO:tasks.workunit.client.0.smithi033.stdout:9/658: mkdir d4/dac/db0/dc8 0 2024-02-15T22:40:57.575 INFO:tasks.workunit.client.0.smithi033.stdout:9/659: rename d4/d1d/d23/l62 to d4/d1d/d23/d32/da7/lc9 0 2024-02-15T22:40:57.577 INFO:tasks.workunit.client.0.smithi033.stdout:9/660: mknod d4/d1d/d23/d32/d3e/d86/d3f/cca 0 2024-02-15T22:40:57.577 INFO:tasks.workunit.client.0.smithi033.stdout:9/661: chown d4/d1d/f70 242545 1 2024-02-15T22:40:57.577 INFO:tasks.workunit.client.0.smithi033.stdout:9/662: stat d4/d1d/d23/d32/d3e/c6c 0 2024-02-15T22:40:57.577 INFO:tasks.workunit.client.0.smithi033.stdout:9/663: fsync d4/d1d/d23/d32/f67 0 2024-02-15T22:40:57.578 INFO:tasks.workunit.client.0.smithi033.stdout:9/664: read d4/d1d/f21 [559594,31479] 0 2024-02-15T22:40:57.579 INFO:tasks.workunit.client.0.smithi033.stdout:9/665: unlink d4/d1d/d23/d24/d5a/cb6 0 2024-02-15T22:40:57.579 INFO:tasks.workunit.client.0.smithi033.stdout:1/785: dread d1/de/d27/d39/ddb/de1/d2d/f76 [0,4194304] 0 2024-02-15T22:40:57.584 INFO:tasks.workunit.client.0.smithi033.stdout:9/666: dread d4/d1d/d23/d32/d3e/f64 [0,4194304] 0 2024-02-15T22:40:57.584 INFO:tasks.workunit.client.0.smithi033.stdout:9/667: stat d4/d1d/d23/d24/d51/lb8 0 2024-02-15T22:40:57.584 INFO:tasks.workunit.client.0.smithi033.stdout:9/668: chown d4/d1d/d23/d35/l5c 3644718 1 2024-02-15T22:40:57.585 INFO:tasks.workunit.client.0.smithi033.stdout:9/669: mknod d4/d1d/d23/d35/ccb 0 2024-02-15T22:40:57.585 INFO:tasks.workunit.client.0.smithi033.stdout:9/670: fdatasync d4/d1d/f70 0 2024-02-15T22:40:57.586 INFO:tasks.workunit.client.0.smithi033.stdout:9/671: symlink d4/dac/lcc 0 2024-02-15T22:40:57.587 INFO:tasks.workunit.client.0.smithi033.stdout:9/672: creat d4/d1d/d23/d24/d51/fcd x:0 0 0 2024-02-15T22:40:57.588 INFO:tasks.workunit.client.0.smithi033.stdout:9/673: creat d4/dac/fce x:0 0 0 2024-02-15T22:40:57.588 INFO:tasks.workunit.client.0.smithi033.stdout:7/722: sync 2024-02-15T22:40:57.589 INFO:tasks.workunit.client.0.smithi033.stdout:5/787: sync 2024-02-15T22:40:57.589 INFO:tasks.workunit.client.0.smithi033.stdout:3/786: sync 2024-02-15T22:40:57.589 INFO:tasks.workunit.client.0.smithi033.stdout:9/674: mknod d4/d1d/daf/dba/ccf 0 2024-02-15T22:40:57.589 INFO:tasks.workunit.client.0.smithi033.stdout:5/788: write d6/feb [976101,82795] 0 2024-02-15T22:40:57.589 INFO:tasks.workunit.client.0.smithi033.stdout:9/675: write d4/d1d/d23/d24/fa3 [873490,24406] 0 2024-02-15T22:40:57.590 INFO:tasks.workunit.client.0.smithi033.stdout:7/723: mkdir d5/dc/d5f/d8b/da0/dc6/de4/df5 0 2024-02-15T22:40:57.591 INFO:tasks.workunit.client.0.smithi033.stdout:5/789: creat d6/d25/ffa x:0 0 0 2024-02-15T22:40:57.592 INFO:tasks.workunit.client.0.smithi033.stdout:9/676: creat d4/d1d/d23/d24/fd0 x:0 0 0 2024-02-15T22:40:57.593 INFO:tasks.workunit.client.0.smithi033.stdout:7/724: mknod d5/d6/cf6 0 2024-02-15T22:40:57.593 INFO:tasks.workunit.client.0.smithi033.stdout:5/790: getdents d6/d14/d31/d48/d49/d53/dd7 0 2024-02-15T22:40:57.594 INFO:tasks.workunit.client.0.smithi033.stdout:1/786: dwrite d1/de/d27/d39/ddb/de1/d37/fc0 [0,4194304] 0 2024-02-15T22:40:57.595 INFO:tasks.workunit.client.0.smithi033.stdout:7/725: unlink d5/df/d56/d99/lac 0 2024-02-15T22:40:57.596 INFO:tasks.workunit.client.0.smithi033.stdout:5/791: link d6/d14/d31/d50/cc9 d6/d14/d31/d48/d49/d53/cfb 0 2024-02-15T22:40:57.598 INFO:tasks.workunit.client.0.smithi033.stdout:9/677: link d4/d1d/d23/d32/d3e/d86/d3f/d94/caa d4/cd1 0 2024-02-15T22:40:57.599 INFO:tasks.workunit.client.0.smithi033.stdout:5/792: dread d6/d14/f1c [4194304,4194304] 0 2024-02-15T22:40:57.601 INFO:tasks.workunit.client.0.smithi033.stdout:1/787: symlink d1/d57/db1/le3 0 2024-02-15T22:40:57.602 INFO:tasks.workunit.client.0.smithi033.stdout:7/726: unlink d5/df/d40/l57 0 2024-02-15T22:40:57.604 INFO:tasks.workunit.client.0.smithi033.stdout:9/678: mkdir d4/d1d/dd2 0 2024-02-15T22:40:57.604 INFO:tasks.workunit.client.0.smithi033.stdout:9/679: chown d4/d1d/d23/d35/f63 126394 1 2024-02-15T22:40:57.604 INFO:tasks.workunit.client.0.smithi033.stdout:9/680: chown d4/d1d/d23/d32/l58 3243643 1 2024-02-15T22:40:57.606 INFO:tasks.workunit.client.0.smithi033.stdout:1/788: mknod d1/d20/d8a/d8f/da4/ce4 0 2024-02-15T22:40:57.609 INFO:tasks.workunit.client.0.smithi033.stdout:9/681: dread d4/d1d/d23/d35/f8b [0,4194304] 0 2024-02-15T22:40:57.609 INFO:tasks.workunit.client.0.smithi033.stdout:9/682: truncate d4/d1d/d23/d24/fd0 265661 0 2024-02-15T22:40:57.609 INFO:tasks.workunit.client.0.smithi033.stdout:9/683: chown d4/d1d/d23/d32/d3e/l54 6052 1 2024-02-15T22:40:57.609 INFO:tasks.workunit.client.0.smithi033.stdout:9/684: read - d4/d1d/d23/d32/d3e/d86/d3f/d94/fae zero size 2024-02-15T22:40:57.611 INFO:tasks.workunit.client.0.smithi033.stdout:1/789: dread d1/d57/f5f [0,4194304] 0 2024-02-15T22:40:57.624 INFO:tasks.workunit.client.0.smithi033.stdout:1/790: write d1/de/d27/d39/ddb/de1/d2d/d36/f54 [195008,125461] 0 2024-02-15T22:40:57.624 INFO:tasks.workunit.client.0.smithi033.stdout:1/791: dread - d1/de/fa5 zero size 2024-02-15T22:40:57.624 INFO:tasks.workunit.client.0.smithi033.stdout:7/727: dwrite d5/dc/d5f/d8b/da0/dc6/dcd/fb3 [0,4194304] 0 2024-02-15T22:40:57.625 INFO:tasks.workunit.client.0.smithi033.stdout:7/728: rmdir d5/dc/d5f/d8b/da0 39 2024-02-15T22:40:57.626 INFO:tasks.workunit.client.0.smithi033.stdout:7/729: write d5/df/d40/d73/fcc [476363,111086] 0 2024-02-15T22:40:57.626 INFO:tasks.workunit.client.0.smithi033.stdout:7/730: write d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/f7c [8515335,31007] 0 2024-02-15T22:40:57.626 INFO:tasks.workunit.client.0.smithi033.stdout:9/685: dwrite d4/d1d/d23/d24/d5e/fb4 [0,4194304] 0 2024-02-15T22:40:57.626 INFO:tasks.workunit.client.0.smithi033.stdout:9/686: fdatasync d4/d1d/d23/d24/fd0 0 2024-02-15T22:40:57.627 INFO:tasks.workunit.client.0.smithi033.stdout:7/731: creat d5/dc/d5f/d8b/ff7 x:0 0 0 2024-02-15T22:40:57.627 INFO:tasks.workunit.client.0.smithi033.stdout:7/732: fdatasync d5/df/d56/d60/d59/f74 0 2024-02-15T22:40:57.627 INFO:tasks.workunit.client.0.smithi033.stdout:7/733: fsync d5/f9b 0 2024-02-15T22:40:57.628 INFO:tasks.workunit.client.0.smithi033.stdout:9/687: symlink d4/d1d/d23/d24/ld3 0 2024-02-15T22:40:57.629 INFO:tasks.workunit.client.0.smithi033.stdout:9/688: dread d4/d1d/d23/d35/f87 [0,4194304] 0 2024-02-15T22:40:57.630 INFO:tasks.workunit.client.0.smithi033.stdout:7/734: link d5/dc/d5f/ff4 d5/dc/d5f/d8b/da0/dc6/de4/ff8 0 2024-02-15T22:40:57.631 INFO:tasks.workunit.client.0.smithi033.stdout:9/689: creat d4/d1d/d23/fd4 x:0 0 0 2024-02-15T22:40:57.631 INFO:tasks.workunit.client.0.smithi033.stdout:9/690: dread - d4/d1d/d42/fbd zero size 2024-02-15T22:40:57.631 INFO:tasks.workunit.client.0.smithi033.stdout:9/691: readlink d4/d1d/d23/d32/d71/l82 0 2024-02-15T22:40:57.635 INFO:tasks.workunit.client.0.smithi033.stdout:9/692: rmdir d4/d1d/d23/d24/d51/d5d 39 2024-02-15T22:40:57.635 INFO:tasks.workunit.client.0.smithi033.stdout:9/693: getdents d4/d1d/d23/d32/d3e/d86/d3f/d94/d9c 0 2024-02-15T22:40:57.636 INFO:tasks.workunit.client.0.smithi033.stdout:9/694: creat d4/d1d/dd2/fd5 x:0 0 0 2024-02-15T22:40:57.639 INFO:tasks.workunit.client.0.smithi033.stdout:9/695: unlink d4/f6f 0 2024-02-15T22:40:57.639 INFO:tasks.workunit.client.0.smithi033.stdout:9/696: creat d4/d1d/d23/d32/d3e/d86/d3f/fd6 x:0 0 0 2024-02-15T22:40:57.639 INFO:tasks.workunit.client.0.smithi033.stdout:9/697: dread - d4/d1d/d23/d24/d5a/fc4 zero size 2024-02-15T22:40:57.640 INFO:tasks.workunit.client.0.smithi033.stdout:9/698: getdents d4/d1d/d23/d24 0 2024-02-15T22:40:57.650 INFO:tasks.workunit.client.0.smithi033.stdout:7/735: dwrite d5/dc/d5f/d8b/da1/f21 [0,4194304] 0 2024-02-15T22:40:57.650 INFO:tasks.workunit.client.0.smithi033.stdout:7/736: stat d5/df/d40/d73/dd2 0 2024-02-15T22:40:57.651 INFO:tasks.workunit.client.0.smithi033.stdout:7/737: creat d5/df/ff9 x:0 0 0 2024-02-15T22:40:57.653 INFO:tasks.workunit.client.0.smithi033.stdout:9/699: write d4/d1d/f7a [4924636,100126] 0 2024-02-15T22:40:57.655 INFO:tasks.workunit.client.0.smithi033.stdout:9/700: unlink d4/f19 0 2024-02-15T22:40:57.657 INFO:tasks.workunit.client.0.smithi033.stdout:9/701: rmdir d4/d1d/d23/d32/d3e/d86/d3f/d94 39 2024-02-15T22:40:57.667 INFO:tasks.workunit.client.0.smithi033.stdout:7/738: dwrite d5/d6/d10/f6d [0,4194304] 0 2024-02-15T22:40:57.669 INFO:tasks.workunit.client.0.smithi033.stdout:7/739: symlink d5/df/d56/d60/lfa 0 2024-02-15T22:40:57.669 INFO:tasks.workunit.client.0.smithi033.stdout:7/740: getdents d5/dc/d5f/d8b/da0/dc6 0 2024-02-15T22:40:57.676 INFO:tasks.workunit.client.0.smithi033.stdout:9/702: dwrite d4/d1d/d23/d24/d5e/f69 [0,4194304] 0 2024-02-15T22:40:57.679 INFO:tasks.workunit.client.0.smithi033.stdout:7/741: dread d5/df/f44 [4194304,4194304] 0 2024-02-15T22:40:57.679 INFO:tasks.workunit.client.0.smithi033.stdout:9/703: rename d4/f92 to d4/d1d/d23/d32/d3e/d86/fd7 0 2024-02-15T22:40:57.680 INFO:tasks.workunit.client.0.smithi033.stdout:9/704: creat d4/d1d/d23/d32/d71/dab/fd8 x:0 0 0 2024-02-15T22:40:57.686 INFO:tasks.workunit.client.0.smithi033.stdout:7/742: dread d5/f31 [0,4194304] 0 2024-02-15T22:40:57.687 INFO:tasks.workunit.client.0.smithi033.stdout:7/743: mkdir d5/dc/d5f/d8b/de1/dfb 0 2024-02-15T22:40:57.703 INFO:tasks.workunit.client.0.smithi033.stdout:7/744: dwrite d5/df/d56/d60/d59/f62 [0,4194304] 0 2024-02-15T22:40:57.716 INFO:tasks.workunit.client.0.smithi033.stdout:7/745: dwrite d5/df/d56/d99/fd0 [0,4194304] 0 2024-02-15T22:40:57.718 INFO:tasks.workunit.client.0.smithi033.stdout:7/746: link d5/dc/l7e d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/lfc 0 2024-02-15T22:40:57.720 INFO:tasks.workunit.client.0.smithi033.stdout:7/747: rename d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/db1/cc9 to d5/dc/d5f/d8b/da0/dc6/de4/de5/cfd 0 2024-02-15T22:40:57.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/654: sync 2024-02-15T22:40:57.824 INFO:tasks.workunit.client.0.smithi033.stdout:8/732: sync 2024-02-15T22:40:57.824 INFO:tasks.workunit.client.0.smithi033.stdout:4/792: sync 2024-02-15T22:40:57.824 INFO:tasks.workunit.client.0.smithi033.stdout:6/576: sync 2024-02-15T22:40:57.824 INFO:tasks.workunit.client.0.smithi033.stdout:2/882: sync 2024-02-15T22:40:57.824 INFO:tasks.workunit.client.0.smithi033.stdout:0/655: symlink db/d19/dd8/ld9 0 2024-02-15T22:40:57.825 INFO:tasks.workunit.client.0.smithi033.stdout:8/733: symlink d1/d36/l103 0 2024-02-15T22:40:57.825 INFO:tasks.workunit.client.0.smithi033.stdout:6/577: mknod d12/d3c/d95/d3f/d4b/dac/cc6 0 2024-02-15T22:40:57.829 INFO:tasks.workunit.client.0.smithi033.stdout:2/883: creat d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d62/f119 x:0 0 0 2024-02-15T22:40:57.829 INFO:tasks.workunit.client.0.smithi033.stdout:2/884: write d1/d16/d5a/fea [311738,40395] 0 2024-02-15T22:40:57.832 INFO:tasks.workunit.client.0.smithi033.stdout:4/793: write d8/fe [7618119,28239] 0 2024-02-15T22:40:57.832 INFO:tasks.workunit.client.0.smithi033.stdout:4/794: readlink d8/d16/d45/l63 0 2024-02-15T22:40:57.832 INFO:tasks.workunit.client.0.smithi033.stdout:4/795: chown d8/d16/d51/d1c/db9/d37/d31/d80/fe7 410 1 2024-02-15T22:40:57.832 INFO:tasks.workunit.client.0.smithi033.stdout:8/734: creat d1/d68/d57/df2/f104 x:0 0 0 2024-02-15T22:40:57.834 INFO:tasks.workunit.client.0.smithi033.stdout:6/578: mkdir d12/d2c/d30/d90/dc7 0 2024-02-15T22:40:57.835 INFO:tasks.workunit.client.0.smithi033.stdout:2/885: dread d1/f7 [0,4194304] 0 2024-02-15T22:40:57.835 INFO:tasks.workunit.client.0.smithi033.stdout:0/656: rename db/d19/d32/d46/c4c to db/d19/d32/d43/cda 0 2024-02-15T22:40:57.836 INFO:tasks.workunit.client.0.smithi033.stdout:4/796: creat d8/d16/d51/d1c/db9/d37/d23/d61/df3/f105 x:0 0 0 2024-02-15T22:40:57.836 INFO:tasks.workunit.client.0.smithi033.stdout:4/797: fdatasync d8/d16/d51/d1c/db9/fbd 0 2024-02-15T22:40:57.837 INFO:tasks.workunit.client.0.smithi033.stdout:8/735: mkdir d1/de/d63/d105 0 2024-02-15T22:40:57.838 INFO:tasks.workunit.client.0.smithi033.stdout:2/886: symlink d1/d8/d2b/d2f/d24/d31/l11a 0 2024-02-15T22:40:57.839 INFO:tasks.workunit.client.0.smithi033.stdout:8/736: dread d1/dae/fcc [0,4194304] 0 2024-02-15T22:40:57.839 INFO:tasks.workunit.client.0.smithi033.stdout:8/737: chown d1/d74/dc1/d75/dbf/d79/l25 218 1 2024-02-15T22:40:57.839 INFO:tasks.workunit.client.0.smithi033.stdout:8/738: chown d1/de/d1a/d2a/f3c 16998 1 2024-02-15T22:40:57.839 INFO:tasks.workunit.client.0.smithi033.stdout:8/739: chown d1/de/d5c/ld9 289 1 2024-02-15T22:40:57.840 INFO:tasks.workunit.client.0.smithi033.stdout:0/657: creat db/d60/fdb x:0 0 0 2024-02-15T22:40:57.842 INFO:tasks.workunit.client.0.smithi033.stdout:4/798: mkdir d8/d16/d106 0 2024-02-15T22:40:57.842 INFO:tasks.workunit.client.0.smithi033.stdout:4/799: write d8/d16/d51/d1c/d3c/d49/fee [427083,97088] 0 2024-02-15T22:40:57.842 INFO:tasks.workunit.client.0.smithi033.stdout:4/800: truncate d8/d1a/f91 492370 0 2024-02-15T22:40:57.843 INFO:tasks.workunit.client.0.smithi033.stdout:2/887: rename d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d62/db7 to d1/d8/d2b/d2f/d13/d59/d76/d118/d11b 0 2024-02-15T22:40:57.844 INFO:tasks.workunit.client.0.smithi033.stdout:8/740: mknod d1/d36/c106 0 2024-02-15T22:40:57.846 INFO:tasks.workunit.client.0.smithi033.stdout:4/801: mkdir d8/d16/d51/d1c/db9/d37/d23/d61/d107 0 2024-02-15T22:40:57.846 INFO:tasks.workunit.client.0.smithi033.stdout:4/802: read d8/f4a [207067,15873] 0 2024-02-15T22:40:57.846 INFO:tasks.workunit.client.0.smithi033.stdout:4/803: fdatasync d8/d16/d51/d1c/db9/d37/d23/d61/f65 0 2024-02-15T22:40:57.847 INFO:tasks.workunit.client.0.smithi033.stdout:8/741: creat d1/d74/dc1/d75/d83/f107 x:0 0 0 2024-02-15T22:40:57.847 INFO:tasks.workunit.client.0.smithi033.stdout:8/742: write d1/d68/d57/fc5 [500525,102127] 0 2024-02-15T22:40:57.849 INFO:tasks.workunit.client.0.smithi033.stdout:8/743: getdents d1/de/d1a/d27/d60 0 2024-02-15T22:40:57.854 INFO:tasks.workunit.client.0.smithi033.stdout:6/579: dwrite d12/d2c/d30/d1d/f60 [0,4194304] 0 2024-02-15T22:40:57.859 INFO:tasks.workunit.client.0.smithi033.stdout:0/658: dwrite db/fa8 [0,4194304] 0 2024-02-15T22:40:57.863 INFO:tasks.workunit.client.0.smithi033.stdout:0/659: symlink db/d2a/d6c/ldc 0 2024-02-15T22:40:57.865 INFO:tasks.workunit.client.0.smithi033.stdout:0/660: rmdir db/d2a/d6e/dc3 39 2024-02-15T22:40:57.865 INFO:tasks.workunit.client.0.smithi033.stdout:0/661: fsync db/d2a/f40 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/580: dwrite d12/d2c/d30/f49 [0,4194304] 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/581: write d12/d3c/da1/fb4 [241126,68448] 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/582: unlink d12/d2c/dc0/l9e 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/583: mkdir d12/d2c/dc0/dc8 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/584: truncate d12/d3c/d95/d3f/d4b/d6f/f9c 60799 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/585: creat d12/d3c/d95/d3f/db6/fc9 x:0 0 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/586: chown d12/d2c/d30/d90/dc7 14 1 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/587: creat d12/d2c/d30/d90/fca x:0 0 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/588: fsync d12/d3c/d95/d3f/d50/f65 0 2024-02-15T22:40:57.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/589: chown d12/d3c/d95/d3f/d4b/dac 469 1 2024-02-15T22:40:57.887 INFO:tasks.workunit.client.0.smithi033.stdout:0/662: dwrite fa [0,4194304] 0 2024-02-15T22:40:57.889 INFO:tasks.workunit.client.0.smithi033.stdout:0/663: symlink db/d2a/d6e/ldd 0 2024-02-15T22:40:57.896 INFO:tasks.workunit.client.0.smithi033.stdout:6/590: dwrite d12/d2c/dbc/f84 [0,4194304] 0 2024-02-15T22:40:57.898 INFO:tasks.workunit.client.0.smithi033.stdout:6/591: dread d12/d3c/d95/f52 [0,4194304] 0 2024-02-15T22:40:57.905 INFO:tasks.workunit.client.0.smithi033.stdout:0/664: dwrite db/d19/d32/d43/d5a/d76/faa [0,4194304] 0 2024-02-15T22:40:57.908 INFO:tasks.workunit.client.0.smithi033.stdout:0/665: creat db/d19/d32/d3d/fde x:0 0 0 2024-02-15T22:40:57.913 INFO:tasks.workunit.client.0.smithi033.stdout:6/592: dwrite d12/f2b [4194304,4194304] 0 2024-02-15T22:40:57.914 INFO:tasks.workunit.client.0.smithi033.stdout:6/593: mkdir d12/d3c/d95/d3f/d50/dbd/dcb 0 2024-02-15T22:40:57.919 INFO:tasks.workunit.client.0.smithi033.stdout:6/594: dread d12/f5d [0,4194304] 0 2024-02-15T22:40:57.920 INFO:tasks.workunit.client.0.smithi033.stdout:6/595: link d12/d3c/d95/d3f/d4b/dac/d5c/lb8 d12/d2c/d30/lcc 0 2024-02-15T22:40:57.921 INFO:tasks.workunit.client.0.smithi033.stdout:6/596: read fa [1447270,90498] 0 2024-02-15T22:40:57.921 INFO:tasks.workunit.client.0.smithi033.stdout:6/597: truncate d12/f29 1290232 0 2024-02-15T22:40:57.936 INFO:tasks.workunit.client.0.smithi033.stdout:6/598: dwrite d12/d3c/da1/fb4 [0,4194304] 0 2024-02-15T22:40:57.953 INFO:tasks.workunit.client.0.smithi033.stdout:6/599: dwrite d12/d3c/f4d [0,4194304] 0 2024-02-15T22:40:57.955 INFO:tasks.workunit.client.0.smithi033.stdout:6/600: symlink d12/d3c/d95/d3f/db6/lcd 0 2024-02-15T22:40:57.956 INFO:tasks.workunit.client.0.smithi033.stdout:6/601: creat d12/d2c/d30/da5/fce x:0 0 0 2024-02-15T22:40:57.956 INFO:tasks.workunit.client.0.smithi033.stdout:6/602: read - d12/d2c/d30/d90/fca zero size 2024-02-15T22:40:57.956 INFO:tasks.workunit.client.0.smithi033.stdout:6/603: getdents d12/d3c/d95/d3f/d50/dbd/dcb 0 2024-02-15T22:40:57.956 INFO:tasks.workunit.client.0.smithi033.stdout:6/604: fsync d12/f78 0 2024-02-15T22:40:57.957 INFO:tasks.workunit.client.0.smithi033.stdout:6/605: link d12/d2c/dbc/f26 d12/d3c/fcf 0 2024-02-15T22:40:57.957 INFO:tasks.workunit.client.0.smithi033.stdout:6/606: creat d12/d3c/d95/d3f/d4b/fd0 x:0 0 0 2024-02-15T22:40:57.959 INFO:tasks.workunit.client.0.smithi033.stdout:6/607: mknod d12/d3c/d95/d3f/cd1 0 2024-02-15T22:40:57.974 INFO:tasks.workunit.client.0.smithi033.stdout:6/608: dwrite d12/d2c/fbf [0,4194304] 0 2024-02-15T22:40:57.974 INFO:tasks.workunit.client.0.smithi033.stdout:6/609: creat d12/d3c/d95/d3f/d4b/fd2 x:0 0 0 2024-02-15T22:40:57.976 INFO:tasks.workunit.client.0.smithi033.stdout:6/610: mknod d12/d3c/d95/d3f/db6/cd3 0 2024-02-15T22:40:57.978 INFO:tasks.workunit.client.0.smithi033.stdout:6/611: mkdir d12/d2c/dbc/dd4 0 2024-02-15T22:40:57.978 INFO:tasks.workunit.client.0.smithi033.stdout:6/612: mknod d12/d2c/dc0/dc8/cd5 0 2024-02-15T22:40:57.988 INFO:tasks.workunit.client.0.smithi033.stdout:6/613: write d12/d2c/d30/f49 [884888,83553] 0 2024-02-15T22:40:57.990 INFO:tasks.workunit.client.0.smithi033.stdout:3/787: sync 2024-02-15T22:40:57.990 INFO:tasks.workunit.client.0.smithi033.stdout:3/788: write d0/d1c/f32 [2681516,113574] 0 2024-02-15T22:40:57.992 INFO:tasks.workunit.client.0.smithi033.stdout:3/789: mkdir d0/d3/d2c/d5d/d3d/d57/d68/dfe 0 2024-02-15T22:40:57.999 INFO:tasks.workunit.client.0.smithi033.stdout:3/790: dread d0/d3/d2c/d43/fc6 [0,4194304] 0 2024-02-15T22:40:57.999 INFO:tasks.workunit.client.0.smithi033.stdout:3/791: stat d0/d3/d3b/d47/fa3 0 2024-02-15T22:40:58.000 INFO:tasks.workunit.client.0.smithi033.stdout:3/792: mkdir d0/d3/d2c/d5d/d3d/d57/d68/dfe/dff 0 2024-02-15T22:40:58.008 INFO:tasks.workunit.client.0.smithi033.stdout:6/614: dwrite d12/d2c/fbf [0,4194304] 0 2024-02-15T22:40:58.008 INFO:tasks.workunit.client.0.smithi033.stdout:6/615: chown d12/fad 14 1 2024-02-15T22:40:58.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/616: mkdir d12/d2c/d30/d90/dc7/dd6 0 2024-02-15T22:40:58.011 INFO:tasks.workunit.client.0.smithi033.stdout:6/617: rename d12/d3c/d95/d3f/d50/f8e to d12/d3c/d95/d3f/d4b/dac/d5c/fd7 0 2024-02-15T22:40:58.012 INFO:tasks.workunit.client.0.smithi033.stdout:6/618: unlink d12/d2c/d30/f31 0 2024-02-15T22:40:58.012 INFO:tasks.workunit.client.0.smithi033.stdout:6/619: dread - d12/d3c/d95/d3f/da3/faa zero size 2024-02-15T22:40:58.013 INFO:tasks.workunit.client.0.smithi033.stdout:3/793: dread d0/d1c/f29 [0,4194304] 0 2024-02-15T22:40:58.013 INFO:tasks.workunit.client.0.smithi033.stdout:3/794: chown d0/d3/d2c/d5d/fd2 460 1 2024-02-15T22:40:58.014 INFO:tasks.workunit.client.0.smithi033.stdout:3/795: truncate d0/d3/dd/f7e 764637 0 2024-02-15T22:40:58.016 INFO:tasks.workunit.client.0.smithi033.stdout:3/796: mkdir d0/d3/d2c/d5d/d3d/d8f/d93/d100 0 2024-02-15T22:40:58.016 INFO:tasks.workunit.client.0.smithi033.stdout:3/797: fsync d0/d3/d2c/d5d/d3d/d57/d68/fd5 0 2024-02-15T22:40:58.016 INFO:tasks.workunit.client.0.smithi033.stdout:3/798: creat d0/d3/d2c/d5d/d3d/f101 x:0 0 0 2024-02-15T22:40:58.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:57 smithi033 ceph-mon[29033]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:58.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:57 smithi033 ceph-mon[29033]: pgmap v11: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 119 MiB/s rd, 137 MiB/s wr, 219 op/s 2024-02-15T22:40:58.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:57 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/4034308337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:40:58.024 INFO:tasks.workunit.client.0.smithi033.stdout:3/799: dread d0/fe [0,4194304] 0 2024-02-15T22:40:58.024 INFO:tasks.workunit.client.0.smithi033.stdout:3/800: truncate d0/d3/d2c/d5d/d3d/d57/d68/df6/ffa 735233 0 2024-02-15T22:40:58.024 INFO:tasks.workunit.client.0.smithi033.stdout:3/801: chown d0/d3/dd/cfb 201 1 2024-02-15T22:40:58.025 INFO:tasks.workunit.client.0.smithi033.stdout:3/802: symlink d0/d3/d2c/d5d/d3d/d8f/dd7/l102 0 2024-02-15T22:40:58.083 INFO:tasks.workunit.client.0.smithi033.stdout:5/793: sync 2024-02-15T22:40:58.083 INFO:tasks.workunit.client.0.smithi033.stdout:1/792: sync 2024-02-15T22:40:58.083 INFO:tasks.workunit.client.0.smithi033.stdout:5/794: write d6/d14/d31/d48/d49/d53/d57/da1/fc2 [1167652,39337] 0 2024-02-15T22:40:58.084 INFO:tasks.workunit.client.0.smithi033.stdout:5/795: mknod d6/d14/d31/d50/d5c/dd6/cfc 0 2024-02-15T22:40:58.086 INFO:tasks.workunit.client.0.smithi033.stdout:5/796: mknod d6/d14/d31/d38/d9b/dd3/d7a/db9/cfd 0 2024-02-15T22:40:58.087 INFO:tasks.workunit.client.0.smithi033.stdout:5/797: mknod d6/d14/d31/d48/d49/d53/d57/cfe 0 2024-02-15T22:40:58.092 INFO:tasks.workunit.client.0.smithi033.stdout:1/793: write d1/de/d27/d39/ddb/de1/d2d/d5e/f61 [6340673,10165] 0 2024-02-15T22:40:58.092 INFO:tasks.workunit.client.0.smithi033.stdout:1/794: readlink d1/de/d27/d39/ddb/de1/d79/dc4/lc7 0 2024-02-15T22:40:58.092 INFO:tasks.workunit.client.0.smithi033.stdout:1/795: truncate d1/f6 3128722 0 2024-02-15T22:40:58.095 INFO:tasks.workunit.client.0.smithi033.stdout:1/796: mkdir d1/d20/d42/d2c/d4e/de5 0 2024-02-15T22:40:58.097 INFO:tasks.workunit.client.0.smithi033.stdout:1/797: dread d1/d20/d42/d25/d67/fb6 [0,4194304] 0 2024-02-15T22:40:58.097 INFO:tasks.workunit.client.0.smithi033.stdout:1/798: write d1/de/d27/d39/d3a/f71 [3645929,106708] 0 2024-02-15T22:40:58.098 INFO:tasks.workunit.client.0.smithi033.stdout:1/799: readlink d1/de/l59 0 2024-02-15T22:40:58.099 INFO:tasks.workunit.client.0.smithi033.stdout:1/800: mknod d1/d20/d42/d2c/ce6 0 2024-02-15T22:40:58.099 INFO:tasks.workunit.client.0.smithi033.stdout:1/801: chown d1/de/fd5 13388 1 2024-02-15T22:40:58.100 INFO:tasks.workunit.client.0.smithi033.stdout:1/802: creat d1/de/d27/d39/ddb/fe7 x:0 0 0 2024-02-15T22:40:58.104 INFO:tasks.workunit.client.0.smithi033.stdout:5/798: dwrite d6/f10 [0,4194304] 0 2024-02-15T22:40:58.119 INFO:tasks.workunit.client.0.smithi033.stdout:5/799: dwrite d6/d14/d31/d48/d49/fdf [0,4194304] 0 2024-02-15T22:40:58.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:57 smithi082 ceph-mon[37153]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:58.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:57 smithi082 ceph-mon[37153]: pgmap v11: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 119 MiB/s rd, 137 MiB/s wr, 219 op/s 2024-02-15T22:40:58.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:57 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/4034308337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:40:58.136 INFO:tasks.workunit.client.0.smithi033.stdout:5/800: dwrite d6/fb1 [0,4194304] 0 2024-02-15T22:40:58.139 INFO:tasks.workunit.client.0.smithi033.stdout:5/801: creat d6/d14/d31/d50/d6a/fff x:0 0 0 2024-02-15T22:40:58.144 INFO:tasks.workunit.client.0.smithi033.stdout:5/802: dread d6/d25/f55 [0,4194304] 0 2024-02-15T22:40:58.146 INFO:tasks.workunit.client.0.smithi033.stdout:5/803: creat d6/d14/d31/d48/d56/dcc/f100 x:0 0 0 2024-02-15T22:40:58.146 INFO:tasks.workunit.client.0.smithi033.stdout:5/804: readlink d6/l75 0 2024-02-15T22:40:58.146 INFO:tasks.workunit.client.0.smithi033.stdout:5/805: truncate d6/d14/d31/d38/d9b/dd3/fc4 1019668 0 2024-02-15T22:40:58.156 INFO:tasks.workunit.client.0.smithi033.stdout:5/806: dread d6/fb1 [0,4194304] 0 2024-02-15T22:40:58.156 INFO:tasks.workunit.client.0.smithi033.stdout:5/807: write d6/d14/d31/d48/d49/d53/d57/f8c [1602218,85111] 0 2024-02-15T22:40:58.158 INFO:tasks.workunit.client.0.smithi033.stdout:5/808: getdents d6/db0/d70 0 2024-02-15T22:40:58.159 INFO:tasks.workunit.client.0.smithi033.stdout:5/809: mkdir d6/d14/d31/d38/d9b/dd3/d7a/db9/d101 0 2024-02-15T22:40:58.161 INFO:tasks.workunit.client.0.smithi033.stdout:5/810: symlink d6/d14/d31/d50/d5c/dd6/l102 0 2024-02-15T22:40:58.164 INFO:tasks.workunit.client.0.smithi033.stdout:5/811: unlink d6/f33 0 2024-02-15T22:40:58.165 INFO:tasks.workunit.client.0.smithi033.stdout:5/812: mknod d6/d14/d31/d50/d6a/daf/c103 0 2024-02-15T22:40:58.179 INFO:tasks.workunit.client.0.smithi033.stdout:5/813: dwrite d6/d25/ffa [0,4194304] 0 2024-02-15T22:40:58.179 INFO:tasks.workunit.client.0.smithi033.stdout:5/814: readlink d6/d14/d31/d48/d49/d53/le9 0 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:4/804: sync 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:8/744: sync 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:4/805: getdents d8/d69/db3 0 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:0/666: sync 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:7/748: sync 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:2/888: sync 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:4/806: truncate d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/fdc 522484 0 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:7/749: readlink d5/df/ld1 0 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:9/705: sync 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:7/750: write d5/dc/d5f/d8b/da0/dc6/de4/de5/f93 [4212934,121707] 0 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:7/751: chown l2 1 1 2024-02-15T22:40:58.201 INFO:tasks.workunit.client.0.smithi033.stdout:5/815: dwrite d6/d14/f45 [0,4194304] 0 2024-02-15T22:40:58.202 INFO:tasks.workunit.client.0.smithi033.stdout:8/745: unlink d1/d74/dc1/d75/dbf/d79/c3e 0 2024-02-15T22:40:58.203 INFO:tasks.workunit.client.0.smithi033.stdout:8/746: write d1/d74/dc1/d75/db1/dde/fe4 [661706,68339] 0 2024-02-15T22:40:58.203 INFO:tasks.workunit.client.0.smithi033.stdout:0/667: mknod db/d19/d32/d46/daf/cdf 0 2024-02-15T22:40:58.203 INFO:tasks.workunit.client.0.smithi033.stdout:4/807: rmdir d8/d16/d51/d1c/db9/d37/dce 39 2024-02-15T22:40:58.205 INFO:tasks.workunit.client.0.smithi033.stdout:2/889: mknod d1/d8/d2b/d2f/d13/d6f/db5/c11c 0 2024-02-15T22:40:58.205 INFO:tasks.workunit.client.0.smithi033.stdout:2/890: chown d1/d8/fe 524498455 1 2024-02-15T22:40:58.205 INFO:tasks.workunit.client.0.smithi033.stdout:2/891: fdatasync d1/d8/d2b/d2f/d3d/faa 0 2024-02-15T22:40:58.207 INFO:tasks.workunit.client.0.smithi033.stdout:9/706: mknod d4/d1d/d23/d24/d51/d5d/dbc/cd9 0 2024-02-15T22:40:58.210 INFO:tasks.workunit.client.0.smithi033.stdout:8/747: creat d1/d68/f108 x:0 0 0 2024-02-15T22:40:58.210 INFO:tasks.workunit.client.0.smithi033.stdout:8/748: dread - d1/d74/dc1/d75/dbf/fd6 zero size 2024-02-15T22:40:58.210 INFO:tasks.workunit.client.0.smithi033.stdout:8/749: truncate d1/de/d1a/d27/d60/fc9 1874773 0 2024-02-15T22:40:58.212 INFO:tasks.workunit.client.0.smithi033.stdout:0/668: symlink db/d2a/d68/le0 0 2024-02-15T22:40:58.213 INFO:tasks.workunit.client.0.smithi033.stdout:4/808: symlink d8/d16/d51/d1c/db9/d37/dce/l108 0 2024-02-15T22:40:58.215 INFO:tasks.workunit.client.0.smithi033.stdout:2/892: link d1/d16/d5a/d67/ld4 d1/d16/d5a/l11d 0 2024-02-15T22:40:58.216 INFO:tasks.workunit.client.0.smithi033.stdout:5/816: dread d6/db0/d70/fe4 [0,4194304] 0 2024-02-15T22:40:58.217 INFO:tasks.workunit.client.0.smithi033.stdout:9/707: mknod d4/d1d/d23/d32/d3e/d86/d3f/dc7/cda 0 2024-02-15T22:40:58.218 INFO:tasks.workunit.client.0.smithi033.stdout:2/893: dread d1/d8/d2b/d2f/d24/d7a/fa5 [0,4194304] 0 2024-02-15T22:40:58.218 INFO:tasks.workunit.client.0.smithi033.stdout:2/894: fdatasync d1/d66/f110 0 2024-02-15T22:40:58.219 INFO:tasks.workunit.client.0.smithi033.stdout:8/750: rmdir d1/de/d63 39 2024-02-15T22:40:58.221 INFO:tasks.workunit.client.0.smithi033.stdout:0/669: creat db/d2a/d6e/d7a/fe1 x:0 0 0 2024-02-15T22:40:58.222 INFO:tasks.workunit.client.0.smithi033.stdout:4/809: rmdir d8/d16/d97 39 2024-02-15T22:40:58.222 INFO:tasks.workunit.client.0.smithi033.stdout:0/670: write db/d2a/d68/da9/fc6 [1018325,114997] 0 2024-02-15T22:40:58.223 INFO:tasks.workunit.client.0.smithi033.stdout:0/671: fsync db/d19/f1e 0 2024-02-15T22:40:58.223 INFO:tasks.workunit.client.0.smithi033.stdout:0/672: write db/d2a/d6e/dc3/fcb [531553,47516] 0 2024-02-15T22:40:58.223 INFO:tasks.workunit.client.0.smithi033.stdout:0/673: fdatasync db/d19/d32/d46/f4f 0 2024-02-15T22:40:58.223 INFO:tasks.workunit.client.0.smithi033.stdout:0/674: truncate db/d2a/d68/da9/fad 401491 0 2024-02-15T22:40:58.223 INFO:tasks.workunit.client.0.smithi033.stdout:5/817: link d6/db0/c81 d6/d14/d31/d38/d9b/dd3/d7a/c104 0 2024-02-15T22:40:58.224 INFO:tasks.workunit.client.0.smithi033.stdout:9/708: mkdir d4/d1d/d23/d32/da7/ddb 0 2024-02-15T22:40:58.225 INFO:tasks.workunit.client.0.smithi033.stdout:8/751: creat d1/de/d5c/f109 x:0 0 0 2024-02-15T22:40:58.225 INFO:tasks.workunit.client.0.smithi033.stdout:8/752: creat d1/de/d1a/f10a x:0 0 0 2024-02-15T22:40:58.227 INFO:tasks.workunit.client.0.smithi033.stdout:5/818: rename d6/d14/d31/d38/d9b/c4b to d6/d25/d99/da8/c105 0 2024-02-15T22:40:58.227 INFO:tasks.workunit.client.0.smithi033.stdout:9/709: stat d4/d1d/d23/d35/l84 0 2024-02-15T22:40:58.227 INFO:tasks.workunit.client.0.smithi033.stdout:9/710: chown d4/d1d/d23/f98 105 1 2024-02-15T22:40:58.227 INFO:tasks.workunit.client.0.smithi033.stdout:9/711: readlink d4/d1d/d23/d24/l27 0 2024-02-15T22:40:58.230 INFO:tasks.workunit.client.0.smithi033.stdout:7/752: dwrite d5/df/d56/d60/f6b [0,4194304] 0 2024-02-15T22:40:58.230 INFO:tasks.workunit.client.0.smithi033.stdout:8/753: mkdir d1/de/d1a/d27/d10b 0 2024-02-15T22:40:58.233 INFO:tasks.workunit.client.0.smithi033.stdout:0/675: getdents db/d19/d32 0 2024-02-15T22:40:58.238 INFO:tasks.workunit.client.0.smithi033.stdout:4/810: write d8/d16/d51/d1c/db9/d37/d31/d47/d85/fb6 [8093964,38958] 0 2024-02-15T22:40:58.244 INFO:tasks.workunit.client.0.smithi033.stdout:2/895: dwrite d1/d8/d2b/d2f/d13/da9/f63 [0,4194304] 0 2024-02-15T22:40:58.249 INFO:tasks.workunit.client.0.smithi033.stdout:8/754: mknod d1/d74/dc1/d75/db1/db5/dfb/d14/d5d/c10c 0 2024-02-15T22:40:58.252 INFO:tasks.workunit.client.0.smithi033.stdout:4/811: rename d8/d16/d51/d1c/db9/d37/d31/c57 to d8/d16/d51/d1c/d96/c109 0 2024-02-15T22:40:58.253 INFO:tasks.workunit.client.0.smithi033.stdout:4/812: write d8/d16/f9e [111066,22463] 0 2024-02-15T22:40:58.265 INFO:tasks.workunit.client.0.smithi033.stdout:5/819: dwrite d6/d14/d31/d38/d9b/f71 [0,4194304] 0 2024-02-15T22:40:58.265 INFO:tasks.workunit.client.0.smithi033.stdout:5/820: stat d6/d14/d31/c39 0 2024-02-15T22:40:58.265 INFO:tasks.workunit.client.0.smithi033.stdout:5/821: chown d6/d14/d31/d38/d9b/ld0 32311 1 2024-02-15T22:40:58.282 INFO:tasks.workunit.client.0.smithi033.stdout:9/712: dwrite d4/d1d/d23/f98 [0,4194304] 0 2024-02-15T22:40:58.288 INFO:tasks.workunit.client.0.smithi033.stdout:7/753: dwrite d5/dc/d5f/d8b/da1/d26/f2a [4194304,4194304] 0 2024-02-15T22:40:58.288 INFO:tasks.workunit.client.0.smithi033.stdout:0/676: dwrite db/d2a/f8c [0,4194304] 0 2024-02-15T22:40:58.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/896: dwrite d1/d16/d3f/df5/f111 [4194304,4194304] 0 2024-02-15T22:40:58.289 INFO:tasks.workunit.client.0.smithi033.stdout:8/755: dwrite d1/d74/dc1/f29 [8388608,4194304] 0 2024-02-15T22:40:58.290 INFO:tasks.workunit.client.0.smithi033.stdout:5/822: dwrite d6/d25/f35 [4194304,4194304] 0 2024-02-15T22:40:58.293 INFO:tasks.workunit.client.0.smithi033.stdout:7/754: mknod d5/dc/d5f/d8b/da0/dc6/cfe 0 2024-02-15T22:40:58.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/677: mknod db/d19/d32/d43/d94/ce2 0 2024-02-15T22:40:58.295 INFO:tasks.workunit.client.0.smithi033.stdout:8/756: dread d1/de/d1a/d27/fbc [0,4194304] 0 2024-02-15T22:40:58.296 INFO:tasks.workunit.client.0.smithi033.stdout:5/823: rmdir d6/d14/d31/d50/d5c/dd6 39 2024-02-15T22:40:58.296 INFO:tasks.workunit.client.0.smithi033.stdout:5/824: chown d6/d25/f55 239 1 2024-02-15T22:40:58.296 INFO:tasks.workunit.client.0.smithi033.stdout:5/825: truncate d6/d14/d31/d48/d49/d53/d57/fbf 847334 0 2024-02-15T22:40:58.297 INFO:tasks.workunit.client.0.smithi033.stdout:7/755: creat d5/df/d40/d81/fff x:0 0 0 2024-02-15T22:40:58.298 INFO:tasks.workunit.client.0.smithi033.stdout:9/713: dwrite d4/d1d/d23/fd4 [0,4194304] 0 2024-02-15T22:40:58.298 INFO:tasks.workunit.client.0.smithi033.stdout:9/714: write d4/d1d/d23/d24/f4b [1057215,12182] 0 2024-02-15T22:40:58.299 INFO:tasks.workunit.client.0.smithi033.stdout:5/826: mknod d6/d14/df5/c106 0 2024-02-15T22:40:58.299 INFO:tasks.workunit.client.0.smithi033.stdout:5/827: write d6/d14/d31/d38/d3f/f92 [2767225,63886] 0 2024-02-15T22:40:58.301 INFO:tasks.workunit.client.0.smithi033.stdout:8/757: rmdir d1/de/d5c 39 2024-02-15T22:40:58.305 INFO:tasks.workunit.client.0.smithi033.stdout:7/756: write d5/df/d56/d84/fd8 [2923214,126556] 0 2024-02-15T22:40:58.312 INFO:tasks.workunit.client.0.smithi033.stdout:0/678: dread db/d19/f1a [0,4194304] 0 2024-02-15T22:40:58.312 INFO:tasks.workunit.client.0.smithi033.stdout:0/679: write db/d19/f1a [3168914,103654] 0 2024-02-15T22:40:58.313 INFO:tasks.workunit.client.0.smithi033.stdout:0/680: chown db/d2a/la5 395 1 2024-02-15T22:40:58.313 INFO:tasks.workunit.client.0.smithi033.stdout:0/681: chown db/d19/d32/d46/ld1 2431383 1 2024-02-15T22:40:58.314 INFO:tasks.workunit.client.0.smithi033.stdout:5/828: dread d6/d25/f40 [0,4194304] 0 2024-02-15T22:40:58.315 INFO:tasks.workunit.client.0.smithi033.stdout:8/758: write d1/de/d1a/f20 [754052,66324] 0 2024-02-15T22:40:58.315 INFO:tasks.workunit.client.0.smithi033.stdout:8/759: creat d1/de/d1a/d2a/f10d x:0 0 0 2024-02-15T22:40:58.315 INFO:tasks.workunit.client.0.smithi033.stdout:8/760: write d1/de/d1a/d2a/f102 [331552,56340] 0 2024-02-15T22:40:58.315 INFO:tasks.workunit.client.0.smithi033.stdout:2/897: dwrite d1/d16/d5a/d67/f80 [0,4194304] 0 2024-02-15T22:40:58.315 INFO:tasks.workunit.client.0.smithi033.stdout:2/898: fsync d1/d8/d2b/d2f/d24/d7a/fa5 0 2024-02-15T22:40:58.316 INFO:tasks.workunit.client.0.smithi033.stdout:2/899: chown d1/d8/d2b/d2f/d13/da9 354904 1 2024-02-15T22:40:58.317 INFO:tasks.workunit.client.0.smithi033.stdout:7/757: dread d5/dc/d5f/d8b/da0/dc6/dcd/fb3 [0,4194304] 0 2024-02-15T22:40:58.317 INFO:tasks.workunit.client.0.smithi033.stdout:5/829: truncate d6/d25/ffa 1187162 0 2024-02-15T22:40:58.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/715: dwrite d4/d1d/d23/d24/d51/d8a/f96 [0,4194304] 0 2024-02-15T22:40:58.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/716: truncate d4/f9 4970674 0 2024-02-15T22:40:58.320 INFO:tasks.workunit.client.0.smithi033.stdout:8/761: unlink d1/de/d1a/d2a/d40/l5f 0 2024-02-15T22:40:58.322 INFO:tasks.workunit.client.0.smithi033.stdout:2/900: link d1/d8/d2b/d2f/d24/d2a/d88/d8e/ccb d1/d8/d2b/d2f/d12/c11e 0 2024-02-15T22:40:58.323 INFO:tasks.workunit.client.0.smithi033.stdout:5/830: symlink d6/d14/d31/d38/d9b/l107 0 2024-02-15T22:40:58.323 INFO:tasks.workunit.client.0.smithi033.stdout:5/831: chown d6/ldd 63680 1 2024-02-15T22:40:58.326 INFO:tasks.workunit.client.0.smithi033.stdout:9/717: write d4/d1d/d23/d35/fc0 [476702,30384] 0 2024-02-15T22:40:58.332 INFO:tasks.workunit.client.0.smithi033.stdout:8/762: rename d1/fb8 to d1/de/d1a/d27/d55/f10e 0 2024-02-15T22:40:58.334 INFO:tasks.workunit.client.0.smithi033.stdout:2/901: stat d1/d8/d2b/d2f/d3d/c54 0 2024-02-15T22:40:58.337 INFO:tasks.workunit.client.0.smithi033.stdout:5/832: unlink d6/d14/d31/d48/d56/dcc/f100 0 2024-02-15T22:40:58.340 INFO:tasks.workunit.client.0.smithi033.stdout:8/763: write d1/de/d1a/d27/fe7 [5512256,43203] 0 2024-02-15T22:40:58.340 INFO:tasks.workunit.client.0.smithi033.stdout:8/764: truncate d1/d68/d44/fb9 926715 0 2024-02-15T22:40:58.341 INFO:tasks.workunit.client.0.smithi033.stdout:9/718: rmdir d4/d1d/d23/d24/d5e 39 2024-02-15T22:40:58.343 INFO:tasks.workunit.client.0.smithi033.stdout:9/719: dread d4/d1d/d23/d32/d3e/d86/d3f/d94/f97 [0,4194304] 0 2024-02-15T22:40:58.343 INFO:tasks.workunit.client.0.smithi033.stdout:9/720: truncate d4/d1d/d23/f98 4224626 0 2024-02-15T22:40:58.343 INFO:tasks.workunit.client.0.smithi033.stdout:8/765: mkdir d1/d74/dc1/d75/dbf/d79/d94/d10f 0 2024-02-15T22:40:58.343 INFO:tasks.workunit.client.0.smithi033.stdout:7/758: dwrite d5/df/d56/d84/fd8 [4194304,4194304] 0 2024-02-15T22:40:58.345 INFO:tasks.workunit.client.0.smithi033.stdout:9/721: creat d4/d1d/d23/d32/d3e/d86/fdc x:0 0 0 2024-02-15T22:40:58.345 INFO:tasks.workunit.client.0.smithi033.stdout:9/722: write d4/d1d/d23/fd4 [4913571,116861] 0 2024-02-15T22:40:58.345 INFO:tasks.workunit.client.0.smithi033.stdout:9/723: chown d4/d1d/d23/d32/d3e/d86/d3f/d94/f97 27935975 1 2024-02-15T22:40:58.345 INFO:tasks.workunit.client.0.smithi033.stdout:9/724: readlink d4/d1d/d23/d32/l58 0 2024-02-15T22:40:58.345 INFO:tasks.workunit.client.0.smithi033.stdout:9/725: chown d4/d1d/dd2 55 1 2024-02-15T22:40:58.347 INFO:tasks.workunit.client.0.smithi033.stdout:7/759: mkdir d5/d6/d10/d100 0 2024-02-15T22:40:58.347 INFO:tasks.workunit.client.0.smithi033.stdout:7/760: write d5/dc/d5f/d8b/da0/dc6/de4/de5/f93 [5228460,113752] 0 2024-02-15T22:40:58.350 INFO:tasks.workunit.client.0.smithi033.stdout:5/833: write d6/d25/d99/fa4 [6770075,98998] 0 2024-02-15T22:40:58.352 INFO:tasks.workunit.client.0.smithi033.stdout:7/761: link d5/dc/d5f/d8b/da1/d26/c4c d5/df/d56/c101 0 2024-02-15T22:40:58.352 INFO:tasks.workunit.client.0.smithi033.stdout:7/762: truncate d5/dc/fc2 4580577 0 2024-02-15T22:40:58.355 INFO:tasks.workunit.client.0.smithi033.stdout:9/726: write d4/d1d/d42/fa0 [2468014,110394] 0 2024-02-15T22:40:58.356 INFO:tasks.workunit.client.0.smithi033.stdout:7/763: rename d5/dc/d5f/d8b/da0/dc6/leb to d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/l102 0 2024-02-15T22:40:58.356 INFO:tasks.workunit.client.0.smithi033.stdout:8/766: dread d1/d74/dc1/d75/dbf/d79/fca [0,4194304] 0 2024-02-15T22:40:58.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/803: sync 2024-02-15T22:40:58.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/804: read d0/f36 [3302992,717] 0 2024-02-15T22:40:58.361 INFO:tasks.workunit.client.0.smithi033.stdout:7/764: creat d5/dc/d5f/d8b/da0/dc6/de4/de9/f103 x:0 0 0 2024-02-15T22:40:58.363 INFO:tasks.workunit.client.0.smithi033.stdout:8/767: creat d1/de/d1a/d27/ddf/f110 x:0 0 0 2024-02-15T22:40:58.365 INFO:tasks.workunit.client.0.smithi033.stdout:3/805: mkdir d0/d3/d2c/d5d/d3d/d57/d68/df6/d103 0 2024-02-15T22:40:58.365 INFO:tasks.workunit.client.0.smithi033.stdout:3/806: stat d0/d3/d2c/d5d/d3d/d57/d68/dc2 0 2024-02-15T22:40:58.367 INFO:tasks.workunit.client.0.smithi033.stdout:6/620: sync 2024-02-15T22:40:58.367 INFO:tasks.workunit.client.0.smithi033.stdout:6/621: fdatasync d12/f28 0 2024-02-15T22:40:58.367 INFO:tasks.workunit.client.0.smithi033.stdout:8/768: truncate d1/f33 449614 0 2024-02-15T22:40:58.368 INFO:tasks.workunit.client.0.smithi033.stdout:2/902: dwrite d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/fa8 [0,4194304] 0 2024-02-15T22:40:58.368 INFO:tasks.workunit.client.0.smithi033.stdout:2/903: write d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f9c [5104955,108343] 0 2024-02-15T22:40:58.369 INFO:tasks.workunit.client.0.smithi033.stdout:6/622: mknod d12/d3c/d95/d3f/d50/dbd/cd8 0 2024-02-15T22:40:58.370 INFO:tasks.workunit.client.0.smithi033.stdout:1/803: sync 2024-02-15T22:40:58.370 INFO:tasks.workunit.client.0.smithi033.stdout:8/769: mknod d1/d74/dc1/d75/dbf/d79/c111 0 2024-02-15T22:40:58.373 INFO:tasks.workunit.client.0.smithi033.stdout:2/904: mkdir d1/d8/d34/d11f 0 2024-02-15T22:40:58.373 INFO:tasks.workunit.client.0.smithi033.stdout:2/905: creat d1/d8/d2b/d2f/d24/d2a/d88/f120 x:0 0 0 2024-02-15T22:40:58.374 INFO:tasks.workunit.client.0.smithi033.stdout:6/623: link d12/d3c/d95/d3f/d50/c83 d12/d3c/d95/cd9 0 2024-02-15T22:40:58.375 INFO:tasks.workunit.client.0.smithi033.stdout:1/804: creat d1/de/d27/d39/ddb/de1/d79/dc4/fe8 x:0 0 0 2024-02-15T22:40:58.382 INFO:tasks.workunit.client.0.smithi033.stdout:7/765: write d5/d6/f7 [567845,2696] 0 2024-02-15T22:40:58.382 INFO:tasks.workunit.client.0.smithi033.stdout:7/766: write d5/f9b [8690979,30332] 0 2024-02-15T22:40:58.384 INFO:tasks.workunit.client.0.smithi033.stdout:7/767: rename d5/dc/d5f/d8b/da0/cbf to d5/df/d40/d73/dd2/c104 0 2024-02-15T22:40:58.385 INFO:tasks.workunit.client.0.smithi033.stdout:7/768: symlink d5/dc/d5f/d8b/de1/l105 0 2024-02-15T22:40:58.386 INFO:tasks.workunit.client.0.smithi033.stdout:8/770: dread d1/de/d1a/d27/f7c [0,4194304] 0 2024-02-15T22:40:58.387 INFO:tasks.workunit.client.0.smithi033.stdout:8/771: getdents d1/de/d63/d105 0 2024-02-15T22:40:58.387 INFO:tasks.workunit.client.0.smithi033.stdout:8/772: fsync d1/de/d1a/d27/f7c 0 2024-02-15T22:40:58.387 INFO:tasks.workunit.client.0.smithi033.stdout:8/773: creat d1/d74/f112 x:0 0 0 2024-02-15T22:40:58.390 INFO:tasks.workunit.client.0.smithi033.stdout:7/769: dread d5/f31 [0,4194304] 0 2024-02-15T22:40:58.393 INFO:tasks.workunit.client.0.smithi033.stdout:7/770: rename d5/df/d40/d89/cda to d5/df/d56/d60/c106 0 2024-02-15T22:40:58.395 INFO:tasks.workunit.client.0.smithi033.stdout:9/727: dwrite d4/d1d/d23/d32/d3e/d86/d3f/f6e [0,4194304] 0 2024-02-15T22:40:58.396 INFO:tasks.workunit.client.0.smithi033.stdout:5/834: dwrite d6/d14/d31/d50/d6a/dab/fe3 [0,4194304] 0 2024-02-15T22:40:58.399 INFO:tasks.workunit.client.0.smithi033.stdout:3/807: dwrite d0/d3/d2c/f34 [4194304,4194304] 0 2024-02-15T22:40:58.399 INFO:tasks.workunit.client.0.smithi033.stdout:2/906: dread d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f6e [0,4194304] 0 2024-02-15T22:40:58.399 INFO:tasks.workunit.client.0.smithi033.stdout:3/808: dread - d0/d3/d65/d97/fe4 zero size 2024-02-15T22:40:58.400 INFO:tasks.workunit.client.0.smithi033.stdout:5/835: rmdir d6/d14/d31 39 2024-02-15T22:40:58.407 INFO:tasks.workunit.client.0.smithi033.stdout:5/836: unlink d6/d14/d31/d38/d9b/dd3/d7a/cd5 0 2024-02-15T22:40:58.407 INFO:tasks.workunit.client.0.smithi033.stdout:5/837: creat d6/db0/f108 x:0 0 0 2024-02-15T22:40:58.412 INFO:tasks.workunit.client.0.smithi033.stdout:9/728: write d4/ff [7399242,12466] 0 2024-02-15T22:40:58.415 INFO:tasks.workunit.client.0.smithi033.stdout:3/809: write d0/d3/d2c/d5d/d3d/d8f/f9c [487680,44436] 0 2024-02-15T22:40:58.417 INFO:tasks.workunit.client.0.smithi033.stdout:3/810: mknod d0/d3/dd/c104 0 2024-02-15T22:40:58.417 INFO:tasks.workunit.client.0.smithi033.stdout:3/811: read d0/d3/d2c/d5d/d3d/d8f/f9c [3523559,52817] 0 2024-02-15T22:40:58.417 INFO:tasks.workunit.client.0.smithi033.stdout:2/907: dread d1/d8/d2b/d2f/d13/d59/f7d [0,4194304] 0 2024-02-15T22:40:58.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/812: getdents d0/d3/d3b/d47 0 2024-02-15T22:40:58.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/813: truncate d0/d3/d2c/d5d/d3d/fcd 48972 0 2024-02-15T22:40:58.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/908: mkdir d1/d8/d2b/d2f/d13/da9/d8d/d121 0 2024-02-15T22:40:58.425 INFO:tasks.workunit.client.0.smithi033.stdout:5/838: read d6/d14/fbd [2279443,45762] 0 2024-02-15T22:40:58.429 INFO:tasks.workunit.client.0.smithi033.stdout:5/839: rmdir d6/d14/d31/d48/d56/dcc 0 2024-02-15T22:40:58.430 INFO:tasks.workunit.client.0.smithi033.stdout:6/624: dwrite d12/d3c/fa2 [4194304,4194304] 0 2024-02-15T22:40:58.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/774: dwrite d1/de/d1a/d27/ddf/f110 [0,4194304] 0 2024-02-15T22:40:58.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/775: truncate d1/d68/d1d/d4a/fc8 605554 0 2024-02-15T22:40:58.432 INFO:tasks.workunit.client.0.smithi033.stdout:7/771: dwrite d5/d6/d10/fbe [0,4194304] 0 2024-02-15T22:40:58.438 INFO:tasks.workunit.client.0.smithi033.stdout:3/814: dread d0/d3/d2c/d5d/d3d/d8f/faf [0,4194304] 0 2024-02-15T22:40:58.439 INFO:tasks.workunit.client.0.smithi033.stdout:9/729: dwrite d4/d1d/d23/f7c [4194304,4194304] 0 2024-02-15T22:40:58.439 INFO:tasks.workunit.client.0.smithi033.stdout:9/730: read - d4/dac/db0/fb9 zero size 2024-02-15T22:40:58.440 INFO:tasks.workunit.client.0.smithi033.stdout:2/909: dwrite d1/d8/d2b/d2f/d24/d31/de6/ff1 [0,4194304] 0 2024-02-15T22:40:58.441 INFO:tasks.workunit.client.0.smithi033.stdout:2/910: dread d1/d8/d2b/d2f/d13/f1c [0,4194304] 0 2024-02-15T22:40:58.441 INFO:tasks.workunit.client.0.smithi033.stdout:7/772: mkdir d5/d6/d107 0 2024-02-15T22:40:58.451 INFO:tasks.workunit.client.0.smithi033.stdout:6/625: dwrite d12/d3c/d95/d3f/d4b/dac/d5c/fba [0,4194304] 0 2024-02-15T22:40:58.462 INFO:tasks.workunit.client.0.smithi033.stdout:3/815: getdents d0/d3/d2c/d5d/d3d/d8f 0 2024-02-15T22:40:58.465 INFO:tasks.workunit.client.0.smithi033.stdout:9/731: creat d4/d1d/d23/d24/d51/d5d/dbc/fdd x:0 0 0 2024-02-15T22:40:58.465 INFO:tasks.workunit.client.0.smithi033.stdout:9/732: creat d4/d1d/d23/d24/d5a/fde x:0 0 0 2024-02-15T22:40:58.469 INFO:tasks.workunit.client.0.smithi033.stdout:6/626: creat d12/d2c/dc0/fda x:0 0 0 2024-02-15T22:40:58.469 INFO:tasks.workunit.client.0.smithi033.stdout:6/627: write d12/d3c/d95/d3f/d4b/fd2 [359760,17950] 0 2024-02-15T22:40:58.469 INFO:tasks.workunit.client.0.smithi033.stdout:6/628: fdatasync d12/d3c/d95/d3f/d4b/d6f/f9c 0 2024-02-15T22:40:58.469 INFO:tasks.workunit.client.0.smithi033.stdout:6/629: dread - d12/d3c/d95/d3f/db6/fc9 zero size 2024-02-15T22:40:58.469 INFO:tasks.workunit.client.0.smithi033.stdout:6/630: chown d12/d2c/d30/d1d/fa6 16 1 2024-02-15T22:40:58.469 INFO:tasks.workunit.client.0.smithi033.stdout:6/631: chown d12/d2c/d30/d1d/fa6 0 1 2024-02-15T22:40:58.470 INFO:tasks.workunit.client.0.smithi033.stdout:3/816: creat d0/d91/f105 x:0 0 0 2024-02-15T22:40:58.470 INFO:tasks.workunit.client.0.smithi033.stdout:7/773: dwrite d5/dc/d5f/d8b/da0/dc6/de4/de9/f103 [0,4194304] 0 2024-02-15T22:40:58.470 INFO:tasks.workunit.client.0.smithi033.stdout:2/911: dwrite d1/d8/d2b/d2f/d13/f1c [0,4194304] 0 2024-02-15T22:40:58.471 INFO:tasks.workunit.client.0.smithi033.stdout:9/733: symlink d4/d1d/d23/d32/d3e/d86/d3f/d94/d9c/ldf 0 2024-02-15T22:40:58.474 INFO:tasks.workunit.client.0.smithi033.stdout:7/774: mkdir d5/dc/d5f/d8b/da0/dc6/dcd/d108 0 2024-02-15T22:40:58.474 INFO:tasks.workunit.client.0.smithi033.stdout:7/775: read - d5/df/ff9 zero size 2024-02-15T22:40:58.475 INFO:tasks.workunit.client.0.smithi033.stdout:3/817: dread d0/d1c/f29 [0,4194304] 0 2024-02-15T22:40:58.475 INFO:tasks.workunit.client.0.smithi033.stdout:2/912: mkdir d1/d8/d2b/d2f/d13/da9/d8d/dec/d122 0 2024-02-15T22:40:58.475 INFO:tasks.workunit.client.0.smithi033.stdout:2/913: creat d1/d8/d2b/d2f/d13/d6f/db5/f123 x:0 0 0 2024-02-15T22:40:58.475 INFO:tasks.workunit.client.0.smithi033.stdout:6/632: dread d12/d3c/d95/d3f/d4b/f6e [0,4194304] 0 2024-02-15T22:40:58.475 INFO:tasks.workunit.client.0.smithi033.stdout:9/734: mknod d4/d1d/d23/d24/d5a/dbb/ce0 0 2024-02-15T22:40:58.476 INFO:tasks.workunit.client.0.smithi033.stdout:9/735: chown d4/d1d 5 1 2024-02-15T22:40:58.478 INFO:tasks.workunit.client.0.smithi033.stdout:7/776: link d5/f15 d5/dc/d5f/d8b/da0/dc6/de4/de9/f109 0 2024-02-15T22:40:58.478 INFO:tasks.workunit.client.0.smithi033.stdout:7/777: fsync d5/f9b 0 2024-02-15T22:40:58.478 INFO:tasks.workunit.client.0.smithi033.stdout:7/778: write d5/df/d56/d60/d59/f62 [4258967,90750] 0 2024-02-15T22:40:58.481 INFO:tasks.workunit.client.0.smithi033.stdout:3/818: rename d0/d3/d3b/d47/fa3 to d0/d3/d2c/d5d/d3d/d57/d68/dc2/f106 0 2024-02-15T22:40:58.481 INFO:tasks.workunit.client.0.smithi033.stdout:3/819: chown d0/d3/d2c/d5d/d3d/db4/le6 408 1 2024-02-15T22:40:58.484 INFO:tasks.workunit.client.0.smithi033.stdout:7/779: dread d5/d6/f54 [0,4194304] 0 2024-02-15T22:40:58.485 INFO:tasks.workunit.client.0.smithi033.stdout:2/914: rename d1/d8/f9b to d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/d99/f124 0 2024-02-15T22:40:58.486 INFO:tasks.workunit.client.0.smithi033.stdout:2/915: chown d1/d16/d3f/df5/dfb 383995945 1 2024-02-15T22:40:58.487 INFO:tasks.workunit.client.0.smithi033.stdout:3/820: mkdir d0/d3/dd/d107 0 2024-02-15T22:40:58.487 INFO:tasks.workunit.client.0.smithi033.stdout:3/821: fsync d0/d3/d2c/d5d/d3d/d8f/fb9 0 2024-02-15T22:40:58.487 INFO:tasks.workunit.client.0.smithi033.stdout:3/822: dread - d0/d3/d2c/d5d/d3d/db4/ff8 zero size 2024-02-15T22:40:58.487 INFO:tasks.workunit.client.0.smithi033.stdout:3/823: readlink d0/d3/d5f/da7/lfc 0 2024-02-15T22:40:58.488 INFO:tasks.workunit.client.0.smithi033.stdout:6/633: getdents d12/d3c/d95/d3f/d4b/d6f 0 2024-02-15T22:40:58.489 INFO:tasks.workunit.client.0.smithi033.stdout:7/780: creat d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/db1/f10a x:0 0 0 2024-02-15T22:40:58.490 INFO:tasks.workunit.client.0.smithi033.stdout:7/781: readlink d5/l12 0 2024-02-15T22:40:58.491 INFO:tasks.workunit.client.0.smithi033.stdout:9/736: rename d4/d1d/d23/c46 to d4/dac/db0/ce1 0 2024-02-15T22:40:58.492 INFO:tasks.workunit.client.0.smithi033.stdout:3/824: link d0/d3/dd/f7e d0/d3/d2c/d5d/d3d/d57/d74/f108 0 2024-02-15T22:40:58.494 INFO:tasks.workunit.client.0.smithi033.stdout:6/634: symlink d12/d3c/da1/ldb 0 2024-02-15T22:40:58.495 INFO:tasks.workunit.client.0.smithi033.stdout:9/737: symlink d4/d1d/d23/d32/da7/le2 0 2024-02-15T22:40:58.497 INFO:tasks.workunit.client.0.smithi033.stdout:3/825: mknod d0/d3/d2c/d5d/d3d/c109 0 2024-02-15T22:40:58.497 INFO:tasks.workunit.client.0.smithi033.stdout:3/826: readlink d0/d3/l7b 0 2024-02-15T22:40:58.498 INFO:tasks.workunit.client.0.smithi033.stdout:7/782: read d5/f15 [979623,56828] 0 2024-02-15T22:40:58.498 INFO:tasks.workunit.client.0.smithi033.stdout:7/783: dread - d5/dc/d5f/d8b/da0/dc6/de4/de5/fcb zero size 2024-02-15T22:40:58.498 INFO:tasks.workunit.client.0.smithi033.stdout:7/784: chown d5/dc/d5f/d8b/da0/dc6/de4/de9/de6/c5a 3 1 2024-02-15T22:40:58.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/738: rmdir d4/d1d/d23/d32/d3e/d86/d3f/dc7 39 2024-02-15T22:40:58.501 INFO:tasks.workunit.client.0.smithi033.stdout:9/739: unlink d4/d1d/d23/d35/f8b 0 2024-02-15T22:40:58.502 INFO:tasks.workunit.client.0.smithi033.stdout:6/635: write d12/f78 [2243226,78415] 0 2024-02-15T22:40:58.502 INFO:tasks.workunit.client.0.smithi033.stdout:9/740: chown d4/d1d/d23/d35/l66 0 1 2024-02-15T22:40:58.505 INFO:tasks.workunit.client.0.smithi033.stdout:9/741: read d4/d1d/d23/d35/f63 [3891418,88244] 0 2024-02-15T22:40:58.505 INFO:tasks.workunit.client.0.smithi033.stdout:9/742: write d4/d1d/f7a [7019128,99653] 0 2024-02-15T22:40:58.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/743: rename d4/d1d/d23/d32/d3e/f56 to d4/d1d/d23/fe3 0 2024-02-15T22:40:58.508 INFO:tasks.workunit.client.0.smithi033.stdout:2/916: dwrite d1/d8/d2b/d2f/d3d/faf [0,4194304] 0 2024-02-15T22:40:58.508 INFO:tasks.workunit.client.0.smithi033.stdout:2/917: fdatasync d1/d8/d2b/d2f/d12/dae/f103 0 2024-02-15T22:40:58.511 INFO:tasks.workunit.client.0.smithi033.stdout:7/785: write d5/dc/d5f/d8b/da0/dc6/de4/de9/f103 [3205311,12593] 0 2024-02-15T22:40:58.511 INFO:tasks.workunit.client.0.smithi033.stdout:7/786: creat d5/dc/d5f/d8b/f10b x:0 0 0 2024-02-15T22:40:58.511 INFO:tasks.workunit.client.0.smithi033.stdout:7/787: write d5/df/d56/d60/d59/f74 [386831,63602] 0 2024-02-15T22:40:58.512 INFO:tasks.workunit.client.0.smithi033.stdout:3/827: dread d0/d1c/f88 [0,4194304] 0 2024-02-15T22:40:58.512 INFO:tasks.workunit.client.0.smithi033.stdout:3/828: dread d0/d3/d2c/d5d/d3d/d57/fbc [0,4194304] 0 2024-02-15T22:40:58.513 INFO:tasks.workunit.client.0.smithi033.stdout:3/829: truncate d0/d3/dd/f99 5399268 0 2024-02-15T22:40:58.514 INFO:tasks.workunit.client.0.smithi033.stdout:2/918: dread d1/d8/d2b/d2f/d24/d31/f90 [0,4194304] 0 2024-02-15T22:40:58.514 INFO:tasks.workunit.client.0.smithi033.stdout:2/919: write d1/d16/d5a/f113 [942524,75255] 0 2024-02-15T22:40:58.515 INFO:tasks.workunit.client.0.smithi033.stdout:2/920: write d1/d8/d2b/d2f/d24/d69/f7c [416224,35668] 0 2024-02-15T22:40:58.516 INFO:tasks.workunit.client.0.smithi033.stdout:6/636: dwrite d12/d2c/d30/f7e [0,4194304] 0 2024-02-15T22:40:58.525 INFO:tasks.workunit.client.0.smithi033.stdout:7/788: creat d5/df/d56/f10c x:0 0 0 2024-02-15T22:40:58.526 INFO:tasks.workunit.client.0.smithi033.stdout:3/830: unlink d0/d3/dd/f6a 0 2024-02-15T22:40:58.527 INFO:tasks.workunit.client.0.smithi033.stdout:3/831: chown d0/d3/d3b/d47 1933 1 2024-02-15T22:40:58.527 INFO:tasks.workunit.client.0.smithi033.stdout:3/832: truncate d0/d91/f105 357076 0 2024-02-15T22:40:58.527 INFO:tasks.workunit.client.0.smithi033.stdout:2/921: truncate d1/d8/d2b/d2f/d13/d59/f7d 3925244 0 2024-02-15T22:40:58.528 INFO:tasks.workunit.client.0.smithi033.stdout:9/744: rmdir d4 39 2024-02-15T22:40:58.529 INFO:tasks.workunit.client.0.smithi033.stdout:9/745: write d4/f9 [5535945,50881] 0 2024-02-15T22:40:58.531 INFO:tasks.workunit.client.0.smithi033.stdout:6/637: mknod d12/d3c/cdc 0 2024-02-15T22:40:58.533 INFO:tasks.workunit.client.0.smithi033.stdout:3/833: link d0/lc d0/d3/d2c/d43/l10a 0 2024-02-15T22:40:58.533 INFO:tasks.workunit.client.0.smithi033.stdout:3/834: chown d0/d1c 18703408 1 2024-02-15T22:40:58.533 INFO:tasks.workunit.client.0.smithi033.stdout:7/789: dread d5/dc/d5f/d8b/da1/d26/f3c [0,4194304] 0 2024-02-15T22:40:58.534 INFO:tasks.workunit.client.0.smithi033.stdout:7/790: write d5/dc/d5f/d8b/ff7 [872277,97968] 0 2024-02-15T22:40:58.534 INFO:tasks.workunit.client.0.smithi033.stdout:7/791: read - d5/dc/d5f/d8b/da0/dc6/de4/ff8 zero size 2024-02-15T22:40:58.534 INFO:tasks.workunit.client.0.smithi033.stdout:7/792: truncate d5/df/d40/fdb 2508628 0 2024-02-15T22:40:58.536 INFO:tasks.workunit.client.0.smithi033.stdout:9/746: creat d4/d1d/fe4 x:0 0 0 2024-02-15T22:40:58.537 INFO:tasks.workunit.client.0.smithi033.stdout:6/638: symlink d12/d3c/d95/ldd 0 2024-02-15T22:40:58.537 INFO:tasks.workunit.client.0.smithi033.stdout:2/922: dread d1/d8/d2b/f10b [0,4194304] 0 2024-02-15T22:40:58.537 INFO:tasks.workunit.client.0.smithi033.stdout:2/923: stat d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f109 0 2024-02-15T22:40:58.538 INFO:tasks.workunit.client.0.smithi033.stdout:3/835: truncate d0/d3/d2c/d5d/d3d/d8f/faf 1782350 0 2024-02-15T22:40:58.538 INFO:tasks.workunit.client.0.smithi033.stdout:3/836: stat d0/d3/d2c/d5d/d3d 0 2024-02-15T22:40:58.540 INFO:tasks.workunit.client.0.smithi033.stdout:9/747: rename d4/d1d/d23/d32/d3e/d86/d3f/d94/caa to d4/dac/db0/dc8/ce5 0 2024-02-15T22:40:58.540 INFO:tasks.workunit.client.0.smithi033.stdout:9/748: dread - d4/d1d/d23/d32/f67 zero size 2024-02-15T22:40:58.541 INFO:tasks.workunit.client.0.smithi033.stdout:9/749: fsync d4/d1d/d23/d24/d5a/f93 0 2024-02-15T22:40:58.541 INFO:tasks.workunit.client.0.smithi033.stdout:9/750: write d4/d1d/d23/d32/d3e/d86/f53 [1557135,74410] 0 2024-02-15T22:40:58.541 INFO:tasks.workunit.client.0.smithi033.stdout:2/924: stat d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/c4c 0 2024-02-15T22:40:58.542 INFO:tasks.workunit.client.0.smithi033.stdout:3/837: rmdir d0/d3/d3b/db1 39 2024-02-15T22:40:58.542 INFO:tasks.workunit.client.0.smithi033.stdout:3/838: creat d0/d3/d2c/d5d/d3d/db4/f10b x:0 0 0 2024-02-15T22:40:58.542 INFO:tasks.workunit.client.0.smithi033.stdout:3/839: chown d0/d3/d2c/f46 0 1 2024-02-15T22:40:58.546 INFO:tasks.workunit.client.0.smithi033.stdout:9/751: link d4/d1d/d23/d24/d51/lb8 d4/d1d/d23/d32/d71/dab/le6 0 2024-02-15T22:40:58.547 INFO:tasks.workunit.client.0.smithi033.stdout:7/793: write d5/df/d56/d99/fd0 [2343042,129627] 0 2024-02-15T22:40:58.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/925: dread d1/d16/d5a/f113 [0,4194304] 0 2024-02-15T22:40:58.550 INFO:tasks.workunit.client.0.smithi033.stdout:2/926: chown d1/d8/d2b/d2f/d13/da9/d8d 868 1 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/639: dread d12/d3c/d95/d3f/d4b/dac/d5c/fba [0,4194304] 0 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/640: dread - d12/d3c/d95/d3f/f89 zero size 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/641: fdatasync d12/d3c/d95/d3f/d4b/fd2 0 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/642: readlink d12/d2c/dc0/lb3 0 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/643: write d12/d2c/dbc/f97 [1375221,72835] 0 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/644: write d12/d3c/d95/d3f/d4b/dac/f7c [653372,122458] 0 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/645: chown d12/d2c/d30 700222968 1 2024-02-15T22:40:58.552 INFO:tasks.workunit.client.0.smithi033.stdout:6/646: chown d12/d3c/d95/d3f/d50/f65 0 1 2024-02-15T22:40:58.561 INFO:tasks.workunit.client.0.smithi033.stdout:2/927: dread d1/d16/d3f/fd7 [4194304,4194304] 0 2024-02-15T22:40:58.561 INFO:tasks.workunit.client.0.smithi033.stdout:2/928: chown d1/d66/d75/cc9 185396 1 2024-02-15T22:40:58.566 INFO:tasks.workunit.client.0.smithi033.stdout:7/794: dwrite d5/d6/d10/f34 [0,4194304] 0 2024-02-15T22:40:58.566 INFO:tasks.workunit.client.0.smithi033.stdout:9/752: mknod d4/d1d/d23/d35/ce7 0 2024-02-15T22:40:58.566 INFO:tasks.workunit.client.0.smithi033.stdout:7/795: chown d5/df/d56/d60/d59/d9c/da6 19 1 2024-02-15T22:40:58.566 INFO:tasks.workunit.client.0.smithi033.stdout:6/647: rmdir d12/d2c/d30/d1d/d35 39 2024-02-15T22:40:58.567 INFO:tasks.workunit.client.0.smithi033.stdout:7/796: creat d5/df/d56/d60/d59/d9c/da6/f10d x:0 0 0 2024-02-15T22:40:58.568 INFO:tasks.workunit.client.0.smithi033.stdout:9/753: creat d4/d1d/d23/d24/d51/d5d/dbc/fe8 x:0 0 0 2024-02-15T22:40:58.571 INFO:tasks.workunit.client.0.smithi033.stdout:6/648: rename d12/f2b to d12/d2c/fde 0 2024-02-15T22:40:58.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/797: mknod d5/c10e 0 2024-02-15T22:40:58.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/798: write d5/d6/f54 [5041217,24781] 0 2024-02-15T22:40:58.573 INFO:tasks.workunit.client.0.smithi033.stdout:7/799: dread - d5/df/d56/f10c zero size 2024-02-15T22:40:58.574 INFO:tasks.workunit.client.0.smithi033.stdout:9/754: rmdir d4/d1d/d23/d32/d3e/d86/d3f 39 2024-02-15T22:40:58.576 INFO:tasks.workunit.client.0.smithi033.stdout:7/800: write d5/df/d40/d89/f9a [164246,125282] 0 2024-02-15T22:40:58.576 INFO:tasks.workunit.client.0.smithi033.stdout:7/801: dread - d5/df/d56/d84/fca zero size 2024-02-15T22:40:58.576 INFO:tasks.workunit.client.0.smithi033.stdout:2/929: dwrite d1/d16/f1a [0,4194304] 0 2024-02-15T22:40:58.577 INFO:tasks.workunit.client.0.smithi033.stdout:9/755: unlink d4/d1d/d23/d24/fa3 0 2024-02-15T22:40:58.578 INFO:tasks.workunit.client.0.smithi033.stdout:2/930: link d1/d16/d5a/f97 d1/d8/d2b/d2f/d12/d52/f125 0 2024-02-15T22:40:58.580 INFO:tasks.workunit.client.0.smithi033.stdout:9/756: unlink d4/d1d/d23/c8c 0 2024-02-15T22:40:58.581 INFO:tasks.workunit.client.0.smithi033.stdout:9/757: rmdir d4/d1d/d23/d24/d51 39 2024-02-15T22:40:58.583 INFO:tasks.workunit.client.0.smithi033.stdout:9/758: creat d4/d1d/d23/d32/da7/ddb/fe9 x:0 0 0 2024-02-15T22:40:58.583 INFO:tasks.workunit.client.0.smithi033.stdout:7/802: dread d5/d6/d10/fa5 [4194304,4194304] 0 2024-02-15T22:40:58.585 INFO:tasks.workunit.client.0.smithi033.stdout:9/759: creat d4/d1d/d23/d32/d3e/fea x:0 0 0 2024-02-15T22:40:58.586 INFO:tasks.workunit.client.0.smithi033.stdout:7/803: link d5/dc/fc2 d5/df/d56/f10f 0 2024-02-15T22:40:58.587 INFO:tasks.workunit.client.0.smithi033.stdout:9/760: creat d4/d1d/dd2/feb x:0 0 0 2024-02-15T22:40:58.588 INFO:tasks.workunit.client.0.smithi033.stdout:9/761: creat d4/d1d/d23/d35/fec x:0 0 0 2024-02-15T22:40:58.590 INFO:tasks.workunit.client.0.smithi033.stdout:9/762: dread d4/d1d/f70 [0,4194304] 0 2024-02-15T22:40:58.590 INFO:tasks.workunit.client.0.smithi033.stdout:9/763: stat d4/d1d/d23/d24/d5e/f69 0 2024-02-15T22:40:58.590 INFO:tasks.workunit.client.0.smithi033.stdout:9/764: write d4/d1d/d23/d24/d5a/fde [22967,57849] 0 2024-02-15T22:40:58.591 INFO:tasks.workunit.client.0.smithi033.stdout:6/649: dwrite d12/d2c/dc0/fda [0,4194304] 0 2024-02-15T22:40:58.591 INFO:tasks.workunit.client.0.smithi033.stdout:6/650: read - d12/d2c/fa4 zero size 2024-02-15T22:40:58.592 INFO:tasks.workunit.client.0.smithi033.stdout:9/765: rename d4/d1d/d23/d32/d3e/d86 to d4/d1d/dd2/ded 0 2024-02-15T22:40:58.592 INFO:tasks.workunit.client.0.smithi033.stdout:9/766: creat d4/d1d/fee x:0 0 0 2024-02-15T22:40:58.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/767: rename d4/dac/lcc to d4/d1d/d23/d32/da7/ddb/lef 0 2024-02-15T22:40:58.597 INFO:tasks.workunit.client.0.smithi033.stdout:9/768: dread - d4/d1d/d23/d35/fec zero size 2024-02-15T22:40:58.599 INFO:tasks.workunit.client.0.smithi033.stdout:9/769: rename d4/d1d/d23/d35/f63 to d4/d1d/d23/d24/d51/d5d/dbc/ff0 0 2024-02-15T22:40:58.601 INFO:tasks.workunit.client.0.smithi033.stdout:9/770: mkdir d4/d1d/d23/d24/d5a/df1 0 2024-02-15T22:40:58.601 INFO:tasks.workunit.client.0.smithi033.stdout:9/771: fsync d4/d1d/d23/d32/d71/dab/fb2 0 2024-02-15T22:40:58.602 INFO:tasks.workunit.client.0.smithi033.stdout:9/772: truncate d4/d1d/d23/f47 2003341 0 2024-02-15T22:40:58.605 INFO:tasks.workunit.client.0.smithi033.stdout:9/773: rename d4/d1d/dd2/ded/f53 to d4/d1d/daf/ff2 0 2024-02-15T22:40:58.605 INFO:tasks.workunit.client.0.smithi033.stdout:9/774: fsync d4/d1d/d23/d24/d51/d8a/f96 0 2024-02-15T22:40:58.606 INFO:tasks.workunit.client.0.smithi033.stdout:9/775: creat d4/d1d/d23/d24/d5a/ff3 x:0 0 0 2024-02-15T22:40:58.607 INFO:tasks.workunit.client.0.smithi033.stdout:9/776: symlink d4/d1d/d23/d32/d71/lf4 0 2024-02-15T22:40:58.610 INFO:tasks.workunit.client.0.smithi033.stdout:7/804: dwrite d5/df/d56/d84/ff3 [0,4194304] 0 2024-02-15T22:40:58.610 INFO:tasks.workunit.client.0.smithi033.stdout:9/777: creat d4/d1d/dd2/ded/ff5 x:0 0 0 2024-02-15T22:40:58.610 INFO:tasks.workunit.client.0.smithi033.stdout:9/778: chown d4/d1d/dd2/ded/d3f/l9f 285075534 1 2024-02-15T22:40:58.613 INFO:tasks.workunit.client.0.smithi033.stdout:7/805: symlink d5/dc/d5f/d8b/de1/dfb/l110 0 2024-02-15T22:40:58.613 INFO:tasks.workunit.client.0.smithi033.stdout:6/651: dwrite d12/d3c/fcf [0,4194304] 0 2024-02-15T22:40:58.613 INFO:tasks.workunit.client.0.smithi033.stdout:6/652: fdatasync d12/d2c/fbf 0 2024-02-15T22:40:58.613 INFO:tasks.workunit.client.0.smithi033.stdout:6/653: chown d12/d2c/d30/d1d/c53 3 1 2024-02-15T22:40:58.613 INFO:tasks.workunit.client.0.smithi033.stdout:6/654: chown d12/d3c/d95/d3f/d4b/fd2 2 1 2024-02-15T22:40:58.614 INFO:tasks.workunit.client.0.smithi033.stdout:9/779: creat d4/d1d/dd2/ded/d3f/d94/d9c/ff6 x:0 0 0 2024-02-15T22:40:58.615 INFO:tasks.workunit.client.0.smithi033.stdout:7/806: link d5/dc/d5f/d8b/da0/dc6/de4/de9/de6/cd4 d5/df/d40/d89/c111 0 2024-02-15T22:40:58.617 INFO:tasks.workunit.client.0.smithi033.stdout:6/655: creat d12/fdf x:0 0 0 2024-02-15T22:40:58.618 INFO:tasks.workunit.client.0.smithi033.stdout:7/807: getdents d5/dc/d5f/d8b/da0/dc6/de4/de5 0 2024-02-15T22:40:58.618 INFO:tasks.workunit.client.0.smithi033.stdout:7/808: readlink d5/df/d40/d73/le7 0 2024-02-15T22:40:58.621 INFO:tasks.workunit.client.0.smithi033.stdout:6/656: read f5 [37176,96738] 0 2024-02-15T22:40:58.622 INFO:tasks.workunit.client.0.smithi033.stdout:7/809: mknod d5/dc/d5f/d8b/da1/d26/d3f/c112 0 2024-02-15T22:40:58.623 INFO:tasks.workunit.client.0.smithi033.stdout:7/810: mkdir d5/dc/d5f/d8b/de1/dfb/d113 0 2024-02-15T22:40:58.641 INFO:tasks.workunit.client.0.smithi033.stdout:9/780: dwrite d4/d1d/dd2/ded/d3f/d94/fae [0,4194304] 0 2024-02-15T22:40:58.641 INFO:tasks.workunit.client.0.smithi033.stdout:9/781: chown d4/d1d/d23/d24/d51/d5d/d90/fa1 34989583 1 2024-02-15T22:40:58.641 INFO:tasks.workunit.client.0.smithi033.stdout:7/811: dwrite d5/df/d56/f6c [0,4194304] 0 2024-02-15T22:40:58.643 INFO:tasks.workunit.client.0.smithi033.stdout:9/782: rmdir d4/d1d/daf 39 2024-02-15T22:40:58.644 INFO:tasks.workunit.client.0.smithi033.stdout:7/812: mkdir d5/dc/d5f/d8b/da0/d114 0 2024-02-15T22:40:58.646 INFO:tasks.workunit.client.0.smithi033.stdout:9/783: symlink d4/d1d/d23/d24/d51/d8a/lf7 0 2024-02-15T22:40:58.652 INFO:tasks.workunit.client.0.smithi033.stdout:9/784: mkdir d4/d1d/dd2/ded/d3f/d94/d9c/df8 0 2024-02-15T22:40:58.655 INFO:tasks.workunit.client.0.smithi033.stdout:9/785: getdents d4/d1d/d23/d35 0 2024-02-15T22:40:58.655 INFO:tasks.workunit.client.0.smithi033.stdout:9/786: creat d4/d1d/d23/d24/d51/d5d/dbc/ff9 x:0 0 0 2024-02-15T22:40:58.665 INFO:tasks.workunit.client.0.smithi033.stdout:7/813: dwrite d5/f18 [0,4194304] 0 2024-02-15T22:40:58.667 INFO:tasks.workunit.client.0.smithi033.stdout:7/814: unlink d5/dc/c8c 0 2024-02-15T22:40:58.672 INFO:tasks.workunit.client.0.smithi033.stdout:9/787: dwrite d4/d1d/d23/d24/d51/d5d/dbc/ff9 [0,4194304] 0 2024-02-15T22:40:58.672 INFO:tasks.workunit.client.0.smithi033.stdout:9/788: dread - d4/d1d/d23/d24/fa6 zero size 2024-02-15T22:40:58.685 INFO:tasks.workunit.client.0.smithi033.stdout:7/815: dwrite d5/dc/d5f/d8b/da0/dc6/de4/de5/f93 [0,4194304] 0 2024-02-15T22:40:58.685 INFO:tasks.workunit.client.0.smithi033.stdout:7/816: dread - d5/dc/d5f/d8b/f10b zero size 2024-02-15T22:40:58.686 INFO:tasks.workunit.client.0.smithi033.stdout:7/817: symlink d5/dc/d5f/d8b/l115 0 2024-02-15T22:40:58.687 INFO:tasks.workunit.client.0.smithi033.stdout:7/818: mkdir d5/dc/d5f/d8b/da1/d26/d116 0 2024-02-15T22:40:58.688 INFO:tasks.workunit.client.0.smithi033.stdout:7/819: creat d5/df/d40/d89/f117 x:0 0 0 2024-02-15T22:40:58.689 INFO:tasks.workunit.client.0.smithi033.stdout:7/820: truncate d5/df/d56/d60/d59/f8d 1811671 0 2024-02-15T22:40:58.689 INFO:tasks.workunit.client.0.smithi033.stdout:7/821: truncate d5/dc/d5f/d8b/da1/f53 354812 0 2024-02-15T22:40:58.691 INFO:tasks.workunit.client.0.smithi033.stdout:9/789: dwrite d4/f60 [0,4194304] 0 2024-02-15T22:40:58.691 INFO:tasks.workunit.client.0.smithi033.stdout:9/790: write d4/d1d/d23/d32/d71/dab/fc6 [302939,1960] 0 2024-02-15T22:40:58.691 INFO:tasks.workunit.client.0.smithi033.stdout:7/822: unlink d5/d6/f68 0 2024-02-15T22:40:58.691 INFO:tasks.workunit.client.0.smithi033.stdout:7/823: fdatasync d5/df/d56/d60/d59/d9c/f6a 0 2024-02-15T22:40:58.691 INFO:tasks.workunit.client.0.smithi033.stdout:7/824: readlink d5/l8e 0 2024-02-15T22:40:58.709 INFO:tasks.workunit.client.0.smithi033.stdout:9/791: dwrite d4/f29 [0,4194304] 0 2024-02-15T22:40:58.711 INFO:tasks.workunit.client.0.smithi033.stdout:9/792: mknod d4/d1d/dd2/cfa 0 2024-02-15T22:40:58.712 INFO:tasks.workunit.client.0.smithi033.stdout:9/793: symlink d4/d1d/d23/d7b/lfb 0 2024-02-15T22:40:58.720 INFO:tasks.workunit.client.0.smithi033.stdout:9/794: write d4/d1d/dd2/ded/d3f/d94/fae [2207446,109524] 0 2024-02-15T22:40:58.721 INFO:tasks.workunit.client.0.smithi033.stdout:9/795: chown d4/d1d/d23/d24/d51/d5d/dbc/ff0 34 1 2024-02-15T22:40:58.721 INFO:tasks.workunit.client.0.smithi033.stdout:9/796: write d4/d1d/d23/d24/fa6 [549179,10454] 0 2024-02-15T22:40:58.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/797: creat d4/d1d/d23/ffc x:0 0 0 2024-02-15T22:40:58.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/798: read - d4/d1d/dd2/ded/d3f/d94/d9c/ff6 zero size 2024-02-15T22:40:58.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/799: chown d4/d1d/d23/d35/fec 28469506 1 2024-02-15T22:40:58.723 INFO:tasks.workunit.client.0.smithi033.stdout:9/800: creat d4/d1d/d23/d24/ffd x:0 0 0 2024-02-15T22:40:58.723 INFO:tasks.workunit.client.0.smithi033.stdout:9/801: creat d4/d1d/dd2/ffe x:0 0 0 2024-02-15T22:40:58.723 INFO:tasks.workunit.client.0.smithi033.stdout:9/802: chown d4/d1d/d23/ffc 4300 1 2024-02-15T22:40:58.726 INFO:tasks.workunit.client.0.smithi033.stdout:9/803: mknod d4/cff 0 2024-02-15T22:40:58.726 INFO:tasks.workunit.client.0.smithi033.stdout:9/804: chown d4/d1d/d23/d32/da7 14 1 2024-02-15T22:40:58.726 INFO:tasks.workunit.client.0.smithi033.stdout:9/805: mknod d4/d1d/d23/d24/d5a/c100 0 2024-02-15T22:40:58.743 INFO:tasks.workunit.client.0.smithi033.stdout:4/813: sync 2024-02-15T22:40:58.744 INFO:tasks.workunit.client.0.smithi033.stdout:4/814: mknod d8/d16/d45/d8f/c10a 0 2024-02-15T22:40:58.757 INFO:tasks.workunit.client.0.smithi033.stdout:4/815: dwrite d8/d16/d45/fea [0,4194304] 0 2024-02-15T22:40:58.758 INFO:tasks.workunit.client.0.smithi033.stdout:4/816: dread d8/d16/d45/d8f/d93/fd4 [0,4194304] 0 2024-02-15T22:40:58.759 INFO:tasks.workunit.client.0.smithi033.stdout:4/817: creat d8/d1a/f10b x:0 0 0 2024-02-15T22:40:58.760 INFO:tasks.workunit.client.0.smithi033.stdout:4/818: stat d8/d16/d51/d1c/d94/l100 0 2024-02-15T22:40:58.760 INFO:tasks.workunit.client.0.smithi033.stdout:4/819: mknod d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/c10c 0 2024-02-15T22:40:58.761 INFO:tasks.workunit.client.0.smithi033.stdout:4/820: write d8/d16/d51/d1c/f7e [1228563,37013] 0 2024-02-15T22:40:58.761 INFO:tasks.workunit.client.0.smithi033.stdout:4/821: fsync d8/d16/d51/d1c/d94/fcc 0 2024-02-15T22:40:58.761 INFO:tasks.workunit.client.0.smithi033.stdout:4/822: fdatasync d8/d16/d51/d1c/f6c 0 2024-02-15T22:40:58.761 INFO:tasks.workunit.client.0.smithi033.stdout:4/823: fsync d8/d16/d51/d1c/db9/d37/d31/d47/fe6 0 2024-02-15T22:40:58.772 INFO:tasks.workunit.client.0.smithi033.stdout:4/824: dwrite d8/d16/d51/d1c/db9/d37/d31/da5/da9/fec [0,4194304] 0 2024-02-15T22:40:58.772 INFO:tasks.workunit.client.0.smithi033.stdout:4/825: chown d8/fa6 85000052 1 2024-02-15T22:40:58.774 INFO:tasks.workunit.client.0.smithi033.stdout:4/826: symlink d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/l10d 0 2024-02-15T22:40:58.774 INFO:tasks.workunit.client.0.smithi033.stdout:4/827: fdatasync d8/dc5/fd1 0 2024-02-15T22:40:58.774 INFO:tasks.workunit.client.0.smithi033.stdout:4/828: rename d8/d16/d51/d1c/d3c/d49/dac to d8/d16/d51/d1c/d3c/d49/dac/d10e 22 2024-02-15T22:40:58.775 INFO:tasks.workunit.client.0.smithi033.stdout:4/829: truncate d8/d16/d51/f86 728980 0 2024-02-15T22:40:58.776 INFO:tasks.workunit.client.0.smithi033.stdout:4/830: creat d8/dd9/f10f x:0 0 0 2024-02-15T22:40:58.821 INFO:tasks.workunit.client.0.smithi033.stdout:1/805: sync 2024-02-15T22:40:58.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/682: sync 2024-02-15T22:40:58.821 INFO:tasks.workunit.client.0.smithi033.stdout:1/806: chown d1/de/d27/d39/ddb/de1/d2d/f76 6 1 2024-02-15T22:40:58.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/683: mkdir db/d19/d32/d43/d9f/de3 0 2024-02-15T22:40:58.830 INFO:tasks.workunit.client.0.smithi033.stdout:1/807: write d1/de/d27/d39/ddb/de1/d2d/f76 [11504496,112986] 0 2024-02-15T22:40:58.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/808: mknod d1/de/d27/d39/ddb/ce9 0 2024-02-15T22:40:58.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/809: chown d1/d20/c22 94401751 1 2024-02-15T22:40:58.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/810: getdents d1/d20/d42/d2c/db0 0 2024-02-15T22:40:58.833 INFO:tasks.workunit.client.0.smithi033.stdout:1/811: read d1/de/d27/d39/d3a/da3/f70 [1604141,47567] 0 2024-02-15T22:40:58.833 INFO:tasks.workunit.client.0.smithi033.stdout:0/684: read db/d19/d32/d43/d5a/d76/faa [3694228,95986] 0 2024-02-15T22:40:58.833 INFO:tasks.workunit.client.0.smithi033.stdout:0/685: fdatasync db/d2a/d6e/d7a/fe1 0 2024-02-15T22:40:58.834 INFO:tasks.workunit.client.0.smithi033.stdout:1/812: creat d1/d20/d42/d2c/d4e/de5/fea x:0 0 0 2024-02-15T22:40:58.837 INFO:tasks.workunit.client.0.smithi033.stdout:0/686: rename db/d19/d32/d43/d5a/d76/fb8 to db/d2a/d6e/d7a/fe4 0 2024-02-15T22:40:58.838 INFO:tasks.workunit.client.0.smithi033.stdout:1/813: creat d1/de/d27/d39/d3a/feb x:0 0 0 2024-02-15T22:40:58.839 INFO:tasks.workunit.client.0.smithi033.stdout:0/687: creat db/d2a/fe5 x:0 0 0 2024-02-15T22:40:58.839 INFO:tasks.workunit.client.0.smithi033.stdout:0/688: write db/f87 [4949331,13365] 0 2024-02-15T22:40:58.840 INFO:tasks.workunit.client.0.smithi033.stdout:1/814: mknod d1/d20/d8a/cec 0 2024-02-15T22:40:58.840 INFO:tasks.workunit.client.0.smithi033.stdout:1/815: truncate d1/d20/fd4 1011530 0 2024-02-15T22:40:58.840 INFO:tasks.workunit.client.0.smithi033.stdout:0/689: mkdir db/d2a/dc7/de6 0 2024-02-15T22:40:58.842 INFO:tasks.workunit.client.0.smithi033.stdout:1/816: rmdir d1/d20/d42/d25/dcb 0 2024-02-15T22:40:58.842 INFO:tasks.workunit.client.0.smithi033.stdout:1/817: chown d1/d20/d42/d2c/d30/cb4 16763208 1 2024-02-15T22:40:58.842 INFO:tasks.workunit.client.0.smithi033.stdout:1/818: truncate d1/d20/fd1 562373 0 2024-02-15T22:40:58.843 INFO:tasks.workunit.client.0.smithi033.stdout:1/819: mknod d1/de/d27/d39/ddb/de1/d2d/d36/d8b/ced 0 2024-02-15T22:40:58.845 INFO:tasks.workunit.client.0.smithi033.stdout:1/820: symlink d1/de/d27/d39/d3a/lee 0 2024-02-15T22:40:58.845 INFO:tasks.workunit.client.0.smithi033.stdout:1/821: creat d1/d20/d8a/d8f/fef x:0 0 0 2024-02-15T22:40:58.845 INFO:tasks.workunit.client.0.smithi033.stdout:1/822: fsync d1/f17 0 2024-02-15T22:40:58.845 INFO:tasks.workunit.client.0.smithi033.stdout:1/823: write d1/d20/d42/d2c/fd2 [206995,39962] 0 2024-02-15T22:40:58.851 INFO:tasks.workunit.client.0.smithi033.stdout:0/690: write db/d19/d32/f23 [4335684,18229] 0 2024-02-15T22:40:58.868 INFO:tasks.workunit.client.0.smithi033.stdout:0/691: dwrite db/d2a/d6c/fca [0,4194304] 0 2024-02-15T22:40:58.869 INFO:tasks.workunit.client.0.smithi033.stdout:1/824: dwrite d1/de/d27/d39/d3a/da3/f70 [0,4194304] 0 2024-02-15T22:40:58.869 INFO:tasks.workunit.client.0.smithi033.stdout:1/825: dread d1/d20/fd4 [0,4194304] 0 2024-02-15T22:40:58.870 INFO:tasks.workunit.client.0.smithi033.stdout:0/692: mkdir db/d2a/dc7/de6/de7 0 2024-02-15T22:40:58.873 INFO:tasks.workunit.client.0.smithi033.stdout:1/826: mknod d1/de/d27/d39/ddb/de1/d2d/d5e/d69/cf0 0 2024-02-15T22:40:58.873 INFO:tasks.workunit.client.0.smithi033.stdout:1/827: fsync d1/de/d27/d39/d3a/dae/fbb 0 2024-02-15T22:40:58.874 INFO:tasks.workunit.client.0.smithi033.stdout:0/693: truncate db/d19/f3f 3563466 0 2024-02-15T22:40:58.874 INFO:tasks.workunit.client.0.smithi033.stdout:0/694: dread - db/d2a/d6e/fb2 zero size 2024-02-15T22:40:58.875 INFO:tasks.workunit.client.0.smithi033.stdout:0/695: mkdir db/d60/de8 0 2024-02-15T22:40:58.876 INFO:tasks.workunit.client.0.smithi033.stdout:0/696: read db/d19/d32/d43/d5a/d76/faa [2348590,40008] 0 2024-02-15T22:40:58.876 INFO:tasks.workunit.client.0.smithi033.stdout:0/697: fdatasync db/d2a/d6e/f8f 0 2024-02-15T22:40:58.876 INFO:tasks.workunit.client.0.smithi033.stdout:0/698: fsync db/d19/d32/d46/f54 0 2024-02-15T22:40:58.876 INFO:tasks.workunit.client.0.smithi033.stdout:0/699: creat db/d2a/d68/da9/fe9 x:0 0 0 2024-02-15T22:40:58.876 INFO:tasks.workunit.client.0.smithi033.stdout:0/700: dread - db/d2a/d68/d8b/f96 zero size 2024-02-15T22:40:58.878 INFO:tasks.workunit.client.0.smithi033.stdout:0/701: rename db/d19/d32/d3d/l52 to db/d2a/d68/d8b/lea 0 2024-02-15T22:40:58.885 INFO:tasks.workunit.client.0.smithi033.stdout:0/702: write db/d19/d32/d46/f83 [1908177,122149] 0 2024-02-15T22:40:58.885 INFO:tasks.workunit.client.0.smithi033.stdout:0/703: write db/d19/d32/d3d/f59 [4139881,12298] 0 2024-02-15T22:40:58.889 INFO:tasks.workunit.client.0.smithi033.stdout:0/704: creat db/d19/d32/d46/daf/feb x:0 0 0 2024-02-15T22:40:58.892 INFO:tasks.workunit.client.0.smithi033.stdout:0/705: mkdir db/d60/dec 0 2024-02-15T22:40:58.895 INFO:tasks.workunit.client.0.smithi033.stdout:0/706: truncate db/d2a/d6e/f7c 423322 0 2024-02-15T22:40:58.895 INFO:tasks.workunit.client.0.smithi033.stdout:0/707: stat db/d2a/la5 0 2024-02-15T22:40:58.895 INFO:tasks.workunit.client.0.smithi033.stdout:0/708: chown db/d19/d32/l20 1 1 2024-02-15T22:40:58.896 INFO:tasks.workunit.client.0.smithi033.stdout:0/709: creat db/d2a/d6e/d7a/d95/fed x:0 0 0 2024-02-15T22:40:58.896 INFO:tasks.workunit.client.0.smithi033.stdout:1/828: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:58.897 INFO:tasks.workunit.client.0.smithi033.stdout:1/829: getdents d1/de/d27/d39/ddb/de1 0 2024-02-15T22:40:58.897 INFO:tasks.workunit.client.0.smithi033.stdout:1/830: write d1/de/f63 [5029964,26352] 0 2024-02-15T22:40:58.898 INFO:tasks.workunit.client.0.smithi033.stdout:1/831: creat d1/d20/d8a/ff1 x:0 0 0 2024-02-15T22:40:58.906 INFO:tasks.workunit.client.0.smithi033.stdout:0/710: dread db/d19/d32/d46/f4f [0,4194304] 0 2024-02-15T22:40:58.909 INFO:tasks.workunit.client.0.smithi033.stdout:0/711: dread db/d19/d32/d46/f4f [0,4194304] 0 2024-02-15T22:40:58.910 INFO:tasks.workunit.client.0.smithi033.stdout:0/712: creat db/d19/dd8/fee x:0 0 0 2024-02-15T22:40:58.914 INFO:tasks.workunit.client.0.smithi033.stdout:1/832: dwrite d1/d20/f9b [0,4194304] 0 2024-02-15T22:40:58.914 INFO:tasks.workunit.client.0.smithi033.stdout:1/833: fsync d1/de/d27/d39/ddb/de1/d2d/f7a 0 2024-02-15T22:40:58.916 INFO:tasks.workunit.client.0.smithi033.stdout:1/834: mknod d1/cf2 0 2024-02-15T22:40:58.917 INFO:tasks.workunit.client.0.smithi033.stdout:1/835: mknod d1/d57/cf3 0 2024-02-15T22:40:58.918 INFO:tasks.workunit.client.0.smithi033.stdout:1/836: rmdir d1/d20/d42/d2c/dd9 0 2024-02-15T22:40:58.918 INFO:tasks.workunit.client.0.smithi033.stdout:1/837: fdatasync d1/d20/d42/d2c/d30/f40 0 2024-02-15T22:40:58.919 INFO:tasks.workunit.client.0.smithi033.stdout:1/838: creat d1/d20/d42/d2c/d4e/ff4 x:0 0 0 2024-02-15T22:40:58.927 INFO:tasks.workunit.client.0.smithi033.stdout:1/839: write d1/de/d27/d39/ddb/de1/d2d/f3d [453657,109783] 0 2024-02-15T22:40:58.931 INFO:tasks.workunit.client.0.smithi033.stdout:0/713: dwrite db/d2a/d6e/d7a/fbc [0,4194304] 0 2024-02-15T22:40:58.935 INFO:tasks.workunit.client.0.smithi033.stdout:0/714: creat db/d60/dec/fef x:0 0 0 2024-02-15T22:40:58.935 INFO:tasks.workunit.client.0.smithi033.stdout:0/715: rmdir db/d19 39 2024-02-15T22:40:58.936 INFO:tasks.workunit.client.0.smithi033.stdout:0/716: link db/d19/d32/d43/d5a/d76/da1/fb4 db/d19/d32/d43/d7d/ff0 0 2024-02-15T22:40:58.945 INFO:tasks.workunit.client.0.smithi033.stdout:1/840: dwrite d1/d20/d42/d25/f6f [0,4194304] 0 2024-02-15T22:40:58.946 INFO:tasks.workunit.client.0.smithi033.stdout:5/840: sync 2024-02-15T22:40:58.946 INFO:tasks.workunit.client.0.smithi033.stdout:5/841: truncate d6/d14/d31/d38/f72 1023787 0 2024-02-15T22:40:58.947 INFO:tasks.workunit.client.0.smithi033.stdout:5/842: mkdir d6/d14/d31/d50/d6a/dab/d109 0 2024-02-15T22:40:58.949 INFO:tasks.workunit.client.0.smithi033.stdout:1/841: rename d1/d20/d8a to d1/de/d27/d39/df5 0 2024-02-15T22:40:58.952 INFO:tasks.workunit.client.0.smithi033.stdout:1/842: rename d1/d20/d42/d25/d67/fb6 to d1/d20/d42/d2c/d30/ff6 0 2024-02-15T22:40:58.952 INFO:tasks.workunit.client.0.smithi033.stdout:1/843: fsync d1/d20/f9b 0 2024-02-15T22:40:58.953 INFO:tasks.workunit.client.0.smithi033.stdout:1/844: rmdir d1/d20/d42/d2c/d7b 39 2024-02-15T22:40:58.955 INFO:tasks.workunit.client.0.smithi033.stdout:1/845: rename d1/de/d27/d39/ddb/de1/d79/d9f/fc3 to d1/d20/d42/d25/d67/ff7 0 2024-02-15T22:40:58.955 INFO:tasks.workunit.client.0.smithi033.stdout:1/846: dread - d1/de/d27/d39/d3a/dae/fbb zero size 2024-02-15T22:40:58.962 INFO:tasks.workunit.client.0.smithi033.stdout:0/717: dwrite db/d19/f2d [0,4194304] 0 2024-02-15T22:40:58.973 INFO:tasks.workunit.client.0.smithi033.stdout:5/843: dwrite d6/d25/f29 [0,4194304] 0 2024-02-15T22:40:58.974 INFO:tasks.workunit.client.0.smithi033.stdout:5/844: creat d6/d14/d31/d38/f10a x:0 0 0 2024-02-15T22:40:58.983 INFO:tasks.workunit.client.0.smithi033.stdout:1/847: dwrite d1/d20/f65 [0,4194304] 0 2024-02-15T22:40:58.983 INFO:tasks.workunit.client.0.smithi033.stdout:0/718: dwrite db/d19/d32/d43/fc9 [0,4194304] 0 2024-02-15T22:40:58.983 INFO:tasks.workunit.client.0.smithi033.stdout:0/719: creat db/d19/d32/d3d/ff1 x:0 0 0 2024-02-15T22:40:58.983 INFO:tasks.workunit.client.0.smithi033.stdout:0/720: creat db/d19/dd8/ff2 x:0 0 0 2024-02-15T22:40:58.988 INFO:tasks.workunit.client.0.smithi033.stdout:1/848: creat d1/d20/dc8/ff8 x:0 0 0 2024-02-15T22:40:58.991 INFO:tasks.workunit.client.0.smithi033.stdout:5/845: dwrite d6/d14/d31/d48/d49/d53/d57/da1/fda [0,4194304] 0 2024-02-15T22:40:58.991 INFO:tasks.workunit.client.0.smithi033.stdout:1/849: dread d1/de/d27/d39/df5/d8f/fa2 [0,4194304] 0 2024-02-15T22:40:58.991 INFO:tasks.workunit.client.0.smithi033.stdout:1/850: write d1/f64 [655909,37728] 0 2024-02-15T22:40:58.991 INFO:tasks.workunit.client.0.smithi033.stdout:1/851: chown d1/f1c 275987177 1 2024-02-15T22:40:58.991 INFO:tasks.workunit.client.0.smithi033.stdout:1/852: dread - d1/d20/d42/d2c/d4e/ff4 zero size 2024-02-15T22:40:58.994 INFO:tasks.workunit.client.0.smithi033.stdout:9/806: sync 2024-02-15T22:40:58.994 INFO:tasks.workunit.client.0.smithi033.stdout:3/840: sync 2024-02-15T22:40:58.994 INFO:tasks.workunit.client.0.smithi033.stdout:8/776: sync 2024-02-15T22:40:58.994 INFO:tasks.workunit.client.0.smithi033.stdout:8/777: dread - d1/fa8 zero size 2024-02-15T22:40:58.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/831: sync 2024-02-15T22:40:58.994 INFO:tasks.workunit.client.0.smithi033.stdout:2/931: sync 2024-02-15T22:40:58.994 INFO:tasks.workunit.client.0.smithi033.stdout:8/778: creat d1/d74/dc1/d75/dbf/d79/f113 x:0 0 0 2024-02-15T22:40:58.995 INFO:tasks.workunit.client.0.smithi033.stdout:7/825: sync 2024-02-15T22:40:58.996 INFO:tasks.workunit.client.0.smithi033.stdout:5/846: symlink d6/d14/d31/d38/d9b/dd3/l10b 0 2024-02-15T22:40:58.997 INFO:tasks.workunit.client.0.smithi033.stdout:6/657: sync 2024-02-15T22:40:58.997 INFO:tasks.workunit.client.0.smithi033.stdout:6/658: chown d12/f28 221 1 2024-02-15T22:40:58.997 INFO:tasks.workunit.client.0.smithi033.stdout:1/853: rename d1/de/d27/d39/df5/d8f/fa2 to d1/d20/d42/d2c/d4e/de5/ff9 0 2024-02-15T22:40:58.998 INFO:tasks.workunit.client.0.smithi033.stdout:3/841: mknod d0/d3/d3b/db1/c10c 0 2024-02-15T22:40:58.998 INFO:tasks.workunit.client.0.smithi033.stdout:3/842: write d0/d3/f41 [1927113,22110] 0 2024-02-15T22:40:58.999 INFO:tasks.workunit.client.0.smithi033.stdout:9/807: creat d4/d1d/d23/d24/d5a/df1/f101 x:0 0 0 2024-02-15T22:40:59.003 INFO:tasks.workunit.client.0.smithi033.stdout:2/932: unlink d1/d16/d5a/f87 0 2024-02-15T22:40:59.003 INFO:tasks.workunit.client.0.smithi033.stdout:2/933: truncate d1/d16/d5a/d67/f70 1447949 0 2024-02-15T22:40:59.005 INFO:tasks.workunit.client.0.smithi033.stdout:4/832: symlink d8/d16/d51/d1c/db9/d37/dbe/l110 0 2024-02-15T22:40:59.005 INFO:tasks.workunit.client.0.smithi033.stdout:0/721: dwrite db/d19/f3a [0,4194304] 0 2024-02-15T22:40:59.005 INFO:tasks.workunit.client.0.smithi033.stdout:8/779: symlink d1/d68/l114 0 2024-02-15T22:40:59.007 INFO:tasks.workunit.client.0.smithi033.stdout:5/847: mkdir d6/d25/d99/da8/d10c 0 2024-02-15T22:40:59.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/659: rename d12/d2c/d30/d1d/c85 to d12/d2c/dbc/dd4/ce0 0 2024-02-15T22:40:59.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/660: chown d12/d3c/d95/f6c 4 1 2024-02-15T22:40:59.012 INFO:tasks.workunit.client.0.smithi033.stdout:7/826: dread d5/df/d40/d73/fee [0,4194304] 0 2024-02-15T22:40:59.012 INFO:tasks.workunit.client.0.smithi033.stdout:1/854: dwrite d1/de/d27/d39/d3a/f78 [0,4194304] 0 2024-02-15T22:40:59.013 INFO:tasks.workunit.client.0.smithi033.stdout:3/843: getdents d0/d3/d2c/d5d/d3d/d57/d68/dc2 0 2024-02-15T22:40:59.015 INFO:tasks.workunit.client.0.smithi033.stdout:9/808: mkdir d4/d1d/d23/d24/d51/d102 0 2024-02-15T22:40:59.015 INFO:tasks.workunit.client.0.smithi033.stdout:9/809: truncate d4/d1d/d23/d32/f79 1496665 0 2024-02-15T22:40:59.016 INFO:tasks.workunit.client.0.smithi033.stdout:4/833: mkdir d8/d16/d51/d1c/db9/d37/dce/d111 0 2024-02-15T22:40:59.016 INFO:tasks.workunit.client.0.smithi033.stdout:4/834: dread - d8/dc5/fd1 zero size 2024-02-15T22:40:59.016 INFO:tasks.workunit.client.0.smithi033.stdout:4/835: read d8/d16/d45/f73 [1032393,58281] 0 2024-02-15T22:40:59.016 INFO:tasks.workunit.client.0.smithi033.stdout:4/836: chown f5 1969771333 1 2024-02-15T22:40:59.018 INFO:tasks.workunit.client.0.smithi033.stdout:5/848: rename d6/d14/d31/d38/d3f/lac to d6/d25/d99/da8/l10d 0 2024-02-15T22:40:59.020 INFO:tasks.workunit.client.0.smithi033.stdout:7/827: creat d5/d6/f118 x:0 0 0 2024-02-15T22:40:59.020 INFO:tasks.workunit.client.0.smithi033.stdout:7/828: truncate d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/db1/f10a 805570 0 2024-02-15T22:40:59.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:59.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:58 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:59.021 INFO:tasks.workunit.client.0.smithi033.stdout:1/855: getdents d1/de/d27/d39/ddb/de1/d79 0 2024-02-15T22:40:59.022 INFO:tasks.workunit.client.0.smithi033.stdout:5/849: truncate d6/d14/f1d 1083482 0 2024-02-15T22:40:59.022 INFO:tasks.workunit.client.0.smithi033.stdout:5/850: fdatasync d6/d14/d31/d38/d9b/f71 0 2024-02-15T22:40:59.022 INFO:tasks.workunit.client.0.smithi033.stdout:5/851: chown d6/d14/d31/d48/d49/d53/d57/da1/fda 87 1 2024-02-15T22:40:59.023 INFO:tasks.workunit.client.0.smithi033.stdout:7/829: creat d5/df/d56/d99/f119 x:0 0 0 2024-02-15T22:40:59.024 INFO:tasks.workunit.client.0.smithi033.stdout:1/856: rename d1/de/f13 to d1/d20/d42/d2c/d4e/de5/ffa 0 2024-02-15T22:40:59.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/852: mknod d6/d14/d31/d50/d6a/c10e 0 2024-02-15T22:40:59.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/853: stat d6/db0/d70/fe4 0 2024-02-15T22:40:59.028 INFO:tasks.workunit.client.0.smithi033.stdout:2/934: dwrite d1/d8/d2b/d2f/d24/d69/f89 [0,4194304] 0 2024-02-15T22:40:59.028 INFO:tasks.workunit.client.0.smithi033.stdout:2/935: creat d1/d8/d2b/d2f/d24/d2a/d88/f126 x:0 0 0 2024-02-15T22:40:59.029 INFO:tasks.workunit.client.0.smithi033.stdout:9/810: dread d4/d1d/d23/d32/f79 [0,4194304] 0 2024-02-15T22:40:59.032 INFO:tasks.workunit.client.0.smithi033.stdout:8/780: dwrite d1/d74/fa1 [4194304,4194304] 0 2024-02-15T22:40:59.033 INFO:tasks.workunit.client.0.smithi033.stdout:0/722: dwrite db/d19/d32/f6f [0,4194304] 0 2024-02-15T22:40:59.034 INFO:tasks.workunit.client.0.smithi033.stdout:2/936: rename d1/d8/d2b/d2f/d24/d2a/fda to d1/d8/d2b/d2f/d13/d59/d76/d118/f127 0 2024-02-15T22:40:59.036 INFO:tasks.workunit.client.0.smithi033.stdout:9/811: link d4/d1d/l26 d4/dac/db0/dc8/l103 0 2024-02-15T22:40:59.036 INFO:tasks.workunit.client.0.smithi033.stdout:9/812: chown d4/d1d/dd2/ded/d3f/f6e 65698859 1 2024-02-15T22:40:59.041 INFO:tasks.workunit.client.0.smithi033.stdout:2/937: rename d1/d16/d5a/d67/fd8 to d1/d16/d3f/df5/f128 0 2024-02-15T22:40:59.041 INFO:tasks.workunit.client.0.smithi033.stdout:2/938: truncate d1/d16/d5a/fd6 705240 0 2024-02-15T22:40:59.042 INFO:tasks.workunit.client.0.smithi033.stdout:8/781: write d1/d68/d44/f9b [6749440,43158] 0 2024-02-15T22:40:59.043 INFO:tasks.workunit.client.0.smithi033.stdout:9/813: creat d4/d1d/d23/d35/f104 x:0 0 0 2024-02-15T22:40:59.045 INFO:tasks.workunit.client.0.smithi033.stdout:2/939: dread d1/d16/d5a/d67/f70 [0,4194304] 0 2024-02-15T22:40:59.045 INFO:tasks.workunit.client.0.smithi033.stdout:8/782: truncate d1/de/f37 2540463 0 2024-02-15T22:40:59.045 INFO:tasks.workunit.client.0.smithi033.stdout:0/723: dread db/d19/d32/d43/d5a/d76/f86 [0,4194304] 0 2024-02-15T22:40:59.046 INFO:tasks.workunit.client.0.smithi033.stdout:9/814: creat d4/d1d/d42/f105 x:0 0 0 2024-02-15T22:40:59.048 INFO:tasks.workunit.client.0.smithi033.stdout:0/724: rename db/d19/d32/d43/d9f/de3 to db/d60/de8/df3 0 2024-02-15T22:40:59.050 INFO:tasks.workunit.client.0.smithi033.stdout:0/725: rmdir db/d2a/d68/da9 39 2024-02-15T22:40:59.057 INFO:tasks.workunit.client.0.smithi033.stdout:9/815: dread d4/d1d/d23/d24/d51/d5d/dbc/ff0 [0,4194304] 0 2024-02-15T22:40:59.059 INFO:tasks.workunit.client.0.smithi033.stdout:9/816: creat d4/d1d/d23/d32/f106 x:0 0 0 2024-02-15T22:40:59.059 INFO:tasks.workunit.client.0.smithi033.stdout:9/817: chown d4/d1d/c36 5679244 1 2024-02-15T22:40:59.060 INFO:tasks.workunit.client.0.smithi033.stdout:2/940: dread d1/d8/d2b/d2f/d12/d52/f125 [4194304,4194304] 0 2024-02-15T22:40:59.061 INFO:tasks.workunit.client.0.smithi033.stdout:9/818: mknod d4/dac/c107 0 2024-02-15T22:40:59.062 INFO:tasks.workunit.client.0.smithi033.stdout:4/837: dwrite d8/d16/d51/d1c/f38 [0,4194304] 0 2024-02-15T22:40:59.065 INFO:tasks.workunit.client.0.smithi033.stdout:6/661: dwrite d12/d2c/d30/d1d/f39 [0,4194304] 0 2024-02-15T22:40:59.069 INFO:tasks.workunit.client.0.smithi033.stdout:4/838: rename d8/d16/d45 to d8/d16/d51/d1c/db9/d37/d31/d47/d112 0 2024-02-15T22:40:59.072 INFO:tasks.workunit.client.0.smithi033.stdout:4/839: getdents d8/d16/d51/d1c/d50/da1 0 2024-02-15T22:40:59.072 INFO:tasks.workunit.client.0.smithi033.stdout:4/840: chown d8/ff 145414 1 2024-02-15T22:40:59.072 INFO:tasks.workunit.client.0.smithi033.stdout:4/841: fsync d8/d16/d51/d1c/f32 0 2024-02-15T22:40:59.075 INFO:tasks.workunit.client.0.smithi033.stdout:4/842: mknod d8/d16/d51/d1c/d50/da1/dc1/c113 0 2024-02-15T22:40:59.075 INFO:tasks.workunit.client.0.smithi033.stdout:4/843: fdatasync d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/fdc 0 2024-02-15T22:40:59.075 INFO:tasks.workunit.client.0.smithi033.stdout:3/844: dwrite d0/d91/f105 [0,4194304] 0 2024-02-15T22:40:59.075 INFO:tasks.workunit.client.0.smithi033.stdout:7/830: dwrite d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/fe3 [0,4194304] 0 2024-02-15T22:40:59.082 INFO:tasks.workunit.client.0.smithi033.stdout:8/783: dwrite d1/d74/fc6 [0,4194304] 0 2024-02-15T22:40:59.082 INFO:tasks.workunit.client.0.smithi033.stdout:8/784: truncate d1/d68/d44/f8d 4249498 0 2024-02-15T22:40:59.082 INFO:tasks.workunit.client.0.smithi033.stdout:4/844: rename d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/c7a to d8/d16/d51/d1c/db9/d37/d31/d47/c114 0 2024-02-15T22:40:59.084 INFO:tasks.workunit.client.0.smithi033.stdout:0/726: dwrite db/d2a/d6c/fca [0,4194304] 0 2024-02-15T22:40:59.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/831: unlink d5/dc/l91 0 2024-02-15T22:40:59.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/832: creat d5/dc/d5f/f11a x:0 0 0 2024-02-15T22:40:59.089 INFO:tasks.workunit.client.0.smithi033.stdout:4/845: dread d8/d16/d97/fb2 [0,4194304] 0 2024-02-15T22:40:59.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/833: read f4 [225034,86545] 0 2024-02-15T22:40:59.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/834: fsync d5/df/f5e 0 2024-02-15T22:40:59.092 INFO:tasks.workunit.client.0.smithi033.stdout:9/819: dwrite d4/d1d/dd2/ded/d3f/fb1 [0,4194304] 0 2024-02-15T22:40:59.094 INFO:tasks.workunit.client.0.smithi033.stdout:4/846: dread d8/d16/d51/d1c/db9/d37/d31/f42 [0,4194304] 0 2024-02-15T22:40:59.094 INFO:tasks.workunit.client.0.smithi033.stdout:4/847: truncate d8/d16/d51/d1c/db9/d37/d31/d47/d112/db1/f102 48853 0 2024-02-15T22:40:59.096 INFO:tasks.workunit.client.0.smithi033.stdout:8/785: creat d1/de/d1a/d27/ddf/de6/df7/f115 x:0 0 0 2024-02-15T22:40:59.099 INFO:tasks.workunit.client.0.smithi033.stdout:0/727: creat db/d19/d32/d43/d94/ff4 x:0 0 0 2024-02-15T22:40:59.100 INFO:tasks.workunit.client.0.smithi033.stdout:2/941: dwrite d1/d8/d2b/d2f/d24/d2a/d88/d8e/f105 [0,4194304] 0 2024-02-15T22:40:59.103 INFO:tasks.workunit.client.0.smithi033.stdout:9/820: creat d4/dac/db0/dc8/f108 x:0 0 0 2024-02-15T22:40:59.103 INFO:tasks.workunit.client.0.smithi033.stdout:6/662: dwrite d12/d2c/d30/f49 [0,4194304] 0 2024-02-15T22:40:59.104 INFO:tasks.workunit.client.0.smithi033.stdout:4/848: truncate d8/d16/d51/d1c/db9/d37/d31/d47/d85/fb4 28196 0 2024-02-15T22:40:59.106 INFO:tasks.workunit.client.0.smithi033.stdout:8/786: dread d1/de/d1a/d27/d70/fa2 [0,4194304] 0 2024-02-15T22:40:59.106 INFO:tasks.workunit.client.0.smithi033.stdout:0/728: unlink db/d19/d32/d43/d5a/d76/c91 0 2024-02-15T22:40:59.108 INFO:tasks.workunit.client.0.smithi033.stdout:3/845: dwrite d0/d3/d2c/d5d/d3d/d57/fbc [0,4194304] 0 2024-02-15T22:40:59.108 INFO:tasks.workunit.client.0.smithi033.stdout:7/835: dwrite d5/d6/f7 [4194304,4194304] 0 2024-02-15T22:40:59.111 INFO:tasks.workunit.client.0.smithi033.stdout:2/942: symlink d1/d8/d2b/d2f/d13/d59/dc8/ded/l129 0 2024-02-15T22:40:59.111 INFO:tasks.workunit.client.0.smithi033.stdout:2/943: fdatasync d1/d66/fdf 0 2024-02-15T22:40:59.113 INFO:tasks.workunit.client.0.smithi033.stdout:9/821: mkdir d4/d1d/d23/d32/da7/d109 0 2024-02-15T22:40:59.113 INFO:tasks.workunit.client.0.smithi033.stdout:9/822: write d4/d1d/d23/d24/f2b [5001862,129039] 0 2024-02-15T22:40:59.113 INFO:tasks.workunit.client.0.smithi033.stdout:7/836: dread d5/dc/d5f/d8b/fef [0,4194304] 0 2024-02-15T22:40:59.113 INFO:tasks.workunit.client.0.smithi033.stdout:7/837: chown d5/f31 1124860141 1 2024-02-15T22:40:59.114 INFO:tasks.workunit.client.0.smithi033.stdout:6/663: truncate d12/d2c/d30/f3d 181825 0 2024-02-15T22:40:59.114 INFO:tasks.workunit.client.0.smithi033.stdout:6/664: write d12/f78 [4164809,30205] 0 2024-02-15T22:40:59.114 INFO:tasks.workunit.client.0.smithi033.stdout:6/665: chown c8 29447310 1 2024-02-15T22:40:59.114 INFO:tasks.workunit.client.0.smithi033.stdout:6/666: fdatasync d12/d3c/f91 0 2024-02-15T22:40:59.116 INFO:tasks.workunit.client.0.smithi033.stdout:4/849: creat d8/d16/d51/d71/f115 x:0 0 0 2024-02-15T22:40:59.119 INFO:tasks.workunit.client.0.smithi033.stdout:8/787: rename d1/de/d1a/f20 to d1/de/d1a/f116 0 2024-02-15T22:40:59.119 INFO:tasks.workunit.client.0.smithi033.stdout:8/788: truncate d1/d74/dc1/d75/db1/db5/dfb/d14/d5d/d72/fba 46827 0 2024-02-15T22:40:59.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/729: creat db/d19/d32/ff5 x:0 0 0 2024-02-15T22:40:59.122 INFO:tasks.workunit.client.0.smithi033.stdout:9/823: write d4/d1d/d23/f7c [2895932,93789] 0 2024-02-15T22:40:59.122 INFO:tasks.workunit.client.0.smithi033.stdout:9/824: write d4/d1d/d23/d24/f6a [157095,117486] 0 2024-02-15T22:40:59.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:40:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:58 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:40:59.125 INFO:tasks.workunit.client.0.smithi033.stdout:3/846: mkdir d0/d3/d3b/d47/d10d 0 2024-02-15T22:40:59.125 INFO:tasks.workunit.client.0.smithi033.stdout:9/825: dread d4/d1d/d23/d32/d3e/f64 [0,4194304] 0 2024-02-15T22:40:59.132 INFO:tasks.workunit.client.0.smithi033.stdout:9/826: dread d4/d1d/d23/d24/f25 [0,4194304] 0 2024-02-15T22:40:59.133 INFO:tasks.workunit.client.0.smithi033.stdout:0/730: write db/d2a/d6c/fca [2720726,14736] 0 2024-02-15T22:40:59.144 INFO:tasks.workunit.client.0.smithi033.stdout:2/944: mkdir d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d9a/d114/d12a 0 2024-02-15T22:40:59.147 INFO:tasks.workunit.client.0.smithi033.stdout:7/838: unlink d5/dc/d5f/d8b/da1/l17 0 2024-02-15T22:40:59.150 INFO:tasks.workunit.client.0.smithi033.stdout:6/667: rename d12/d2c/d30/d1d/d35/f47 to d12/d3c/d95/d3f/da3/fe1 0 2024-02-15T22:40:59.150 INFO:tasks.workunit.client.0.smithi033.stdout:6/668: write d12/d3c/d95/d3f/d4b/fd2 [1105481,42670] 0 2024-02-15T22:40:59.150 INFO:tasks.workunit.client.0.smithi033.stdout:6/669: write d12/d3c/d95/d3f/d50/fb2 [1023122,17669] 0 2024-02-15T22:40:59.151 INFO:tasks.workunit.client.0.smithi033.stdout:4/850: symlink d8/d1a/l116 0 2024-02-15T22:40:59.152 INFO:tasks.workunit.client.0.smithi033.stdout:4/851: readlink d8/d16/d51/d1c/db9/d37/d31/d80/lc2 0 2024-02-15T22:40:59.155 INFO:tasks.workunit.client.0.smithi033.stdout:3/847: rmdir d0/d3/d3b/d47 39 2024-02-15T22:40:59.156 INFO:tasks.workunit.client.0.smithi033.stdout:9/827: creat d4/dac/f10a x:0 0 0 2024-02-15T22:40:59.156 INFO:tasks.workunit.client.0.smithi033.stdout:9/828: fsync d4/f43 0 2024-02-15T22:40:59.156 INFO:tasks.workunit.client.0.smithi033.stdout:9/829: truncate d4/d1d/d23/d32/d71/dab/fd8 26803 0 2024-02-15T22:40:59.157 INFO:tasks.workunit.client.0.smithi033.stdout:0/731: mkdir db/d2a/d68/df6 0 2024-02-15T22:40:59.158 INFO:tasks.workunit.client.0.smithi033.stdout:8/789: dread d1/d74/dc1/d75/db1/db5/dfb/f7 [0,4194304] 0 2024-02-15T22:40:59.160 INFO:tasks.workunit.client.0.smithi033.stdout:2/945: mkdir d1/d8/d2b/d2f/d13/da9/d8d/dec/d122/d12b 0 2024-02-15T22:40:59.163 INFO:tasks.workunit.client.0.smithi033.stdout:7/839: creat d5/dc/f11b x:0 0 0 2024-02-15T22:40:59.163 INFO:tasks.workunit.client.0.smithi033.stdout:7/840: creat d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/db1/f11c x:0 0 0 2024-02-15T22:40:59.165 INFO:tasks.workunit.client.0.smithi033.stdout:6/670: link d12/d3c/d95/f52 d12/d3c/d95/d3f/da3/fe2 0 2024-02-15T22:40:59.169 INFO:tasks.workunit.client.0.smithi033.stdout:4/852: link d8/d16/d51/d1c/db9/d37/d31/l8e d8/d16/d51/d1c/d94/l117 0 2024-02-15T22:40:59.170 INFO:tasks.workunit.client.0.smithi033.stdout:4/853: creat d8/d16/d51/d1c/db9/d37/d23/d61/df3/f118 x:0 0 0 2024-02-15T22:40:59.173 INFO:tasks.workunit.client.0.smithi033.stdout:9/830: mknod d4/d1d/d23/d24/d5a/c10b 0 2024-02-15T22:40:59.175 INFO:tasks.workunit.client.0.smithi033.stdout:8/790: link d1/d74/dc1/fe2 d1/d74/dc1/d75/dbf/d79/da5/f117 0 2024-02-15T22:40:59.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/946: creat d1/d8/d2b/d2f/d13/da9/d8d/d121/f12c x:0 0 0 2024-02-15T22:40:59.183 INFO:tasks.workunit.client.0.smithi033.stdout:7/841: dread d5/df/d56/d60/d59/d9c/f6a [4194304,4194304] 0 2024-02-15T22:40:59.183 INFO:tasks.workunit.client.0.smithi033.stdout:7/842: dread - d5/df/d56/d60/d59/fab zero size 2024-02-15T22:40:59.183 INFO:tasks.workunit.client.0.smithi033.stdout:4/854: truncate d8/d16/d51/d1c/db9/d37/d31/da5/da9/fec 357098 0 2024-02-15T22:40:59.183 INFO:tasks.workunit.client.0.smithi033.stdout:4/855: truncate d8/d16/d51/d1c/db9/d37/d31/d47/d85/fbc 817610 0 2024-02-15T22:40:59.186 INFO:tasks.workunit.client.0.smithi033.stdout:3/848: dwrite d0/d3/d2c/d5d/d3d/f48 [0,4194304] 0 2024-02-15T22:40:59.186 INFO:tasks.workunit.client.0.smithi033.stdout:0/732: dwrite db/d19/d32/d3d/f74 [0,4194304] 0 2024-02-15T22:40:59.187 INFO:tasks.workunit.client.0.smithi033.stdout:9/831: truncate d4/d1d/d23/d35/f77 3434944 0 2024-02-15T22:40:59.191 INFO:tasks.workunit.client.0.smithi033.stdout:8/791: mknod d1/de/d1a/d27/ddf/de6/df7/c118 0 2024-02-15T22:40:59.192 INFO:tasks.workunit.client.0.smithi033.stdout:8/792: truncate d1/d68/f108 345965 0 2024-02-15T22:40:59.193 INFO:tasks.workunit.client.0.smithi033.stdout:2/947: mknod d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d9a/c12d 0 2024-02-15T22:40:59.199 INFO:tasks.workunit.client.0.smithi033.stdout:4/856: write d8/d16/d51/fa7 [1321670,64654] 0 2024-02-15T22:40:59.202 INFO:tasks.workunit.client.0.smithi033.stdout:6/671: dwrite d12/d2c/d30/d1d/f39 [0,4194304] 0 2024-02-15T22:40:59.202 INFO:tasks.workunit.client.0.smithi033.stdout:6/672: creat d12/d2c/d30/d90/fe3 x:0 0 0 2024-02-15T22:40:59.206 INFO:tasks.workunit.client.0.smithi033.stdout:0/733: readlink db/d19/d32/d46/l5e 0 2024-02-15T22:40:59.215 INFO:tasks.workunit.client.0.smithi033.stdout:9/832: rename d4/d1d/d23/d24/ffd to d4/d1d/d23/d24/d51/d5d/d90/f10c 0 2024-02-15T22:40:59.217 INFO:tasks.workunit.client.0.smithi033.stdout:7/843: dwrite d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/fe3 [4194304,4194304] 0 2024-02-15T22:40:59.218 INFO:tasks.workunit.client.0.smithi033.stdout:8/793: mkdir d1/d68/d44/d49/d119 0 2024-02-15T22:40:59.218 INFO:tasks.workunit.client.0.smithi033.stdout:8/794: chown d1/d68/d1d/d4a/fbb 154191 1 2024-02-15T22:40:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:2/948: dwrite d1/d66/d75/f83 [0,4194304] 0 2024-02-15T22:40:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:2/949: stat d1/d16/d5a/d67 0 2024-02-15T22:40:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:3/849: dwrite d0/d3/d2c/f2f [0,4194304] 0 2024-02-15T22:40:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:4/857: creat d8/d16/d51/d1c/d3c/d3f/f119 x:0 0 0 2024-02-15T22:40:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:6/673: truncate d12/d2c/f4a 548598 0 2024-02-15T22:40:59.235 INFO:tasks.workunit.client.0.smithi033.stdout:8/795: mkdir d1/d74/dc1/d75/dbf/d79/d11a 0 2024-02-15T22:40:59.235 INFO:tasks.workunit.client.0.smithi033.stdout:8/796: chown d1/d68/d44/c8c 2831 1 2024-02-15T22:40:59.235 INFO:tasks.workunit.client.0.smithi033.stdout:8/797: truncate d1/de/d1a/d2a/f10d 785015 0 2024-02-15T22:40:59.237 INFO:tasks.workunit.client.0.smithi033.stdout:7/844: dwrite d5/df/d40/d73/fcc [0,4194304] 0 2024-02-15T22:40:59.238 INFO:tasks.workunit.client.0.smithi033.stdout:0/734: dwrite db/d2a/fe5 [0,4194304] 0 2024-02-15T22:40:59.238 INFO:tasks.workunit.client.0.smithi033.stdout:7/845: write d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/db1/fe0 [900047,81720] 0 2024-02-15T22:40:59.239 INFO:tasks.workunit.client.0.smithi033.stdout:2/950: rmdir d1/d8/d116 0 2024-02-15T22:40:59.243 INFO:tasks.workunit.client.0.smithi033.stdout:3/850: creat d0/d3/d2c/d5d/f10e x:0 0 0 2024-02-15T22:40:59.244 INFO:tasks.workunit.client.0.smithi033.stdout:3/851: truncate d0/d3/d2c/d5d/d3d/fe8 769277 0 2024-02-15T22:40:59.244 INFO:tasks.workunit.client.0.smithi033.stdout:3/852: creat d0/d3/d3b/f10f x:0 0 0 2024-02-15T22:40:59.245 INFO:tasks.workunit.client.0.smithi033.stdout:4/858: symlink d8/d16/d51/d1c/db9/d37/d31/d47/l11a 0 2024-02-15T22:40:59.245 INFO:tasks.workunit.client.0.smithi033.stdout:4/859: fdatasync d8/d16/d51/d1c/d50/fe1 0 2024-02-15T22:40:59.246 INFO:tasks.workunit.client.0.smithi033.stdout:6/674: symlink d12/d3c/d95/d3f/d50/le4 0 2024-02-15T22:40:59.248 INFO:tasks.workunit.client.0.smithi033.stdout:9/833: getdents d4/d1d/d23 0 2024-02-15T22:40:59.250 INFO:tasks.workunit.client.0.smithi033.stdout:8/798: unlink d1/d74/cf9 0 2024-02-15T22:40:59.254 INFO:tasks.workunit.client.0.smithi033.stdout:4/860: write d8/d16/d51/d27/f5e [1398698,125863] 0 2024-02-15T22:40:59.257 INFO:tasks.workunit.client.0.smithi033.stdout:1/857: sync 2024-02-15T22:40:59.258 INFO:tasks.workunit.client.0.smithi033.stdout:1/858: readlink d1/de/d27/d39/ddb/de1/ld8 0 2024-02-15T22:40:59.266 INFO:tasks.workunit.client.0.smithi033.stdout:7/846: creat d5/dc/d5f/d8b/da0/dc6/dcd/f11d x:0 0 0 2024-02-15T22:40:59.266 INFO:tasks.workunit.client.0.smithi033.stdout:2/951: rmdir d1/d8/d2b/d2f/d12 39 2024-02-15T22:40:59.267 INFO:tasks.workunit.client.0.smithi033.stdout:1/859: dread d1/de/d27/d39/d3a/dae/fb8 [0,4194304] 0 2024-02-15T22:40:59.268 INFO:tasks.workunit.client.0.smithi033.stdout:8/799: dwrite d1/de/d1a/f6e [0,4194304] 0 2024-02-15T22:40:59.269 INFO:tasks.workunit.client.0.smithi033.stdout:3/853: mkdir d0/d3/dd/d110 0 2024-02-15T22:40:59.269 INFO:tasks.workunit.client.0.smithi033.stdout:3/854: fdatasync d0/d3/d2c/d5d/d3d/d57/d68/dac/fc1 0 2024-02-15T22:40:59.271 INFO:tasks.workunit.client.0.smithi033.stdout:6/675: rename d12/d3c/d95/d3f/f88 to d12/d3c/d95/d3f/da3/fe5 0 2024-02-15T22:40:59.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/854: sync 2024-02-15T22:40:59.272 INFO:tasks.workunit.client.0.smithi033.stdout:9/834: symlink d4/d1d/d23/d35/l10d 0 2024-02-15T22:40:59.277 INFO:tasks.workunit.client.0.smithi033.stdout:4/861: creat d8/d16/d51/d1c/d50/f11b x:0 0 0 2024-02-15T22:40:59.277 INFO:tasks.workunit.client.0.smithi033.stdout:4/862: write d8/d16/d51/d1c/db9/d37/d31/d47/d85/f89 [550900,13141] 0 2024-02-15T22:40:59.277 INFO:tasks.workunit.client.0.smithi033.stdout:4/863: stat d8/d16/d51/d1c/d3c/d49/dac/lbb 0 2024-02-15T22:40:59.277 INFO:tasks.workunit.client.0.smithi033.stdout:4/864: fdatasync d8/d16/d51/d1c/db9/d37/d23/f5b 0 2024-02-15T22:40:59.279 INFO:tasks.workunit.client.0.smithi033.stdout:2/952: mknod d1/d8/d2b/d2f/d13/d6f/db5/c12e 0 2024-02-15T22:40:59.280 INFO:tasks.workunit.client.0.smithi033.stdout:1/860: truncate d1/d20/d42/d2c/fd2 136545 0 2024-02-15T22:40:59.280 INFO:tasks.workunit.client.0.smithi033.stdout:7/847: write d5/df/d56/d60/f6b [3583446,6033] 0 2024-02-15T22:40:59.282 INFO:tasks.workunit.client.0.smithi033.stdout:9/835: dread d4/d1d/d23/d24/f2b [0,4194304] 0 2024-02-15T22:40:59.284 INFO:tasks.workunit.client.0.smithi033.stdout:6/676: mknod d12/d3c/d95/d3f/d4b/dac/d5c/ce6 0 2024-02-15T22:40:59.287 INFO:tasks.workunit.client.0.smithi033.stdout:5/855: creat d6/d14/d31/d48/d56/d90/f10f x:0 0 0 2024-02-15T22:40:59.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/953: unlink d1/d8/d2b/d2f/d24/d31/f58 0 2024-02-15T22:40:59.290 INFO:tasks.workunit.client.0.smithi033.stdout:1/861: creat d1/de/d27/d39/df5/d8f/ffb x:0 0 0 2024-02-15T22:40:59.292 INFO:tasks.workunit.client.0.smithi033.stdout:7/848: link d5/df/d56/d84/fca d5/dc/d5f/d8b/da1/d26/d3f/f11e 0 2024-02-15T22:40:59.293 INFO:tasks.workunit.client.0.smithi033.stdout:6/677: mknod d12/d3c/d95/d3f/d50/ce7 0 2024-02-15T22:40:59.293 INFO:tasks.workunit.client.0.smithi033.stdout:6/678: chown d12/d3c/d95/d3f/db6/fc9 0 1 2024-02-15T22:40:59.294 INFO:tasks.workunit.client.0.smithi033.stdout:3/855: dwrite d0/d3/d2c/d5d/d3d/d57/d68/dac/fc1 [0,4194304] 0 2024-02-15T22:40:59.295 INFO:tasks.workunit.client.0.smithi033.stdout:5/856: symlink d6/d14/d31/d48/d49/d53/d57/l110 0 2024-02-15T22:40:59.298 INFO:tasks.workunit.client.0.smithi033.stdout:2/954: creat d1/d8/d2b/d2f/d24/d31/d79/de3/f12f x:0 0 0 2024-02-15T22:40:59.299 INFO:tasks.workunit.client.0.smithi033.stdout:1/862: symlink d1/d20/d42/d2c/d4e/lfc 0 2024-02-15T22:40:59.301 INFO:tasks.workunit.client.0.smithi033.stdout:7/849: mknod d5/df/d40/c11f 0 2024-02-15T22:40:59.303 INFO:tasks.workunit.client.0.smithi033.stdout:6/679: unlink d12/d3c/da1/fb4 0 2024-02-15T22:40:59.303 INFO:tasks.workunit.client.0.smithi033.stdout:6/680: readlink d12/d3c/d95/d3f/d4b/dac/d5c/l80 0 2024-02-15T22:40:59.306 INFO:tasks.workunit.client.0.smithi033.stdout:4/865: dwrite d8/d16/d51/d1c/d3c/d3f/f119 [0,4194304] 0 2024-02-15T22:40:59.306 INFO:tasks.workunit.client.0.smithi033.stdout:4/866: fdatasync d8/d16/d51/d1c/db9/d37/d23/d61/df3/f118 0 2024-02-15T22:40:59.306 INFO:tasks.workunit.client.0.smithi033.stdout:4/867: write d8/d16/d51/d1c/db9/d37/d31/da5/ffc [743898,55433] 0 2024-02-15T22:40:59.307 INFO:tasks.workunit.client.0.smithi033.stdout:9/836: dwrite d4/dac/fce [0,4194304] 0 2024-02-15T22:40:59.307 INFO:tasks.workunit.client.0.smithi033.stdout:3/856: rmdir d0/d3/d2c 39 2024-02-15T22:40:59.310 INFO:tasks.workunit.client.0.smithi033.stdout:5/857: link d6/d14/d31/d38/f82 d6/d14/df5/f111 0 2024-02-15T22:40:59.310 INFO:tasks.workunit.client.0.smithi033.stdout:5/858: truncate d6/d14/d31/d48/d56/f9a 509114 0 2024-02-15T22:40:59.310 INFO:tasks.workunit.client.0.smithi033.stdout:5/859: chown d6/d14/d31/d48/d56/d90/cd1 61033880 1 2024-02-15T22:40:59.312 INFO:tasks.workunit.client.0.smithi033.stdout:8/800: rename d1/d74/dc1/d75/db1/db5/dfb/d14/d5d/d72 to d1/de/d1a/d2a/d40/d11b 0 2024-02-15T22:40:59.314 INFO:tasks.workunit.client.0.smithi033.stdout:2/955: dread d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f109 [0,4194304] 0 2024-02-15T22:40:59.314 INFO:tasks.workunit.client.0.smithi033.stdout:1/863: getdents d1/de/d27/d39/df5 0 2024-02-15T22:40:59.317 INFO:tasks.workunit.client.0.smithi033.stdout:7/850: symlink d5/dc/d5f/d8b/da1/d26/d116/l120 0 2024-02-15T22:40:59.317 INFO:tasks.workunit.client.0.smithi033.stdout:7/851: chown d5/dc/d5f/d8b/da1/d26/d3f 0 1 2024-02-15T22:40:59.317 INFO:tasks.workunit.client.0.smithi033.stdout:3/857: dread d0/d3/d3b/f98 [0,4194304] 0 2024-02-15T22:40:59.320 INFO:tasks.workunit.client.0.smithi033.stdout:4/868: creat d8/f11c x:0 0 0 2024-02-15T22:40:59.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/681: dwrite d12/d2c/d30/d90/fe3 [0,4194304] 0 2024-02-15T22:40:59.324 INFO:tasks.workunit.client.0.smithi033.stdout:9/837: mkdir d4/d1d/dd2/ded/d3f/d10e 0 2024-02-15T22:40:59.324 INFO:tasks.workunit.client.0.smithi033.stdout:9/838: fsync d4/d1d/d23/d32/da7/ddb/fe9 0 2024-02-15T22:40:59.326 INFO:tasks.workunit.client.0.smithi033.stdout:5/860: link d6/d14/d31/d48/f69 d6/d14/d31/d38/d9b/dd2/f112 0 2024-02-15T22:40:59.327 INFO:tasks.workunit.client.0.smithi033.stdout:8/801: symlink d1/de/d1a/d2a/d40/d11b/l11c 0 2024-02-15T22:40:59.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/864: mkdir d1/de/d27/d39/ddb/de1/d37/dfd 0 2024-02-15T22:40:59.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/865: write d1/de/d27/d39/ddb/de1/f29 [1799249,58051] 0 2024-02-15T22:40:59.333 INFO:tasks.workunit.client.0.smithi033.stdout:7/852: link d5/d6/d10/fa5 d5/df/d56/d60/d59/f121 0 2024-02-15T22:40:59.333 INFO:tasks.workunit.client.0.smithi033.stdout:7/853: write d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/db1/f11c [216273,83502] 0 2024-02-15T22:40:59.333 INFO:tasks.workunit.client.0.smithi033.stdout:7/854: fsync d5/dc/d5f/d8b/da1/d26/f3c 0 2024-02-15T22:40:59.334 INFO:tasks.workunit.client.0.smithi033.stdout:3/858: mknod d0/d3/d3b/d47/c111 0 2024-02-15T22:40:59.342 INFO:tasks.workunit.client.0.smithi033.stdout:8/802: dwrite d1/f33 [0,4194304] 0 2024-02-15T22:40:59.343 INFO:tasks.workunit.client.0.smithi033.stdout:6/682: mknod d12/d3c/d95/d3f/db6/ce8 0 2024-02-15T22:40:59.343 INFO:tasks.workunit.client.0.smithi033.stdout:6/683: write d12/d2c/d30/d1d/fa6 [823663,94496] 0 2024-02-15T22:40:59.343 INFO:tasks.workunit.client.0.smithi033.stdout:9/839: getdents d4/d1d/d23/d24/d5a/dbb 0 2024-02-15T22:40:59.344 INFO:tasks.workunit.client.0.smithi033.stdout:7/855: write d5/df/d56/d84/ff3 [3325625,107395] 0 2024-02-15T22:40:59.344 INFO:tasks.workunit.client.0.smithi033.stdout:9/840: dread - d4/d1d/d23/d24/d5a/ff3 zero size 2024-02-15T22:40:59.344 INFO:tasks.workunit.client.0.smithi033.stdout:9/841: chown d4/d1d/c36 14881480 1 2024-02-15T22:40:59.344 INFO:tasks.workunit.client.0.smithi033.stdout:7/856: chown d5/dc/fc2 63590744 1 2024-02-15T22:40:59.344 INFO:tasks.workunit.client.0.smithi033.stdout:7/857: chown d5/df/f5e 7751 1 2024-02-15T22:40:59.344 INFO:tasks.workunit.client.0.smithi033.stdout:5/861: truncate d6/feb 190298 0 2024-02-15T22:40:59.345 INFO:tasks.workunit.client.0.smithi033.stdout:2/956: getdents d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/d99 0 2024-02-15T22:40:59.348 INFO:tasks.workunit.client.0.smithi033.stdout:1/866: creat d1/de/d27/d39/ffe x:0 0 0 2024-02-15T22:40:59.349 INFO:tasks.workunit.client.0.smithi033.stdout:3/859: unlink d0/d1c/f32 0 2024-02-15T22:40:59.351 INFO:tasks.workunit.client.0.smithi033.stdout:4/869: rmdir d8/dd9 39 2024-02-15T22:40:59.351 INFO:tasks.workunit.client.0.smithi033.stdout:6/684: dread d12/d3c/d95/d3f/d50/f65 [0,4194304] 0 2024-02-15T22:40:59.351 INFO:tasks.workunit.client.0.smithi033.stdout:6/685: chown d12/d2c/d30/d1d/d35/l6d 1 1 2024-02-15T22:40:59.358 INFO:tasks.workunit.client.0.smithi033.stdout:8/803: rename d1/d68/d1d/d4a/c64 to d1/d68/d57/df2/c11d 0 2024-02-15T22:40:59.358 INFO:tasks.workunit.client.0.smithi033.stdout:8/804: write d1/de/d1a/ffd [846729,70216] 0 2024-02-15T22:40:59.358 INFO:tasks.workunit.client.0.smithi033.stdout:8/805: read d1/d74/dc1/d75/dbf/d79/da5/f117 [85374,53939] 0 2024-02-15T22:40:59.360 INFO:tasks.workunit.client.0.smithi033.stdout:6/686: write d12/d2c/d30/f36 [3943932,125365] 0 2024-02-15T22:40:59.360 INFO:tasks.workunit.client.0.smithi033.stdout:6/687: dread - d12/d3c/d95/d3f/d4b/dac/f77 zero size 2024-02-15T22:40:59.360 INFO:tasks.workunit.client.0.smithi033.stdout:6/688: creat d12/d2c/d30/d90/fe9 x:0 0 0 2024-02-15T22:40:59.363 INFO:tasks.workunit.client.0.smithi033.stdout:9/842: dread - d4/d1d/dd2/ded/f78 zero size 2024-02-15T22:40:59.363 INFO:tasks.workunit.client.0.smithi033.stdout:9/843: fdatasync d4/d1d/d23/d24/d5e/f69 0 2024-02-15T22:40:59.363 INFO:tasks.workunit.client.0.smithi033.stdout:9/844: chown d4/d1d/d23/d32/da7/ddb 44503 1 2024-02-15T22:40:59.363 INFO:tasks.workunit.client.0.smithi033.stdout:9/845: chown d4/d1d/c2d 7910425 1 2024-02-15T22:40:59.364 INFO:tasks.workunit.client.0.smithi033.stdout:7/858: unlink d5/d6/d10/fbe 0 2024-02-15T22:40:59.364 INFO:tasks.workunit.client.0.smithi033.stdout:4/870: dwrite d8/d16/d51/d1c/d50/da1/dc1/ff8 [4194304,4194304] 0 2024-02-15T22:40:59.365 INFO:tasks.workunit.client.0.smithi033.stdout:4/871: chown d8/d16/d51/d1c/d3c/ddd/cfa 7 1 2024-02-15T22:40:59.366 INFO:tasks.workunit.client.0.smithi033.stdout:2/957: symlink d1/d8/d2b/d2f/d13/da9/d8d/dec/d122/l130 0 2024-02-15T22:40:59.366 INFO:tasks.workunit.client.0.smithi033.stdout:2/958: write d1/d16/f1a [5084480,97226] 0 2024-02-15T22:40:59.366 INFO:tasks.workunit.client.0.smithi033.stdout:2/959: chown d1/d8/cc2 4671 1 2024-02-15T22:40:59.366 INFO:tasks.workunit.client.0.smithi033.stdout:2/960: fsync d1/d16/d3f/f4b 0 2024-02-15T22:40:59.366 INFO:tasks.workunit.client.0.smithi033.stdout:2/961: write d1/d8/d2b/d2f/d24/f39 [1504701,15393] 0 2024-02-15T22:40:59.367 INFO:tasks.workunit.client.0.smithi033.stdout:1/867: truncate d1/de/f38 3003204 0 2024-02-15T22:40:59.367 INFO:tasks.workunit.client.0.smithi033.stdout:1/868: creat d1/d96/fff x:0 0 0 2024-02-15T22:40:59.370 INFO:tasks.workunit.client.0.smithi033.stdout:3/860: creat d0/d3/dd/d110/f112 x:0 0 0 2024-02-15T22:40:59.370 INFO:tasks.workunit.client.0.smithi033.stdout:3/861: write d0/d1c/fbd [978105,71028] 0 2024-02-15T22:40:59.370 INFO:tasks.workunit.client.0.smithi033.stdout:3/862: chown d0/d3/d2c/d5d/d3d/la6 9 1 2024-02-15T22:40:59.370 INFO:tasks.workunit.client.0.smithi033.stdout:3/863: stat d0/d3/d3b/db1/dd8 0 2024-02-15T22:40:59.371 INFO:tasks.workunit.client.0.smithi033.stdout:5/862: rename d6/d14/d31/d50/d6a/dab/fe3 to d6/d14/d31/d38/df9/f113 0 2024-02-15T22:40:59.372 INFO:tasks.workunit.client.0.smithi033.stdout:6/689: creat d12/d3c/d95/d3f/d50/dbd/fea x:0 0 0 2024-02-15T22:40:59.373 INFO:tasks.workunit.client.0.smithi033.stdout:9/846: creat d4/d1d/d23/d24/d5e/f10f x:0 0 0 2024-02-15T22:40:59.375 INFO:tasks.workunit.client.0.smithi033.stdout:7/859: mkdir d5/dc/d5f/daa/d122 0 2024-02-15T22:40:59.380 INFO:tasks.workunit.client.0.smithi033.stdout:4/872: creat d8/d16/d51/d1c/d96/f11d x:0 0 0 2024-02-15T22:40:59.382 INFO:tasks.workunit.client.0.smithi033.stdout:1/869: unlink d1/de/d27/l9c 0 2024-02-15T22:40:59.385 INFO:tasks.workunit.client.0.smithi033.stdout:3/864: unlink d0/d3/d5f/da7/ff1 0 2024-02-15T22:40:59.385 INFO:tasks.workunit.client.0.smithi033.stdout:3/865: chown d0/d3/d77/leb 1103 1 2024-02-15T22:40:59.387 INFO:tasks.workunit.client.0.smithi033.stdout:8/806: rename d1/de/d1a/c34 to d1/de/d1a/d9d/c11e 0 2024-02-15T22:40:59.388 INFO:tasks.workunit.client.0.smithi033.stdout:5/863: mknod d6/db0/c114 0 2024-02-15T22:40:59.388 INFO:tasks.workunit.client.0.smithi033.stdout:5/864: write d6/d14/d31/d48/d49/d53/d57/fbf [1009150,38591] 0 2024-02-15T22:40:59.389 INFO:tasks.workunit.client.0.smithi033.stdout:7/860: creat d5/dc/d5f/d8b/da1/f123 x:0 0 0 2024-02-15T22:40:59.390 INFO:tasks.workunit.client.0.smithi033.stdout:4/873: mknod d8/d16/d51/d1c/c11e 0 2024-02-15T22:40:59.392 INFO:tasks.workunit.client.0.smithi033.stdout:5/865: link d6/d14/d31/d38/d3f/f92 d6/d14/d31/d38/d9b/f115 0 2024-02-15T22:40:59.395 INFO:tasks.workunit.client.0.smithi033.stdout:5/866: rename d6/l75 to d6/d25/df4/l116 0 2024-02-15T22:40:59.397 INFO:tasks.workunit.client.0.smithi033.stdout:5/867: mkdir d6/d14/d31/d48/d49/d53/dd7/d117 0 2024-02-15T22:40:59.397 INFO:tasks.workunit.client.0.smithi033.stdout:5/868: creat d6/d14/d31/d48/d49/d53/d57/da1/f118 x:0 0 0 2024-02-15T22:40:59.397 INFO:tasks.workunit.client.0.smithi033.stdout:5/869: write d6/d14/f2e [1238988,68095] 0 2024-02-15T22:40:59.397 INFO:tasks.workunit.client.0.smithi033.stdout:3/866: write d0/f56 [1800863,57752] 0 2024-02-15T22:40:59.401 INFO:tasks.workunit.client.0.smithi033.stdout:3/867: mknod d0/d3/d2c/c113 0 2024-02-15T22:40:59.401 INFO:tasks.workunit.client.0.smithi033.stdout:3/868: chown d0/d3/dd/fa5 0 1 2024-02-15T22:40:59.402 INFO:tasks.workunit.client.0.smithi033.stdout:1/870: dread d1/de/d27/d39/df5/d92/fac [0,4194304] 0 2024-02-15T22:40:59.402 INFO:tasks.workunit.client.0.smithi033.stdout:3/869: mknod d0/d3/d2c/d5d/d3d/d57/d68/dfe/c114 0 2024-02-15T22:40:59.403 INFO:tasks.workunit.client.0.smithi033.stdout:2/962: dwrite d1/d8/d2b/d2f/d13/da9/f63 [0,4194304] 0 2024-02-15T22:40:59.403 INFO:tasks.workunit.client.0.smithi033.stdout:1/871: mknod d1/de/d27/d39/ddb/de1/d79/c100 0 2024-02-15T22:40:59.404 INFO:tasks.workunit.client.0.smithi033.stdout:1/872: truncate d1/de/d27/d39/ddb/de1/d2d/d5e/d69/fc2 1037436 0 2024-02-15T22:40:59.404 INFO:tasks.workunit.client.0.smithi033.stdout:1/873: chown d1/de/d27/d39/ddb/de1/d2d/d36/cc5 79115 1 2024-02-15T22:40:59.406 INFO:tasks.workunit.client.0.smithi033.stdout:3/870: symlink d0/d3/d2c/d5d/d3d/d57/d68/dc2/l115 0 2024-02-15T22:40:59.406 INFO:tasks.workunit.client.0.smithi033.stdout:3/871: chown d0/d3/d2c/d5d/d3d/db4/f10b 4105681 1 2024-02-15T22:40:59.410 INFO:tasks.workunit.client.0.smithi033.stdout:4/874: dread d8/d16/d51/d1c/f6c [0,4194304] 0 2024-02-15T22:40:59.414 INFO:tasks.workunit.client.0.smithi033.stdout:1/874: dread d1/d20/d42/f49 [0,4194304] 0 2024-02-15T22:40:59.415 INFO:tasks.workunit.client.0.smithi033.stdout:3/872: unlink d0/d3/d65/d97/l85 0 2024-02-15T22:40:59.417 INFO:tasks.workunit.client.0.smithi033.stdout:4/875: creat d8/d16/d51/d1c/d50/da1/f11f x:0 0 0 2024-02-15T22:40:59.417 INFO:tasks.workunit.client.0.smithi033.stdout:4/876: stat d8/d16/d51/d1c/db9/d37/d31/da5/da9/fec 0 2024-02-15T22:40:59.417 INFO:tasks.workunit.client.0.smithi033.stdout:4/877: truncate d8/dd9/f10f 588018 0 2024-02-15T22:40:59.418 INFO:tasks.workunit.client.0.smithi033.stdout:2/963: rename d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/c4c to d1/d8/d34/c131 0 2024-02-15T22:40:59.419 INFO:tasks.workunit.client.0.smithi033.stdout:6/690: dwrite d12/d3c/d95/d3f/d4b/fd0 [0,4194304] 0 2024-02-15T22:40:59.419 INFO:tasks.workunit.client.0.smithi033.stdout:3/873: mkdir d0/d3/dd/d110/d116 0 2024-02-15T22:40:59.420 INFO:tasks.workunit.client.0.smithi033.stdout:9/847: dwrite d4/d1d/dd2/ded/f78 [0,4194304] 0 2024-02-15T22:40:59.421 INFO:tasks.workunit.client.0.smithi033.stdout:5/870: dwrite d6/fe [0,4194304] 0 2024-02-15T22:40:59.422 INFO:tasks.workunit.client.0.smithi033.stdout:7/861: dwrite d5/dc/fc2 [0,4194304] 0 2024-02-15T22:40:59.422 INFO:tasks.workunit.client.0.smithi033.stdout:8/807: dwrite d1/de/d1a/d2a/f6f [0,4194304] 0 2024-02-15T22:40:59.423 INFO:tasks.workunit.client.0.smithi033.stdout:4/878: unlink d8/d16/d51/d1c/d50/f11b 0 2024-02-15T22:40:59.423 INFO:tasks.workunit.client.0.smithi033.stdout:4/879: chown d8/d16/d51/d1c/d3c/d49 157211 1 2024-02-15T22:40:59.426 INFO:tasks.workunit.client.0.smithi033.stdout:6/691: truncate d12/d2c/dbc/f97 1088627 0 2024-02-15T22:40:59.427 INFO:tasks.workunit.client.0.smithi033.stdout:6/692: chown d12/d2c/dbc/f97 12 1 2024-02-15T22:40:59.427 INFO:tasks.workunit.client.0.smithi033.stdout:3/874: mknod d0/d3/d2c/d5d/d3d/db6/c117 0 2024-02-15T22:40:59.427 INFO:tasks.workunit.client.0.smithi033.stdout:3/875: write d0/d3/d2c/d5d/d3d/db4/ff8 [143687,16601] 0 2024-02-15T22:40:59.430 INFO:tasks.workunit.client.0.smithi033.stdout:5/871: rmdir d6/d14/d31/d50/d5c/dd6 39 2024-02-15T22:40:59.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/808: mknod d1/d74/dc1/d75/db1/db5/c11f 0 2024-02-15T22:40:59.432 INFO:tasks.workunit.client.0.smithi033.stdout:4/880: truncate d8/d16/d51/d1c/db9/f25 1148966 0 2024-02-15T22:40:59.433 INFO:tasks.workunit.client.0.smithi033.stdout:4/881: readlink d8/d16/d51/d1c/db9/l5a 0 2024-02-15T22:40:59.434 INFO:tasks.workunit.client.0.smithi033.stdout:3/876: getdents d0/d3/d2c/d5d/d3d/d57/d74 0 2024-02-15T22:40:59.434 INFO:tasks.workunit.client.0.smithi033.stdout:3/877: fdatasync d0/d3/dd/fc9 0 2024-02-15T22:40:59.434 INFO:tasks.workunit.client.0.smithi033.stdout:3/878: chown d0/d3/d77 0 1 2024-02-15T22:40:59.437 INFO:tasks.workunit.client.0.smithi033.stdout:1/875: dwrite d1/d96/fad [0,4194304] 0 2024-02-15T22:40:59.437 INFO:tasks.workunit.client.0.smithi033.stdout:1/876: write d1/d20/d42/d25/d67/ff7 [769766,42407] 0 2024-02-15T22:40:59.437 INFO:tasks.workunit.client.0.smithi033.stdout:9/848: mkdir d4/d110 0 2024-02-15T22:40:59.438 INFO:tasks.workunit.client.0.smithi033.stdout:9/849: write d4/d1d/d23/d24/d51/d5d/dbc/fe8 [779933,32695] 0 2024-02-15T22:40:59.439 INFO:tasks.workunit.client.0.smithi033.stdout:9/850: write d4/d1d/f70 [148427,77767] 0 2024-02-15T22:40:59.439 INFO:tasks.workunit.client.0.smithi033.stdout:8/809: rename d1/d74/dc1/d75/db1/db5/dfb/d14/fa4 to d1/d74/dc1/d75/d83/f120 0 2024-02-15T22:40:59.440 INFO:tasks.workunit.client.0.smithi033.stdout:8/810: write d1/d74/dc1/d75/db1/db5/dfb/d14/d5d/fc0 [1717108,115604] 0 2024-02-15T22:40:59.442 INFO:tasks.workunit.client.0.smithi033.stdout:4/882: read d8/d16/d97/dbf/fdf [777792,58577] 0 2024-02-15T22:40:59.442 INFO:tasks.workunit.client.0.smithi033.stdout:4/883: chown d8/d16/l41 569387240 1 2024-02-15T22:40:59.442 INFO:tasks.workunit.client.0.smithi033.stdout:5/872: dread d6/d14/d31/d48/d56/f5b [0,4194304] 0 2024-02-15T22:40:59.446 INFO:tasks.workunit.client.0.smithi033.stdout:3/879: dread d0/d1c/f6b [0,4194304] 0 2024-02-15T22:40:59.447 INFO:tasks.workunit.client.0.smithi033.stdout:3/880: creat d0/d91/f118 x:0 0 0 2024-02-15T22:40:59.447 INFO:tasks.workunit.client.0.smithi033.stdout:3/881: fsync d0/d3/d2c/d5d/d3d/d57/d68/dac/fc1 0 2024-02-15T22:40:59.447 INFO:tasks.workunit.client.0.smithi033.stdout:9/851: link d4/d1d/d23/d24/d51/d5d/d90/f10c d4/d1d/daf/dba/f111 0 2024-02-15T22:40:59.451 INFO:tasks.workunit.client.0.smithi033.stdout:4/884: symlink d8/d16/d51/d1c/d96/l120 0 2024-02-15T22:40:59.453 INFO:tasks.workunit.client.0.smithi033.stdout:5/873: link d6/d25/le1 d6/d14/d31/d48/d49/d53/l119 0 2024-02-15T22:40:59.453 INFO:tasks.workunit.client.0.smithi033.stdout:5/874: fdatasync d6/d14/d31/d38/d9b/dd3/d7a/fc5 0 2024-02-15T22:40:59.454 INFO:tasks.workunit.client.0.smithi033.stdout:1/877: write d1/d96/fad [29062,34114] 0 2024-02-15T22:40:59.455 INFO:tasks.workunit.client.0.smithi033.stdout:2/964: dwrite d1/d16/d5a/f91 [0,4194304] 0 2024-02-15T22:40:59.455 INFO:tasks.workunit.client.0.smithi033.stdout:1/878: dread d1/d20/fd4 [0,4194304] 0 2024-02-15T22:40:59.456 INFO:tasks.workunit.client.0.smithi033.stdout:7/862: dwrite d5/d6/f7 [0,4194304] 0 2024-02-15T22:40:59.456 INFO:tasks.workunit.client.0.smithi033.stdout:7/863: write d5/dc/d5f/d8b/da1/f53 [1339590,115053] 0 2024-02-15T22:40:59.458 INFO:tasks.workunit.client.0.smithi033.stdout:9/852: rename d4/fc to d4/d1d/d83/f112 0 2024-02-15T22:40:59.459 INFO:tasks.workunit.client.0.smithi033.stdout:5/875: mkdir d6/db0/d70/d11a 0 2024-02-15T22:40:59.465 INFO:tasks.workunit.client.0.smithi033.stdout:1/879: rmdir d1/de/d27/d39/ddb/de1/d2d/d36/d8b 39 2024-02-15T22:40:59.469 INFO:tasks.workunit.client.0.smithi033.stdout:4/885: rename d8/d16/d51/d1c/db9/d37/d31/d47/d112/d8f to d8/d16/d51/d1c/db9/d37/d31/d47/d85/d121 0 2024-02-15T22:40:59.470 INFO:tasks.workunit.client.0.smithi033.stdout:5/876: symlink d6/d14/d31/dce/l11b 0 2024-02-15T22:40:59.470 INFO:tasks.workunit.client.0.smithi033.stdout:5/877: write d6/d14/d31/d48/d49/d53/d57/f8c [2734993,75110] 0 2024-02-15T22:40:59.471 INFO:tasks.workunit.client.0.smithi033.stdout:2/965: dwrite d1/d16/d5a/f7b [0,4194304] 0 2024-02-15T22:40:59.472 INFO:tasks.workunit.client.0.smithi033.stdout:1/880: unlink d1/de/d27/d39/d3a/dae/fb8 0 2024-02-15T22:40:59.473 INFO:tasks.workunit.client.0.smithi033.stdout:1/881: write d1/d20/d42/d25/f60 [1625505,41901] 0 2024-02-15T22:40:59.475 INFO:tasks.workunit.client.0.smithi033.stdout:7/864: rename d5/d6/d107 to d5/df/d56/d7f/d124 0 2024-02-15T22:40:59.477 INFO:tasks.workunit.client.0.smithi033.stdout:4/886: mkdir d8/d16/d51/d1c/d3c/d49/dac/d122 0 2024-02-15T22:40:59.477 INFO:tasks.workunit.client.0.smithi033.stdout:4/887: write d8/d16/d51/d1c/db9/d37/d31/f42 [2366279,16340] 0 2024-02-15T22:40:59.479 INFO:tasks.workunit.client.0.smithi033.stdout:5/878: mknod d6/d14/d31/d50/c11c 0 2024-02-15T22:40:59.480 INFO:tasks.workunit.client.0.smithi033.stdout:5/879: chown d6/c12 0 1 2024-02-15T22:40:59.481 INFO:tasks.workunit.client.0.smithi033.stdout:1/882: mkdir d1/d20/d42/d101 0 2024-02-15T22:40:59.485 INFO:tasks.workunit.client.0.smithi033.stdout:9/853: rename d4/d1d/d23/d32/da7/d109 to d4/d1d/daf/dba/d113 0 2024-02-15T22:40:59.485 INFO:tasks.workunit.client.0.smithi033.stdout:9/854: truncate d4/d1d/dd2/ded/d3f/fb1 4411381 0 2024-02-15T22:40:59.485 INFO:tasks.workunit.client.0.smithi033.stdout:9/855: write d4/d1d/d23/fe3 [4597526,48459] 0 2024-02-15T22:40:59.486 INFO:tasks.workunit.client.0.smithi033.stdout:7/865: mkdir d5/d6/d125 0 2024-02-15T22:40:59.486 INFO:tasks.workunit.client.0.smithi033.stdout:7/866: chown d5/df/d56/d99/cc3 63251555 1 2024-02-15T22:40:59.486 INFO:tasks.workunit.client.0.smithi033.stdout:7/867: truncate d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/fd5 534965 0 2024-02-15T22:40:59.487 INFO:tasks.workunit.client.0.smithi033.stdout:4/888: creat d8/d16/d51/d56/f123 x:0 0 0 2024-02-15T22:40:59.488 INFO:tasks.workunit.client.0.smithi033.stdout:4/889: read d8/d16/d51/d1c/db9/d37/d31/d80/fe7 [450452,66482] 0 2024-02-15T22:40:59.489 INFO:tasks.workunit.client.0.smithi033.stdout:7/868: dread d5/dc/d5f/d8b/da1/f53 [0,4194304] 0 2024-02-15T22:40:59.490 INFO:tasks.workunit.client.0.smithi033.stdout:5/880: creat d6/d14/d31/d38/d9b/dd3/f11d x:0 0 0 2024-02-15T22:40:59.491 INFO:tasks.workunit.client.0.smithi033.stdout:8/811: write d1/de/d1a/d2a/f3c [1319378,102033] 0 2024-02-15T22:40:59.491 INFO:tasks.workunit.client.0.smithi033.stdout:8/812: read - d1/d68/d44/d49/ffa zero size 2024-02-15T22:40:59.491 INFO:tasks.workunit.client.0.smithi033.stdout:8/813: creat d1/de/d1a/d27/ddf/de6/df7/f121 x:0 0 0 2024-02-15T22:40:59.491 INFO:tasks.workunit.client.0.smithi033.stdout:8/814: fdatasync d1/d68/d57/df2/f104 0 2024-02-15T22:40:59.495 INFO:tasks.workunit.client.0.smithi033.stdout:9/856: rmdir d4/d1d/d23/d32/da7 39 2024-02-15T22:40:59.495 INFO:tasks.workunit.client.0.smithi033.stdout:3/882: write d0/d3/d3b/f71 [1313724,27214] 0 2024-02-15T22:40:59.498 INFO:tasks.workunit.client.0.smithi033.stdout:7/869: dread d5/d6/d10/f6d [0,4194304] 0 2024-02-15T22:40:59.503 INFO:tasks.workunit.client.0.smithi033.stdout:4/890: getdents d8/dd9 0 2024-02-15T22:40:59.503 INFO:tasks.workunit.client.0.smithi033.stdout:4/891: read - d8/d16/d51/d1c/db9/d37/d23/d61/df3/f105 zero size 2024-02-15T22:40:59.503 INFO:tasks.workunit.client.0.smithi033.stdout:4/892: fdatasync d8/d16/d51/d1c/db9/d37/f5f 0 2024-02-15T22:40:59.504 INFO:tasks.workunit.client.0.smithi033.stdout:5/881: mknod d6/d14/d31/d48/d56/def/c11e 0 2024-02-15T22:40:59.507 INFO:tasks.workunit.client.0.smithi033.stdout:8/815: mkdir d1/d74/dc1/d75/db1/db5/d122 0 2024-02-15T22:40:59.508 INFO:tasks.workunit.client.0.smithi033.stdout:2/966: rmdir d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/de8 39 2024-02-15T22:40:59.511 INFO:tasks.workunit.client.0.smithi033.stdout:9/857: mknod d4/d1d/dd2/ded/d3f/d10e/c114 0 2024-02-15T22:40:59.513 INFO:tasks.workunit.client.0.smithi033.stdout:7/870: link d5/f9b d5/dc/f126 0 2024-02-15T22:40:59.515 INFO:tasks.workunit.client.0.smithi033.stdout:5/882: mknod d6/d14/d31/d48/d49/d53/d57/da1/c11f 0 2024-02-15T22:40:59.515 INFO:tasks.workunit.client.0.smithi033.stdout:4/893: write d8/d16/d51/d1c/db9/d37/d23/d61/ff2 [2932926,13905] 0 2024-02-15T22:40:59.516 INFO:tasks.workunit.client.0.smithi033.stdout:8/816: mkdir d1/de/d1a/d27/ddf/de6/df7/d123 0 2024-02-15T22:40:59.517 INFO:tasks.workunit.client.0.smithi033.stdout:9/858: rmdir d4/d1d/dd2/ded/d3f/d94/d9c/df8 0 2024-02-15T22:40:59.517 INFO:tasks.workunit.client.0.smithi033.stdout:3/883: dwrite d0/d91/f105 [0,4194304] 0 2024-02-15T22:40:59.519 INFO:tasks.workunit.client.0.smithi033.stdout:7/871: creat d5/d6/d10/f127 x:0 0 0 2024-02-15T22:40:59.519 INFO:tasks.workunit.client.0.smithi033.stdout:7/872: fsync d5/dc/d5f/d8b/da0/dc6/dcd/fb3 0 2024-02-15T22:40:59.521 INFO:tasks.workunit.client.0.smithi033.stdout:5/883: creat d6/d14/d31/dce/f120 x:0 0 0 2024-02-15T22:40:59.524 INFO:tasks.workunit.client.0.smithi033.stdout:8/817: mkdir d1/de/d1a/d2a/d124 0 2024-02-15T22:40:59.524 INFO:tasks.workunit.client.0.smithi033.stdout:8/818: creat d1/d74/dc1/d75/dbf/d79/f125 x:0 0 0 2024-02-15T22:40:59.525 INFO:tasks.workunit.client.0.smithi033.stdout:2/967: dread d1/d8/d2b/d2f/d13/da9/f63 [0,4194304] 0 2024-02-15T22:40:59.525 INFO:tasks.workunit.client.0.smithi033.stdout:8/819: dread d1/d68/d1d/d4a/f93 [0,4194304] 0 2024-02-15T22:40:59.525 INFO:tasks.workunit.client.0.smithi033.stdout:9/859: creat d4/d1d/dd2/ded/d3f/f115 x:0 0 0 2024-02-15T22:40:59.525 INFO:tasks.workunit.client.0.smithi033.stdout:8/820: dread d1/d74/dc1/d75/d83/fa9 [0,4194304] 0 2024-02-15T22:40:59.527 INFO:tasks.workunit.client.0.smithi033.stdout:7/873: link d5/dc/d5f/f11a d5/d6/d10/d100/f128 0 2024-02-15T22:40:59.530 INFO:tasks.workunit.client.0.smithi033.stdout:3/884: dwrite d0/d3/d2c/d43/f75 [0,4194304] 0 2024-02-15T22:40:59.530 INFO:tasks.workunit.client.0.smithi033.stdout:3/885: write d0/d3/f41 [843420,61582] 0 2024-02-15T22:40:59.530 INFO:tasks.workunit.client.0.smithi033.stdout:3/886: chown d0/d3/dd/lce 1730728 1 2024-02-15T22:40:59.530 INFO:tasks.workunit.client.0.smithi033.stdout:3/887: chown d0/d3/d2c/d5d/fd2 1018 1 2024-02-15T22:40:59.531 INFO:tasks.workunit.client.0.smithi033.stdout:2/968: unlink d1/d8/d2b/d2f/d12/c11e 0 2024-02-15T22:40:59.533 INFO:tasks.workunit.client.0.smithi033.stdout:9/860: rename d4/d1d/daf to d4/d1d/d23/d24/d51/d5d/d90/d116 0 2024-02-15T22:40:59.533 INFO:tasks.workunit.client.0.smithi033.stdout:2/969: rename d1 to d1/d16/d3f/df5/dfb/d132 22 2024-02-15T22:40:59.534 INFO:tasks.workunit.client.0.smithi033.stdout:8/821: rmdir d1/d74/dc1/d75/db1/db5/dfb 39 2024-02-15T22:40:59.534 INFO:tasks.workunit.client.0.smithi033.stdout:8/822: dread - d1/de/d5c/f109 zero size 2024-02-15T22:40:59.536 INFO:tasks.workunit.client.0.smithi033.stdout:7/874: getdents d5/dc/d5f/d8b/da1/d26 0 2024-02-15T22:40:59.546 INFO:tasks.workunit.client.0.smithi033.stdout:3/888: creat d0/d3/d2c/d5d/d3d/d8f/dcf/f119 x:0 0 0 2024-02-15T22:40:59.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/884: rmdir d6/d14/d31/d48/d49/d53 39 2024-02-15T22:40:59.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/885: creat d6/d14/d31/d50/d5c/f121 x:0 0 0 2024-02-15T22:40:59.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/886: write d6/d14/d31/d38/f10a [195312,82215] 0 2024-02-15T22:40:59.547 INFO:tasks.workunit.client.0.smithi033.stdout:2/970: creat d1/d8/d2b/d2f/d13/da9/d8d/f133 x:0 0 0 2024-02-15T22:40:59.547 INFO:tasks.workunit.client.0.smithi033.stdout:2/971: dread - d1/d8/fce zero size 2024-02-15T22:40:59.547 INFO:tasks.workunit.client.0.smithi033.stdout:2/972: dread - d1/d8/d2b/d2f/d13/d6f/db5/fcf zero size 2024-02-15T22:40:59.548 INFO:tasks.workunit.client.0.smithi033.stdout:7/875: mknod d5/dc/d5f/d8b/da0/dc6/de4/de5/c129 0 2024-02-15T22:40:59.553 INFO:tasks.workunit.client.0.smithi033.stdout:2/973: mkdir d1/d8/d2b/d2f/d13/da9/d8d/d134 0 2024-02-15T22:40:59.553 INFO:tasks.workunit.client.0.smithi033.stdout:2/974: truncate d1/d8/d2b/d2f/d24/d2a/d88/f126 237403 0 2024-02-15T22:40:59.554 INFO:tasks.workunit.client.0.smithi033.stdout:7/876: mknod d5/dc/d5f/d8b/da0/c12a 0 2024-02-15T22:40:59.556 INFO:tasks.workunit.client.0.smithi033.stdout:2/975: rename d1/d8/d2b/d2f/d13/d6f/db5/c11c to d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/d62/dfe/c135 0 2024-02-15T22:40:59.556 INFO:tasks.workunit.client.0.smithi033.stdout:2/976: creat d1/d8/d2b/d2f/d13/d6f/db5/f136 x:0 0 0 2024-02-15T22:40:59.558 INFO:tasks.workunit.client.0.smithi033.stdout:7/877: unlink d5/c10e 0 2024-02-15T22:40:59.558 INFO:tasks.workunit.client.0.smithi033.stdout:7/878: write d5/df/fad [166440,70488] 0 2024-02-15T22:40:59.558 INFO:tasks.workunit.client.0.smithi033.stdout:9/861: dwrite d4/d1d/dd2/ded/d3f/fb1 [0,4194304] 0 2024-02-15T22:40:59.561 INFO:tasks.workunit.client.0.smithi033.stdout:2/977: creat d1/d16/d57/f137 x:0 0 0 2024-02-15T22:40:59.561 INFO:tasks.workunit.client.0.smithi033.stdout:8/823: dwrite d1/d74/dc1/d75/d83/f120 [0,4194304] 0 2024-02-15T22:40:59.562 INFO:tasks.workunit.client.0.smithi033.stdout:3/889: dwrite d0/d3/d5f/da7/fed [0,4194304] 0 2024-02-15T22:40:59.562 INFO:tasks.workunit.client.0.smithi033.stdout:3/890: chown d0/lb2 89011935 1 2024-02-15T22:40:59.562 INFO:tasks.workunit.client.0.smithi033.stdout:3/891: chown d0/d3/d2c/d5d/d3d/d57/d68/dac 40 1 2024-02-15T22:40:59.562 INFO:tasks.workunit.client.0.smithi033.stdout:3/892: dread - d0/d91/f118 zero size 2024-02-15T22:40:59.563 INFO:tasks.workunit.client.0.smithi033.stdout:5/887: dread d6/d14/d31/d48/f5e [0,4194304] 0 2024-02-15T22:40:59.563 INFO:tasks.workunit.client.0.smithi033.stdout:7/879: symlink d5/df/d40/d73/dd2/l12b 0 2024-02-15T22:40:59.569 INFO:tasks.workunit.client.0.smithi033.stdout:8/824: mkdir d1/dae/d126 0 2024-02-15T22:40:59.569 INFO:tasks.workunit.client.0.smithi033.stdout:8/825: fsync d1/d74/dc1/d75/db1/db5/dfb/d14/fb7 0 2024-02-15T22:40:59.574 INFO:tasks.workunit.client.0.smithi033.stdout:5/888: rename d6/d14/d31/d48/d49/d53/d57/c74 to d6/d14/df5/c122 0 2024-02-15T22:40:59.576 INFO:tasks.workunit.client.0.smithi033.stdout:7/880: rmdir d5/dc/d5f/d8b/de1/dfb/d113 0 2024-02-15T22:40:59.577 INFO:tasks.workunit.client.0.smithi033.stdout:3/893: rmdir d0/d3/d2c/d5d/d3d/db4 39 2024-02-15T22:40:59.579 INFO:tasks.workunit.client.0.smithi033.stdout:3/894: getdents d0/d3/d2c/d5d/d3d/d57/d68/dc2 0 2024-02-15T22:40:59.580 INFO:tasks.workunit.client.0.smithi033.stdout:3/895: mknod d0/d3/d3b/d47/c11a 0 2024-02-15T22:40:59.582 INFO:tasks.workunit.client.0.smithi033.stdout:3/896: mkdir d0/d3/d2c/d5d/d3d/d8f/d93/d100/d11b 0 2024-02-15T22:40:59.582 INFO:tasks.workunit.client.0.smithi033.stdout:3/897: creat d0/d3/d2c/d5d/d3d/d8f/dcf/f11c x:0 0 0 2024-02-15T22:40:59.582 INFO:tasks.workunit.client.0.smithi033.stdout:3/898: chown d0/d3/d3b/f71 717 1 2024-02-15T22:40:59.582 INFO:tasks.workunit.client.0.smithi033.stdout:3/899: dread - d0/d91/f118 zero size 2024-02-15T22:40:59.586 INFO:tasks.workunit.client.0.smithi033.stdout:4/894: dwrite d8/d16/d51/d1c/db9/d37/d31/f34 [0,4194304] 0 2024-02-15T22:40:59.588 INFO:tasks.workunit.client.0.smithi033.stdout:4/895: getdents d8/d16/d97/dbf 0 2024-02-15T22:40:59.588 INFO:tasks.workunit.client.0.smithi033.stdout:4/896: chown d8/d16/d51/d1c/d3c/d3f/l79 40642386 1 2024-02-15T22:40:59.589 INFO:tasks.workunit.client.0.smithi033.stdout:5/889: write d6/d14/f6b [2113057,4117] 0 2024-02-15T22:40:59.596 INFO:tasks.workunit.client.0.smithi033.stdout:2/978: dwrite d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f9c [0,4194304] 0 2024-02-15T22:40:59.596 INFO:tasks.workunit.client.0.smithi033.stdout:9/862: dwrite d4/d1d/dd2/ded/fd7 [4194304,4194304] 0 2024-02-15T22:40:59.596 INFO:tasks.workunit.client.0.smithi033.stdout:9/863: stat d4/d1d/f2c 0 2024-02-15T22:40:59.599 INFO:tasks.workunit.client.0.smithi033.stdout:2/979: mkdir d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/de8/d10a/d138 0 2024-02-15T22:40:59.601 INFO:tasks.workunit.client.0.smithi033.stdout:8/826: dwrite d1/d74/dc1/d75/d83/f120 [0,4194304] 0 2024-02-15T22:40:59.603 INFO:tasks.workunit.client.0.smithi033.stdout:2/980: rename d1/d16/d5a/f113 to d1/d8/d2b/d2f/d24/d2a/f139 0 2024-02-15T22:40:59.605 INFO:tasks.workunit.client.0.smithi033.stdout:8/827: rmdir d1/de/d1a/d2a/d40/d11b 39 2024-02-15T22:40:59.606 INFO:tasks.workunit.client.0.smithi033.stdout:8/828: mknod d1/d74/dc1/d75/db1/db5/dfb/d14/c127 0 2024-02-15T22:40:59.609 INFO:tasks.workunit.client.0.smithi033.stdout:8/829: symlink d1/d74/dc1/d75/db1/db5/dfb/l128 0 2024-02-15T22:40:59.615 INFO:tasks.workunit.client.0.smithi033.stdout:2/981: dread d1/d8/d2b/d2f/d24/d31/f3e [0,4194304] 0 2024-02-15T22:40:59.615 INFO:tasks.workunit.client.0.smithi033.stdout:2/982: read d1/f48 [111685,7722] 0 2024-02-15T22:40:59.616 INFO:tasks.workunit.client.0.smithi033.stdout:2/983: mknod d1/d8/d2b/d2f/d13/d6f/db5/c13a 0 2024-02-15T22:40:59.616 INFO:tasks.workunit.client.0.smithi033.stdout:2/984: fsync d1/d16/d3f/fd7 0 2024-02-15T22:40:59.618 INFO:tasks.workunit.client.0.smithi033.stdout:7/881: dwrite d5/d6/d10/d100/f128 [0,4194304] 0 2024-02-15T22:40:59.618 INFO:tasks.workunit.client.0.smithi033.stdout:4/897: dwrite d8/d16/d51/d1c/db9/d37/f40 [0,4194304] 0 2024-02-15T22:40:59.619 INFO:tasks.workunit.client.0.smithi033.stdout:2/985: dread d1/d16/d5a/fea [0,4194304] 0 2024-02-15T22:40:59.619 INFO:tasks.workunit.client.0.smithi033.stdout:5/890: dwrite d6/db0/d70/f78 [0,4194304] 0 2024-02-15T22:40:59.622 INFO:tasks.workunit.client.0.smithi033.stdout:5/891: dread d6/d25/f55 [0,4194304] 0 2024-02-15T22:40:59.622 INFO:tasks.workunit.client.0.smithi033.stdout:5/892: fsync d6/f42 0 2024-02-15T22:40:59.622 INFO:tasks.workunit.client.0.smithi033.stdout:3/900: dwrite d0/f56 [0,4194304] 0 2024-02-15T22:40:59.622 INFO:tasks.workunit.client.0.smithi033.stdout:8/830: dread d1/de/d5c/f7e [0,4194304] 0 2024-02-15T22:40:59.623 INFO:tasks.workunit.client.0.smithi033.stdout:7/882: mkdir d5/dc/d5f/d8b/de1/d12c 0 2024-02-15T22:40:59.626 INFO:tasks.workunit.client.0.smithi033.stdout:4/898: symlink d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/l124 0 2024-02-15T22:40:59.630 INFO:tasks.workunit.client.0.smithi033.stdout:2/986: mkdir d1/d8/d2b/d2f/d13/da9/d13b 0 2024-02-15T22:40:59.636 INFO:tasks.workunit.client.0.smithi033.stdout:5/893: creat d6/d14/d31/d38/d9b/dd2/f123 x:0 0 0 2024-02-15T22:40:59.636 INFO:tasks.workunit.client.0.smithi033.stdout:5/894: chown d6/d14/d31/d50/d6a/daf 12286 1 2024-02-15T22:40:59.636 INFO:tasks.workunit.client.0.smithi033.stdout:5/895: readlink d6/d14/d31/d48/d49/d53/d57/l110 0 2024-02-15T22:40:59.636 INFO:tasks.workunit.client.0.smithi033.stdout:4/899: symlink d8/d69/l125 0 2024-02-15T22:40:59.649 INFO:tasks.workunit.client.0.smithi033.stdout:5/896: dread d6/d14/d31/d50/d5c/f97 [0,4194304] 0 2024-02-15T22:40:59.650 INFO:tasks.workunit.client.0.smithi033.stdout:5/897: creat d6/d25/df4/f124 x:0 0 0 2024-02-15T22:40:59.651 INFO:tasks.workunit.client.0.smithi033.stdout:5/898: mkdir d6/db0/d70/d125 0 2024-02-15T22:40:59.657 INFO:tasks.workunit.client.0.smithi033.stdout:5/899: mkdir d6/d14/d31/d48/d49/d53/d57/d126 0 2024-02-15T22:40:59.658 INFO:tasks.workunit.client.0.smithi033.stdout:5/900: stat d6/d14/d31/d48/d56/d90/cd1 0 2024-02-15T22:40:59.658 INFO:tasks.workunit.client.0.smithi033.stdout:5/901: write d6/feb [954630,53743] 0 2024-02-15T22:40:59.659 INFO:tasks.workunit.client.0.smithi033.stdout:3/901: dwrite d0/d3/dd/f99 [4194304,4194304] 0 2024-02-15T22:40:59.659 INFO:tasks.workunit.client.0.smithi033.stdout:5/902: mkdir d6/d14/d31/d38/d9b/dd3/d7a/db9/d101/d127 0 2024-02-15T22:40:59.660 INFO:tasks.workunit.client.0.smithi033.stdout:7/883: dwrite d5/df/d56/d60/d59/f62 [0,4194304] 0 2024-02-15T22:40:59.660 INFO:tasks.workunit.client.0.smithi033.stdout:4/900: dwrite d8/d16/d51/d1c/db9/fbd [0,4194304] 0 2024-02-15T22:40:59.661 INFO:tasks.workunit.client.0.smithi033.stdout:7/884: creat d5/dc/d5f/d8b/da0/dc6/de4/df5/f12d x:0 0 0 2024-02-15T22:40:59.665 INFO:tasks.workunit.client.0.smithi033.stdout:7/885: rename d5/l82 to d5/df/d56/d7f/d124/l12e 0 2024-02-15T22:40:59.665 INFO:tasks.workunit.client.0.smithi033.stdout:7/886: write d5/dc/d5f/f75 [567852,51572] 0 2024-02-15T22:40:59.668 INFO:tasks.workunit.client.0.smithi033.stdout:7/887: symlink d5/df/d40/d89/l12f 0 2024-02-15T22:40:59.668 INFO:tasks.workunit.client.0.smithi033.stdout:7/888: stat d5/df/f44 0 2024-02-15T22:40:59.668 INFO:tasks.workunit.client.0.smithi033.stdout:7/889: stat d5/dc/d5f/d8b/da0/dc6/de4/de9 0 2024-02-15T22:40:59.668 INFO:tasks.workunit.client.0.smithi033.stdout:7/890: fdatasync d5/dc/d5f/d8b/da0/dc6/de4/df5/f12d 0 2024-02-15T22:40:59.670 INFO:tasks.workunit.client.0.smithi033.stdout:5/903: read d6/db0/d70/f78 [2623482,107485] 0 2024-02-15T22:40:59.671 INFO:tasks.workunit.client.0.smithi033.stdout:7/891: link d5/df/d40/fdb d5/dc/d5f/d8b/da0/dc6/dcd/f130 0 2024-02-15T22:40:59.671 INFO:tasks.workunit.client.0.smithi033.stdout:7/892: stat d5/df/d56/d60/d59/d9c/da6 0 2024-02-15T22:40:59.671 INFO:tasks.workunit.client.0.smithi033.stdout:7/893: fdatasync d5/dc/d5f/d8b/da1/d26/d3f/f11e 0 2024-02-15T22:40:59.674 INFO:tasks.workunit.client.0.smithi033.stdout:7/894: symlink d5/d6/d10/l131 0 2024-02-15T22:40:59.680 INFO:tasks.workunit.client.0.smithi033.stdout:4/901: dwrite d8/d69/f9c [0,4194304] 0 2024-02-15T22:40:59.680 INFO:tasks.workunit.client.0.smithi033.stdout:4/902: chown d8/d16/d51/d1c/db9/d37/d31 42418 1 2024-02-15T22:40:59.681 INFO:tasks.workunit.client.0.smithi033.stdout:7/895: dread d5/df/d40/fdb [0,4194304] 0 2024-02-15T22:40:59.689 INFO:tasks.workunit.client.0.smithi033.stdout:2/987: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:40:59.690 INFO:tasks.workunit.client.0.smithi033.stdout:2/988: rmdir d1/d8/d2b/d2f/d13/d59/d76/d118/d11b 39 2024-02-15T22:40:59.693 INFO:tasks.workunit.client.0.smithi033.stdout:2/989: truncate d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/db0/f9c 3592117 0 2024-02-15T22:40:59.693 INFO:tasks.workunit.client.0.smithi033.stdout:2/990: stat d1/d16/d3f/lad 0 2024-02-15T22:40:59.697 INFO:tasks.workunit.client.0.smithi033.stdout:2/991: dread d1/d8/d2b/d2f/d12/d52/f125 [4194304,4194304] 0 2024-02-15T22:40:59.707 INFO:tasks.workunit.client.0.smithi033.stdout:2/992: dread d1/d8/d2b/d2f/d24/d2a/d88/d8e/df3/f95 [0,4194304] 0 2024-02-15T22:40:59.715 INFO:tasks.workunit.client.0.smithi033.stdout:4/903: dwrite d8/d16/d51/d1c/db9/d37/d31/f42 [0,4194304] 0 2024-02-15T22:40:59.715 INFO:tasks.workunit.client.0.smithi033.stdout:7/896: dwrite d5/dc/d5f/d8b/da1/d26/fd9 [0,4194304] 0 2024-02-15T22:40:59.715 INFO:tasks.workunit.client.0.smithi033.stdout:7/897: fsync d5/df/d56/d84/fca 0 2024-02-15T22:40:59.715 INFO:tasks.workunit.client.0.smithi033.stdout:5/904: dwrite d6/d14/d31/d38/f72 [0,4194304] 0 2024-02-15T22:40:59.717 INFO:tasks.workunit.client.0.smithi033.stdout:4/904: creat d8/d16/d51/d1c/d3c/d49/f126 x:0 0 0 2024-02-15T22:40:59.717 INFO:tasks.workunit.client.0.smithi033.stdout:4/905: dread - d8/d16/d51/d1c/db9/d37/d23/d61/df3/f118 zero size 2024-02-15T22:40:59.719 INFO:tasks.workunit.client.0.smithi033.stdout:7/898: mkdir d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/d132 0 2024-02-15T22:40:59.721 INFO:tasks.workunit.client.0.smithi033.stdout:7/899: getdents d5/df/d56/d99 0 2024-02-15T22:40:59.721 INFO:tasks.workunit.client.0.smithi033.stdout:7/900: read d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/fd5 [303060,37333] 0 2024-02-15T22:40:59.723 INFO:tasks.workunit.client.0.smithi033.stdout:7/901: mknod d5/dc/d5f/d8b/da0/dc6/de4/de5/c133 0 2024-02-15T22:40:59.724 INFO:tasks.workunit.client.0.smithi033.stdout:7/902: symlink d5/df/d56/d84/l134 0 2024-02-15T22:40:59.725 INFO:tasks.workunit.client.0.smithi033.stdout:7/903: truncate d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/f7c 4595203 0 2024-02-15T22:40:59.727 INFO:tasks.workunit.client.0.smithi033.stdout:7/904: creat d5/dc/d5f/d8b/da0/dc6/de4/f135 x:0 0 0 2024-02-15T22:40:59.727 INFO:tasks.workunit.client.0.smithi033.stdout:7/905: fdatasync d5/df/d56/d60/d59/f85 0 2024-02-15T22:40:59.727 INFO:tasks.workunit.client.0.smithi033.stdout:7/906: readlink d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/lfc 0 2024-02-15T22:40:59.731 INFO:tasks.workunit.client.0.smithi033.stdout:5/905: dread d6/d14/d31/d50/d5c/f9e [0,4194304] 0 2024-02-15T22:40:59.731 INFO:tasks.workunit.client.0.smithi033.stdout:5/906: chown d6/d14/d31/d38/d9b/dd2 1014728 1 2024-02-15T22:40:59.731 INFO:tasks.workunit.client.0.smithi033.stdout:5/907: stat d6/db0/f108 0 2024-02-15T22:40:59.731 INFO:tasks.workunit.client.0.smithi033.stdout:5/908: dread - d6/db0/f108 zero size 2024-02-15T22:40:59.732 INFO:tasks.workunit.client.0.smithi033.stdout:5/909: chown d6/d14/d31/d50/d6a/cb2 2966206 1 2024-02-15T22:40:59.732 INFO:tasks.workunit.client.0.smithi033.stdout:5/910: write d6/d14/d31/dce/f120 [911669,41531] 0 2024-02-15T22:40:59.734 INFO:tasks.workunit.client.0.smithi033.stdout:4/906: dwrite d8/d16/d51/d1c/db9/d37/d23/f5b [0,4194304] 0 2024-02-15T22:40:59.734 INFO:tasks.workunit.client.0.smithi033.stdout:4/907: fsync d8/d16/d51/d56/f123 0 2024-02-15T22:40:59.738 INFO:tasks.workunit.client.0.smithi033.stdout:4/908: dread d8/d16/d51/d56/f8d [0,4194304] 0 2024-02-15T22:40:59.739 INFO:tasks.workunit.client.0.smithi033.stdout:4/909: creat d8/d16/d51/d1c/db9/d37/dbe/f127 x:0 0 0 2024-02-15T22:40:59.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/910: rename d8/d16/d51/d1c/db9/d37/d31/da5/da9/fe2 to d8/dc5/f128 0 2024-02-15T22:40:59.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/911: write d8/d16/d51/d1c/d3c/d49/fee [881874,47385] 0 2024-02-15T22:40:59.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/912: fsync d8/d16/d51/d56/f8d 0 2024-02-15T22:40:59.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/913: dread d8/d16/d51/d1c/d50/da1/dc1/ffb [0,4194304] 0 2024-02-15T22:40:59.743 INFO:tasks.workunit.client.0.smithi033.stdout:4/914: fsync d8/d16/d51/d1c/db9/d37/d31/f42 0 2024-02-15T22:40:59.753 INFO:tasks.workunit.client.0.smithi033.stdout:7/907: dwrite d5/dc/d5f/d8b/da0/dc6/de4/de5/d7b/db1/fe0 [0,4194304] 0 2024-02-15T22:40:59.755 INFO:tasks.workunit.client.0.smithi033.stdout:5/911: dwrite d6/d25/d99/fa4 [0,4194304] 0 2024-02-15T22:40:59.764 INFO:tasks.workunit.client.0.smithi033.stdout:7/908: rename d5/dc/d5f/d8b to d5/df/d40/d136 0 2024-02-15T22:40:59.764 INFO:tasks.workunit.client.0.smithi033.stdout:5/912: dread d6/d14/d31/d38/d9b/f115 [0,4194304] 0 2024-02-15T22:40:59.768 INFO:tasks.workunit.client.0.smithi033.stdout:4/915: dwrite d8/d16/d51/d1c/db9/d37/d23/d61/df3/f118 [0,4194304] 0 2024-02-15T22:40:59.768 INFO:tasks.workunit.client.0.smithi033.stdout:4/916: chown d8/d16/d51/d1c/db9/d37/d31/f48 23770 1 2024-02-15T22:40:59.778 INFO:tasks.workunit.client.0.smithi033.stdout:4/917: symlink d8/d16/d97/dbf/l129 0 2024-02-15T22:40:59.781 INFO:tasks.workunit.client.0.smithi033.stdout:4/918: rename d8/d16/d51/d1c/db9/d37/d31/da5/da9 to d8/d16/d51/d27/d12a 0 2024-02-15T22:40:59.783 INFO:tasks.workunit.client.0.smithi033.stdout:4/919: rename d8/d16/d51/d1c/d96/c109 to d8/d16/d51/c12b 0 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:5/913: dwrite d6/d14/d31/d48/f69 [0,4194304] 0 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:4/920: rename f4 to d8/d16/d51/d1c/db9/d37/dce/f12c 0 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:4/921: read - d8/f11c zero size 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:4/922: read d8/d16/d51/d1c/d3c/d49/f6b [105397,18666] 0 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:4/923: write d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/fdc [578326,83882] 0 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/909: dwrite d5/df/d56/f10f [0,4194304] 0 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/910: write d5/f18 [4393817,94963] 0 2024-02-15T22:40:59.785 INFO:tasks.workunit.client.0.smithi033.stdout:7/911: write d5/df/d40/d136/da0/dc6/de4/de9/f109 [4023581,31966] 0 2024-02-15T22:40:59.786 INFO:tasks.workunit.client.0.smithi033.stdout:7/912: fdatasync d5/df/d56/d84/fca 0 2024-02-15T22:40:59.787 INFO:tasks.workunit.client.0.smithi033.stdout:5/914: unlink d6/d14/d31/d38/d9b/f71 0 2024-02-15T22:40:59.787 INFO:tasks.workunit.client.0.smithi033.stdout:5/915: chown d6/d14/d31/d38/d9b/dd3/d7a/db9/lf1 1215357 1 2024-02-15T22:40:59.791 INFO:tasks.workunit.client.0.smithi033.stdout:4/924: mkdir d8/d16/d51/d1c/d3c/d3f/d12d 0 2024-02-15T22:40:59.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/913: mknod d5/df/d40/d136/da0/dc6/c137 0 2024-02-15T22:40:59.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/914: dread - d5/df/d40/d136/da0/dc6/dcd/f11d zero size 2024-02-15T22:40:59.793 INFO:tasks.workunit.client.0.smithi033.stdout:7/915: dread d5/df/f94 [0,4194304] 0 2024-02-15T22:40:59.793 INFO:tasks.workunit.client.0.smithi033.stdout:7/916: stat d5/df/d56/f6c 0 2024-02-15T22:40:59.793 INFO:tasks.workunit.client.0.smithi033.stdout:7/917: fsync d5/df/d40/d136/da0/dc6/de4/ff8 0 2024-02-15T22:40:59.795 INFO:tasks.workunit.client.0.smithi033.stdout:4/925: rename d8/l12 to d8/d16/d51/d1c/db9/d37/d31/da5/l12e 0 2024-02-15T22:40:59.798 INFO:tasks.workunit.client.0.smithi033.stdout:4/926: unlink d8/d16/d51/d56/f8d 0 2024-02-15T22:40:59.799 INFO:tasks.workunit.client.0.smithi033.stdout:4/927: stat d8/d16/d51/d1c/db9/d37/d31/d80 0 2024-02-15T22:40:59.800 INFO:tasks.workunit.client.0.smithi033.stdout:4/928: mknod d8/d16/d51/d56/c12f 0 2024-02-15T22:40:59.800 INFO:tasks.workunit.client.0.smithi033.stdout:4/929: write d8/d16/d51/d1c/d3c/d49/f62 [2367167,82686] 0 2024-02-15T22:40:59.801 INFO:tasks.workunit.client.0.smithi033.stdout:4/930: creat d8/d16/d51/d1c/d94/f130 x:0 0 0 2024-02-15T22:40:59.802 INFO:tasks.workunit.client.0.smithi033.stdout:4/931: stat d8/d16/d51/d1c/d94/fcc 0 2024-02-15T22:40:59.802 INFO:tasks.workunit.client.0.smithi033.stdout:4/932: creat d8/d16/f131 x:0 0 0 2024-02-15T22:40:59.803 INFO:tasks.workunit.client.0.smithi033.stdout:4/933: mkdir d8/d16/d51/d56/d132 0 2024-02-15T22:40:59.803 INFO:tasks.workunit.client.0.smithi033.stdout:4/934: creat d8/d16/d97/dbf/f133 x:0 0 0 2024-02-15T22:40:59.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/918: dwrite d5/df/d40/d136/da0/dc6/fed [0,4194304] 0 2024-02-15T22:40:59.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/919: write d5/df/d40/d136/da1/d26/fd9 [4882088,73668] 0 2024-02-15T22:40:59.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/920: write d5/df/d40/d136/da0/dc6/de4/f135 [1011273,56077] 0 2024-02-15T22:40:59.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/921: dread - d5/dc/f11b zero size 2024-02-15T22:40:59.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/922: chown d5/df/d56/d60 54490 1 2024-02-15T22:40:59.808 INFO:tasks.workunit.client.0.smithi033.stdout:7/923: symlink d5/dc/d5f/l138 0 2024-02-15T22:40:59.822 INFO:tasks.workunit.client.0.smithi033.stdout:0/735: sync 2024-02-15T22:40:59.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/736: unlink db/d19/dd8/ff2 0 2024-02-15T22:40:59.825 INFO:tasks.workunit.client.0.smithi033.stdout:0/737: link db/d19/l88 db/d2a/d6e/d7a/d95/dcd/lf7 0 2024-02-15T22:40:59.825 INFO:tasks.workunit.client.0.smithi033.stdout:0/738: link db/d19/d32/d46/ld1 db/d2a/d68/da9/lf8 0 2024-02-15T22:40:59.826 INFO:tasks.workunit.client.0.smithi033.stdout:0/739: mknod db/d2a/d6e/dc3/cf9 0 2024-02-15T22:40:59.826 INFO:tasks.workunit.client.0.smithi033.stdout:0/740: creat db/d19/d32/d46/daf/ffa x:0 0 0 2024-02-15T22:40:59.827 INFO:tasks.workunit.client.0.smithi033.stdout:0/741: mknod db/d2a/dc7/de6/de7/cfb 0 2024-02-15T22:40:59.832 INFO:tasks.workunit.client.0.smithi033.stdout:4/935: dwrite d8/d16/d51/f44 [0,4194304] 0 2024-02-15T22:40:59.832 INFO:tasks.workunit.client.0.smithi033.stdout:7/924: dwrite d5/df/d40/d136/da1/d26/d3f/f11e [0,4194304] 0 2024-02-15T22:40:59.832 INFO:tasks.workunit.client.0.smithi033.stdout:7/925: fsync d5/d6/d10/f34 0 2024-02-15T22:40:59.838 INFO:tasks.workunit.client.0.smithi033.stdout:4/936: dread d8/d16/d51/d1c/db9/f68 [0,4194304] 0 2024-02-15T22:40:59.839 INFO:tasks.workunit.client.0.smithi033.stdout:4/937: truncate d8/d16/d51/d1c/d3c/d49/dac/f103 324677 0 2024-02-15T22:40:59.842 INFO:tasks.workunit.client.0.smithi033.stdout:4/938: creat d8/d16/d51/d1c/d3c/d49/dac/dd5/f134 x:0 0 0 2024-02-15T22:40:59.842 INFO:tasks.workunit.client.0.smithi033.stdout:4/939: mkdir d8/d16/d106/d135 0 2024-02-15T22:40:59.843 INFO:tasks.workunit.client.0.smithi033.stdout:4/940: rename d8/d16/d51/d1c/d3c/c52 to d8/d16/d51/d1c/db9/d37/d31/d47/d112/db1/c136 0 2024-02-15T22:40:59.844 INFO:tasks.workunit.client.0.smithi033.stdout:4/941: symlink d8/d16/d51/d1c/db9/d37/d23/d61/d107/l137 0 2024-02-15T22:40:59.848 INFO:tasks.workunit.client.0.smithi033.stdout:0/742: dwrite db/d2a/d6e/dc3/fcb [0,4194304] 0 2024-02-15T22:40:59.848 INFO:tasks.workunit.client.0.smithi033.stdout:4/942: dread d8/d16/d51/d1c/db9/d37/fdb [0,4194304] 0 2024-02-15T22:40:59.851 INFO:tasks.workunit.client.0.smithi033.stdout:0/743: mknod db/d2a/dc7/de6/de7/cfc 0 2024-02-15T22:40:59.853 INFO:tasks.workunit.client.0.smithi033.stdout:7/926: dwrite d5/d6/f54 [0,4194304] 0 2024-02-15T22:40:59.855 INFO:tasks.workunit.client.0.smithi033.stdout:7/927: dread d5/dc/d5f/f75 [0,4194304] 0 2024-02-15T22:40:59.855 INFO:tasks.workunit.client.0.smithi033.stdout:7/928: write d5/df/d40/d73/dd2/fe2 [734430,89652] 0 2024-02-15T22:40:59.855 INFO:tasks.workunit.client.0.smithi033.stdout:4/943: creat d8/d16/d106/f138 x:0 0 0 2024-02-15T22:40:59.855 INFO:tasks.workunit.client.0.smithi033.stdout:7/929: readlink d5/df/d40/d136/da1/d26/d3f/ldf 0 2024-02-15T22:40:59.856 INFO:tasks.workunit.client.0.smithi033.stdout:0/744: mknod db/d19/d32/d43/cfd 0 2024-02-15T22:40:59.857 INFO:tasks.workunit.client.0.smithi033.stdout:4/944: mkdir d8/d16/d51/d1c/d3c/d3f/d12d/d139 0 2024-02-15T22:40:59.859 INFO:tasks.workunit.client.0.smithi033.stdout:7/930: creat d5/df/d40/f139 x:0 0 0 2024-02-15T22:40:59.862 INFO:tasks.workunit.client.0.smithi033.stdout:4/945: link d8/d16/d51/d27/f5e d8/d16/d51/f13a 0 2024-02-15T22:40:59.862 INFO:tasks.workunit.client.0.smithi033.stdout:4/946: fsync d8/d16/d51/d56/f123 0 2024-02-15T22:40:59.862 INFO:tasks.workunit.client.0.smithi033.stdout:4/947: stat d8/d16/c67 0 2024-02-15T22:40:59.863 INFO:tasks.workunit.client.0.smithi033.stdout:4/948: mkdir d8/d16/d51/d1c/d3c/d49/dac/dd5/d13b 0 2024-02-15T22:40:59.865 INFO:tasks.workunit.client.0.smithi033.stdout:7/931: rename d5/df/c4e to d5/df/d56/d60/d59/d9c/da6/c13a 0 2024-02-15T22:40:59.866 INFO:tasks.workunit.client.0.smithi033.stdout:4/949: getdents d8/d16/d51/d1c/db9/d37/d31/d47 0 2024-02-15T22:40:59.866 INFO:tasks.workunit.client.0.smithi033.stdout:4/950: creat d8/d16/d106/f13c x:0 0 0 2024-02-15T22:40:59.869 INFO:tasks.workunit.client.0.smithi033.stdout:0/745: dwrite db/d2a/d68/d8b/f96 [0,4194304] 0 2024-02-15T22:40:59.869 INFO:tasks.workunit.client.0.smithi033.stdout:4/951: creat d8/d16/d51/d1c/db9/d37/dce/f13d x:0 0 0 2024-02-15T22:40:59.870 INFO:tasks.workunit.client.0.smithi033.stdout:4/952: readlink l0 0 2024-02-15T22:40:59.872 INFO:tasks.workunit.client.0.smithi033.stdout:0/746: creat db/d2a/ffe x:0 0 0 2024-02-15T22:40:59.874 INFO:tasks.workunit.client.0.smithi033.stdout:0/747: getdents db/d19/d32/d43/d9f 0 2024-02-15T22:40:59.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/748: symlink db/d2a/lff 0 2024-02-15T22:40:59.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/749: chown db/d19/d32/d43/cda 7 1 2024-02-15T22:40:59.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/750: rmdir db/dc0 0 2024-02-15T22:40:59.878 INFO:tasks.workunit.client.0.smithi033.stdout:0/751: creat db/d2a/d6e/d7a/f100 x:0 0 0 2024-02-15T22:40:59.878 INFO:tasks.workunit.client.0.smithi033.stdout:0/752: truncate db/d2a/ffe 607510 0 2024-02-15T22:40:59.897 INFO:tasks.workunit.client.0.smithi033.stdout:7/932: dwrite d5/dc/d5f/f2f [0,4194304] 0 2024-02-15T22:40:59.898 INFO:tasks.workunit.client.0.smithi033.stdout:7/933: readlink d5/df/d56/d7f/lb9 0 2024-02-15T22:40:59.898 INFO:tasks.workunit.client.0.smithi033.stdout:4/953: dwrite d8/d16/d51/fa7 [0,4194304] 0 2024-02-15T22:40:59.899 INFO:tasks.workunit.client.0.smithi033.stdout:7/934: getdents d5/df/d40/d73 0 2024-02-15T22:40:59.899 INFO:tasks.workunit.client.0.smithi033.stdout:7/935: write d5/df/d56/d60/f6b [4265691,89322] 0 2024-02-15T22:40:59.901 INFO:tasks.workunit.client.0.smithi033.stdout:4/954: creat d8/d16/d106/d135/f13e x:0 0 0 2024-02-15T22:40:59.902 INFO:tasks.workunit.client.0.smithi033.stdout:4/955: mkdir d8/d16/d51/d1c/d3c/d49/dac/d122/d13f 0 2024-02-15T22:40:59.903 INFO:tasks.workunit.client.0.smithi033.stdout:4/956: creat d8/d16/d51/d1c/db9/d37/dce/d111/f140 x:0 0 0 2024-02-15T22:40:59.903 INFO:tasks.workunit.client.0.smithi033.stdout:4/957: chown d8/d16/d51/c12b 9360 1 2024-02-15T22:40:59.911 INFO:tasks.workunit.client.0.smithi033.stdout:4/958: write d8/d16/d51/d1c/db9/d37/d31/d47/d112/fea [1725286,90246] 0 2024-02-15T22:40:59.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/936: dwrite d5/dc/f126 [0,4194304] 0 2024-02-15T22:40:59.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/937: chown d5/l12 598586334 1 2024-02-15T22:40:59.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/938: dread - d5/df/d56/d99/f119 zero size 2024-02-15T22:40:59.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/939: fdatasync f4 0 2024-02-15T22:40:59.918 INFO:tasks.workunit.client.0.smithi033.stdout:7/940: rename d5/df/d40/d136/da1/f53 to d5/df/d40/d136/da0/dc6/f13b 0 2024-02-15T22:40:59.918 INFO:tasks.workunit.client.0.smithi033.stdout:7/941: dread - d5/df/d56/d60/d59/d9c/da6/f10d zero size 2024-02-15T22:40:59.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/942: getdents d5/df/d56/d84 0 2024-02-15T22:40:59.928 INFO:tasks.workunit.client.0.smithi033.stdout:4/959: dwrite d8/d16/d51/d1c/db9/d37/d23/f5b [0,4194304] 0 2024-02-15T22:40:59.930 INFO:tasks.workunit.client.0.smithi033.stdout:4/960: creat d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/f141 x:0 0 0 2024-02-15T22:40:59.930 INFO:tasks.workunit.client.0.smithi033.stdout:4/961: creat d8/d16/d51/d71/f142 x:0 0 0 2024-02-15T22:40:59.945 INFO:tasks.workunit.client.0.smithi033.stdout:4/962: dwrite d8/d16/d51/d1c/db9/d37/dce/d111/f140 [0,4194304] 0 2024-02-15T22:40:59.947 INFO:tasks.workunit.client.0.smithi033.stdout:4/963: getdents d8/d16/d51/d1c/db9/d37/d31/d47/d112 0 2024-02-15T22:40:59.948 INFO:tasks.workunit.client.0.smithi033.stdout:4/964: rmdir d8/d16/d51/d1c/db9/d37/dbe/de0 39 2024-02-15T22:40:59.948 INFO:tasks.workunit.client.0.smithi033.stdout:4/965: write d8/fa6 [4856201,123874] 0 2024-02-15T22:40:59.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/966: mknod d8/d16/d51/d1c/d3c/d3f/d12d/c143 0 2024-02-15T22:40:59.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/967: dread - d8/f11c zero size 2024-02-15T22:40:59.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/968: truncate d8/d16/d51/d27/d12a/fec 1096069 0 2024-02-15T22:40:59.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/969: creat d8/d16/d51/d56/d132/f144 x:0 0 0 2024-02-15T22:40:59.951 INFO:tasks.workunit.client.0.smithi033.stdout:4/970: write d8/d16/d51/d1c/f7e [1126951,55912] 0 2024-02-15T22:40:59.951 INFO:tasks.workunit.client.0.smithi033.stdout:4/971: chown d8/d16/d97 61888 1 2024-02-15T22:40:59.952 INFO:tasks.workunit.client.0.smithi033.stdout:6/693: sync 2024-02-15T22:40:59.952 INFO:tasks.workunit.client.0.smithi033.stdout:6/694: write d12/d3c/d95/f6c [273147,20536] 0 2024-02-15T22:40:59.952 INFO:tasks.workunit.client.0.smithi033.stdout:4/972: getdents d8/d16/d51/d1c/db9/d37/d31/da5 0 2024-02-15T22:40:59.952 INFO:tasks.workunit.client.0.smithi033.stdout:4/973: creat d8/d16/d51/d1c/db9/d37/dbe/f145 x:0 0 0 2024-02-15T22:40:59.962 INFO:tasks.workunit.client.0.smithi033.stdout:4/974: write d8/d1a/f87 [4093652,21127] 0 2024-02-15T22:40:59.962 INFO:tasks.workunit.client.0.smithi033.stdout:4/975: creat d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/f146 x:0 0 0 2024-02-15T22:40:59.962 INFO:tasks.workunit.client.0.smithi033.stdout:4/976: truncate d8/d16/d97/fb2 2324142 0 2024-02-15T22:40:59.963 INFO:tasks.workunit.client.0.smithi033.stdout:4/977: unlink d8/d16/l41 0 2024-02-15T22:40:59.966 INFO:tasks.workunit.client.0.smithi033.stdout:4/978: rename d8/d16/d51/d1c/d3c to d8/d16/d51/d1c/d147 0 2024-02-15T22:40:59.966 INFO:tasks.workunit.client.0.smithi033.stdout:4/979: truncate d8/d16/d51/d1c/d147/d49/dac/f103 667449 0 2024-02-15T22:40:59.966 INFO:tasks.workunit.client.0.smithi033.stdout:4/980: stat d8/d16/d51/d1c/db9/d37/d31/da5/l12e 0 2024-02-15T22:40:59.967 INFO:tasks.workunit.client.0.smithi033.stdout:4/981: mkdir d8/d16/d51/d1c/db9/d37/d31/d148 0 2024-02-15T22:40:59.972 INFO:tasks.workunit.client.0.smithi033.stdout:6/695: dwrite d12/d3c/f44 [0,4194304] 0 2024-02-15T22:40:59.973 INFO:tasks.workunit.client.0.smithi033.stdout:4/982: write d8/d16/d51/d1c/f32 [144603,39058] 0 2024-02-15T22:40:59.980 INFO:tasks.workunit.client.0.smithi033.stdout:4/983: dread d8/d16/d51/d1c/d50/da1/dc1/ff8 [4194304,4194304] 0 2024-02-15T22:40:59.980 INFO:tasks.workunit.client.0.smithi033.stdout:4/984: stat d8/d16/d51/d1c/d147/d49/l7c 0 2024-02-15T22:40:59.981 INFO:tasks.workunit.client.0.smithi033.stdout:4/985: truncate d8/d16/d51/d1c/d50/da1/dc1/ffb 76979 0 2024-02-15T22:40:59.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/986: rename d8/d16/d51/d1c/db9/d37/d31/d47/d112/db1/f102 to d8/d16/d51/d56/f149 0 2024-02-15T22:40:59.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/987: write d8/d16/d51/d1c/db9/d37/d23/d61/df3/dfd/f146 [247636,78568] 0 2024-02-15T22:40:59.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/988: stat d8/d16/d51/d1c/db9/d37/dce/l108 0 2024-02-15T22:40:59.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/989: chown d8/d16/d51/d1c/db9/d37/d31/d80/fe7 195631 1 2024-02-15T22:40:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:4/990: dread - d8/d16/d51/d71/f115 zero size 2024-02-15T22:40:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:4/991: dread - d8/d16/d51/d1c/d147/d49/dac/dd5/f134 zero size 2024-02-15T22:40:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:4/992: write d8/d1a/f87 [4249188,100989] 0 2024-02-15T22:40:59.986 INFO:tasks.workunit.client.0.smithi033.stdout:4/993: dread d8/d16/d51/d1c/db9/f25 [0,4194304] 0 2024-02-15T22:40:59.986 INFO:tasks.workunit.client.0.smithi033.stdout:4/994: creat d8/d16/d51/d1c/db9/d37/dce/f14a x:0 0 0 2024-02-15T22:40:59.986 INFO:tasks.workunit.client.0.smithi033.stdout:4/995: readlink d8/d16/d51/d1c/db9/d37/d31/d47/d112/l63 0 2024-02-15T22:40:59.996 INFO:tasks.workunit.client.0.smithi033.stdout:4/996: dread d8/d16/d51/d1c/db9/fbd [0,4194304] 0 2024-02-15T22:40:59.996 INFO:tasks.workunit.client.0.smithi033.stdout:4/997: mkdir d8/d16/d51/d1c/db9/d37/dce/d111/d14b 0 2024-02-15T22:41:00.008 INFO:tasks.workunit.client.0.smithi033.stdout:4/998: dwrite d8/d16/d51/d56/f123 [0,4194304] 0 2024-02-15T22:41:00.008 INFO:tasks.workunit.client.0.smithi033.stdout:4/999: chown d8/d16/d51/d1c/db9/d37/d23/f5b 56104 1 2024-02-15T22:41:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:59 smithi033 ceph-mon[29033]: pgmap v12: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 182 MiB/s rd, 204 MiB/s wr, 769 op/s 2024-02-15T22:41:00.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:40:59 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi082 to 2581M 2024-02-15T22:41:00.030 INFO:tasks.workunit.client.0.smithi033.stdout:1/883: sync 2024-02-15T22:41:00.031 INFO:tasks.workunit.client.0.smithi033.stdout:1/884: unlink d1/de/d27/d39/ddb/de1/d79/c100 0 2024-02-15T22:41:00.048 INFO:tasks.workunit.client.0.smithi033.stdout:1/885: dwrite d1/de/d27/d39/ddb/de1/d2d/f3d [0,4194304] 0 2024-02-15T22:41:00.048 INFO:tasks.workunit.client.0.smithi033.stdout:1/886: chown d1/de/d27/d39/ddb/de1/d79/dc4/fe8 109 1 2024-02-15T22:41:00.050 INFO:tasks.workunit.client.0.smithi033.stdout:1/887: unlink d1/de/d27/d39/ddb/de1/d37/f8e 0 2024-02-15T22:41:00.050 INFO:tasks.workunit.client.0.smithi033.stdout:1/888: fdatasync d1/d57/fc9 0 2024-02-15T22:41:00.050 INFO:tasks.workunit.client.0.smithi033.stdout:1/889: write d1/de/d27/d39/df5/d8f/fef [745398,40571] 0 2024-02-15T22:41:00.051 INFO:tasks.workunit.client.0.smithi033.stdout:1/890: creat d1/d20/d42/d101/f102 x:0 0 0 2024-02-15T22:41:00.051 INFO:tasks.workunit.client.0.smithi033.stdout:1/891: write d1/de/d27/d39/ddb/de1/d2d/f76 [9793141,37782] 0 2024-02-15T22:41:00.051 INFO:tasks.workunit.client.0.smithi033.stdout:1/892: symlink d1/d20/d42/d2c/l103 0 2024-02-15T22:41:00.053 INFO:tasks.workunit.client.0.smithi033.stdout:1/893: unlink d1/c9 0 2024-02-15T22:41:00.053 INFO:tasks.workunit.client.0.smithi033.stdout:1/894: write d1/de/d27/d39/d3a/f51 [9342384,61977] 0 2024-02-15T22:41:00.062 INFO:tasks.workunit.client.0.smithi033.stdout:1/895: dread d1/de/d27/d39/d3a/f51 [0,4194304] 0 2024-02-15T22:41:00.071 INFO:tasks.workunit.client.0.smithi033.stdout:1/896: write d1/f17 [3784663,27497] 0 2024-02-15T22:41:00.078 INFO:tasks.workunit.client.0.smithi033.stdout:1/897: write d1/de/f1b [3905361,3812] 0 2024-02-15T22:41:00.091 INFO:tasks.workunit.client.0.smithi033.stdout:1/898: dwrite d1/de/d27/d39/ddb/de1/d2d/f8c [0,4194304] 0 2024-02-15T22:41:00.093 INFO:tasks.workunit.client.0.smithi033.stdout:1/899: creat d1/de/d27/d39/ddb/de1/d2d/d5e/d69/f104 x:0 0 0 2024-02-15T22:41:00.094 INFO:tasks.workunit.client.0.smithi033.stdout:1/900: stat d1/d20/d42/d101/f102 0 2024-02-15T22:41:00.094 INFO:tasks.workunit.client.0.smithi033.stdout:1/901: write d1/de/d27/d39/ddb/fe7 [161618,27171] 0 2024-02-15T22:41:00.094 INFO:tasks.workunit.client.0.smithi033.stdout:1/902: creat d1/de/d27/d39/ddb/de1/d37/f105 x:0 0 0 2024-02-15T22:41:00.094 INFO:tasks.workunit.client.0.smithi033.stdout:1/903: creat d1/de/d27/d39/ddb/de1/d79/dc4/f106 x:0 0 0 2024-02-15T22:41:00.096 INFO:tasks.workunit.client.0.smithi033.stdout:1/904: link d1/de/d27/d39/ddb/de1/d79/dc4/fce d1/d20/d42/d2c/d4e/f107 0 2024-02-15T22:41:00.097 INFO:tasks.workunit.client.0.smithi033.stdout:1/905: creat d1/d20/d42/d25/f108 x:0 0 0 2024-02-15T22:41:00.098 INFO:tasks.workunit.client.0.smithi033.stdout:1/906: rmdir d1/d20/dc8 39 2024-02-15T22:41:00.098 INFO:tasks.workunit.client.0.smithi033.stdout:1/907: creat d1/de/d27/f109 x:0 0 0 2024-02-15T22:41:00.098 INFO:tasks.workunit.client.0.smithi033.stdout:1/908: getdents d1/de/d27/d39/ddb/de1/d37/dfd 0 2024-02-15T22:41:00.098 INFO:tasks.workunit.client.0.smithi033.stdout:1/909: chown d1/d57/f5f 4 1 2024-02-15T22:41:00.099 INFO:tasks.workunit.client.0.smithi033.stdout:1/910: mknod d1/de/d27/d39/ddb/de1/d2d/d3b/c10a 0 2024-02-15T22:41:00.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/911: getdents d1/d20/d42/d101 0 2024-02-15T22:41:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:59 smithi082 ceph-mon[37153]: pgmap v12: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 182 MiB/s rd, 204 MiB/s wr, 769 op/s 2024-02-15T22:41:00.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:40:59 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi082 to 2581M 2024-02-15T22:41:00.154 INFO:tasks.workunit.client.0.smithi033.stdout:1/912: dwrite d1/d20/fa9 [0,4194304] 0 2024-02-15T22:41:00.159 INFO:tasks.workunit.client.0.smithi033.stdout:1/913: symlink d1/de/d27/d39/d3a/da3/l10b 0 2024-02-15T22:41:00.159 INFO:tasks.workunit.client.0.smithi033.stdout:1/914: write d1/de/d27/d39/ddb/de1/d2d/f76 [1878641,52218] 0 2024-02-15T22:41:00.159 INFO:tasks.workunit.client.0.smithi033.stdout:1/915: stat d1/de/d27/d39/d3a/feb 0 2024-02-15T22:41:00.160 INFO:tasks.workunit.client.0.smithi033.stdout:1/916: mknod d1/d20/d42/d2c/d7b/c10c 0 2024-02-15T22:41:00.179 INFO:tasks.workunit.client.0.smithi033.stdout:1/917: dwrite d1/d20/d42/d2c/d30/ff6 [0,4194304] 0 2024-02-15T22:41:00.181 INFO:tasks.workunit.client.0.smithi033.stdout:1/918: creat d1/de/d27/d39/ddb/de1/d2d/d36/d8b/f10d x:0 0 0 2024-02-15T22:41:00.183 INFO:tasks.workunit.client.0.smithi033.stdout:1/919: creat d1/de/d27/d39/ddb/de1/d79/d9f/f10e x:0 0 0 2024-02-15T22:41:00.184 INFO:tasks.workunit.client.0.smithi033.stdout:1/920: creat d1/de/d27/d39/df5/d8f/da4/f10f x:0 0 0 2024-02-15T22:41:00.184 INFO:tasks.workunit.client.0.smithi033.stdout:1/921: readlink d1/de/d27/d39/df5/lb2 0 2024-02-15T22:41:00.187 INFO:tasks.workunit.client.0.smithi033.stdout:1/922: link d1/d57/db1/le3 d1/de/d27/d39/df5/d92/l110 0 2024-02-15T22:41:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:1/923: mknod d1/de/d27/d39/ddb/de1/d79/dc4/c111 0 2024-02-15T22:41:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:1/924: creat d1/de/d27/d39/ddb/de1/d2d/d36/d8b/f112 x:0 0 0 2024-02-15T22:41:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:3/902: sync 2024-02-15T22:41:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:9/864: sync 2024-02-15T22:41:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:8/831: sync 2024-02-15T22:41:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:8/832: chown d1/d68/d44/d49/d119 13 1 2024-02-15T22:41:00.191 INFO:tasks.workunit.client.0.smithi033.stdout:1/925: creat d1/d20/d42/d101/f113 x:0 0 0 2024-02-15T22:41:00.191 INFO:tasks.workunit.client.0.smithi033.stdout:1/926: write d1/d20/d42/d2c/d4e/ff4 [578519,56508] 0 2024-02-15T22:41:00.191 INFO:tasks.workunit.client.0.smithi033.stdout:1/927: dread - d1/d20/d42/d25/f108 zero size 2024-02-15T22:41:00.191 INFO:tasks.workunit.client.0.smithi033.stdout:1/928: write d1/d20/d42/d2c/d7b/fc1 [956403,98943] 0 2024-02-15T22:41:00.191 INFO:tasks.workunit.client.0.smithi033.stdout:3/903: mknod d0/d3/d2c/d5d/d3d/d8f/d93/c11d 0 2024-02-15T22:41:00.191 INFO:tasks.workunit.client.0.smithi033.stdout:3/904: write d0/d3/d5f/fcc [4228710,62340] 0 2024-02-15T22:41:00.191 INFO:tasks.workunit.client.0.smithi033.stdout:8/833: dread - d1/de/d1a/d27/d70/fc4 zero size 2024-02-15T22:41:00.194 INFO:tasks.workunit.client.0.smithi033.stdout:3/905: creat d0/d3/d2c/d5d/d3d/d8f/dd7/dec/f11e x:0 0 0 2024-02-15T22:41:00.194 INFO:tasks.workunit.client.0.smithi033.stdout:3/906: readlink d0/d3/d77/le9 0 2024-02-15T22:41:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/929: mknod d1/c114 0 2024-02-15T22:41:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/930: write d1/de/d27/d39/ddb/de1/d37/f45 [1607178,90909] 0 2024-02-15T22:41:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/931: write d1/de/d27/d39/ddb/de1/d2d/d36/d8b/f112 [537077,85741] 0 2024-02-15T22:41:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/932: chown d1/de/d27/d39/ddb/de1/d2d/d5e/f61 472 1 2024-02-15T22:41:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/933: chown d1/d57/db1 842 1 2024-02-15T22:41:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/934: readlink d1/de/d27/d39/df5/d92/l110 0 2024-02-15T22:41:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/935: chown d1/d20/fa1 1 1 2024-02-15T22:41:00.197 INFO:tasks.workunit.client.0.smithi033.stdout:3/907: rename d0/d3/d2c/d5d/d3d/d57/d68/dac/fdf to d0/d3/d3b/f11f 0 2024-02-15T22:41:00.198 INFO:tasks.workunit.client.0.smithi033.stdout:3/908: symlink d0/d3/d2c/d5d/d3d/d57/d68/df6/l120 0 2024-02-15T22:41:00.198 INFO:tasks.workunit.client.0.smithi033.stdout:3/909: chown d0/d3/d5f 173682 1 2024-02-15T22:41:00.199 INFO:tasks.workunit.client.0.smithi033.stdout:3/910: truncate d0/d3/d2c/d5d/d3d/d8f/faf 1304074 0 2024-02-15T22:41:00.202 INFO:tasks.workunit.client.0.smithi033.stdout:3/911: getdents d0/d3/d2c/d5d/d3d/d8f/dd7 0 2024-02-15T22:41:00.202 INFO:tasks.workunit.client.0.smithi033.stdout:3/912: write d0/d3/d5f/fcb [34177,51050] 0 2024-02-15T22:41:00.204 INFO:tasks.workunit.client.0.smithi033.stdout:9/865: dread d4/d1d/d23/d32/d71/dab/fb2 [0,4194304] 0 2024-02-15T22:41:00.204 INFO:tasks.workunit.client.0.smithi033.stdout:9/866: write d4/d1d/f70 [629812,52039] 0 2024-02-15T22:41:00.207 INFO:tasks.workunit.client.0.smithi033.stdout:9/867: symlink d4/d1d/d23/d24/d51/l117 0 2024-02-15T22:41:00.207 INFO:tasks.workunit.client.0.smithi033.stdout:8/834: dwrite d1/d74/dc1/d75/dbf/d79/da5/f117 [0,4194304] 0 2024-02-15T22:41:00.208 INFO:tasks.workunit.client.0.smithi033.stdout:9/868: rename d4/d1d/d23/d35/fc0 to d4/d1d/dd2/f118 0 2024-02-15T22:41:00.213 INFO:tasks.workunit.client.0.smithi033.stdout:8/835: mkdir d1/de/d1a/d27/d10b/d129 0 2024-02-15T22:41:00.216 INFO:tasks.workunit.client.0.smithi033.stdout:9/869: unlink d4/d1d/d23/d24/d51/lb8 0 2024-02-15T22:41:00.219 INFO:tasks.workunit.client.0.smithi033.stdout:8/836: link d1/d74/dc1/d75/dbf/lb2 d1/d74/l12a 0 2024-02-15T22:41:00.221 INFO:tasks.workunit.client.0.smithi033.stdout:9/870: mkdir d4/d1d/dd2/ded/d3f/d94/d9c/d119 0 2024-02-15T22:41:00.222 INFO:tasks.workunit.client.0.smithi033.stdout:8/837: mkdir d1/d74/dc1/d75/db1/d12b 0 2024-02-15T22:41:00.223 INFO:tasks.workunit.client.0.smithi033.stdout:8/838: dread d1/de/d1a/d2a/f10d [0,4194304] 0 2024-02-15T22:41:00.224 INFO:tasks.workunit.client.0.smithi033.stdout:9/871: link d4/d1d/d23/c91 d4/d1d/d23/d24/d5a/df1/c11a 0 2024-02-15T22:41:00.224 INFO:tasks.workunit.client.0.smithi033.stdout:9/872: write d4/d1d/d23/d32/d71/dab/fd8 [895945,86069] 0 2024-02-15T22:41:00.224 INFO:tasks.workunit.client.0.smithi033.stdout:8/839: stat d1/de/d1a/l26 0 2024-02-15T22:41:00.225 INFO:tasks.workunit.client.0.smithi033.stdout:3/913: dwrite d0/d3/d2c/d5d/d3d/db6/ffd [0,4194304] 0 2024-02-15T22:41:00.225 INFO:tasks.workunit.client.0.smithi033.stdout:3/914: chown d0/d3/dd/cfb 723266 1 2024-02-15T22:41:00.225 INFO:tasks.workunit.client.0.smithi033.stdout:3/915: truncate d0/d3/d2c/d5d/f10e 341604 0 2024-02-15T22:41:00.225 INFO:tasks.workunit.client.0.smithi033.stdout:9/873: truncate d4/d1d/dd2/ded/fd7 5389049 0 2024-02-15T22:41:00.228 INFO:tasks.workunit.client.0.smithi033.stdout:1/936: dwrite d1/f7 [0,4194304] 0 2024-02-15T22:41:00.230 INFO:tasks.workunit.client.0.smithi033.stdout:9/874: link d4/d1d/d23/d24/d51/d8a/lf7 d4/d1d/d23/d24/d5a/df1/l11b 0 2024-02-15T22:41:00.232 INFO:tasks.workunit.client.0.smithi033.stdout:8/840: getdents d1/de/d1a/d27/ddf/de6/df7 0 2024-02-15T22:41:00.234 INFO:tasks.workunit.client.0.smithi033.stdout:9/875: creat d4/d1d/d23/d24/d51/d5d/d90/d116/dba/f11c x:0 0 0 2024-02-15T22:41:00.237 INFO:tasks.workunit.client.0.smithi033.stdout:8/841: creat d1/d74/dc1/d75/dbf/d79/d94/d10f/f12c x:0 0 0 2024-02-15T22:41:00.243 INFO:tasks.workunit.client.0.smithi033.stdout:3/916: dwrite d0/d3/d2c/f34 [4194304,4194304] 0 2024-02-15T22:41:00.249 INFO:tasks.workunit.client.0.smithi033.stdout:8/842: link d1/de/d1a/d27/ddf/de6/df7/c118 d1/d74/dc1/d75/dbf/d79/d94/c12d 0 2024-02-15T22:41:00.252 INFO:tasks.workunit.client.0.smithi033.stdout:9/876: dwrite d4/d1d/d83/f112 [4194304,4194304] 0 2024-02-15T22:41:00.252 INFO:tasks.workunit.client.0.smithi033.stdout:3/917: mknod d0/d3/d3b/d47/c121 0 2024-02-15T22:41:00.252 INFO:tasks.workunit.client.0.smithi033.stdout:9/877: write d4/d1d/d23/d24/d5a/d72/f7e [506949,21015] 0 2024-02-15T22:41:00.253 INFO:tasks.workunit.client.0.smithi033.stdout:3/918: symlink d0/d3/d2c/d5d/d3d/d8f/dd7/dec/l122 0 2024-02-15T22:41:00.256 INFO:tasks.workunit.client.0.smithi033.stdout:3/919: rename d0/d3/f41 to d0/d3/d2c/d5d/d3d/d57/d68/df6/f123 0 2024-02-15T22:41:00.256 INFO:tasks.workunit.client.0.smithi033.stdout:3/920: read - d0/d3/d3b/fea zero size 2024-02-15T22:41:00.256 INFO:tasks.workunit.client.0.smithi033.stdout:3/921: readlink d0/d3/l7b 0 2024-02-15T22:41:00.261 INFO:tasks.workunit.client.0.smithi033.stdout:8/843: dread d1/de/d1a/d27/fff [0,4194304] 0 2024-02-15T22:41:00.261 INFO:tasks.workunit.client.0.smithi033.stdout:8/844: fsync d1/d74/dc1/d75/dbf/d79/da5/f117 0 2024-02-15T22:41:00.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/922: symlink d0/d3/d65/l124 0 2024-02-15T22:41:00.261 INFO:tasks.workunit.client.0.smithi033.stdout:3/923: fdatasync d0/f36 0 2024-02-15T22:41:00.261 INFO:tasks.workunit.client.0.smithi033.stdout:9/878: write d4/fe [1401153,26971] 0 2024-02-15T22:41:00.261 INFO:tasks.workunit.client.0.smithi033.stdout:8/845: dread d1/de/d1a/d27/d70/fa2 [0,4194304] 0 2024-02-15T22:41:00.264 INFO:tasks.workunit.client.0.smithi033.stdout:3/924: rmdir d0/d3/d2c/d5d/d3d/db6/ddc 0 2024-02-15T22:41:00.264 INFO:tasks.workunit.client.0.smithi033.stdout:3/925: write d0/d3/d5f/fcb [388024,10212] 0 2024-02-15T22:41:00.264 INFO:tasks.workunit.client.0.smithi033.stdout:3/926: readlink d0/d3/d77/ddb/lee 0 2024-02-15T22:41:00.265 INFO:tasks.workunit.client.0.smithi033.stdout:9/879: symlink d4/d1d/d23/d24/l11d 0 2024-02-15T22:41:00.265 INFO:tasks.workunit.client.0.smithi033.stdout:9/880: chown d4/d1d/d23/d35/la9 42983 1 2024-02-15T22:41:00.265 INFO:tasks.workunit.client.0.smithi033.stdout:9/881: write d4/d1d/d23/d32/d3e/f4d [4812607,16912] 0 2024-02-15T22:41:00.266 INFO:tasks.workunit.client.0.smithi033.stdout:8/846: rename d1/de/d1a/d27/fbc to d1/d74/dc1/d75/db1/db5/f12e 0 2024-02-15T22:41:00.267 INFO:tasks.workunit.client.0.smithi033.stdout:3/927: truncate d0/d3/d2c/d5d/d3d/d57/fbc 636985 0 2024-02-15T22:41:00.267 INFO:tasks.workunit.client.0.smithi033.stdout:3/928: dread - d0/d3/d2c/d5d/fd6 zero size 2024-02-15T22:41:00.267 INFO:tasks.workunit.client.0.smithi033.stdout:3/929: chown d0/d3/dd/cad 57571 1 2024-02-15T22:41:00.277 INFO:tasks.workunit.client.0.smithi033.stdout:8/847: dread d1/d74/fc6 [0,4194304] 0 2024-02-15T22:41:00.277 INFO:tasks.workunit.client.0.smithi033.stdout:8/848: write d1/d74/dc1/d75/dbf/d79/d94/d10f/f12c [991602,51007] 0 2024-02-15T22:41:00.277 INFO:tasks.workunit.client.0.smithi033.stdout:9/882: mknod d4/d1d/d42/c11e 0 2024-02-15T22:41:00.281 INFO:tasks.workunit.client.0.smithi033.stdout:3/930: rename d0/d3/d2c/d5d/d3d/d8f/dd7/dec/f11e to d0/d3/d2c/d5d/d3d/db6/f125 0 2024-02-15T22:41:00.281 INFO:tasks.workunit.client.0.smithi033.stdout:3/931: write d0/d3/d2c/d5d/d3d/d57/d68/ff5 [337310,6993] 0 2024-02-15T22:41:00.281 INFO:tasks.workunit.client.0.smithi033.stdout:8/849: mknod d1/de/d1a/d27/ddf/de6/c12f 0 2024-02-15T22:41:00.289 INFO:tasks.workunit.client.0.smithi033.stdout:3/932: write d0/d3/f17 [1412719,124956] 0 2024-02-15T22:41:00.300 INFO:tasks.workunit.client.0.smithi033.stdout:3/933: dread d0/d3/d2c/d5d/d3d/d57/d68/fd5 [0,4194304] 0 2024-02-15T22:41:00.301 INFO:tasks.workunit.client.0.smithi033.stdout:3/934: dread d0/d1c/f59 [0,4194304] 0 2024-02-15T22:41:00.302 INFO:tasks.workunit.client.0.smithi033.stdout:8/850: dwrite d1/d36/fac [0,4194304] 0 2024-02-15T22:41:00.303 INFO:tasks.workunit.client.0.smithi033.stdout:3/935: unlink d0/d1c/le3 0 2024-02-15T22:41:00.303 INFO:tasks.workunit.client.0.smithi033.stdout:9/883: dwrite d4/fd [0,4194304] 0 2024-02-15T22:41:00.305 INFO:tasks.workunit.client.0.smithi033.stdout:3/936: rename d0/d3/d2c/d5d/d3d/fcd to d0/d3/dd/d107/f126 0 2024-02-15T22:41:00.316 INFO:tasks.workunit.client.0.smithi033.stdout:8/851: write d1/de/d1a/d9d/fda [2219978,94831] 0 2024-02-15T22:41:00.316 INFO:tasks.workunit.client.0.smithi033.stdout:8/852: truncate d1/d68/d44/f8d 5050256 0 2024-02-15T22:41:00.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/884: write d4/d1d/dd2/ded/d3f/fb1 [3973193,48389] 0 2024-02-15T22:41:00.319 INFO:tasks.workunit.client.0.smithi033.stdout:8/853: rmdir d1/d74/dc1/d75/dbf/d79/d94/dd1 39 2024-02-15T22:41:00.320 INFO:tasks.workunit.client.0.smithi033.stdout:8/854: rmdir d1/de/d1a/d9d 39 2024-02-15T22:41:00.324 INFO:tasks.workunit.client.0.smithi033.stdout:8/855: unlink d1/d36/l103 0 2024-02-15T22:41:00.324 INFO:tasks.workunit.client.0.smithi033.stdout:8/856: dread - d1/d74/dc1/d75/dbf/d79/f125 zero size 2024-02-15T22:41:00.324 INFO:tasks.workunit.client.0.smithi033.stdout:8/857: truncate d1/de/d1a/d2a/f30 1342584 0 2024-02-15T22:41:00.325 INFO:tasks.workunit.client.0.smithi033.stdout:8/858: stat d1/d74/dc1/d75/db1/db5/f12e 0 2024-02-15T22:41:00.325 INFO:tasks.workunit.client.0.smithi033.stdout:8/859: dread - d1/d74/dc1/d75/dbf/d79/f113 zero size 2024-02-15T22:41:00.325 INFO:tasks.workunit.client.0.smithi033.stdout:8/860: fdatasync d1/de/d1a/d27/d60/fab 0 2024-02-15T22:41:00.325 INFO:tasks.workunit.client.0.smithi033.stdout:8/861: symlink d1/d68/d57/df2/l130 0 2024-02-15T22:41:00.326 INFO:tasks.workunit.client.0.smithi033.stdout:8/862: rmdir d1/dae/d126 0 2024-02-15T22:41:00.326 INFO:tasks.workunit.client.0.smithi033.stdout:8/863: chown d1/d74/dc1/d75/dbf/d79/c111 64519 1 2024-02-15T22:41:00.326 INFO:tasks.workunit.client.0.smithi033.stdout:8/864: chown d1/d74/dc1/d75 7 1 2024-02-15T22:41:00.326 INFO:tasks.workunit.client.0.smithi033.stdout:8/865: chown d1/d68/d44/cc7 70118430 1 2024-02-15T22:41:00.326 INFO:tasks.workunit.client.0.smithi033.stdout:3/937: dwrite d0/d3/d2c/d5d/d3d/f101 [0,4194304] 0 2024-02-15T22:41:00.326 INFO:tasks.workunit.client.0.smithi033.stdout:3/938: fsync d0/d1c/f25 0 2024-02-15T22:41:00.326 INFO:tasks.workunit.client.0.smithi033.stdout:3/939: write d0/d1c/fbd [1571071,57274] 0 2024-02-15T22:41:00.333 INFO:tasks.workunit.client.0.smithi033.stdout:9/885: dwrite d4/d1d/d23/d24/f2b [4194304,4194304] 0 2024-02-15T22:41:00.333 INFO:tasks.workunit.client.0.smithi033.stdout:9/886: write d4/d1d/d23/d24/d51/d5d/fa2 [137212,74184] 0 2024-02-15T22:41:00.334 INFO:tasks.workunit.client.0.smithi033.stdout:3/940: rename d0/d3/d65/d97/c87 to d0/d3/d2c/d5d/d3d/d57/d68/dfe/dff/c127 0 2024-02-15T22:41:00.334 INFO:tasks.workunit.client.0.smithi033.stdout:3/941: chown d0/d3/d3b/d47/fc7 339691582 1 2024-02-15T22:41:00.334 INFO:tasks.workunit.client.0.smithi033.stdout:9/887: dread d4/d1d/dd2/ded/d3f/d94/f97 [0,4194304] 0 2024-02-15T22:41:00.338 INFO:tasks.workunit.client.0.smithi033.stdout:9/888: creat d4/d1d/dd2/ded/d3f/d10e/f11f x:0 0 0 2024-02-15T22:41:00.340 INFO:tasks.workunit.client.0.smithi033.stdout:9/889: symlink d4/d1d/l120 0 2024-02-15T22:41:00.340 INFO:tasks.workunit.client.0.smithi033.stdout:9/890: chown d4/d1d/dd2/ded/d3f/dc7/cda 18 1 2024-02-15T22:41:00.341 INFO:tasks.workunit.client.0.smithi033.stdout:9/891: fsync d4/d1d/d23/d24/d51/d5d/dbc/ff9 0 2024-02-15T22:41:00.341 INFO:tasks.workunit.client.0.smithi033.stdout:9/892: write d4/d1d/dd2/ded/fdc [182857,50436] 0 2024-02-15T22:41:00.341 INFO:tasks.workunit.client.0.smithi033.stdout:9/893: creat d4/d1d/d23/d35/f121 x:0 0 0 2024-02-15T22:41:00.341 INFO:tasks.workunit.client.0.smithi033.stdout:9/894: chown d4/d1d/d23/d24/d51/d5d/l95 11 1 2024-02-15T22:41:00.342 INFO:tasks.workunit.client.0.smithi033.stdout:9/895: symlink d4/d1d/d42/l122 0 2024-02-15T22:41:00.342 INFO:tasks.workunit.client.0.smithi033.stdout:3/942: write d0/fe [1175001,50138] 0 2024-02-15T22:41:00.343 INFO:tasks.workunit.client.0.smithi033.stdout:9/896: mknod d4/d1d/dd2/ded/d3f/d94/d9c/d119/c123 0 2024-02-15T22:41:00.343 INFO:tasks.workunit.client.0.smithi033.stdout:8/866: dread d1/de/d1a/d2a/f30 [0,4194304] 0 2024-02-15T22:41:00.345 INFO:tasks.workunit.client.0.smithi033.stdout:3/943: creat d0/d3/d2c/d5d/d3d/d8f/dd7/f128 x:0 0 0 2024-02-15T22:41:00.346 INFO:tasks.workunit.client.0.smithi033.stdout:9/897: creat d4/d1d/d83/f124 x:0 0 0 2024-02-15T22:41:00.349 INFO:tasks.workunit.client.0.smithi033.stdout:8/867: rename d1/d74/cdc to d1/d68/d44/dd3/c131 0 2024-02-15T22:41:00.350 INFO:tasks.workunit.client.0.smithi033.stdout:3/944: creat d0/d3/d3b/db1/f129 x:0 0 0 2024-02-15T22:41:00.351 INFO:tasks.workunit.client.0.smithi033.stdout:8/868: creat d1/de/d1a/d27/f132 x:0 0 0 2024-02-15T22:41:00.352 INFO:tasks.workunit.client.0.smithi033.stdout:3/945: write d0/d3/d2c/d5d/d3d/db6/fc8 [808307,61118] 0 2024-02-15T22:41:00.357 INFO:tasks.workunit.client.0.smithi033.stdout:7/943: sync 2024-02-15T22:41:00.357 INFO:tasks.workunit.client.0.smithi033.stdout:2/993: sync 2024-02-15T22:41:00.358 INFO:tasks.workunit.client.0.smithi033.stdout:6/696: sync 2024-02-15T22:41:00.358 INFO:tasks.workunit.client.0.smithi033.stdout:5/916: sync 2024-02-15T22:41:00.358 INFO:tasks.workunit.client.0.smithi033.stdout:7/944: fsync d5/df/f94 0 2024-02-15T22:41:00.358 INFO:tasks.workunit.client.0.smithi033.stdout:0/753: sync 2024-02-15T22:41:00.358 INFO:tasks.workunit.client.0.smithi033.stdout:5/917: write d6/d14/d31/d50/d6a/fff [541149,9519] 0 2024-02-15T22:41:00.358 INFO:tasks.workunit.client.0.smithi033.stdout:7/945: write d5/df/d56/d60/f6b [522280,77520] 0 2024-02-15T22:41:00.358 INFO:tasks.workunit.client.0.smithi033.stdout:5/918: truncate d6/d14/d31/d38/d9b/dd3/d7a/db9/ff8 104515 0 2024-02-15T22:41:00.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/946: symlink d0/d3/d2c/d5d/d3d/d57/d68/dfe/dff/l12a 0 2024-02-15T22:41:00.360 INFO:tasks.workunit.client.0.smithi033.stdout:1/937: sync 2024-02-15T22:41:00.360 INFO:tasks.workunit.client.0.smithi033.stdout:2/994: rmdir d1/d8/d2b/d2f/d3d 39 2024-02-15T22:41:00.361 INFO:tasks.workunit.client.0.smithi033.stdout:6/697: creat d12/d3c/d95/d3f/d50/dbd/dcb/feb x:0 0 0 2024-02-15T22:41:00.361 INFO:tasks.workunit.client.0.smithi033.stdout:6/698: fsync d12/d3c/d95/d3f/d50/f81 0 2024-02-15T22:41:00.362 INFO:tasks.workunit.client.0.smithi033.stdout:6/699: fsync d12/f5d 0 2024-02-15T22:41:00.362 INFO:tasks.workunit.client.0.smithi033.stdout:2/995: write d1/d8/d2b/d2f/d24/d31/f81 [5488774,122854] 0 2024-02-15T22:41:00.362 INFO:tasks.workunit.client.0.smithi033.stdout:2/996: truncate d1/d8/d2b/d2f/d13/f3b 280750 0 2024-02-15T22:41:00.363 INFO:tasks.workunit.client.0.smithi033.stdout:0/754: truncate db/fa8 3383230 0 2024-02-15T22:41:00.365 INFO:tasks.workunit.client.0.smithi033.stdout:5/919: mkdir d6/d14/d31/d48/d49/d53/dd7/d117/d128 0 2024-02-15T22:41:00.365 INFO:tasks.workunit.client.0.smithi033.stdout:5/920: chown d6/d14/d31/d38/d9b/dd3/d7a/cea 105063 1 2024-02-15T22:41:00.367 INFO:tasks.workunit.client.0.smithi033.stdout:3/947: creat d0/d3/d2c/d5d/d3d/db4/f12b x:0 0 0 2024-02-15T22:41:00.369 INFO:tasks.workunit.client.0.smithi033.stdout:8/869: dwrite d1/d68/d57/df2/f104 [0,4194304] 0 2024-02-15T22:41:00.369 INFO:tasks.workunit.client.0.smithi033.stdout:8/870: readlink d1/de/d1a/l1e 0 2024-02-15T22:41:00.371 INFO:tasks.workunit.client.0.smithi033.stdout:2/997: mkdir d1/d16/d3f/df5/d13c 0 2024-02-15T22:41:00.371 INFO:tasks.workunit.client.0.smithi033.stdout:2/998: truncate d1/d8/d2b/d2f/d12/dae/fdd 1747862 0 2024-02-15T22:41:00.372 INFO:tasks.workunit.client.0.smithi033.stdout:0/755: rename db/d2a/d6e/ldd to db/d2a/d68/d8b/l101 0 2024-02-15T22:41:00.373 INFO:tasks.workunit.client.0.smithi033.stdout:7/946: rmdir d5/dc/d5f 39 2024-02-15T22:41:00.377 INFO:tasks.workunit.client.0.smithi033.stdout:8/871: dread d1/de/d5c/f7e [0,4194304] 0 2024-02-15T22:41:00.379 INFO:tasks.workunit.client.0.smithi033.stdout:2/999: mkdir d1/d8/d2b/d2f/d13/da9/d13b/d13d 0 2024-02-15T22:41:00.380 INFO:tasks.workunit.client.0.smithi033.stdout:3/948: dread d0/d3/d3b/f71 [0,4194304] 0 2024-02-15T22:41:00.380 INFO:tasks.workunit.client.0.smithi033.stdout:6/700: dwrite d12/d3c/f91 [0,4194304] 0 2024-02-15T22:41:00.381 INFO:tasks.workunit.client.0.smithi033.stdout:5/921: rename d6/d14/d31/f47 to d6/d14/d31/d38/d9b/dd3/d7a/db9/d101/d127/f129 0 2024-02-15T22:41:00.383 INFO:tasks.workunit.client.0.smithi033.stdout:7/947: rmdir d5/df/d40/d136/da1/d26 39 2024-02-15T22:41:00.385 INFO:tasks.workunit.client.0.smithi033.stdout:1/938: getdents d1/d96 0 2024-02-15T22:41:00.385 INFO:tasks.workunit.client.0.smithi033.stdout:1/939: readlink d1/de/d27/d39/ddb/de1/ld8 0 2024-02-15T22:41:00.385 INFO:tasks.workunit.client.0.smithi033.stdout:1/940: read d1/de/d27/d39/ddb/de1/d2d/f76 [9119124,106353] 0 2024-02-15T22:41:00.388 INFO:tasks.workunit.client.0.smithi033.stdout:8/872: mkdir d1/de/d1a/d9d/d133 0 2024-02-15T22:41:00.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/949: creat d0/d3/d2c/d5d/f12c x:0 0 0 2024-02-15T22:41:00.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/950: creat d0/d3/d2c/d5d/d3d/db4/f12d x:0 0 0 2024-02-15T22:41:00.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/951: write d0/d1c/f59 [878545,49000] 0 2024-02-15T22:41:00.390 INFO:tasks.workunit.client.0.smithi033.stdout:3/952: creat d0/d3/d2c/d5d/d3d/db6/f12e x:0 0 0 2024-02-15T22:41:00.391 INFO:tasks.workunit.client.0.smithi033.stdout:7/948: dread d5/df/d40/d136/da0/dc6/fed [0,4194304] 0 2024-02-15T22:41:00.393 INFO:tasks.workunit.client.0.smithi033.stdout:0/756: dwrite db/d19/d32/d3d/fde [0,4194304] 0 2024-02-15T22:41:00.394 INFO:tasks.workunit.client.0.smithi033.stdout:5/922: rename d6/d14/d31/d48/d49/d53/d57/da1/fc2 to d6/d14/d31/d38/d9b/dd3/d7a/db9/d101/d127/f12a 0 2024-02-15T22:41:00.402 INFO:tasks.workunit.client.0.smithi033.stdout:8/873: rename d1/d74/dc1/d75/dbf/d79/d94/dd1/fd7 to d1/d68/d57/f134 0 2024-02-15T22:41:00.402 INFO:tasks.workunit.client.0.smithi033.stdout:8/874: fdatasync d1/d68/d44/d49/fb3 0 2024-02-15T22:41:00.402 INFO:tasks.workunit.client.0.smithi033.stdout:0/757: dread db/d2a/d6c/f93 [0,4194304] 0 2024-02-15T22:41:00.402 INFO:tasks.workunit.client.0.smithi033.stdout:0/758: write db/d2a/d6c/fca [5068941,91714] 0 2024-02-15T22:41:00.403 INFO:tasks.workunit.client.0.smithi033.stdout:0/759: dread db/d2a/ffe [0,4194304] 0 2024-02-15T22:41:00.403 INFO:tasks.workunit.client.0.smithi033.stdout:5/923: unlink d6/d14/d31/d38/d9b/dd3/d7a/cea 0 2024-02-15T22:41:00.406 INFO:tasks.workunit.client.0.smithi033.stdout:7/949: rename d5/dc/f11b to d5/df/d56/f13c 0 2024-02-15T22:41:00.410 INFO:tasks.workunit.client.0.smithi033.stdout:0/760: rename db/d2a/d6e/d7a/f8a to db/d19/d32/d43/d5a/d76/da1/f102 0 2024-02-15T22:41:00.412 INFO:tasks.workunit.client.0.smithi033.stdout:0/761: creat db/d2a/d68/df6/f103 x:0 0 0 2024-02-15T22:41:00.413 INFO:tasks.workunit.client.0.smithi033.stdout:0/762: mknod db/d19/d32/d43/d9f/c104 0 2024-02-15T22:41:00.422 INFO:tasks.workunit.client.0.smithi033.stdout:7/950: dread d5/df/d40/d136/da0/dc6/de4/de5/d7b/f7c [0,4194304] 0 2024-02-15T22:41:00.426 INFO:tasks.workunit.client.0.smithi033.stdout:3/953: dwrite d0/d3/d2c/d5d/d3d/d57/d68/fd5 [0,4194304] 0 2024-02-15T22:41:00.429 INFO:tasks.workunit.client.0.smithi033.stdout:6/701: dwrite d12/d3c/d95/d3f/d4b/dac/d5c/fd7 [0,4194304] 0 2024-02-15T22:41:00.430 INFO:tasks.workunit.client.0.smithi033.stdout:6/702: dread - d12/d2c/fa4 zero size 2024-02-15T22:41:00.430 INFO:tasks.workunit.client.0.smithi033.stdout:6/703: creat d12/d2c/d30/d90/fec x:0 0 0 2024-02-15T22:41:00.430 INFO:tasks.workunit.client.0.smithi033.stdout:6/704: write d12/d2c/fa4 [328579,16803] 0 2024-02-15T22:41:00.431 INFO:tasks.workunit.client.0.smithi033.stdout:6/705: read d12/d3c/d95/d3f/da3/fe1 [595301,17179] 0 2024-02-15T22:41:00.431 INFO:tasks.workunit.client.0.smithi033.stdout:6/706: truncate d12/d3c/d95/d3f/d50/dbd/fea 376977 0 2024-02-15T22:41:00.431 INFO:tasks.workunit.client.0.smithi033.stdout:1/941: dwrite d1/d20/d42/d2c/d4e/de5/fea [0,4194304] 0 2024-02-15T22:41:00.431 INFO:tasks.workunit.client.0.smithi033.stdout:1/942: creat d1/d20/d42/d2c/d30/f115 x:0 0 0 2024-02-15T22:41:00.433 INFO:tasks.workunit.client.0.smithi033.stdout:3/954: dread d0/d3/d2c/d5d/d3d/d8f/fb9 [0,4194304] 0 2024-02-15T22:41:00.434 INFO:tasks.workunit.client.0.smithi033.stdout:3/955: write d0/d3/d2c/f34 [3830697,39142] 0 2024-02-15T22:41:00.435 INFO:tasks.workunit.client.0.smithi033.stdout:5/924: dwrite d6/d14/d31/d38/f82 [0,4194304] 0 2024-02-15T22:41:00.435 INFO:tasks.workunit.client.0.smithi033.stdout:5/925: fdatasync d6/d14/df5/f111 0 2024-02-15T22:41:00.435 INFO:tasks.workunit.client.0.smithi033.stdout:5/926: dread - d6/d14/d31/d38/d9b/dd2/f123 zero size 2024-02-15T22:41:00.436 INFO:tasks.workunit.client.0.smithi033.stdout:8/875: dwrite d1/d74/dc1/d75/d83/fa9 [0,4194304] 0 2024-02-15T22:41:00.436 INFO:tasks.workunit.client.0.smithi033.stdout:8/876: readlink d1/d68/d1d/d4a/d4c/le8 0 2024-02-15T22:41:00.436 INFO:tasks.workunit.client.0.smithi033.stdout:8/877: truncate d1/d74/dc1/d75/dbf/fd6 803229 0 2024-02-15T22:41:00.437 INFO:tasks.workunit.client.0.smithi033.stdout:3/956: mknod d0/d3/d3b/c12f 0 2024-02-15T22:41:00.437 INFO:tasks.workunit.client.0.smithi033.stdout:3/957: truncate d0/fe 4775250 0 2024-02-15T22:41:00.437 INFO:tasks.workunit.client.0.smithi033.stdout:5/927: getdents d6/d14/d31/d48/d49/d53 0 2024-02-15T22:41:00.438 INFO:tasks.workunit.client.0.smithi033.stdout:5/928: chown d6/d14/d31/d48/d49/d53/cfb 24601 1 2024-02-15T22:41:00.438 INFO:tasks.workunit.client.0.smithi033.stdout:0/763: dwrite db/d19/d32/f3c [0,4194304] 0 2024-02-15T22:41:00.440 INFO:tasks.workunit.client.0.smithi033.stdout:1/943: rmdir d1/de/d27/d39/df5/d8f/da4 39 2024-02-15T22:41:00.444 INFO:tasks.workunit.client.0.smithi033.stdout:7/951: dwrite d5/df/d40/d73/dd2/ff1 [0,4194304] 0 2024-02-15T22:41:00.444 INFO:tasks.workunit.client.0.smithi033.stdout:7/952: chown d5/dc/d5f/daa/lb0 223046 1 2024-02-15T22:41:00.445 INFO:tasks.workunit.client.0.smithi033.stdout:1/944: creat d1/d96/f116 x:0 0 0 2024-02-15T22:41:00.445 INFO:tasks.workunit.client.0.smithi033.stdout:1/945: readlink d1/de/d27/d39/ddb/de1/d2d/l50 0 2024-02-15T22:41:00.462 INFO:tasks.workunit.client.0.smithi033.stdout:7/953: write d5/dc/d5f/f11a [2394541,70139] 0 2024-02-15T22:41:00.464 INFO:tasks.workunit.client.0.smithi033.stdout:7/954: creat d5/df/d40/d136/da0/d114/f13d x:0 0 0 2024-02-15T22:41:00.464 INFO:tasks.workunit.client.0.smithi033.stdout:7/955: write d5/df/d40/d136/da0/dc6/de4/ff8 [672060,70142] 0 2024-02-15T22:41:00.465 INFO:tasks.workunit.client.0.smithi033.stdout:0/764: dwrite db/d2a/d68/d8b/f98 [0,4194304] 0 2024-02-15T22:41:00.465 INFO:tasks.workunit.client.0.smithi033.stdout:3/958: dwrite d0/d3/d2c/d5d/d3d/db6/fb8 [0,4194304] 0 2024-02-15T22:41:00.465 INFO:tasks.workunit.client.0.smithi033.stdout:3/959: write d0/d3/d2c/d5d/d3d/d8f/d93/fbf [316346,13214] 0 2024-02-15T22:41:00.468 INFO:tasks.workunit.client.0.smithi033.stdout:0/765: dread db/d19/d32/d43/d7d/f85 [0,4194304] 0 2024-02-15T22:41:00.468 INFO:tasks.workunit.client.0.smithi033.stdout:0/766: fsync db/d19/d32/d3d/fde 0 2024-02-15T22:41:00.470 INFO:tasks.workunit.client.0.smithi033.stdout:0/767: mknod db/d19/d32/d43/c105 0 2024-02-15T22:41:00.472 INFO:tasks.workunit.client.0.smithi033.stdout:0/768: mkdir db/d2a/d6e/dc3/d106 0 2024-02-15T22:41:00.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/769: mkdir db/d2a/d68/d8b/dbf/d107 0 2024-02-15T22:41:00.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/770: creat db/d19/dd8/f108 x:0 0 0 2024-02-15T22:41:00.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/771: readlink db/d2a/d6e/d7a/lb5 0 2024-02-15T22:41:00.474 INFO:tasks.workunit.client.0.smithi033.stdout:5/929: write d6/d14/d31/d48/d56/f9a [834209,9531] 0 2024-02-15T22:41:00.474 INFO:tasks.workunit.client.0.smithi033.stdout:5/930: creat d6/d25/df4/f12b x:0 0 0 2024-02-15T22:41:00.477 INFO:tasks.workunit.client.0.smithi033.stdout:0/772: rename db/d2a/d68/da9 to db/d2a/d6e/dc3/d109 0 2024-02-15T22:41:00.478 INFO:tasks.workunit.client.0.smithi033.stdout:1/946: dwrite d1/d96/f116 [0,4194304] 0 2024-02-15T22:41:00.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/931: read d6/d14/d31/d48/d49/fdf [673880,107087] 0 2024-02-15T22:41:00.488 INFO:tasks.workunit.client.0.smithi033.stdout:5/932: rmdir d6/d14/d31/d48/d49/d53/dd7 39 2024-02-15T22:41:00.489 INFO:tasks.workunit.client.0.smithi033.stdout:5/933: chown d6/d25/ffa 1038216 1 2024-02-15T22:41:00.489 INFO:tasks.workunit.client.0.smithi033.stdout:7/956: dwrite d5/df/d40/d136/da1/f21 [0,4194304] 0 2024-02-15T22:41:00.490 INFO:tasks.workunit.client.0.smithi033.stdout:3/960: dwrite d0/d3/d3b/d47/f50 [0,4194304] 0 2024-02-15T22:41:00.490 INFO:tasks.workunit.client.0.smithi033.stdout:3/961: write d0/d3/dd/d110/f112 [355520,1344] 0 2024-02-15T22:41:00.490 INFO:tasks.workunit.client.0.smithi033.stdout:1/947: write d1/d20/d42/d2c/d4e/f97 [2819068,55631] 0 2024-02-15T22:41:00.491 INFO:tasks.workunit.client.0.smithi033.stdout:5/934: creat d6/d14/d31/d48/d49/d53/dd7/d117/d128/f12c x:0 0 0 2024-02-15T22:41:00.492 INFO:tasks.workunit.client.0.smithi033.stdout:7/957: symlink d5/df/d40/d136/da0/dc6/de4/de9/l13e 0 2024-02-15T22:41:00.496 INFO:tasks.workunit.client.0.smithi033.stdout:1/948: mknod d1/de/d27/d39/d3a/dbe/c117 0 2024-02-15T22:41:00.504 INFO:tasks.workunit.client.0.smithi033.stdout:1/949: dread d1/de/d27/d39/d3a/f51 [4194304,4194304] 0 2024-02-15T22:41:00.504 INFO:tasks.workunit.client.0.smithi033.stdout:1/950: chown d1/d57/cf3 934457 1 2024-02-15T22:41:00.507 INFO:tasks.workunit.client.0.smithi033.stdout:5/935: mkdir d6/d14/d31/d50/d12d 0 2024-02-15T22:41:00.508 INFO:tasks.workunit.client.0.smithi033.stdout:1/951: mkdir d1/de/d27/d39/ddb/de1/d79/dc4/d118 0 2024-02-15T22:41:00.519 INFO:tasks.workunit.client.0.smithi033.stdout:3/962: dwrite d0/d3/d3b/f10f [0,4194304] 0 2024-02-15T22:41:00.519 INFO:tasks.workunit.client.0.smithi033.stdout:3/963: write d0/d3/d2c/d43/fc5 [808689,17472] 0 2024-02-15T22:41:00.519 INFO:tasks.workunit.client.0.smithi033.stdout:3/964: fsync d0/d3/d5f/da7/fed 0 2024-02-15T22:41:00.520 INFO:tasks.workunit.client.0.smithi033.stdout:7/958: dwrite d5/df/d40/d73/fee [0,4194304] 0 2024-02-15T22:41:00.523 INFO:tasks.workunit.client.0.smithi033.stdout:5/936: dread d6/d14/d31/d38/d9b/dd2/f112 [0,4194304] 0 2024-02-15T22:41:00.523 INFO:tasks.workunit.client.0.smithi033.stdout:5/937: fdatasync d6/d14/f22 0 2024-02-15T22:41:00.524 INFO:tasks.workunit.client.0.smithi033.stdout:5/938: truncate d6/d14/fbd 349782 0 2024-02-15T22:41:00.527 INFO:tasks.workunit.client.0.smithi033.stdout:5/939: mkdir d6/d14/d31/d48/d12e 0 2024-02-15T22:41:00.530 INFO:tasks.workunit.client.0.smithi033.stdout:1/952: dwrite d1/d20/d42/d2c/d30/ff6 [0,4194304] 0 2024-02-15T22:41:00.549 INFO:tasks.workunit.client.0.smithi033.stdout:7/959: dwrite d5/df/d40/d81/fff [0,4194304] 0 2024-02-15T22:41:00.550 INFO:tasks.workunit.client.0.smithi033.stdout:7/960: symlink d5/df/d56/d7f/d124/l13f 0 2024-02-15T22:41:00.557 INFO:tasks.workunit.client.0.smithi033.stdout:3/965: dwrite d0/d3/dd/d110/f112 [0,4194304] 0 2024-02-15T22:41:00.557 INFO:tasks.workunit.client.0.smithi033.stdout:3/966: truncate d0/d3/d2c/d5d/d3d/d8f/d93/fbf 424474 0 2024-02-15T22:41:00.558 INFO:tasks.workunit.client.0.smithi033.stdout:3/967: mkdir d0/d3/d2c/d5d/d3d/db6/d130 0 2024-02-15T22:41:00.565 INFO:tasks.workunit.client.0.smithi033.stdout:7/961: dread d5/df/d40/d81/fff [0,4194304] 0 2024-02-15T22:41:00.578 INFO:tasks.workunit.client.0.smithi033.stdout:7/962: rename d5/df/f94 to d5/df/d56/d84/f140 0 2024-02-15T22:41:00.600 INFO:tasks.workunit.client.0.smithi033.stdout:1/953: dwrite d1/de/d27/d39/ddb/de1/f83 [0,4194304] 0 2024-02-15T22:41:00.600 INFO:tasks.workunit.client.0.smithi033.stdout:7/963: dwrite d5/dc/fc2 [4194304,4194304] 0 2024-02-15T22:41:00.600 INFO:tasks.workunit.client.0.smithi033.stdout:3/968: dwrite d0/d1c/f88 [0,4194304] 0 2024-02-15T22:41:00.600 INFO:tasks.workunit.client.0.smithi033.stdout:3/969: fsync d0/d3/d2c/d5d/d3d/d57/d68/df6/ffa 0 2024-02-15T22:41:00.601 INFO:tasks.workunit.client.0.smithi033.stdout:1/954: symlink d1/de/d27/d39/ddb/de1/d2d/d5e/d69/dca/l119 0 2024-02-15T22:41:00.617 INFO:tasks.workunit.client.0.smithi033.stdout:1/955: dwrite d1/de/d27/d39/df5/d8f/fef [0,4194304] 0 2024-02-15T22:41:00.617 INFO:tasks.workunit.client.0.smithi033.stdout:1/956: chown d1/de/d27/l7f 5 1 2024-02-15T22:41:00.619 INFO:tasks.workunit.client.0.smithi033.stdout:1/957: truncate d1/de/d27/d39/ddb/de1/d37/fc0 3556952 0 2024-02-15T22:41:00.619 INFO:tasks.workunit.client.0.smithi033.stdout:1/958: write d1/d20/fa1 [4300658,50940] 0 2024-02-15T22:41:00.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/959: write d1/de/d27/f109 [76118,126971] 0 2024-02-15T22:41:00.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/960: chown d1/de/d27/d39/ddb/de1/d2d/d5e/d69 233 1 2024-02-15T22:41:00.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/961: truncate d1/de/d27/d39/ddb/de1/d2d/d36/d8b/f10d 237010 0 2024-02-15T22:41:00.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/962: creat d1/de/d27/d39/df5/d8f/f11a x:0 0 0 2024-02-15T22:41:00.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/963: fsync d1/de/d27/d39/ddb/de1/d2d/f7a 0 2024-02-15T22:41:00.621 INFO:tasks.workunit.client.0.smithi033.stdout:1/964: rename d1/d20/d42/d2c/d30/l9d to d1/de/d27/d39/ddb/de1/d2d/l11b 0 2024-02-15T22:41:00.621 INFO:tasks.workunit.client.0.smithi033.stdout:1/965: chown d1/de/d27/cba 1 1 2024-02-15T22:41:00.621 INFO:tasks.workunit.client.0.smithi033.stdout:1/966: mknod d1/d20/dc8/c11c 0 2024-02-15T22:41:00.621 INFO:tasks.workunit.client.0.smithi033.stdout:1/967: truncate d1/de/d27/d39/df5/d8f/da4/f10f 277053 0 2024-02-15T22:41:00.622 INFO:tasks.workunit.client.0.smithi033.stdout:1/968: stat d1/de/d27/d39/df5/d8f/f11a 0 2024-02-15T22:41:00.622 INFO:tasks.workunit.client.0.smithi033.stdout:3/970: dwrite d0/d1c/f29 [0,4194304] 0 2024-02-15T22:41:00.629 INFO:tasks.workunit.client.0.smithi033.stdout:1/969: write d1/de/d27/d39/d3a/da3/f70 [3256540,15461] 0 2024-02-15T22:41:00.629 INFO:tasks.workunit.client.0.smithi033.stdout:1/970: creat d1/de/d27/d39/d3a/f11d x:0 0 0 2024-02-15T22:41:00.642 INFO:tasks.workunit.client.0.smithi033.stdout:3/971: dwrite d0/d1c/f59 [0,4194304] 0 2024-02-15T22:41:00.646 INFO:tasks.workunit.client.0.smithi033.stdout:1/971: dwrite d1/de/d27/d39/ddb/de1/d2d/f8c [4194304,4194304] 0 2024-02-15T22:41:00.649 INFO:tasks.workunit.client.0.smithi033.stdout:1/972: creat d1/de/d27/d39/ddb/de1/d2d/d3b/d84/f11e x:0 0 0 2024-02-15T22:41:00.655 INFO:tasks.workunit.client.0.smithi033.stdout:3/972: dwrite d0/d3/d5f/fdd [0,4194304] 0 2024-02-15T22:41:00.658 INFO:tasks.workunit.client.0.smithi033.stdout:3/973: rename d0/d3/dd/f7e to d0/d3/d2c/d5d/d3d/d8f/f131 0 2024-02-15T22:41:00.659 INFO:tasks.workunit.client.0.smithi033.stdout:3/974: mkdir d0/d3/d2c/d5d/d3d/d57/d68/dfe/dff/d132 0 2024-02-15T22:41:00.696 INFO:tasks.workunit.client.0.smithi033.stdout:9/898: sync 2024-02-15T22:41:00.697 INFO:tasks.workunit.client.0.smithi033.stdout:9/899: mkdir d4/d1d/d23/d32/da7/ddb/d125 0 2024-02-15T22:41:00.697 INFO:tasks.workunit.client.0.smithi033.stdout:9/900: creat d4/d1d/f126 x:0 0 0 2024-02-15T22:41:00.698 INFO:tasks.workunit.client.0.smithi033.stdout:9/901: creat d4/d1d/d23/d32/d71/dab/f127 x:0 0 0 2024-02-15T22:41:00.700 INFO:tasks.workunit.client.0.smithi033.stdout:9/902: rename d4/d1d/d23/d24/ld3 to d4/dac/db0/l128 0 2024-02-15T22:41:00.700 INFO:tasks.workunit.client.0.smithi033.stdout:9/903: creat d4/d1d/d23/d24/d5a/dbb/f129 x:0 0 0 2024-02-15T22:41:00.701 INFO:tasks.workunit.client.0.smithi033.stdout:9/904: unlink d4/d1d/d23/d35/l84 0 2024-02-15T22:41:00.702 INFO:tasks.workunit.client.0.smithi033.stdout:9/905: unlink d4/d1d/dd2/ded/cb5 0 2024-02-15T22:41:00.703 INFO:tasks.workunit.client.0.smithi033.stdout:9/906: getdents d4/d1d/dd2/ded/d3f/d94/d9c 0 2024-02-15T22:41:00.719 INFO:tasks.workunit.client.0.smithi033.stdout:9/907: dwrite d4/d1d/d23/d24/f25 [4194304,4194304] 0 2024-02-15T22:41:00.721 INFO:tasks.workunit.client.0.smithi033.stdout:9/908: rename d4/d1d/d23/d32/d71/dab/f127 to d4/d1d/d23/d7b/f12a 0 2024-02-15T22:41:00.721 INFO:tasks.workunit.client.0.smithi033.stdout:9/909: write d4/d1d/d23/f61 [9412032,66151] 0 2024-02-15T22:41:00.721 INFO:tasks.workunit.client.0.smithi033.stdout:9/910: chown d4/d1d/dd2/ded/d3f/d94 4775167 1 2024-02-15T22:41:00.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/911: symlink d4/d1d/d23/d24/d51/d5d/d90/d116/l12b 0 2024-02-15T22:41:00.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/912: fsync d4/d1d/dd2/ded/ff5 0 2024-02-15T22:41:00.724 INFO:tasks.workunit.client.0.smithi033.stdout:9/913: rename d4/d1d/f70 to d4/d1d/d23/d24/d51/d8a/f12c 0 2024-02-15T22:41:00.724 INFO:tasks.workunit.client.0.smithi033.stdout:9/914: mknod d4/d1d/d23/d24/d51/d102/c12d 0 2024-02-15T22:41:00.726 INFO:tasks.workunit.client.0.smithi033.stdout:9/915: mknod d4/d1d/d23/d24/d51/d102/c12e 0 2024-02-15T22:41:00.728 INFO:tasks.workunit.client.0.smithi033.stdout:9/916: mknod d4/c12f 0 2024-02-15T22:41:00.728 INFO:tasks.workunit.client.0.smithi033.stdout:9/917: fsync d4/d1d/dd2/ffe 0 2024-02-15T22:41:00.730 INFO:tasks.workunit.client.0.smithi033.stdout:9/918: creat d4/d1d/d23/d24/d51/f130 x:0 0 0 2024-02-15T22:41:00.730 INFO:tasks.workunit.client.0.smithi033.stdout:9/919: creat d4/d1d/d23/d32/da7/ddb/f131 x:0 0 0 2024-02-15T22:41:00.731 INFO:tasks.workunit.client.0.smithi033.stdout:9/920: dread d4/d1d/d23/d24/fd0 [0,4194304] 0 2024-02-15T22:41:00.733 INFO:tasks.workunit.client.0.smithi033.stdout:9/921: symlink d4/l132 0 2024-02-15T22:41:00.733 INFO:tasks.workunit.client.0.smithi033.stdout:9/922: dread - d4/d1d/d42/fbd zero size 2024-02-15T22:41:00.735 INFO:tasks.workunit.client.0.smithi033.stdout:9/923: rename d4/d1d/d23/d24/d5a/dbb to d4/d1d/dd2/ded/d3f/dc7/d133 0 2024-02-15T22:41:00.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/924: getdents d4/d1d/dd2/ded/d3f/d10e 0 2024-02-15T22:41:00.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/925: truncate d4/d1d/dd2/ded/d3f/d10e/f11f 157300 0 2024-02-15T22:41:00.739 INFO:tasks.workunit.client.0.smithi033.stdout:9/926: rename d4/d1d/d23/d24/f25 to d4/d1d/d23/d7b/f134 0 2024-02-15T22:41:00.743 INFO:tasks.workunit.client.0.smithi033.stdout:9/927: getdents d4/d1d/d23/d24/d51 0 2024-02-15T22:41:00.744 INFO:tasks.workunit.client.0.smithi033.stdout:9/928: creat d4/d1d/d23/d24/d51/d8a/f135 x:0 0 0 2024-02-15T22:41:00.744 INFO:tasks.workunit.client.0.smithi033.stdout:9/929: stat d4/d1d/d23/d35/l10d 0 2024-02-15T22:41:00.756 INFO:tasks.workunit.client.0.smithi033.stdout:9/930: dwrite d4/d1d/d23/d32/d3e/f44 [4194304,4194304] 0 2024-02-15T22:41:00.757 INFO:tasks.workunit.client.0.smithi033.stdout:9/931: dread d4/d1d/dd2/ded/d3f/d10e/f11f [0,4194304] 0 2024-02-15T22:41:00.759 INFO:tasks.workunit.client.0.smithi033.stdout:9/932: mkdir d4/d1d/d23/d24/d51/d5d/d90/d136 0 2024-02-15T22:41:00.759 INFO:tasks.workunit.client.0.smithi033.stdout:9/933: chown d4/d1d 7586 1 2024-02-15T22:41:00.774 INFO:tasks.workunit.client.0.smithi033.stdout:9/934: dwrite d4/fe [0,4194304] 0 2024-02-15T22:41:00.791 INFO:tasks.workunit.client.0.smithi033.stdout:9/935: dwrite d4/d1d/dd2/ded/d3f/fb1 [4194304,4194304] 0 2024-02-15T22:41:00.791 INFO:tasks.workunit.client.0.smithi033.stdout:9/936: chown d4/d1d/dd2/ded/d3f/fd6 2080346 1 2024-02-15T22:41:00.791 INFO:tasks.workunit.client.0.smithi033.stdout:9/937: creat d4/dac/f137 x:0 0 0 2024-02-15T22:41:00.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/707: sync 2024-02-15T22:41:00.812 INFO:tasks.workunit.client.0.smithi033.stdout:6/708: readlink d12/d2c/d30/d1d/d35/l6d 0 2024-02-15T22:41:00.812 INFO:tasks.workunit.client.0.smithi033.stdout:9/938: dwrite d4/d1d/d23/d24/d5e/f10f [0,4194304] 0 2024-02-15T22:41:00.814 INFO:tasks.workunit.client.0.smithi033.stdout:6/709: getdents d12/d2c/d30/d90/dc7 0 2024-02-15T22:41:00.820 INFO:tasks.workunit.client.0.smithi033.stdout:9/939: dread d4/d1d/d23/d24/d5e/fb4 [0,4194304] 0 2024-02-15T22:41:00.821 INFO:tasks.workunit.client.0.smithi033.stdout:9/940: symlink d4/d1d/d23/d24/d51/d8a/l138 0 2024-02-15T22:41:00.822 INFO:tasks.workunit.client.0.smithi033.stdout:9/941: creat d4/d1d/dd2/ded/d3f/d94/d9c/d119/f139 x:0 0 0 2024-02-15T22:41:00.822 INFO:tasks.workunit.client.0.smithi033.stdout:6/710: write d12/d2c/dc0/fda [1151156,81175] 0 2024-02-15T22:41:00.825 INFO:tasks.workunit.client.0.smithi033.stdout:6/711: creat d12/d3c/d95/d3f/fed x:0 0 0 2024-02-15T22:41:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:9/942: write d4/d1d/d23/d24/d5e/fb4 [269606,97302] 0 2024-02-15T22:41:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:9/943: fdatasync d4/d1d/d23/d32/da7/ddb/f131 0 2024-02-15T22:41:00.827 INFO:tasks.workunit.client.0.smithi033.stdout:9/944: mknod d4/dac/c13a 0 2024-02-15T22:41:00.829 INFO:tasks.workunit.client.0.smithi033.stdout:9/945: write d4/d1d/d23/d32/d71/dab/fb2 [1843299,43877] 0 2024-02-15T22:41:00.829 INFO:tasks.workunit.client.0.smithi033.stdout:9/946: getdents d4/d1d/dd2/ded/d3f/d94/d9c 0 2024-02-15T22:41:00.829 INFO:tasks.workunit.client.0.smithi033.stdout:9/947: dread - d4/d1d/fe4 zero size 2024-02-15T22:41:00.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/948: mkdir d4/d1d/d23/d24/d5a/df1/d13b 0 2024-02-15T22:41:00.831 INFO:tasks.workunit.client.0.smithi033.stdout:9/949: dread - d4/d1d/d23/d32/f67 zero size 2024-02-15T22:41:00.831 INFO:tasks.workunit.client.0.smithi033.stdout:9/950: chown d4/d1d/d23/d35/f104 124 1 2024-02-15T22:41:00.831 INFO:tasks.workunit.client.0.smithi033.stdout:9/951: mknod d4/d1d/d23/d32/da7/c13c 0 2024-02-15T22:41:00.832 INFO:tasks.workunit.client.0.smithi033.stdout:6/712: dread d12/d3c/d95/d3f/d4b/dac/d5c/fba [0,4194304] 0 2024-02-15T22:41:00.832 INFO:tasks.workunit.client.0.smithi033.stdout:9/952: mknod d4/d1d/d23/d24/d5a/c13d 0 2024-02-15T22:41:00.833 INFO:tasks.workunit.client.0.smithi033.stdout:9/953: read d4/d1d/f7a [5514784,50189] 0 2024-02-15T22:41:00.834 INFO:tasks.workunit.client.0.smithi033.stdout:6/713: unlink d12/d3c/d95/d3f/d4b/f6e 0 2024-02-15T22:41:00.858 INFO:tasks.workunit.client.0.smithi033.stdout:9/954: dwrite d4/dac/f10a [0,4194304] 0 2024-02-15T22:41:00.858 INFO:tasks.workunit.client.0.smithi033.stdout:6/714: dwrite d12/d2c/dbc/f84 [4194304,4194304] 0 2024-02-15T22:41:00.858 INFO:tasks.workunit.client.0.smithi033.stdout:6/715: write d12/d3c/d95/fb5 [295200,89702] 0 2024-02-15T22:41:00.860 INFO:tasks.workunit.client.0.smithi033.stdout:9/955: creat d4/dac/db0/f13e x:0 0 0 2024-02-15T22:41:00.860 INFO:tasks.workunit.client.0.smithi033.stdout:9/956: chown d4/d1d/d23/fe3 84923319 1 2024-02-15T22:41:00.860 INFO:tasks.workunit.client.0.smithi033.stdout:9/957: chown d4/d1d/d23/d7b/f134 260777637 1 2024-02-15T22:41:00.875 INFO:tasks.workunit.client.0.smithi033.stdout:9/958: dwrite d4/d1d/d23/d24/f6a [0,4194304] 0 2024-02-15T22:41:00.876 INFO:tasks.workunit.client.0.smithi033.stdout:8/878: sync 2024-02-15T22:41:00.876 INFO:tasks.workunit.client.0.smithi033.stdout:5/940: sync 2024-02-15T22:41:00.876 INFO:tasks.workunit.client.0.smithi033.stdout:8/879: getdents d1/d74/dc1/d75/db1/db5/d122 0 2024-02-15T22:41:00.878 INFO:tasks.workunit.client.0.smithi033.stdout:5/941: creat d6/d14/d31/d48/d49/d53/d57/da1/f12f x:0 0 0 2024-02-15T22:41:00.878 INFO:tasks.workunit.client.0.smithi033.stdout:5/942: chown d6/d14/d31/d48/d49/d53/dd7/d117 523893 1 2024-02-15T22:41:00.878 INFO:tasks.workunit.client.0.smithi033.stdout:8/880: stat d1/d74/dc1/d75/db1/db5/dfb/d14/c97 0 2024-02-15T22:41:00.880 INFO:tasks.workunit.client.0.smithi033.stdout:8/881: creat d1/de/d1a/d27/d10b/f135 x:0 0 0 2024-02-15T22:41:00.880 INFO:tasks.workunit.client.0.smithi033.stdout:8/882: dread - d1/de/d1a/d27/d70/fc4 zero size 2024-02-15T22:41:00.881 INFO:tasks.workunit.client.0.smithi033.stdout:5/943: rename d6/d14/d31/d48/d49/d53/dd7/d117 to d6/d14/d31/d48/d49/d53/d130 0 2024-02-15T22:41:00.883 INFO:tasks.workunit.client.0.smithi033.stdout:8/883: mkdir d1/de/d5c/df4/d136 0 2024-02-15T22:41:00.883 INFO:tasks.workunit.client.0.smithi033.stdout:0/773: sync 2024-02-15T22:41:00.883 INFO:tasks.workunit.client.0.smithi033.stdout:0/774: truncate db/d19/d32/d43/d9f/fcf 26922 0 2024-02-15T22:41:00.883 INFO:tasks.workunit.client.0.smithi033.stdout:0/775: fsync db/d19/d32/d43/f78 0 2024-02-15T22:41:00.883 INFO:tasks.workunit.client.0.smithi033.stdout:5/944: getdents d6/d14/d31/d48/d56/def 0 2024-02-15T22:41:00.885 INFO:tasks.workunit.client.0.smithi033.stdout:8/884: creat d1/de/d1a/d27/d60/f137 x:0 0 0 2024-02-15T22:41:00.885 INFO:tasks.workunit.client.0.smithi033.stdout:8/885: fdatasync d1/de/d1a/d2a/d40/d11b/f80 0 2024-02-15T22:41:00.885 INFO:tasks.workunit.client.0.smithi033.stdout:8/886: chown d1/de/d1a/d27/d60/ce0 888377744 1 2024-02-15T22:41:00.885 INFO:tasks.workunit.client.0.smithi033.stdout:9/959: dread d4/d1d/dd2/ded/fd7 [0,4194304] 0 2024-02-15T22:41:00.885 INFO:tasks.workunit.client.0.smithi033.stdout:5/945: truncate d6/d14/d31/d48/f69 3847024 0 2024-02-15T22:41:00.886 INFO:tasks.workunit.client.0.smithi033.stdout:5/946: write d6/d14/d31/d38/f10a [1173141,100226] 0 2024-02-15T22:41:00.886 INFO:tasks.workunit.client.0.smithi033.stdout:9/960: link d4/d1d/d23/d24/l27 d4/d1d/d23/l13f 0 2024-02-15T22:41:00.886 INFO:tasks.workunit.client.0.smithi033.stdout:9/961: dread - d4/d1d/d23/ffc zero size 2024-02-15T22:41:00.887 INFO:tasks.workunit.client.0.smithi033.stdout:5/947: rmdir d6/d14/d31/d48/d49/d53/dd7 39 2024-02-15T22:41:00.887 INFO:tasks.workunit.client.0.smithi033.stdout:5/948: creat d6/d14/d31/d50/d6a/f131 x:0 0 0 2024-02-15T22:41:00.888 INFO:tasks.workunit.client.0.smithi033.stdout:9/962: dread d4/d1d/d23/d24/d5a/d72/f7e [0,4194304] 0 2024-02-15T22:41:00.890 INFO:tasks.workunit.client.0.smithi033.stdout:5/949: dread d6/d14/d31/d50/d6a/fff [0,4194304] 0 2024-02-15T22:41:00.892 INFO:tasks.workunit.client.0.smithi033.stdout:5/950: mkdir d6/d14/d31/d38/d9b/dd3/d7a/d132 0 2024-02-15T22:41:00.892 INFO:tasks.workunit.client.0.smithi033.stdout:5/951: write d6/faa [464624,121619] 0 2024-02-15T22:41:00.893 INFO:tasks.workunit.client.0.smithi033.stdout:8/887: dread d1/de/d1a/d2a/f10d [0,4194304] 0 2024-02-15T22:41:00.893 INFO:tasks.workunit.client.0.smithi033.stdout:8/888: read - d1/de/d5c/f109 zero size 2024-02-15T22:41:00.897 INFO:tasks.workunit.client.0.smithi033.stdout:8/889: rename d1/d74/dc1/d75/dbf/d79/c21 to d1/d68/d1d/d58/c138 0 2024-02-15T22:41:00.904 INFO:tasks.workunit.client.0.smithi033.stdout:0/776: dwrite db/d2a/d68/d8b/fd7 [0,4194304] 0 2024-02-15T22:41:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:5/952: dwrite d6/d14/d31/d50/d5c/f9e [0,4194304] 0 2024-02-15T22:41:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:8/890: dwrite d1/de/d1a/d27/f132 [0,4194304] 0 2024-02-15T22:41:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:5/953: write d6/d14/df5/f111 [4738387,25279] 0 2024-02-15T22:41:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:9/963: dwrite d4/d1d/d23/d24/d51/d5d/fa2 [0,4194304] 0 2024-02-15T22:41:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:5/954: write d6/db0/d70/f78 [1156566,11503] 0 2024-02-15T22:41:00.939 INFO:tasks.workunit.client.0.smithi033.stdout:8/891: dread d1/d74/dc1/f50 [0,4194304] 0 2024-02-15T22:41:00.939 INFO:tasks.workunit.client.0.smithi033.stdout:8/892: chown d1/d74/dc1/d75/dbf/d79 1991948 1 2024-02-15T22:41:00.945 INFO:tasks.workunit.client.0.smithi033.stdout:9/964: dwrite d4/d1d/d23/d24/d51/d5d/d90/d116/dba/f11c [0,4194304] 0 2024-02-15T22:41:00.947 INFO:tasks.workunit.client.0.smithi033.stdout:9/965: creat d4/d1d/d23/d24/d51/f140 x:0 0 0 2024-02-15T22:41:00.947 INFO:tasks.workunit.client.0.smithi033.stdout:9/966: dread - d4/d1d/d23/d24/d5a/ff3 zero size 2024-02-15T22:41:00.950 INFO:tasks.workunit.client.0.smithi033.stdout:5/955: dwrite d6/fb1 [4194304,4194304] 0 2024-02-15T22:41:00.950 INFO:tasks.workunit.client.0.smithi033.stdout:5/956: truncate d6/faa 830050 0 2024-02-15T22:41:00.952 INFO:tasks.workunit.client.0.smithi033.stdout:9/967: dread d4/d1d/d23/d24/d5e/fb4 [0,4194304] 0 2024-02-15T22:41:00.955 INFO:tasks.workunit.client.0.smithi033.stdout:9/968: rename d4/d1d/d23/d32/d3e to d4/d1d/d23/d24/d5a/d141 0 2024-02-15T22:41:00.955 INFO:tasks.workunit.client.0.smithi033.stdout:9/969: chown d4/d1d/d23/d24/d5a/d141/cbf 12136 1 2024-02-15T22:41:00.955 INFO:tasks.workunit.client.0.smithi033.stdout:9/970: fsync d4/d1d/d23/d24/d5e/f69 0 2024-02-15T22:41:00.956 INFO:tasks.workunit.client.0.smithi033.stdout:9/971: dread d4/d1d/dd2/ded/d3f/d94/f97 [0,4194304] 0 2024-02-15T22:41:00.956 INFO:tasks.workunit.client.0.smithi033.stdout:9/972: dread - d4/d1d/d23/d24/d51/d5d/d90/fa1 zero size 2024-02-15T22:41:00.956 INFO:tasks.workunit.client.0.smithi033.stdout:9/973: stat d4/d1d/d23/d32/da7/ddb/fe9 0 2024-02-15T22:41:00.957 INFO:tasks.workunit.client.0.smithi033.stdout:9/974: mknod d4/c142 0 2024-02-15T22:41:00.958 INFO:tasks.workunit.client.0.smithi033.stdout:9/975: rename d4/cff to d4/d1d/d23/d32/c143 0 2024-02-15T22:41:00.959 INFO:tasks.workunit.client.0.smithi033.stdout:5/957: dread d6/db0/fb4 [0,4194304] 0 2024-02-15T22:41:00.959 INFO:tasks.workunit.client.0.smithi033.stdout:5/958: read d6/d25/d99/fa4 [4653496,90830] 0 2024-02-15T22:41:00.960 INFO:tasks.workunit.client.0.smithi033.stdout:5/959: creat d6/d14/d31/d48/d12e/f133 x:0 0 0 2024-02-15T22:41:00.960 INFO:tasks.workunit.client.0.smithi033.stdout:5/960: write d6/d14/d31/d48/d56/d90/f10f [529033,32905] 0 2024-02-15T22:41:00.960 INFO:tasks.workunit.client.0.smithi033.stdout:5/961: stat d6/f1b 0 2024-02-15T22:41:00.960 INFO:tasks.workunit.client.0.smithi033.stdout:5/962: creat d6/db0/d70/f134 x:0 0 0 2024-02-15T22:41:00.961 INFO:tasks.workunit.client.0.smithi033.stdout:5/963: symlink d6/d14/d31/d48/d49/d53/d57/l135 0 2024-02-15T22:41:00.977 INFO:tasks.workunit.client.0.smithi033.stdout:5/964: dwrite d6/d14/d31/d38/d9b/f115 [4194304,4194304] 0 2024-02-15T22:41:00.979 INFO:tasks.workunit.client.0.smithi033.stdout:5/965: unlink d6/d14/df5/c122 0 2024-02-15T22:41:00.979 INFO:tasks.workunit.client.0.smithi033.stdout:5/966: creat d6/d14/d31/d48/d12e/f136 x:0 0 0 2024-02-15T22:41:00.981 INFO:tasks.workunit.client.0.smithi033.stdout:5/967: mkdir d6/d14/d31/d38/df9/d137 0 2024-02-15T22:41:00.987 INFO:tasks.workunit.client.0.smithi033.stdout:5/968: dread d6/d14/d31/d48/ff3 [0,4194304] 0 2024-02-15T22:41:00.988 INFO:tasks.workunit.client.0.smithi033.stdout:5/969: mknod d6/d25/d99/da8/c138 0 2024-02-15T22:41:00.988 INFO:tasks.workunit.client.0.smithi033.stdout:5/970: creat d6/d14/d31/d50/d6a/f139 x:0 0 0 2024-02-15T22:41:00.989 INFO:tasks.workunit.client.0.smithi033.stdout:5/971: readlink d6/l11 0 2024-02-15T22:41:00.989 INFO:tasks.workunit.client.0.smithi033.stdout:5/972: mkdir d6/d14/d31/d48/d49/d53/d130/d13a 0 2024-02-15T22:41:01.003 INFO:tasks.workunit.client.0.smithi033.stdout:5/973: dwrite d6/d14/d31/d38/d9b/dd2/fa9 [0,4194304] 0 2024-02-15T22:41:01.004 INFO:tasks.workunit.client.0.smithi033.stdout:5/974: fsync d6/d14/d31/d38/d9b/fc8 0 2024-02-15T22:41:01.006 INFO:tasks.workunit.client.0.smithi033.stdout:5/975: creat d6/d14/d31/d38/d9b/dd3/d7a/f13b x:0 0 0 2024-02-15T22:41:01.006 INFO:tasks.workunit.client.0.smithi033.stdout:5/976: rmdir d6/d14 39 2024-02-15T22:41:01.007 INFO:tasks.workunit.client.0.smithi033.stdout:5/977: truncate d6/d25/ffa 146445 0 2024-02-15T22:41:01.007 INFO:tasks.workunit.client.0.smithi033.stdout:5/978: readlink d6/d14/d31/d38/d9b/ld0 0 2024-02-15T22:41:01.007 INFO:tasks.workunit.client.0.smithi033.stdout:5/979: fsync d6/d14/fbd 0 2024-02-15T22:41:01.009 INFO:tasks.workunit.client.0.smithi033.stdout:5/980: unlink d6/d14/d31/d50/d5c/c66 0 2024-02-15T22:41:01.010 INFO:tasks.workunit.client.0.smithi033.stdout:5/981: symlink d6/db0/l13c 0 2024-02-15T22:41:01.011 INFO:tasks.workunit.client.0.smithi033.stdout:5/982: symlink d6/d14/d31/d38/d9b/dd3/d7a/db9/d101/d127/l13d 0 2024-02-15T22:41:01.011 INFO:tasks.workunit.client.0.smithi033.stdout:5/983: fdatasync d6/d14/d31/d48/d49/d53/ff7 0 2024-02-15T22:41:01.011 INFO:tasks.workunit.client.0.smithi033.stdout:5/984: chown d6/d14/d31/d38/df9/d137 46407 1 2024-02-15T22:41:01.012 INFO:tasks.workunit.client.0.smithi033.stdout:5/985: creat d6/d14/d31/d48/d56/def/f13e x:0 0 0 2024-02-15T22:41:01.012 INFO:tasks.workunit.client.0.smithi033.stdout:5/986: fdatasync d6/d14/d31/d50/d6a/daf/fee 0 2024-02-15T22:41:01.013 INFO:tasks.workunit.client.0.smithi033.stdout:5/987: mknod d6/d14/d31/d48/d56/c13f 0 2024-02-15T22:41:01.014 INFO:tasks.workunit.client.0.smithi033.stdout:5/988: dread d6/d14/d31/d50/d6a/fff [0,4194304] 0 2024-02-15T22:41:01.014 INFO:tasks.workunit.client.0.smithi033.stdout:5/989: write d6/d14/d31/d48/d56/def/f13e [909444,7323] 0 2024-02-15T22:41:01.016 INFO:tasks.workunit.client.0.smithi033.stdout:5/990: symlink d6/d14/d31/d50/d6a/dab/d109/l140 0 2024-02-15T22:41:01.017 INFO:tasks.workunit.client.0.smithi033.stdout:5/991: mkdir d6/d14/d31/d38/d9b/dd3/d141 0 2024-02-15T22:41:01.018 INFO:tasks.workunit.client.0.smithi033.stdout:5/992: creat d6/d14/d31/d50/d12d/f142 x:0 0 0 2024-02-15T22:41:01.019 INFO:tasks.workunit.client.0.smithi033.stdout:5/993: creat d6/d14/d31/d50/d6a/dab/d109/f143 x:0 0 0 2024-02-15T22:41:01.020 INFO:tasks.workunit.client.0.smithi033.stdout:5/994: creat d6/db0/d70/d11a/f144 x:0 0 0 2024-02-15T22:41:01.022 INFO:tasks.workunit.client.0.smithi033.stdout:5/995: rename d6/d14/d31/d50/d6a/daf/fd9 to d6/db0/d70/d11a/f145 0 2024-02-15T22:41:01.022 INFO:tasks.workunit.client.0.smithi033.stdout:5/996: write d6/d14/d31/d48/d56/def/f13e [1773430,30491] 0 2024-02-15T22:41:01.022 INFO:tasks.workunit.client.0.smithi033.stdout:5/997: write d6/f16 [1588224,57348] 0 2024-02-15T22:41:01.024 INFO:tasks.workunit.client.0.smithi033.stdout:5/998: truncate d6/f10 3997411 0 2024-02-15T22:41:01.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/999: getdents d6/d14/d31/d50/d5c 0 2024-02-15T22:41:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:1/973: sync 2024-02-15T22:41:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:7/964: sync 2024-02-15T22:41:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:3/975: sync 2024-02-15T22:41:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:1/974: chown d1/d20/d42/l26 3638563 1 2024-02-15T22:41:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:7/965: write d5/df/d40/d89/f9a [2172864,116407] 0 2024-02-15T22:41:01.045 INFO:tasks.workunit.client.0.smithi033.stdout:3/976: truncate d0/d3/d2c/d5d/d3d/db6/fc8 456530 0 2024-02-15T22:41:01.046 INFO:tasks.workunit.client.0.smithi033.stdout:1/975: mkdir d1/de/d27/d39/ddb/de1/d2d/d36/d8b/d11f 0 2024-02-15T22:41:01.047 INFO:tasks.workunit.client.0.smithi033.stdout:3/977: dread d0/d3/d2c/d5d/d3d/d57/d68/dc2/f106 [0,4194304] 0 2024-02-15T22:41:01.048 INFO:tasks.workunit.client.0.smithi033.stdout:3/978: write d0/d3/f17 [4952426,82487] 0 2024-02-15T22:41:01.048 INFO:tasks.workunit.client.0.smithi033.stdout:3/979: creat d0/d3/d5f/da7/f133 x:0 0 0 2024-02-15T22:41:01.050 INFO:tasks.workunit.client.0.smithi033.stdout:3/980: symlink d0/d3/d5f/l134 0 2024-02-15T22:41:01.052 INFO:tasks.workunit.client.0.smithi033.stdout:3/981: symlink d0/d3/d3b/db1/dd8/l135 0 2024-02-15T22:41:01.052 INFO:tasks.workunit.client.0.smithi033.stdout:3/982: chown d0/d3/d2c/d5d/d3d/d8f/dcf/cef 12779 1 2024-02-15T22:41:01.052 INFO:tasks.workunit.client.0.smithi033.stdout:3/983: write d0/d3/d2c/d5d/d3d/d8f/f9c [156738,53661] 0 2024-02-15T22:41:01.055 INFO:tasks.workunit.client.0.smithi033.stdout:1/976: dread d1/f6 [0,4194304] 0 2024-02-15T22:41:01.055 INFO:tasks.workunit.client.0.smithi033.stdout:3/984: creat d0/d3/d3b/db1/dd8/f136 x:0 0 0 2024-02-15T22:41:01.056 INFO:tasks.workunit.client.0.smithi033.stdout:3/985: stat d0/d3/d2c/d43/l10a 0 2024-02-15T22:41:01.058 INFO:tasks.workunit.client.0.smithi033.stdout:1/977: rename d1/d20/d42/d2c/d4e/de5 to d1/d20/d42/d25/d120 0 2024-02-15T22:41:01.059 INFO:tasks.workunit.client.0.smithi033.stdout:3/986: rename d0/d3/d2c/d43/l8b to d0/d3/d77/l137 0 2024-02-15T22:41:01.059 INFO:tasks.workunit.client.0.smithi033.stdout:3/987: chown d0/d3/d5f/l134 0 1 2024-02-15T22:41:01.061 INFO:tasks.workunit.client.0.smithi033.stdout:3/988: mkdir d0/d3/d2c/d5d/d3d/d57/d138 0 2024-02-15T22:41:01.061 INFO:tasks.workunit.client.0.smithi033.stdout:3/989: chown d0/d1c/l3e 222433341 1 2024-02-15T22:41:01.061 INFO:tasks.workunit.client.0.smithi033.stdout:3/990: write d0/d3/d2c/d5d/d3d/d8f/fb9 [2805581,38417] 0 2024-02-15T22:41:01.061 INFO:tasks.workunit.client.0.smithi033.stdout:3/991: chown d0/d3/c3a 12 1 2024-02-15T22:41:01.061 INFO:tasks.workunit.client.0.smithi033.stdout:3/992: chown d0/d3/d2c/d5d/d3d/db4/ff8 535 1 2024-02-15T22:41:01.062 INFO:tasks.workunit.client.0.smithi033.stdout:7/966: dwrite d5/df/d56/f6c [0,4194304] 0 2024-02-15T22:41:01.062 INFO:tasks.workunit.client.0.smithi033.stdout:7/967: chown d5/df/d40/d136/da0/dc6/de4/de5/d7b 17353 1 2024-02-15T22:41:01.063 INFO:tasks.workunit.client.0.smithi033.stdout:7/968: rmdir d5/df/d40/d136/da0/dc6/de4/de9/de6 39 2024-02-15T22:41:01.066 INFO:tasks.workunit.client.0.smithi033.stdout:7/969: mkdir d5/df/d56/d7f/d124/d141 0 2024-02-15T22:41:01.067 INFO:tasks.workunit.client.0.smithi033.stdout:1/978: dread d1/de/d27/d39/ddb/de1/f83 [0,4194304] 0 2024-02-15T22:41:01.067 INFO:tasks.workunit.client.0.smithi033.stdout:1/979: chown d1/de/d27/d39/d3a/dae 2063454503 1 2024-02-15T22:41:01.069 INFO:tasks.workunit.client.0.smithi033.stdout:1/980: rename d1/de/d27/d39/df5/lb2 to d1/d57/db1/l121 0 2024-02-15T22:41:01.069 INFO:tasks.workunit.client.0.smithi033.stdout:1/981: chown d1/de/c18 14577 1 2024-02-15T22:41:01.076 INFO:tasks.workunit.client.0.smithi033.stdout:3/993: dwrite d0/d3/d5f/fcb [0,4194304] 0 2024-02-15T22:41:01.076 INFO:tasks.workunit.client.0.smithi033.stdout:7/970: dread d5/f9b [0,4194304] 0 2024-02-15T22:41:01.080 INFO:tasks.workunit.client.0.smithi033.stdout:3/994: rename d0/d3/dd/d107 to d0/d3/d2c/d5d/d139 0 2024-02-15T22:41:01.083 INFO:tasks.workunit.client.0.smithi033.stdout:3/995: rmdir d0/dc0 39 2024-02-15T22:41:01.084 INFO:tasks.workunit.client.0.smithi033.stdout:3/996: symlink d0/d3/d5f/l13a 0 2024-02-15T22:41:01.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/997: chown d0/d3/dd/c30 431 1 2024-02-15T22:41:01.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/998: read - d0/d3/d2c/d5d/d3d/d8f/dcf/f119 zero size 2024-02-15T22:41:01.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/999: fdatasync d0/d3/d5f/fcc 0 2024-02-15T22:41:01.086 INFO:tasks.workunit.client.0.smithi033.stdout:1/982: dwrite d1/d20/d42/d25/f108 [0,4194304] 0 2024-02-15T22:41:01.089 INFO:tasks.workunit.client.0.smithi033.stdout:1/983: getdents d1/d20/d42/d2c 0 2024-02-15T22:41:01.102 INFO:tasks.workunit.client.0.smithi033.stdout:1/984: dwrite d1/de/d27/d39/ddb/de1/d2d/d5e/d69/fc2 [0,4194304] 0 2024-02-15T22:41:01.104 INFO:tasks.workunit.client.0.smithi033.stdout:1/985: link d1/d20/d42/d25/cde d1/de/d27/d39/d3a/dae/c122 0 2024-02-15T22:41:01.105 INFO:tasks.workunit.client.0.smithi033.stdout:1/986: fdatasync d1/d20/d42/fbf 0 2024-02-15T22:41:01.106 INFO:tasks.workunit.client.0.smithi033.stdout:1/987: unlink d1/caa 0 2024-02-15T22:41:01.106 INFO:tasks.workunit.client.0.smithi033.stdout:1/988: fdatasync d1/de/d27/d39/ddb/de1/d2d/d5e/f61 0 2024-02-15T22:41:01.107 INFO:tasks.workunit.client.0.smithi033.stdout:1/989: rename d1/de/d27/d39/df5/d8f/fef to d1/de/d27/d39/df5/d92/f123 0 2024-02-15T22:41:01.128 INFO:tasks.workunit.client.0.smithi033.stdout:1/990: dwrite d1/d57/f5f [0,4194304] 0 2024-02-15T22:41:01.132 INFO:tasks.workunit.client.0.smithi033.stdout:1/991: dread d1/de/d27/d39/d3a/da3/f70 [0,4194304] 0 2024-02-15T22:41:01.134 INFO:tasks.workunit.client.0.smithi033.stdout:1/992: getdents d1/de/d27/d39/ddb/de1/d79/d9f 0 2024-02-15T22:41:01.149 INFO:tasks.workunit.client.0.smithi033.stdout:1/993: dwrite d1/de/d27/d39/d3a/da3/f70 [4194304,4194304] 0 2024-02-15T22:41:01.150 INFO:tasks.workunit.client.0.smithi033.stdout:1/994: dread - d1/de/d27/d39/ddb/de1/d2d/d5e/d69/dca/fd6 zero size 2024-02-15T22:41:01.150 INFO:tasks.workunit.client.0.smithi033.stdout:1/995: symlink d1/de/d27/d39/ddb/de1/d2d/d5e/l124 0 2024-02-15T22:41:01.154 INFO:tasks.workunit.client.0.smithi033.stdout:1/996: dread d1/d20/d42/d25/f60 [0,4194304] 0 2024-02-15T22:41:01.155 INFO:tasks.workunit.client.0.smithi033.stdout:1/997: mkdir d1/de/d27/d39/ddb/de1/d2d/d5e/d125 0 2024-02-15T22:41:01.173 INFO:tasks.workunit.client.0.smithi033.stdout:1/998: dwrite d1/d20/d42/d25/d120/fea [0,4194304] 0 2024-02-15T22:41:01.175 INFO:tasks.workunit.client.0.smithi033.stdout:1/999: link d1/de/d27/d39/ddb/de1/d2d/d5e/d69/cf0 d1/de/d27/d39/d3a/dae/c126 0 2024-02-15T22:41:01.200 INFO:tasks.workunit.client.0.smithi033.stdout:6/716: sync 2024-02-15T22:41:01.207 INFO:tasks.workunit.client.0.smithi033.stdout:6/717: read d12/d3c/f44 [3830891,7292] 0 2024-02-15T22:41:01.207 INFO:tasks.workunit.client.0.smithi033.stdout:6/718: stat d12/d2c/f63 0 2024-02-15T22:41:01.207 INFO:tasks.workunit.client.0.smithi033.stdout:6/719: chown d12/d3c/d95/d3f/d50/dbd/cd8 875 1 2024-02-15T22:41:01.209 INFO:tasks.workunit.client.0.smithi033.stdout:6/720: unlink d12/d3c/d95/d3f/d50/f81 0 2024-02-15T22:41:01.215 INFO:tasks.workunit.client.0.smithi033.stdout:6/721: dread d12/f18 [0,4194304] 0 2024-02-15T22:41:01.215 INFO:tasks.workunit.client.0.smithi033.stdout:6/722: fdatasync d12/d3c/d95/d3f/db6/fc9 0 2024-02-15T22:41:01.215 INFO:tasks.workunit.client.0.smithi033.stdout:6/723: chown d12/d3c/d95/d3f/f43 1105 1 2024-02-15T22:41:01.215 INFO:tasks.workunit.client.0.smithi033.stdout:6/724: chown d12/d2c/d30/f36 3918040 1 2024-02-15T22:41:01.215 INFO:tasks.workunit.client.0.smithi033.stdout:6/725: mknod d12/d2c/dc3/cee 0 2024-02-15T22:41:01.228 INFO:tasks.workunit.client.0.smithi033.stdout:6/726: dwrite d12/f18 [8388608,4194304] 0 2024-02-15T22:41:01.231 INFO:tasks.workunit.client.0.smithi033.stdout:6/727: getdents d12/d2c 0 2024-02-15T22:41:01.242 INFO:tasks.workunit.client.0.smithi033.stdout:9/976: sync 2024-02-15T22:41:01.242 INFO:tasks.workunit.client.0.smithi033.stdout:0/777: sync 2024-02-15T22:41:01.242 INFO:tasks.workunit.client.0.smithi033.stdout:8/893: sync 2024-02-15T22:41:01.242 INFO:tasks.workunit.client.0.smithi033.stdout:8/894: readlink d1/d74/dc1/d75/dbf/lb2 0 2024-02-15T22:41:01.243 INFO:tasks.workunit.client.0.smithi033.stdout:9/977: rmdir d4 39 2024-02-15T22:41:01.245 INFO:tasks.workunit.client.0.smithi033.stdout:6/728: dwrite d12/d2c/d30/f3d [0,4194304] 0 2024-02-15T22:41:01.246 INFO:tasks.workunit.client.0.smithi033.stdout:9/978: link d4/d1d/f2c d4/d1d/d23/d24/d5a/df1/f144 0 2024-02-15T22:41:01.247 INFO:tasks.workunit.client.0.smithi033.stdout:8/895: getdents d1/d36 0 2024-02-15T22:41:01.247 INFO:tasks.workunit.client.0.smithi033.stdout:8/896: dread - d1/d74/f112 zero size 2024-02-15T22:41:01.247 INFO:tasks.workunit.client.0.smithi033.stdout:8/897: chown d1/d68/d44/dc3 0 1 2024-02-15T22:41:01.247 INFO:tasks.workunit.client.0.smithi033.stdout:8/898: chown d1/d74/c88 166578 1 2024-02-15T22:41:01.248 INFO:tasks.workunit.client.0.smithi033.stdout:9/979: link d4/d1d/c20 d4/dac/db0/dc8/c145 0 2024-02-15T22:41:01.248 INFO:tasks.workunit.client.0.smithi033.stdout:9/980: write d4/d1d/dd2/f118 [1548697,124165] 0 2024-02-15T22:41:01.249 INFO:tasks.workunit.client.0.smithi033.stdout:8/899: mknod d1/de/d1a/c139 0 2024-02-15T22:41:01.249 INFO:tasks.workunit.client.0.smithi033.stdout:8/900: write d1/de/d5c/df4/ffc [678506,76791] 0 2024-02-15T22:41:01.249 INFO:tasks.workunit.client.0.smithi033.stdout:8/901: fsync d1/d74/dc1/d75/db1/db5/dfb/d14/fb7 0 2024-02-15T22:41:01.250 INFO:tasks.workunit.client.0.smithi033.stdout:9/981: write d4/d1d/d23/d24/d51/d5d/dbc/fe8 [662160,83358] 0 2024-02-15T22:41:01.251 INFO:tasks.workunit.client.0.smithi033.stdout:9/982: link d4/dac/db0/dc8/c145 d4/d1d/d23/d24/d5a/d141/c146 0 2024-02-15T22:41:01.252 INFO:tasks.workunit.client.0.smithi033.stdout:9/983: symlink d4/d1d/dd2/ded/d3f/dc7/l147 0 2024-02-15T22:41:01.257 INFO:tasks.workunit.client.0.smithi033.stdout:6/729: read d12/d3c/f91 [1293713,79290] 0 2024-02-15T22:41:01.258 INFO:tasks.workunit.client.0.smithi033.stdout:6/730: creat d12/d2c/d30/d90/dc7/dd6/fef x:0 0 0 2024-02-15T22:41:01.259 INFO:tasks.workunit.client.0.smithi033.stdout:6/731: mknod d12/d2c/d30/da5/cf0 0 2024-02-15T22:41:01.259 INFO:tasks.workunit.client.0.smithi033.stdout:8/902: read d1/d74/fc6 [3665152,43200] 0 2024-02-15T22:41:01.262 INFO:tasks.workunit.client.0.smithi033.stdout:8/903: rename d1/d74/dc1/d75/dbf/d79/fca to d1/d74/dc1/d75/dbf/d79/d94/dd1/f13a 0 2024-02-15T22:41:01.272 INFO:tasks.workunit.client.0.smithi033.stdout:0/778: dwrite db/d2a/d6e/d7a/fbc [4194304,4194304] 0 2024-02-15T22:41:01.272 INFO:tasks.workunit.client.0.smithi033.stdout:0/779: chown db/d19/d32/d43/d7d/l92 103309 1 2024-02-15T22:41:01.273 INFO:tasks.workunit.client.0.smithi033.stdout:9/984: dwrite d4/d1d/d23/d32/f106 [0,4194304] 0 2024-02-15T22:41:01.273 INFO:tasks.workunit.client.0.smithi033.stdout:9/985: chown d4/d1d/d23/d24/d51/d5d/l95 201 1 2024-02-15T22:41:01.276 INFO:tasks.workunit.client.0.smithi033.stdout:0/780: getdents db/d19/d32/d46 0 2024-02-15T22:41:01.276 INFO:tasks.workunit.client.0.smithi033.stdout:0/781: write db/d19/d32/fb7 [1374035,65989] 0 2024-02-15T22:41:01.277 INFO:tasks.workunit.client.0.smithi033.stdout:0/782: symlink db/l10a 0 2024-02-15T22:41:01.277 INFO:tasks.workunit.client.0.smithi033.stdout:0/783: truncate db/d19/dd8/fee 886302 0 2024-02-15T22:41:01.277 INFO:tasks.workunit.client.0.smithi033.stdout:0/784: chown db/d60/lae 50368 1 2024-02-15T22:41:01.283 INFO:tasks.workunit.client.0.smithi033.stdout:7/971: sync 2024-02-15T22:41:01.284 INFO:tasks.workunit.client.0.smithi033.stdout:7/972: fsync d5/df/d56/d60/d59/f121 0 2024-02-15T22:41:01.289 INFO:tasks.workunit.client.0.smithi033.stdout:6/732: dwrite d12/d3c/fcf [0,4194304] 0 2024-02-15T22:41:01.289 INFO:tasks.workunit.client.0.smithi033.stdout:6/733: write d12/d3c/d95/d3f/d4b/fa0 [817650,100162] 0 2024-02-15T22:41:01.289 INFO:tasks.workunit.client.0.smithi033.stdout:6/734: fsync d12/d3c/d95/d3f/d4b/dac/d5c/fba 0 2024-02-15T22:41:01.293 INFO:tasks.workunit.client.0.smithi033.stdout:8/904: dwrite d1/d74/dc1/d75/d83/fa9 [0,4194304] 0 2024-02-15T22:41:01.298 INFO:tasks.workunit.client.0.smithi033.stdout:0/785: dwrite db/d19/d32/d43/d5a/d76/f86 [0,4194304] 0 2024-02-15T22:41:01.446 INFO:tasks.workunit.client.0.smithi033.stdout:6/735: rmdir d12/d3c/d95/d3f/d4b/d6f 39 2024-02-15T22:41:01.447 INFO:tasks.workunit.client.0.smithi033.stdout:6/736: rename d12/d2c/d30/d1d/fa6 to d12/d3c/d95/d3f/d50/ff1 0 2024-02-15T22:41:01.447 INFO:tasks.workunit.client.0.smithi033.stdout:6/737: stat d12/d3c/d95/d3f/c56 0 2024-02-15T22:41:01.454 INFO:tasks.workunit.client.1.smithi082.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T22:41:01.466 INFO:tasks.workunit.client.0.smithi033.stdout:6/738: dwrite d12/d2c/d30/d1d/f46 [0,4194304] 0 2024-02-15T22:41:01.466 INFO:tasks.workunit.client.1.smithi082.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:41:01.466 INFO:tasks.workunit.client.1.smithi082.stderr:+ make 2024-02-15T22:41:01.467 INFO:tasks.workunit.client.0.smithi033.stdout:6/739: creat d12/ff2 x:0 0 0 2024-02-15T22:41:01.475 INFO:tasks.workunit.client.0.smithi033.stdout:6/740: write d12/d2c/fde [7616600,113959] 0 2024-02-15T22:41:01.475 INFO:tasks.workunit.client.0.smithi033.stdout:6/741: dread d12/d3c/d95/d3f/d50/dbd/fea [0,4194304] 0 2024-02-15T22:41:01.476 INFO:tasks.workunit.client.0.smithi033.stdout:6/742: mkdir d12/d3c/d95/d3f/db6/df3 0 2024-02-15T22:41:01.476 INFO:tasks.workunit.client.0.smithi033.stdout:6/743: dread - d12/d2c/d30/d90/dc7/dd6/fef zero size 2024-02-15T22:41:01.477 INFO:tasks.workunit.client.0.smithi033.stdout:6/744: chown d12/d2c/d30/cb1 509 1 2024-02-15T22:41:01.478 INFO:tasks.workunit.client.0.smithi033.stdout:6/745: unlink d12/d2c/dbc/f94 0 2024-02-15T22:41:01.491 INFO:tasks.workunit.client.0.smithi033.stdout:6/746: dwrite d12/d3c/d95/d3f/d50/f65 [0,4194304] 0 2024-02-15T22:41:01.491 INFO:tasks.workunit.client.0.smithi033.stdout:6/747: readlink d12/d3c/d95/ldd 0 2024-02-15T22:41:01.492 INFO:tasks.workunit.client.0.smithi033.stdout:6/748: creat d12/d2c/dc0/dc8/ff4 x:0 0 0 2024-02-15T22:41:01.492 INFO:tasks.workunit.client.0.smithi033.stdout:6/749: fsync d12/d3c/d95/d3f/d4b/dac/d5c/fba 0 2024-02-15T22:41:01.505 INFO:tasks.workunit.client.0.smithi033.stdout:6/750: dwrite d12/d3c/d95/d3f/d4b/fa0 [0,4194304] 0 2024-02-15T22:41:01.505 INFO:tasks.workunit.client.0.smithi033.stdout:6/751: creat d12/d3c/d95/d3f/d50/ff5 x:0 0 0 2024-02-15T22:41:01.505 INFO:tasks.workunit.client.0.smithi033.stdout:6/752: readlink d12/d2c/d30/l51 0 2024-02-15T22:41:01.509 INFO:tasks.workunit.client.0.smithi033.stdout:6/753: unlink d12/d3c/d95/ldd 0 2024-02-15T22:41:01.513 INFO:tasks.workunit.client.0.smithi033.stdout:6/754: dread d12/d3c/d95/d3f/da3/fe1 [0,4194304] 0 2024-02-15T22:41:01.513 INFO:tasks.workunit.client.0.smithi033.stdout:6/755: getdents d12/d3c/d95/d3f/d4b/d6f 0 2024-02-15T22:41:01.513 INFO:tasks.workunit.client.0.smithi033.stdout:6/756: chown d12/d2c/dc0/db7 4 1 2024-02-15T22:41:01.513 INFO:tasks.workunit.client.0.smithi033.stdout:6/757: dread - d12/fdf zero size 2024-02-15T22:41:01.513 INFO:tasks.workunit.client.0.smithi033.stdout:6/758: stat d12/d2c/d30/c76 0 2024-02-15T22:41:01.513 INFO:tasks.workunit.client.0.smithi033.stdout:6/759: chown d12/d2c/fde 91400721 1 2024-02-15T22:41:01.513 INFO:tasks.workunit.client.0.smithi033.stdout:6/760: chown d12/d2c/dbc/lae 1264653 1 2024-02-15T22:41:01.514 INFO:tasks.workunit.client.0.smithi033.stdout:6/761: dread d12/d3c/d95/d3f/d4b/dac/f7c [0,4194304] 0 2024-02-15T22:41:01.515 INFO:tasks.workunit.client.0.smithi033.stdout:6/762: fdatasync d12/d2c/d30/f7e 0 2024-02-15T22:41:01.515 INFO:tasks.workunit.client.0.smithi033.stdout:6/763: creat d12/d2c/d30/d90/dc7/ff6 x:0 0 0 2024-02-15T22:41:01.517 INFO:tasks.workunit.client.0.smithi033.stdout:6/764: rename d12/f5d to d12/d2c/d30/d90/dc7/dd6/ff7 0 2024-02-15T22:41:01.517 INFO:tasks.workunit.client.0.smithi033.stdout:6/765: mknod d12/d2c/dc0/cf8 0 2024-02-15T22:41:01.518 INFO:tasks.workunit.client.0.smithi033.stdout:9/986: sync 2024-02-15T22:41:01.518 INFO:tasks.workunit.client.0.smithi033.stdout:9/987: truncate d4/d1d/f126 289056 0 2024-02-15T22:41:01.518 INFO:tasks.workunit.client.0.smithi033.stdout:9/988: write d4/d1d/d23/d24/d5a/d141/f64 [2378705,92226] 0 2024-02-15T22:41:01.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/989: mknod d4/d1d/d23/c148 0 2024-02-15T22:41:01.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/990: chown d4/d1d/d23/d35/la9 90025 1 2024-02-15T22:41:01.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/991: read d4/d1d/dd2/ded/fdc [212722,127250] 0 2024-02-15T22:41:01.524 INFO:tasks.workunit.client.0.smithi033.stdout:6/766: write d12/d3c/d95/d3f/d4b/fa0 [2962492,42826] 0 2024-02-15T22:41:01.525 INFO:tasks.workunit.client.0.smithi033.stdout:6/767: truncate d12/f13 4005270 0 2024-02-15T22:41:01.525 INFO:tasks.workunit.client.0.smithi033.stdout:6/768: truncate d12/fad 596194 0 2024-02-15T22:41:01.547 INFO:tasks.workunit.client.0.smithi033.stdout:9/992: dwrite d4/d1d/d23/d24/d5a/d141/f64 [0,4194304] 0 2024-02-15T22:41:01.547 INFO:tasks.workunit.client.0.smithi033.stdout:9/993: rmdir d4/d1d/d23/d24/d5a/d72 39 2024-02-15T22:41:01.549 INFO:tasks.workunit.client.0.smithi033.stdout:6/769: dwrite d12/d3c/d95/d3f/f89 [0,4194304] 0 2024-02-15T22:41:01.549 INFO:tasks.workunit.client.0.smithi033.stdout:6/770: truncate d12/d2c/d30/d90/fca 1003824 0 2024-02-15T22:41:01.549 INFO:tasks.workunit.client.0.smithi033.stdout:6/771: write d12/d2c/dbc/f8f [602684,17521] 0 2024-02-15T22:41:01.549 INFO:tasks.workunit.client.0.smithi033.stdout:6/772: creat d12/d2c/dc0/ff9 x:0 0 0 2024-02-15T22:41:01.555 INFO:tasks.workunit.client.0.smithi033.stdout:6/773: mkdir d12/d2c/d30/d1d/dfa 0 2024-02-15T22:41:01.555 INFO:tasks.workunit.client.0.smithi033.stdout:6/774: fsync d12/d3c/d95/d3f/d4b/dac/f77 0 2024-02-15T22:41:01.561 INFO:tasks.workunit.client.0.smithi033.stdout:6/775: write d12/d3c/d95/d3f/da3/fe2 [15413,38120] 0 2024-02-15T22:41:01.561 INFO:tasks.workunit.client.0.smithi033.stdout:6/776: chown d12/d3c/d95/d3f/d4b/dac/d5c/ce6 32971276 1 2024-02-15T22:41:01.561 INFO:tasks.workunit.client.0.smithi033.stdout:9/994: dwrite d4/d1d/dd2/ded/f78 [0,4194304] 0 2024-02-15T22:41:01.570 INFO:tasks.workunit.client.0.smithi033.stdout:9/995: dread d4/d1d/d23/d35/f77 [0,4194304] 0 2024-02-15T22:41:01.570 INFO:tasks.workunit.client.0.smithi033.stdout:9/996: stat d4/dac 0 2024-02-15T22:41:01.571 INFO:tasks.workunit.client.0.smithi033.stdout:9/997: link d4/d1d/d23/d32/c40 d4/d1d/d23/d32/da7/c149 0 2024-02-15T22:41:01.571 INFO:tasks.workunit.client.0.smithi033.stdout:8/905: sync 2024-02-15T22:41:01.572 INFO:tasks.workunit.client.0.smithi033.stdout:7/973: sync 2024-02-15T22:41:01.572 INFO:tasks.workunit.client.0.smithi033.stdout:0/786: sync 2024-02-15T22:41:01.572 INFO:tasks.workunit.client.0.smithi033.stdout:7/974: read - d5/df/d40/d136/da0/dc6/de4/de5/fcb zero size 2024-02-15T22:41:01.573 INFO:tasks.workunit.client.0.smithi033.stdout:0/787: symlink db/d2a/d68/d8b/dbf/l10b 0 2024-02-15T22:41:01.573 INFO:tasks.workunit.client.0.smithi033.stdout:0/788: fdatasync f4 0 2024-02-15T22:41:01.574 INFO:tasks.workunit.client.0.smithi033.stdout:7/975: dread d5/df/d56/d60/d59/f8d [0,4194304] 0 2024-02-15T22:41:01.574 INFO:tasks.workunit.client.0.smithi033.stdout:7/976: write d5/dc/d5f/f11a [1061969,14078] 0 2024-02-15T22:41:01.577 INFO:tasks.workunit.client.0.smithi033.stdout:7/977: mkdir d5/d6/d10/d100/d142 0 2024-02-15T22:41:01.578 INFO:tasks.workunit.client.0.smithi033.stdout:7/978: chown d5/df/d40/d73/fee 4651 1 2024-02-15T22:41:01.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/777: dwrite d12/d3c/d95/d3f/f89 [0,4194304] 0 2024-02-15T22:41:01.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/778: fsync d12/d2c/d30/d90/fe9 0 2024-02-15T22:41:01.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/779: fdatasync d12/d2c/d30/d1d/f82 0 2024-02-15T22:41:01.583 INFO:tasks.workunit.client.0.smithi033.stdout:9/998: dread d4/d1d/d23/f98 [0,4194304] 0 2024-02-15T22:41:01.585 INFO:tasks.workunit.client.0.smithi033.stdout:6/780: unlink d12/d2c/d30/d90/dc7/dd6/ff7 0 2024-02-15T22:41:01.586 INFO:tasks.workunit.client.0.smithi033.stdout:9/999: rmdir d4/d1d/dd2/ded 39 2024-02-15T22:41:01.593 INFO:tasks.workunit.client.0.smithi033.stdout:6/781: dread d12/f13 [0,4194304] 0 2024-02-15T22:41:01.593 INFO:tasks.workunit.client.0.smithi033.stdout:6/782: stat d12/d2c/dc0/dc8/cd5 0 2024-02-15T22:41:01.595 INFO:tasks.workunit.client.0.smithi033.stdout:6/783: unlink d12/d3c/d95/d3f/d4b/dac/d5c/ce6 0 2024-02-15T22:41:01.596 INFO:tasks.workunit.client.0.smithi033.stdout:6/784: mkdir d12/d2c/dc0/dc8/dfb 0 2024-02-15T22:41:01.598 INFO:tasks.workunit.client.0.smithi033.stdout:6/785: rename d12/d3c/d95/d3f/d4b/d6f to d12/d3c/d95/d3f/d50/dfc 0 2024-02-15T22:41:01.598 INFO:tasks.workunit.client.0.smithi033.stdout:6/786: truncate d12/d3c/d95/d3f/d50/dbd/dcb/feb 518477 0 2024-02-15T22:41:01.598 INFO:tasks.workunit.client.0.smithi033.stdout:6/787: truncate d12/d3c/d95/d3f/d50/dbd/fea 808213 0 2024-02-15T22:41:01.599 INFO:tasks.workunit.client.0.smithi033.stdout:6/788: mkdir d12/d3c/d95/d3f/d50/dfc/dfd 0 2024-02-15T22:41:01.599 INFO:tasks.workunit.client.0.smithi033.stdout:6/789: chown d12/d3c/d95/d3f/d50/ff5 76200 1 2024-02-15T22:41:01.599 INFO:tasks.workunit.client.0.smithi033.stdout:6/790: creat d12/d2c/d30/d90/dc7/ffe x:0 0 0 2024-02-15T22:41:01.599 INFO:tasks.workunit.client.0.smithi033.stdout:6/791: fdatasync d12/d3c/d95/d3f/f89 0 2024-02-15T22:41:01.600 INFO:tasks.workunit.client.0.smithi033.stdout:6/792: write d12/d3c/f4c [32525,72170] 0 2024-02-15T22:41:01.600 INFO:tasks.workunit.client.0.smithi033.stdout:6/793: mknod d12/d3c/d95/d3f/d50/dfc/dfd/cff 0 2024-02-15T22:41:01.602 INFO:tasks.workunit.client.0.smithi033.stdout:8/906: dwrite d1/de/d1a/d27/fe7 [4194304,4194304] 0 2024-02-15T22:41:01.602 INFO:tasks.workunit.client.0.smithi033.stdout:8/907: truncate d1/de/d1a/d27/d10b/f135 509056 0 2024-02-15T22:41:01.609 INFO:tasks.workunit.client.0.smithi033.stdout:7/979: dwrite d5/df/d40/d136/da1/d26/d3f/f11e [0,4194304] 0 2024-02-15T22:41:01.611 INFO:tasks.workunit.client.0.smithi033.stdout:0/789: dwrite db/d19/d32/d43/d5a/d76/fc1 [0,4194304] 0 2024-02-15T22:41:01.611 INFO:tasks.workunit.client.0.smithi033.stdout:0/790: chown db/d19/d32/d43/d7d/l92 48 1 2024-02-15T22:41:01.611 INFO:tasks.workunit.client.0.smithi033.stdout:7/980: link d5/df/d56/d99/ce8 d5/d6/c143 0 2024-02-15T22:41:01.611 INFO:tasks.workunit.client.0.smithi033.stdout:7/981: fdatasync d5/df/d40/d136/da0/dc6/de4/de9/f109 0 2024-02-15T22:41:01.611 INFO:tasks.workunit.client.0.smithi033.stdout:6/794: dread d12/f28 [0,4194304] 0 2024-02-15T22:41:01.613 INFO:tasks.workunit.client.0.smithi033.stdout:7/982: symlink d5/df/d40/d136/l144 0 2024-02-15T22:41:01.615 INFO:tasks.workunit.client.0.smithi033.stdout:7/983: creat d5/df/d40/d136/de1/f145 x:0 0 0 2024-02-15T22:41:01.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/908: read d1/de/d1a/f6e [1597496,67661] 0 2024-02-15T22:41:01.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/909: fsync d1/d68/d44/dd3/fea 0 2024-02-15T22:41:01.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/910: fdatasync d1/d74/dc1/d75/dbf/d79/d94/d10f/f12c 0 2024-02-15T22:41:01.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/911: stat d1/de/d1a/d2a/d40/d11b/l11c 0 2024-02-15T22:41:01.616 INFO:tasks.workunit.client.0.smithi033.stdout:7/984: symlink d5/df/d40/d89/l146 0 2024-02-15T22:41:01.617 INFO:tasks.workunit.client.0.smithi033.stdout:8/912: dread d1/d68/d44/fb9 [0,4194304] 0 2024-02-15T22:41:01.617 INFO:tasks.workunit.client.0.smithi033.stdout:8/913: write d1/de/d1a/d2a/d40/d11b/fba [301991,85591] 0 2024-02-15T22:41:01.619 INFO:tasks.workunit.client.0.smithi033.stdout:8/914: link d1/d68/d57/l5b d1/d74/dc1/d75/db1/db5/dfb/d14/l13b 0 2024-02-15T22:41:01.619 INFO:tasks.workunit.client.0.smithi033.stdout:8/915: truncate d1/de/d1a/f10a 243170 0 2024-02-15T22:41:01.619 INFO:tasks.workunit.client.0.smithi033.stdout:8/916: write d1/d68/d1d/fd0 [1048537,89385] 0 2024-02-15T22:41:01.619 INFO:tasks.workunit.client.0.smithi033.stdout:0/791: dread db/d19/d32/f3c [0,4194304] 0 2024-02-15T22:41:01.621 INFO:tasks.workunit.client.0.smithi033.stdout:8/917: mkdir d1/d74/dc1/d75/dbf/d79/d13c 0 2024-02-15T22:41:01.623 INFO:tasks.workunit.client.0.smithi033.stdout:8/918: mkdir d1/d74/dc1/d75/db1/db5/dfb/d14/d13d 0 2024-02-15T22:41:01.623 INFO:tasks.workunit.client.0.smithi033.stdout:8/919: read - d1/de/d1a/fdd zero size 2024-02-15T22:41:01.625 INFO:tasks.workunit.client.0.smithi033.stdout:7/985: write d5/d6/f54 [2443566,68280] 0 2024-02-15T22:41:01.625 INFO:tasks.workunit.client.0.smithi033.stdout:7/986: write d5/f31 [778228,96126] 0 2024-02-15T22:41:01.636 INFO:tasks.workunit.client.0.smithi033.stdout:8/920: dread d1/d74/dc1/d75/db1/db5/dfb/d14/f1b [0,4194304] 0 2024-02-15T22:41:01.636 INFO:tasks.workunit.client.0.smithi033.stdout:6/795: dwrite d12/d3c/d95/d3f/d4b/dac/f77 [0,4194304] 0 2024-02-15T22:41:01.636 INFO:tasks.workunit.client.0.smithi033.stdout:8/921: chown d1/d74/dc1/d75/dbf/d79/f113 0 1 2024-02-15T22:41:01.636 INFO:tasks.workunit.client.0.smithi033.stdout:8/922: fsync d1/de/d1a/d27/d60/fab 0 2024-02-15T22:41:01.636 INFO:tasks.workunit.client.0.smithi033.stdout:7/987: fdatasync d5/f31 0 2024-02-15T22:41:01.636 INFO:tasks.workunit.client.0.smithi033.stdout:0/792: dwrite db/d60/dec/fef [0,4194304] 0 2024-02-15T22:41:01.638 INFO:tasks.workunit.client.0.smithi033.stdout:6/796: symlink d12/d2c/dbc/l100 0 2024-02-15T22:41:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:8/923: dread d1/d74/dc1/f50 [0,4194304] 0 2024-02-15T22:41:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:8/924: fsync d1/d74/dc1/d75/db1/db5/f12e 0 2024-02-15T22:41:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:8/925: write d1/d68/d44/fe1 [843915,96296] 0 2024-02-15T22:41:01.642 INFO:tasks.workunit.client.0.smithi033.stdout:8/926: mknod d1/d74/dc1/d75/dbf/c13e 0 2024-02-15T22:41:01.643 INFO:tasks.workunit.client.0.smithi033.stdout:8/927: unlink d1/de/d5c/cbe 0 2024-02-15T22:41:01.645 INFO:tasks.workunit.client.0.smithi033.stdout:8/928: mknod d1/de/d1a/d27/d60/c13f 0 2024-02-15T22:41:01.650 INFO:tasks.workunit.client.0.smithi033.stdout:6/797: write d12/d2c/d30/d1d/f60 [2893993,80941] 0 2024-02-15T22:41:01.657 INFO:tasks.workunit.client.0.smithi033.stdout:7/988: dwrite d5/df/d56/d99/f119 [0,4194304] 0 2024-02-15T22:41:01.657 INFO:tasks.workunit.client.0.smithi033.stdout:0/793: dwrite db/d19/d32/d3d/f44 [0,4194304] 0 2024-02-15T22:41:01.659 INFO:tasks.workunit.client.0.smithi033.stdout:8/929: dread d1/d68/d44/fe1 [0,4194304] 0 2024-02-15T22:41:01.659 INFO:tasks.workunit.client.0.smithi033.stdout:8/930: write d1/de/d1a/d2a/f10d [1249156,119332] 0 2024-02-15T22:41:01.659 INFO:tasks.workunit.client.0.smithi033.stdout:8/931: stat d1/de/d1a/d27/f7c 0 2024-02-15T22:41:01.660 INFO:tasks.workunit.client.0.smithi033.stdout:0/794: symlink db/d2a/d68/d8b/dbf/l10c 0 2024-02-15T22:41:01.660 INFO:tasks.workunit.client.0.smithi033.stdout:0/795: chown db/d2a/d68/d8b/dbf/l10c 16254478 1 2024-02-15T22:41:01.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/932: symlink d1/de/d1a/d27/d55/l140 0 2024-02-15T22:41:01.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/933: chown d1/d74/dc1/d75/db1/dde/cfe 65530 1 2024-02-15T22:41:01.666 INFO:tasks.workunit.client.0.smithi033.stdout:8/934: write d1/d68/d57/f134 [429462,16447] 0 2024-02-15T22:41:01.666 INFO:tasks.workunit.client.0.smithi033.stdout:0/796: mknod db/d2a/d6e/c10d 0 2024-02-15T22:41:01.667 INFO:tasks.workunit.client.0.smithi033.stdout:8/935: fdatasync d1/d68/d57/f134 0 2024-02-15T22:41:01.669 INFO:tasks.workunit.client.0.smithi033.stdout:8/936: dread d1/d68/d57/fc5 [0,4194304] 0 2024-02-15T22:41:01.672 INFO:tasks.workunit.client.0.smithi033.stdout:8/937: rename d1/d74/dc1/d75/dbf/d79/d94/d10f to d1/d74/dc1/d75/db1/db5/dfb/d14/d5d/d141 0 2024-02-15T22:41:01.680 INFO:tasks.workunit.client.0.smithi033.stdout:8/938: write d1/d68/d44/d49/fb3 [821651,76856] 0 2024-02-15T22:41:01.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/939: dread d1/de/d1a/f116 [0,4194304] 0 2024-02-15T22:41:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:8/940: dwrite d1/de/f37 [0,4194304] 0 2024-02-15T22:41:01.702 INFO:tasks.workunit.client.0.smithi033.stdout:8/941: creat d1/d68/d44/d49/d119/f142 x:0 0 0 2024-02-15T22:41:01.702 INFO:tasks.workunit.client.0.smithi033.stdout:8/942: write d1/de/d1a/d2a/f3c [1979060,41170] 0 2024-02-15T22:41:01.703 INFO:tasks.workunit.client.0.smithi033.stdout:8/943: link d1/d68/d44/f8d d1/d74/dc1/d75/db1/f143 0 2024-02-15T22:41:01.703 INFO:tasks.workunit.client.0.smithi033.stdout:8/944: truncate d1/dae/dcf/fec 1033248 0 2024-02-15T22:41:01.705 INFO:tasks.workunit.client.0.smithi033.stdout:8/945: dread d1/d68/d1d/fd0 [0,4194304] 0 2024-02-15T22:41:01.706 INFO:tasks.workunit.client.0.smithi033.stdout:8/946: dread d1/d68/d57/fc5 [0,4194304] 0 2024-02-15T22:41:01.706 INFO:tasks.workunit.client.0.smithi033.stdout:8/947: readlink d1/d68/d1d/d4a/d4c/le8 0 2024-02-15T22:41:01.706 INFO:tasks.workunit.client.0.smithi033.stdout:8/948: truncate d1/d68/d44/dd3/ff8 654364 0 2024-02-15T22:41:01.708 INFO:tasks.workunit.client.1.smithi082.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T22:41:01.710 INFO:tasks.workunit.client.0.smithi033.stdout:8/949: read d1/d74/dc1/d75/db1/db5/dfb/d14/f1b [3379115,92230] 0 2024-02-15T22:41:01.712 INFO:tasks.workunit.client.0.smithi033.stdout:8/950: creat d1/d68/d44/dc3/f144 x:0 0 0 2024-02-15T22:41:01.724 INFO:tasks.workunit.client.0.smithi033.stdout:8/951: dwrite d1/de/d1a/d2a/ff1 [0,4194304] 0 2024-02-15T22:41:01.727 INFO:tasks.workunit.client.0.smithi033.stdout:8/952: unlink d1/d74/dc1/d75/d83/f120 0 2024-02-15T22:41:01.741 INFO:tasks.workunit.client.0.smithi033.stdout:8/953: dwrite d1/d68/d44/fb9 [0,4194304] 0 2024-02-15T22:41:01.741 INFO:tasks.workunit.client.0.smithi033.stdout:8/954: write d1/d74/dc1/d75/dbf/d79/da5/f117 [5103450,122860] 0 2024-02-15T22:41:01.743 INFO:tasks.workunit.client.0.smithi033.stdout:8/955: read d1/de/d1a/d2a/f10d [115870,20402] 0 2024-02-15T22:41:01.759 INFO:tasks.workunit.client.0.smithi033.stdout:8/956: dwrite d1/d68/d57/df2/f104 [0,4194304] 0 2024-02-15T22:41:01.777 INFO:tasks.workunit.client.0.smithi033.stdout:8/957: dwrite d1/d74/dc1/d75/db1/db5/dfb/f7 [0,4194304] 0 2024-02-15T22:41:01.777 INFO:tasks.workunit.client.0.smithi033.stdout:8/958: write d1/de/d1a/d2a/f10d [1061350,67706] 0 2024-02-15T22:41:01.778 INFO:tasks.workunit.client.0.smithi033.stdout:8/959: write d1/de/d1a/d27/ddf/de6/df7/f115 [572565,65153] 0 2024-02-15T22:41:01.780 INFO:tasks.workunit.client.0.smithi033.stdout:8/960: creat d1/d74/dc1/d75/db1/db5/dfb/d14/d5d/d141/f145 x:0 0 0 2024-02-15T22:41:01.780 INFO:tasks.workunit.client.0.smithi033.stdout:8/961: chown d1/d74/dc1/d75/dbf/lf5 36323591 1 2024-02-15T22:41:01.781 INFO:tasks.workunit.client.0.smithi033.stdout:8/962: dread d1/d68/d1d/fd0 [0,4194304] 0 2024-02-15T22:41:01.789 INFO:tasks.workunit.client.0.smithi033.stdout:8/963: write d1/de/d1a/d2a/f6f [3774124,31848] 0 2024-02-15T22:41:01.789 INFO:tasks.workunit.client.0.smithi033.stdout:8/964: chown d1/d74/dc1/d75/db1/db5/dfb/d14/l3f 0 1 2024-02-15T22:41:01.790 INFO:tasks.workunit.client.0.smithi033.stdout:8/965: fsync d1/de/d1a/d27/f7c 0 2024-02-15T22:41:01.802 INFO:tasks.workunit.client.0.smithi033.stdout:8/966: dwrite d1/de/d1a/d27/f132 [0,4194304] 0 2024-02-15T22:41:01.802 INFO:tasks.workunit.client.0.smithi033.stdout:8/967: chown d1/de/d1a/d27/d60/c100 987389 1 2024-02-15T22:41:01.802 INFO:tasks.workunit.client.0.smithi033.stdout:8/968: read - d1/de/d1a/d27/d60/f137 zero size 2024-02-15T22:41:01.803 INFO:tasks.workunit.client.0.smithi033.stdout:8/969: creat d1/d74/dc1/d75/db1/db5/dfb/d14/f146 x:0 0 0 2024-02-15T22:41:01.803 INFO:tasks.workunit.client.0.smithi033.stdout:8/970: mknod d1/d74/dc1/d75/db1/db5/d122/c147 0 2024-02-15T22:41:01.804 INFO:tasks.workunit.client.0.smithi033.stdout:8/971: mkdir d1/d74/dc1/d75/d148 0 2024-02-15T22:41:01.818 INFO:tasks.workunit.client.0.smithi033.stdout:8/972: dwrite d1/de/d1a/d27/fe7 [4194304,4194304] 0 2024-02-15T22:41:01.914 INFO:tasks.workunit.client.0.smithi033.stdout:8/973: sync 2024-02-15T22:41:01.914 INFO:tasks.workunit.client.0.smithi033.stdout:0/797: sync 2024-02-15T22:41:01.914 INFO:tasks.workunit.client.0.smithi033.stdout:8/974: truncate d1/fa8 914891 0 2024-02-15T22:41:01.914 INFO:tasks.workunit.client.0.smithi033.stdout:6/798: sync 2024-02-15T22:41:01.914 INFO:tasks.workunit.client.0.smithi033.stdout:8/975: stat d1/de/d1a/d27/d60/f137 0 2024-02-15T22:41:01.915 INFO:tasks.workunit.client.0.smithi033.stdout:7/989: sync 2024-02-15T22:41:01.915 INFO:tasks.workunit.client.0.smithi033.stdout:8/976: chown d1/lf0 22 1 2024-02-15T22:41:01.915 INFO:tasks.workunit.client.0.smithi033.stdout:0/798: fsync db/d2a/d6e/d7a/d95/fed 0 2024-02-15T22:41:01.915 INFO:tasks.workunit.client.0.smithi033.stdout:6/799: rmdir d12/d2c/d30/d1d 39 2024-02-15T22:41:01.915 INFO:tasks.workunit.client.0.smithi033.stdout:7/990: unlink d5/l8e 0 2024-02-15T22:41:01.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/991: link d5/df/d40/d136/da0/dc6/de4/de9/lf0 d5/df/d40/d136/da1/d26/l147 0 2024-02-15T22:41:01.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/992: fdatasync d5/f9b 0 2024-02-15T22:41:01.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/993: chown d5/df/d40/d136/da1 0 1 2024-02-15T22:41:01.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/994: write d5/df/fad [3919666,903] 0 2024-02-15T22:41:01.919 INFO:tasks.workunit.client.0.smithi033.stdout:0/799: rmdir db/d2a/d6c 39 2024-02-15T22:41:01.920 INFO:tasks.workunit.client.0.smithi033.stdout:0/800: creat db/d2a/d6e/d7a/d95/f10e x:0 0 0 2024-02-15T22:41:01.921 INFO:tasks.workunit.client.0.smithi033.stdout:7/995: chown d5/df/l51 61 1 2024-02-15T22:41:01.923 INFO:tasks.workunit.client.0.smithi033.stdout:8/977: rename d1/d68/d44/d49/d119 to d1/dae/d149 0 2024-02-15T22:41:01.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/996: getdents d5/df/d40/d136/da0/dc6 0 2024-02-15T22:41:01.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/997: chown d5/df/d40/d136/de1 1191172 1 2024-02-15T22:41:01.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/998: chown d5/c67 10259 1 2024-02-15T22:41:01.924 INFO:tasks.workunit.client.0.smithi033.stdout:8/978: creat d1/de/d1a/d9d/d133/f14a x:0 0 0 2024-02-15T22:41:01.925 INFO:tasks.workunit.client.0.smithi033.stdout:8/979: symlink d1/de/d1a/d2a/l14b 0 2024-02-15T22:41:01.926 INFO:tasks.workunit.client.0.smithi033.stdout:8/980: write d1/de/d1a/d2a/d40/d11b/fba [1426288,3268] 0 2024-02-15T22:41:01.926 INFO:tasks.workunit.client.0.smithi033.stdout:8/981: read - d1/d68/d44/dc3/f144 zero size 2024-02-15T22:41:01.926 INFO:tasks.workunit.client.0.smithi033.stdout:8/982: chown d1/fa8 54621 1 2024-02-15T22:41:01.927 INFO:tasks.workunit.client.0.smithi033.stdout:8/983: unlink d1/de/d1a/d27/d10b/f135 0 2024-02-15T22:41:01.930 INFO:tasks.workunit.client.0.smithi033.stdout:0/801: dread db/d19/f1a [0,4194304] 0 2024-02-15T22:41:01.930 INFO:tasks.workunit.client.0.smithi033.stdout:0/802: truncate db/d19/d32/d43/fc9 4474275 0 2024-02-15T22:41:01.932 INFO:tasks.workunit.client.0.smithi033.stdout:0/803: rename db/d19/f1e to db/d19/d32/f10f 0 2024-02-15T22:41:01.933 INFO:tasks.workunit.client.0.smithi033.stdout:0/804: mkdir db/d19/d32/d43/d7d/d110 0 2024-02-15T22:41:01.934 INFO:tasks.workunit.client.0.smithi033.stdout:7/999: write d5/f18 [646269,75098] 0 2024-02-15T22:41:01.935 INFO:tasks.workunit.client.0.smithi033.stdout:0/805: unlink db/d2a/d6e/d7a/lb5 0 2024-02-15T22:41:01.935 INFO:tasks.workunit.client.0.smithi033.stdout:0/806: write db/d2a/d6e/f8f [916822,21749] 0 2024-02-15T22:41:01.935 INFO:tasks.workunit.client.0.smithi033.stdout:0/807: truncate db/d2a/d6e/dc3/d109/fc6 3196 0 2024-02-15T22:41:01.937 INFO:tasks.workunit.client.0.smithi033.stdout:0/808: mkdir db/d60/d111 0 2024-02-15T22:41:01.937 INFO:tasks.workunit.client.0.smithi033.stdout:0/809: truncate db/d19/d32/d3d/f59 5128417 0 2024-02-15T22:41:01.938 INFO:tasks.workunit.client.0.smithi033.stdout:0/810: symlink db/d19/dd8/l112 0 2024-02-15T22:41:01.938 INFO:tasks.workunit.client.0.smithi033.stdout:6/800: dwrite d12/d2c/d30/d1d/f39 [0,4194304] 0 2024-02-15T22:41:01.938 INFO:tasks.workunit.client.0.smithi033.stdout:6/801: creat d12/d2c/d30/f101 x:0 0 0 2024-02-15T22:41:01.939 INFO:tasks.workunit.client.0.smithi033.stdout:8/984: dread d1/de/d1a/d27/d55/f59 [0,4194304] 0 2024-02-15T22:41:01.940 INFO:tasks.workunit.client.0.smithi033.stdout:0/811: unlink db/d19/d32/d3d/lbe 0 2024-02-15T22:41:01.944 INFO:tasks.workunit.client.0.smithi033.stdout:6/802: truncate d12/d2c/d30/d90/fca 250242 0 2024-02-15T22:41:01.945 INFO:tasks.workunit.client.0.smithi033.stdout:8/985: symlink d1/de/d1a/d27/d55/l14c 0 2024-02-15T22:41:01.946 INFO:tasks.workunit.client.0.smithi033.stdout:6/803: mkdir d12/d3c/d95/d102 0 2024-02-15T22:41:01.946 INFO:tasks.workunit.client.0.smithi033.stdout:6/804: write d12/d2c/fde [7361304,68797] 0 2024-02-15T22:41:01.948 INFO:tasks.workunit.client.0.smithi033.stdout:8/986: getdents d1/de/d1a/d27/d70 0 2024-02-15T22:41:01.948 INFO:tasks.workunit.client.0.smithi033.stdout:8/987: chown d1/d68/d44/d49/f7b 3553019 1 2024-02-15T22:41:01.948 INFO:tasks.workunit.client.0.smithi033.stdout:8/988: dread - d1/de/d1a/d9d/f9e zero size 2024-02-15T22:41:01.948 INFO:tasks.workunit.client.0.smithi033.stdout:8/989: write d1/d68/d44/fe1 [1505694,102752] 0 2024-02-15T22:41:01.948 INFO:tasks.workunit.client.0.smithi033.stdout:8/990: chown d1/d74/dc1/d75/db1/db5/dfb/l38 20938 1 2024-02-15T22:41:01.949 INFO:tasks.workunit.client.0.smithi033.stdout:8/991: chown d1/de/d1a/d27/ddf/de6/df7/f115 421580 1 2024-02-15T22:41:01.949 INFO:tasks.workunit.client.0.smithi033.stdout:0/812: read db/d19/d32/f10f [2114087,93389] 0 2024-02-15T22:41:01.950 INFO:tasks.workunit.client.0.smithi033.stdout:8/992: mknod d1/d74/dc1/d75/dbf/c14d 0 2024-02-15T22:41:01.952 INFO:tasks.workunit.client.1.smithi082.stderr:++ readlink -f fsstress 2024-02-15T22:41:01.955 INFO:tasks.workunit.client.1.smithi082.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T22:41:01.955 INFO:tasks.workunit.client.1.smithi082.stderr:+ popd 2024-02-15T22:41:01.956 INFO:tasks.workunit.client.0.smithi033.stdout:8/993: creat d1/de/d1a/d9d/f14e x:0 0 0 2024-02-15T22:41:01.957 INFO:tasks.workunit.client.1.smithi082.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:41:01.957 INFO:tasks.workunit.client.1.smithi082.stderr:+ popd 2024-02-15T22:41:01.957 INFO:tasks.workunit.client.1.smithi082.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:41:01.957 INFO:tasks.workunit.client.1.smithi082.stderr:++ mktemp -d -p . 2024-02-15T22:41:01.958 INFO:tasks.workunit.client.0.smithi033.stdout:6/805: truncate d12/d2c/d30/d1d/f39 2842232 0 2024-02-15T22:41:01.959 INFO:tasks.workunit.client.1.smithi082.stderr:+ T=./tmp.xeOm4ZHvvm 2024-02-15T22:41:01.959 INFO:tasks.workunit.client.1.smithi082.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.xeOm4ZHvvm -l 1 -n 1000 -p 10 -v 2024-02-15T22:41:01.960 INFO:tasks.workunit.client.0.smithi033.stdout:6/806: rename d12/d2c/l3a to d12/d2c/dc0/db7/l103 0 2024-02-15T22:41:01.960 INFO:tasks.workunit.client.0.smithi033.stdout:6/807: fsync d12/d3c/d95/d3f/da3/fe5 0 2024-02-15T22:41:01.961 INFO:tasks.workunit.client.1.smithi082.stdout:seed = 1707096135 2024-02-15T22:41:01.963 INFO:tasks.workunit.client.0.smithi033.stdout:6/808: creat d12/d2c/dbc/f104 x:0 0 0 2024-02-15T22:41:01.963 INFO:tasks.workunit.client.0.smithi033.stdout:6/809: stat d12/d2c/dbc/f26 0 2024-02-15T22:41:01.963 INFO:tasks.workunit.client.0.smithi033.stdout:8/994: write d1/d74/dc1/fe2 [2416548,22304] 0 2024-02-15T22:41:01.964 INFO:tasks.workunit.client.1.smithi082.stdout:1/0: dread - no filename 2024-02-15T22:41:01.964 INFO:tasks.workunit.client.1.smithi082.stdout:0/0: creat f0 x:0 0 0 2024-02-15T22:41:01.965 INFO:tasks.workunit.client.0.smithi033.stdout:0/813: dwrite db/d2a/d6e/dc3/d109/fc6 [0,4194304] 0 2024-02-15T22:41:01.965 INFO:tasks.workunit.client.0.smithi033.stdout:0/814: write db/d19/d32/d43/d5a/d76/faa [486942,82244] 0 2024-02-15T22:41:01.965 INFO:tasks.workunit.client.1.smithi082.stdout:2/0: fdatasync - no filename 2024-02-15T22:41:01.965 INFO:tasks.workunit.client.1.smithi082.stdout:2/1: dwrite - no filename 2024-02-15T22:41:01.965 INFO:tasks.workunit.client.1.smithi082.stdout:2/2: dwrite - no filename 2024-02-15T22:41:01.965 INFO:tasks.workunit.client.1.smithi082.stdout:2/3: dwrite - no filename 2024-02-15T22:41:01.966 INFO:tasks.workunit.client.1.smithi082.stdout:1/1: creat f0 x:0 0 0 2024-02-15T22:41:01.966 INFO:tasks.workunit.client.1.smithi082.stdout:0/1: symlink l1 0 2024-02-15T22:41:01.966 INFO:tasks.workunit.client.1.smithi082.stdout:0/2: chown l1 295801763 1 2024-02-15T22:41:01.967 INFO:tasks.workunit.client.1.smithi082.stdout:3/0: write - no filename 2024-02-15T22:41:01.967 INFO:tasks.workunit.client.1.smithi082.stdout:3/1: readlink - no filename 2024-02-15T22:41:01.967 INFO:tasks.workunit.client.1.smithi082.stdout:2/4: creat f0 x:0 0 0 2024-02-15T22:41:01.969 INFO:tasks.workunit.client.0.smithi033.stdout:0/815: mkdir db/d19/dd8/d113 0 2024-02-15T22:41:01.970 INFO:tasks.workunit.client.1.smithi082.stdout:1/2: mkdir d1 0 2024-02-15T22:41:01.970 INFO:tasks.workunit.client.1.smithi082.stdout:4/0: truncate - no filename 2024-02-15T22:41:01.971 INFO:tasks.workunit.client.0.smithi033.stdout:8/995: rmdir d1/de/d1a/d27/d10b 39 2024-02-15T22:41:01.972 INFO:tasks.workunit.client.1.smithi082.stdout:1/3: mknod d1/c2 0 2024-02-15T22:41:01.972 INFO:tasks.workunit.client.1.smithi082.stdout:1/4: write f0 [684909,119490] 0 2024-02-15T22:41:01.973 INFO:tasks.workunit.client.0.smithi033.stdout:8/996: creat d1/d68/f14f x:0 0 0 2024-02-15T22:41:01.973 INFO:tasks.workunit.client.0.smithi033.stdout:6/810: write d12/f29 [1540353,45933] 0 2024-02-15T22:41:01.973 INFO:tasks.workunit.client.0.smithi033.stdout:6/811: chown d12/d3c/d95/d3f/lab 283186 1 2024-02-15T22:41:01.975 INFO:tasks.workunit.client.1.smithi082.stdout:5/0: write - no filename 2024-02-15T22:41:01.975 INFO:tasks.workunit.client.1.smithi082.stdout:5/1: dread - no filename 2024-02-15T22:41:01.976 INFO:tasks.workunit.client.0.smithi033.stdout:6/812: getdents d12/d3c/d95/d3f/d50/dbd/dcb 0 2024-02-15T22:41:01.976 INFO:tasks.workunit.client.0.smithi033.stdout:6/813: fdatasync d12/d3c/d95/d3f/da3/fe1 0 2024-02-15T22:41:01.976 INFO:tasks.workunit.client.1.smithi082.stdout:4/1: mkdir d0 0 2024-02-15T22:41:01.976 INFO:tasks.workunit.client.1.smithi082.stdout:4/2: write - no filename 2024-02-15T22:41:01.979 INFO:tasks.workunit.client.1.smithi082.stdout:5/2: symlink l0 0 2024-02-15T22:41:01.979 INFO:tasks.workunit.client.1.smithi082.stdout:5/3: stat l0 0 2024-02-15T22:41:01.979 INFO:tasks.workunit.client.1.smithi082.stdout:5/4: write - no filename 2024-02-15T22:41:01.980 INFO:tasks.workunit.client.1.smithi082.stdout:5/5: truncate - no filename 2024-02-15T22:41:01.980 INFO:tasks.workunit.client.1.smithi082.stdout:5/6: dread - no filename 2024-02-15T22:41:01.980 INFO:tasks.workunit.client.1.smithi082.stdout:5/7: truncate - no filename 2024-02-15T22:41:01.981 INFO:tasks.workunit.client.1.smithi082.stdout:6/0: write - no filename 2024-02-15T22:41:01.981 INFO:tasks.workunit.client.1.smithi082.stdout:6/1: read - no filename 2024-02-15T22:41:01.983 INFO:tasks.workunit.client.1.smithi082.stdout:4/3: creat d0/f1 x:0 0 0 2024-02-15T22:41:01.988 INFO:tasks.workunit.client.1.smithi082.stdout:0/3: fsync f0 0 2024-02-15T22:41:01.988 INFO:tasks.workunit.client.1.smithi082.stdout:5/8: creat f1 x:0 0 0 2024-02-15T22:41:01.988 INFO:tasks.workunit.client.1.smithi082.stdout:5/9: creat f2 x:0 0 0 2024-02-15T22:41:01.995 INFO:tasks.workunit.client.1.smithi082.stdout:6/2: creat f0 x:0 0 0 2024-02-15T22:41:01.995 INFO:tasks.workunit.client.1.smithi082.stdout:6/3: creat f1 x:0 0 0 2024-02-15T22:41:01.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/0: rename - no filename 2024-02-15T22:41:01.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/1: unlink - no file 2024-02-15T22:41:01.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/2: unlink - no file 2024-02-15T22:41:01.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/3: readlink - no filename 2024-02-15T22:41:01.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/4: dread - no filename 2024-02-15T22:41:01.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/5: dwrite - no filename 2024-02-15T22:41:01.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/6: write - no filename 2024-02-15T22:41:01.998 INFO:tasks.workunit.client.1.smithi082.stdout:2/5: getdents . 0 2024-02-15T22:41:02.005 INFO:tasks.workunit.client.1.smithi082.stdout:4/4: link d0/f1 d0/f2 0 2024-02-15T22:41:02.005 INFO:tasks.workunit.client.1.smithi082.stdout:0/4: symlink l2 0 2024-02-15T22:41:02.006 INFO:tasks.workunit.client.1.smithi082.stdout:0/5: dread - f0 zero size 2024-02-15T22:41:02.006 INFO:tasks.workunit.client.1.smithi082.stdout:5/10: link l0 l3 0 2024-02-15T22:41:02.006 INFO:tasks.workunit.client.1.smithi082.stdout:7/7: symlink l0 0 2024-02-15T22:41:02.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/8: chown l0 24175 1 2024-02-15T22:41:02.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/9: readlink l0 0 2024-02-15T22:41:02.007 INFO:tasks.workunit.client.1.smithi082.stdout:2/6: creat f1 x:0 0 0 2024-02-15T22:41:02.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/10: stat l0 0 2024-02-15T22:41:02.008 INFO:tasks.workunit.client.1.smithi082.stdout:6/4: mkdir d2 0 2024-02-15T22:41:02.008 INFO:tasks.workunit.client.1.smithi082.stdout:0/6: mkdir d3 0 2024-02-15T22:41:02.008 INFO:tasks.workunit.client.1.smithi082.stdout:6/5: getdents d2 0 2024-02-15T22:41:02.009 INFO:tasks.workunit.client.1.smithi082.stdout:5/11: link f2 f4 0 2024-02-15T22:41:02.009 INFO:tasks.workunit.client.1.smithi082.stdout:5/12: chown l3 476630615 1 2024-02-15T22:41:02.009 INFO:tasks.workunit.client.1.smithi082.stdout:5/13: write f2 [961345,37390] 0 2024-02-15T22:41:02.010 INFO:tasks.workunit.client.1.smithi082.stdout:5/14: chown f4 231 1 2024-02-15T22:41:02.011 INFO:tasks.workunit.client.1.smithi082.stdout:7/11: link l0 l1 0 2024-02-15T22:41:02.012 INFO:tasks.workunit.client.1.smithi082.stdout:0/7: symlink d3/l4 0 2024-02-15T22:41:02.017 INFO:tasks.workunit.client.1.smithi082.stdout:6/6: creat d2/f3 x:0 0 0 2024-02-15T22:41:02.017 INFO:tasks.workunit.client.1.smithi082.stdout:5/15: mkdir d5 0 2024-02-15T22:41:02.017 INFO:tasks.workunit.client.1.smithi082.stdout:6/7: dread - d2/f3 zero size 2024-02-15T22:41:02.017 INFO:tasks.workunit.client.1.smithi082.stdout:6/8: dread - f1 zero size 2024-02-15T22:41:02.017 INFO:tasks.workunit.client.1.smithi082.stdout:7/12: symlink l2 0 2024-02-15T22:41:02.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:01 smithi033 ceph-mon[29033]: pgmap v13: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 134 MiB/s wr, 653 op/s 2024-02-15T22:41:02.023 INFO:tasks.workunit.client.1.smithi082.stdout:5/16: unlink l0 0 2024-02-15T22:41:02.024 INFO:tasks.workunit.client.1.smithi082.stdout:5/17: mknod d5/c6 0 2024-02-15T22:41:02.024 INFO:tasks.workunit.client.1.smithi082.stdout:5/18: chown l3 56054046 1 2024-02-15T22:41:02.036 INFO:tasks.workunit.client.1.smithi082.stdout:1/5: write f0 [566212,32777] 0 2024-02-15T22:41:02.058 INFO:tasks.workunit.client.0.smithi033.stdout:0/816: dwrite db/d2a/d6e/f8f [0,4194304] 0 2024-02-15T22:41:02.058 INFO:tasks.workunit.client.0.smithi033.stdout:0/817: chown db/d60/dec 28076 1 2024-02-15T22:41:02.061 INFO:tasks.workunit.client.0.smithi033.stdout:0/818: unlink db/d19/d32/d43/d94/la4 0 2024-02-15T22:41:02.061 INFO:tasks.workunit.client.0.smithi033.stdout:0/819: readlink db/l58 0 2024-02-15T22:41:02.062 INFO:tasks.workunit.client.0.smithi033.stdout:0/820: mknod db/d19/d32/d43/d7d/d110/c114 0 2024-02-15T22:41:02.066 INFO:tasks.workunit.client.0.smithi033.stdout:0/821: link db/d19/d32/d43/d9f/fcf db/d2a/d6e/d7a/d95/f115 0 2024-02-15T22:41:02.066 INFO:tasks.workunit.client.0.smithi033.stdout:0/822: truncate db/d2a/d68/d8b/f98 4573084 0 2024-02-15T22:41:02.068 INFO:tasks.workunit.client.0.smithi033.stdout:0/823: link db/d19/d32/d43/d7d/ld6 db/d19/d32/d43/d7d/l116 0 2024-02-15T22:41:02.069 INFO:tasks.workunit.client.0.smithi033.stdout:0/824: mkdir db/d2a/dc7/d117 0 2024-02-15T22:41:02.072 INFO:tasks.workunit.client.0.smithi033.stdout:0/825: unlink db/d2a/d68/d8b/fa7 0 2024-02-15T22:41:02.072 INFO:tasks.workunit.client.0.smithi033.stdout:8/997: dwrite d1/de/d1a/d27/ddf/f110 [0,4194304] 0 2024-02-15T22:41:02.073 INFO:tasks.workunit.client.0.smithi033.stdout:8/998: truncate d1/d68/f108 852470 0 2024-02-15T22:41:02.073 INFO:tasks.workunit.client.0.smithi033.stdout:8/999: stat d1/d74/dc1/d75/dbf/c13e 0 2024-02-15T22:41:02.075 INFO:tasks.workunit.client.0.smithi033.stdout:0/826: unlink db/d2a/d68/d8b/fd7 0 2024-02-15T22:41:02.076 INFO:tasks.workunit.client.0.smithi033.stdout:0/827: mknod db/d19/c118 0 2024-02-15T22:41:02.079 INFO:tasks.workunit.client.0.smithi033.stdout:0/828: creat db/d19/d32/d43/d5a/d76/f119 x:0 0 0 2024-02-15T22:41:02.079 INFO:tasks.workunit.client.0.smithi033.stdout:0/829: fdatasync db/d19/d32/fb7 0 2024-02-15T22:41:02.079 INFO:tasks.workunit.client.0.smithi033.stdout:0/830: dread - db/d19/d32/d43/d7d/f82 zero size 2024-02-15T22:41:02.080 INFO:tasks.workunit.client.0.smithi033.stdout:0/831: chown db/d2a/dc7/de6/de7/cfc 23951169 1 2024-02-15T22:41:02.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:01 smithi082 ceph-mon[37153]: pgmap v13: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 134 MiB/s wr, 653 op/s 2024-02-15T22:41:02.328 INFO:tasks.workunit.client.1.smithi082.stdout:6/9: fsync f0 0 2024-02-15T22:41:02.342 INFO:tasks.workunit.client.0.smithi033.stdout:6/814: dwrite d12/d2c/dbc/f97 [0,4194304] 0 2024-02-15T22:41:02.342 INFO:tasks.workunit.client.0.smithi033.stdout:6/815: creat d12/d2c/dc0/dc8/f105 x:0 0 0 2024-02-15T22:41:02.342 INFO:tasks.workunit.client.0.smithi033.stdout:6/816: read d12/d3c/f91 [702541,71026] 0 2024-02-15T22:41:02.349 INFO:tasks.workunit.client.0.smithi033.stdout:6/817: rmdir d12/d3c/d95/d3f/d50/dbd/dcb 39 2024-02-15T22:41:02.351 INFO:tasks.workunit.client.0.smithi033.stdout:6/818: link d12/d2c/d30/f72 d12/d2c/d30/d1d/f106 0 2024-02-15T22:41:02.351 INFO:tasks.workunit.client.0.smithi033.stdout:6/819: readlink d12/d3c/d95/d3f/d50/la7 0 2024-02-15T22:41:02.352 INFO:tasks.workunit.client.1.smithi082.stdout:0/8: getdents d3 0 2024-02-15T22:41:02.352 INFO:tasks.workunit.client.1.smithi082.stdout:0/9: dread - f0 zero size 2024-02-15T22:41:02.353 INFO:tasks.workunit.client.0.smithi033.stdout:6/820: mkdir d12/d2c/d30/d90/dc7/d107 0 2024-02-15T22:41:02.355 INFO:tasks.workunit.client.0.smithi033.stdout:6/821: symlink d12/d2c/d30/d1d/l108 0 2024-02-15T22:41:02.355 INFO:tasks.workunit.client.0.smithi033.stdout:6/822: fdatasync d12/d2c/d30/f72 0 2024-02-15T22:41:02.355 INFO:tasks.workunit.client.1.smithi082.stdout:7/13: getdents . 0 2024-02-15T22:41:02.355 INFO:tasks.workunit.client.1.smithi082.stdout:7/14: dread - no filename 2024-02-15T22:41:02.514 INFO:tasks.workunit.client.1.smithi082.stdout:2/7: write f1 [765156,75552] 0 2024-02-15T22:41:02.515 INFO:tasks.workunit.client.1.smithi082.stdout:8/0: rename - no filename 2024-02-15T22:41:02.515 INFO:tasks.workunit.client.1.smithi082.stdout:8/1: dread - no filename 2024-02-15T22:41:02.515 INFO:tasks.workunit.client.1.smithi082.stdout:8/2: read - no filename 2024-02-15T22:41:02.515 INFO:tasks.workunit.client.1.smithi082.stdout:8/3: link - no file 2024-02-15T22:41:02.515 INFO:tasks.workunit.client.1.smithi082.stdout:9/0: fdatasync - no filename 2024-02-15T22:41:02.515 INFO:tasks.workunit.client.1.smithi082.stdout:9/1: dwrite - no filename 2024-02-15T22:41:02.674 INFO:tasks.workunit.client.1.smithi082.stdout:0/10: dwrite f0 [0,4194304] 0 2024-02-15T22:41:02.687 INFO:tasks.workunit.client.1.smithi082.stdout:0/11: dread f0 [0,4194304] 0 2024-02-15T22:41:02.688 INFO:tasks.workunit.client.1.smithi082.stdout:0/12: chown l1 10182 1 2024-02-15T22:41:02.693 INFO:tasks.workunit.client.1.smithi082.stdout:0/13: dread f0 [0,4194304] 0 2024-02-15T22:41:02.710 INFO:tasks.workunit.client.1.smithi082.stdout:4/5: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:41:02.858 INFO:tasks.workunit.client.0.smithi033.stdout:6/823: dread d12/d2c/f4a [0,4194304] 0 2024-02-15T22:41:02.859 INFO:tasks.workunit.client.0.smithi033.stdout:6/824: unlink d12/d3c/d95/d3f/f57 0 2024-02-15T22:41:02.861 INFO:tasks.workunit.client.0.smithi033.stdout:6/825: link d12/d3c/d95/d3f/da3/fe1 d12/f109 0 2024-02-15T22:41:02.864 INFO:tasks.workunit.client.0.smithi033.stdout:6/826: rename d12/d2c/dbc/dd4/ce0 to d12/d3c/d95/c10a 0 2024-02-15T22:41:02.864 INFO:tasks.workunit.client.0.smithi033.stdout:6/827: write d12/d3c/d95/d3f/db6/fc9 [22428,14571] 0 2024-02-15T22:41:02.869 INFO:tasks.workunit.client.0.smithi033.stdout:6/828: write d12/f29 [793180,64228] 0 2024-02-15T22:41:02.869 INFO:tasks.workunit.client.0.smithi033.stdout:6/829: write d12/d3c/d95/d3f/da3/fe1 [880871,6553] 0 2024-02-15T22:41:02.886 INFO:tasks.workunit.client.0.smithi033.stdout:0/832: dwrite db/d19/d32/d43/d5a/d76/da1/fb4 [0,4194304] 0 2024-02-15T22:41:02.888 INFO:tasks.workunit.client.0.smithi033.stdout:0/833: symlink db/d19/d32/d43/d7d/l11a 0 2024-02-15T22:41:02.894 INFO:tasks.workunit.client.0.smithi033.stdout:6/830: dwrite d12/d2c/dc0/ff9 [0,4194304] 0 2024-02-15T22:41:02.894 INFO:tasks.workunit.client.0.smithi033.stdout:6/831: truncate d12/d3c/d95/f52 1309874 0 2024-02-15T22:41:02.896 INFO:tasks.workunit.client.0.smithi033.stdout:6/832: truncate d12/d2c/d30/d1d/f106 858111 0 2024-02-15T22:41:02.896 INFO:tasks.workunit.client.0.smithi033.stdout:6/833: creat d12/d3c/d95/d3f/d50/f10b x:0 0 0 2024-02-15T22:41:02.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/834: dread d12/d2c/dc0/fb9 [0,4194304] 0 2024-02-15T22:41:02.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/835: truncate d12/f109 1594251 0 2024-02-15T22:41:02.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/836: write d12/d3c/d95/d3f/fed [603707,3606] 0 2024-02-15T22:41:02.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/837: write fa [5047605,45093] 0 2024-02-15T22:41:02.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/838: fsync d12/d3c/d95/d3f/d50/fb2 0 2024-02-15T22:41:02.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/839: chown d12/d2c/fa4 1401 1 2024-02-15T22:41:02.924 INFO:tasks.workunit.client.0.smithi033.stdout:0/834: dwrite db/d2a/d6e/f7c [0,4194304] 0 2024-02-15T22:41:02.931 INFO:tasks.workunit.client.0.smithi033.stdout:0/835: symlink db/l11b 0 2024-02-15T22:41:02.944 INFO:tasks.workunit.client.0.smithi033.stdout:0/836: dread f4 [4194304,4194304] 0 2024-02-15T22:41:02.946 INFO:tasks.workunit.client.0.smithi033.stdout:0/837: mknod db/d60/de8/c11c 0 2024-02-15T22:41:02.960 INFO:tasks.workunit.client.0.smithi033.stdout:0/838: write db/d19/d32/d43/d7d/ff0 [1859164,21010] 0 2024-02-15T22:41:02.964 INFO:tasks.workunit.client.0.smithi033.stdout:0/839: link db/d2a/d6e/d7a/d95/cb3 db/d19/d32/d43/d5a/d76/c11d 0 2024-02-15T22:41:02.965 INFO:tasks.workunit.client.0.smithi033.stdout:0/840: mkdir db/d2a/d6e/d7a/d95/dcd/d11e 0 2024-02-15T22:41:02.976 INFO:tasks.workunit.client.0.smithi033.stdout:0/841: dread db/d19/f3a [0,4194304] 0 2024-02-15T22:41:02.976 INFO:tasks.workunit.client.0.smithi033.stdout:0/842: creat db/d2a/dc7/d117/f11f x:0 0 0 2024-02-15T22:41:02.976 INFO:tasks.workunit.client.0.smithi033.stdout:0/843: creat db/d2a/d68/f120 x:0 0 0 2024-02-15T22:41:02.977 INFO:tasks.workunit.client.0.smithi033.stdout:0/844: mkdir db/d2a/d6c/d121 0 2024-02-15T22:41:02.977 INFO:tasks.workunit.client.0.smithi033.stdout:0/845: getdents db/d2a/dc7 0 2024-02-15T22:41:02.979 INFO:tasks.workunit.client.0.smithi033.stdout:0/846: link db/d19/d32/d43/c9a db/d19/dd8/c122 0 2024-02-15T22:41:02.980 INFO:tasks.workunit.client.0.smithi033.stdout:0/847: unlink db/d2a/d6e/d7a/fe1 0 2024-02-15T22:41:02.999 INFO:tasks.workunit.client.1.smithi082.stdout:5/19: fsync f4 0 2024-02-15T22:41:02.999 INFO:tasks.workunit.client.1.smithi082.stdout:1/6: fdatasync f0 0 2024-02-15T22:41:03.000 INFO:tasks.workunit.client.0.smithi033.stdout:0/848: dwrite db/d19/d32/d43/d94/fc5 [0,4194304] 0 2024-02-15T22:41:03.000 INFO:tasks.workunit.client.0.smithi033.stdout:0/849: write db/d60/fdb [821526,88678] 0 2024-02-15T22:41:03.000 INFO:tasks.workunit.client.0.smithi033.stdout:0/850: chown db/d2a/d68/le0 778942736 1 2024-02-15T22:41:03.000 INFO:tasks.workunit.client.0.smithi033.stdout:0/851: readlink db/ld 0 2024-02-15T22:41:03.002 INFO:tasks.workunit.client.0.smithi033.stdout:0/852: symlink db/d2a/l123 0 2024-02-15T22:41:03.004 INFO:tasks.workunit.client.0.smithi033.stdout:0/853: link db/d19/d32/d3d/f59 db/d2a/d6e/d7a/f124 0 2024-02-15T22:41:03.004 INFO:tasks.workunit.client.0.smithi033.stdout:0/854: write db/d2a/d6e/d7a/d95/fed [503354,35409] 0 2024-02-15T22:41:03.004 INFO:tasks.workunit.client.0.smithi033.stdout:0/855: chown db/d19/dd8 29027029 1 2024-02-15T22:41:03.004 INFO:tasks.workunit.client.0.smithi033.stdout:0/856: chown db/d19/l37 1010718 1 2024-02-15T22:41:03.006 INFO:tasks.workunit.client.0.smithi033.stdout:0/857: dread db/d2a/f40 [0,4194304] 0 2024-02-15T22:41:03.015 INFO:tasks.workunit.client.0.smithi033.stdout:0/858: dread db/d2a/fe5 [0,4194304] 0 2024-02-15T22:41:03.015 INFO:tasks.workunit.client.0.smithi033.stdout:0/859: creat db/d2a/dc7/d117/f125 x:0 0 0 2024-02-15T22:41:03.022 INFO:tasks.workunit.client.0.smithi033.stdout:0/860: write db/d19/d32/d46/f4f [1873579,43557] 0 2024-02-15T22:41:03.024 INFO:tasks.workunit.client.0.smithi033.stdout:0/861: rename db/d2a/d6e/cc2 to db/d2a/d6e/dc3/d109/c126 0 2024-02-15T22:41:03.042 INFO:tasks.workunit.client.0.smithi033.stdout:0/862: dwrite db/d19/d32/f6f [4194304,4194304] 0 2024-02-15T22:41:03.044 INFO:tasks.workunit.client.0.smithi033.stdout:0/863: mkdir db/d2a/d6e/dc3/d127 0 2024-02-15T22:41:03.044 INFO:tasks.workunit.client.0.smithi033.stdout:0/864: mkdir db/d2a/dc7/de6/d128 0 2024-02-15T22:41:03.046 INFO:tasks.workunit.client.0.smithi033.stdout:0/865: unlink db/l6a 0 2024-02-15T22:41:03.048 INFO:tasks.workunit.client.0.smithi033.stdout:0/866: getdents db/d2a/d6e/d7a 0 2024-02-15T22:41:03.048 INFO:tasks.workunit.client.0.smithi033.stdout:0/867: chown db/d19/d32/d43/fc9 69175477 1 2024-02-15T22:41:03.048 INFO:tasks.workunit.client.0.smithi033.stdout:0/868: readlink db/d19/d32/d46/ld1 0 2024-02-15T22:41:03.049 INFO:tasks.workunit.client.0.smithi033.stdout:0/869: mknod db/d19/d32/d43/d5a/d76/da1/c129 0 2024-02-15T22:41:03.049 INFO:tasks.workunit.client.0.smithi033.stdout:0/870: fsync db/d2a/d6e/d7a/fe4 0 2024-02-15T22:41:03.049 INFO:tasks.workunit.client.0.smithi033.stdout:0/871: fdatasync db/d2a/d6e/d7a/f124 0 2024-02-15T22:41:03.049 INFO:tasks.workunit.client.0.smithi033.stdout:0/872: chown db/d2a/d68/l97 251 1 2024-02-15T22:41:03.050 INFO:tasks.workunit.client.0.smithi033.stdout:0/873: mkdir db/d19/d32/d43/d94/d12a 0 2024-02-15T22:41:03.051 INFO:tasks.workunit.client.0.smithi033.stdout:0/874: rename db/d2a/dc7/d117/f125 to db/d2a/d68/df6/f12b 0 2024-02-15T22:41:03.053 INFO:tasks.workunit.client.0.smithi033.stdout:0/875: getdents db/d19/dd8 0 2024-02-15T22:41:03.054 INFO:tasks.workunit.client.0.smithi033.stdout:0/876: symlink db/d2a/dc7/de6/de7/l12c 0 2024-02-15T22:41:03.056 INFO:tasks.workunit.client.0.smithi033.stdout:0/877: dread db/d19/d32/d43/f78 [0,4194304] 0 2024-02-15T22:41:03.057 INFO:tasks.workunit.client.0.smithi033.stdout:0/878: truncate db/d19/d32/f3c 3741878 0 2024-02-15T22:41:03.057 INFO:tasks.workunit.client.0.smithi033.stdout:0/879: truncate db/d60/fdb 1306327 0 2024-02-15T22:41:03.059 INFO:tasks.workunit.client.0.smithi033.stdout:0/880: dread db/d19/d32/d43/d7d/f85 [0,4194304] 0 2024-02-15T22:41:03.060 INFO:tasks.workunit.client.0.smithi033.stdout:0/881: write db/d19/d32/d43/f78 [493814,16063] 0 2024-02-15T22:41:03.061 INFO:tasks.workunit.client.0.smithi033.stdout:0/882: dread db/d19/dd8/fee [0,4194304] 0 2024-02-15T22:41:03.063 INFO:tasks.workunit.client.0.smithi033.stdout:0/883: truncate db/d19/d32/fb7 385513 0 2024-02-15T22:41:03.064 INFO:tasks.workunit.client.0.smithi033.stdout:0/884: symlink db/d2a/dc7/l12d 0 2024-02-15T22:41:03.065 INFO:tasks.workunit.client.0.smithi033.stdout:0/885: mkdir db/d2a/d6e/dc3/d12e 0 2024-02-15T22:41:03.065 INFO:tasks.workunit.client.0.smithi033.stdout:0/886: chown db/d19/d32/d46 149805 1 2024-02-15T22:41:03.065 INFO:tasks.workunit.client.0.smithi033.stdout:0/887: readlink db/d60/la2 0 2024-02-15T22:41:03.069 INFO:tasks.workunit.client.0.smithi033.stdout:0/888: truncate db/d19/d32/d43/fc9 1454446 0 2024-02-15T22:41:03.070 INFO:tasks.workunit.client.0.smithi033.stdout:0/889: symlink db/d2a/dc7/de6/d128/l12f 0 2024-02-15T22:41:03.071 INFO:tasks.workunit.client.0.smithi033.stdout:0/890: rmdir db/d2a/d6c 39 2024-02-15T22:41:03.085 INFO:tasks.workunit.client.0.smithi033.stdout:0/891: dwrite db/d19/dd8/f108 [0,4194304] 0 2024-02-15T22:41:03.102 INFO:tasks.workunit.client.0.smithi033.stdout:0/892: dwrite db/d19/d32/d43/d5a/d76/da1/fb4 [0,4194304] 0 2024-02-15T22:41:03.118 INFO:tasks.workunit.client.0.smithi033.stdout:0/893: dwrite db/d2a/d6e/d7a/fe4 [0,4194304] 0 2024-02-15T22:41:03.120 INFO:tasks.workunit.client.0.smithi033.stdout:0/894: symlink db/d19/d32/d43/d5a/d76/l130 0 2024-02-15T22:41:03.120 INFO:tasks.workunit.client.0.smithi033.stdout:0/895: readlink db/l11b 0 2024-02-15T22:41:03.120 INFO:tasks.workunit.client.0.smithi033.stdout:0/896: chown db/d2a/d6c/fca 25 1 2024-02-15T22:41:03.129 INFO:tasks.workunit.client.0.smithi033.stdout:0/897: write db/d19/f1f [1830891,107050] 0 2024-02-15T22:41:03.264 INFO:tasks.workunit.client.1.smithi082.stdout:7/15: creat f3 x:0 0 0 2024-02-15T22:41:03.600 INFO:tasks.workunit.client.0.smithi033.stdout:6/840: sync 2024-02-15T22:41:03.600 INFO:tasks.workunit.client.0.smithi033.stdout:0/898: sync 2024-02-15T22:41:03.601 INFO:tasks.workunit.client.0.smithi033.stdout:0/899: truncate db/d19/d32/d46/f53 4214537 0 2024-02-15T22:41:03.601 INFO:tasks.workunit.client.0.smithi033.stdout:6/841: creat d12/d3c/d95/d3f/db6/df3/f10c x:0 0 0 2024-02-15T22:41:03.602 INFO:tasks.workunit.client.0.smithi033.stdout:0/900: mkdir db/d19/d32/d43/d7d/d131 0 2024-02-15T22:41:03.603 INFO:tasks.workunit.client.0.smithi033.stdout:0/901: getdents db/d19/d32/d46/daf 0 2024-02-15T22:41:03.603 INFO:tasks.workunit.client.0.smithi033.stdout:0/902: dread - db/d2a/d6e/d7a/d95/f10e zero size 2024-02-15T22:41:03.603 INFO:tasks.workunit.client.0.smithi033.stdout:6/842: dread d12/d3c/d95/f6c [0,4194304] 0 2024-02-15T22:41:03.604 INFO:tasks.workunit.client.0.smithi033.stdout:0/903: creat db/d19/dd8/d113/f132 x:0 0 0 2024-02-15T22:41:03.626 INFO:tasks.workunit.client.0.smithi033.stdout:6/843: dwrite d12/d2c/dbc/f8f [0,4194304] 0 2024-02-15T22:41:03.626 INFO:tasks.workunit.client.0.smithi033.stdout:0/904: dwrite db/d19/f3a [0,4194304] 0 2024-02-15T22:41:03.628 INFO:tasks.workunit.client.0.smithi033.stdout:6/844: mknod d12/d3c/d95/d3f/d50/dbd/dcb/c10d 0 2024-02-15T22:41:03.631 INFO:tasks.workunit.client.0.smithi033.stdout:0/905: rename db/d2a/d6e/dc3/d109 to db/d2a/d6e/dc3/d127/d133 0 2024-02-15T22:41:03.633 INFO:tasks.workunit.client.0.smithi033.stdout:0/906: rmdir db/d2a/d6e/d7a 39 2024-02-15T22:41:03.633 INFO:tasks.workunit.client.0.smithi033.stdout:0/907: write db/d19/d32/d3d/ff1 [290300,57529] 0 2024-02-15T22:41:03.635 INFO:tasks.workunit.client.0.smithi033.stdout:0/908: link db/d2a/d6e/d7a/d95/cb3 db/d2a/d6e/c134 0 2024-02-15T22:41:03.636 INFO:tasks.workunit.client.0.smithi033.stdout:0/909: write db/d19/dd8/fee [1167239,103009] 0 2024-02-15T22:41:03.640 INFO:tasks.workunit.client.0.smithi033.stdout:0/910: dread db/d19/d32/d43/d7d/f85 [0,4194304] 0 2024-02-15T22:41:03.640 INFO:tasks.workunit.client.0.smithi033.stdout:0/911: chown db/d19/d32/l28 0 1 2024-02-15T22:41:03.640 INFO:tasks.workunit.client.0.smithi033.stdout:0/912: truncate db/d19/d32/d43/d7d/d9c/fc4 109955 0 2024-02-15T22:41:03.641 INFO:tasks.workunit.client.0.smithi033.stdout:0/913: symlink db/d60/d111/l135 0 2024-02-15T22:41:03.642 INFO:tasks.workunit.client.0.smithi033.stdout:0/914: mkdir db/d2a/d136 0 2024-02-15T22:41:03.642 INFO:tasks.workunit.client.0.smithi033.stdout:0/915: stat db/d19/d32/d43/d7d/d131 0 2024-02-15T22:41:03.643 INFO:tasks.workunit.client.0.smithi033.stdout:0/916: write db/d19/f1f [207073,127933] 0 2024-02-15T22:41:03.643 INFO:tasks.workunit.client.0.smithi033.stdout:0/917: readlink db/l12 0 2024-02-15T22:41:03.645 INFO:tasks.workunit.client.0.smithi033.stdout:0/918: link db/d19/d32/d43/d5a/d76/fc1 db/d2a/d136/f137 0 2024-02-15T22:41:03.647 INFO:tasks.workunit.client.0.smithi033.stdout:0/919: link db/d19/d32/d43/d7d/ff0 db/d19/d32/d43/d7d/d131/f138 0 2024-02-15T22:41:03.648 INFO:tasks.workunit.client.0.smithi033.stdout:0/920: write db/d60/fdb [102039,26182] 0 2024-02-15T22:41:03.649 INFO:tasks.workunit.client.0.smithi033.stdout:0/921: stat db/d19/c5d 0 2024-02-15T22:41:03.650 INFO:tasks.workunit.client.0.smithi033.stdout:0/922: rmdir db/d2a/dc7/d117 39 2024-02-15T22:41:03.650 INFO:tasks.workunit.client.0.smithi033.stdout:0/923: creat db/d2a/d68/d8b/f139 x:0 0 0 2024-02-15T22:41:03.652 INFO:tasks.workunit.client.0.smithi033.stdout:6/845: dwrite d12/d2c/d30/fbe [0,4194304] 0 2024-02-15T22:41:03.675 INFO:tasks.workunit.client.0.smithi033.stdout:0/924: dwrite db/d2a/d68/df6/f103 [0,4194304] 0 2024-02-15T22:41:03.675 INFO:tasks.workunit.client.0.smithi033.stdout:6/846: dwrite d12/d2c/fa4 [0,4194304] 0 2024-02-15T22:41:03.676 INFO:tasks.workunit.client.0.smithi033.stdout:0/925: rmdir db/d19/d32/d46 39 2024-02-15T22:41:03.678 INFO:tasks.workunit.client.0.smithi033.stdout:6/847: link d12/d3c/d95/l54 d12/d3c/d95/d3f/db6/df3/l10e 0 2024-02-15T22:41:03.679 INFO:tasks.workunit.client.0.smithi033.stdout:0/926: symlink db/d19/d32/d43/d5a/d76/da1/l13a 0 2024-02-15T22:41:03.680 INFO:tasks.workunit.client.0.smithi033.stdout:6/848: getdents d12/d2c/dbc/dd4 0 2024-02-15T22:41:03.680 INFO:tasks.workunit.client.0.smithi033.stdout:0/927: write db/d19/d32/d3d/f45 [1096907,77029] 0 2024-02-15T22:41:03.683 INFO:tasks.workunit.client.0.smithi033.stdout:0/928: creat db/d2a/dc7/de6/d128/f13b x:0 0 0 2024-02-15T22:41:03.685 INFO:tasks.workunit.client.0.smithi033.stdout:0/929: creat db/d2a/f13c x:0 0 0 2024-02-15T22:41:03.686 INFO:tasks.workunit.client.0.smithi033.stdout:0/930: mknod db/d2a/d6e/d7a/d95/dcd/c13d 0 2024-02-15T22:41:03.686 INFO:tasks.workunit.client.0.smithi033.stdout:0/931: creat db/d19/d32/d43/d94/f13e x:0 0 0 2024-02-15T22:41:03.688 INFO:tasks.workunit.client.0.smithi033.stdout:0/932: symlink db/d19/d32/d43/d7d/d110/l13f 0 2024-02-15T22:41:03.689 INFO:tasks.workunit.client.0.smithi033.stdout:0/933: mkdir db/d19/d32/d43/d94/d140 0 2024-02-15T22:41:03.690 INFO:tasks.workunit.client.0.smithi033.stdout:0/934: creat db/d2a/d6e/dc3/d12e/f141 x:0 0 0 2024-02-15T22:41:03.699 INFO:tasks.workunit.client.0.smithi033.stdout:6/849: dwrite d12/f13 [0,4194304] 0 2024-02-15T22:41:03.699 INFO:tasks.workunit.client.0.smithi033.stdout:6/850: creat d12/d2c/d30/d90/f10f x:0 0 0 2024-02-15T22:41:03.708 INFO:tasks.workunit.client.1.smithi082.stdout:8/4: creat f0 x:0 0 0 2024-02-15T22:41:03.709 INFO:tasks.workunit.client.1.smithi082.stdout:9/2: symlink l0 0 2024-02-15T22:41:03.709 INFO:tasks.workunit.client.1.smithi082.stdout:9/3: readlink l0 0 2024-02-15T22:41:03.716 INFO:tasks.workunit.client.0.smithi033.stdout:6/851: dwrite d12/d2c/f63 [0,4194304] 0 2024-02-15T22:41:03.718 INFO:tasks.workunit.client.0.smithi033.stdout:6/852: truncate d12/d2c/d30/f36 2564464 0 2024-02-15T22:41:03.719 INFO:tasks.workunit.client.0.smithi033.stdout:6/853: write d12/d3c/d95/f6c [123821,59568] 0 2024-02-15T22:41:03.721 INFO:tasks.workunit.client.0.smithi033.stdout:6/854: creat d12/d3c/d95/d3f/d4b/dac/f110 x:0 0 0 2024-02-15T22:41:03.721 INFO:tasks.workunit.client.0.smithi033.stdout:6/855: read d12/d3c/f91 [433343,64463] 0 2024-02-15T22:41:03.723 INFO:tasks.workunit.client.0.smithi033.stdout:6/856: dread d12/d3c/d95/d3f/da3/fe2 [0,4194304] 0 2024-02-15T22:41:03.723 INFO:tasks.workunit.client.0.smithi033.stdout:6/857: truncate d12/d2c/d30/d90/fec 325798 0 2024-02-15T22:41:03.724 INFO:tasks.workunit.client.0.smithi033.stdout:6/858: symlink d12/d2c/dc0/dc8/l111 0 2024-02-15T22:41:03.724 INFO:tasks.workunit.client.0.smithi033.stdout:6/859: write d12/d2c/d30/d90/f9b [924143,27507] 0 2024-02-15T22:41:03.741 INFO:tasks.workunit.client.0.smithi033.stdout:6/860: dwrite d12/d2c/d30/d90/f9b [0,4194304] 0 2024-02-15T22:41:03.741 INFO:tasks.workunit.client.0.smithi033.stdout:6/861: write d12/d2c/d30/da5/fce [434956,119507] 0 2024-02-15T22:41:03.742 INFO:tasks.workunit.client.0.smithi033.stdout:6/862: write d12/d3c/d95/d3f/d4b/dac/f7c [790936,11022] 0 2024-02-15T22:41:03.742 INFO:tasks.workunit.client.0.smithi033.stdout:6/863: dread d12/d3c/d95/d3f/da3/fe2 [0,4194304] 0 2024-02-15T22:41:03.744 INFO:tasks.workunit.client.0.smithi033.stdout:6/864: symlink d12/d2c/d30/da5/l112 0 2024-02-15T22:41:03.744 INFO:tasks.workunit.client.0.smithi033.stdout:6/865: dread - d12/d2c/d30/d90/fe9 zero size 2024-02-15T22:41:03.766 INFO:tasks.workunit.client.0.smithi033.stdout:6/866: dwrite d12/d3c/d95/d3f/da3/faa [0,4194304] 0 2024-02-15T22:41:03.767 INFO:tasks.workunit.client.0.smithi033.stdout:6/867: dread d12/d3c/d95/d3f/d50/dbd/fea [0,4194304] 0 2024-02-15T22:41:03.767 INFO:tasks.workunit.client.0.smithi033.stdout:6/868: fsync d12/d2c/d30/d90/f9b 0 2024-02-15T22:41:03.770 INFO:tasks.workunit.client.0.smithi033.stdout:6/869: rename d12/d3c/f91 to d12/d2c/d30/d90/dc7/d107/f113 0 2024-02-15T22:41:03.770 INFO:tasks.workunit.client.0.smithi033.stdout:6/870: write d12/d2c/d30/d90/dc7/d107/f113 [3542122,92186] 0 2024-02-15T22:41:03.770 INFO:tasks.workunit.client.0.smithi033.stdout:6/871: read - d12/ff2 zero size 2024-02-15T22:41:03.771 INFO:tasks.workunit.client.0.smithi033.stdout:6/872: mknod d12/d3c/d95/d3f/d4b/dac/d5c/c114 0 2024-02-15T22:41:03.787 INFO:tasks.workunit.client.0.smithi033.stdout:6/873: dwrite d12/d3c/f4c [0,4194304] 0 2024-02-15T22:41:03.787 INFO:tasks.workunit.client.0.smithi033.stdout:6/874: dread - d12/d2c/dc0/dc8/ff4 zero size 2024-02-15T22:41:03.790 INFO:tasks.workunit.client.0.smithi033.stdout:6/875: mkdir d12/d2c/dc0/dc8/d115 0 2024-02-15T22:41:03.790 INFO:tasks.workunit.client.0.smithi033.stdout:6/876: fdatasync d12/f109 0 2024-02-15T22:41:03.796 INFO:tasks.workunit.client.0.smithi033.stdout:6/877: symlink d12/d2c/dbc/l116 0 2024-02-15T22:41:03.798 INFO:tasks.workunit.client.0.smithi033.stdout:6/878: link d12/d2c/d30/f3d d12/d3c/da1/f117 0 2024-02-15T22:41:03.798 INFO:tasks.workunit.client.0.smithi033.stdout:6/879: write d12/d3c/d95/d3f/d50/f10b [85827,94437] 0 2024-02-15T22:41:03.799 INFO:tasks.workunit.client.0.smithi033.stdout:6/880: read d12/f109 [114732,117220] 0 2024-02-15T22:41:03.799 INFO:tasks.workunit.client.0.smithi033.stdout:6/881: truncate d12/fdf 391680 0 2024-02-15T22:41:03.799 INFO:tasks.workunit.client.0.smithi033.stdout:6/882: chown d12/d3c/d95/d3f 923993435 1 2024-02-15T22:41:03.800 INFO:tasks.workunit.client.0.smithi033.stdout:6/883: unlink d12/d3c/d95/d3f/f89 0 2024-02-15T22:41:03.803 INFO:tasks.workunit.client.0.smithi033.stdout:0/935: sync 2024-02-15T22:41:03.804 INFO:tasks.workunit.client.0.smithi033.stdout:0/936: symlink db/d19/dd8/l142 0 2024-02-15T22:41:03.805 INFO:tasks.workunit.client.0.smithi033.stdout:0/937: mknod db/d60/c143 0 2024-02-15T22:41:03.809 INFO:tasks.workunit.client.0.smithi033.stdout:0/938: dread db/d19/d32/d43/fc9 [0,4194304] 0 2024-02-15T22:41:03.810 INFO:tasks.workunit.client.0.smithi033.stdout:0/939: mkdir db/d2a/d6c/d121/d144 0 2024-02-15T22:41:03.810 INFO:tasks.workunit.client.0.smithi033.stdout:0/940: chown db/fa8 368964 1 2024-02-15T22:41:03.810 INFO:tasks.workunit.client.0.smithi033.stdout:0/941: chown db/d19/f3f 195 1 2024-02-15T22:41:03.811 INFO:tasks.workunit.client.0.smithi033.stdout:0/942: creat db/d2a/f145 x:0 0 0 2024-02-15T22:41:03.826 INFO:tasks.workunit.client.0.smithi033.stdout:6/884: dwrite d12/d2c/d30/f72 [0,4194304] 0 2024-02-15T22:41:03.826 INFO:tasks.workunit.client.0.smithi033.stdout:6/885: write d12/d2c/dbc/f104 [937388,119110] 0 2024-02-15T22:41:03.828 INFO:tasks.workunit.client.0.smithi033.stdout:0/943: dwrite db/d19/dd8/fee [0,4194304] 0 2024-02-15T22:41:03.828 INFO:tasks.workunit.client.0.smithi033.stdout:0/944: chown db/d19/d32/d3d/f59 31017 1 2024-02-15T22:41:03.828 INFO:tasks.workunit.client.0.smithi033.stdout:0/945: chown db/d19/d32/d43/fc9 477475269 1 2024-02-15T22:41:03.829 INFO:tasks.workunit.client.0.smithi033.stdout:6/886: symlink d12/d2c/d30/d1d/l118 0 2024-02-15T22:41:03.836 INFO:tasks.workunit.client.0.smithi033.stdout:6/887: getdents d12/d2c/d30/d90 0 2024-02-15T22:41:03.838 INFO:tasks.workunit.client.0.smithi033.stdout:0/946: write db/d60/dec/fef [1848985,45673] 0 2024-02-15T22:41:03.838 INFO:tasks.workunit.client.0.smithi033.stdout:0/947: creat db/d60/f146 x:0 0 0 2024-02-15T22:41:03.838 INFO:tasks.workunit.client.0.smithi033.stdout:0/948: read db/d19/f1f [593724,64693] 0 2024-02-15T22:41:03.839 INFO:tasks.workunit.client.0.smithi033.stdout:6/888: mkdir d12/d2c/d30/d90/dc7/dd6/d119 0 2024-02-15T22:41:03.845 INFO:tasks.workunit.client.0.smithi033.stdout:6/889: mkdir d12/d2c/dbc/d11a 0 2024-02-15T22:41:03.846 INFO:tasks.workunit.client.0.smithi033.stdout:6/890: mknod d12/d2c/dc3/c11b 0 2024-02-15T22:41:03.851 INFO:tasks.workunit.client.0.smithi033.stdout:6/891: dread d12/d2c/d30/d1d/f60 [0,4194304] 0 2024-02-15T22:41:03.853 INFO:tasks.workunit.client.0.smithi033.stdout:6/892: dread d12/d3c/d95/f52 [0,4194304] 0 2024-02-15T22:41:03.854 INFO:tasks.workunit.client.0.smithi033.stdout:0/949: dwrite db/d2a/d68/d8b/f96 [0,4194304] 0 2024-02-15T22:41:03.854 INFO:tasks.workunit.client.0.smithi033.stdout:0/950: fdatasync db/d19/d32/d43/d5a/d76/da1/fb4 0 2024-02-15T22:41:03.864 INFO:tasks.workunit.client.0.smithi033.stdout:0/951: dread db/d19/f72 [0,4194304] 0 2024-02-15T22:41:03.866 INFO:tasks.workunit.client.0.smithi033.stdout:0/952: rename db/d2a/d6c/ldc to db/d60/dec/l147 0 2024-02-15T22:41:03.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/953: rmdir db 39 2024-02-15T22:41:03.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/954: write db/d19/dd8/d113/f132 [223364,84679] 0 2024-02-15T22:41:03.887 INFO:tasks.workunit.client.0.smithi033.stdout:0/955: write db/d2a/d6e/f8f [369932,100581] 0 2024-02-15T22:41:03.889 INFO:tasks.workunit.client.0.smithi033.stdout:0/956: creat db/d2a/d6e/f148 x:0 0 0 2024-02-15T22:41:03.889 INFO:tasks.workunit.client.0.smithi033.stdout:0/957: creat db/d2a/d68/f149 x:0 0 0 2024-02-15T22:41:03.904 INFO:tasks.workunit.client.0.smithi033.stdout:0/958: dwrite db/d2a/d68/df6/f12b [0,4194304] 0 2024-02-15T22:41:03.906 INFO:tasks.workunit.client.0.smithi033.stdout:0/959: creat db/d2a/f14a x:0 0 0 2024-02-15T22:41:03.923 INFO:tasks.workunit.client.0.smithi033.stdout:0/960: dwrite db/d19/d32/f48 [4194304,4194304] 0 2024-02-15T22:41:03.928 INFO:tasks.workunit.client.0.smithi033.stdout:0/961: dread db/d2a/fe5 [0,4194304] 0 2024-02-15T22:41:04.008 INFO:tasks.workunit.client.0.smithi033.stdout:6/893: sync 2024-02-15T22:41:04.013 INFO:tasks.workunit.client.0.smithi033.stdout:6/894: dread d12/d2c/d30/d1d/f60 [0,4194304] 0 2024-02-15T22:41:04.013 INFO:tasks.workunit.client.0.smithi033.stdout:6/895: fdatasync d12/d3c/d95/fb5 0 2024-02-15T22:41:04.013 INFO:tasks.workunit.client.0.smithi033.stdout:6/896: fdatasync d12/d3c/fcf 0 2024-02-15T22:41:04.014 INFO:tasks.workunit.client.0.smithi033.stdout:6/897: write d12/d2c/dc0/ff9 [4944373,92267] 0 2024-02-15T22:41:04.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:03 smithi033 ceph-mon[29033]: pgmap v14: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 185 MiB/s rd, 231 MiB/s wr, 783 op/s 2024-02-15T22:41:04.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:03 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:04.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:03 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:04.030 INFO:tasks.workunit.client.0.smithi033.stdout:6/898: dwrite d12/f18 [8388608,4194304] 0 2024-02-15T22:41:04.030 INFO:tasks.workunit.client.0.smithi033.stdout:6/899: chown d12/d3c/d95/d3f/c56 161 1 2024-02-15T22:41:04.031 INFO:tasks.workunit.client.0.smithi033.stdout:6/900: unlink d12/d3c/d95/d3f/d4b/fd2 0 2024-02-15T22:41:04.031 INFO:tasks.workunit.client.0.smithi033.stdout:6/901: symlink d12/d2c/dc3/l11c 0 2024-02-15T22:41:04.032 INFO:tasks.workunit.client.0.smithi033.stdout:6/902: mkdir d12/d2c/d30/d90/d11d 0 2024-02-15T22:41:04.042 INFO:tasks.workunit.client.0.smithi033.stdout:6/903: dread d12/d2c/d30/f72 [0,4194304] 0 2024-02-15T22:41:04.042 INFO:tasks.workunit.client.0.smithi033.stdout:6/904: stat d12/d2c/d30/d90/fe9 0 2024-02-15T22:41:04.043 INFO:tasks.workunit.client.0.smithi033.stdout:6/905: mkdir d12/d3c/d95/d3f/d50/dfc/dfd/d11e 0 2024-02-15T22:41:04.045 INFO:tasks.workunit.client.0.smithi033.stdout:0/962: sync 2024-02-15T22:41:04.046 INFO:tasks.workunit.client.0.smithi033.stdout:0/963: mknod db/d2a/dc7/de6/c14b 0 2024-02-15T22:41:04.052 INFO:tasks.workunit.client.0.smithi033.stdout:0/964: dread db/d19/d32/d43/d5a/d76/f86 [0,4194304] 0 2024-02-15T22:41:04.053 INFO:tasks.workunit.client.0.smithi033.stdout:0/965: fdatasync db/d2a/d68/df6/f12b 0 2024-02-15T22:41:04.070 INFO:tasks.workunit.client.0.smithi033.stdout:0/966: dwrite db/d19/f2d [0,4194304] 0 2024-02-15T22:41:04.070 INFO:tasks.workunit.client.0.smithi033.stdout:0/967: readlink db/d19/l1d 0 2024-02-15T22:41:04.072 INFO:tasks.workunit.client.0.smithi033.stdout:0/968: rmdir db/d2a/d6c/d121/d144 0 2024-02-15T22:41:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:0/969: creat db/d60/de8/df3/f14c x:0 0 0 2024-02-15T22:41:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:0/970: truncate db/d19/d32/d46/daf/ffa 974406 0 2024-02-15T22:41:04.091 INFO:tasks.workunit.client.0.smithi033.stdout:0/971: dwrite db/d19/d32/d43/fbb [0,4194304] 0 2024-02-15T22:41:04.094 INFO:tasks.workunit.client.0.smithi033.stdout:0/972: link db/d2a/d6e/d7a/d95/l99 db/d19/d32/d43/d7d/l14d 0 2024-02-15T22:41:04.094 INFO:tasks.workunit.client.0.smithi033.stdout:0/973: stat db/d19/d32/d43/d94 0 2024-02-15T22:41:04.094 INFO:tasks.workunit.client.0.smithi033.stdout:0/974: read db/d19/d32/f23 [6248042,102594] 0 2024-02-15T22:41:04.094 INFO:tasks.workunit.client.0.smithi033.stdout:0/975: truncate db/d2a/d6c/f93 333147 0 2024-02-15T22:41:04.095 INFO:tasks.workunit.client.0.smithi033.stdout:0/976: creat db/d2a/d68/d8b/dbf/d107/f14e x:0 0 0 2024-02-15T22:41:04.096 INFO:tasks.workunit.client.0.smithi033.stdout:0/977: creat db/d2a/d6e/dc3/d12e/f14f x:0 0 0 2024-02-15T22:41:04.097 INFO:tasks.workunit.client.0.smithi033.stdout:0/978: truncate db/d19/dd8/d113/f132 1345053 0 2024-02-15T22:41:04.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/979: dwrite db/d2a/d68/df6/f103 [4194304,4194304] 0 2024-02-15T22:41:04.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/980: chown db/f87 13917 1 2024-02-15T22:41:04.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:03 smithi082 ceph-mon[37153]: pgmap v14: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 185 MiB/s rd, 231 MiB/s wr, 783 op/s 2024-02-15T22:41:04.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:03 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:04.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:03 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:04.133 INFO:tasks.workunit.client.0.smithi033.stdout:0/981: dwrite db/d2a/d68/d8b/f139 [0,4194304] 0 2024-02-15T22:41:04.136 INFO:tasks.workunit.client.0.smithi033.stdout:0/982: rename db/d19/d32/d46/l70 to db/d19/dd8/d113/l150 0 2024-02-15T22:41:04.136 INFO:tasks.workunit.client.0.smithi033.stdout:0/983: chown db/d2a/d6e/d7a/d95/f10e 10545624 1 2024-02-15T22:41:04.137 INFO:tasks.workunit.client.0.smithi033.stdout:0/984: write db/d19/d32/d3d/f45 [413873,76000] 0 2024-02-15T22:41:04.137 INFO:tasks.workunit.client.0.smithi033.stdout:0/985: readlink db/d19/l27 0 2024-02-15T22:41:04.138 INFO:tasks.workunit.client.0.smithi033.stdout:0/986: unlink db/d60/f146 0 2024-02-15T22:41:04.162 INFO:tasks.workunit.client.0.smithi033.stdout:0/987: dwrite fa [0,4194304] 0 2024-02-15T22:41:04.178 INFO:tasks.workunit.client.0.smithi033.stdout:0/988: dwrite db/d19/d32/d43/d5a/d76/f86 [0,4194304] 0 2024-02-15T22:41:04.184 INFO:tasks.workunit.client.0.smithi033.stdout:0/989: dread db/d2a/fe5 [0,4194304] 0 2024-02-15T22:41:04.185 INFO:tasks.workunit.client.0.smithi033.stdout:0/990: getdents db/d2a/d68/d8b 0 2024-02-15T22:41:04.186 INFO:tasks.workunit.client.0.smithi033.stdout:0/991: truncate db/d2a/d6e/d7a/f100 656618 0 2024-02-15T22:41:04.186 INFO:tasks.workunit.client.0.smithi033.stdout:0/992: write db/d60/fdb [998412,112589] 0 2024-02-15T22:41:04.188 INFO:tasks.workunit.client.0.smithi033.stdout:0/993: creat db/d19/d32/d3d/f151 x:0 0 0 2024-02-15T22:41:04.193 INFO:tasks.workunit.client.0.smithi033.stdout:0/994: mknod db/d19/d32/d43/d5a/d76/c152 0 2024-02-15T22:41:04.195 INFO:tasks.workunit.client.0.smithi033.stdout:0/995: rmdir db/d19 39 2024-02-15T22:41:04.195 INFO:tasks.workunit.client.0.smithi033.stdout:0/996: chown db/d2a/d136 42901 1 2024-02-15T22:41:04.195 INFO:tasks.workunit.client.0.smithi033.stdout:0/997: stat db/d19/d32/d43/d94/fc5 0 2024-02-15T22:41:04.196 INFO:tasks.workunit.client.0.smithi033.stdout:0/998: creat db/d60/d111/f153 x:0 0 0 2024-02-15T22:41:04.197 INFO:tasks.workunit.client.0.smithi033.stdout:0/999: symlink db/d2a/d68/df6/l154 0 2024-02-15T22:41:04.203 INFO:tasks.workunit.client.0.smithi033.stdout:6/906: sync 2024-02-15T22:41:04.211 INFO:tasks.workunit.client.0.smithi033.stdout:6/907: dread d12/d3c/d95/d3f/d50/f65 [0,4194304] 0 2024-02-15T22:41:04.212 INFO:tasks.workunit.client.0.smithi033.stdout:6/908: mknod d12/d3c/d95/d3f/d4b/dac/c11f 0 2024-02-15T22:41:04.213 INFO:tasks.workunit.client.0.smithi033.stdout:6/909: creat d12/d3c/f120 x:0 0 0 2024-02-15T22:41:04.213 INFO:tasks.workunit.client.0.smithi033.stdout:6/910: chown d12/d3c/d95/d3f/d4b/fa0 0 1 2024-02-15T22:41:04.214 INFO:tasks.workunit.client.0.smithi033.stdout:6/911: mknod d12/d3c/da1/c121 0 2024-02-15T22:41:04.214 INFO:tasks.workunit.client.0.smithi033.stdout:6/912: readlink l1 0 2024-02-15T22:41:04.214 INFO:tasks.workunit.client.0.smithi033.stdout:6/913: read d12/d3c/d95/d3f/da3/fe1 [825045,76824] 0 2024-02-15T22:41:04.232 INFO:tasks.workunit.client.0.smithi033.stdout:6/914: dwrite d12/d2c/dbc/f84 [0,4194304] 0 2024-02-15T22:41:04.232 INFO:tasks.workunit.client.0.smithi033.stdout:6/915: stat d12/d3c/d95/d3f/d50/dfc 0 2024-02-15T22:41:04.233 INFO:tasks.workunit.client.0.smithi033.stdout:6/916: symlink d12/d3c/d95/d3f/d4b/l122 0 2024-02-15T22:41:04.233 INFO:tasks.workunit.client.0.smithi033.stdout:6/917: read - d12/d2c/d30/d90/dc7/ffe zero size 2024-02-15T22:41:04.233 INFO:tasks.workunit.client.0.smithi033.stdout:6/918: chown d12/d2c/dbc/c99 116 1 2024-02-15T22:41:04.234 INFO:tasks.workunit.client.0.smithi033.stdout:6/919: unlink d12/d3c/da1/c121 0 2024-02-15T22:41:04.255 INFO:tasks.workunit.client.0.smithi033.stdout:6/920: dwrite d12/d2c/dbc/f26 [4194304,4194304] 0 2024-02-15T22:41:04.256 INFO:tasks.workunit.client.0.smithi033.stdout:6/921: truncate d12/d3c/da1/f117 1988434 0 2024-02-15T22:41:04.258 INFO:tasks.workunit.client.0.smithi033.stdout:6/922: rename d12/d3c/d95/f6c to d12/d2c/d30/d90/f123 0 2024-02-15T22:41:04.258 INFO:tasks.workunit.client.0.smithi033.stdout:6/923: write d12/d3c/d95/d3f/d4b/dac/f7c [1497793,27763] 0 2024-02-15T22:41:04.259 INFO:tasks.workunit.client.0.smithi033.stdout:6/924: read d12/d3c/d95/d3f/d50/fb2 [958231,43055] 0 2024-02-15T22:41:04.262 INFO:tasks.workunit.client.0.smithi033.stdout:6/925: dread d12/f29 [0,4194304] 0 2024-02-15T22:41:04.264 INFO:tasks.workunit.client.0.smithi033.stdout:6/926: mknod d12/d2c/d30/d90/dc7/dd6/d119/c124 0 2024-02-15T22:41:04.264 INFO:tasks.workunit.client.0.smithi033.stdout:6/927: creat d12/d2c/dbc/f125 x:0 0 0 2024-02-15T22:41:04.271 INFO:tasks.workunit.client.0.smithi033.stdout:6/928: dread d12/f78 [0,4194304] 0 2024-02-15T22:41:04.275 INFO:tasks.workunit.client.0.smithi033.stdout:6/929: dread d12/d2c/d30/f3d [0,4194304] 0 2024-02-15T22:41:04.290 INFO:tasks.workunit.client.0.smithi033.stdout:6/930: dwrite d12/d3c/d95/d3f/d50/f65 [0,4194304] 0 2024-02-15T22:41:04.290 INFO:tasks.workunit.client.0.smithi033.stdout:6/931: chown d12/d2c/dc0/dc8/l111 5 1 2024-02-15T22:41:04.307 INFO:tasks.workunit.client.0.smithi033.stdout:6/932: dwrite d12/d2c/dbc/f26 [0,4194304] 0 2024-02-15T22:41:04.307 INFO:tasks.workunit.client.0.smithi033.stdout:6/933: write d12/d2c/d30/d90/dc7/dd6/fef [304657,102231] 0 2024-02-15T22:41:04.308 INFO:tasks.workunit.client.0.smithi033.stdout:6/934: creat d12/d2c/dbc/d11a/f126 x:0 0 0 2024-02-15T22:41:04.308 INFO:tasks.workunit.client.0.smithi033.stdout:6/935: truncate d12/d3c/d95/fb5 1093704 0 2024-02-15T22:41:04.324 INFO:tasks.workunit.client.0.smithi033.stdout:6/936: dwrite d12/d2c/d30/d90/dc7/ff6 [0,4194304] 0 2024-02-15T22:41:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/937: creat d12/d2c/d30/d90/d11d/f127 x:0 0 0 2024-02-15T22:41:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/938: fsync d12/d2c/dc0/ff9 0 2024-02-15T22:41:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/939: creat d12/d3c/d95/d3f/db6/df3/f128 x:0 0 0 2024-02-15T22:41:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/940: stat d12/d2c/d30/d1d/d35/c75 0 2024-02-15T22:41:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/941: stat d12/d3c/d95/d3f/cd1 0 2024-02-15T22:41:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/942: chown d12/d3c/d95/d3f/d4b/dac/d5c 5970753 1 2024-02-15T22:41:04.332 INFO:tasks.workunit.client.0.smithi033.stdout:6/943: rename d12/d3c/d95/d3f/d4b to d12/d2c/dc0/dc8/dfb/d129 0 2024-02-15T22:41:04.332 INFO:tasks.workunit.client.0.smithi033.stdout:6/944: write d12/d3c/d95/d3f/f43 [2507334,4576] 0 2024-02-15T22:41:04.332 INFO:tasks.workunit.client.0.smithi033.stdout:6/945: chown d12/d2c/dc0/db7 1693 1 2024-02-15T22:41:04.333 INFO:tasks.workunit.client.0.smithi033.stdout:6/946: rmdir d12/d2c/dc3 39 2024-02-15T22:41:04.347 INFO:tasks.workunit.client.0.smithi033.stdout:6/947: dwrite d12/fdf [0,4194304] 0 2024-02-15T22:41:04.352 INFO:tasks.workunit.client.1.smithi082.stdout:0/14: rename d3/l4 to d3/l5 0 2024-02-15T22:41:04.356 INFO:tasks.workunit.client.0.smithi033.stdout:6/948: write d12/d2c/d30/d1d/f46 [3528708,9548] 0 2024-02-15T22:41:04.358 INFO:tasks.workunit.client.0.smithi033.stdout:6/949: creat d12/d2c/d30/d1d/dfa/f12a x:0 0 0 2024-02-15T22:41:04.358 INFO:tasks.workunit.client.0.smithi033.stdout:6/950: fsync d12/f109 0 2024-02-15T22:41:04.359 INFO:tasks.workunit.client.0.smithi033.stdout:6/951: write d12/d3c/d95/d3f/fed [692939,119814] 0 2024-02-15T22:41:04.373 INFO:tasks.workunit.client.0.smithi033.stdout:6/952: dwrite d12/f18 [0,4194304] 0 2024-02-15T22:41:04.373 INFO:tasks.workunit.client.0.smithi033.stdout:6/953: fsync d12/d3c/d95/d3f/da3/faa 0 2024-02-15T22:41:04.374 INFO:tasks.workunit.client.0.smithi033.stdout:6/954: dread d12/d2c/dc0/fb9 [0,4194304] 0 2024-02-15T22:41:04.375 INFO:tasks.workunit.client.0.smithi033.stdout:6/955: creat d12/d2c/dc3/f12b x:0 0 0 2024-02-15T22:41:04.381 INFO:tasks.workunit.client.0.smithi033.stdout:6/956: dread d12/fdf [0,4194304] 0 2024-02-15T22:41:04.401 INFO:tasks.workunit.client.1.smithi082.stdout:4/6: symlink d0/l3 0 2024-02-15T22:41:04.403 INFO:tasks.workunit.client.0.smithi033.stdout:6/957: dwrite d12/d3c/fcf [4194304,4194304] 0 2024-02-15T22:41:04.411 INFO:tasks.workunit.client.1.smithi082.stdout:4/7: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:04.413 INFO:tasks.workunit.client.0.smithi033.stdout:6/958: dread d12/d2c/d30/d1d/f46 [0,4194304] 0 2024-02-15T22:41:04.413 INFO:tasks.workunit.client.0.smithi033.stdout:6/959: fdatasync d12/d2c/d30/fbe 0 2024-02-15T22:41:04.415 INFO:tasks.workunit.client.0.smithi033.stdout:6/960: rename d12/d2c/dc0/dc8/dfb/d129/l122 to d12/d2c/dbc/d11a/l12c 0 2024-02-15T22:41:04.417 INFO:tasks.workunit.client.0.smithi033.stdout:6/961: unlink d12/d2c/dc0/ff9 0 2024-02-15T22:41:04.420 INFO:tasks.workunit.client.0.smithi033.stdout:6/962: dread d12/fdf [0,4194304] 0 2024-02-15T22:41:04.420 INFO:tasks.workunit.client.0.smithi033.stdout:6/963: fdatasync d12/d2c/dbc/d11a/f126 0 2024-02-15T22:41:04.420 INFO:tasks.workunit.client.0.smithi033.stdout:6/964: chown d12/d2c/dc0/dc8/dfb/d129/dac/d5c/fd7 379 1 2024-02-15T22:41:04.420 INFO:tasks.workunit.client.0.smithi033.stdout:6/965: fsync d12/d3c/d95/d3f/d50/ff1 0 2024-02-15T22:41:04.422 INFO:tasks.workunit.client.0.smithi033.stdout:6/966: dread fa [4194304,4194304] 0 2024-02-15T22:41:04.423 INFO:tasks.workunit.client.0.smithi033.stdout:6/967: write d12/f109 [884738,91988] 0 2024-02-15T22:41:04.423 INFO:tasks.workunit.client.0.smithi033.stdout:6/968: fdatasync d12/d3c/fa2 0 2024-02-15T22:41:04.423 INFO:tasks.workunit.client.0.smithi033.stdout:6/969: truncate d12/d2c/dc0/dc8/ff4 535294 0 2024-02-15T22:41:04.423 INFO:tasks.workunit.client.0.smithi033.stdout:6/970: readlink d12/d3c/d95/l54 0 2024-02-15T22:41:04.424 INFO:tasks.workunit.client.0.smithi033.stdout:6/971: mkdir d12/d2c/dc3/d12d 0 2024-02-15T22:41:04.426 INFO:tasks.workunit.client.0.smithi033.stdout:6/972: unlink d12/d3c/d95/d3f/db6/df3/f10c 0 2024-02-15T22:41:04.428 INFO:tasks.workunit.client.0.smithi033.stdout:6/973: link d12/d3c/d95/d3f/c4f d12/d2c/dc0/dc8/dfb/d129/dac/c12e 0 2024-02-15T22:41:04.437 INFO:tasks.workunit.client.0.smithi033.stdout:6/974: dread d12/d3c/d95/d3f/da3/faa [0,4194304] 0 2024-02-15T22:41:04.439 INFO:tasks.workunit.client.0.smithi033.stdout:6/975: rename d12/ff2 to d12/d2c/dbc/d11a/f12f 0 2024-02-15T22:41:04.440 INFO:tasks.workunit.client.0.smithi033.stdout:6/976: mknod d12/d2c/c130 0 2024-02-15T22:41:04.442 INFO:tasks.workunit.client.0.smithi033.stdout:6/977: creat d12/d2c/d30/d90/dc7/dd6/d119/f131 x:0 0 0 2024-02-15T22:41:04.442 INFO:tasks.workunit.client.0.smithi033.stdout:6/978: chown d12/d3c/d95/d3f/db6/fc9 127292 1 2024-02-15T22:41:04.449 INFO:tasks.workunit.client.0.smithi033.stdout:6/979: dread d12/f109 [0,4194304] 0 2024-02-15T22:41:04.449 INFO:tasks.workunit.client.0.smithi033.stdout:6/980: write d12/d2c/dc0/dc8/ff4 [292376,57026] 0 2024-02-15T22:41:04.451 INFO:tasks.workunit.client.0.smithi033.stdout:6/981: rename d12/d3c/d95/d3f/d50/dfc/dfd to d12/d2c/dc0/dc8/d115/d132 0 2024-02-15T22:41:04.461 INFO:tasks.workunit.client.0.smithi033.stdout:6/982: write d12/d2c/dc0/dc8/dfb/d129/dac/d5c/fd7 [4080664,31265] 0 2024-02-15T22:41:04.475 INFO:tasks.workunit.client.0.smithi033.stdout:6/983: dwrite d12/d2c/d30/d90/fec [0,4194304] 0 2024-02-15T22:41:04.477 INFO:tasks.workunit.client.0.smithi033.stdout:6/984: unlink d12/d2c/d30/d90/dc7/ff6 0 2024-02-15T22:41:04.499 INFO:tasks.workunit.client.0.smithi033.stdout:6/985: dwrite d12/d2c/d30/f49 [4194304,4194304] 0 2024-02-15T22:41:04.502 INFO:tasks.workunit.client.0.smithi033.stdout:6/986: getdents d12/d2c/d30/d90/dc7 0 2024-02-15T22:41:04.503 INFO:tasks.workunit.client.0.smithi033.stdout:6/987: dread d12/d3c/d95/d3f/d50/dbd/dcb/feb [0,4194304] 0 2024-02-15T22:41:04.504 INFO:tasks.workunit.client.0.smithi033.stdout:6/988: mknod d12/d3c/d95/d3f/c133 0 2024-02-15T22:41:04.505 INFO:tasks.workunit.client.0.smithi033.stdout:6/989: link d12/d2c/d30/d1d/f33 d12/d2c/d30/d90/dc7/dd6/f134 0 2024-02-15T22:41:04.505 INFO:tasks.workunit.client.0.smithi033.stdout:6/990: dread - d12/d2c/dc0/dc8/f105 zero size 2024-02-15T22:41:04.522 INFO:tasks.workunit.client.0.smithi033.stdout:6/991: dwrite d12/d2c/dc0/dc8/dfb/d129/dac/f77 [0,4194304] 0 2024-02-15T22:41:04.523 INFO:tasks.workunit.client.0.smithi033.stdout:6/992: write d12/d2c/dc0/dc8/ff4 [613062,127033] 0 2024-02-15T22:41:04.523 INFO:tasks.workunit.client.0.smithi033.stdout:6/993: readlink d12/d2c/d30/l96 0 2024-02-15T22:41:04.543 INFO:tasks.workunit.client.0.smithi033.stdout:6/994: dwrite d12/d3c/d95/fb5 [0,4194304] 0 2024-02-15T22:41:04.544 INFO:tasks.workunit.client.0.smithi033.stdout:6/995: truncate d12/d2c/d30/d1d/dfa/f12a 651856 0 2024-02-15T22:41:04.544 INFO:tasks.workunit.client.0.smithi033.stdout:6/996: fsync d12/d2c/dc0/dc8/dfb/d129/fd0 0 2024-02-15T22:41:04.546 INFO:tasks.workunit.client.0.smithi033.stdout:6/997: rename d12/d3c/f4d to d12/d2c/dc0/dc8/dfb/d129/f135 0 2024-02-15T22:41:04.546 INFO:tasks.workunit.client.0.smithi033.stdout:6/998: creat d12/d2c/dc3/f136 x:0 0 0 2024-02-15T22:41:04.546 INFO:tasks.workunit.client.0.smithi033.stdout:6/999: fsync d12/d2c/d30/f101 0 2024-02-15T22:41:04.549 INFO:tasks.workunit.client.0.smithi033.stderr:+ rm -rf -- ./tmp.wtoHaaVMZL 2024-02-15T22:41:05.143 INFO:tasks.workunit.client.1.smithi082.stdout:1/7: mknod d1/c3 0 2024-02-15T22:41:05.145 INFO:tasks.workunit.client.1.smithi082.stdout:6/10: link d2/f3 d2/f4 0 2024-02-15T22:41:05.148 INFO:tasks.workunit.client.1.smithi082.stdout:2/8: getdents . 0 2024-02-15T22:41:05.148 INFO:tasks.workunit.client.1.smithi082.stdout:2/9: write f0 [969637,73617] 0 2024-02-15T22:41:05.151 INFO:tasks.workunit.client.1.smithi082.stdout:9/4: creat f1 x:0 0 0 2024-02-15T22:41:05.152 INFO:tasks.workunit.client.1.smithi082.stdout:9/5: write f1 [967570,13669] 0 2024-02-15T22:41:05.153 INFO:tasks.workunit.client.1.smithi082.stdout:9/6: write f1 [810915,96617] 0 2024-02-15T22:41:05.173 INFO:tasks.workunit.client.1.smithi082.stdout:9/7: dwrite f1 [0,4194304] 0 2024-02-15T22:41:05.185 INFO:tasks.workunit.client.1.smithi082.stdout:9/8: write f1 [686900,95980] 0 2024-02-15T22:41:05.204 INFO:tasks.workunit.client.1.smithi082.stdout:9/9: dwrite f1 [0,4194304] 0 2024-02-15T22:41:05.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/10: creat f2 x:0 0 0 2024-02-15T22:41:05.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/11: fdatasync f1 0 2024-02-15T22:41:05.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/12: dread - f2 zero size 2024-02-15T22:41:05.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/13: read - f2 zero size 2024-02-15T22:41:05.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/14: chown f2 60294 1 2024-02-15T22:41:05.216 INFO:tasks.workunit.client.1.smithi082.stdout:9/15: dread f1 [0,4194304] 0 2024-02-15T22:41:05.216 INFO:tasks.workunit.client.1.smithi082.stdout:9/16: creat f3 x:0 0 0 2024-02-15T22:41:05.232 INFO:tasks.workunit.client.1.smithi082.stdout:9/17: dwrite f3 [0,4194304] 0 2024-02-15T22:41:05.248 INFO:tasks.workunit.client.1.smithi082.stdout:0/15: creat d3/f6 x:0 0 0 2024-02-15T22:41:05.249 INFO:tasks.workunit.client.1.smithi082.stdout:0/16: truncate d3/f6 190480 0 2024-02-15T22:41:05.250 INFO:tasks.workunit.client.1.smithi082.stdout:4/8: symlink d0/l4 0 2024-02-15T22:41:05.253 INFO:tasks.workunit.client.1.smithi082.stdout:6/11: unlink f1 0 2024-02-15T22:41:05.256 INFO:tasks.workunit.client.1.smithi082.stdout:2/10: rename f1 to f2 0 2024-02-15T22:41:05.257 INFO:tasks.workunit.client.1.smithi082.stdout:8/5: getdents . 0 2024-02-15T22:41:05.262 INFO:tasks.workunit.client.1.smithi082.stdout:9/18: mknod c4 0 2024-02-15T22:41:05.263 INFO:tasks.workunit.client.1.smithi082.stdout:4/9: truncate d0/f2 1944400 0 2024-02-15T22:41:05.265 INFO:tasks.workunit.client.1.smithi082.stdout:5/20: rename f1 to d5/f7 0 2024-02-15T22:41:05.268 INFO:tasks.workunit.client.1.smithi082.stdout:7/16: rename l1 to l4 0 2024-02-15T22:41:05.268 INFO:tasks.workunit.client.1.smithi082.stdout:7/17: rmdir - no directory 2024-02-15T22:41:05.269 INFO:tasks.workunit.client.1.smithi082.stdout:2/11: write f0 [1163638,41398] 0 2024-02-15T22:41:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: Adjusting osd_memory_target on smithi033 to 1559M 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: pgmap v15: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 127 MiB/s rd, 164 MiB/s wr, 680 op/s 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:41:05.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:41:05.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:41:05.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:04 smithi033 ceph-mon[29033]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:41:05.272 INFO:tasks.workunit.client.1.smithi082.stdout:8/6: mkdir d1 0 2024-02-15T22:41:05.272 INFO:tasks.workunit.client.1.smithi082.stdout:4/10: mknod d0/c5 0 2024-02-15T22:41:05.274 INFO:tasks.workunit.client.1.smithi082.stdout:8/7: mknod d1/c2 0 2024-02-15T22:41:05.275 INFO:tasks.workunit.client.1.smithi082.stdout:4/11: rename d0/l4 to d0/l6 0 2024-02-15T22:41:05.276 INFO:tasks.workunit.client.1.smithi082.stdout:5/21: unlink f2 0 2024-02-15T22:41:05.278 INFO:tasks.workunit.client.1.smithi082.stdout:5/22: stat f4 0 2024-02-15T22:41:05.280 INFO:tasks.workunit.client.1.smithi082.stdout:7/18: rename l0 to l5 0 2024-02-15T22:41:05.280 INFO:tasks.workunit.client.1.smithi082.stdout:0/17: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:41:05.280 INFO:tasks.workunit.client.1.smithi082.stdout:0/18: rename d3 to d3/d7 22 2024-02-15T22:41:05.281 INFO:tasks.workunit.client.1.smithi082.stdout:9/19: dwrite f1 [0,4194304] 0 2024-02-15T22:41:05.281 INFO:tasks.workunit.client.1.smithi082.stdout:6/12: dwrite d2/f4 [0,4194304] 0 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:2/12: dread f2 [0,4194304] 0 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:2/13: chown f2 9 1 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:2/14: chown f2 1674942 1 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:2/15: fdatasync f2 0 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:2/16: write f0 [2002027,93656] 0 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:7/19: creat f6 x:0 0 0 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:7/20: write f3 [313816,104480] 0 2024-02-15T22:41:05.284 INFO:tasks.workunit.client.1.smithi082.stdout:7/21: write f3 [1365668,49439] 0 2024-02-15T22:41:05.293 INFO:tasks.workunit.client.1.smithi082.stdout:0/19: write d3/f6 [3417442,74566] 0 2024-02-15T22:41:05.297 INFO:tasks.workunit.client.1.smithi082.stdout:6/13: dread d2/f4 [0,4194304] 0 2024-02-15T22:41:05.297 INFO:tasks.workunit.client.1.smithi082.stdout:6/14: chown d2/f4 87167 1 2024-02-15T22:41:05.347 INFO:tasks.workunit.client.1.smithi082.stdout:7/22: creat f7 x:0 0 0 2024-02-15T22:41:05.351 INFO:tasks.workunit.client.1.smithi082.stdout:6/15: symlink d2/l5 0 2024-02-15T22:41:05.352 INFO:tasks.workunit.client.1.smithi082.stdout:7/23: creat f8 x:0 0 0 2024-02-15T22:41:05.352 INFO:tasks.workunit.client.1.smithi082.stdout:7/24: write f6 [774533,91634] 0 2024-02-15T22:41:05.354 INFO:tasks.workunit.client.1.smithi082.stdout:6/16: symlink d2/l6 0 2024-02-15T22:41:05.355 INFO:tasks.workunit.client.1.smithi082.stdout:8/8: dwrite f0 [0,4194304] 0 2024-02-15T22:41:05.355 INFO:tasks.workunit.client.1.smithi082.stdout:7/25: creat f9 x:0 0 0 2024-02-15T22:41:05.355 INFO:tasks.workunit.client.1.smithi082.stdout:7/26: fdatasync f7 0 2024-02-15T22:41:05.359 INFO:tasks.workunit.client.1.smithi082.stdout:8/9: symlink d1/l3 0 2024-02-15T22:41:05.361 INFO:tasks.workunit.client.1.smithi082.stdout:8/10: creat d1/f4 x:0 0 0 2024-02-15T22:41:05.362 INFO:tasks.workunit.client.1.smithi082.stdout:7/27: symlink la 0 2024-02-15T22:41:05.363 INFO:tasks.workunit.client.1.smithi082.stdout:8/11: rename d1/f4 to d1/f5 0 2024-02-15T22:41:05.363 INFO:tasks.workunit.client.1.smithi082.stdout:8/12: truncate d1/f5 467410 0 2024-02-15T22:41:05.364 INFO:tasks.workunit.client.1.smithi082.stdout:2/17: dwrite f0 [0,4194304] 0 2024-02-15T22:41:05.364 INFO:tasks.workunit.client.1.smithi082.stdout:7/28: creat fb x:0 0 0 2024-02-15T22:41:05.365 INFO:tasks.workunit.client.1.smithi082.stdout:8/13: link d1/l3 d1/l6 0 2024-02-15T22:41:05.369 INFO:tasks.workunit.client.1.smithi082.stdout:8/14: mkdir d1/d7 0 2024-02-15T22:41:05.371 INFO:tasks.workunit.client.1.smithi082.stdout:8/15: link d1/c2 d1/d7/c8 0 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: Adjusting osd_memory_target on smithi033 to 1559M 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:05.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: pgmap v15: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 127 MiB/s rd, 164 MiB/s wr, 680 op/s 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:41:05.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:04 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:41:05.379 INFO:tasks.workunit.client.1.smithi082.stdout:8/16: write f0 [2820855,123356] 0 2024-02-15T22:41:05.380 INFO:tasks.workunit.client.1.smithi082.stdout:8/17: mkdir d1/d7/d9 0 2024-02-15T22:41:05.381 INFO:tasks.workunit.client.1.smithi082.stdout:8/18: link d1/l6 d1/d7/d9/la 0 2024-02-15T22:41:05.382 INFO:tasks.workunit.client.1.smithi082.stdout:8/19: mknod d1/d7/cb 0 2024-02-15T22:41:05.389 INFO:tasks.workunit.client.1.smithi082.stdout:8/20: dread f0 [0,4194304] 0 2024-02-15T22:41:05.391 INFO:tasks.workunit.client.1.smithi082.stdout:8/21: unlink d1/d7/c8 0 2024-02-15T22:41:05.391 INFO:tasks.workunit.client.1.smithi082.stdout:8/22: write f0 [4013525,30586] 0 2024-02-15T22:41:05.391 INFO:tasks.workunit.client.1.smithi082.stdout:8/23: read f0 [2714504,112264] 0 2024-02-15T22:41:05.530 INFO:tasks.workunit.client.1.smithi082.stdout:5/23: truncate f4 173345 0 2024-02-15T22:41:05.531 INFO:tasks.workunit.client.1.smithi082.stdout:5/24: dread - d5/f7 zero size 2024-02-15T22:41:05.554 INFO:tasks.workunit.client.1.smithi082.stdout:5/25: dwrite d5/f7 [0,4194304] 0 2024-02-15T22:41:05.556 INFO:tasks.workunit.client.1.smithi082.stdout:5/26: mknod d5/c8 0 2024-02-15T22:41:05.559 INFO:tasks.workunit.client.1.smithi082.stdout:5/27: rename d5/c6 to d5/c9 0 2024-02-15T22:41:05.575 INFO:tasks.workunit.client.1.smithi082.stdout:0/20: getdents d3 0 2024-02-15T22:41:05.577 INFO:tasks.workunit.client.1.smithi082.stdout:2/18: getdents . 0 2024-02-15T22:41:05.583 INFO:tasks.workunit.client.1.smithi082.stdout:1/8: truncate f0 72454 0 2024-02-15T22:41:05.584 INFO:tasks.workunit.client.1.smithi082.stdout:1/9: creat d1/f4 x:0 0 0 2024-02-15T22:41:05.586 INFO:tasks.workunit.client.1.smithi082.stdout:1/10: symlink d1/l5 0 2024-02-15T22:41:05.588 INFO:tasks.workunit.client.1.smithi082.stdout:1/11: rename d1/c2 to d1/c6 0 2024-02-15T22:41:05.590 INFO:tasks.workunit.client.1.smithi082.stdout:1/12: rename d1/c3 to d1/c7 0 2024-02-15T22:41:05.596 INFO:tasks.workunit.client.1.smithi082.stdout:6/17: write d2/f4 [4435474,2832] 0 2024-02-15T22:41:05.596 INFO:tasks.workunit.client.1.smithi082.stdout:6/18: rename d2 to d2/d7 22 2024-02-15T22:41:05.596 INFO:tasks.workunit.client.1.smithi082.stdout:6/19: chown d2/l5 205128364 1 2024-02-15T22:41:05.597 INFO:tasks.workunit.client.1.smithi082.stdout:6/20: creat d2/f8 x:0 0 0 2024-02-15T22:41:05.598 INFO:tasks.workunit.client.1.smithi082.stdout:9/20: truncate f1 632071 0 2024-02-15T22:41:05.598 INFO:tasks.workunit.client.1.smithi082.stdout:9/21: fdatasync f1 0 2024-02-15T22:41:05.604 INFO:tasks.workunit.client.1.smithi082.stdout:9/22: unlink l0 0 2024-02-15T22:41:05.606 INFO:tasks.workunit.client.1.smithi082.stdout:8/24: fsync d1/f5 0 2024-02-15T22:41:05.608 INFO:tasks.workunit.client.1.smithi082.stdout:7/29: getdents . 0 2024-02-15T22:41:05.608 INFO:tasks.workunit.client.1.smithi082.stdout:2/19: dwrite f2 [0,4194304] 0 2024-02-15T22:41:05.612 INFO:tasks.workunit.client.1.smithi082.stdout:0/21: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:41:05.615 INFO:tasks.workunit.client.1.smithi082.stdout:5/28: write f4 [728387,115756] 0 2024-02-15T22:41:05.617 INFO:tasks.workunit.client.1.smithi082.stdout:0/22: write f0 [624006,115556] 0 2024-02-15T22:41:05.619 INFO:tasks.workunit.client.1.smithi082.stdout:4/12: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:41:05.619 INFO:tasks.workunit.client.1.smithi082.stdout:5/29: mkdir d5/da 0 2024-02-15T22:41:05.621 INFO:tasks.workunit.client.1.smithi082.stdout:2/20: write f0 [2696724,101100] 0 2024-02-15T22:41:05.622 INFO:tasks.workunit.client.1.smithi082.stdout:6/21: dwrite f0 [0,4194304] 0 2024-02-15T22:41:05.626 INFO:tasks.workunit.client.1.smithi082.stdout:0/23: dread f0 [0,4194304] 0 2024-02-15T22:41:05.627 INFO:tasks.workunit.client.1.smithi082.stdout:8/25: dread f0 [0,4194304] 0 2024-02-15T22:41:05.627 INFO:tasks.workunit.client.1.smithi082.stdout:8/26: rename d1 to d1/dc 22 2024-02-15T22:41:05.627 INFO:tasks.workunit.client.1.smithi082.stdout:8/27: truncate f0 4693966 0 2024-02-15T22:41:05.628 INFO:tasks.workunit.client.1.smithi082.stdout:4/13: getdents d0 0 2024-02-15T22:41:05.632 INFO:tasks.workunit.client.1.smithi082.stdout:6/22: dread f0 [0,4194304] 0 2024-02-15T22:41:05.635 INFO:tasks.workunit.client.1.smithi082.stdout:8/28: link d1/l6 d1/ld 0 2024-02-15T22:41:05.636 INFO:tasks.workunit.client.1.smithi082.stdout:4/14: rename d0/l6 to d0/l7 0 2024-02-15T22:41:05.638 INFO:tasks.workunit.client.1.smithi082.stdout:8/29: unlink d1/d7/cb 0 2024-02-15T22:41:05.638 INFO:tasks.workunit.client.1.smithi082.stdout:8/30: fsync f0 0 2024-02-15T22:41:05.639 INFO:tasks.workunit.client.1.smithi082.stdout:8/31: chown d1/d7/d9/la 207 1 2024-02-15T22:41:05.673 INFO:tasks.workunit.client.1.smithi082.stdout:8/32: mkdir d1/d7/de 0 2024-02-15T22:41:05.673 INFO:tasks.workunit.client.1.smithi082.stdout:8/33: stat d1 0 2024-02-15T22:41:05.673 INFO:tasks.workunit.client.1.smithi082.stdout:4/15: mkdir d0/d8 0 2024-02-15T22:41:05.674 INFO:tasks.workunit.client.1.smithi082.stdout:8/34: creat d1/d7/de/ff x:0 0 0 2024-02-15T22:41:05.675 INFO:tasks.workunit.client.1.smithi082.stdout:8/35: fsync f0 0 2024-02-15T22:41:05.675 INFO:tasks.workunit.client.1.smithi082.stdout:1/13: write f0 [143159,127284] 0 2024-02-15T22:41:05.675 INFO:tasks.workunit.client.1.smithi082.stdout:4/16: chown d0/c5 58410816 1 2024-02-15T22:41:05.676 INFO:tasks.workunit.client.1.smithi082.stdout:8/36: symlink d1/d7/d9/l10 0 2024-02-15T22:41:05.676 INFO:tasks.workunit.client.1.smithi082.stdout:8/37: readlink d1/ld 0 2024-02-15T22:41:05.679 INFO:tasks.workunit.client.1.smithi082.stdout:8/38: symlink d1/d7/de/l11 0 2024-02-15T22:41:05.679 INFO:tasks.workunit.client.1.smithi082.stdout:1/14: rmdir d1 39 2024-02-15T22:41:05.681 INFO:tasks.workunit.client.1.smithi082.stdout:9/23: write f1 [1629851,17819] 0 2024-02-15T22:41:05.688 INFO:tasks.workunit.client.1.smithi082.stdout:5/30: stat f4 0 2024-02-15T22:41:05.696 INFO:tasks.workunit.client.1.smithi082.stdout:0/24: truncate f0 620403 0 2024-02-15T22:41:05.776 INFO:tasks.workunit.client.1.smithi082.stdout:5/31: dread f4 [0,4194304] 0 2024-02-15T22:41:05.780 INFO:tasks.workunit.client.1.smithi082.stdout:5/32: rename f4 to d5/fb 0 2024-02-15T22:41:05.781 INFO:tasks.workunit.client.1.smithi082.stdout:5/33: dread d5/fb [0,4194304] 0 2024-02-15T22:41:05.782 INFO:tasks.workunit.client.1.smithi082.stdout:4/17: truncate d0/f1 1474483 0 2024-02-15T22:41:05.783 INFO:tasks.workunit.client.1.smithi082.stdout:5/34: mkdir d5/da/dc 0 2024-02-15T22:41:05.785 INFO:tasks.workunit.client.1.smithi082.stdout:4/18: creat d0/f9 x:0 0 0 2024-02-15T22:41:05.785 INFO:tasks.workunit.client.1.smithi082.stdout:5/35: rmdir d5 39 2024-02-15T22:41:05.787 INFO:tasks.workunit.client.1.smithi082.stdout:4/19: creat d0/d8/fa x:0 0 0 2024-02-15T22:41:05.788 INFO:tasks.workunit.client.1.smithi082.stdout:4/20: creat d0/fb x:0 0 0 2024-02-15T22:41:05.789 INFO:tasks.workunit.client.1.smithi082.stdout:5/36: mkdir d5/dd 0 2024-02-15T22:41:05.790 INFO:tasks.workunit.client.1.smithi082.stdout:6/23: dwrite f0 [4194304,4194304] 0 2024-02-15T22:41:05.790 INFO:tasks.workunit.client.1.smithi082.stdout:5/37: fsync d5/fb 0 2024-02-15T22:41:05.790 INFO:tasks.workunit.client.1.smithi082.stdout:5/38: chown d5/da 18239970 1 2024-02-15T22:41:05.792 INFO:tasks.workunit.client.1.smithi082.stdout:5/39: dread d5/fb [0,4194304] 0 2024-02-15T22:41:05.792 INFO:tasks.workunit.client.1.smithi082.stdout:5/40: write d5/f7 [4772146,63736] 0 2024-02-15T22:41:05.794 INFO:tasks.workunit.client.1.smithi082.stdout:6/24: write f0 [2961516,123272] 0 2024-02-15T22:41:05.794 INFO:tasks.workunit.client.1.smithi082.stdout:6/25: write d2/f8 [338223,49848] 0 2024-02-15T22:41:05.795 INFO:tasks.workunit.client.1.smithi082.stdout:5/41: rmdir d5/dd 0 2024-02-15T22:41:05.797 INFO:tasks.workunit.client.1.smithi082.stdout:6/26: rename f0 to d2/f9 0 2024-02-15T22:41:05.799 INFO:tasks.workunit.client.1.smithi082.stdout:5/42: mkdir d5/da/dc/de 0 2024-02-15T22:41:05.799 INFO:tasks.workunit.client.1.smithi082.stdout:5/43: fdatasync d5/fb 0 2024-02-15T22:41:05.811 INFO:tasks.workunit.client.1.smithi082.stdout:6/27: rmdir d2 39 2024-02-15T22:41:05.812 INFO:tasks.workunit.client.1.smithi082.stdout:5/44: write d5/f7 [2623951,119370] 0 2024-02-15T22:41:05.814 INFO:tasks.workunit.client.1.smithi082.stdout:5/45: rename d5/fb to d5/da/dc/ff 0 2024-02-15T22:41:05.816 INFO:tasks.workunit.client.1.smithi082.stdout:5/46: creat d5/da/dc/f10 x:0 0 0 2024-02-15T22:41:05.816 INFO:tasks.workunit.client.1.smithi082.stdout:6/28: dread d2/f4 [0,4194304] 0 2024-02-15T22:41:05.817 INFO:tasks.workunit.client.1.smithi082.stdout:6/29: stat d2/f8 0 2024-02-15T22:41:05.817 INFO:tasks.workunit.client.1.smithi082.stdout:6/30: symlink d2/la 0 2024-02-15T22:41:05.817 INFO:tasks.workunit.client.1.smithi082.stdout:6/31: chown d2/f3 253117 1 2024-02-15T22:41:05.818 INFO:tasks.workunit.client.1.smithi082.stdout:6/32: mknod d2/cb 0 2024-02-15T22:41:05.825 INFO:tasks.workunit.client.1.smithi082.stdout:6/33: write d2/f3 [1208494,48698] 0 2024-02-15T22:41:05.826 INFO:tasks.workunit.client.1.smithi082.stdout:6/34: chown d2 9 1 2024-02-15T22:41:05.826 INFO:tasks.workunit.client.1.smithi082.stdout:6/35: symlink d2/lc 0 2024-02-15T22:41:05.832 INFO:tasks.workunit.client.1.smithi082.stdout:6/36: fdatasync d2/f9 0 2024-02-15T22:41:05.836 INFO:tasks.workunit.client.1.smithi082.stdout:6/37: getdents d2 0 2024-02-15T22:41:05.836 INFO:tasks.workunit.client.1.smithi082.stdout:6/38: write d2/f9 [8931622,118098] 0 2024-02-15T22:41:05.836 INFO:tasks.workunit.client.1.smithi082.stdout:6/39: getdents d2 0 2024-02-15T22:41:06.103 INFO:tasks.workunit.client.1.smithi082.stdout:8/39: read d1/f5 [51272,11420] 0 2024-02-15T22:41:06.103 INFO:tasks.workunit.client.1.smithi082.stdout:8/40: chown d1/d7/de/ff 900 1 2024-02-15T22:41:06.104 INFO:tasks.workunit.client.1.smithi082.stdout:8/41: chown d1/ld 17215 1 2024-02-15T22:41:06.109 INFO:tasks.workunit.client.1.smithi082.stdout:8/42: dread f0 [0,4194304] 0 2024-02-15T22:41:06.110 INFO:tasks.workunit.client.1.smithi082.stdout:8/43: symlink d1/d7/de/l12 0 2024-02-15T22:41:06.112 INFO:tasks.workunit.client.1.smithi082.stdout:8/44: unlink f0 0 2024-02-15T22:41:06.114 INFO:tasks.workunit.client.1.smithi082.stdout:8/45: mkdir d1/d7/de/d13 0 2024-02-15T22:41:06.114 INFO:tasks.workunit.client.1.smithi082.stdout:8/46: dread - d1/d7/de/ff zero size 2024-02-15T22:41:06.114 INFO:tasks.workunit.client.1.smithi082.stdout:8/47: creat d1/f14 x:0 0 0 2024-02-15T22:41:06.133 INFO:tasks.workunit.client.1.smithi082.stdout:1/15: dwrite d1/f4 [0,4194304] 0 2024-02-15T22:41:06.133 INFO:tasks.workunit.client.1.smithi082.stdout:9/24: dwrite f2 [0,4194304] 0 2024-02-15T22:41:06.133 INFO:tasks.workunit.client.1.smithi082.stdout:9/25: stat f3 0 2024-02-15T22:41:06.133 INFO:tasks.workunit.client.1.smithi082.stdout:0/25: dwrite f0 [0,4194304] 0 2024-02-15T22:41:06.134 INFO:tasks.workunit.client.1.smithi082.stdout:4/21: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:41:06.134 INFO:tasks.workunit.client.1.smithi082.stdout:4/22: chown d0/d8/fa 13 1 2024-02-15T22:41:06.134 INFO:tasks.workunit.client.1.smithi082.stdout:4/23: write d0/f9 [1020996,74892] 0 2024-02-15T22:41:06.134 INFO:tasks.workunit.client.1.smithi082.stdout:8/48: dwrite d1/d7/de/ff [0,4194304] 0 2024-02-15T22:41:06.134 INFO:tasks.workunit.client.1.smithi082.stdout:5/47: dwrite d5/da/dc/f10 [0,4194304] 0 2024-02-15T22:41:06.135 INFO:tasks.workunit.client.1.smithi082.stdout:6/40: fsync d2/f4 0 2024-02-15T22:41:06.137 INFO:tasks.workunit.client.1.smithi082.stdout:5/48: fdatasync d5/f7 0 2024-02-15T22:41:06.137 INFO:tasks.workunit.client.1.smithi082.stdout:1/16: rename d1/c6 to d1/c8 0 2024-02-15T22:41:06.139 INFO:tasks.workunit.client.1.smithi082.stdout:9/26: unlink f2 0 2024-02-15T22:41:06.139 INFO:tasks.workunit.client.1.smithi082.stdout:9/27: creat f5 x:0 0 0 2024-02-15T22:41:06.139 INFO:tasks.workunit.client.1.smithi082.stdout:0/26: rmdir d3 39 2024-02-15T22:41:06.145 INFO:tasks.workunit.client.1.smithi082.stdout:8/49: rmdir d1/d7/de/d13 0 2024-02-15T22:41:06.148 INFO:tasks.workunit.client.1.smithi082.stdout:5/49: write d5/da/dc/f10 [995395,114872] 0 2024-02-15T22:41:06.149 INFO:tasks.workunit.client.1.smithi082.stdout:1/17: mkdir d1/d9 0 2024-02-15T22:41:06.151 INFO:tasks.workunit.client.1.smithi082.stdout:9/28: symlink l6 0 2024-02-15T22:41:06.152 INFO:tasks.workunit.client.1.smithi082.stdout:9/29: chown l6 10191060 1 2024-02-15T22:41:06.153 INFO:tasks.workunit.client.1.smithi082.stdout:4/24: mkdir d0/dc 0 2024-02-15T22:41:06.155 INFO:tasks.workunit.client.1.smithi082.stdout:8/50: rename d1/d7/de/l12 to d1/d7/de/l15 0 2024-02-15T22:41:06.157 INFO:tasks.workunit.client.1.smithi082.stdout:4/25: mkdir d0/dc/dd 0 2024-02-15T22:41:06.157 INFO:tasks.workunit.client.1.smithi082.stdout:4/26: dread - d0/d8/fa zero size 2024-02-15T22:41:06.159 INFO:tasks.workunit.client.1.smithi082.stdout:8/51: mknod d1/c16 0 2024-02-15T22:41:06.161 INFO:tasks.workunit.client.1.smithi082.stdout:9/30: dread f1 [0,4194304] 0 2024-02-15T22:41:06.161 INFO:tasks.workunit.client.1.smithi082.stdout:4/27: mknod d0/dc/ce 0 2024-02-15T22:41:06.162 INFO:tasks.workunit.client.1.smithi082.stdout:4/28: dread - d0/d8/fa zero size 2024-02-15T22:41:06.162 INFO:tasks.workunit.client.1.smithi082.stdout:4/29: chown d0/dc/ce 61 1 2024-02-15T22:41:06.165 INFO:tasks.workunit.client.1.smithi082.stdout:6/41: truncate d2/f8 6811 0 2024-02-15T22:41:06.168 INFO:tasks.workunit.client.1.smithi082.stdout:0/27: dwrite d3/f6 [4194304,4194304] 0 2024-02-15T22:41:06.169 INFO:tasks.workunit.client.1.smithi082.stdout:1/18: dwrite d1/f4 [0,4194304] 0 2024-02-15T22:41:06.169 INFO:tasks.workunit.client.1.smithi082.stdout:1/19: write f0 [637980,93310] 0 2024-02-15T22:41:06.171 INFO:tasks.workunit.client.1.smithi082.stdout:1/20: mkdir d1/da 0 2024-02-15T22:41:06.171 INFO:tasks.workunit.client.1.smithi082.stdout:1/21: getdents d1/d9 0 2024-02-15T22:41:06.171 INFO:tasks.workunit.client.1.smithi082.stdout:1/22: rename d1 to d1/da/db 22 2024-02-15T22:41:06.172 INFO:tasks.workunit.client.1.smithi082.stdout:6/42: dread d2/f3 [0,4194304] 0 2024-02-15T22:41:06.172 INFO:tasks.workunit.client.1.smithi082.stdout:6/43: stat d2/la 0 2024-02-15T22:41:06.172 INFO:tasks.workunit.client.1.smithi082.stdout:9/31: dread f3 [0,4194304] 0 2024-02-15T22:41:06.173 INFO:tasks.workunit.client.1.smithi082.stdout:1/23: rename f0 to d1/fc 0 2024-02-15T22:41:06.175 INFO:tasks.workunit.client.1.smithi082.stdout:9/32: mknod c7 0 2024-02-15T22:41:06.176 INFO:tasks.workunit.client.1.smithi082.stdout:4/30: truncate d0/f9 23382 0 2024-02-15T22:41:06.176 INFO:tasks.workunit.client.1.smithi082.stdout:4/31: dread - d0/fb zero size 2024-02-15T22:41:06.178 INFO:tasks.workunit.client.1.smithi082.stdout:4/32: creat d0/dc/dd/ff x:0 0 0 2024-02-15T22:41:06.183 INFO:tasks.workunit.client.1.smithi082.stdout:6/44: dread d2/f3 [0,4194304] 0 2024-02-15T22:41:06.183 INFO:tasks.workunit.client.1.smithi082.stdout:6/45: chown d2/f4 63 1 2024-02-15T22:41:06.183 INFO:tasks.workunit.client.1.smithi082.stdout:6/46: getdents d2 0 2024-02-15T22:41:06.183 INFO:tasks.workunit.client.1.smithi082.stdout:9/33: write f3 [4710753,121336] 0 2024-02-15T22:41:06.183 INFO:tasks.workunit.client.1.smithi082.stdout:9/34: write f5 [912827,83513] 0 2024-02-15T22:41:06.184 INFO:tasks.workunit.client.1.smithi082.stdout:9/35: mkdir d8 0 2024-02-15T22:41:06.185 INFO:tasks.workunit.client.1.smithi082.stdout:0/28: write f0 [1236894,69419] 0 2024-02-15T22:41:06.186 INFO:tasks.workunit.client.1.smithi082.stdout:0/29: getdents d3 0 2024-02-15T22:41:06.186 INFO:tasks.workunit.client.1.smithi082.stdout:9/36: rename f3 to d8/f9 0 2024-02-15T22:41:06.188 INFO:tasks.workunit.client.1.smithi082.stdout:0/30: creat d3/f8 x:0 0 0 2024-02-15T22:41:06.188 INFO:tasks.workunit.client.1.smithi082.stdout:0/31: write d3/f8 [173534,60459] 0 2024-02-15T22:41:06.188 INFO:tasks.workunit.client.1.smithi082.stdout:0/32: chown d3 493995027 1 2024-02-15T22:41:06.188 INFO:tasks.workunit.client.1.smithi082.stdout:9/37: rmdir d8 39 2024-02-15T22:41:06.190 INFO:tasks.workunit.client.1.smithi082.stdout:6/47: dread d2/f4 [0,4194304] 0 2024-02-15T22:41:06.194 INFO:tasks.workunit.client.1.smithi082.stdout:1/24: dwrite d1/fc [0,4194304] 0 2024-02-15T22:41:06.194 INFO:tasks.workunit.client.1.smithi082.stdout:4/33: dread d0/f9 [0,4194304] 0 2024-02-15T22:41:06.196 INFO:tasks.workunit.client.1.smithi082.stdout:4/34: mknod d0/dc/dd/c10 0 2024-02-15T22:41:06.196 INFO:tasks.workunit.client.1.smithi082.stdout:4/35: fsync d0/f1 0 2024-02-15T22:41:06.199 INFO:tasks.workunit.client.1.smithi082.stdout:6/48: dread d2/f3 [0,4194304] 0 2024-02-15T22:41:06.199 INFO:tasks.workunit.client.1.smithi082.stdout:6/49: getdents d2 0 2024-02-15T22:41:06.199 INFO:tasks.workunit.client.1.smithi082.stdout:6/50: readlink d2/l6 0 2024-02-15T22:41:06.199 INFO:tasks.workunit.client.1.smithi082.stdout:6/51: chown d2/f8 46585705 1 2024-02-15T22:41:06.200 INFO:tasks.workunit.client.1.smithi082.stdout:4/36: chown d0/f2 120284 1 2024-02-15T22:41:06.204 INFO:tasks.workunit.client.1.smithi082.stdout:6/52: unlink d2/f8 0 2024-02-15T22:41:06.205 INFO:tasks.workunit.client.1.smithi082.stdout:4/37: dread d0/f9 [0,4194304] 0 2024-02-15T22:41:06.205 INFO:tasks.workunit.client.1.smithi082.stdout:0/33: getdents d3 0 2024-02-15T22:41:06.207 INFO:tasks.workunit.client.1.smithi082.stdout:0/34: mknod d3/c9 0 2024-02-15T22:41:06.207 INFO:tasks.workunit.client.1.smithi082.stdout:0/35: chown d3/c9 1538 1 2024-02-15T22:41:06.209 INFO:tasks.workunit.client.1.smithi082.stdout:0/36: rename f0 to d3/fa 0 2024-02-15T22:41:06.210 INFO:tasks.workunit.client.1.smithi082.stdout:0/37: creat d3/fb x:0 0 0 2024-02-15T22:41:06.212 INFO:tasks.workunit.client.1.smithi082.stdout:0/38: creat d3/fc x:0 0 0 2024-02-15T22:41:06.212 INFO:tasks.workunit.client.1.smithi082.stdout:0/39: dread - d3/fb zero size 2024-02-15T22:41:06.213 INFO:tasks.workunit.client.1.smithi082.stdout:0/40: creat d3/fd x:0 0 0 2024-02-15T22:41:06.213 INFO:tasks.workunit.client.1.smithi082.stdout:0/41: write d3/fc [466879,84201] 0 2024-02-15T22:41:06.214 INFO:tasks.workunit.client.1.smithi082.stdout:0/42: creat d3/fe x:0 0 0 2024-02-15T22:41:06.214 INFO:tasks.workunit.client.1.smithi082.stdout:0/43: chown d3/fd 25 1 2024-02-15T22:41:06.215 INFO:tasks.workunit.client.1.smithi082.stdout:0/44: symlink d3/lf 0 2024-02-15T22:41:06.216 INFO:tasks.workunit.client.1.smithi082.stdout:0/45: chown d3/lf 7649124 1 2024-02-15T22:41:06.218 INFO:tasks.workunit.client.1.smithi082.stdout:6/53: write d2/f9 [8092647,8468] 0 2024-02-15T22:41:06.219 INFO:tasks.workunit.client.1.smithi082.stdout:4/38: write d0/f2 [3438572,30830] 0 2024-02-15T22:41:06.219 INFO:tasks.workunit.client.1.smithi082.stdout:4/39: chown d0/d8 230 1 2024-02-15T22:41:06.220 INFO:tasks.workunit.client.1.smithi082.stdout:6/54: unlink d2/l5 0 2024-02-15T22:41:06.220 INFO:tasks.workunit.client.1.smithi082.stdout:6/55: write d2/f4 [4620954,32262] 0 2024-02-15T22:41:06.221 INFO:tasks.workunit.client.1.smithi082.stdout:4/40: mknod d0/dc/dd/c11 0 2024-02-15T22:41:06.224 INFO:tasks.workunit.client.1.smithi082.stdout:1/25: dwrite d1/fc [0,4194304] 0 2024-02-15T22:41:06.224 INFO:tasks.workunit.client.1.smithi082.stdout:1/26: write d1/f4 [4323915,54266] 0 2024-02-15T22:41:06.224 INFO:tasks.workunit.client.1.smithi082.stdout:9/38: dwrite d8/f9 [0,4194304] 0 2024-02-15T22:41:06.224 INFO:tasks.workunit.client.1.smithi082.stdout:6/56: creat d2/fd x:0 0 0 2024-02-15T22:41:06.228 INFO:tasks.workunit.client.1.smithi082.stdout:9/39: creat d8/fa x:0 0 0 2024-02-15T22:41:06.230 INFO:tasks.workunit.client.1.smithi082.stdout:6/57: symlink d2/le 0 2024-02-15T22:41:06.232 INFO:tasks.workunit.client.1.smithi082.stdout:1/27: dread d1/fc [0,4194304] 0 2024-02-15T22:41:06.235 INFO:tasks.workunit.client.1.smithi082.stdout:9/40: symlink d8/lb 0 2024-02-15T22:41:06.239 INFO:tasks.workunit.client.1.smithi082.stdout:9/41: rename c4 to d8/cc 0 2024-02-15T22:41:06.240 INFO:tasks.workunit.client.1.smithi082.stdout:6/58: dread d2/f3 [0,4194304] 0 2024-02-15T22:41:06.240 INFO:tasks.workunit.client.1.smithi082.stdout:6/59: readlink d2/le 0 2024-02-15T22:41:06.240 INFO:tasks.workunit.client.1.smithi082.stdout:6/60: read d2/f4 [2321268,98625] 0 2024-02-15T22:41:06.240 INFO:tasks.workunit.client.1.smithi082.stdout:4/41: rmdir d0 39 2024-02-15T22:41:06.240 INFO:tasks.workunit.client.1.smithi082.stdout:6/61: chown d2/cb 26846 1 2024-02-15T22:41:06.244 INFO:tasks.workunit.client.1.smithi082.stdout:9/42: mkdir d8/dd 0 2024-02-15T22:41:06.244 INFO:tasks.workunit.client.1.smithi082.stdout:9/43: write f5 [1249915,55093] 0 2024-02-15T22:41:06.244 INFO:tasks.workunit.client.1.smithi082.stdout:9/44: readlink l6 0 2024-02-15T22:41:06.245 INFO:tasks.workunit.client.1.smithi082.stdout:9/45: rmdir d8/dd 0 2024-02-15T22:41:06.248 INFO:tasks.workunit.client.1.smithi082.stdout:1/28: truncate d1/fc 2896926 0 2024-02-15T22:41:06.258 INFO:tasks.workunit.client.1.smithi082.stdout:9/46: rmdir d8 39 2024-02-15T22:41:06.259 INFO:tasks.workunit.client.1.smithi082.stdout:1/29: read d1/f4 [27246,28781] 0 2024-02-15T22:41:06.259 INFO:tasks.workunit.client.1.smithi082.stdout:1/30: read d1/f4 [1808559,91991] 0 2024-02-15T22:41:06.269 INFO:tasks.workunit.client.1.smithi082.stdout:6/62: dwrite d2/f3 [0,4194304] 0 2024-02-15T22:41:06.269 INFO:tasks.workunit.client.1.smithi082.stdout:6/63: read - d2/fd zero size 2024-02-15T22:41:06.269 INFO:tasks.workunit.client.1.smithi082.stdout:6/64: creat d2/ff x:0 0 0 2024-02-15T22:41:06.272 INFO:tasks.workunit.client.1.smithi082.stdout:6/65: mknod d2/c10 0 2024-02-15T22:41:06.272 INFO:tasks.workunit.client.1.smithi082.stdout:6/66: dread - d2/ff zero size 2024-02-15T22:41:06.272 INFO:tasks.workunit.client.1.smithi082.stdout:6/67: stat d2/f9 0 2024-02-15T22:41:06.272 INFO:tasks.workunit.client.1.smithi082.stdout:6/68: dread - d2/fd zero size 2024-02-15T22:41:06.276 INFO:tasks.workunit.client.1.smithi082.stdout:9/47: dread d8/f9 [0,4194304] 0 2024-02-15T22:41:06.276 INFO:tasks.workunit.client.1.smithi082.stdout:4/42: dwrite d0/f2 [4194304,4194304] 0 2024-02-15T22:41:06.279 INFO:tasks.workunit.client.1.smithi082.stdout:9/48: dread f1 [0,4194304] 0 2024-02-15T22:41:06.280 INFO:tasks.workunit.client.1.smithi082.stdout:9/49: rmdir d8 39 2024-02-15T22:41:06.289 INFO:tasks.workunit.client.1.smithi082.stdout:1/31: dwrite d1/f4 [0,4194304] 0 2024-02-15T22:41:06.292 INFO:tasks.workunit.client.1.smithi082.stdout:1/32: mknod d1/da/cd 0 2024-02-15T22:41:06.294 INFO:tasks.workunit.client.1.smithi082.stdout:1/33: creat d1/da/fe x:0 0 0 2024-02-15T22:41:06.294 INFO:tasks.workunit.client.1.smithi082.stdout:1/34: creat d1/da/ff x:0 0 0 2024-02-15T22:41:06.297 INFO:tasks.workunit.client.1.smithi082.stdout:1/35: truncate d1/fc 323275 0 2024-02-15T22:41:06.297 INFO:tasks.workunit.client.1.smithi082.stdout:1/36: read - d1/da/fe zero size 2024-02-15T22:41:06.297 INFO:tasks.workunit.client.1.smithi082.stdout:1/37: dread - d1/da/ff zero size 2024-02-15T22:41:06.314 INFO:tasks.workunit.client.1.smithi082.stdout:1/38: dread d1/f4 [0,4194304] 0 2024-02-15T22:41:06.314 INFO:tasks.workunit.client.1.smithi082.stdout:1/39: rename d1/d9 to d1/d9/d10 22 2024-02-15T22:41:06.314 INFO:tasks.workunit.client.1.smithi082.stdout:1/40: getdents d1/d9 0 2024-02-15T22:41:06.315 INFO:tasks.workunit.client.1.smithi082.stdout:1/41: mkdir d1/da/d11 0 2024-02-15T22:41:06.317 INFO:tasks.workunit.client.1.smithi082.stdout:1/42: creat d1/da/d11/f12 x:0 0 0 2024-02-15T22:41:06.317 INFO:tasks.workunit.client.1.smithi082.stdout:9/50: dwrite d8/f9 [0,4194304] 0 2024-02-15T22:41:06.317 INFO:tasks.workunit.client.1.smithi082.stdout:9/51: write d8/fa [934279,124621] 0 2024-02-15T22:41:06.317 INFO:tasks.workunit.client.1.smithi082.stdout:9/52: chown d8/f9 0 1 2024-02-15T22:41:06.318 INFO:tasks.workunit.client.1.smithi082.stdout:1/43: creat d1/d9/f13 x:0 0 0 2024-02-15T22:41:06.318 INFO:tasks.workunit.client.1.smithi082.stdout:1/44: write d1/da/ff [624780,123310] 0 2024-02-15T22:41:06.319 INFO:tasks.workunit.client.1.smithi082.stdout:9/53: unlink f1 0 2024-02-15T22:41:06.320 INFO:tasks.workunit.client.1.smithi082.stdout:6/69: dwrite d2/f9 [4194304,4194304] 0 2024-02-15T22:41:06.321 INFO:tasks.workunit.client.1.smithi082.stdout:4/43: dwrite d0/f2 [4194304,4194304] 0 2024-02-15T22:41:06.323 INFO:tasks.workunit.client.1.smithi082.stdout:6/70: rename d2/c10 to d2/c11 0 2024-02-15T22:41:06.323 INFO:tasks.workunit.client.1.smithi082.stdout:6/71: chown d2/c11 5981320 1 2024-02-15T22:41:06.325 INFO:tasks.workunit.client.1.smithi082.stdout:4/44: symlink d0/d8/l12 0 2024-02-15T22:41:06.326 INFO:tasks.workunit.client.1.smithi082.stdout:4/45: rmdir d0/d8 39 2024-02-15T22:41:06.328 INFO:tasks.workunit.client.1.smithi082.stdout:9/54: dread d8/fa [0,4194304] 0 2024-02-15T22:41:06.328 INFO:tasks.workunit.client.1.smithi082.stdout:4/46: symlink d0/dc/dd/l13 0 2024-02-15T22:41:06.328 INFO:tasks.workunit.client.1.smithi082.stdout:4/47: stat d0/c5 0 2024-02-15T22:41:06.328 INFO:tasks.workunit.client.1.smithi082.stdout:4/48: chown d0/l7 1 1 2024-02-15T22:41:06.336 INFO:tasks.workunit.client.1.smithi082.stdout:6/72: rename d2/c11 to d2/c12 0 2024-02-15T22:41:06.339 INFO:tasks.workunit.client.1.smithi082.stdout:1/45: rename d1/d9 to d1/da/d14 0 2024-02-15T22:41:06.340 INFO:tasks.workunit.client.1.smithi082.stdout:1/46: rmdir d1 39 2024-02-15T22:41:06.356 INFO:tasks.workunit.client.1.smithi082.stdout:9/55: dwrite f5 [0,4194304] 0 2024-02-15T22:41:06.356 INFO:tasks.workunit.client.1.smithi082.stdout:4/49: dwrite d0/f9 [0,4194304] 0 2024-02-15T22:41:06.359 INFO:tasks.workunit.client.1.smithi082.stdout:6/73: truncate d2/f3 3489949 0 2024-02-15T22:41:06.363 INFO:tasks.workunit.client.1.smithi082.stdout:9/56: rename l6 to d8/le 0 2024-02-15T22:41:06.363 INFO:tasks.workunit.client.1.smithi082.stdout:6/74: stat d2/c12 0 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: Reconfiguring node-exporter.smithi033 (dependencies changed)... 2024-02-15T22:41:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:06 smithi082 ceph-mon[37153]: Reconfiguring daemon node-exporter.smithi033 on smithi033 2024-02-15T22:41:06.389 INFO:tasks.workunit.client.1.smithi082.stdout:9/57: dwrite d8/fa [0,4194304] 0 2024-02-15T22:41:06.391 INFO:tasks.workunit.client.1.smithi082.stdout:6/75: dwrite d2/f9 [4194304,4194304] 0 2024-02-15T22:41:06.392 INFO:tasks.workunit.client.1.smithi082.stdout:9/58: creat d8/ff x:0 0 0 2024-02-15T22:41:06.392 INFO:tasks.workunit.client.1.smithi082.stdout:9/59: chown d8 16589045 1 2024-02-15T22:41:06.394 INFO:tasks.workunit.client.1.smithi082.stdout:6/76: link d2/c12 d2/c13 0 2024-02-15T22:41:06.394 INFO:tasks.workunit.client.1.smithi082.stdout:6/77: fsync d2/fd 0 2024-02-15T22:41:06.400 INFO:tasks.workunit.client.1.smithi082.stdout:9/60: getdents d8 0 2024-02-15T22:41:06.400 INFO:tasks.workunit.client.1.smithi082.stdout:9/61: chown d8/f9 2 1 2024-02-15T22:41:06.401 INFO:tasks.workunit.client.1.smithi082.stdout:9/62: rmdir d8 39 2024-02-15T22:41:06.415 INFO:tasks.workunit.client.1.smithi082.stdout:9/63: dread d8/fa [0,4194304] 0 2024-02-15T22:41:06.415 INFO:tasks.workunit.client.1.smithi082.stdout:9/64: chown c7 18027 1 2024-02-15T22:41:06.417 INFO:tasks.workunit.client.1.smithi082.stdout:9/65: creat d8/f10 x:0 0 0 2024-02-15T22:41:06.429 INFO:tasks.workunit.client.1.smithi082.stdout:9/66: read d8/f9 [2643986,81560] 0 2024-02-15T22:41:06.452 INFO:tasks.workunit.client.1.smithi082.stdout:9/67: dwrite d8/f10 [0,4194304] 0 2024-02-15T22:41:06.455 INFO:tasks.workunit.client.1.smithi082.stdout:9/68: rename d8/ff to d8/f11 0 2024-02-15T22:41:06.456 INFO:tasks.workunit.client.1.smithi082.stdout:9/69: mkdir d8/d12 0 2024-02-15T22:41:06.458 INFO:tasks.workunit.client.1.smithi082.stdout:9/70: symlink d8/d12/l13 0 2024-02-15T22:41:06.459 INFO:tasks.workunit.client.1.smithi082.stdout:9/71: creat d8/d12/f14 x:0 0 0 2024-02-15T22:41:06.461 INFO:tasks.workunit.client.1.smithi082.stdout:9/72: link d8/lb d8/l15 0 2024-02-15T22:41:06.476 INFO:tasks.workunit.client.1.smithi082.stdout:9/73: dread f5 [0,4194304] 0 2024-02-15T22:41:06.497 INFO:tasks.workunit.client.1.smithi082.stdout:9/74: dwrite f5 [0,4194304] 0 2024-02-15T22:41:06.497 INFO:tasks.workunit.client.1.smithi082.stdout:9/75: write f5 [4226140,7405] 0 2024-02-15T22:41:06.498 INFO:tasks.workunit.client.1.smithi082.stdout:9/76: mknod d8/d12/c16 0 2024-02-15T22:41:06.498 INFO:tasks.workunit.client.1.smithi082.stdout:9/77: chown d8/le 9319160 1 2024-02-15T22:41:06.508 INFO:tasks.workunit.client.1.smithi082.stdout:9/78: getdents d8 0 2024-02-15T22:41:06.508 INFO:tasks.workunit.client.1.smithi082.stdout:9/79: dread - d8/f11 zero size 2024-02-15T22:41:06.514 INFO:tasks.workunit.client.1.smithi082.stdout:9/80: truncate f5 2690327 0 2024-02-15T22:41:06.515 INFO:tasks.workunit.client.1.smithi082.stdout:9/81: chown d8/cc 10870 1 2024-02-15T22:41:06.515 INFO:tasks.workunit.client.1.smithi082.stdout:9/82: chown f5 70540 1 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:06.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: Reconfiguring node-exporter.smithi033 (dependencies changed)... 2024-02-15T22:41:06.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:06 smithi033 ceph-mon[29033]: Reconfiguring daemon node-exporter.smithi033 on smithi033 2024-02-15T22:41:07.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:07 smithi033 ceph-mon[29033]: pgmap v16: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 127 MiB/s rd, 164 MiB/s wr, 680 op/s 2024-02-15T22:41:07.360 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:07 smithi082 ceph-mon[37153]: pgmap v16: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 127 MiB/s rd, 164 MiB/s wr, 680 op/s 2024-02-15T22:41:08.559 INFO:tasks.workunit.client.1.smithi082.stdout:2/21: sync 2024-02-15T22:41:08.559 INFO:tasks.workunit.client.1.smithi082.stdout:5/50: sync 2024-02-15T22:41:08.559 INFO:tasks.workunit.client.1.smithi082.stdout:0/46: sync 2024-02-15T22:41:08.559 INFO:tasks.workunit.client.1.smithi082.stdout:1/47: sync 2024-02-15T22:41:08.559 INFO:tasks.workunit.client.1.smithi082.stdout:8/52: sync 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:6/78: sync 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:8/53: fdatasync d1/f14 0 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:0/47: truncate d3/fc 956792 0 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:0/48: dread - d3/fe zero size 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:8/54: chown d1/d7/de/l11 4809484 1 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:7/30: sync 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:1/48: creat d1/da/d11/f15 x:0 0 0 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:9/83: sync 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:4/50: sync 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:1/49: creat d1/da/d11/f16 x:0 0 0 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:3/2: sync 2024-02-15T22:41:08.560 INFO:tasks.workunit.client.1.smithi082.stdout:3/3: readlink - no filename 2024-02-15T22:41:08.561 INFO:tasks.workunit.client.1.smithi082.stdout:3/4: stat - no entries 2024-02-15T22:41:08.561 INFO:tasks.workunit.client.1.smithi082.stdout:9/84: write d8/f9 [4918434,22595] 0 2024-02-15T22:41:08.561 INFO:tasks.workunit.client.1.smithi082.stdout:1/50: write d1/fc [1032824,80087] 0 2024-02-15T22:41:08.561 INFO:tasks.workunit.client.1.smithi082.stdout:0/49: chown d3/f6 39111913 1 2024-02-15T22:41:08.562 INFO:tasks.workunit.client.1.smithi082.stdout:7/31: creat fc x:0 0 0 2024-02-15T22:41:08.562 INFO:tasks.workunit.client.1.smithi082.stdout:7/32: write f7 [673724,46448] 0 2024-02-15T22:41:08.562 INFO:tasks.workunit.client.1.smithi082.stdout:4/51: getdents d0/d8 0 2024-02-15T22:41:08.563 INFO:tasks.workunit.client.1.smithi082.stdout:9/85: symlink d8/l17 0 2024-02-15T22:41:08.564 INFO:tasks.workunit.client.1.smithi082.stdout:9/86: chown d8/f9 15703 1 2024-02-15T22:41:08.564 INFO:tasks.workunit.client.1.smithi082.stdout:3/5: mkdir d0 0 2024-02-15T22:41:08.564 INFO:tasks.workunit.client.1.smithi082.stdout:3/6: fsync - no filename 2024-02-15T22:41:08.564 INFO:tasks.workunit.client.1.smithi082.stdout:3/7: rename d0 to d0/d1 22 2024-02-15T22:41:08.566 INFO:tasks.workunit.client.1.smithi082.stdout:1/51: symlink d1/da/d11/l17 0 2024-02-15T22:41:08.566 INFO:tasks.workunit.client.1.smithi082.stdout:1/52: readlink d1/l5 0 2024-02-15T22:41:08.569 INFO:tasks.workunit.client.1.smithi082.stdout:4/52: creat d0/f14 x:0 0 0 2024-02-15T22:41:08.571 INFO:tasks.workunit.client.1.smithi082.stdout:3/8: creat d0/f2 x:0 0 0 2024-02-15T22:41:08.571 INFO:tasks.workunit.client.1.smithi082.stdout:3/9: fdatasync d0/f2 0 2024-02-15T22:41:08.571 INFO:tasks.workunit.client.1.smithi082.stdout:6/79: dread d2/f9 [4194304,4194304] 0 2024-02-15T22:41:08.571 INFO:tasks.workunit.client.1.smithi082.stdout:6/80: chown d2/c12 0 1 2024-02-15T22:41:08.572 INFO:tasks.workunit.client.1.smithi082.stdout:1/53: mkdir d1/da/d14/d18 0 2024-02-15T22:41:08.572 INFO:tasks.workunit.client.1.smithi082.stdout:0/50: symlink d3/l10 0 2024-02-15T22:41:08.572 INFO:tasks.workunit.client.1.smithi082.stdout:0/51: truncate d3/fc 1233532 0 2024-02-15T22:41:08.574 INFO:tasks.workunit.client.1.smithi082.stdout:4/53: unlink d0/f14 0 2024-02-15T22:41:08.574 INFO:tasks.workunit.client.1.smithi082.stdout:4/54: readlink d0/d8/l12 0 2024-02-15T22:41:08.574 INFO:tasks.workunit.client.1.smithi082.stdout:3/10: mknod d0/c3 0 2024-02-15T22:41:08.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/81: unlink d2/f9 0 2024-02-15T22:41:08.577 INFO:tasks.workunit.client.1.smithi082.stdout:1/54: rename d1/da/d11/l17 to d1/l19 0 2024-02-15T22:41:08.577 INFO:tasks.workunit.client.1.smithi082.stdout:1/55: readlink d1/l5 0 2024-02-15T22:41:08.578 INFO:tasks.workunit.client.1.smithi082.stdout:0/52: creat d3/f11 x:0 0 0 2024-02-15T22:41:08.579 INFO:tasks.workunit.client.1.smithi082.stdout:7/33: link l2 ld 0 2024-02-15T22:41:08.582 INFO:tasks.workunit.client.1.smithi082.stdout:6/82: link d2/cb d2/c14 0 2024-02-15T22:41:08.583 INFO:tasks.workunit.client.1.smithi082.stdout:1/56: mkdir d1/da/d1a 0 2024-02-15T22:41:08.583 INFO:tasks.workunit.client.1.smithi082.stdout:1/57: write d1/da/d11/f12 [466023,28311] 0 2024-02-15T22:41:08.584 INFO:tasks.workunit.client.1.smithi082.stdout:7/34: creat fe x:0 0 0 2024-02-15T22:41:08.585 INFO:tasks.workunit.client.1.smithi082.stdout:7/35: write f9 [300819,64394] 0 2024-02-15T22:41:08.585 INFO:tasks.workunit.client.1.smithi082.stdout:4/55: mknod d0/c15 0 2024-02-15T22:41:08.585 INFO:tasks.workunit.client.1.smithi082.stdout:5/51: dwrite d5/da/dc/f10 [0,4194304] 0 2024-02-15T22:41:08.587 INFO:tasks.workunit.client.1.smithi082.stdout:6/83: unlink d2/f4 0 2024-02-15T22:41:08.587 INFO:tasks.workunit.client.1.smithi082.stdout:6/84: creat d2/f15 x:0 0 0 2024-02-15T22:41:08.588 INFO:tasks.workunit.client.1.smithi082.stdout:1/58: creat d1/f1b x:0 0 0 2024-02-15T22:41:08.589 INFO:tasks.workunit.client.1.smithi082.stdout:5/52: readlink l3 0 2024-02-15T22:41:08.589 INFO:tasks.workunit.client.1.smithi082.stdout:5/53: chown d5/f7 95 1 2024-02-15T22:41:08.591 INFO:tasks.workunit.client.1.smithi082.stdout:6/85: unlink d2/f15 0 2024-02-15T22:41:08.593 INFO:tasks.workunit.client.1.smithi082.stdout:8/55: dwrite d1/d7/de/ff [0,4194304] 0 2024-02-15T22:41:08.595 INFO:tasks.workunit.client.1.smithi082.stdout:9/87: dwrite f5 [0,4194304] 0 2024-02-15T22:41:08.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/11: dwrite d0/f2 [0,4194304] 0 2024-02-15T22:41:08.598 INFO:tasks.workunit.client.1.smithi082.stdout:8/56: link d1/f14 d1/d7/d9/f17 0 2024-02-15T22:41:08.601 INFO:tasks.workunit.client.1.smithi082.stdout:9/88: creat d8/f18 x:0 0 0 2024-02-15T22:41:08.615 INFO:tasks.workunit.client.1.smithi082.stdout:9/89: dread d8/fa [0,4194304] 0 2024-02-15T22:41:08.615 INFO:tasks.workunit.client.1.smithi082.stdout:9/90: dread - d8/f11 zero size 2024-02-15T22:41:08.616 INFO:tasks.workunit.client.1.smithi082.stdout:0/53: rmdir d3 39 2024-02-15T22:41:08.616 INFO:tasks.workunit.client.1.smithi082.stdout:0/54: stat d3/fe 0 2024-02-15T22:41:08.617 INFO:tasks.workunit.client.1.smithi082.stdout:3/12: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:08.622 INFO:tasks.workunit.client.1.smithi082.stdout:3/13: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:08.630 INFO:tasks.workunit.client.1.smithi082.stdout:3/14: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:08.631 INFO:tasks.workunit.client.1.smithi082.stdout:3/15: mkdir d0/d4 0 2024-02-15T22:41:08.631 INFO:tasks.workunit.client.1.smithi082.stdout:3/16: fsync d0/f2 0 2024-02-15T22:41:08.631 INFO:tasks.workunit.client.1.smithi082.stdout:0/55: dread d3/fa [0,4194304] 0 2024-02-15T22:41:08.632 INFO:tasks.workunit.client.1.smithi082.stdout:0/56: readlink l1 0 2024-02-15T22:41:08.632 INFO:tasks.workunit.client.1.smithi082.stdout:9/91: write f5 [721566,43025] 0 2024-02-15T22:41:08.632 INFO:tasks.workunit.client.1.smithi082.stdout:0/57: unlink l2 0 2024-02-15T22:41:08.641 INFO:tasks.workunit.client.1.smithi082.stdout:6/86: dwrite d2/f3 [4194304,4194304] 0 2024-02-15T22:41:08.642 INFO:tasks.workunit.client.1.smithi082.stdout:7/36: dwrite f7 [0,4194304] 0 2024-02-15T22:41:08.643 INFO:tasks.workunit.client.1.smithi082.stdout:9/92: dread d8/f10 [0,4194304] 0 2024-02-15T22:41:08.644 INFO:tasks.workunit.client.1.smithi082.stdout:6/87: symlink d2/l16 0 2024-02-15T22:41:08.644 INFO:tasks.workunit.client.1.smithi082.stdout:6/88: write d2/fd [1042135,25371] 0 2024-02-15T22:41:08.644 INFO:tasks.workunit.client.1.smithi082.stdout:9/93: write d8/f9 [4202724,78929] 0 2024-02-15T22:41:08.645 INFO:tasks.workunit.client.1.smithi082.stdout:9/94: dread - d8/f18 zero size 2024-02-15T22:41:08.645 INFO:tasks.workunit.client.1.smithi082.stdout:5/54: dwrite d5/da/dc/f10 [0,4194304] 0 2024-02-15T22:41:08.645 INFO:tasks.workunit.client.1.smithi082.stdout:0/58: dread d3/f6 [0,4194304] 0 2024-02-15T22:41:08.645 INFO:tasks.workunit.client.1.smithi082.stdout:5/55: chown d5/da 358650111 1 2024-02-15T22:41:08.645 INFO:tasks.workunit.client.1.smithi082.stdout:5/56: rename d5 to d5/d11 22 2024-02-15T22:41:08.646 INFO:tasks.workunit.client.1.smithi082.stdout:6/89: symlink d2/l17 0 2024-02-15T22:41:08.646 INFO:tasks.workunit.client.1.smithi082.stdout:9/95: link d8/f9 d8/f19 0 2024-02-15T22:41:08.647 INFO:tasks.workunit.client.1.smithi082.stdout:9/96: stat d8 0 2024-02-15T22:41:08.647 INFO:tasks.workunit.client.1.smithi082.stdout:9/97: creat d8/f1a x:0 0 0 2024-02-15T22:41:08.647 INFO:tasks.workunit.client.1.smithi082.stdout:9/98: stat d8/f18 0 2024-02-15T22:41:08.647 INFO:tasks.workunit.client.1.smithi082.stdout:0/59: creat d3/f12 x:0 0 0 2024-02-15T22:41:08.648 INFO:tasks.workunit.client.1.smithi082.stdout:5/57: mkdir d5/da/d12 0 2024-02-15T22:41:08.648 INFO:tasks.workunit.client.1.smithi082.stdout:5/58: write d5/f7 [1840966,90571] 0 2024-02-15T22:41:08.650 INFO:tasks.workunit.client.1.smithi082.stdout:6/90: mkdir d2/d18 0 2024-02-15T22:41:08.652 INFO:tasks.workunit.client.1.smithi082.stdout:1/59: dwrite d1/da/d11/f12 [0,4194304] 0 2024-02-15T22:41:08.652 INFO:tasks.workunit.client.1.smithi082.stdout:7/37: write f7 [199977,56631] 0 2024-02-15T22:41:08.652 INFO:tasks.workunit.client.1.smithi082.stdout:3/17: dwrite d0/f2 [0,4194304] 0 2024-02-15T22:41:08.652 INFO:tasks.workunit.client.1.smithi082.stdout:8/57: dwrite d1/d7/d9/f17 [0,4194304] 0 2024-02-15T22:41:08.652 INFO:tasks.workunit.client.1.smithi082.stdout:8/58: creat d1/f18 x:0 0 0 2024-02-15T22:41:08.653 INFO:tasks.workunit.client.1.smithi082.stdout:8/59: write d1/f5 [182197,95394] 0 2024-02-15T22:41:08.653 INFO:tasks.workunit.client.1.smithi082.stdout:8/60: readlink d1/l6 0 2024-02-15T22:41:08.654 INFO:tasks.workunit.client.1.smithi082.stdout:9/99: rename d8/fa to d8/d12/f1b 0 2024-02-15T22:41:08.654 INFO:tasks.workunit.client.1.smithi082.stdout:9/100: write d8/f11 [465679,117063] 0 2024-02-15T22:41:08.654 INFO:tasks.workunit.client.1.smithi082.stdout:9/101: read - d8/f1a zero size 2024-02-15T22:41:08.655 INFO:tasks.workunit.client.1.smithi082.stdout:5/59: mknod d5/da/dc/de/c13 0 2024-02-15T22:41:08.655 INFO:tasks.workunit.client.1.smithi082.stdout:5/60: write d5/f7 [1297067,105797] 0 2024-02-15T22:41:08.655 INFO:tasks.workunit.client.1.smithi082.stdout:5/61: write d5/da/dc/ff [1583421,107847] 0 2024-02-15T22:41:08.656 INFO:tasks.workunit.client.1.smithi082.stdout:6/91: creat d2/d18/f19 x:0 0 0 2024-02-15T22:41:08.660 INFO:tasks.workunit.client.1.smithi082.stdout:1/60: unlink d1/da/d14/f13 0 2024-02-15T22:41:08.664 INFO:tasks.workunit.client.1.smithi082.stdout:3/18: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:08.664 INFO:tasks.workunit.client.1.smithi082.stdout:1/61: dread d1/fc [0,4194304] 0 2024-02-15T22:41:08.665 INFO:tasks.workunit.client.1.smithi082.stdout:7/38: creat ff x:0 0 0 2024-02-15T22:41:08.665 INFO:tasks.workunit.client.1.smithi082.stdout:7/39: write fe [552200,25640] 0 2024-02-15T22:41:08.665 INFO:tasks.workunit.client.1.smithi082.stdout:7/40: rmdir - no directory 2024-02-15T22:41:08.671 INFO:tasks.workunit.client.1.smithi082.stdout:3/19: write d0/f2 [303737,27295] 0 2024-02-15T22:41:08.671 INFO:tasks.workunit.client.1.smithi082.stdout:0/60: link d3/fb d3/f13 0 2024-02-15T22:41:08.671 INFO:tasks.workunit.client.1.smithi082.stdout:0/61: chown d3/c9 31640332 1 2024-02-15T22:41:08.679 INFO:tasks.workunit.client.1.smithi082.stdout:1/62: dwrite d1/f4 [0,4194304] 0 2024-02-15T22:41:08.679 INFO:tasks.workunit.client.1.smithi082.stdout:5/62: rename d5/da/dc/de to d5/da/d14 0 2024-02-15T22:41:08.683 INFO:tasks.workunit.client.1.smithi082.stdout:8/61: write d1/d7/d9/f17 [5143772,88046] 0 2024-02-15T22:41:08.683 INFO:tasks.workunit.client.1.smithi082.stdout:8/62: creat d1/f19 x:0 0 0 2024-02-15T22:41:08.683 INFO:tasks.workunit.client.1.smithi082.stdout:8/63: write d1/f18 [818590,123167] 0 2024-02-15T22:41:08.684 INFO:tasks.workunit.client.1.smithi082.stdout:9/102: rmdir d8/d12 39 2024-02-15T22:41:08.692 INFO:tasks.workunit.client.1.smithi082.stdout:5/63: getdents d5 0 2024-02-15T22:41:08.692 INFO:tasks.workunit.client.1.smithi082.stdout:7/41: link f6 f10 0 2024-02-15T22:41:08.692 INFO:tasks.workunit.client.1.smithi082.stdout:7/42: chown fc 633274 1 2024-02-15T22:41:08.693 INFO:tasks.workunit.client.1.smithi082.stdout:1/63: dwrite d1/da/d11/f15 [0,4194304] 0 2024-02-15T22:41:08.693 INFO:tasks.workunit.client.1.smithi082.stdout:1/64: fsync d1/da/fe 0 2024-02-15T22:41:08.696 INFO:tasks.workunit.client.1.smithi082.stdout:3/20: getdents d0 0 2024-02-15T22:41:08.700 INFO:tasks.workunit.client.1.smithi082.stdout:0/62: mknod d3/c14 0 2024-02-15T22:41:08.707 INFO:tasks.workunit.client.1.smithi082.stdout:3/21: mknod d0/c5 0 2024-02-15T22:41:08.708 INFO:tasks.workunit.client.1.smithi082.stdout:0/63: creat d3/f15 x:0 0 0 2024-02-15T22:41:08.709 INFO:tasks.workunit.client.1.smithi082.stdout:3/22: mkdir d0/d6 0 2024-02-15T22:41:08.711 INFO:tasks.workunit.client.1.smithi082.stdout:3/23: creat d0/d4/f7 x:0 0 0 2024-02-15T22:41:08.711 INFO:tasks.workunit.client.1.smithi082.stdout:3/24: write d0/d4/f7 [995473,86179] 0 2024-02-15T22:41:08.712 INFO:tasks.workunit.client.1.smithi082.stdout:3/25: symlink d0/l8 0 2024-02-15T22:41:08.712 INFO:tasks.workunit.client.1.smithi082.stdout:3/26: truncate d0/d4/f7 1325428 0 2024-02-15T22:41:08.720 INFO:tasks.workunit.client.1.smithi082.stdout:8/64: rmdir d1 39 2024-02-15T22:41:08.720 INFO:tasks.workunit.client.1.smithi082.stdout:5/64: dwrite d5/f7 [0,4194304] 0 2024-02-15T22:41:08.721 INFO:tasks.workunit.client.1.smithi082.stdout:5/65: fsync d5/da/dc/ff 0 2024-02-15T22:41:08.721 INFO:tasks.workunit.client.1.smithi082.stdout:5/66: creat d5/da/dc/f15 x:0 0 0 2024-02-15T22:41:08.724 INFO:tasks.workunit.client.1.smithi082.stdout:5/67: link l3 d5/da/dc/l16 0 2024-02-15T22:41:08.728 INFO:tasks.workunit.client.1.smithi082.stdout:1/65: dwrite d1/f1b [0,4194304] 0 2024-02-15T22:41:08.728 INFO:tasks.workunit.client.1.smithi082.stdout:1/66: creat d1/da/f1c x:0 0 0 2024-02-15T22:41:08.729 INFO:tasks.workunit.client.1.smithi082.stdout:1/67: creat d1/f1d x:0 0 0 2024-02-15T22:41:08.729 INFO:tasks.workunit.client.1.smithi082.stdout:7/43: dwrite f3 [0,4194304] 0 2024-02-15T22:41:08.729 INFO:tasks.workunit.client.1.smithi082.stdout:7/44: stat f3 0 2024-02-15T22:41:08.729 INFO:tasks.workunit.client.1.smithi082.stdout:7/45: readlink l2 0 2024-02-15T22:41:08.729 INFO:tasks.workunit.client.1.smithi082.stdout:7/46: truncate f3 5086928 0 2024-02-15T22:41:08.730 INFO:tasks.workunit.client.1.smithi082.stdout:0/64: dwrite d3/f13 [0,4194304] 0 2024-02-15T22:41:08.735 INFO:tasks.workunit.client.1.smithi082.stdout:3/27: dread d0/d4/f7 [0,4194304] 0 2024-02-15T22:41:08.736 INFO:tasks.workunit.client.1.smithi082.stdout:7/47: getdents . 0 2024-02-15T22:41:08.737 INFO:tasks.workunit.client.1.smithi082.stdout:3/28: creat d0/d6/f9 x:0 0 0 2024-02-15T22:41:08.737 INFO:tasks.workunit.client.1.smithi082.stdout:3/29: readlink d0/l8 0 2024-02-15T22:41:08.738 INFO:tasks.workunit.client.1.smithi082.stdout:0/65: mkdir d3/d16 0 2024-02-15T22:41:08.739 INFO:tasks.workunit.client.1.smithi082.stdout:3/30: dread d0/d4/f7 [0,4194304] 0 2024-02-15T22:41:08.739 INFO:tasks.workunit.client.1.smithi082.stdout:7/48: symlink l11 0 2024-02-15T22:41:08.740 INFO:tasks.workunit.client.1.smithi082.stdout:8/65: dwrite d1/d7/de/ff [4194304,4194304] 0 2024-02-15T22:41:08.740 INFO:tasks.workunit.client.1.smithi082.stdout:0/66: creat d3/f17 x:0 0 0 2024-02-15T22:41:08.742 INFO:tasks.workunit.client.1.smithi082.stdout:3/31: symlink d0/d6/la 0 2024-02-15T22:41:08.742 INFO:tasks.workunit.client.1.smithi082.stdout:3/32: truncate d0/d6/f9 692905 0 2024-02-15T22:41:08.742 INFO:tasks.workunit.client.1.smithi082.stdout:7/49: chown ld 2 1 2024-02-15T22:41:08.743 INFO:tasks.workunit.client.1.smithi082.stdout:1/68: dread d1/f1b [0,4194304] 0 2024-02-15T22:41:08.744 INFO:tasks.workunit.client.1.smithi082.stdout:0/67: creat d3/d16/f18 x:0 0 0 2024-02-15T22:41:08.745 INFO:tasks.workunit.client.1.smithi082.stdout:5/68: dwrite d5/da/dc/f10 [0,4194304] 0 2024-02-15T22:41:08.745 INFO:tasks.workunit.client.1.smithi082.stdout:5/69: fdatasync d5/f7 0 2024-02-15T22:41:08.747 INFO:tasks.workunit.client.1.smithi082.stdout:1/69: rename d1/da/d11/f15 to d1/da/d1a/f1e 0 2024-02-15T22:41:08.748 INFO:tasks.workunit.client.1.smithi082.stdout:1/70: chown d1/da/d1a 780 1 2024-02-15T22:41:08.750 INFO:tasks.workunit.client.1.smithi082.stdout:5/70: rmdir d5/da/d12 0 2024-02-15T22:41:08.750 INFO:tasks.workunit.client.1.smithi082.stdout:5/71: readlink d5/da/dc/l16 0 2024-02-15T22:41:08.751 INFO:tasks.workunit.client.1.smithi082.stdout:3/33: truncate d0/f2 1469658 0 2024-02-15T22:41:08.751 INFO:tasks.workunit.client.1.smithi082.stdout:3/34: creat d0/d4/fb x:0 0 0 2024-02-15T22:41:08.752 INFO:tasks.workunit.client.1.smithi082.stdout:7/50: mkdir d12 0 2024-02-15T22:41:08.752 INFO:tasks.workunit.client.1.smithi082.stdout:7/51: getdents d12 0 2024-02-15T22:41:08.754 INFO:tasks.workunit.client.1.smithi082.stdout:0/68: mkdir d3/d19 0 2024-02-15T22:41:08.754 INFO:tasks.workunit.client.1.smithi082.stdout:0/69: stat d3 0 2024-02-15T22:41:08.754 INFO:tasks.workunit.client.1.smithi082.stdout:0/70: creat d3/d16/f1a x:0 0 0 2024-02-15T22:41:08.755 INFO:tasks.workunit.client.1.smithi082.stdout:5/72: truncate d5/da/dc/ff 26288 0 2024-02-15T22:41:08.760 INFO:tasks.workunit.client.1.smithi082.stdout:1/71: rename d1/da/d1a to d1/da/d14/d18/d1f 0 2024-02-15T22:41:08.761 INFO:tasks.workunit.client.1.smithi082.stdout:1/72: stat d1/da/d11/f12 0 2024-02-15T22:41:08.761 INFO:tasks.workunit.client.1.smithi082.stdout:1/73: write d1/da/f1c [47715,25057] 0 2024-02-15T22:41:08.766 INFO:tasks.workunit.client.1.smithi082.stdout:0/71: getdents d3/d16 0 2024-02-15T22:41:08.766 INFO:tasks.workunit.client.1.smithi082.stdout:0/72: read - d3/f12 zero size 2024-02-15T22:41:08.766 INFO:tasks.workunit.client.1.smithi082.stdout:0/73: stat d3/fc 0 2024-02-15T22:41:08.767 INFO:tasks.workunit.client.1.smithi082.stdout:5/73: write d5/da/dc/f10 [1528913,42143] 0 2024-02-15T22:41:08.767 INFO:tasks.workunit.client.1.smithi082.stdout:5/74: dread d5/da/dc/ff [0,4194304] 0 2024-02-15T22:41:08.768 INFO:tasks.workunit.client.1.smithi082.stdout:3/35: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:08.769 INFO:tasks.workunit.client.1.smithi082.stdout:0/74: rename d3/l10 to d3/d16/l1b 0 2024-02-15T22:41:08.771 INFO:tasks.workunit.client.1.smithi082.stdout:5/75: creat d5/da/d14/f17 x:0 0 0 2024-02-15T22:41:08.774 INFO:tasks.workunit.client.1.smithi082.stdout:5/76: link d5/f7 d5/da/d14/f18 0 2024-02-15T22:41:08.775 INFO:tasks.workunit.client.1.smithi082.stdout:7/52: write f3 [1607021,110460] 0 2024-02-15T22:41:08.777 INFO:tasks.workunit.client.1.smithi082.stdout:5/77: mknod d5/da/dc/c19 0 2024-02-15T22:41:08.777 INFO:tasks.workunit.client.1.smithi082.stdout:5/78: write d5/da/dc/f15 [658954,88332] 0 2024-02-15T22:41:08.777 INFO:tasks.workunit.client.1.smithi082.stdout:5/79: read - d5/da/d14/f17 zero size 2024-02-15T22:41:08.783 INFO:tasks.workunit.client.1.smithi082.stdout:5/80: creat d5/da/f1a x:0 0 0 2024-02-15T22:41:08.784 INFO:tasks.workunit.client.1.smithi082.stdout:7/53: dread f6 [0,4194304] 0 2024-02-15T22:41:08.785 INFO:tasks.workunit.client.1.smithi082.stdout:7/54: symlink d12/l13 0 2024-02-15T22:41:08.786 INFO:tasks.workunit.client.1.smithi082.stdout:7/55: write fe [501155,118168] 0 2024-02-15T22:41:08.807 INFO:tasks.workunit.client.1.smithi082.stdout:3/36: dwrite d0/d4/f7 [0,4194304] 0 2024-02-15T22:41:08.807 INFO:tasks.workunit.client.1.smithi082.stdout:0/75: dwrite d3/d16/f18 [0,4194304] 0 2024-02-15T22:41:08.807 INFO:tasks.workunit.client.1.smithi082.stdout:0/76: dread - d3/fe zero size 2024-02-15T22:41:08.807 INFO:tasks.workunit.client.1.smithi082.stdout:1/74: dwrite d1/da/ff [0,4194304] 0 2024-02-15T22:41:08.808 INFO:tasks.workunit.client.1.smithi082.stdout:7/56: dwrite fb [0,4194304] 0 2024-02-15T22:41:08.813 INFO:tasks.workunit.client.1.smithi082.stdout:5/81: getdents d5/da/dc 0 2024-02-15T22:41:08.813 INFO:tasks.workunit.client.1.smithi082.stdout:5/82: creat d5/da/d14/f1b x:0 0 0 2024-02-15T22:41:08.814 INFO:tasks.workunit.client.1.smithi082.stdout:0/77: mkdir d3/d19/d1c 0 2024-02-15T22:41:08.820 INFO:tasks.workunit.client.1.smithi082.stdout:0/78: mknod d3/d19/c1d 0 2024-02-15T22:41:08.820 INFO:tasks.workunit.client.1.smithi082.stdout:0/79: dread - d3/f15 zero size 2024-02-15T22:41:08.820 INFO:tasks.workunit.client.1.smithi082.stdout:5/83: fdatasync d5/da/dc/f15 0 2024-02-15T22:41:08.822 INFO:tasks.workunit.client.1.smithi082.stdout:7/57: unlink f9 0 2024-02-15T22:41:08.823 INFO:tasks.workunit.client.1.smithi082.stdout:7/58: readlink l11 0 2024-02-15T22:41:08.823 INFO:tasks.workunit.client.1.smithi082.stdout:3/37: dwrite d0/d4/f7 [0,4194304] 0 2024-02-15T22:41:08.823 INFO:tasks.workunit.client.1.smithi082.stdout:1/75: getdents d1/da/d14 0 2024-02-15T22:41:08.823 INFO:tasks.workunit.client.1.smithi082.stdout:1/76: write d1/da/d11/f16 [249805,312] 0 2024-02-15T22:41:08.823 INFO:tasks.workunit.client.1.smithi082.stdout:1/77: stat d1/da/d11/f12 0 2024-02-15T22:41:08.823 INFO:tasks.workunit.client.1.smithi082.stdout:1/78: chown d1/f1d 2024571318 1 2024-02-15T22:41:08.834 INFO:tasks.workunit.client.1.smithi082.stdout:1/79: write d1/da/d14/d18/d1f/f1e [3556214,77520] 0 2024-02-15T22:41:08.836 INFO:tasks.workunit.client.1.smithi082.stdout:7/59: unlink l11 0 2024-02-15T22:41:08.836 INFO:tasks.workunit.client.1.smithi082.stdout:7/60: chown fb 1 1 2024-02-15T22:41:08.847 INFO:tasks.workunit.client.1.smithi082.stdout:5/84: dwrite d5/f7 [0,4194304] 0 2024-02-15T22:41:08.847 INFO:tasks.workunit.client.1.smithi082.stdout:5/85: read - d5/da/d14/f17 zero size 2024-02-15T22:41:08.847 INFO:tasks.workunit.client.1.smithi082.stdout:5/86: creat d5/da/f1c x:0 0 0 2024-02-15T22:41:08.876 INFO:tasks.workunit.client.1.smithi082.stdout:0/80: dwrite d3/f8 [0,4194304] 0 2024-02-15T22:41:08.877 INFO:tasks.workunit.client.1.smithi082.stdout:5/87: dwrite d5/da/dc/ff [0,4194304] 0 2024-02-15T22:41:08.877 INFO:tasks.workunit.client.1.smithi082.stdout:1/80: dwrite d1/da/ff [0,4194304] 0 2024-02-15T22:41:08.885 INFO:tasks.workunit.client.1.smithi082.stdout:5/88: read d5/f7 [4062391,125567] 0 2024-02-15T22:41:08.894 INFO:tasks.workunit.client.1.smithi082.stdout:1/81: dwrite d1/da/d14/d18/d1f/f1e [0,4194304] 0 2024-02-15T22:41:08.960 INFO:tasks.workunit.client.1.smithi082.stdout:7/61: rename d12/l13 to d12/l14 0 2024-02-15T22:41:08.961 INFO:tasks.workunit.client.1.smithi082.stdout:3/38: mkdir d0/dc 0 2024-02-15T22:41:08.962 INFO:tasks.workunit.client.1.smithi082.stdout:3/39: write d0/f2 [78917,58488] 0 2024-02-15T22:41:08.967 INFO:tasks.workunit.client.1.smithi082.stdout:0/81: readlink d3/l5 0 2024-02-15T22:41:08.967 INFO:tasks.workunit.client.1.smithi082.stdout:0/82: fdatasync d3/f12 0 2024-02-15T22:41:08.968 INFO:tasks.workunit.client.1.smithi082.stdout:3/40: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:08.971 INFO:tasks.workunit.client.1.smithi082.stdout:5/89: mknod d5/da/dc/c1d 0 2024-02-15T22:41:08.971 INFO:tasks.workunit.client.1.smithi082.stdout:5/90: truncate d5/da/f1c 980078 0 2024-02-15T22:41:08.983 INFO:tasks.workunit.client.1.smithi082.stdout:7/62: write f7 [5217702,120478] 0 2024-02-15T22:41:08.985 INFO:tasks.workunit.client.1.smithi082.stdout:3/41: unlink d0/d6/f9 0 2024-02-15T22:41:08.986 INFO:tasks.workunit.client.1.smithi082.stdout:5/91: link l3 d5/da/l1e 0 2024-02-15T22:41:08.988 INFO:tasks.workunit.client.1.smithi082.stdout:7/63: symlink d12/l15 0 2024-02-15T22:41:08.989 INFO:tasks.workunit.client.1.smithi082.stdout:0/83: mknod d3/d16/c1e 0 2024-02-15T22:41:08.989 INFO:tasks.workunit.client.1.smithi082.stdout:0/84: chown d3/d16/l1b 0 1 2024-02-15T22:41:08.990 INFO:tasks.workunit.client.1.smithi082.stdout:3/42: creat d0/dc/fd x:0 0 0 2024-02-15T22:41:08.991 INFO:tasks.workunit.client.1.smithi082.stdout:7/64: fdatasync f10 0 2024-02-15T22:41:08.994 INFO:tasks.workunit.client.1.smithi082.stdout:7/65: write f8 [563785,26410] 0 2024-02-15T22:41:08.995 INFO:tasks.workunit.client.1.smithi082.stdout:1/82: truncate d1/da/d14/d18/d1f/f1e 1747412 0 2024-02-15T22:41:08.996 INFO:tasks.workunit.client.1.smithi082.stdout:0/85: mknod d3/d16/c1f 0 2024-02-15T22:41:08.996 INFO:tasks.workunit.client.1.smithi082.stdout:0/86: stat d3/f6 0 2024-02-15T22:41:08.997 INFO:tasks.workunit.client.1.smithi082.stdout:7/66: truncate f10 304068 0 2024-02-15T22:41:08.998 INFO:tasks.workunit.client.1.smithi082.stdout:7/67: write f8 [1044138,9050] 0 2024-02-15T22:41:08.999 INFO:tasks.workunit.client.1.smithi082.stdout:1/83: rename d1/c8 to d1/da/d14/c20 0 2024-02-15T22:41:09.001 INFO:tasks.workunit.client.1.smithi082.stdout:0/87: mkdir d3/d19/d20 0 2024-02-15T22:41:09.008 INFO:tasks.workunit.client.1.smithi082.stdout:3/43: dwrite d0/f2 [0,4194304] 0 2024-02-15T22:41:09.008 INFO:tasks.workunit.client.1.smithi082.stdout:3/44: write d0/d4/fb [714512,84532] 0 2024-02-15T22:41:09.011 INFO:tasks.workunit.client.1.smithi082.stdout:3/45: link d0/d4/f7 d0/d4/fe 0 2024-02-15T22:41:09.013 INFO:tasks.workunit.client.1.smithi082.stdout:3/46: link d0/l8 d0/d6/lf 0 2024-02-15T22:41:09.014 INFO:tasks.workunit.client.1.smithi082.stdout:3/47: symlink d0/d6/l10 0 2024-02-15T22:41:09.014 INFO:tasks.workunit.client.1.smithi082.stdout:3/48: chown d0/d6 786 1 2024-02-15T22:41:09.015 INFO:tasks.workunit.client.1.smithi082.stdout:3/49: chown d0/c3 27105043 1 2024-02-15T22:41:09.015 INFO:tasks.workunit.client.1.smithi082.stdout:3/50: chown d0/c5 2802 1 2024-02-15T22:41:09.015 INFO:tasks.workunit.client.1.smithi082.stdout:3/51: rename d0/dc to d0/dc/d11 22 2024-02-15T22:41:09.015 INFO:tasks.workunit.client.1.smithi082.stdout:3/52: chown d0/d4/fb 77 1 2024-02-15T22:41:09.030 INFO:tasks.workunit.client.1.smithi082.stdout:1/84: dwrite d1/da/f1c [0,4194304] 0 2024-02-15T22:41:09.031 INFO:tasks.workunit.client.1.smithi082.stdout:1/85: fdatasync d1/da/ff 0 2024-02-15T22:41:09.031 INFO:tasks.workunit.client.1.smithi082.stdout:7/68: dwrite f3 [0,4194304] 0 2024-02-15T22:41:09.031 INFO:tasks.workunit.client.1.smithi082.stdout:0/88: dwrite d3/d16/f18 [0,4194304] 0 2024-02-15T22:41:09.031 INFO:tasks.workunit.client.1.smithi082.stdout:0/89: write d3/f17 [823395,83834] 0 2024-02-15T22:41:09.032 INFO:tasks.workunit.client.1.smithi082.stdout:0/90: truncate d3/f17 1640727 0 2024-02-15T22:41:09.033 INFO:tasks.workunit.client.1.smithi082.stdout:3/53: dwrite d0/d4/fe [0,4194304] 0 2024-02-15T22:41:09.033 INFO:tasks.workunit.client.1.smithi082.stdout:3/54: creat d0/d6/f12 x:0 0 0 2024-02-15T22:41:09.035 INFO:tasks.workunit.client.1.smithi082.stdout:1/86: symlink d1/da/d14/d18/l21 0 2024-02-15T22:41:09.035 INFO:tasks.workunit.client.1.smithi082.stdout:1/87: chown d1/l19 1 1 2024-02-15T22:41:09.036 INFO:tasks.workunit.client.1.smithi082.stdout:0/91: link d3/fb d3/d19/f21 0 2024-02-15T22:41:09.037 INFO:tasks.workunit.client.1.smithi082.stdout:3/55: fdatasync d0/d4/fb 0 2024-02-15T22:41:09.040 INFO:tasks.workunit.client.1.smithi082.stdout:1/88: rename d1/da/d11/f12 to d1/f22 0 2024-02-15T22:41:09.040 INFO:tasks.workunit.client.1.smithi082.stdout:1/89: write d1/f1d [697408,34848] 0 2024-02-15T22:41:09.040 INFO:tasks.workunit.client.1.smithi082.stdout:1/90: rename d1/da/d14 to d1/da/d14/d23 22 2024-02-15T22:41:09.041 INFO:tasks.workunit.client.1.smithi082.stdout:0/92: unlink d3/f17 0 2024-02-15T22:41:09.043 INFO:tasks.workunit.client.1.smithi082.stdout:0/93: truncate d3/d16/f1a 165306 0 2024-02-15T22:41:09.045 INFO:tasks.workunit.client.1.smithi082.stdout:3/56: link d0/l8 d0/l13 0 2024-02-15T22:41:09.045 INFO:tasks.workunit.client.1.smithi082.stdout:0/94: symlink d3/d19/d20/l22 0 2024-02-15T22:41:09.046 INFO:tasks.workunit.client.1.smithi082.stdout:3/57: mkdir d0/d4/d14 0 2024-02-15T22:41:09.048 INFO:tasks.workunit.client.1.smithi082.stdout:0/95: rename d3/d16/c1f to d3/d19/c23 0 2024-02-15T22:41:09.049 INFO:tasks.workunit.client.1.smithi082.stdout:0/96: creat d3/d19/f24 x:0 0 0 2024-02-15T22:41:09.050 INFO:tasks.workunit.client.1.smithi082.stdout:7/69: dwrite fe [0,4194304] 0 2024-02-15T22:41:09.050 INFO:tasks.workunit.client.1.smithi082.stdout:1/91: dread d1/da/f1c [0,4194304] 0 2024-02-15T22:41:09.050 INFO:tasks.workunit.client.1.smithi082.stdout:1/92: creat d1/da/f24 x:0 0 0 2024-02-15T22:41:09.051 INFO:tasks.workunit.client.1.smithi082.stdout:0/97: mkdir d3/d19/d25 0 2024-02-15T22:41:09.054 INFO:tasks.workunit.client.1.smithi082.stdout:7/70: creat d12/f16 x:0 0 0 2024-02-15T22:41:09.056 INFO:tasks.workunit.client.1.smithi082.stdout:1/93: mknod d1/da/d11/c25 0 2024-02-15T22:41:09.059 INFO:tasks.workunit.client.1.smithi082.stdout:1/94: rename d1/l19 to d1/l26 0 2024-02-15T22:41:09.061 INFO:tasks.workunit.client.1.smithi082.stdout:7/71: dread fb [0,4194304] 0 2024-02-15T22:41:09.062 INFO:tasks.workunit.client.1.smithi082.stdout:7/72: mkdir d12/d17 0 2024-02-15T22:41:09.065 INFO:tasks.workunit.client.1.smithi082.stdout:3/58: truncate d0/d4/fe 1689937 0 2024-02-15T22:41:09.076 INFO:tasks.workunit.client.1.smithi082.stdout:1/95: dwrite d1/fc [0,4194304] 0 2024-02-15T22:41:09.077 INFO:tasks.workunit.client.1.smithi082.stdout:1/96: symlink d1/da/d14/l27 0 2024-02-15T22:41:09.078 INFO:tasks.workunit.client.1.smithi082.stdout:1/97: creat d1/da/d14/f28 x:0 0 0 2024-02-15T22:41:09.079 INFO:tasks.workunit.client.1.smithi082.stdout:1/98: rename d1/fc to d1/da/f29 0 2024-02-15T22:41:09.080 INFO:tasks.workunit.client.1.smithi082.stdout:1/99: rename d1/da/d14/d18/d1f/f1e to d1/da/d14/f2a 0 2024-02-15T22:41:09.081 INFO:tasks.workunit.client.1.smithi082.stdout:0/98: truncate d3/d16/f18 4173486 0 2024-02-15T22:41:09.082 INFO:tasks.workunit.client.1.smithi082.stdout:0/99: dread - d3/fd zero size 2024-02-15T22:41:09.083 INFO:tasks.workunit.client.1.smithi082.stdout:3/59: write d0/d4/f7 [2559407,15902] 0 2024-02-15T22:41:09.083 INFO:tasks.workunit.client.1.smithi082.stdout:3/60: getdents d0/d4/d14 0 2024-02-15T22:41:09.085 INFO:tasks.workunit.client.1.smithi082.stdout:3/61: symlink d0/dc/l15 0 2024-02-15T22:41:09.085 INFO:tasks.workunit.client.1.smithi082.stdout:3/62: readlink d0/d6/lf 0 2024-02-15T22:41:09.090 INFO:tasks.workunit.client.1.smithi082.stdout:3/63: rename d0/d6 to d0/d16 0 2024-02-15T22:41:09.092 INFO:tasks.workunit.client.1.smithi082.stdout:3/64: rename d0/l13 to d0/d4/d14/l17 0 2024-02-15T22:41:09.095 INFO:tasks.workunit.client.1.smithi082.stdout:3/65: mknod d0/dc/c18 0 2024-02-15T22:41:09.111 INFO:tasks.workunit.client.1.smithi082.stdout:1/100: dwrite d1/f1b [0,4194304] 0 2024-02-15T22:41:09.113 INFO:tasks.workunit.client.1.smithi082.stdout:1/101: creat d1/da/d14/d18/f2b x:0 0 0 2024-02-15T22:41:09.113 INFO:tasks.workunit.client.1.smithi082.stdout:1/102: chown d1/f4 2 1 2024-02-15T22:41:09.117 INFO:tasks.workunit.client.1.smithi082.stdout:0/100: dwrite d3/d19/f21 [0,4194304] 0 2024-02-15T22:41:09.117 INFO:tasks.workunit.client.1.smithi082.stdout:0/101: fsync d3/fa 0 2024-02-15T22:41:09.117 INFO:tasks.workunit.client.1.smithi082.stdout:0/102: truncate d3/f12 430678 0 2024-02-15T22:41:09.118 INFO:tasks.workunit.client.1.smithi082.stdout:3/66: dwrite d0/d4/fb [0,4194304] 0 2024-02-15T22:41:09.118 INFO:tasks.workunit.client.1.smithi082.stdout:3/67: dread - d0/dc/fd zero size 2024-02-15T22:41:09.118 INFO:tasks.workunit.client.1.smithi082.stdout:3/68: chown d0/dc/l15 456494 1 2024-02-15T22:41:09.120 INFO:tasks.workunit.client.1.smithi082.stdout:0/103: mkdir d3/d19/d20/d26 0 2024-02-15T22:41:09.124 INFO:tasks.workunit.client.1.smithi082.stdout:0/104: rename d3/fc to d3/d19/d1c/f27 0 2024-02-15T22:41:09.129 INFO:tasks.workunit.client.1.smithi082.stdout:1/103: dwrite d1/f1d [0,4194304] 0 2024-02-15T22:41:09.130 INFO:tasks.workunit.client.1.smithi082.stdout:0/105: rename d3/c9 to d3/d19/d25/c28 0 2024-02-15T22:41:09.130 INFO:tasks.workunit.client.1.smithi082.stdout:1/104: write d1/da/f29 [4565746,31571] 0 2024-02-15T22:41:09.130 INFO:tasks.workunit.client.1.smithi082.stdout:0/106: creat d3/d19/f29 x:0 0 0 2024-02-15T22:41:09.136 INFO:tasks.workunit.client.1.smithi082.stdout:3/69: rename d0/d4 to d0/d19 0 2024-02-15T22:41:09.139 INFO:tasks.workunit.client.1.smithi082.stdout:0/107: link d3/fe d3/d16/f2a 0 2024-02-15T22:41:09.140 INFO:tasks.workunit.client.1.smithi082.stdout:0/108: creat d3/f2b x:0 0 0 2024-02-15T22:41:09.140 INFO:tasks.workunit.client.1.smithi082.stdout:0/109: write d3/fb [4452253,50414] 0 2024-02-15T22:41:09.142 INFO:tasks.workunit.client.1.smithi082.stdout:0/110: mknod d3/d19/c2c 0 2024-02-15T22:41:09.143 INFO:tasks.workunit.client.1.smithi082.stdout:3/70: read d0/f2 [891087,91083] 0 2024-02-15T22:41:09.145 INFO:tasks.workunit.client.1.smithi082.stdout:3/71: getdents d0/dc 0 2024-02-15T22:41:09.151 INFO:tasks.workunit.client.1.smithi082.stdout:0/111: dread d3/d16/f18 [0,4194304] 0 2024-02-15T22:41:09.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:09 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:09.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:09 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:09.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:09 smithi033 ceph-mon[29033]: Reconfiguring alertmanager.smithi033 (dependencies changed)... 2024-02-15T22:41:09.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:09 smithi033 ceph-mon[29033]: Reconfiguring daemon alertmanager.smithi033 on smithi033 2024-02-15T22:41:09.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:09 smithi033 ceph-mon[29033]: pgmap v17: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 157 MiB/s rd, 201 MiB/s wr, 1.08k op/s 2024-02-15T22:41:09.318 INFO:tasks.workunit.client.1.smithi082.stdout:2/22: sync 2024-02-15T22:41:09.318 INFO:tasks.workunit.client.1.smithi082.stdout:2/23: readlink - no filename 2024-02-15T22:41:09.337 INFO:tasks.workunit.client.1.smithi082.stdout:2/24: dwrite f2 [0,4194304] 0 2024-02-15T22:41:09.357 INFO:tasks.workunit.client.1.smithi082.stdout:2/25: dwrite f0 [0,4194304] 0 2024-02-15T22:41:09.359 INFO:tasks.workunit.client.1.smithi082.stdout:2/26: rename f0 to f3 0 2024-02-15T22:41:09.365 INFO:tasks.workunit.client.1.smithi082.stdout:2/27: truncate f3 1651813 0 2024-02-15T22:41:09.376 INFO:tasks.workunit.client.1.smithi082.stdout:2/28: truncate f3 632402 0 2024-02-15T22:41:09.394 INFO:tasks.workunit.client.1.smithi082.stdout:2/29: dwrite f2 [0,4194304] 0 2024-02-15T22:41:09.394 INFO:tasks.workunit.client.1.smithi082.stdout:2/30: rmdir - no directory 2024-02-15T22:41:09.412 INFO:tasks.workunit.client.1.smithi082.stdout:2/31: dwrite f2 [0,4194304] 0 2024-02-15T22:41:09.414 INFO:tasks.workunit.client.1.smithi082.stdout:2/32: creat f4 x:0 0 0 2024-02-15T22:41:09.414 INFO:tasks.workunit.client.1.smithi082.stdout:2/33: readlink - no filename 2024-02-15T22:41:09.414 INFO:tasks.workunit.client.1.smithi082.stdout:2/34: truncate f4 183020 0 2024-02-15T22:41:09.425 INFO:tasks.workunit.client.1.smithi082.stdout:4/56: sync 2024-02-15T22:41:09.428 INFO:tasks.workunit.client.1.smithi082.stdout:6/92: sync 2024-02-15T22:41:09.428 INFO:tasks.workunit.client.1.smithi082.stdout:6/93: fdatasync d2/d18/f19 0 2024-02-15T22:41:09.430 INFO:tasks.workunit.client.1.smithi082.stdout:6/94: unlink d2/l6 0 2024-02-15T22:41:09.430 INFO:tasks.workunit.client.1.smithi082.stdout:6/95: write d2/d18/f19 [335426,101847] 0 2024-02-15T22:41:09.430 INFO:tasks.workunit.client.1.smithi082.stdout:2/35: dwrite f3 [0,4194304] 0 2024-02-15T22:41:09.430 INFO:tasks.workunit.client.1.smithi082.stdout:2/36: chown f4 10 1 2024-02-15T22:41:09.430 INFO:tasks.workunit.client.1.smithi082.stdout:2/37: chown f4 132 1 2024-02-15T22:41:09.430 INFO:tasks.workunit.client.1.smithi082.stdout:2/38: chown f3 160948 1 2024-02-15T22:41:09.433 INFO:tasks.workunit.client.1.smithi082.stdout:2/39: truncate f2 4106610 0 2024-02-15T22:41:09.434 INFO:tasks.workunit.client.1.smithi082.stdout:2/40: write f4 [890825,25010] 0 2024-02-15T22:41:09.434 INFO:tasks.workunit.client.1.smithi082.stdout:2/41: fsync f3 0 2024-02-15T22:41:09.434 INFO:tasks.workunit.client.1.smithi082.stdout:2/42: creat f5 x:0 0 0 2024-02-15T22:41:09.436 INFO:tasks.workunit.client.1.smithi082.stdout:2/43: mkdir d6 0 2024-02-15T22:41:09.454 INFO:tasks.workunit.client.1.smithi082.stdout:2/44: write f2 [3737425,64537] 0 2024-02-15T22:41:09.455 INFO:tasks.workunit.client.1.smithi082.stdout:2/45: creat d6/f7 x:0 0 0 2024-02-15T22:41:09.458 INFO:tasks.workunit.client.1.smithi082.stdout:6/96: dwrite d2/d18/f19 [0,4194304] 0 2024-02-15T22:41:09.460 INFO:tasks.workunit.client.1.smithi082.stdout:6/97: link d2/f3 d2/f1a 0 2024-02-15T22:41:09.462 INFO:tasks.workunit.client.1.smithi082.stdout:6/98: link d2/lc d2/d18/l1b 0 2024-02-15T22:41:09.465 INFO:tasks.workunit.client.1.smithi082.stdout:6/99: fsync d2/f1a 0 2024-02-15T22:41:09.468 INFO:tasks.workunit.client.1.smithi082.stdout:6/100: rmdir d2 39 2024-02-15T22:41:09.468 INFO:tasks.workunit.client.1.smithi082.stdout:6/101: write d2/fd [1258725,85035] 0 2024-02-15T22:41:09.469 INFO:tasks.workunit.client.1.smithi082.stdout:6/102: creat d2/f1c x:0 0 0 2024-02-15T22:41:09.481 INFO:tasks.workunit.client.1.smithi082.stdout:2/46: dwrite f4 [0,4194304] 0 2024-02-15T22:41:09.481 INFO:tasks.workunit.client.1.smithi082.stdout:2/47: creat d6/f8 x:0 0 0 2024-02-15T22:41:09.482 INFO:tasks.workunit.client.1.smithi082.stdout:6/103: dread d2/fd [0,4194304] 0 2024-02-15T22:41:09.482 INFO:tasks.workunit.client.1.smithi082.stdout:6/104: fdatasync d2/fd 0 2024-02-15T22:41:09.485 INFO:tasks.workunit.client.1.smithi082.stdout:6/105: mknod d2/c1d 0 2024-02-15T22:41:09.485 INFO:tasks.workunit.client.1.smithi082.stdout:6/106: write d2/ff [230133,65786] 0 2024-02-15T22:41:09.485 INFO:tasks.workunit.client.1.smithi082.stdout:6/107: creat d2/f1e x:0 0 0 2024-02-15T22:41:09.489 INFO:tasks.workunit.client.1.smithi082.stdout:2/48: getdents d6 0 2024-02-15T22:41:09.503 INFO:tasks.workunit.client.1.smithi082.stdout:6/108: dwrite d2/f1c [0,4194304] 0 2024-02-15T22:41:09.504 INFO:tasks.workunit.client.1.smithi082.stdout:6/109: mknod d2/c1f 0 2024-02-15T22:41:09.513 INFO:tasks.workunit.client.1.smithi082.stdout:2/49: dwrite f5 [0,4194304] 0 2024-02-15T22:41:09.517 INFO:tasks.workunit.client.1.smithi082.stdout:6/110: dread d2/f3 [0,4194304] 0 2024-02-15T22:41:09.520 INFO:tasks.workunit.client.1.smithi082.stdout:2/50: unlink f4 0 2024-02-15T22:41:09.522 INFO:tasks.workunit.client.1.smithi082.stdout:6/111: rename d2/d18/l1b to d2/l20 0 2024-02-15T22:41:09.522 INFO:tasks.workunit.client.1.smithi082.stdout:6/112: write d2/ff [320118,114407] 0 2024-02-15T22:41:09.522 INFO:tasks.workunit.client.1.smithi082.stdout:6/113: rename d2 to d2/d21 22 2024-02-15T22:41:09.522 INFO:tasks.workunit.client.1.smithi082.stdout:6/114: readlink d2/la 0 2024-02-15T22:41:09.523 INFO:tasks.workunit.client.1.smithi082.stdout:2/51: mkdir d6/d9 0 2024-02-15T22:41:09.524 INFO:tasks.workunit.client.1.smithi082.stdout:2/52: symlink d6/la 0 2024-02-15T22:41:09.525 INFO:tasks.workunit.client.1.smithi082.stdout:9/103: sync 2024-02-15T22:41:09.525 INFO:tasks.workunit.client.1.smithi082.stdout:9/104: write d8/d12/f14 [1029878,18915] 0 2024-02-15T22:41:09.526 INFO:tasks.workunit.client.1.smithi082.stdout:9/105: truncate f5 155110 0 2024-02-15T22:41:09.526 INFO:tasks.workunit.client.1.smithi082.stdout:9/106: chown d8/d12/c16 5938 1 2024-02-15T22:41:09.528 INFO:tasks.workunit.client.1.smithi082.stdout:9/107: link d8/f9 d8/f1c 0 2024-02-15T22:41:09.528 INFO:tasks.workunit.client.1.smithi082.stdout:9/108: fsync d8/f10 0 2024-02-15T22:41:09.529 INFO:tasks.workunit.client.1.smithi082.stdout:6/115: rename d2/l20 to d2/d18/l22 0 2024-02-15T22:41:09.529 INFO:tasks.workunit.client.1.smithi082.stdout:6/116: fdatasync d2/f3 0 2024-02-15T22:41:09.530 INFO:tasks.workunit.client.1.smithi082.stdout:9/109: creat d8/d12/f1d x:0 0 0 2024-02-15T22:41:09.531 INFO:tasks.workunit.client.1.smithi082.stdout:6/117: mkdir d2/d18/d23 0 2024-02-15T22:41:09.532 INFO:tasks.workunit.client.1.smithi082.stdout:2/53: dread f3 [0,4194304] 0 2024-02-15T22:41:09.532 INFO:tasks.workunit.client.1.smithi082.stdout:2/54: read - d6/f7 zero size 2024-02-15T22:41:09.532 INFO:tasks.workunit.client.1.smithi082.stdout:6/118: symlink d2/d18/d23/l24 0 2024-02-15T22:41:09.532 INFO:tasks.workunit.client.1.smithi082.stdout:6/119: dread - d2/f1e zero size 2024-02-15T22:41:09.534 INFO:tasks.workunit.client.1.smithi082.stdout:2/55: mknod d6/d9/cb 0 2024-02-15T22:41:09.534 INFO:tasks.workunit.client.1.smithi082.stdout:2/56: readlink d6/la 0 2024-02-15T22:41:09.534 INFO:tasks.workunit.client.1.smithi082.stdout:2/57: read - d6/f8 zero size 2024-02-15T22:41:09.564 INFO:tasks.workunit.client.1.smithi082.stdout:9/110: dwrite d8/f1a [0,4194304] 0 2024-02-15T22:41:09.564 INFO:tasks.workunit.client.1.smithi082.stdout:9/111: creat d8/d12/f1e x:0 0 0 2024-02-15T22:41:09.564 INFO:tasks.workunit.client.1.smithi082.stdout:9/112: creat d8/f1f x:0 0 0 2024-02-15T22:41:09.564 INFO:tasks.workunit.client.1.smithi082.stdout:6/120: dwrite d2/f3 [4194304,4194304] 0 2024-02-15T22:41:09.564 INFO:tasks.workunit.client.1.smithi082.stdout:2/58: dwrite d6/f7 [0,4194304] 0 2024-02-15T22:41:09.565 INFO:tasks.workunit.client.1.smithi082.stdout:6/121: dread d2/fd [0,4194304] 0 2024-02-15T22:41:09.566 INFO:tasks.workunit.client.1.smithi082.stdout:6/122: stat d2/c1d 0 2024-02-15T22:41:09.568 INFO:tasks.workunit.client.1.smithi082.stdout:9/113: rename d8/d12/l13 to d8/d12/l20 0 2024-02-15T22:41:09.568 INFO:tasks.workunit.client.1.smithi082.stdout:9/114: truncate d8/d12/f14 1986938 0 2024-02-15T22:41:09.568 INFO:tasks.workunit.client.1.smithi082.stdout:9/115: write d8/f1f [719191,64383] 0 2024-02-15T22:41:09.570 INFO:tasks.workunit.client.1.smithi082.stdout:2/59: mkdir d6/dc 0 2024-02-15T22:41:09.571 INFO:tasks.workunit.client.1.smithi082.stdout:9/116: rename c7 to d8/c21 0 2024-02-15T22:41:09.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/117: creat d8/f22 x:0 0 0 2024-02-15T22:41:09.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/118: fdatasync d8/f9 0 2024-02-15T22:41:09.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/119: rename d8 to d8/d12/d23 22 2024-02-15T22:41:09.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/120: write d8/f11 [1541163,29891] 0 2024-02-15T22:41:09.572 INFO:tasks.workunit.client.1.smithi082.stdout:2/60: getdents d6/d9 0 2024-02-15T22:41:09.574 INFO:tasks.workunit.client.1.smithi082.stdout:9/121: mkdir d8/d24 0 2024-02-15T22:41:09.574 INFO:tasks.workunit.client.1.smithi082.stdout:6/123: read d2/f1c [2237968,871] 0 2024-02-15T22:41:09.575 INFO:tasks.workunit.client.1.smithi082.stdout:2/61: mkdir d6/dc/dd 0 2024-02-15T22:41:09.578 INFO:tasks.workunit.client.1.smithi082.stdout:9/122: unlink d8/cc 0 2024-02-15T22:41:09.580 INFO:tasks.workunit.client.1.smithi082.stdout:6/124: rename d2/ff to d2/d18/d23/f25 0 2024-02-15T22:41:09.580 INFO:tasks.workunit.client.1.smithi082.stdout:2/62: creat d6/d9/fe x:0 0 0 2024-02-15T22:41:09.582 INFO:tasks.workunit.client.1.smithi082.stdout:9/123: link d8/f11 d8/d12/f25 0 2024-02-15T22:41:09.585 INFO:tasks.workunit.client.1.smithi082.stdout:6/125: rename d2/c13 to d2/c26 0 2024-02-15T22:41:09.597 INFO:tasks.workunit.client.1.smithi082.stdout:6/126: truncate d2/f3 6877832 0 2024-02-15T22:41:09.607 INFO:tasks.workunit.client.1.smithi082.stdout:2/63: dwrite f3 [0,4194304] 0 2024-02-15T22:41:09.607 INFO:tasks.workunit.client.1.smithi082.stdout:2/64: read - d6/f8 zero size 2024-02-15T22:41:09.608 INFO:tasks.workunit.client.1.smithi082.stdout:9/124: dwrite d8/f1f [0,4194304] 0 2024-02-15T22:41:09.611 INFO:tasks.workunit.client.1.smithi082.stdout:6/127: dread d2/d18/f19 [0,4194304] 0 2024-02-15T22:41:09.615 INFO:tasks.workunit.client.1.smithi082.stdout:9/125: dread d8/d12/f1b [0,4194304] 0 2024-02-15T22:41:09.615 INFO:tasks.workunit.client.1.smithi082.stdout:9/126: fdatasync d8/f1a 0 2024-02-15T22:41:09.616 INFO:tasks.workunit.client.1.smithi082.stdout:9/127: symlink d8/d12/l26 0 2024-02-15T22:41:09.617 INFO:tasks.workunit.client.1.smithi082.stdout:9/128: write d8/f19 [3977117,130629] 0 2024-02-15T22:41:09.617 INFO:tasks.workunit.client.1.smithi082.stdout:9/129: write d8/d12/f1d [303890,30938] 0 2024-02-15T22:41:09.618 INFO:tasks.workunit.client.1.smithi082.stdout:9/130: mkdir d8/d12/d27 0 2024-02-15T22:41:09.618 INFO:tasks.workunit.client.1.smithi082.stdout:9/131: fdatasync d8/f1f 0 2024-02-15T22:41:09.618 INFO:tasks.workunit.client.1.smithi082.stdout:2/65: dread d6/f7 [0,4194304] 0 2024-02-15T22:41:09.618 INFO:tasks.workunit.client.1.smithi082.stdout:2/66: chown d6/d9 456618 1 2024-02-15T22:41:09.619 INFO:tasks.workunit.client.1.smithi082.stdout:2/67: unlink f3 0 2024-02-15T22:41:09.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:09 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:09.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:09 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:09.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:09 smithi082 ceph-mon[37153]: Reconfiguring alertmanager.smithi033 (dependencies changed)... 2024-02-15T22:41:09.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:09 smithi082 ceph-mon[37153]: Reconfiguring daemon alertmanager.smithi033 on smithi033 2024-02-15T22:41:09.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:09 smithi082 ceph-mon[37153]: pgmap v17: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 157 MiB/s rd, 201 MiB/s wr, 1.08k op/s 2024-02-15T22:41:09.624 INFO:tasks.workunit.client.1.smithi082.stdout:6/128: write d2/f3 [6432598,39390] 0 2024-02-15T22:41:09.625 INFO:tasks.workunit.client.1.smithi082.stdout:9/132: write d8/d12/f1b [245891,72617] 0 2024-02-15T22:41:09.625 INFO:tasks.workunit.client.1.smithi082.stdout:6/129: truncate d2/f1c 1860123 0 2024-02-15T22:41:09.625 INFO:tasks.workunit.client.1.smithi082.stdout:9/133: write d8/d12/f1d [89011,97795] 0 2024-02-15T22:41:09.627 INFO:tasks.workunit.client.1.smithi082.stdout:6/130: link d2/l16 d2/d18/l27 0 2024-02-15T22:41:09.628 INFO:tasks.workunit.client.1.smithi082.stdout:6/131: symlink d2/d18/d23/l28 0 2024-02-15T22:41:09.628 INFO:tasks.workunit.client.1.smithi082.stdout:9/134: fsync d8/f1c 0 2024-02-15T22:41:09.630 INFO:tasks.workunit.client.1.smithi082.stdout:2/68: write d6/f7 [1599058,81116] 0 2024-02-15T22:41:09.630 INFO:tasks.workunit.client.1.smithi082.stdout:2/69: fsync d6/d9/fe 0 2024-02-15T22:41:09.630 INFO:tasks.workunit.client.1.smithi082.stdout:2/70: readlink d6/la 0 2024-02-15T22:41:09.630 INFO:tasks.workunit.client.1.smithi082.stdout:6/132: creat d2/d18/f29 x:0 0 0 2024-02-15T22:41:09.635 INFO:tasks.workunit.client.1.smithi082.stdout:6/133: mknod d2/c2a 0 2024-02-15T22:41:09.635 INFO:tasks.workunit.client.1.smithi082.stdout:6/134: write d2/f1e [583929,125829] 0 2024-02-15T22:41:09.637 INFO:tasks.workunit.client.1.smithi082.stdout:6/135: fdatasync d2/f3 0 2024-02-15T22:41:09.637 INFO:tasks.workunit.client.1.smithi082.stdout:6/136: stat d2 0 2024-02-15T22:41:09.639 INFO:tasks.workunit.client.1.smithi082.stdout:6/137: mknod d2/d18/c2b 0 2024-02-15T22:41:09.647 INFO:tasks.workunit.client.1.smithi082.stdout:2/71: dwrite d6/d9/fe [0,4194304] 0 2024-02-15T22:41:09.650 INFO:tasks.workunit.client.1.smithi082.stdout:9/135: truncate d8/f9 2553406 0 2024-02-15T22:41:09.651 INFO:tasks.workunit.client.1.smithi082.stdout:9/136: chown d8/l17 4772520 1 2024-02-15T22:41:09.651 INFO:tasks.workunit.client.1.smithi082.stdout:6/138: dread d2/f1e [0,4194304] 0 2024-02-15T22:41:09.653 INFO:tasks.workunit.client.1.smithi082.stdout:6/139: dread d2/f1e [0,4194304] 0 2024-02-15T22:41:09.653 INFO:tasks.workunit.client.1.smithi082.stdout:2/72: symlink d6/lf 0 2024-02-15T22:41:09.653 INFO:tasks.workunit.client.1.smithi082.stdout:2/73: truncate d6/f8 257073 0 2024-02-15T22:41:09.653 INFO:tasks.workunit.client.1.smithi082.stdout:2/74: stat d6/la 0 2024-02-15T22:41:09.654 INFO:tasks.workunit.client.1.smithi082.stdout:2/75: fdatasync d6/f8 0 2024-02-15T22:41:09.654 INFO:tasks.workunit.client.1.smithi082.stdout:2/76: dread d6/f8 [0,4194304] 0 2024-02-15T22:41:09.655 INFO:tasks.workunit.client.1.smithi082.stdout:9/137: write d8/f9 [40848,104129] 0 2024-02-15T22:41:09.655 INFO:tasks.workunit.client.1.smithi082.stdout:9/138: fsync d8/f1a 0 2024-02-15T22:41:09.655 INFO:tasks.workunit.client.1.smithi082.stdout:9/139: write d8/d12/f25 [2494972,53564] 0 2024-02-15T22:41:09.657 INFO:tasks.workunit.client.1.smithi082.stdout:6/140: dread d2/f3 [0,4194304] 0 2024-02-15T22:41:09.657 INFO:tasks.workunit.client.1.smithi082.stdout:6/141: write d2/f1c [751304,3236] 0 2024-02-15T22:41:09.658 INFO:tasks.workunit.client.1.smithi082.stdout:9/140: rename d8/d12/d27 to d8/d24/d28 0 2024-02-15T22:41:09.659 INFO:tasks.workunit.client.1.smithi082.stdout:9/141: fsync d8/f10 0 2024-02-15T22:41:09.659 INFO:tasks.workunit.client.1.smithi082.stdout:2/77: rmdir d6/d9 39 2024-02-15T22:41:09.661 INFO:tasks.workunit.client.1.smithi082.stdout:2/78: rmdir d6 39 2024-02-15T22:41:09.661 INFO:tasks.workunit.client.1.smithi082.stdout:8/66: sync 2024-02-15T22:41:09.661 INFO:tasks.workunit.client.1.smithi082.stdout:5/92: sync 2024-02-15T22:41:09.662 INFO:tasks.workunit.client.1.smithi082.stdout:2/79: creat d6/dc/f10 x:0 0 0 2024-02-15T22:41:09.662 INFO:tasks.workunit.client.1.smithi082.stdout:2/80: chown d6/la 127 1 2024-02-15T22:41:09.662 INFO:tasks.workunit.client.1.smithi082.stdout:2/81: write d6/dc/f10 [196540,35779] 0 2024-02-15T22:41:09.662 INFO:tasks.workunit.client.1.smithi082.stdout:2/82: chown d6/dc/dd 17033460 1 2024-02-15T22:41:09.663 INFO:tasks.workunit.client.1.smithi082.stdout:5/93: mknod d5/da/dc/c1f 0 2024-02-15T22:41:09.663 INFO:tasks.workunit.client.1.smithi082.stdout:5/94: write d5/da/f1c [736757,114567] 0 2024-02-15T22:41:09.664 INFO:tasks.workunit.client.1.smithi082.stdout:8/67: mknod d1/d7/c1a 0 2024-02-15T22:41:09.666 INFO:tasks.workunit.client.1.smithi082.stdout:8/68: creat d1/f1b x:0 0 0 2024-02-15T22:41:09.666 INFO:tasks.workunit.client.1.smithi082.stdout:8/69: creat d1/f1c x:0 0 0 2024-02-15T22:41:09.669 INFO:tasks.workunit.client.1.smithi082.stdout:8/70: mknod d1/d7/de/c1d 0 2024-02-15T22:41:09.679 INFO:tasks.workunit.client.1.smithi082.stdout:5/95: getdents d5/da/dc 0 2024-02-15T22:41:09.679 INFO:tasks.workunit.client.1.smithi082.stdout:8/71: dread d1/d7/de/ff [0,4194304] 0 2024-02-15T22:41:09.680 INFO:tasks.workunit.client.1.smithi082.stdout:6/142: dwrite d2/fd [0,4194304] 0 2024-02-15T22:41:09.680 INFO:tasks.workunit.client.1.smithi082.stdout:6/143: chown d2/l17 471 1 2024-02-15T22:41:09.680 INFO:tasks.workunit.client.1.smithi082.stdout:6/144: fdatasync d2/d18/f29 0 2024-02-15T22:41:09.680 INFO:tasks.workunit.client.1.smithi082.stdout:6/145: chown d2/d18/c2b 88 1 2024-02-15T22:41:09.680 INFO:tasks.workunit.client.1.smithi082.stdout:6/146: write d2/d18/d23/f25 [650563,59246] 0 2024-02-15T22:41:09.681 INFO:tasks.workunit.client.1.smithi082.stdout:5/96: creat d5/da/dc/f20 x:0 0 0 2024-02-15T22:41:09.681 INFO:tasks.workunit.client.1.smithi082.stdout:5/97: readlink d5/da/l1e 0 2024-02-15T22:41:09.681 INFO:tasks.workunit.client.1.smithi082.stdout:5/98: creat d5/da/f21 x:0 0 0 2024-02-15T22:41:09.682 INFO:tasks.workunit.client.1.smithi082.stdout:8/72: mkdir d1/d7/de/d1e 0 2024-02-15T22:41:09.686 INFO:tasks.workunit.client.1.smithi082.stdout:9/142: dwrite d8/f1c [0,4194304] 0 2024-02-15T22:41:09.686 INFO:tasks.workunit.client.1.smithi082.stdout:2/83: dwrite d6/d9/fe [4194304,4194304] 0 2024-02-15T22:41:09.687 INFO:tasks.workunit.client.1.smithi082.stdout:6/147: rename d2/d18/f29 to d2/d18/f2c 0 2024-02-15T22:41:09.690 INFO:tasks.workunit.client.1.smithi082.stdout:5/99: mkdir d5/da/d22 0 2024-02-15T22:41:09.690 INFO:tasks.workunit.client.1.smithi082.stdout:5/100: creat d5/da/f23 x:0 0 0 2024-02-15T22:41:09.690 INFO:tasks.workunit.client.1.smithi082.stdout:8/73: getdents d1/d7/d9 0 2024-02-15T22:41:09.690 INFO:tasks.workunit.client.1.smithi082.stdout:8/74: dread - d1/f1b zero size 2024-02-15T22:41:09.692 INFO:tasks.workunit.client.1.smithi082.stdout:2/84: mknod d6/dc/dd/c11 0 2024-02-15T22:41:09.695 INFO:tasks.workunit.client.1.smithi082.stdout:6/148: write d2/d18/d23/f25 [442220,67116] 0 2024-02-15T22:41:09.695 INFO:tasks.workunit.client.1.smithi082.stdout:6/149: stat d2/f1c 0 2024-02-15T22:41:09.695 INFO:tasks.workunit.client.1.smithi082.stdout:5/101: rename d5/da/f21 to d5/da/f24 0 2024-02-15T22:41:09.695 INFO:tasks.workunit.client.1.smithi082.stdout:5/102: dread - d5/da/d14/f17 zero size 2024-02-15T22:41:09.695 INFO:tasks.workunit.client.1.smithi082.stdout:5/103: write d5/da/f24 [552446,36885] 0 2024-02-15T22:41:09.696 INFO:tasks.workunit.client.1.smithi082.stdout:8/75: rename d1/d7/d9/la to d1/l1f 0 2024-02-15T22:41:09.697 INFO:tasks.workunit.client.1.smithi082.stdout:2/85: getdents d6 0 2024-02-15T22:41:09.698 INFO:tasks.workunit.client.1.smithi082.stdout:6/150: mknod d2/d18/d23/c2d 0 2024-02-15T22:41:09.699 INFO:tasks.workunit.client.1.smithi082.stdout:5/104: rename d5/da/d14/f17 to d5/da/f25 0 2024-02-15T22:41:09.701 INFO:tasks.workunit.client.1.smithi082.stdout:8/76: creat d1/d7/de/d1e/f20 x:0 0 0 2024-02-15T22:41:09.701 INFO:tasks.workunit.client.1.smithi082.stdout:8/77: creat d1/f21 x:0 0 0 2024-02-15T22:41:09.701 INFO:tasks.workunit.client.1.smithi082.stdout:9/143: dwrite d8/d12/f14 [0,4194304] 0 2024-02-15T22:41:09.702 INFO:tasks.workunit.client.1.smithi082.stdout:2/86: mkdir d6/dc/d12 0 2024-02-15T22:41:09.705 INFO:tasks.workunit.client.1.smithi082.stdout:6/151: link d2/lc d2/d18/l2e 0 2024-02-15T22:41:09.705 INFO:tasks.workunit.client.1.smithi082.stdout:6/152: dread - d2/d18/f2c zero size 2024-02-15T22:41:09.709 INFO:tasks.workunit.client.1.smithi082.stdout:8/78: creat d1/d7/f22 x:0 0 0 2024-02-15T22:41:09.709 INFO:tasks.workunit.client.1.smithi082.stdout:5/105: dread d5/da/d14/f18 [0,4194304] 0 2024-02-15T22:41:09.711 INFO:tasks.workunit.client.1.smithi082.stdout:1/105: sync 2024-02-15T22:41:09.711 INFO:tasks.workunit.client.1.smithi082.stdout:7/73: sync 2024-02-15T22:41:09.712 INFO:tasks.workunit.client.1.smithi082.stdout:7/74: fdatasync fe 0 2024-02-15T22:41:09.712 INFO:tasks.workunit.client.1.smithi082.stdout:2/87: link d6/dc/dd/c11 d6/d9/c13 0 2024-02-15T22:41:09.713 INFO:tasks.workunit.client.1.smithi082.stdout:2/88: write d6/dc/f10 [1215508,79857] 0 2024-02-15T22:41:09.713 INFO:tasks.workunit.client.1.smithi082.stdout:2/89: fsync f5 0 2024-02-15T22:41:09.713 INFO:tasks.workunit.client.1.smithi082.stdout:2/90: write f2 [2200337,38219] 0 2024-02-15T22:41:09.713 INFO:tasks.workunit.client.1.smithi082.stdout:8/79: rmdir d1/d7/d9 39 2024-02-15T22:41:09.714 INFO:tasks.workunit.client.1.smithi082.stdout:1/106: symlink d1/da/l2c 0 2024-02-15T22:41:09.715 INFO:tasks.workunit.client.1.smithi082.stdout:7/75: creat d12/d17/f18 x:0 0 0 2024-02-15T22:41:09.715 INFO:tasks.workunit.client.1.smithi082.stdout:7/76: creat d12/d17/f19 x:0 0 0 2024-02-15T22:41:09.715 INFO:tasks.workunit.client.1.smithi082.stdout:7/77: stat f10 0 2024-02-15T22:41:09.716 INFO:tasks.workunit.client.1.smithi082.stdout:1/107: rename d1/da/f29 to d1/da/d14/f2d 0 2024-02-15T22:41:09.741 INFO:tasks.workunit.client.1.smithi082.stdout:9/144: dwrite d8/f1c [0,4194304] 0 2024-02-15T22:41:09.741 INFO:tasks.workunit.client.1.smithi082.stdout:9/145: creat d8/d12/f29 x:0 0 0 2024-02-15T22:41:09.742 INFO:tasks.workunit.client.1.smithi082.stdout:6/153: dwrite d2/fd [0,4194304] 0 2024-02-15T22:41:09.742 INFO:tasks.workunit.client.1.smithi082.stdout:6/154: stat d2/f1c 0 2024-02-15T22:41:09.742 INFO:tasks.workunit.client.1.smithi082.stdout:6/155: readlink d2/l17 0 2024-02-15T22:41:09.742 INFO:tasks.workunit.client.1.smithi082.stdout:6/156: dread - d2/d18/f2c zero size 2024-02-15T22:41:09.745 INFO:tasks.workunit.client.1.smithi082.stdout:7/78: dwrite d12/f16 [0,4194304] 0 2024-02-15T22:41:09.747 INFO:tasks.workunit.client.1.smithi082.stdout:5/106: dread d5/da/f1c [0,4194304] 0 2024-02-15T22:41:09.747 INFO:tasks.workunit.client.1.smithi082.stdout:1/108: dwrite d1/da/d14/f28 [0,4194304] 0 2024-02-15T22:41:09.747 INFO:tasks.workunit.client.1.smithi082.stdout:8/80: dwrite d1/f14 [0,4194304] 0 2024-02-15T22:41:09.747 INFO:tasks.workunit.client.1.smithi082.stdout:1/109: creat d1/f2e x:0 0 0 2024-02-15T22:41:09.747 INFO:tasks.workunit.client.1.smithi082.stdout:8/81: creat d1/f23 x:0 0 0 2024-02-15T22:41:09.756 INFO:tasks.workunit.client.1.smithi082.stdout:6/157: dread d2/fd [0,4194304] 0 2024-02-15T22:41:09.759 INFO:tasks.workunit.client.1.smithi082.stdout:7/79: rename fc to d12/d17/f1a 0 2024-02-15T22:41:09.761 INFO:tasks.workunit.client.1.smithi082.stdout:2/91: dwrite d6/dc/f10 [0,4194304] 0 2024-02-15T22:41:09.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/82: mkdir d1/d7/d9/d24 0 2024-02-15T22:41:09.766 INFO:tasks.workunit.client.1.smithi082.stdout:8/83: chown d1/f5 122 1 2024-02-15T22:41:09.766 INFO:tasks.workunit.client.1.smithi082.stdout:8/84: write d1/f18 [1008154,27447] 0 2024-02-15T22:41:09.766 INFO:tasks.workunit.client.1.smithi082.stdout:8/85: read - d1/f1c zero size 2024-02-15T22:41:09.766 INFO:tasks.workunit.client.1.smithi082.stdout:9/146: rmdir d8 39 2024-02-15T22:41:09.766 INFO:tasks.workunit.client.1.smithi082.stdout:9/147: chown d8/d24 6617 1 2024-02-15T22:41:09.766 INFO:tasks.workunit.client.1.smithi082.stdout:9/148: write f5 [665255,84701] 0 2024-02-15T22:41:09.768 INFO:tasks.workunit.client.1.smithi082.stdout:7/80: unlink f8 0 2024-02-15T22:41:09.770 INFO:tasks.workunit.client.1.smithi082.stdout:2/92: creat d6/d9/f14 x:0 0 0 2024-02-15T22:41:09.771 INFO:tasks.workunit.client.1.smithi082.stdout:2/93: symlink d6/d9/l15 0 2024-02-15T22:41:09.773 INFO:tasks.workunit.client.1.smithi082.stdout:9/149: dread d8/d12/f25 [0,4194304] 0 2024-02-15T22:41:09.773 INFO:tasks.workunit.client.1.smithi082.stdout:9/150: stat d8/f9 0 2024-02-15T22:41:09.774 INFO:tasks.workunit.client.1.smithi082.stdout:1/110: dwrite d1/da/f1c [4194304,4194304] 0 2024-02-15T22:41:09.774 INFO:tasks.workunit.client.1.smithi082.stdout:9/151: truncate d8/d12/f14 1493255 0 2024-02-15T22:41:09.774 INFO:tasks.workunit.client.1.smithi082.stdout:9/152: getdents d8/d24/d28 0 2024-02-15T22:41:09.777 INFO:tasks.workunit.client.1.smithi082.stdout:1/111: truncate d1/f1b 241478 0 2024-02-15T22:41:09.779 INFO:tasks.workunit.client.1.smithi082.stdout:1/112: mkdir d1/da/d14/d18/d1f/d2f 0 2024-02-15T22:41:09.779 INFO:tasks.workunit.client.1.smithi082.stdout:1/113: stat d1/da/d14/d18 0 2024-02-15T22:41:09.779 INFO:tasks.workunit.client.1.smithi082.stdout:1/114: chown d1/da/d11/c25 902 1 2024-02-15T22:41:09.779 INFO:tasks.workunit.client.1.smithi082.stdout:1/115: rename d1/da/d14 to d1/da/d14/d30 22 2024-02-15T22:41:09.779 INFO:tasks.workunit.client.1.smithi082.stdout:6/158: dwrite d2/d18/f2c [0,4194304] 0 2024-02-15T22:41:09.782 INFO:tasks.workunit.client.1.smithi082.stdout:7/81: write fe [8694,114454] 0 2024-02-15T22:41:09.785 INFO:tasks.workunit.client.1.smithi082.stdout:9/153: dread d8/f9 [0,4194304] 0 2024-02-15T22:41:09.789 INFO:tasks.workunit.client.1.smithi082.stdout:6/159: symlink d2/d18/d23/l2f 0 2024-02-15T22:41:09.791 INFO:tasks.workunit.client.1.smithi082.stdout:2/94: dwrite f2 [0,4194304] 0 2024-02-15T22:41:09.792 INFO:tasks.workunit.client.1.smithi082.stdout:2/95: creat d6/dc/f16 x:0 0 0 2024-02-15T22:41:09.792 INFO:tasks.workunit.client.1.smithi082.stdout:2/96: creat d6/d9/f17 x:0 0 0 2024-02-15T22:41:09.793 INFO:tasks.workunit.client.1.smithi082.stdout:9/154: mknod d8/d12/c2a 0 2024-02-15T22:41:09.793 INFO:tasks.workunit.client.1.smithi082.stdout:9/155: chown f5 56289791 1 2024-02-15T22:41:09.796 INFO:tasks.workunit.client.1.smithi082.stdout:1/116: read d1/f22 [3220406,31766] 0 2024-02-15T22:41:09.798 INFO:tasks.workunit.client.1.smithi082.stdout:9/156: rename d8/d12/f25 to d8/f2b 0 2024-02-15T22:41:09.798 INFO:tasks.workunit.client.1.smithi082.stdout:9/157: readlink d8/l15 0 2024-02-15T22:41:09.799 INFO:tasks.workunit.client.1.smithi082.stdout:9/158: creat d8/f2c x:0 0 0 2024-02-15T22:41:09.799 INFO:tasks.workunit.client.1.smithi082.stdout:9/159: chown d8/l15 6638276 1 2024-02-15T22:41:09.802 INFO:tasks.workunit.client.1.smithi082.stdout:0/112: sync 2024-02-15T22:41:09.802 INFO:tasks.workunit.client.1.smithi082.stdout:4/57: sync 2024-02-15T22:41:09.802 INFO:tasks.workunit.client.1.smithi082.stdout:0/113: stat d3/fd 0 2024-02-15T22:41:09.802 INFO:tasks.workunit.client.1.smithi082.stdout:3/72: sync 2024-02-15T22:41:09.805 INFO:tasks.workunit.client.1.smithi082.stdout:1/117: write d1/da/d14/f2a [411858,42032] 0 2024-02-15T22:41:09.805 INFO:tasks.workunit.client.1.smithi082.stdout:0/114: mknod d3/d19/c2d 0 2024-02-15T22:41:09.805 INFO:tasks.workunit.client.1.smithi082.stdout:1/118: truncate d1/da/f24 131148 0 2024-02-15T22:41:09.805 INFO:tasks.workunit.client.1.smithi082.stdout:0/115: getdents d3/d19/d20/d26 0 2024-02-15T22:41:09.806 INFO:tasks.workunit.client.1.smithi082.stdout:4/58: mkdir d0/d16 0 2024-02-15T22:41:09.807 INFO:tasks.workunit.client.1.smithi082.stdout:4/59: write d0/dc/dd/ff [11563,38453] 0 2024-02-15T22:41:09.807 INFO:tasks.workunit.client.1.smithi082.stdout:4/60: write d0/dc/dd/ff [713626,74806] 0 2024-02-15T22:41:09.808 INFO:tasks.workunit.client.1.smithi082.stdout:1/119: mknod d1/da/d11/c31 0 2024-02-15T22:41:09.808 INFO:tasks.workunit.client.1.smithi082.stdout:4/61: rmdir d0/d8 39 2024-02-15T22:41:09.809 INFO:tasks.workunit.client.1.smithi082.stdout:4/62: truncate d0/f2 3015248 0 2024-02-15T22:41:09.811 INFO:tasks.workunit.client.1.smithi082.stdout:1/120: dread d1/f1b [0,4194304] 0 2024-02-15T22:41:09.811 INFO:tasks.workunit.client.1.smithi082.stdout:1/121: write d1/f22 [2840290,2551] 0 2024-02-15T22:41:09.812 INFO:tasks.workunit.client.1.smithi082.stdout:3/73: read d0/d19/f7 [1120278,108603] 0 2024-02-15T22:41:09.812 INFO:tasks.workunit.client.1.smithi082.stdout:3/74: chown d0/d19/fb 483606 1 2024-02-15T22:41:09.812 INFO:tasks.workunit.client.1.smithi082.stdout:1/122: rmdir d1/da/d14/d18/d1f 39 2024-02-15T22:41:09.813 INFO:tasks.workunit.client.1.smithi082.stdout:3/75: creat d0/d19/f1a x:0 0 0 2024-02-15T22:41:09.813 INFO:tasks.workunit.client.1.smithi082.stdout:1/123: dread d1/da/d11/f16 [0,4194304] 0 2024-02-15T22:41:09.815 INFO:tasks.workunit.client.1.smithi082.stdout:1/124: rmdir d1/da/d14 39 2024-02-15T22:41:09.820 INFO:tasks.workunit.client.1.smithi082.stdout:7/82: dwrite f3 [4194304,4194304] 0 2024-02-15T22:41:09.820 INFO:tasks.workunit.client.1.smithi082.stdout:0/116: write d3/d19/f21 [2134731,28617] 0 2024-02-15T22:41:09.820 INFO:tasks.workunit.client.1.smithi082.stdout:0/117: fsync d3/f8 0 2024-02-15T22:41:09.820 INFO:tasks.workunit.client.1.smithi082.stdout:0/118: creat d3/d19/f2e x:0 0 0 2024-02-15T22:41:09.820 INFO:tasks.workunit.client.1.smithi082.stdout:6/160: dwrite d2/d18/d23/f25 [0,4194304] 0 2024-02-15T22:41:09.820 INFO:tasks.workunit.client.1.smithi082.stdout:6/161: readlink d2/d18/d23/l28 0 2024-02-15T22:41:09.822 INFO:tasks.workunit.client.1.smithi082.stdout:0/119: creat d3/f2f x:0 0 0 2024-02-15T22:41:09.823 INFO:tasks.workunit.client.1.smithi082.stdout:2/97: dwrite d6/dc/f10 [0,4194304] 0 2024-02-15T22:41:09.825 INFO:tasks.workunit.client.1.smithi082.stdout:6/162: mkdir d2/d30 0 2024-02-15T22:41:09.825 INFO:tasks.workunit.client.1.smithi082.stdout:6/163: read d2/f1c [952061,35285] 0 2024-02-15T22:41:09.825 INFO:tasks.workunit.client.1.smithi082.stdout:3/76: read d0/d19/fb [2286789,100421] 0 2024-02-15T22:41:09.826 INFO:tasks.workunit.client.1.smithi082.stdout:7/83: link l5 d12/l1b 0 2024-02-15T22:41:09.830 INFO:tasks.workunit.client.1.smithi082.stdout:2/98: mkdir d6/d18 0 2024-02-15T22:41:09.831 INFO:tasks.workunit.client.1.smithi082.stdout:2/99: dread d6/f8 [0,4194304] 0 2024-02-15T22:41:09.831 INFO:tasks.workunit.client.1.smithi082.stdout:2/100: dread - d6/d9/f14 zero size 2024-02-15T22:41:09.831 INFO:tasks.workunit.client.1.smithi082.stdout:2/101: chown f5 201 1 2024-02-15T22:41:09.831 INFO:tasks.workunit.client.1.smithi082.stdout:6/164: mkdir d2/d31 0 2024-02-15T22:41:09.831 INFO:tasks.workunit.client.1.smithi082.stdout:6/165: fsync d2/f1e 0 2024-02-15T22:41:09.831 INFO:tasks.workunit.client.1.smithi082.stdout:6/166: fdatasync d2/d18/d23/f25 0 2024-02-15T22:41:09.832 INFO:tasks.workunit.client.1.smithi082.stdout:3/77: mknod d0/d19/d14/c1b 0 2024-02-15T22:41:09.833 INFO:tasks.workunit.client.1.smithi082.stdout:7/84: mknod d12/c1c 0 2024-02-15T22:41:09.835 INFO:tasks.workunit.client.1.smithi082.stdout:0/120: rename d3/f2b to d3/f30 0 2024-02-15T22:41:09.835 INFO:tasks.workunit.client.1.smithi082.stdout:0/121: dread - d3/f30 zero size 2024-02-15T22:41:09.835 INFO:tasks.workunit.client.1.smithi082.stdout:0/122: dread d3/d16/f1a [0,4194304] 0 2024-02-15T22:41:09.837 INFO:tasks.workunit.client.1.smithi082.stdout:6/167: mknod d2/d18/d23/c32 0 2024-02-15T22:41:09.839 INFO:tasks.workunit.client.1.smithi082.stdout:3/78: creat d0/f1c x:0 0 0 2024-02-15T22:41:09.842 INFO:tasks.workunit.client.1.smithi082.stdout:0/123: creat d3/d19/d20/d26/f31 x:0 0 0 2024-02-15T22:41:09.847 INFO:tasks.workunit.client.1.smithi082.stdout:2/102: getdents d6 0 2024-02-15T22:41:09.849 INFO:tasks.workunit.client.1.smithi082.stdout:2/103: rename d6/d9/f14 to d6/d9/f19 0 2024-02-15T22:41:09.849 INFO:tasks.workunit.client.1.smithi082.stdout:2/104: chown d6/d9/f17 107 1 2024-02-15T22:41:09.850 INFO:tasks.workunit.client.1.smithi082.stdout:7/85: getdents d12 0 2024-02-15T22:41:09.851 INFO:tasks.workunit.client.1.smithi082.stdout:7/86: creat d12/d17/f1d x:0 0 0 2024-02-15T22:41:09.851 INFO:tasks.workunit.client.1.smithi082.stdout:7/87: fdatasync fb 0 2024-02-15T22:41:09.853 INFO:tasks.workunit.client.1.smithi082.stdout:7/88: mknod d12/d17/c1e 0 2024-02-15T22:41:09.853 INFO:tasks.workunit.client.1.smithi082.stdout:7/89: write d12/f16 [5066485,127698] 0 2024-02-15T22:41:09.854 INFO:tasks.workunit.client.1.smithi082.stdout:7/90: truncate fb 2546821 0 2024-02-15T22:41:09.868 INFO:tasks.workunit.client.1.smithi082.stdout:4/63: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:41:09.868 INFO:tasks.workunit.client.1.smithi082.stdout:3/79: getdents d0 0 2024-02-15T22:41:09.869 INFO:tasks.workunit.client.1.smithi082.stdout:4/64: symlink d0/d16/l17 0 2024-02-15T22:41:09.879 INFO:tasks.workunit.client.1.smithi082.stdout:0/124: dwrite d3/f11 [0,4194304] 0 2024-02-15T22:41:09.879 INFO:tasks.workunit.client.1.smithi082.stdout:6/168: dwrite d2/fd [0,4194304] 0 2024-02-15T22:41:09.880 INFO:tasks.workunit.client.1.smithi082.stdout:2/105: dwrite d6/f8 [0,4194304] 0 2024-02-15T22:41:09.880 INFO:tasks.workunit.client.1.smithi082.stdout:7/91: dwrite d12/d17/f1d [0,4194304] 0 2024-02-15T22:41:09.881 INFO:tasks.workunit.client.1.smithi082.stdout:0/125: truncate d3/f13 2034543 0 2024-02-15T22:41:09.882 INFO:tasks.workunit.client.1.smithi082.stdout:6/169: truncate d2/f3 2985874 0 2024-02-15T22:41:09.885 INFO:tasks.workunit.client.1.smithi082.stdout:2/106: rmdir d6/dc/dd 39 2024-02-15T22:41:09.885 INFO:tasks.workunit.client.1.smithi082.stdout:2/107: truncate d6/dc/f16 205324 0 2024-02-15T22:41:09.886 INFO:tasks.workunit.client.1.smithi082.stdout:7/92: rename fe to d12/d17/f1f 0 2024-02-15T22:41:09.887 INFO:tasks.workunit.client.1.smithi082.stdout:6/170: creat d2/d30/f33 x:0 0 0 2024-02-15T22:41:09.887 INFO:tasks.workunit.client.1.smithi082.stdout:6/171: creat d2/d18/f34 x:0 0 0 2024-02-15T22:41:09.888 INFO:tasks.workunit.client.1.smithi082.stdout:2/108: truncate d6/dc/f10 2605189 0 2024-02-15T22:41:09.889 INFO:tasks.workunit.client.1.smithi082.stdout:2/109: creat d6/dc/dd/f1a x:0 0 0 2024-02-15T22:41:09.890 INFO:tasks.workunit.client.1.smithi082.stdout:2/110: dread d6/dc/f16 [0,4194304] 0 2024-02-15T22:41:09.896 INFO:tasks.workunit.client.1.smithi082.stdout:4/65: dwrite d0/f9 [0,4194304] 0 2024-02-15T22:41:09.896 INFO:tasks.workunit.client.1.smithi082.stdout:4/66: fsync d0/dc/dd/ff 0 2024-02-15T22:41:09.896 INFO:tasks.workunit.client.1.smithi082.stdout:3/80: dwrite d0/d19/fe [0,4194304] 0 2024-02-15T22:41:09.898 INFO:tasks.workunit.client.1.smithi082.stdout:3/81: symlink d0/l1d 0 2024-02-15T22:41:09.899 INFO:tasks.workunit.client.1.smithi082.stdout:3/82: getdents d0/d16 0 2024-02-15T22:41:09.900 INFO:tasks.workunit.client.1.smithi082.stdout:6/172: write d2/d18/f2c [1474268,9059] 0 2024-02-15T22:41:09.900 INFO:tasks.workunit.client.1.smithi082.stdout:6/173: truncate d2/d18/f34 141487 0 2024-02-15T22:41:09.900 INFO:tasks.workunit.client.1.smithi082.stdout:3/83: symlink d0/d19/d14/l1e 0 2024-02-15T22:41:09.901 INFO:tasks.workunit.client.1.smithi082.stdout:2/111: dread d6/f8 [0,4194304] 0 2024-02-15T22:41:09.906 INFO:tasks.workunit.client.1.smithi082.stdout:4/67: dread d0/f1 [0,4194304] 0 2024-02-15T22:41:09.906 INFO:tasks.workunit.client.1.smithi082.stdout:4/68: truncate d0/f2 4345271 0 2024-02-15T22:41:09.908 INFO:tasks.workunit.client.1.smithi082.stdout:4/69: rmdir d0/d8 39 2024-02-15T22:41:09.908 INFO:tasks.workunit.client.1.smithi082.stdout:4/70: truncate d0/dc/dd/ff 1273259 0 2024-02-15T22:41:09.927 INFO:tasks.workunit.client.1.smithi082.stdout:6/174: dwrite d2/fd [0,4194304] 0 2024-02-15T22:41:09.929 INFO:tasks.workunit.client.1.smithi082.stdout:6/175: creat d2/d18/d23/f35 x:0 0 0 2024-02-15T22:41:09.929 INFO:tasks.workunit.client.1.smithi082.stdout:6/176: truncate d2/d30/f33 156432 0 2024-02-15T22:41:09.930 INFO:tasks.workunit.client.1.smithi082.stdout:6/177: rmdir d2/d31 0 2024-02-15T22:41:09.931 INFO:tasks.workunit.client.1.smithi082.stdout:6/178: chown d2/d18/f2c 213897353 1 2024-02-15T22:41:09.931 INFO:tasks.workunit.client.1.smithi082.stdout:6/179: chown d2/c1f 3542636 1 2024-02-15T22:41:09.931 INFO:tasks.workunit.client.1.smithi082.stdout:2/112: dwrite f5 [0,4194304] 0 2024-02-15T22:41:09.931 INFO:tasks.workunit.client.1.smithi082.stdout:4/71: dwrite d0/fb [0,4194304] 0 2024-02-15T22:41:09.931 INFO:tasks.workunit.client.1.smithi082.stdout:2/113: truncate f2 2239528 0 2024-02-15T22:41:09.933 INFO:tasks.workunit.client.1.smithi082.stdout:6/180: getdents d2/d18 0 2024-02-15T22:41:09.936 INFO:tasks.workunit.client.1.smithi082.stdout:2/114: rename d6/la to d6/dc/l1b 0 2024-02-15T22:41:09.937 INFO:tasks.workunit.client.1.smithi082.stdout:6/181: symlink d2/d30/l36 0 2024-02-15T22:41:09.967 INFO:tasks.workunit.client.1.smithi082.stdout:6/182: dwrite d2/d18/d23/f35 [0,4194304] 0 2024-02-15T22:41:09.967 INFO:tasks.workunit.client.1.smithi082.stdout:6/183: chown d2/d18/f19 1 1 2024-02-15T22:41:09.967 INFO:tasks.workunit.client.1.smithi082.stdout:2/115: dwrite d6/d9/f17 [0,4194304] 0 2024-02-15T22:41:09.967 INFO:tasks.workunit.client.1.smithi082.stdout:2/116: dread - d6/d9/f19 zero size 2024-02-15T22:41:09.967 INFO:tasks.workunit.client.1.smithi082.stdout:2/117: chown d6 85701 1 2024-02-15T22:41:09.979 INFO:tasks.workunit.client.1.smithi082.stdout:6/184: mknod d2/d18/d23/c37 0 2024-02-15T22:41:09.983 INFO:tasks.workunit.client.1.smithi082.stdout:2/118: mknod d6/dc/c1c 0 2024-02-15T22:41:09.986 INFO:tasks.workunit.client.1.smithi082.stdout:4/72: truncate d0/f1 1492631 0 2024-02-15T22:41:09.990 INFO:tasks.workunit.client.1.smithi082.stdout:6/185: symlink d2/d30/l38 0 2024-02-15T22:41:09.990 INFO:tasks.workunit.client.1.smithi082.stdout:6/186: chown d2/d18/d23/f35 1672 1 2024-02-15T22:41:09.990 INFO:tasks.workunit.client.1.smithi082.stdout:6/187: fdatasync d2/f3 0 2024-02-15T22:41:09.991 INFO:tasks.workunit.client.1.smithi082.stdout:2/119: mkdir d6/dc/dd/d1d 0 2024-02-15T22:41:09.991 INFO:tasks.workunit.client.1.smithi082.stdout:2/120: fdatasync d6/dc/f16 0 2024-02-15T22:41:09.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/121: unlink d6/d9/c13 0 2024-02-15T22:41:09.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/122: creat d6/d9/f1e x:0 0 0 2024-02-15T22:41:09.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/123: truncate d6/d9/f19 208989 0 2024-02-15T22:41:09.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/124: readlink d6/lf 0 2024-02-15T22:41:09.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/125: write d6/d9/f17 [4890703,94788] 0 2024-02-15T22:41:09.994 INFO:tasks.workunit.client.1.smithi082.stdout:6/188: write d2/f1a [2384726,117682] 0 2024-02-15T22:41:09.994 INFO:tasks.workunit.client.1.smithi082.stdout:2/126: creat d6/dc/dd/d1d/f1f x:0 0 0 2024-02-15T22:41:09.999 INFO:tasks.workunit.client.1.smithi082.stdout:6/189: rmdir d2/d30 39 2024-02-15T22:41:09.999 INFO:tasks.workunit.client.1.smithi082.stdout:6/190: chown d2/f3 170 1 2024-02-15T22:41:09.999 INFO:tasks.workunit.client.1.smithi082.stdout:2/127: dread f2 [0,4194304] 0 2024-02-15T22:41:10.000 INFO:tasks.workunit.client.1.smithi082.stdout:6/191: mkdir d2/d18/d39 0 2024-02-15T22:41:10.001 INFO:tasks.workunit.client.1.smithi082.stdout:2/128: dread f2 [0,4194304] 0 2024-02-15T22:41:10.002 INFO:tasks.workunit.client.1.smithi082.stdout:6/192: symlink d2/l3a 0 2024-02-15T22:41:10.004 INFO:tasks.workunit.client.1.smithi082.stdout:6/193: mkdir d2/d30/d3b 0 2024-02-15T22:41:10.004 INFO:tasks.workunit.client.1.smithi082.stdout:6/194: stat d2/f1e 0 2024-02-15T22:41:10.004 INFO:tasks.workunit.client.1.smithi082.stdout:6/195: readlink d2/d18/l27 0 2024-02-15T22:41:10.005 INFO:tasks.workunit.client.1.smithi082.stdout:6/196: mkdir d2/d18/d23/d3c 0 2024-02-15T22:41:10.006 INFO:tasks.workunit.client.1.smithi082.stdout:6/197: chown d2/d18/d23/f35 77571720 1 2024-02-15T22:41:10.006 INFO:tasks.workunit.client.1.smithi082.stdout:6/198: write d2/d30/f33 [453396,20695] 0 2024-02-15T22:41:10.009 INFO:tasks.workunit.client.1.smithi082.stdout:2/129: dread d6/f7 [0,4194304] 0 2024-02-15T22:41:10.010 INFO:tasks.workunit.client.1.smithi082.stdout:2/130: rename d6/dc/dd/c11 to d6/dc/dd/c20 0 2024-02-15T22:41:10.011 INFO:tasks.workunit.client.1.smithi082.stdout:2/131: mkdir d6/dc/dd/d21 0 2024-02-15T22:41:10.013 INFO:tasks.workunit.client.1.smithi082.stdout:4/73: dwrite d0/f2 [0,4194304] 0 2024-02-15T22:41:10.013 INFO:tasks.workunit.client.1.smithi082.stdout:4/74: getdents d0/d8 0 2024-02-15T22:41:10.013 INFO:tasks.workunit.client.1.smithi082.stdout:4/75: readlink d0/l7 0 2024-02-15T22:41:10.014 INFO:tasks.workunit.client.1.smithi082.stdout:2/132: getdents d6/dc/dd/d1d 0 2024-02-15T22:41:10.014 INFO:tasks.workunit.client.1.smithi082.stdout:2/133: write d6/f7 [3588366,109015] 0 2024-02-15T22:41:10.014 INFO:tasks.workunit.client.1.smithi082.stdout:2/134: chown d6/lf 241 1 2024-02-15T22:41:10.017 INFO:tasks.workunit.client.1.smithi082.stdout:2/135: creat d6/d18/f22 x:0 0 0 2024-02-15T22:41:10.017 INFO:tasks.workunit.client.1.smithi082.stdout:6/199: write d2/d18/d23/f25 [1099870,70069] 0 2024-02-15T22:41:10.018 INFO:tasks.workunit.client.1.smithi082.stdout:2/136: mkdir d6/dc/d12/d23 0 2024-02-15T22:41:10.019 INFO:tasks.workunit.client.1.smithi082.stdout:6/200: rename d2/d18/d23/f25 to d2/d18/d23/d3c/f3d 0 2024-02-15T22:41:10.021 INFO:tasks.workunit.client.1.smithi082.stdout:2/137: mkdir d6/dc/dd/d24 0 2024-02-15T22:41:10.021 INFO:tasks.workunit.client.1.smithi082.stdout:2/138: truncate f2 2261533 0 2024-02-15T22:41:10.022 INFO:tasks.workunit.client.1.smithi082.stdout:4/76: write d0/f9 [1600654,48359] 0 2024-02-15T22:41:10.023 INFO:tasks.workunit.client.1.smithi082.stdout:8/86: sync 2024-02-15T22:41:10.023 INFO:tasks.workunit.client.1.smithi082.stdout:8/87: fsync d1/f14 0 2024-02-15T22:41:10.023 INFO:tasks.workunit.client.1.smithi082.stdout:5/107: sync 2024-02-15T22:41:10.023 INFO:tasks.workunit.client.1.smithi082.stdout:5/108: dread - d5/da/dc/f20 zero size 2024-02-15T22:41:10.023 INFO:tasks.workunit.client.1.smithi082.stdout:5/109: creat d5/da/f26 x:0 0 0 2024-02-15T22:41:10.024 INFO:tasks.workunit.client.1.smithi082.stdout:9/160: sync 2024-02-15T22:41:10.024 INFO:tasks.workunit.client.1.smithi082.stdout:1/125: sync 2024-02-15T22:41:10.024 INFO:tasks.workunit.client.1.smithi082.stdout:6/201: link d2/c26 d2/d30/d3b/c3e 0 2024-02-15T22:41:10.024 INFO:tasks.workunit.client.1.smithi082.stdout:2/139: dread f2 [0,4194304] 0 2024-02-15T22:41:10.024 INFO:tasks.workunit.client.1.smithi082.stdout:2/140: chown d6 114 1 2024-02-15T22:41:10.028 INFO:tasks.workunit.client.1.smithi082.stdout:8/88: mkdir d1/d7/d25 0 2024-02-15T22:41:10.028 INFO:tasks.workunit.client.1.smithi082.stdout:4/77: truncate d0/fb 2829146 0 2024-02-15T22:41:10.028 INFO:tasks.workunit.client.1.smithi082.stdout:6/202: write d2/d30/f33 [207765,51584] 0 2024-02-15T22:41:10.031 INFO:tasks.workunit.client.1.smithi082.stdout:5/110: read d5/da/dc/f15 [571120,35445] 0 2024-02-15T22:41:10.032 INFO:tasks.workunit.client.1.smithi082.stdout:2/141: mknod d6/dc/d12/c25 0 2024-02-15T22:41:10.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/203: read d2/d18/f19 [2372427,25695] 0 2024-02-15T22:41:10.033 INFO:tasks.workunit.client.1.smithi082.stdout:6/204: write d2/d18/f19 [515101,99583] 0 2024-02-15T22:41:10.033 INFO:tasks.workunit.client.1.smithi082.stdout:6/205: readlink d2/d18/d23/l24 0 2024-02-15T22:41:10.037 INFO:tasks.workunit.client.1.smithi082.stdout:8/89: symlink d1/d7/l26 0 2024-02-15T22:41:10.037 INFO:tasks.workunit.client.1.smithi082.stdout:8/90: creat d1/d7/de/d1e/f27 x:0 0 0 2024-02-15T22:41:10.037 INFO:tasks.workunit.client.1.smithi082.stdout:8/91: write d1/f1c [87475,13121] 0 2024-02-15T22:41:10.037 INFO:tasks.workunit.client.1.smithi082.stdout:8/92: dread - d1/f21 zero size 2024-02-15T22:41:10.038 INFO:tasks.workunit.client.1.smithi082.stdout:4/78: write d0/f2 [2585976,40773] 0 2024-02-15T22:41:10.038 INFO:tasks.workunit.client.1.smithi082.stdout:9/161: dwrite d8/f9 [0,4194304] 0 2024-02-15T22:41:10.038 INFO:tasks.workunit.client.1.smithi082.stdout:9/162: write f5 [722117,40039] 0 2024-02-15T22:41:10.039 INFO:tasks.workunit.client.1.smithi082.stdout:5/111: truncate d5/da/d14/f18 4220398 0 2024-02-15T22:41:10.039 INFO:tasks.workunit.client.1.smithi082.stdout:5/112: chown d5/da/f25 62684590 1 2024-02-15T22:41:10.040 INFO:tasks.workunit.client.1.smithi082.stdout:6/206: mknod d2/d30/c3f 0 2024-02-15T22:41:10.043 INFO:tasks.workunit.client.1.smithi082.stdout:2/142: write d6/d9/f17 [1787982,36132] 0 2024-02-15T22:41:10.044 INFO:tasks.workunit.client.1.smithi082.stdout:8/93: mknod d1/c28 0 2024-02-15T22:41:10.044 INFO:tasks.workunit.client.1.smithi082.stdout:8/94: dread - d1/d7/f22 zero size 2024-02-15T22:41:10.046 INFO:tasks.workunit.client.1.smithi082.stdout:4/79: creat d0/dc/dd/f18 x:0 0 0 2024-02-15T22:41:10.050 INFO:tasks.workunit.client.1.smithi082.stdout:6/207: getdents d2/d30/d3b 0 2024-02-15T22:41:10.050 INFO:tasks.workunit.client.1.smithi082.stdout:2/143: write d6/f8 [2983299,18426] 0 2024-02-15T22:41:10.050 INFO:tasks.workunit.client.1.smithi082.stdout:2/144: truncate d6/dc/f16 451598 0 2024-02-15T22:41:10.051 INFO:tasks.workunit.client.1.smithi082.stdout:2/145: fsync d6/dc/f10 0 2024-02-15T22:41:10.051 INFO:tasks.workunit.client.1.smithi082.stdout:8/95: rmdir d1/d7/de 39 2024-02-15T22:41:10.052 INFO:tasks.workunit.client.1.smithi082.stdout:4/80: unlink d0/c5 0 2024-02-15T22:41:10.053 INFO:tasks.workunit.client.1.smithi082.stdout:5/113: symlink d5/da/dc/l27 0 2024-02-15T22:41:10.053 INFO:tasks.workunit.client.1.smithi082.stdout:6/208: rmdir d2/d30/d3b 39 2024-02-15T22:41:10.053 INFO:tasks.workunit.client.1.smithi082.stdout:6/209: readlink d2/d30/l36 0 2024-02-15T22:41:10.054 INFO:tasks.workunit.client.1.smithi082.stdout:2/146: creat d6/f26 x:0 0 0 2024-02-15T22:41:10.055 INFO:tasks.workunit.client.1.smithi082.stdout:8/96: mknod d1/d7/de/d1e/c29 0 2024-02-15T22:41:10.056 INFO:tasks.workunit.client.1.smithi082.stdout:4/81: symlink d0/d16/l19 0 2024-02-15T22:41:10.059 INFO:tasks.workunit.client.1.smithi082.stdout:6/210: rename d2/d18/d23/c2d to d2/d18/d23/c40 0 2024-02-15T22:41:10.064 INFO:tasks.workunit.client.1.smithi082.stdout:9/163: dwrite d8/d12/f1e [0,4194304] 0 2024-02-15T22:41:10.066 INFO:tasks.workunit.client.1.smithi082.stdout:6/211: unlink d2/c1f 0 2024-02-15T22:41:10.074 INFO:tasks.workunit.client.1.smithi082.stdout:4/82: rename d0/dc to d0/d1a 0 2024-02-15T22:41:10.075 INFO:tasks.workunit.client.1.smithi082.stdout:9/164: dread d8/f1a [0,4194304] 0 2024-02-15T22:41:10.075 INFO:tasks.workunit.client.1.smithi082.stdout:9/165: chown d8/d12/f14 25 1 2024-02-15T22:41:10.076 INFO:tasks.workunit.client.1.smithi082.stdout:4/83: rmdir d0/d1a/dd 39 2024-02-15T22:41:10.076 INFO:tasks.workunit.client.1.smithi082.stdout:6/212: read d2/d18/d23/f35 [2008939,59318] 0 2024-02-15T22:41:10.078 INFO:tasks.workunit.client.1.smithi082.stdout:9/166: dread d8/f2b [0,4194304] 0 2024-02-15T22:41:10.078 INFO:tasks.workunit.client.1.smithi082.stdout:9/167: dread - d8/f2c zero size 2024-02-15T22:41:10.078 INFO:tasks.workunit.client.1.smithi082.stdout:9/168: truncate d8/d12/f29 186014 0 2024-02-15T22:41:10.078 INFO:tasks.workunit.client.1.smithi082.stdout:5/114: dwrite d5/da/dc/ff [0,4194304] 0 2024-02-15T22:41:10.078 INFO:tasks.workunit.client.1.smithi082.stdout:6/213: mknod d2/d30/c41 0 2024-02-15T22:41:10.079 INFO:tasks.workunit.client.1.smithi082.stdout:4/84: getdents d0/d16 0 2024-02-15T22:41:10.080 INFO:tasks.workunit.client.1.smithi082.stdout:5/115: mknod d5/da/d22/c28 0 2024-02-15T22:41:10.083 INFO:tasks.workunit.client.1.smithi082.stdout:6/214: creat d2/d30/d3b/f42 x:0 0 0 2024-02-15T22:41:10.083 INFO:tasks.workunit.client.1.smithi082.stdout:6/215: write d2/d18/f34 [203683,23230] 0 2024-02-15T22:41:10.086 INFO:tasks.workunit.client.1.smithi082.stdout:4/85: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:10.086 INFO:tasks.workunit.client.1.smithi082.stdout:6/216: mknod d2/d18/d39/c43 0 2024-02-15T22:41:10.086 INFO:tasks.workunit.client.1.smithi082.stdout:6/217: truncate d2/d18/f34 380058 0 2024-02-15T22:41:10.088 INFO:tasks.workunit.client.1.smithi082.stdout:6/218: creat d2/d18/f44 x:0 0 0 2024-02-15T22:41:10.090 INFO:tasks.workunit.client.1.smithi082.stdout:6/219: truncate d2/d18/d23/f35 3747761 0 2024-02-15T22:41:10.091 INFO:tasks.workunit.client.1.smithi082.stdout:6/220: mkdir d2/d45 0 2024-02-15T22:41:10.094 INFO:tasks.workunit.client.1.smithi082.stdout:5/116: dwrite d5/da/f23 [0,4194304] 0 2024-02-15T22:41:10.095 INFO:tasks.workunit.client.1.smithi082.stdout:4/86: rename d0/d1a to d0/d8/d1b 0 2024-02-15T22:41:10.095 INFO:tasks.workunit.client.1.smithi082.stdout:4/87: dread - d0/d8/fa zero size 2024-02-15T22:41:10.095 INFO:tasks.workunit.client.1.smithi082.stdout:4/88: write d0/d8/fa [1012848,43949] 0 2024-02-15T22:41:10.095 INFO:tasks.workunit.client.1.smithi082.stdout:0/126: sync 2024-02-15T22:41:10.096 INFO:tasks.workunit.client.1.smithi082.stdout:0/127: chown d3/d19/d20/d26/f31 198 1 2024-02-15T22:41:10.098 INFO:tasks.workunit.client.1.smithi082.stdout:0/128: mknod d3/d16/c32 0 2024-02-15T22:41:10.099 INFO:tasks.workunit.client.1.smithi082.stdout:0/129: mknod d3/d19/d1c/c33 0 2024-02-15T22:41:10.099 INFO:tasks.workunit.client.1.smithi082.stdout:0/130: chown d3/d19/f29 63713528 1 2024-02-15T22:41:10.099 INFO:tasks.workunit.client.1.smithi082.stdout:0/131: stat d3/c14 0 2024-02-15T22:41:10.100 INFO:tasks.workunit.client.1.smithi082.stdout:0/132: unlink d3/f8 0 2024-02-15T22:41:10.103 INFO:tasks.workunit.client.1.smithi082.stdout:0/133: link d3/fb d3/f34 0 2024-02-15T22:41:10.106 INFO:tasks.workunit.client.1.smithi082.stdout:0/134: rename d3/l5 to d3/d16/l35 0 2024-02-15T22:41:10.123 INFO:tasks.workunit.client.1.smithi082.stdout:0/135: read d3/f6 [1395984,46239] 0 2024-02-15T22:41:10.125 INFO:tasks.workunit.client.1.smithi082.stdout:6/221: dwrite d2/f3 [0,4194304] 0 2024-02-15T22:41:10.125 INFO:tasks.workunit.client.1.smithi082.stdout:5/117: dwrite d5/da/dc/f20 [0,4194304] 0 2024-02-15T22:41:10.125 INFO:tasks.workunit.client.1.smithi082.stdout:5/118: getdents d5 0 2024-02-15T22:41:10.125 INFO:tasks.workunit.client.1.smithi082.stdout:5/119: read - d5/da/f25 zero size 2024-02-15T22:41:10.128 INFO:tasks.workunit.client.1.smithi082.stdout:4/89: dwrite d0/d8/d1b/dd/f18 [0,4194304] 0 2024-02-15T22:41:10.128 INFO:tasks.workunit.client.1.smithi082.stdout:4/90: chown d0 0 1 2024-02-15T22:41:10.139 INFO:tasks.workunit.client.1.smithi082.stdout:5/120: dread d5/da/dc/f10 [0,4194304] 0 2024-02-15T22:41:10.145 INFO:tasks.workunit.client.1.smithi082.stdout:4/91: dread d0/f1 [0,4194304] 0 2024-02-15T22:41:10.145 INFO:tasks.workunit.client.1.smithi082.stdout:0/136: dwrite d3/fa [0,4194304] 0 2024-02-15T22:41:10.145 INFO:tasks.workunit.client.1.smithi082.stdout:0/137: write d3/fe [1023539,99641] 0 2024-02-15T22:41:10.146 INFO:tasks.workunit.client.1.smithi082.stdout:6/222: dwrite d2/f1a [4194304,4194304] 0 2024-02-15T22:41:10.148 INFO:tasks.workunit.client.1.smithi082.stdout:6/223: link d2/d18/l27 d2/d18/d39/l46 0 2024-02-15T22:41:10.148 INFO:tasks.workunit.client.1.smithi082.stdout:6/224: chown d2/d18/d23/c37 35824 1 2024-02-15T22:41:10.148 INFO:tasks.workunit.client.1.smithi082.stdout:6/225: fsync d2/f1c 0 2024-02-15T22:41:10.148 INFO:tasks.workunit.client.1.smithi082.stdout:6/226: truncate d2/fd 4940700 0 2024-02-15T22:41:10.149 INFO:tasks.workunit.client.1.smithi082.stdout:0/138: rmdir d3/d19 39 2024-02-15T22:41:10.150 INFO:tasks.workunit.client.1.smithi082.stdout:6/227: truncate d2/d18/d23/d3c/f3d 2547100 0 2024-02-15T22:41:10.150 INFO:tasks.workunit.client.1.smithi082.stdout:6/228: chown d2/d18/l2e 402970694 1 2024-02-15T22:41:10.150 INFO:tasks.workunit.client.1.smithi082.stdout:4/92: dread d0/fb [0,4194304] 0 2024-02-15T22:41:10.152 INFO:tasks.workunit.client.1.smithi082.stdout:0/139: fdatasync d3/d16/f2a 0 2024-02-15T22:41:10.152 INFO:tasks.workunit.client.1.smithi082.stdout:4/93: rename d0/d8/l12 to d0/d8/l1c 0 2024-02-15T22:41:10.152 INFO:tasks.workunit.client.1.smithi082.stdout:6/229: dread d2/f1e [0,4194304] 0 2024-02-15T22:41:10.157 INFO:tasks.workunit.client.1.smithi082.stdout:0/140: getdents d3/d19/d20/d26 0 2024-02-15T22:41:10.157 INFO:tasks.workunit.client.1.smithi082.stdout:0/141: read - d3/f15 zero size 2024-02-15T22:41:10.157 INFO:tasks.workunit.client.1.smithi082.stdout:0/142: chown d3/d16/f1a 23 1 2024-02-15T22:41:10.159 INFO:tasks.workunit.client.1.smithi082.stdout:4/94: rename d0/fb to d0/d8/d1b/f1d 0 2024-02-15T22:41:10.159 INFO:tasks.workunit.client.1.smithi082.stdout:4/95: write d0/f1 [959461,80823] 0 2024-02-15T22:41:10.160 INFO:tasks.workunit.client.1.smithi082.stdout:0/143: unlink d3/d19/c2d 0 2024-02-15T22:41:10.163 INFO:tasks.workunit.client.1.smithi082.stdout:4/96: creat d0/f1e x:0 0 0 2024-02-15T22:41:10.164 INFO:tasks.workunit.client.1.smithi082.stdout:4/97: creat d0/d16/f1f x:0 0 0 2024-02-15T22:41:10.164 INFO:tasks.workunit.client.1.smithi082.stdout:4/98: chown d0/f2 4861 1 2024-02-15T22:41:10.164 INFO:tasks.workunit.client.1.smithi082.stdout:3/84: sync 2024-02-15T22:41:10.164 INFO:tasks.workunit.client.1.smithi082.stdout:7/93: sync 2024-02-15T22:41:10.164 INFO:tasks.workunit.client.1.smithi082.stdout:3/85: dread - d0/d16/f12 zero size 2024-02-15T22:41:10.164 INFO:tasks.workunit.client.1.smithi082.stdout:3/86: write d0/d19/fb [4121036,124748] 0 2024-02-15T22:41:10.165 INFO:tasks.workunit.client.1.smithi082.stdout:4/99: symlink d0/d8/l20 0 2024-02-15T22:41:10.165 INFO:tasks.workunit.client.1.smithi082.stdout:4/100: read - d0/f1e zero size 2024-02-15T22:41:10.165 INFO:tasks.workunit.client.1.smithi082.stdout:7/94: creat d12/f20 x:0 0 0 2024-02-15T22:41:10.165 INFO:tasks.workunit.client.1.smithi082.stdout:7/95: creat d12/f21 x:0 0 0 2024-02-15T22:41:10.171 INFO:tasks.workunit.client.1.smithi082.stdout:3/87: dread d0/d19/f7 [0,4194304] 0 2024-02-15T22:41:10.172 INFO:tasks.workunit.client.1.smithi082.stdout:3/88: creat d0/d16/f1f x:0 0 0 2024-02-15T22:41:10.173 INFO:tasks.workunit.client.1.smithi082.stdout:3/89: write d0/d19/fb [305935,32226] 0 2024-02-15T22:41:10.173 INFO:tasks.workunit.client.1.smithi082.stdout:3/90: readlink d0/d19/d14/l17 0 2024-02-15T22:41:10.175 INFO:tasks.workunit.client.1.smithi082.stdout:3/91: dread d0/d19/fe [0,4194304] 0 2024-02-15T22:41:10.176 INFO:tasks.workunit.client.1.smithi082.stdout:3/92: creat d0/dc/f20 x:0 0 0 2024-02-15T22:41:10.194 INFO:tasks.workunit.client.1.smithi082.stdout:4/101: dwrite d0/d16/f1f [0,4194304] 0 2024-02-15T22:41:10.195 INFO:tasks.workunit.client.1.smithi082.stdout:4/102: truncate d0/d8/d1b/dd/ff 187342 0 2024-02-15T22:41:10.196 INFO:tasks.workunit.client.1.smithi082.stdout:4/103: dread - d0/f1e zero size 2024-02-15T22:41:10.196 INFO:tasks.workunit.client.1.smithi082.stdout:4/104: creat d0/d16/f21 x:0 0 0 2024-02-15T22:41:10.211 INFO:tasks.workunit.client.1.smithi082.stdout:4/105: dwrite d0/f9 [0,4194304] 0 2024-02-15T22:41:10.213 INFO:tasks.workunit.client.1.smithi082.stdout:4/106: link d0/f1e d0/d16/f22 0 2024-02-15T22:41:10.213 INFO:tasks.workunit.client.1.smithi082.stdout:4/107: creat d0/f23 x:0 0 0 2024-02-15T22:41:10.215 INFO:tasks.workunit.client.1.smithi082.stdout:4/108: creat d0/d8/d1b/dd/f24 x:0 0 0 2024-02-15T22:41:10.219 INFO:tasks.workunit.client.1.smithi082.stdout:4/109: getdents d0/d8/d1b/dd 0 2024-02-15T22:41:10.219 INFO:tasks.workunit.client.1.smithi082.stdout:4/110: stat d0/d8/d1b/dd/f18 0 2024-02-15T22:41:10.219 INFO:tasks.workunit.client.1.smithi082.stdout:4/111: dread - d0/f23 zero size 2024-02-15T22:41:10.220 INFO:tasks.workunit.client.1.smithi082.stdout:4/112: creat d0/d8/f25 x:0 0 0 2024-02-15T22:41:10.221 INFO:tasks.workunit.client.1.smithi082.stdout:4/113: truncate d0/d8/d1b/f1d 2510867 0 2024-02-15T22:41:10.221 INFO:tasks.workunit.client.1.smithi082.stdout:4/114: dread - d0/d16/f22 zero size 2024-02-15T22:41:10.234 INFO:tasks.workunit.client.1.smithi082.stdout:4/115: dread d0/f1 [0,4194304] 0 2024-02-15T22:41:10.234 INFO:tasks.workunit.client.1.smithi082.stdout:4/116: stat d0/c15 0 2024-02-15T22:41:10.235 INFO:tasks.workunit.client.1.smithi082.stdout:4/117: symlink d0/d8/d1b/l26 0 2024-02-15T22:41:10.237 INFO:tasks.workunit.client.1.smithi082.stdout:6/230: dwrite d2/d18/f44 [0,4194304] 0 2024-02-15T22:41:10.237 INFO:tasks.workunit.client.1.smithi082.stdout:6/231: stat d2/d18/c2b 0 2024-02-15T22:41:10.237 INFO:tasks.workunit.client.1.smithi082.stdout:6/232: write d2/f1c [369591,85261] 0 2024-02-15T22:41:10.237 INFO:tasks.workunit.client.1.smithi082.stdout:7/96: dwrite d12/d17/f19 [0,4194304] 0 2024-02-15T22:41:10.237 INFO:tasks.workunit.client.1.smithi082.stdout:7/97: stat f10 0 2024-02-15T22:41:10.237 INFO:tasks.workunit.client.1.smithi082.stdout:7/98: truncate d12/d17/f18 508307 0 2024-02-15T22:41:10.239 INFO:tasks.workunit.client.1.smithi082.stdout:4/118: dread d0/d8/fa [0,4194304] 0 2024-02-15T22:41:10.239 INFO:tasks.workunit.client.1.smithi082.stdout:4/119: write d0/d16/f21 [713007,12572] 0 2024-02-15T22:41:10.243 INFO:tasks.workunit.client.1.smithi082.stdout:6/233: mkdir d2/d18/d23/d3c/d47 0 2024-02-15T22:41:10.243 INFO:tasks.workunit.client.1.smithi082.stdout:6/234: write d2/d18/f2c [3136651,103664] 0 2024-02-15T22:41:10.243 INFO:tasks.workunit.client.1.smithi082.stdout:6/235: write d2/d18/f2c [3207142,10542] 0 2024-02-15T22:41:10.243 INFO:tasks.workunit.client.1.smithi082.stdout:6/236: rename d2/d18/d23 to d2/d18/d23/d3c/d47/d48 22 2024-02-15T22:41:10.246 INFO:tasks.workunit.client.1.smithi082.stdout:4/120: symlink d0/d8/d1b/dd/l27 0 2024-02-15T22:41:10.250 INFO:tasks.workunit.client.1.smithi082.stdout:6/237: rename d2/d18/f2c to d2/d30/d3b/f49 0 2024-02-15T22:41:10.252 INFO:tasks.workunit.client.1.smithi082.stdout:7/99: rmdir d12 39 2024-02-15T22:41:10.252 INFO:tasks.workunit.client.1.smithi082.stdout:7/100: dread - d12/f21 zero size 2024-02-15T22:41:10.255 INFO:tasks.workunit.client.1.smithi082.stdout:4/121: rename d0/d8/d1b/dd/f24 to d0/d16/f28 0 2024-02-15T22:41:10.257 INFO:tasks.workunit.client.1.smithi082.stdout:7/101: creat d12/f22 x:0 0 0 2024-02-15T22:41:10.257 INFO:tasks.workunit.client.1.smithi082.stdout:4/122: mknod d0/d8/d1b/c29 0 2024-02-15T22:41:10.257 INFO:tasks.workunit.client.1.smithi082.stdout:4/123: chown d0/c15 79692573 1 2024-02-15T22:41:10.258 INFO:tasks.workunit.client.1.smithi082.stdout:7/102: write ff [778624,50975] 0 2024-02-15T22:41:10.259 INFO:tasks.workunit.client.1.smithi082.stdout:4/124: mknod d0/d8/c2a 0 2024-02-15T22:41:10.261 INFO:tasks.workunit.client.1.smithi082.stdout:7/103: creat d12/d17/f23 x:0 0 0 2024-02-15T22:41:10.261 INFO:tasks.workunit.client.1.smithi082.stdout:7/104: fdatasync d12/f16 0 2024-02-15T22:41:10.261 INFO:tasks.workunit.client.1.smithi082.stdout:7/105: dread - d12/d17/f1a zero size 2024-02-15T22:41:10.261 INFO:tasks.workunit.client.1.smithi082.stdout:7/106: truncate d12/d17/f1a 549264 0 2024-02-15T22:41:10.274 INFO:tasks.workunit.client.1.smithi082.stdout:6/238: dwrite d2/d18/f44 [4194304,4194304] 0 2024-02-15T22:41:10.278 INFO:tasks.workunit.client.1.smithi082.stdout:7/107: rmdir d12 39 2024-02-15T22:41:10.281 INFO:tasks.workunit.client.1.smithi082.stdout:7/108: link d12/d17/c1e d12/d17/c24 0 2024-02-15T22:41:10.292 INFO:tasks.workunit.client.1.smithi082.stdout:6/239: dwrite d2/d30/d3b/f49 [0,4194304] 0 2024-02-15T22:41:10.303 INFO:tasks.workunit.client.1.smithi082.stdout:1/126: sync 2024-02-15T22:41:10.315 INFO:tasks.workunit.client.1.smithi082.stdout:7/109: dwrite d12/d17/f1d [0,4194304] 0 2024-02-15T22:41:10.316 INFO:tasks.workunit.client.1.smithi082.stdout:7/110: write f10 [915064,84843] 0 2024-02-15T22:41:10.316 INFO:tasks.workunit.client.1.smithi082.stdout:7/111: write f7 [1358211,35523] 0 2024-02-15T22:41:10.318 INFO:tasks.workunit.client.1.smithi082.stdout:7/112: creat d12/d17/f25 x:0 0 0 2024-02-15T22:41:10.319 INFO:tasks.workunit.client.1.smithi082.stdout:6/240: dwrite d2/d30/f33 [0,4194304] 0 2024-02-15T22:41:10.319 INFO:tasks.workunit.client.1.smithi082.stdout:7/113: mkdir d12/d26 0 2024-02-15T22:41:10.323 INFO:tasks.workunit.client.1.smithi082.stdout:6/241: mknod d2/d18/d23/d3c/c4a 0 2024-02-15T22:41:10.337 INFO:tasks.workunit.client.1.smithi082.stdout:6/242: write d2/d30/f33 [582822,36687] 0 2024-02-15T22:41:10.337 INFO:tasks.workunit.client.1.smithi082.stdout:6/243: write d2/d18/f19 [1367189,2290] 0 2024-02-15T22:41:10.337 INFO:tasks.workunit.client.1.smithi082.stdout:6/244: truncate d2/d30/d3b/f42 495322 0 2024-02-15T22:41:10.337 INFO:tasks.workunit.client.1.smithi082.stdout:6/245: write d2/d18/d23/f35 [26939,58802] 0 2024-02-15T22:41:10.339 INFO:tasks.workunit.client.1.smithi082.stdout:6/246: link d2/d30/c41 d2/d18/d23/d3c/d47/c4b 0 2024-02-15T22:41:10.339 INFO:tasks.workunit.client.1.smithi082.stdout:6/247: mkdir d2/d4c 0 2024-02-15T22:41:10.342 INFO:tasks.workunit.client.1.smithi082.stdout:1/127: dwrite d1/da/ff [0,4194304] 0 2024-02-15T22:41:10.342 INFO:tasks.workunit.client.1.smithi082.stdout:1/128: fsync d1/da/d11/f16 0 2024-02-15T22:41:10.342 INFO:tasks.workunit.client.1.smithi082.stdout:1/129: chown d1/da/d14/f28 118 1 2024-02-15T22:41:10.342 INFO:tasks.workunit.client.1.smithi082.stdout:1/130: fdatasync d1/f1b 0 2024-02-15T22:41:10.342 INFO:tasks.workunit.client.1.smithi082.stdout:1/131: write d1/da/f24 [454706,83698] 0 2024-02-15T22:41:10.342 INFO:tasks.workunit.client.1.smithi082.stdout:1/132: readlink d1/da/l2c 0 2024-02-15T22:41:10.344 INFO:tasks.workunit.client.1.smithi082.stdout:1/133: getdents d1/da/d11 0 2024-02-15T22:41:10.346 INFO:tasks.workunit.client.1.smithi082.stdout:1/134: rename d1/l5 to d1/da/d14/d18/d1f/d2f/l32 0 2024-02-15T22:41:10.347 INFO:tasks.workunit.client.1.smithi082.stdout:7/114: dwrite d12/d17/f18 [0,4194304] 0 2024-02-15T22:41:10.347 INFO:tasks.workunit.client.1.smithi082.stdout:7/115: chown d12/f22 124 1 2024-02-15T22:41:10.348 INFO:tasks.workunit.client.1.smithi082.stdout:1/135: creat d1/da/d11/f33 x:0 0 0 2024-02-15T22:41:10.348 INFO:tasks.workunit.client.1.smithi082.stdout:1/136: write d1/f2e [209193,58586] 0 2024-02-15T22:41:10.348 INFO:tasks.workunit.client.1.smithi082.stdout:1/137: stat d1/f22 0 2024-02-15T22:41:10.351 INFO:tasks.workunit.client.1.smithi082.stdout:7/116: mkdir d12/d27 0 2024-02-15T22:41:10.351 INFO:tasks.workunit.client.1.smithi082.stdout:7/117: fsync f3 0 2024-02-15T22:41:10.351 INFO:tasks.workunit.client.1.smithi082.stdout:7/118: readlink ld 0 2024-02-15T22:41:10.351 INFO:tasks.workunit.client.1.smithi082.stdout:6/248: dread d2/fd [0,4194304] 0 2024-02-15T22:41:10.354 INFO:tasks.workunit.client.1.smithi082.stdout:1/138: unlink d1/da/l2c 0 2024-02-15T22:41:10.354 INFO:tasks.workunit.client.1.smithi082.stdout:1/139: write d1/da/fe [589019,124774] 0 2024-02-15T22:41:10.355 INFO:tasks.workunit.client.1.smithi082.stdout:1/140: read d1/da/f24 [110866,130522] 0 2024-02-15T22:41:10.355 INFO:tasks.workunit.client.1.smithi082.stdout:6/249: getdents d2/d30 0 2024-02-15T22:41:10.357 INFO:tasks.workunit.client.1.smithi082.stdout:6/250: dread d2/f1e [0,4194304] 0 2024-02-15T22:41:10.372 INFO:tasks.workunit.client.1.smithi082.stdout:7/119: dread f7 [0,4194304] 0 2024-02-15T22:41:10.375 INFO:tasks.workunit.client.1.smithi082.stdout:7/120: link d12/c1c d12/d27/c28 0 2024-02-15T22:41:10.376 INFO:tasks.workunit.client.1.smithi082.stdout:7/121: rmdir d12/d17 39 2024-02-15T22:41:10.377 INFO:tasks.workunit.client.1.smithi082.stdout:7/122: mknod d12/d17/c29 0 2024-02-15T22:41:10.385 INFO:tasks.workunit.client.1.smithi082.stdout:1/141: dwrite d1/f1b [0,4194304] 0 2024-02-15T22:41:10.385 INFO:tasks.workunit.client.1.smithi082.stdout:1/142: truncate d1/da/d11/f33 32891 0 2024-02-15T22:41:10.386 INFO:tasks.workunit.client.1.smithi082.stdout:1/143: fdatasync d1/da/d11/f16 0 2024-02-15T22:41:10.386 INFO:tasks.workunit.client.1.smithi082.stdout:1/144: rename d1/da/d14 to d1/da/d14/d18/d34 22 2024-02-15T22:41:10.399 INFO:tasks.workunit.client.1.smithi082.stdout:6/251: dwrite d2/f1e [0,4194304] 0 2024-02-15T22:41:10.400 INFO:tasks.workunit.client.1.smithi082.stdout:1/145: write d1/f4 [853329,95074] 0 2024-02-15T22:41:10.400 INFO:tasks.workunit.client.1.smithi082.stdout:7/123: dwrite fb [0,4194304] 0 2024-02-15T22:41:10.401 INFO:tasks.workunit.client.1.smithi082.stdout:7/124: chown d12/d17/c29 1530276 1 2024-02-15T22:41:10.406 INFO:tasks.workunit.client.1.smithi082.stdout:6/252: mknod d2/d18/d39/c4d 0 2024-02-15T22:41:10.406 INFO:tasks.workunit.client.1.smithi082.stdout:1/146: rmdir d1/da/d14/d18 39 2024-02-15T22:41:10.407 INFO:tasks.workunit.client.1.smithi082.stdout:7/125: symlink d12/d27/l2a 0 2024-02-15T22:41:10.407 INFO:tasks.workunit.client.1.smithi082.stdout:7/126: write d12/f21 [1029963,126440] 0 2024-02-15T22:41:10.408 INFO:tasks.workunit.client.1.smithi082.stdout:6/253: symlink d2/d45/l4e 0 2024-02-15T22:41:10.409 INFO:tasks.workunit.client.1.smithi082.stdout:7/127: symlink d12/d27/l2b 0 2024-02-15T22:41:10.411 INFO:tasks.workunit.client.1.smithi082.stdout:6/254: rename d2/d30/f33 to d2/f4f 0 2024-02-15T22:41:10.414 INFO:tasks.workunit.client.1.smithi082.stdout:7/128: rmdir d12/d26 0 2024-02-15T22:41:10.415 INFO:tasks.workunit.client.1.smithi082.stdout:6/255: mknod d2/d30/c50 0 2024-02-15T22:41:10.416 INFO:tasks.workunit.client.1.smithi082.stdout:6/256: truncate d2/f1c 820811 0 2024-02-15T22:41:10.418 INFO:tasks.workunit.client.1.smithi082.stdout:6/257: getdents d2/d18/d23/d3c/d47 0 2024-02-15T22:41:10.419 INFO:tasks.workunit.client.1.smithi082.stdout:6/258: symlink d2/d30/d3b/l51 0 2024-02-15T22:41:10.420 INFO:tasks.workunit.client.1.smithi082.stdout:1/147: dread d1/f22 [0,4194304] 0 2024-02-15T22:41:10.422 INFO:tasks.workunit.client.1.smithi082.stdout:1/148: symlink d1/da/d14/l35 0 2024-02-15T22:41:10.422 INFO:tasks.workunit.client.1.smithi082.stdout:1/149: chown d1/da/d14/d18/l21 767 1 2024-02-15T22:41:10.423 INFO:tasks.workunit.client.1.smithi082.stdout:2/147: sync 2024-02-15T22:41:10.423 INFO:tasks.workunit.client.1.smithi082.stdout:2/148: fsync d6/dc/dd/d1d/f1f 0 2024-02-15T22:41:10.424 INFO:tasks.workunit.client.1.smithi082.stdout:1/150: mknod d1/c36 0 2024-02-15T22:41:10.424 INFO:tasks.workunit.client.1.smithi082.stdout:1/151: fdatasync d1/da/d11/f16 0 2024-02-15T22:41:10.424 INFO:tasks.workunit.client.1.smithi082.stdout:1/152: chown d1/f1d 237 1 2024-02-15T22:41:10.424 INFO:tasks.workunit.client.1.smithi082.stdout:1/153: fdatasync d1/da/d14/f2a 0 2024-02-15T22:41:10.424 INFO:tasks.workunit.client.1.smithi082.stdout:2/149: mknod d6/dc/d12/c27 0 2024-02-15T22:41:10.426 INFO:tasks.workunit.client.1.smithi082.stdout:1/154: mkdir d1/da/d14/d37 0 2024-02-15T22:41:10.428 INFO:tasks.workunit.client.1.smithi082.stdout:2/150: mknod d6/dc/dd/d21/c28 0 2024-02-15T22:41:10.428 INFO:tasks.workunit.client.1.smithi082.stdout:2/151: dread - d6/dc/dd/f1a zero size 2024-02-15T22:41:10.428 INFO:tasks.workunit.client.1.smithi082.stdout:7/129: read d12/d17/f18 [1250762,87332] 0 2024-02-15T22:41:10.428 INFO:tasks.workunit.client.1.smithi082.stdout:0/144: sync 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:8/97: sync 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:9/169: sync 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:0/145: chown d3/d19/d20/d26/f31 14 1 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:0/146: stat d3/fa 0 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:0/147: readlink d3/d19/d20/l22 0 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:5/121: sync 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:3/93: sync 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:3/94: dread - d0/d16/f12 zero size 2024-02-15T22:41:10.429 INFO:tasks.workunit.client.1.smithi082.stdout:3/95: chown d0/d19/fe 468 1 2024-02-15T22:41:10.430 INFO:tasks.workunit.client.1.smithi082.stdout:3/96: fdatasync d0/dc/f20 0 2024-02-15T22:41:10.431 INFO:tasks.workunit.client.1.smithi082.stdout:7/130: unlink d12/c1c 0 2024-02-15T22:41:10.432 INFO:tasks.workunit.client.1.smithi082.stdout:8/98: read d1/f14 [4889447,19193] 0 2024-02-15T22:41:10.434 INFO:tasks.workunit.client.1.smithi082.stdout:0/148: symlink d3/d19/l36 0 2024-02-15T22:41:10.434 INFO:tasks.workunit.client.1.smithi082.stdout:0/149: chown d3/d19/d20/d26/f31 1606197368 1 2024-02-15T22:41:10.436 INFO:tasks.workunit.client.1.smithi082.stdout:6/259: dread d2/d30/d3b/f49 [0,4194304] 0 2024-02-15T22:41:10.437 INFO:tasks.workunit.client.1.smithi082.stdout:8/99: truncate d1/f5 117401 0 2024-02-15T22:41:10.437 INFO:tasks.workunit.client.1.smithi082.stdout:8/100: creat d1/d7/f2a x:0 0 0 2024-02-15T22:41:10.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/170: dread d8/f11 [0,4194304] 0 2024-02-15T22:41:10.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/171: truncate d8/f11 3333694 0 2024-02-15T22:41:10.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/172: fdatasync d8/d12/f1e 0 2024-02-15T22:41:10.443 INFO:tasks.workunit.client.1.smithi082.stdout:8/101: rename d1/ld to d1/d7/de/l2b 0 2024-02-15T22:41:10.444 INFO:tasks.workunit.client.1.smithi082.stdout:8/102: readlink d1/d7/l26 0 2024-02-15T22:41:10.445 INFO:tasks.workunit.client.1.smithi082.stdout:0/150: mknod d3/d16/c37 0 2024-02-15T22:41:10.447 INFO:tasks.workunit.client.1.smithi082.stdout:9/173: rename d8/d12/c16 to d8/d24/c2d 0 2024-02-15T22:41:10.449 INFO:tasks.workunit.client.1.smithi082.stdout:4/125: sync 2024-02-15T22:41:10.450 INFO:tasks.workunit.client.1.smithi082.stdout:4/126: creat d0/d16/f2b x:0 0 0 2024-02-15T22:41:10.450 INFO:tasks.workunit.client.1.smithi082.stdout:4/127: creat d0/d16/f2c x:0 0 0 2024-02-15T22:41:10.450 INFO:tasks.workunit.client.1.smithi082.stdout:4/128: write d0/d16/f2c [842429,45889] 0 2024-02-15T22:41:10.452 INFO:tasks.workunit.client.1.smithi082.stdout:0/151: symlink d3/d16/l38 0 2024-02-15T22:41:10.454 INFO:tasks.workunit.client.1.smithi082.stdout:4/129: truncate d0/d8/d1b/f1d 2293355 0 2024-02-15T22:41:10.454 INFO:tasks.workunit.client.1.smithi082.stdout:7/131: dread d12/d17/f19 [0,4194304] 0 2024-02-15T22:41:10.456 INFO:tasks.workunit.client.1.smithi082.stdout:7/132: creat d12/d27/f2c x:0 0 0 2024-02-15T22:41:10.457 INFO:tasks.workunit.client.1.smithi082.stdout:0/152: dread d3/fe [0,4194304] 0 2024-02-15T22:41:10.458 INFO:tasks.workunit.client.1.smithi082.stdout:7/133: rename d12/d17/f18 to d12/f2d 0 2024-02-15T22:41:10.458 INFO:tasks.workunit.client.1.smithi082.stdout:7/134: chown d12/d27/f2c 29 1 2024-02-15T22:41:10.458 INFO:tasks.workunit.client.1.smithi082.stdout:0/153: rmdir d3/d19/d25 39 2024-02-15T22:41:10.458 INFO:tasks.workunit.client.1.smithi082.stdout:0/154: dread - d3/f2f zero size 2024-02-15T22:41:10.461 INFO:tasks.workunit.client.1.smithi082.stdout:7/135: rename d12/d27/c28 to d12/c2e 0 2024-02-15T22:41:10.465 INFO:tasks.workunit.client.1.smithi082.stdout:2/152: dwrite d6/dc/f10 [0,4194304] 0 2024-02-15T22:41:10.466 INFO:tasks.workunit.client.1.smithi082.stdout:2/153: truncate f5 1403500 0 2024-02-15T22:41:10.473 INFO:tasks.workunit.client.1.smithi082.stdout:4/130: write d0/d16/f1f [1081249,107295] 0 2024-02-15T22:41:10.474 INFO:tasks.workunit.client.1.smithi082.stdout:4/131: readlink d0/l3 0 2024-02-15T22:41:10.475 INFO:tasks.workunit.client.1.smithi082.stdout:1/155: dwrite d1/da/d11/f16 [0,4194304] 0 2024-02-15T22:41:10.475 INFO:tasks.workunit.client.1.smithi082.stdout:4/132: unlink d0/l7 0 2024-02-15T22:41:10.476 INFO:tasks.workunit.client.1.smithi082.stdout:4/133: creat d0/d16/f2d x:0 0 0 2024-02-15T22:41:10.476 INFO:tasks.workunit.client.1.smithi082.stdout:4/134: readlink d0/d8/d1b/dd/l13 0 2024-02-15T22:41:10.479 INFO:tasks.workunit.client.1.smithi082.stdout:4/135: rename d0/f9 to d0/d8/f2e 0 2024-02-15T22:41:10.481 INFO:tasks.workunit.client.1.smithi082.stdout:4/136: creat d0/d8/d1b/dd/f2f x:0 0 0 2024-02-15T22:41:10.481 INFO:tasks.workunit.client.1.smithi082.stdout:4/137: chown d0/f2 38096 1 2024-02-15T22:41:10.482 INFO:tasks.workunit.client.1.smithi082.stdout:4/138: rename d0/d16/f2c to d0/d16/f30 0 2024-02-15T22:41:10.482 INFO:tasks.workunit.client.1.smithi082.stdout:6/260: dwrite d2/f1c [0,4194304] 0 2024-02-15T22:41:10.482 INFO:tasks.workunit.client.1.smithi082.stdout:4/139: fsync d0/d8/fa 0 2024-02-15T22:41:10.482 INFO:tasks.workunit.client.1.smithi082.stdout:4/140: fsync d0/d8/f25 0 2024-02-15T22:41:10.484 INFO:tasks.workunit.client.1.smithi082.stdout:3/97: dwrite d0/f2 [4194304,4194304] 0 2024-02-15T22:41:10.484 INFO:tasks.workunit.client.1.smithi082.stdout:6/261: rmdir d2/d4c 0 2024-02-15T22:41:10.484 INFO:tasks.workunit.client.1.smithi082.stdout:6/262: creat d2/f52 x:0 0 0 2024-02-15T22:41:10.485 INFO:tasks.workunit.client.1.smithi082.stdout:5/122: dwrite d5/da/f23 [4194304,4194304] 0 2024-02-15T22:41:10.485 INFO:tasks.workunit.client.1.smithi082.stdout:2/154: dwrite d6/dc/dd/d1d/f1f [0,4194304] 0 2024-02-15T22:41:10.485 INFO:tasks.workunit.client.1.smithi082.stdout:2/155: write d6/d18/f22 [519224,64208] 0 2024-02-15T22:41:10.485 INFO:tasks.workunit.client.1.smithi082.stdout:2/156: write d6/d9/f1e [195460,68884] 0 2024-02-15T22:41:10.486 INFO:tasks.workunit.client.1.smithi082.stdout:4/141: creat d0/f31 x:0 0 0 2024-02-15T22:41:10.490 INFO:tasks.workunit.client.1.smithi082.stdout:8/103: getdents d1/d7 0 2024-02-15T22:41:10.490 INFO:tasks.workunit.client.1.smithi082.stdout:8/104: write d1/f1b [231181,96469] 0 2024-02-15T22:41:10.490 INFO:tasks.workunit.client.1.smithi082.stdout:1/156: write d1/da/f1c [1412004,42077] 0 2024-02-15T22:41:10.495 INFO:tasks.workunit.client.1.smithi082.stdout:9/174: getdents d8/d24 0 2024-02-15T22:41:10.502 INFO:tasks.workunit.client.1.smithi082.stdout:6/263: write d2/f3 [470568,125583] 0 2024-02-15T22:41:10.503 INFO:tasks.workunit.client.1.smithi082.stdout:4/142: mkdir d0/d8/d32 0 2024-02-15T22:41:10.504 INFO:tasks.workunit.client.1.smithi082.stdout:3/98: getdents d0/d16 0 2024-02-15T22:41:10.505 INFO:tasks.workunit.client.1.smithi082.stdout:8/105: rmdir d1/d7 39 2024-02-15T22:41:10.510 INFO:tasks.workunit.client.1.smithi082.stdout:1/157: rmdir d1/da/d14/d18/d1f/d2f 39 2024-02-15T22:41:10.512 INFO:tasks.workunit.client.1.smithi082.stdout:8/106: mknod d1/d7/de/c2c 0 2024-02-15T22:41:10.515 INFO:tasks.workunit.client.1.smithi082.stdout:1/158: mknod d1/da/d14/d18/c38 0 2024-02-15T22:41:10.517 INFO:tasks.workunit.client.1.smithi082.stdout:8/107: symlink d1/d7/l2d 0 2024-02-15T22:41:10.521 INFO:tasks.workunit.client.1.smithi082.stdout:1/159: truncate d1/da/f24 317374 0 2024-02-15T22:41:10.521 INFO:tasks.workunit.client.1.smithi082.stdout:1/160: chown d1/da/d11/f16 593785783 1 2024-02-15T22:41:10.523 INFO:tasks.workunit.client.1.smithi082.stdout:8/108: creat d1/d7/de/f2e x:0 0 0 2024-02-15T22:41:10.523 INFO:tasks.workunit.client.1.smithi082.stdout:8/109: chown d1/c28 17564465 1 2024-02-15T22:41:10.525 INFO:tasks.workunit.client.1.smithi082.stdout:1/161: unlink d1/da/d11/c25 0 2024-02-15T22:41:10.531 INFO:tasks.workunit.client.1.smithi082.stdout:5/123: dwrite d5/da/f1a [0,4194304] 0 2024-02-15T22:41:10.532 INFO:tasks.workunit.client.1.smithi082.stdout:2/157: dwrite d6/d9/f1e [0,4194304] 0 2024-02-15T22:41:10.535 INFO:tasks.workunit.client.1.smithi082.stdout:5/124: unlink d5/da/f1a 0 2024-02-15T22:41:10.536 INFO:tasks.workunit.client.1.smithi082.stdout:5/125: chown d5/da/d22 36 1 2024-02-15T22:41:10.541 INFO:tasks.workunit.client.1.smithi082.stdout:3/99: dwrite d0/d19/fe [0,4194304] 0 2024-02-15T22:41:10.541 INFO:tasks.workunit.client.1.smithi082.stdout:9/175: dwrite d8/f9 [4194304,4194304] 0 2024-02-15T22:41:10.542 INFO:tasks.workunit.client.1.smithi082.stdout:9/176: fdatasync d8/f10 0 2024-02-15T22:41:10.543 INFO:tasks.workunit.client.1.smithi082.stdout:4/143: dwrite d0/d16/f2d [0,4194304] 0 2024-02-15T22:41:10.543 INFO:tasks.workunit.client.1.smithi082.stdout:4/144: write d0/d8/d1b/dd/ff [1169246,59306] 0 2024-02-15T22:41:10.544 INFO:tasks.workunit.client.1.smithi082.stdout:8/110: dwrite d1/f14 [0,4194304] 0 2024-02-15T22:41:10.544 INFO:tasks.workunit.client.1.smithi082.stdout:8/111: stat d1/d7/f2a 0 2024-02-15T22:41:10.547 INFO:tasks.workunit.client.1.smithi082.stdout:3/100: getdents d0/dc 0 2024-02-15T22:41:10.547 INFO:tasks.workunit.client.1.smithi082.stdout:3/101: write d0/f1c [458941,69292] 0 2024-02-15T22:41:10.547 INFO:tasks.workunit.client.1.smithi082.stdout:3/102: dread - d0/d16/f12 zero size 2024-02-15T22:41:10.556 INFO:tasks.workunit.client.1.smithi082.stdout:4/145: creat d0/d8/d32/f33 x:0 0 0 2024-02-15T22:41:10.556 INFO:tasks.workunit.client.1.smithi082.stdout:4/146: chown d0/d8/d32/f33 1437 1 2024-02-15T22:41:10.556 INFO:tasks.workunit.client.1.smithi082.stdout:4/147: creat d0/d8/f34 x:0 0 0 2024-02-15T22:41:10.558 INFO:tasks.workunit.client.1.smithi082.stdout:6/264: dread d2/f3 [4194304,4194304] 0 2024-02-15T22:41:10.564 INFO:tasks.workunit.client.1.smithi082.stdout:9/177: rmdir d8 39 2024-02-15T22:41:10.566 INFO:tasks.workunit.client.1.smithi082.stdout:3/103: mkdir d0/d19/d14/d21 0 2024-02-15T22:41:10.566 INFO:tasks.workunit.client.1.smithi082.stdout:3/104: stat d0/dc/l15 0 2024-02-15T22:41:10.566 INFO:tasks.workunit.client.1.smithi082.stdout:3/105: readlink d0/d19/d14/l1e 0 2024-02-15T22:41:10.566 INFO:tasks.workunit.client.1.smithi082.stdout:3/106: write d0/d16/f12 [449763,116765] 0 2024-02-15T22:41:10.566 INFO:tasks.workunit.client.1.smithi082.stdout:1/162: dwrite d1/f2e [0,4194304] 0 2024-02-15T22:41:10.566 INFO:tasks.workunit.client.1.smithi082.stdout:1/163: write d1/da/d11/f33 [504864,48084] 0 2024-02-15T22:41:10.566 INFO:tasks.workunit.client.1.smithi082.stdout:1/164: stat d1/da/d14/d18/l21 0 2024-02-15T22:41:10.567 INFO:tasks.workunit.client.1.smithi082.stdout:1/165: readlink d1/da/d14/d18/d1f/d2f/l32 0 2024-02-15T22:41:10.567 INFO:tasks.workunit.client.1.smithi082.stdout:1/166: readlink d1/l26 0 2024-02-15T22:41:10.567 INFO:tasks.workunit.client.1.smithi082.stdout:2/158: dwrite d6/d9/fe [4194304,4194304] 0 2024-02-15T22:41:10.567 INFO:tasks.workunit.client.1.smithi082.stdout:5/126: dwrite d5/f7 [0,4194304] 0 2024-02-15T22:41:10.567 INFO:tasks.workunit.client.1.smithi082.stdout:5/127: chown d5/da 147998116 1 2024-02-15T22:41:10.570 INFO:tasks.workunit.client.1.smithi082.stdout:4/148: unlink d0/d8/l20 0 2024-02-15T22:41:10.570 INFO:tasks.workunit.client.1.smithi082.stdout:4/149: fdatasync d0/d8/f25 0 2024-02-15T22:41:10.571 INFO:tasks.workunit.client.1.smithi082.stdout:6/265: rename d2/d18/d23/l28 to d2/d18/d23/d3c/d47/l53 0 2024-02-15T22:41:10.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/178: dread d8/d12/f1b [0,4194304] 0 2024-02-15T22:41:10.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/179: readlink d8/l17 0 2024-02-15T22:41:10.573 INFO:tasks.workunit.client.1.smithi082.stdout:9/180: chown d8/f1f 3 1 2024-02-15T22:41:10.574 INFO:tasks.workunit.client.1.smithi082.stdout:1/167: truncate d1/da/d14/f28 2587369 0 2024-02-15T22:41:10.577 INFO:tasks.workunit.client.1.smithi082.stdout:5/128: link l3 d5/da/l29 0 2024-02-15T22:41:10.579 INFO:tasks.workunit.client.1.smithi082.stdout:4/150: creat d0/d8/d1b/f35 x:0 0 0 2024-02-15T22:41:10.579 INFO:tasks.workunit.client.1.smithi082.stdout:4/151: write d0/d16/f1f [3414840,11546] 0 2024-02-15T22:41:10.579 INFO:tasks.workunit.client.1.smithi082.stdout:2/159: write d6/d9/f1e [3092501,51700] 0 2024-02-15T22:41:10.580 INFO:tasks.workunit.client.1.smithi082.stdout:2/160: write d6/dc/f16 [246850,22063] 0 2024-02-15T22:41:10.581 INFO:tasks.workunit.client.1.smithi082.stdout:6/266: creat d2/d18/d23/d3c/d47/f54 x:0 0 0 2024-02-15T22:41:10.581 INFO:tasks.workunit.client.1.smithi082.stdout:6/267: write d2/d18/d23/f35 [2846839,90401] 0 2024-02-15T22:41:10.582 INFO:tasks.workunit.client.1.smithi082.stdout:1/168: rename d1/f22 to d1/f39 0 2024-02-15T22:41:10.583 INFO:tasks.workunit.client.1.smithi082.stdout:9/181: dread d8/f9 [0,4194304] 0 2024-02-15T22:41:10.583 INFO:tasks.workunit.client.1.smithi082.stdout:5/129: chown d5/da/dc/c19 15 1 2024-02-15T22:41:10.583 INFO:tasks.workunit.client.1.smithi082.stdout:5/130: readlink l3 0 2024-02-15T22:41:10.584 INFO:tasks.workunit.client.1.smithi082.stdout:2/161: dread f2 [0,4194304] 0 2024-02-15T22:41:10.585 INFO:tasks.workunit.client.1.smithi082.stdout:4/152: unlink d0/f1e 0 2024-02-15T22:41:10.585 INFO:tasks.workunit.client.1.smithi082.stdout:4/153: dread - d0/f31 zero size 2024-02-15T22:41:10.585 INFO:tasks.workunit.client.1.smithi082.stdout:4/154: write d0/d16/f30 [1304987,96641] 0 2024-02-15T22:41:10.586 INFO:tasks.workunit.client.1.smithi082.stdout:3/107: dwrite d0/dc/fd [0,4194304] 0 2024-02-15T22:41:10.586 INFO:tasks.workunit.client.1.smithi082.stdout:3/108: chown d0/d16/f12 28137 1 2024-02-15T22:41:10.586 INFO:tasks.workunit.client.1.smithi082.stdout:3/109: write d0/dc/f20 [430375,38309] 0 2024-02-15T22:41:10.587 INFO:tasks.workunit.client.1.smithi082.stdout:6/268: rename d2/l16 to d2/d18/d23/d3c/l55 0 2024-02-15T22:41:10.587 INFO:tasks.workunit.client.1.smithi082.stdout:1/169: truncate d1/f1b 2399985 0 2024-02-15T22:41:10.588 INFO:tasks.workunit.client.1.smithi082.stdout:9/182: rmdir d8 39 2024-02-15T22:41:10.588 INFO:tasks.workunit.client.1.smithi082.stdout:9/183: chown d8/f1a 678405 1 2024-02-15T22:41:10.589 INFO:tasks.workunit.client.1.smithi082.stdout:5/131: mknod d5/da/d22/c2a 0 2024-02-15T22:41:10.589 INFO:tasks.workunit.client.1.smithi082.stdout:5/132: truncate d5/da/f1c 1675716 0 2024-02-15T22:41:10.594 INFO:tasks.workunit.client.1.smithi082.stdout:2/162: dread d6/dc/f10 [0,4194304] 0 2024-02-15T22:41:10.594 INFO:tasks.workunit.client.1.smithi082.stdout:4/155: rename d0/d8/d1b/dd/f18 to d0/d8/d1b/f36 0 2024-02-15T22:41:10.597 INFO:tasks.workunit.client.1.smithi082.stdout:6/269: creat d2/d45/f56 x:0 0 0 2024-02-15T22:41:10.598 INFO:tasks.workunit.client.1.smithi082.stdout:5/133: dread d5/f7 [0,4194304] 0 2024-02-15T22:41:10.599 INFO:tasks.workunit.client.1.smithi082.stdout:9/184: unlink d8/f10 0 2024-02-15T22:41:10.600 INFO:tasks.workunit.client.1.smithi082.stdout:3/110: write d0/d19/fe [2372562,93503] 0 2024-02-15T22:41:10.601 INFO:tasks.workunit.client.1.smithi082.stdout:2/163: rename d6/dc/d12/c27 to d6/c29 0 2024-02-15T22:41:10.603 INFO:tasks.workunit.client.1.smithi082.stdout:4/156: mkdir d0/d8/d1b/dd/d37 0 2024-02-15T22:41:10.603 INFO:tasks.workunit.client.1.smithi082.stdout:4/157: chown d0/d8/d1b/dd/l13 13063591 1 2024-02-15T22:41:10.603 INFO:tasks.workunit.client.1.smithi082.stdout:4/158: readlink d0/d8/l1c 0 2024-02-15T22:41:10.607 INFO:tasks.workunit.client.1.smithi082.stdout:2/164: mkdir d6/d2a 0 2024-02-15T22:41:10.607 INFO:tasks.workunit.client.1.smithi082.stdout:2/165: chown d6/dc 0 1 2024-02-15T22:41:10.611 INFO:tasks.workunit.client.1.smithi082.stdout:9/185: dread d8/d12/f14 [0,4194304] 0 2024-02-15T22:41:10.614 INFO:tasks.workunit.client.1.smithi082.stdout:9/186: dread d8/d12/f14 [0,4194304] 0 2024-02-15T22:41:10.616 INFO:tasks.workunit.client.1.smithi082.stdout:9/187: mkdir d8/d24/d2e 0 2024-02-15T22:41:10.617 INFO:tasks.workunit.client.1.smithi082.stdout:9/188: dread d8/d12/f29 [0,4194304] 0 2024-02-15T22:41:10.620 INFO:tasks.workunit.client.1.smithi082.stdout:9/189: creat d8/d12/f2f x:0 0 0 2024-02-15T22:41:10.620 INFO:tasks.workunit.client.1.smithi082.stdout:5/134: rmdir d5/da 39 2024-02-15T22:41:10.620 INFO:tasks.workunit.client.1.smithi082.stdout:5/135: dread - d5/da/d14/f1b zero size 2024-02-15T22:41:10.623 INFO:tasks.workunit.client.1.smithi082.stdout:5/136: write d5/da/f1c [1424844,119114] 0 2024-02-15T22:41:10.623 INFO:tasks.workunit.client.1.smithi082.stdout:5/137: write d5/da/f24 [943774,51253] 0 2024-02-15T22:41:10.623 INFO:tasks.workunit.client.1.smithi082.stdout:3/111: dread d0/d19/fe [0,4194304] 0 2024-02-15T22:41:10.624 INFO:tasks.workunit.client.1.smithi082.stdout:1/170: dwrite d1/da/d11/f16 [0,4194304] 0 2024-02-15T22:41:10.628 INFO:tasks.workunit.client.1.smithi082.stdout:5/138: rename d5/c8 to d5/c2b 0 2024-02-15T22:41:10.631 INFO:tasks.workunit.client.1.smithi082.stdout:3/112: symlink d0/d19/d14/l22 0 2024-02-15T22:41:10.634 INFO:tasks.workunit.client.1.smithi082.stdout:5/139: mknod d5/c2c 0 2024-02-15T22:41:10.634 INFO:tasks.workunit.client.1.smithi082.stdout:3/113: mknod d0/d19/d14/c23 0 2024-02-15T22:41:10.636 INFO:tasks.workunit.client.1.smithi082.stdout:3/114: rename d0/d19/d14/c23 to d0/d19/d14/d21/c24 0 2024-02-15T22:41:10.637 INFO:tasks.workunit.client.1.smithi082.stdout:3/115: dread - d0/d16/f1f zero size 2024-02-15T22:41:10.661 INFO:tasks.workunit.client.1.smithi082.stdout:4/159: dwrite d0/d8/d1b/f1d [0,4194304] 0 2024-02-15T22:41:10.684 INFO:tasks.workunit.client.1.smithi082.stdout:2/166: dwrite d6/d9/f17 [0,4194304] 0 2024-02-15T22:41:10.685 INFO:tasks.workunit.client.1.smithi082.stdout:6/270: dwrite d2/f52 [0,4194304] 0 2024-02-15T22:41:10.685 INFO:tasks.workunit.client.1.smithi082.stdout:9/190: dwrite d8/f2b [0,4194304] 0 2024-02-15T22:41:10.686 INFO:tasks.workunit.client.1.smithi082.stdout:5/140: dwrite d5/f7 [0,4194304] 0 2024-02-15T22:41:10.686 INFO:tasks.workunit.client.1.smithi082.stdout:5/141: chown d5 0 1 2024-02-15T22:41:10.686 INFO:tasks.workunit.client.1.smithi082.stdout:3/116: dwrite d0/d19/fb [0,4194304] 0 2024-02-15T22:41:10.686 INFO:tasks.workunit.client.1.smithi082.stdout:3/117: chown d0/d19/d14/d21/c24 97 1 2024-02-15T22:41:10.700 INFO:tasks.workunit.client.1.smithi082.stdout:9/191: rename d8/d24/d28 to d8/d12/d30 0 2024-02-15T22:41:10.701 INFO:tasks.workunit.client.1.smithi082.stdout:5/142: creat d5/da/d22/f2d x:0 0 0 2024-02-15T22:41:10.702 INFO:tasks.workunit.client.1.smithi082.stdout:9/192: rmdir d8/d24 39 2024-02-15T22:41:10.702 INFO:tasks.workunit.client.1.smithi082.stdout:9/193: write d8/f2b [4411277,36317] 0 2024-02-15T22:41:10.703 INFO:tasks.workunit.client.1.smithi082.stdout:5/143: rmdir d5/da 39 2024-02-15T22:41:10.705 INFO:tasks.workunit.client.1.smithi082.stdout:9/194: symlink d8/d12/l31 0 2024-02-15T22:41:10.705 INFO:tasks.workunit.client.1.smithi082.stdout:9/195: truncate d8/d12/f2f 566316 0 2024-02-15T22:41:10.705 INFO:tasks.workunit.client.1.smithi082.stdout:5/144: creat d5/f2e x:0 0 0 2024-02-15T22:41:10.706 INFO:tasks.workunit.client.1.smithi082.stdout:6/271: write d2/f52 [1208152,51879] 0 2024-02-15T22:41:10.706 INFO:tasks.workunit.client.1.smithi082.stdout:9/196: dread d8/d12/f29 [0,4194304] 0 2024-02-15T22:41:10.706 INFO:tasks.workunit.client.1.smithi082.stdout:9/197: readlink d8/d12/l20 0 2024-02-15T22:41:10.708 INFO:tasks.workunit.client.1.smithi082.stdout:5/145: creat d5/da/f2f x:0 0 0 2024-02-15T22:41:10.708 INFO:tasks.workunit.client.1.smithi082.stdout:5/146: chown d5/da/d14/c13 264 1 2024-02-15T22:41:10.708 INFO:tasks.workunit.client.1.smithi082.stdout:5/147: readlink d5/da/l1e 0 2024-02-15T22:41:10.708 INFO:tasks.workunit.client.1.smithi082.stdout:6/272: rmdir d2/d18/d23/d3c 39 2024-02-15T22:41:10.709 INFO:tasks.workunit.client.1.smithi082.stdout:5/148: symlink d5/l30 0 2024-02-15T22:41:10.710 INFO:tasks.workunit.client.1.smithi082.stdout:5/149: creat d5/da/d14/f31 x:0 0 0 2024-02-15T22:41:10.710 INFO:tasks.workunit.client.1.smithi082.stdout:9/198: dread f5 [0,4194304] 0 2024-02-15T22:41:10.711 INFO:tasks.workunit.client.1.smithi082.stdout:5/150: link d5/f7 d5/f32 0 2024-02-15T22:41:10.713 INFO:tasks.workunit.client.1.smithi082.stdout:5/151: mknod d5/da/dc/c33 0 2024-02-15T22:41:10.715 INFO:tasks.workunit.client.1.smithi082.stdout:5/152: unlink d5/da/f2f 0 2024-02-15T22:41:10.718 INFO:tasks.workunit.client.1.smithi082.stdout:3/118: dwrite d0/f1c [0,4194304] 0 2024-02-15T22:41:10.718 INFO:tasks.workunit.client.1.smithi082.stdout:3/119: read d0/dc/f20 [465932,122787] 0 2024-02-15T22:41:10.718 INFO:tasks.workunit.client.1.smithi082.stdout:3/120: fsync d0/d19/f1a 0 2024-02-15T22:41:10.718 INFO:tasks.workunit.client.1.smithi082.stdout:3/121: creat d0/d19/f25 x:0 0 0 2024-02-15T22:41:10.719 INFO:tasks.workunit.client.1.smithi082.stdout:2/167: dwrite d6/dc/f10 [4194304,4194304] 0 2024-02-15T22:41:10.734 INFO:tasks.workunit.client.1.smithi082.stdout:5/153: rmdir d5 39 2024-02-15T22:41:10.790 INFO:tasks.workunit.client.1.smithi082.stdout:2/168: dwrite d6/d18/f22 [0,4194304] 0 2024-02-15T22:41:10.790 INFO:tasks.workunit.client.1.smithi082.stdout:2/169: rename d6/dc/dd/d1d to d6/dc/dd/d1d/d2b 22 2024-02-15T22:41:10.791 INFO:tasks.workunit.client.1.smithi082.stdout:2/170: fsync d6/f26 0 2024-02-15T22:41:10.791 INFO:tasks.workunit.client.1.smithi082.stdout:9/199: dwrite d8/f2c [0,4194304] 0 2024-02-15T22:41:10.791 INFO:tasks.workunit.client.1.smithi082.stdout:6/273: dwrite d2/f52 [0,4194304] 0 2024-02-15T22:41:10.791 INFO:tasks.workunit.client.1.smithi082.stdout:3/122: dwrite d0/d16/f12 [0,4194304] 0 2024-02-15T22:41:10.791 INFO:tasks.workunit.client.1.smithi082.stdout:5/154: dwrite d5/f7 [0,4194304] 0 2024-02-15T22:41:10.791 INFO:tasks.workunit.client.1.smithi082.stdout:3/123: chown d0/dc/fd 11268 1 2024-02-15T22:41:10.800 INFO:tasks.workunit.client.1.smithi082.stdout:9/200: mknod d8/d12/c32 0 2024-02-15T22:41:10.800 INFO:tasks.workunit.client.1.smithi082.stdout:9/201: getdents d8/d24/d2e 0 2024-02-15T22:41:10.802 INFO:tasks.workunit.client.1.smithi082.stdout:6/274: symlink d2/d18/d23/d3c/d47/l57 0 2024-02-15T22:41:10.803 INFO:tasks.workunit.client.1.smithi082.stdout:5/155: symlink d5/da/d22/l34 0 2024-02-15T22:41:10.804 INFO:tasks.workunit.client.1.smithi082.stdout:9/202: mkdir d8/d12/d33 0 2024-02-15T22:41:10.805 INFO:tasks.workunit.client.1.smithi082.stdout:5/156: getdents d5/da 0 2024-02-15T22:41:10.805 INFO:tasks.workunit.client.1.smithi082.stdout:5/157: chown d5/da 11473 1 2024-02-15T22:41:10.805 INFO:tasks.workunit.client.1.smithi082.stdout:5/158: chown d5/da/d14 518 1 2024-02-15T22:41:10.805 INFO:tasks.workunit.client.1.smithi082.stdout:9/203: creat d8/d24/d2e/f34 x:0 0 0 2024-02-15T22:41:10.807 INFO:tasks.workunit.client.1.smithi082.stdout:9/204: unlink d8/d12/f14 0 2024-02-15T22:41:10.807 INFO:tasks.workunit.client.1.smithi082.stdout:9/205: truncate d8/f1c 9114317 0 2024-02-15T22:41:10.807 INFO:tasks.workunit.client.1.smithi082.stdout:9/206: truncate d8/f18 978811 0 2024-02-15T22:41:10.807 INFO:tasks.workunit.client.1.smithi082.stdout:6/275: dread d2/fd [0,4194304] 0 2024-02-15T22:41:10.808 INFO:tasks.workunit.client.1.smithi082.stdout:9/207: unlink d8/le 0 2024-02-15T22:41:10.822 INFO:tasks.workunit.client.1.smithi082.stdout:9/208: write d8/f2c [1359328,6833] 0 2024-02-15T22:41:10.824 INFO:tasks.workunit.client.1.smithi082.stdout:3/124: dwrite d0/d16/f1f [0,4194304] 0 2024-02-15T22:41:10.824 INFO:tasks.workunit.client.1.smithi082.stdout:3/125: readlink d0/d19/d14/l17 0 2024-02-15T22:41:10.825 INFO:tasks.workunit.client.1.smithi082.stdout:0/155: sync 2024-02-15T22:41:10.825 INFO:tasks.workunit.client.1.smithi082.stdout:7/136: sync 2024-02-15T22:41:10.825 INFO:tasks.workunit.client.1.smithi082.stdout:8/112: sync 2024-02-15T22:41:10.825 INFO:tasks.workunit.client.1.smithi082.stdout:8/113: creat d1/d7/de/f2f x:0 0 0 2024-02-15T22:41:10.826 INFO:tasks.workunit.client.1.smithi082.stdout:1/171: sync 2024-02-15T22:41:10.826 INFO:tasks.workunit.client.1.smithi082.stdout:6/276: write d2/f1c [3489843,21292] 0 2024-02-15T22:41:10.826 INFO:tasks.workunit.client.1.smithi082.stdout:6/277: truncate d2/d30/d3b/f42 815970 0 2024-02-15T22:41:10.826 INFO:tasks.workunit.client.1.smithi082.stdout:6/278: truncate d2/fd 5874230 0 2024-02-15T22:41:10.827 INFO:tasks.workunit.client.1.smithi082.stdout:2/171: dwrite f5 [0,4194304] 0 2024-02-15T22:41:10.827 INFO:tasks.workunit.client.1.smithi082.stdout:2/172: fsync d6/d9/f19 0 2024-02-15T22:41:10.827 INFO:tasks.workunit.client.1.smithi082.stdout:2/173: creat d6/dc/f2c x:0 0 0 2024-02-15T22:41:10.827 INFO:tasks.workunit.client.1.smithi082.stdout:3/126: creat d0/dc/f26 x:0 0 0 2024-02-15T22:41:10.828 INFO:tasks.workunit.client.1.smithi082.stdout:0/156: dread d3/d16/f2a [0,4194304] 0 2024-02-15T22:41:10.828 INFO:tasks.workunit.client.1.smithi082.stdout:7/137: creat d12/d27/f2f x:0 0 0 2024-02-15T22:41:10.830 INFO:tasks.workunit.client.1.smithi082.stdout:1/172: truncate d1/da/d11/f33 386012 0 2024-02-15T22:41:10.831 INFO:tasks.workunit.client.1.smithi082.stdout:6/279: symlink d2/d18/l58 0 2024-02-15T22:41:10.831 INFO:tasks.workunit.client.1.smithi082.stdout:6/280: creat d2/d18/d23/d3c/d47/f59 x:0 0 0 2024-02-15T22:41:10.834 INFO:tasks.workunit.client.1.smithi082.stdout:2/174: dread d6/d9/f1e [0,4194304] 0 2024-02-15T22:41:10.834 INFO:tasks.workunit.client.1.smithi082.stdout:3/127: mknod d0/dc/c27 0 2024-02-15T22:41:10.835 INFO:tasks.workunit.client.1.smithi082.stdout:0/157: getdents d3/d19/d25 0 2024-02-15T22:41:10.835 INFO:tasks.workunit.client.1.smithi082.stdout:0/158: write d3/f34 [3033962,117664] 0 2024-02-15T22:41:10.837 INFO:tasks.workunit.client.1.smithi082.stdout:1/173: creat d1/da/d14/d18/f3a x:0 0 0 2024-02-15T22:41:10.837 INFO:tasks.workunit.client.1.smithi082.stdout:7/138: read d12/d17/f1a [55883,42329] 0 2024-02-15T22:41:10.839 INFO:tasks.workunit.client.1.smithi082.stdout:2/175: truncate d6/f8 1426707 0 2024-02-15T22:41:10.840 INFO:tasks.workunit.client.1.smithi082.stdout:8/114: dread d1/d7/de/ff [4194304,4194304] 0 2024-02-15T22:41:10.840 INFO:tasks.workunit.client.1.smithi082.stdout:0/159: creat d3/d16/f39 x:0 0 0 2024-02-15T22:41:10.840 INFO:tasks.workunit.client.1.smithi082.stdout:0/160: readlink d3/d16/l35 0 2024-02-15T22:41:10.842 INFO:tasks.workunit.client.1.smithi082.stdout:1/174: rename d1/da/fe to d1/da/d14/d18/d1f/d2f/f3b 0 2024-02-15T22:41:10.842 INFO:tasks.workunit.client.1.smithi082.stdout:1/175: chown d1/da/d11/c31 0 1 2024-02-15T22:41:10.842 INFO:tasks.workunit.client.1.smithi082.stdout:1/176: fdatasync d1/da/d14/f2a 0 2024-02-15T22:41:10.843 INFO:tasks.workunit.client.1.smithi082.stdout:2/176: truncate d6/d9/f17 1409098 0 2024-02-15T22:41:10.844 INFO:tasks.workunit.client.1.smithi082.stdout:0/161: truncate d3/d16/f1a 116324 0 2024-02-15T22:41:10.845 INFO:tasks.workunit.client.1.smithi082.stdout:2/177: write f2 [2021913,6497] 0 2024-02-15T22:41:10.846 INFO:tasks.workunit.client.1.smithi082.stdout:8/115: rename d1/d7/d25 to d1/d7/d9/d24/d30 0 2024-02-15T22:41:10.847 INFO:tasks.workunit.client.1.smithi082.stdout:7/139: dread f7 [4194304,4194304] 0 2024-02-15T22:41:10.847 INFO:tasks.workunit.client.1.smithi082.stdout:1/177: unlink d1/f2e 0 2024-02-15T22:41:10.849 INFO:tasks.workunit.client.1.smithi082.stdout:2/178: symlink d6/dc/dd/d1d/l2d 0 2024-02-15T22:41:10.852 INFO:tasks.workunit.client.1.smithi082.stdout:2/179: rename d6/dc/c1c to d6/dc/dd/d1d/c2e 0 2024-02-15T22:41:10.854 INFO:tasks.workunit.client.1.smithi082.stdout:8/116: mknod d1/d7/d9/c31 0 2024-02-15T22:41:10.854 INFO:tasks.workunit.client.1.smithi082.stdout:8/117: truncate d1/d7/f22 841516 0 2024-02-15T22:41:10.855 INFO:tasks.workunit.client.1.smithi082.stdout:8/118: creat d1/d7/de/f32 x:0 0 0 2024-02-15T22:41:10.855 INFO:tasks.workunit.client.1.smithi082.stdout:8/119: dread - d1/d7/de/f2e zero size 2024-02-15T22:41:10.856 INFO:tasks.workunit.client.1.smithi082.stdout:8/120: truncate d1/d7/de/ff 1780245 0 2024-02-15T22:41:10.856 INFO:tasks.workunit.client.1.smithi082.stdout:8/121: truncate d1/f1c 600614 0 2024-02-15T22:41:10.856 INFO:tasks.workunit.client.1.smithi082.stdout:8/122: stat d1/d7/d9/d24/d30 0 2024-02-15T22:41:10.856 INFO:tasks.workunit.client.1.smithi082.stdout:8/123: chown d1/l1f 369890 1 2024-02-15T22:41:10.857 INFO:tasks.workunit.client.1.smithi082.stdout:8/124: mkdir d1/d7/d9/d24/d33 0 2024-02-15T22:41:10.857 INFO:tasks.workunit.client.1.smithi082.stdout:8/125: dread - d1/d7/de/d1e/f20 zero size 2024-02-15T22:41:10.858 INFO:tasks.workunit.client.1.smithi082.stdout:8/126: dread d1/f5 [0,4194304] 0 2024-02-15T22:41:10.858 INFO:tasks.workunit.client.1.smithi082.stdout:8/127: dread - d1/d7/de/d1e/f20 zero size 2024-02-15T22:41:10.858 INFO:tasks.workunit.client.1.smithi082.stdout:8/128: stat d1/d7/d9/c31 0 2024-02-15T22:41:10.858 INFO:tasks.workunit.client.1.smithi082.stdout:8/129: readlink d1/l1f 0 2024-02-15T22:41:10.868 INFO:tasks.workunit.client.1.smithi082.stdout:5/159: dwrite d5/f7 [0,4194304] 0 2024-02-15T22:41:10.868 INFO:tasks.workunit.client.1.smithi082.stdout:5/160: fsync d5/da/f25 0 2024-02-15T22:41:10.881 INFO:tasks.workunit.client.1.smithi082.stdout:5/161: write d5/f7 [1570487,96369] 0 2024-02-15T22:41:10.882 INFO:tasks.workunit.client.1.smithi082.stdout:5/162: getdents d5/da/dc 0 2024-02-15T22:41:10.884 INFO:tasks.workunit.client.1.smithi082.stdout:5/163: getdents d5/da/dc 0 2024-02-15T22:41:10.884 INFO:tasks.workunit.client.1.smithi082.stdout:5/164: fdatasync d5/da/f23 0 2024-02-15T22:41:10.884 INFO:tasks.workunit.client.1.smithi082.stdout:5/165: chown d5/da/d22/c2a 11 1 2024-02-15T22:41:10.884 INFO:tasks.workunit.client.1.smithi082.stdout:5/166: write d5/da/f24 [1040173,20838] 0 2024-02-15T22:41:10.885 INFO:tasks.workunit.client.1.smithi082.stdout:5/167: creat d5/da/d22/f35 x:0 0 0 2024-02-15T22:41:10.885 INFO:tasks.workunit.client.1.smithi082.stdout:5/168: stat d5/da/l29 0 2024-02-15T22:41:10.885 INFO:tasks.workunit.client.1.smithi082.stdout:5/169: stat d5/c2c 0 2024-02-15T22:41:10.905 INFO:tasks.workunit.client.1.smithi082.stdout:9/209: dwrite d8/f9 [4194304,4194304] 0 2024-02-15T22:41:10.907 INFO:tasks.workunit.client.1.smithi082.stdout:9/210: unlink d8/lb 0 2024-02-15T22:41:10.920 INFO:tasks.workunit.client.1.smithi082.stdout:9/211: getdents d8/d12 0 2024-02-15T22:41:10.921 INFO:tasks.workunit.client.1.smithi082.stdout:9/212: rmdir d8/d24 39 2024-02-15T22:41:10.924 INFO:tasks.workunit.client.1.smithi082.stdout:7/140: dwrite d12/d27/f2f [0,4194304] 0 2024-02-15T22:41:10.926 INFO:tasks.workunit.client.1.smithi082.stdout:2/180: dwrite d6/d9/f1e [0,4194304] 0 2024-02-15T22:41:10.926 INFO:tasks.workunit.client.1.smithi082.stdout:3/128: dwrite d0/d19/fe [0,4194304] 0 2024-02-15T22:41:10.926 INFO:tasks.workunit.client.1.smithi082.stdout:2/181: stat d6/dc/dd/d1d/f1f 0 2024-02-15T22:41:10.929 INFO:tasks.workunit.client.1.smithi082.stdout:8/130: dwrite d1/f5 [0,4194304] 0 2024-02-15T22:41:10.929 INFO:tasks.workunit.client.1.smithi082.stdout:8/131: fdatasync d1/f18 0 2024-02-15T22:41:10.929 INFO:tasks.workunit.client.1.smithi082.stdout:5/170: dwrite d5/da/d14/f31 [0,4194304] 0 2024-02-15T22:41:10.929 INFO:tasks.workunit.client.1.smithi082.stdout:1/178: dwrite d1/da/f24 [0,4194304] 0 2024-02-15T22:41:10.930 INFO:tasks.workunit.client.1.smithi082.stdout:0/162: dwrite d3/f34 [0,4194304] 0 2024-02-15T22:41:10.931 INFO:tasks.workunit.client.1.smithi082.stdout:2/182: creat d6/dc/d12/d23/f2f x:0 0 0 2024-02-15T22:41:10.933 INFO:tasks.workunit.client.1.smithi082.stdout:6/281: getdents d2/d18/d23/d3c/d47 0 2024-02-15T22:41:10.933 INFO:tasks.workunit.client.1.smithi082.stdout:6/282: chown d2/f1a 13509 1 2024-02-15T22:41:10.933 INFO:tasks.workunit.client.1.smithi082.stdout:6/283: stat d2/d18/d23/f35 0 2024-02-15T22:41:10.937 INFO:tasks.workunit.client.1.smithi082.stdout:8/132: unlink d1/d7/f22 0 2024-02-15T22:41:10.939 INFO:tasks.workunit.client.1.smithi082.stdout:3/129: write d0/d19/fb [1959423,18213] 0 2024-02-15T22:41:10.940 INFO:tasks.workunit.client.1.smithi082.stdout:3/130: chown d0/dc/c27 19621 1 2024-02-15T22:41:10.940 INFO:tasks.workunit.client.1.smithi082.stdout:3/131: chown d0/d16/f1f 1 1 2024-02-15T22:41:10.941 INFO:tasks.workunit.client.1.smithi082.stdout:9/213: dwrite d8/d12/f1d [0,4194304] 0 2024-02-15T22:41:10.943 INFO:tasks.workunit.client.1.smithi082.stdout:0/163: write d3/d16/f1a [118268,119699] 0 2024-02-15T22:41:10.946 INFO:tasks.workunit.client.1.smithi082.stdout:6/284: write d2/f52 [1528932,43037] 0 2024-02-15T22:41:10.946 INFO:tasks.workunit.client.1.smithi082.stdout:1/179: mknod d1/da/c3c 0 2024-02-15T22:41:10.946 INFO:tasks.workunit.client.1.smithi082.stdout:1/180: creat d1/f3d x:0 0 0 2024-02-15T22:41:10.947 INFO:tasks.workunit.client.1.smithi082.stdout:2/183: creat d6/dc/dd/d24/f30 x:0 0 0 2024-02-15T22:41:10.949 INFO:tasks.workunit.client.1.smithi082.stdout:8/133: mknod d1/d7/d9/d24/c34 0 2024-02-15T22:41:10.952 INFO:tasks.workunit.client.1.smithi082.stdout:3/132: link d0/d19/fe d0/d19/d14/f28 0 2024-02-15T22:41:10.955 INFO:tasks.workunit.client.1.smithi082.stdout:0/164: write d3/f13 [1952386,125998] 0 2024-02-15T22:41:10.955 INFO:tasks.workunit.client.1.smithi082.stdout:0/165: dread - d3/d19/f24 zero size 2024-02-15T22:41:10.955 INFO:tasks.workunit.client.1.smithi082.stdout:0/166: fsync d3/d19/f2e 0 2024-02-15T22:41:10.957 INFO:tasks.workunit.client.1.smithi082.stdout:5/171: dwrite d5/da/dc/f20 [0,4194304] 0 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:6/285: dread d2/d18/d23/f35 [0,4194304] 0 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/172: fdatasync d5/da/f23 0 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/173: write d5/da/dc/f15 [1329644,65250] 0 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/174: write d5/da/d22/f35 [678218,28012] 0 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/175: write d5/da/d22/f2d [112080,12530] 0 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/176: dread - d5/da/d14/f1b zero size 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/177: chown d5/c2b 266195942 1 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/178: chown d5/da/d14/f1b 3410931 1 2024-02-15T22:41:10.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/179: dread - d5/da/f26 zero size 2024-02-15T22:41:10.963 INFO:tasks.workunit.client.1.smithi082.stdout:9/214: mknod d8/d24/d2e/c35 0 2024-02-15T22:41:10.963 INFO:tasks.workunit.client.1.smithi082.stdout:9/215: fsync d8/f2c 0 2024-02-15T22:41:10.965 INFO:tasks.workunit.client.1.smithi082.stdout:1/181: creat d1/da/d14/d18/d1f/d2f/f3e x:0 0 0 2024-02-15T22:41:10.966 INFO:tasks.workunit.client.1.smithi082.stdout:3/133: mkdir d0/d19/d14/d21/d29 0 2024-02-15T22:41:10.966 INFO:tasks.workunit.client.1.smithi082.stdout:3/134: dread - d0/d19/f25 zero size 2024-02-15T22:41:10.969 INFO:tasks.workunit.client.1.smithi082.stdout:5/180: mknod d5/da/d14/c36 0 2024-02-15T22:41:10.969 INFO:tasks.workunit.client.1.smithi082.stdout:5/181: fsync d5/da/dc/ff 0 2024-02-15T22:41:10.969 INFO:tasks.workunit.client.1.smithi082.stdout:5/182: getdents d5/da 0 2024-02-15T22:41:10.970 INFO:tasks.workunit.client.1.smithi082.stdout:1/182: rmdir d1/da/d14/d37 0 2024-02-15T22:41:10.971 INFO:tasks.workunit.client.1.smithi082.stdout:3/135: creat d0/d19/d14/f2a x:0 0 0 2024-02-15T22:41:10.971 INFO:tasks.workunit.client.1.smithi082.stdout:3/136: stat d0/d19/fb 0 2024-02-15T22:41:10.973 INFO:tasks.workunit.client.1.smithi082.stdout:5/183: mkdir d5/da/d14/d37 0 2024-02-15T22:41:10.973 INFO:tasks.workunit.client.1.smithi082.stdout:5/184: write d5/da/dc/f10 [4541365,15151] 0 2024-02-15T22:41:10.976 INFO:tasks.workunit.client.1.smithi082.stdout:5/185: rmdir d5/da/d14/d37 0 2024-02-15T22:41:10.976 INFO:tasks.workunit.client.1.smithi082.stdout:5/186: read d5/f7 [2292111,55037] 0 2024-02-15T22:41:10.976 INFO:tasks.workunit.client.1.smithi082.stdout:5/187: write d5/f2e [305782,126874] 0 2024-02-15T22:41:10.976 INFO:tasks.workunit.client.1.smithi082.stdout:5/188: creat d5/da/d22/f38 x:0 0 0 2024-02-15T22:41:10.979 INFO:tasks.workunit.client.1.smithi082.stdout:5/189: creat d5/f39 x:0 0 0 2024-02-15T22:41:10.980 INFO:tasks.workunit.client.1.smithi082.stdout:9/216: read d8/f1f [925771,99493] 0 2024-02-15T22:41:10.982 INFO:tasks.workunit.client.1.smithi082.stdout:5/190: rename d5/da/d14/c36 to d5/c3a 0 2024-02-15T22:41:10.982 INFO:tasks.workunit.client.1.smithi082.stdout:5/191: fdatasync d5/da/d22/f38 0 2024-02-15T22:41:10.982 INFO:tasks.workunit.client.1.smithi082.stdout:5/192: creat d5/f3b x:0 0 0 2024-02-15T22:41:10.982 INFO:tasks.workunit.client.1.smithi082.stdout:5/193: read d5/f7 [1284222,123057] 0 2024-02-15T22:41:10.982 INFO:tasks.workunit.client.1.smithi082.stdout:5/194: read d5/da/d14/f18 [225924,93705] 0 2024-02-15T22:41:10.986 INFO:tasks.workunit.client.1.smithi082.stdout:3/137: write d0/dc/fd [276895,18549] 0 2024-02-15T22:41:11.005 INFO:tasks.workunit.client.1.smithi082.stdout:4/160: sync 2024-02-15T22:41:11.005 INFO:tasks.workunit.client.1.smithi082.stdout:4/161: fdatasync d0/d8/d1b/f35 0 2024-02-15T22:41:11.006 INFO:tasks.workunit.client.1.smithi082.stdout:5/195: read d5/da/dc/ff [3325672,76762] 0 2024-02-15T22:41:11.009 INFO:tasks.workunit.client.1.smithi082.stdout:4/162: unlink d0/d16/f1f 0 2024-02-15T22:41:11.011 INFO:tasks.workunit.client.1.smithi082.stdout:4/163: symlink d0/d8/l38 0 2024-02-15T22:41:11.038 INFO:tasks.workunit.client.1.smithi082.stdout:2/184: dwrite d6/f7 [0,4194304] 0 2024-02-15T22:41:11.041 INFO:tasks.workunit.client.1.smithi082.stdout:2/185: rmdir d6/d2a 0 2024-02-15T22:41:11.041 INFO:tasks.workunit.client.1.smithi082.stdout:2/186: readlink d6/dc/l1b 0 2024-02-15T22:41:11.045 INFO:tasks.workunit.client.1.smithi082.stdout:6/286: dwrite d2/f1c [0,4194304] 0 2024-02-15T22:41:11.045 INFO:tasks.workunit.client.1.smithi082.stdout:6/287: stat d2/d18/d23/c32 0 2024-02-15T22:41:11.045 INFO:tasks.workunit.client.1.smithi082.stdout:6/288: creat d2/d18/f5a x:0 0 0 2024-02-15T22:41:11.046 INFO:tasks.workunit.client.1.smithi082.stdout:0/167: dwrite d3/d16/f18 [0,4194304] 0 2024-02-15T22:41:11.046 INFO:tasks.workunit.client.1.smithi082.stdout:9/217: dwrite d8/f22 [0,4194304] 0 2024-02-15T22:41:11.046 INFO:tasks.workunit.client.1.smithi082.stdout:1/183: dwrite d1/da/f24 [0,4194304] 0 2024-02-15T22:41:11.047 INFO:tasks.workunit.client.1.smithi082.stdout:4/164: dwrite d0/d8/f25 [0,4194304] 0 2024-02-15T22:41:11.047 INFO:tasks.workunit.client.1.smithi082.stdout:4/165: truncate d0/d8/d1b/f35 223549 0 2024-02-15T22:41:11.047 INFO:tasks.workunit.client.1.smithi082.stdout:3/138: dwrite d0/d16/f12 [4194304,4194304] 0 2024-02-15T22:41:11.051 INFO:tasks.workunit.client.1.smithi082.stdout:5/196: truncate d5/f32 3535785 0 2024-02-15T22:41:11.051 INFO:tasks.workunit.client.1.smithi082.stdout:5/197: write d5/da/dc/ff [3653324,85908] 0 2024-02-15T22:41:11.055 INFO:tasks.workunit.client.1.smithi082.stdout:0/168: symlink d3/d19/d25/l3a 0 2024-02-15T22:41:11.058 INFO:tasks.workunit.client.1.smithi082.stdout:1/184: mkdir d1/da/d11/d3f 0 2024-02-15T22:41:11.063 INFO:tasks.workunit.client.1.smithi082.stdout:2/187: dwrite d6/f7 [0,4194304] 0 2024-02-15T22:41:11.065 INFO:tasks.workunit.client.1.smithi082.stdout:4/166: mkdir d0/d8/d32/d39 0 2024-02-15T22:41:11.065 INFO:tasks.workunit.client.1.smithi082.stdout:4/167: truncate d0/d8/d1b/dd/f2f 811855 0 2024-02-15T22:41:11.065 INFO:tasks.workunit.client.1.smithi082.stdout:9/218: write d8/f9 [1779033,31009] 0 2024-02-15T22:41:11.066 INFO:tasks.workunit.client.1.smithi082.stdout:1/185: write d1/da/f1c [6735216,79914] 0 2024-02-15T22:41:11.068 INFO:tasks.workunit.client.1.smithi082.stdout:3/139: mkdir d0/d16/d2b 0 2024-02-15T22:41:11.072 INFO:tasks.workunit.client.1.smithi082.stdout:6/289: unlink d2/d18/f5a 0 2024-02-15T22:41:11.076 INFO:tasks.workunit.client.1.smithi082.stdout:5/198: creat d5/da/f3c x:0 0 0 2024-02-15T22:41:11.077 INFO:tasks.workunit.client.1.smithi082.stdout:0/169: mknod d3/d19/d20/c3b 0 2024-02-15T22:41:11.077 INFO:tasks.workunit.client.1.smithi082.stdout:0/170: dread - d3/d16/f39 zero size 2024-02-15T22:41:11.081 INFO:tasks.workunit.client.1.smithi082.stdout:2/188: mknod d6/c31 0 2024-02-15T22:41:11.082 INFO:tasks.workunit.client.1.smithi082.stdout:4/168: creat d0/d16/f3a x:0 0 0 2024-02-15T22:41:11.089 INFO:tasks.workunit.client.1.smithi082.stdout:3/140: rmdir d0/d16/d2b 0 2024-02-15T22:41:11.090 INFO:tasks.workunit.client.1.smithi082.stdout:5/199: getdents d5/da/d14 0 2024-02-15T22:41:11.092 INFO:tasks.workunit.client.1.smithi082.stdout:2/189: symlink d6/dc/d12/l32 0 2024-02-15T22:41:11.095 INFO:tasks.workunit.client.1.smithi082.stdout:9/219: creat d8/d12/d30/f36 x:0 0 0 2024-02-15T22:41:11.099 INFO:tasks.workunit.client.1.smithi082.stdout:6/290: dwrite d2/d18/d23/d3c/d47/f59 [0,4194304] 0 2024-02-15T22:41:11.103 INFO:tasks.workunit.client.1.smithi082.stdout:1/186: rmdir d1 39 2024-02-15T22:41:11.103 INFO:tasks.workunit.client.1.smithi082.stdout:1/187: chown d1/da/d14/d18/c38 149 1 2024-02-15T22:41:11.104 INFO:tasks.workunit.client.1.smithi082.stdout:0/171: dwrite d3/f34 [0,4194304] 0 2024-02-15T22:41:11.104 INFO:tasks.workunit.client.1.smithi082.stdout:0/172: dread - d3/d19/f29 zero size 2024-02-15T22:41:11.104 INFO:tasks.workunit.client.1.smithi082.stdout:3/141: mknod d0/d19/c2c 0 2024-02-15T22:41:11.105 INFO:tasks.workunit.client.1.smithi082.stdout:9/220: chown d8/f1c 142967 1 2024-02-15T22:41:11.108 INFO:tasks.workunit.client.1.smithi082.stdout:1/188: rmdir d1/da/d11 39 2024-02-15T22:41:11.108 INFO:tasks.workunit.client.1.smithi082.stdout:1/189: truncate d1/da/d14/d18/f3a 765395 0 2024-02-15T22:41:11.108 INFO:tasks.workunit.client.1.smithi082.stdout:1/190: truncate d1/da/d14/d18/f3a 1166035 0 2024-02-15T22:41:11.108 INFO:tasks.workunit.client.1.smithi082.stdout:1/191: write d1/f3d [849010,80845] 0 2024-02-15T22:41:11.108 INFO:tasks.workunit.client.1.smithi082.stdout:1/192: chown d1/da/d14/f2d 114 1 2024-02-15T22:41:11.109 INFO:tasks.workunit.client.1.smithi082.stdout:9/221: write d8/f18 [1080675,97914] 0 2024-02-15T22:41:11.110 INFO:tasks.workunit.client.1.smithi082.stdout:1/193: symlink d1/l40 0 2024-02-15T22:41:11.112 INFO:tasks.workunit.client.1.smithi082.stdout:5/200: dread d5/da/dc/ff [0,4194304] 0 2024-02-15T22:41:11.112 INFO:tasks.workunit.client.1.smithi082.stdout:5/201: truncate d5/da/f3c 162764 0 2024-02-15T22:41:11.114 INFO:tasks.workunit.client.1.smithi082.stdout:9/222: symlink d8/d12/d30/l37 0 2024-02-15T22:41:11.115 INFO:tasks.workunit.client.1.smithi082.stdout:1/194: creat d1/f41 x:0 0 0 2024-02-15T22:41:11.116 INFO:tasks.workunit.client.1.smithi082.stdout:1/195: dread d1/da/d14/d18/f3a [0,4194304] 0 2024-02-15T22:41:11.116 INFO:tasks.workunit.client.1.smithi082.stdout:1/196: truncate d1/da/d14/d18/d1f/d2f/f3e 98824 0 2024-02-15T22:41:11.117 INFO:tasks.workunit.client.1.smithi082.stdout:1/197: symlink d1/da/d14/l42 0 2024-02-15T22:41:11.119 INFO:tasks.workunit.client.1.smithi082.stdout:5/202: rename d5/f7 to d5/da/dc/f3d 0 2024-02-15T22:41:11.120 INFO:tasks.workunit.client.1.smithi082.stdout:5/203: fdatasync d5/da/d14/f1b 0 2024-02-15T22:41:11.121 INFO:tasks.workunit.client.1.smithi082.stdout:5/204: rename d5/da/dc/c1f to d5/da/d14/c3e 0 2024-02-15T22:41:11.121 INFO:tasks.workunit.client.1.smithi082.stdout:5/205: creat d5/da/d22/f3f x:0 0 0 2024-02-15T22:41:11.122 INFO:tasks.workunit.client.1.smithi082.stdout:5/206: creat d5/da/f40 x:0 0 0 2024-02-15T22:41:11.126 INFO:tasks.workunit.client.1.smithi082.stdout:9/223: write d8/f1c [7782480,25731] 0 2024-02-15T22:41:11.127 INFO:tasks.workunit.client.1.smithi082.stdout:1/198: write d1/da/d14/f28 [592226,51563] 0 2024-02-15T22:41:11.135 INFO:tasks.workunit.client.1.smithi082.stdout:2/190: dwrite f2 [0,4194304] 0 2024-02-15T22:41:11.137 INFO:tasks.workunit.client.1.smithi082.stdout:2/191: symlink d6/d18/l33 0 2024-02-15T22:41:11.138 INFO:tasks.workunit.client.1.smithi082.stdout:2/192: mknod d6/d18/c34 0 2024-02-15T22:41:11.138 INFO:tasks.workunit.client.1.smithi082.stdout:2/193: dread - d6/dc/dd/f1a zero size 2024-02-15T22:41:11.138 INFO:tasks.workunit.client.1.smithi082.stdout:2/194: chown d6/d18/c34 35076 1 2024-02-15T22:41:11.139 INFO:tasks.workunit.client.1.smithi082.stdout:1/199: dread d1/da/f24 [0,4194304] 0 2024-02-15T22:41:11.139 INFO:tasks.workunit.client.1.smithi082.stdout:2/195: symlink d6/d9/l35 0 2024-02-15T22:41:11.143 INFO:tasks.workunit.client.1.smithi082.stdout:1/200: creat d1/da/d14/f43 x:0 0 0 2024-02-15T22:41:11.144 INFO:tasks.workunit.client.1.smithi082.stdout:1/201: chown d1/da/d14/d18/f2b 895341370 1 2024-02-15T22:41:11.144 INFO:tasks.workunit.client.1.smithi082.stdout:4/169: dwrite d0/d16/f2b [0,4194304] 0 2024-02-15T22:41:11.144 INFO:tasks.workunit.client.1.smithi082.stdout:4/170: stat d0/d8/d1b 0 2024-02-15T22:41:11.144 INFO:tasks.workunit.client.1.smithi082.stdout:6/291: dwrite d2/d18/d23/f35 [0,4194304] 0 2024-02-15T22:41:11.144 INFO:tasks.workunit.client.1.smithi082.stdout:0/173: dwrite d3/f34 [0,4194304] 0 2024-02-15T22:41:11.144 INFO:tasks.workunit.client.1.smithi082.stdout:0/174: stat d3/d19/d20/d26/f31 0 2024-02-15T22:41:11.146 INFO:tasks.workunit.client.1.smithi082.stdout:2/196: creat d6/dc/dd/d21/f36 x:0 0 0 2024-02-15T22:41:11.146 INFO:tasks.workunit.client.1.smithi082.stdout:2/197: write d6/f26 [749409,18795] 0 2024-02-15T22:41:11.146 INFO:tasks.workunit.client.1.smithi082.stdout:2/198: fdatasync d6/dc/dd/d1d/f1f 0 2024-02-15T22:41:11.146 INFO:tasks.workunit.client.1.smithi082.stdout:2/199: creat d6/d18/f37 x:0 0 0 2024-02-15T22:41:11.149 INFO:tasks.workunit.client.1.smithi082.stdout:1/202: symlink d1/da/d11/d3f/l44 0 2024-02-15T22:41:11.155 INFO:tasks.workunit.client.1.smithi082.stdout:6/292: write d2/d18/d23/d3c/d47/f59 [1531035,62974] 0 2024-02-15T22:41:11.156 INFO:tasks.workunit.client.1.smithi082.stdout:5/207: getdents d5/da/dc 0 2024-02-15T22:41:11.158 INFO:tasks.workunit.client.1.smithi082.stdout:0/175: dread d3/fb [0,4194304] 0 2024-02-15T22:41:11.160 INFO:tasks.workunit.client.1.smithi082.stdout:1/203: symlink d1/da/l45 0 2024-02-15T22:41:11.161 INFO:tasks.workunit.client.1.smithi082.stdout:2/200: dread f5 [0,4194304] 0 2024-02-15T22:41:11.161 INFO:tasks.workunit.client.1.smithi082.stdout:2/201: readlink d6/d9/l15 0 2024-02-15T22:41:11.162 INFO:tasks.workunit.client.1.smithi082.stdout:6/293: symlink d2/d18/l5b 0 2024-02-15T22:41:11.162 INFO:tasks.workunit.client.1.smithi082.stdout:6/294: write d2/d18/d23/d3c/f3d [449756,14056] 0 2024-02-15T22:41:11.162 INFO:tasks.workunit.client.1.smithi082.stdout:6/295: creat d2/f5c x:0 0 0 2024-02-15T22:41:11.163 INFO:tasks.workunit.client.1.smithi082.stdout:5/208: mknod d5/c41 0 2024-02-15T22:41:11.163 INFO:tasks.workunit.client.1.smithi082.stdout:5/209: read d5/da/dc/ff [3878631,10972] 0 2024-02-15T22:41:11.164 INFO:tasks.workunit.client.1.smithi082.stdout:1/204: stat d1/da/d14/c20 0 2024-02-15T22:41:11.164 INFO:tasks.workunit.client.1.smithi082.stdout:1/205: chown d1/da/d14/d18/d1f/d2f/l32 28323 1 2024-02-15T22:41:11.164 INFO:tasks.workunit.client.1.smithi082.stdout:1/206: fdatasync d1/da/d14/f2a 0 2024-02-15T22:41:11.165 INFO:tasks.workunit.client.1.smithi082.stdout:9/224: dwrite d8/f2c [0,4194304] 0 2024-02-15T22:41:11.166 INFO:tasks.workunit.client.1.smithi082.stdout:4/171: dwrite d0/f31 [0,4194304] 0 2024-02-15T22:41:11.167 INFO:tasks.workunit.client.1.smithi082.stdout:1/207: rename d1/f41 to d1/da/d11/d3f/f46 0 2024-02-15T22:41:11.167 INFO:tasks.workunit.client.1.smithi082.stdout:1/208: write d1/da/d14/f28 [1374490,96633] 0 2024-02-15T22:41:11.167 INFO:tasks.workunit.client.1.smithi082.stdout:1/209: creat d1/f47 x:0 0 0 2024-02-15T22:41:11.171 INFO:tasks.workunit.client.1.smithi082.stdout:4/172: readlink d0/d16/l17 0 2024-02-15T22:41:11.176 INFO:tasks.workunit.client.1.smithi082.stdout:5/210: dread d5/da/dc/f10 [0,4194304] 0 2024-02-15T22:41:11.178 INFO:tasks.workunit.client.1.smithi082.stdout:9/225: link d8/f1f d8/d24/d2e/f38 0 2024-02-15T22:41:11.180 INFO:tasks.workunit.client.1.smithi082.stdout:4/173: rmdir d0/d8/d1b/dd 39 2024-02-15T22:41:11.180 INFO:tasks.workunit.client.1.smithi082.stdout:4/174: creat d0/d8/d1b/f3b x:0 0 0 2024-02-15T22:41:11.183 INFO:tasks.workunit.client.1.smithi082.stdout:9/226: rename d8/d12/f1b to d8/d12/d33/f39 0 2024-02-15T22:41:11.183 INFO:tasks.workunit.client.1.smithi082.stdout:9/227: chown d8/d12/c32 181425267 1 2024-02-15T22:41:11.183 INFO:tasks.workunit.client.1.smithi082.stdout:0/176: dwrite d3/d16/f1a [0,4194304] 0 2024-02-15T22:41:11.183 INFO:tasks.workunit.client.1.smithi082.stdout:0/177: dread - d3/d16/f39 zero size 2024-02-15T22:41:11.183 INFO:tasks.workunit.client.1.smithi082.stdout:5/211: dread d5/da/f24 [0,4194304] 0 2024-02-15T22:41:11.189 INFO:tasks.workunit.client.1.smithi082.stdout:0/178: rename d3/d16/l38 to d3/d19/d1c/l3c 0 2024-02-15T22:41:11.189 INFO:tasks.workunit.client.1.smithi082.stdout:0/179: write d3/d19/d1c/f27 [542093,7448] 0 2024-02-15T22:41:11.190 INFO:tasks.workunit.client.1.smithi082.stdout:5/212: truncate d5/f32 322044 0 2024-02-15T22:41:11.192 INFO:tasks.workunit.client.1.smithi082.stdout:5/213: mknod d5/da/c42 0 2024-02-15T22:41:11.193 INFO:tasks.workunit.client.1.smithi082.stdout:5/214: unlink d5/da/dc/f20 0 2024-02-15T22:41:11.193 INFO:tasks.workunit.client.1.smithi082.stdout:5/215: read - d5/f3b zero size 2024-02-15T22:41:11.195 INFO:tasks.workunit.client.1.smithi082.stdout:2/202: dwrite d6/f7 [0,4194304] 0 2024-02-15T22:41:11.196 INFO:tasks.workunit.client.1.smithi082.stdout:1/210: dwrite d1/da/d14/f2d [0,4194304] 0 2024-02-15T22:41:11.197 INFO:tasks.workunit.client.1.smithi082.stdout:8/134: sync 2024-02-15T22:41:11.197 INFO:tasks.workunit.client.1.smithi082.stdout:7/141: sync 2024-02-15T22:41:11.197 INFO:tasks.workunit.client.1.smithi082.stdout:0/180: fsync d3/d19/d1c/f27 0 2024-02-15T22:41:11.198 INFO:tasks.workunit.client.1.smithi082.stdout:0/181: stat d3/d19/f24 0 2024-02-15T22:41:11.198 INFO:tasks.workunit.client.1.smithi082.stdout:0/182: chown d3/d16/f2a 4 1 2024-02-15T22:41:11.198 INFO:tasks.workunit.client.1.smithi082.stdout:6/296: dwrite d2/d18/d23/d3c/d47/f59 [0,4194304] 0 2024-02-15T22:41:11.200 INFO:tasks.workunit.client.1.smithi082.stdout:8/135: link d1/d7/de/l2b d1/d7/d9/d24/d33/l35 0 2024-02-15T22:41:11.200 INFO:tasks.workunit.client.1.smithi082.stdout:8/136: chown d1/d7/de/d1e/c29 146402159 1 2024-02-15T22:41:11.201 INFO:tasks.workunit.client.1.smithi082.stdout:4/175: read d0/d16/f2d [1469980,106904] 0 2024-02-15T22:41:11.204 INFO:tasks.workunit.client.1.smithi082.stdout:1/211: read d1/f1b [1103471,59378] 0 2024-02-15T22:41:11.204 INFO:tasks.workunit.client.1.smithi082.stdout:1/212: readlink d1/da/d14/l27 0 2024-02-15T22:41:11.204 INFO:tasks.workunit.client.1.smithi082.stdout:1/213: stat d1/da/d11/d3f 0 2024-02-15T22:41:11.205 INFO:tasks.workunit.client.1.smithi082.stdout:6/297: rename d2/c14 to d2/d45/c5d 0 2024-02-15T22:41:11.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/228: dread d8/f19 [4194304,4194304] 0 2024-02-15T22:41:11.205 INFO:tasks.workunit.client.1.smithi082.stdout:6/298: getdents d2/d18/d23/d3c/d47 0 2024-02-15T22:41:11.208 INFO:tasks.workunit.client.1.smithi082.stdout:7/142: dread d12/d17/f19 [0,4194304] 0 2024-02-15T22:41:11.210 INFO:tasks.workunit.client.1.smithi082.stdout:7/143: dread d12/d17/f1a [0,4194304] 0 2024-02-15T22:41:11.210 INFO:tasks.workunit.client.1.smithi082.stdout:7/144: chown d12/d17/f19 3 1 2024-02-15T22:41:11.214 INFO:tasks.workunit.client.1.smithi082.stdout:2/203: dwrite d6/dc/dd/d1d/f1f [0,4194304] 0 2024-02-15T22:41:11.214 INFO:tasks.workunit.client.1.smithi082.stdout:2/204: creat d6/dc/f38 x:0 0 0 2024-02-15T22:41:11.215 INFO:tasks.workunit.client.1.smithi082.stdout:8/137: link d1/f19 d1/d7/de/f36 0 2024-02-15T22:41:11.217 INFO:tasks.workunit.client.1.smithi082.stdout:4/176: mknod d0/d8/d32/d39/c3c 0 2024-02-15T22:41:11.218 INFO:tasks.workunit.client.1.smithi082.stdout:1/214: truncate d1/f4 2354904 0 2024-02-15T22:41:11.218 INFO:tasks.workunit.client.1.smithi082.stdout:5/216: rmdir d5/da/dc 39 2024-02-15T22:41:11.219 INFO:tasks.workunit.client.1.smithi082.stdout:0/183: symlink d3/d16/l3d 0 2024-02-15T22:41:11.220 INFO:tasks.workunit.client.1.smithi082.stdout:9/229: symlink d8/d24/l3a 0 2024-02-15T22:41:11.221 INFO:tasks.workunit.client.1.smithi082.stdout:7/145: link d12/d17/f23 d12/d17/f30 0 2024-02-15T22:41:11.223 INFO:tasks.workunit.client.1.smithi082.stdout:2/205: dread d6/dc/f10 [0,4194304] 0 2024-02-15T22:41:11.223 INFO:tasks.workunit.client.1.smithi082.stdout:2/206: creat d6/dc/dd/d24/f39 x:0 0 0 2024-02-15T22:41:11.223 INFO:tasks.workunit.client.1.smithi082.stdout:2/207: chown f5 287338352 1 2024-02-15T22:41:11.223 INFO:tasks.workunit.client.1.smithi082.stdout:2/208: read - d6/dc/f2c zero size 2024-02-15T22:41:11.224 INFO:tasks.workunit.client.1.smithi082.stdout:4/177: rename d0/d8/f25 to d0/d8/f3d 0 2024-02-15T22:41:11.224 INFO:tasks.workunit.client.1.smithi082.stdout:6/299: dwrite d2/fd [0,4194304] 0 2024-02-15T22:41:11.226 INFO:tasks.workunit.client.1.smithi082.stdout:1/215: creat d1/da/d11/f48 x:0 0 0 2024-02-15T22:41:11.228 INFO:tasks.workunit.client.1.smithi082.stdout:8/138: write d1/f5 [528053,42466] 0 2024-02-15T22:41:11.228 INFO:tasks.workunit.client.1.smithi082.stdout:8/139: write d1/d7/de/d1e/f27 [276912,102044] 0 2024-02-15T22:41:11.228 INFO:tasks.workunit.client.1.smithi082.stdout:8/140: write d1/d7/de/d1e/f27 [1316790,95248] 0 2024-02-15T22:41:11.228 INFO:tasks.workunit.client.1.smithi082.stdout:8/141: readlink d1/d7/l2d 0 2024-02-15T22:41:11.228 INFO:tasks.workunit.client.1.smithi082.stdout:5/217: mkdir d5/da/dc/d43 0 2024-02-15T22:41:11.235 INFO:tasks.workunit.client.1.smithi082.stdout:4/178: rename d0/d8/d1b/dd/l27 to d0/d8/d1b/dd/l3e 0 2024-02-15T22:41:11.235 INFO:tasks.workunit.client.1.smithi082.stdout:4/179: write d0/d8/d1b/f35 [109947,31102] 0 2024-02-15T22:41:11.235 INFO:tasks.workunit.client.1.smithi082.stdout:4/180: truncate d0/d8/d1b/f35 906937 0 2024-02-15T22:41:11.236 INFO:tasks.workunit.client.1.smithi082.stdout:6/300: mknod d2/d18/d39/c5e 0 2024-02-15T22:41:11.237 INFO:tasks.workunit.client.1.smithi082.stdout:6/301: write d2/d30/d3b/f42 [1292251,69845] 0 2024-02-15T22:41:11.238 INFO:tasks.workunit.client.1.smithi082.stdout:1/216: mknod d1/da/d14/d18/d1f/c49 0 2024-02-15T22:41:11.238 INFO:tasks.workunit.client.1.smithi082.stdout:3/142: sync 2024-02-15T22:41:11.238 INFO:tasks.workunit.client.1.smithi082.stdout:3/143: dread - d0/d19/f25 zero size 2024-02-15T22:41:11.243 INFO:tasks.workunit.client.1.smithi082.stdout:9/230: dread d8/f22 [0,4194304] 0 2024-02-15T22:41:11.243 INFO:tasks.workunit.client.1.smithi082.stdout:9/231: write d8/f9 [7448745,41323] 0 2024-02-15T22:41:11.244 INFO:tasks.workunit.client.1.smithi082.stdout:0/184: rename d3/d16/c1e to d3/c3e 0 2024-02-15T22:41:11.247 INFO:tasks.workunit.client.1.smithi082.stdout:4/181: truncate d0/d8/fa 690170 0 2024-02-15T22:41:11.253 INFO:tasks.workunit.client.1.smithi082.stdout:6/302: link d2/d45/l4e d2/d18/d23/d3c/l5f 0 2024-02-15T22:41:11.254 INFO:tasks.workunit.client.1.smithi082.stdout:8/142: mknod d1/d7/d9/c37 0 2024-02-15T22:41:11.254 INFO:tasks.workunit.client.1.smithi082.stdout:8/143: dread - d1/d7/de/f32 zero size 2024-02-15T22:41:11.254 INFO:tasks.workunit.client.1.smithi082.stdout:8/144: creat d1/f38 x:0 0 0 2024-02-15T22:41:11.254 INFO:tasks.workunit.client.1.smithi082.stdout:8/145: fdatasync d1/f14 0 2024-02-15T22:41:11.254 INFO:tasks.workunit.client.1.smithi082.stdout:8/146: truncate d1/f23 370466 0 2024-02-15T22:41:11.257 INFO:tasks.workunit.client.1.smithi082.stdout:9/232: creat d8/d12/d33/f3b x:0 0 0 2024-02-15T22:41:11.258 INFO:tasks.workunit.client.1.smithi082.stdout:7/146: rename l5 to d12/d17/l31 0 2024-02-15T22:41:11.259 INFO:tasks.workunit.client.1.smithi082.stdout:7/147: write d12/d17/f23 [430636,56020] 0 2024-02-15T22:41:11.259 INFO:tasks.workunit.client.1.smithi082.stdout:0/185: rmdir d3/d19/d25 39 2024-02-15T22:41:11.260 INFO:tasks.workunit.client.1.smithi082.stdout:4/182: truncate d0/f2 1777963 0 2024-02-15T22:41:11.263 INFO:tasks.workunit.client.1.smithi082.stdout:9/233: mkdir d8/d12/d30/d3c 0 2024-02-15T22:41:11.263 INFO:tasks.workunit.client.1.smithi082.stdout:9/234: creat d8/d12/d30/f3d x:0 0 0 2024-02-15T22:41:11.263 INFO:tasks.workunit.client.1.smithi082.stdout:9/235: write d8/d12/d30/f36 [206588,107236] 0 2024-02-15T22:41:11.264 INFO:tasks.workunit.client.1.smithi082.stdout:7/148: rmdir d12/d17 39 2024-02-15T22:41:11.266 INFO:tasks.workunit.client.1.smithi082.stdout:0/186: link d3/fe d3/d19/d1c/f3f 0 2024-02-15T22:41:11.266 INFO:tasks.workunit.client.1.smithi082.stdout:0/187: write d3/fe [1872875,86784] 0 2024-02-15T22:41:11.268 INFO:tasks.workunit.client.1.smithi082.stdout:6/303: getdents d2 0 2024-02-15T22:41:11.272 INFO:tasks.workunit.client.1.smithi082.stdout:5/218: dwrite d5/da/f26 [0,4194304] 0 2024-02-15T22:41:11.273 INFO:tasks.workunit.client.1.smithi082.stdout:9/236: unlink d8/c21 0 2024-02-15T22:41:11.274 INFO:tasks.workunit.client.1.smithi082.stdout:3/144: dwrite d0/dc/fd [4194304,4194304] 0 2024-02-15T22:41:11.274 INFO:tasks.workunit.client.1.smithi082.stdout:3/145: chown d0/f2 1210 1 2024-02-15T22:41:11.275 INFO:tasks.workunit.client.1.smithi082.stdout:1/217: dwrite d1/da/d11/f16 [0,4194304] 0 2024-02-15T22:41:11.277 INFO:tasks.workunit.client.1.smithi082.stdout:5/219: symlink d5/da/d14/l44 0 2024-02-15T22:41:11.278 INFO:tasks.workunit.client.1.smithi082.stdout:5/220: write d5/da/d14/f1b [153586,46386] 0 2024-02-15T22:41:11.278 INFO:tasks.workunit.client.1.smithi082.stdout:5/221: write d5/da/d22/f3f [391911,14559] 0 2024-02-15T22:41:11.278 INFO:tasks.workunit.client.1.smithi082.stdout:9/237: mkdir d8/d12/d33/d3e 0 2024-02-15T22:41:11.283 INFO:tasks.workunit.client.1.smithi082.stdout:8/147: dread d1/d7/de/d1e/f27 [0,4194304] 0 2024-02-15T22:41:11.283 INFO:tasks.workunit.client.1.smithi082.stdout:8/148: fsync d1/f1c 0 2024-02-15T22:41:11.283 INFO:tasks.workunit.client.1.smithi082.stdout:8/149: truncate d1/f19 1020472 0 2024-02-15T22:41:11.283 INFO:tasks.workunit.client.1.smithi082.stdout:3/146: rename d0/d16/lf to d0/dc/l2d 0 2024-02-15T22:41:11.284 INFO:tasks.workunit.client.1.smithi082.stdout:8/150: dread d1/d7/de/f36 [0,4194304] 0 2024-02-15T22:41:11.284 INFO:tasks.workunit.client.1.smithi082.stdout:8/151: dread - d1/d7/de/d1e/f20 zero size 2024-02-15T22:41:11.285 INFO:tasks.workunit.client.1.smithi082.stdout:9/238: dread d8/f18 [0,4194304] 0 2024-02-15T22:41:11.285 INFO:tasks.workunit.client.1.smithi082.stdout:9/239: fsync d8/d12/f1e 0 2024-02-15T22:41:11.285 INFO:tasks.workunit.client.1.smithi082.stdout:9/240: chown d8/d24/d2e/c35 9 1 2024-02-15T22:41:11.285 INFO:tasks.workunit.client.1.smithi082.stdout:9/241: stat d8/d24/d2e/c35 0 2024-02-15T22:41:11.285 INFO:tasks.workunit.client.1.smithi082.stdout:9/242: chown d8/d24/l3a 0 1 2024-02-15T22:41:11.288 INFO:tasks.workunit.client.1.smithi082.stdout:0/188: dread d3/f11 [0,4194304] 0 2024-02-15T22:41:11.288 INFO:tasks.workunit.client.1.smithi082.stdout:0/189: write d3/f15 [930711,30965] 0 2024-02-15T22:41:11.298 INFO:tasks.workunit.client.1.smithi082.stdout:9/243: symlink d8/l3f 0 2024-02-15T22:41:11.305 INFO:tasks.workunit.client.1.smithi082.stdout:0/190: read d3/f6 [4681104,74981] 0 2024-02-15T22:41:11.306 INFO:tasks.workunit.client.1.smithi082.stdout:3/147: dread d0/d19/d14/f28 [0,4194304] 0 2024-02-15T22:41:11.306 INFO:tasks.workunit.client.1.smithi082.stdout:0/191: creat d3/f40 x:0 0 0 2024-02-15T22:41:11.308 INFO:tasks.workunit.client.1.smithi082.stdout:3/148: rename d0/d19/d14/d21/d29 to d0/d19/d2e 0 2024-02-15T22:41:11.309 INFO:tasks.workunit.client.1.smithi082.stdout:9/244: write d8/f11 [3280705,51893] 0 2024-02-15T22:41:11.310 INFO:tasks.workunit.client.1.smithi082.stdout:0/192: symlink d3/d16/l41 0 2024-02-15T22:41:11.310 INFO:tasks.workunit.client.1.smithi082.stdout:0/193: write d3/f11 [4412324,25715] 0 2024-02-15T22:41:11.312 INFO:tasks.workunit.client.1.smithi082.stdout:9/245: fdatasync d8/f1a 0 2024-02-15T22:41:11.312 INFO:tasks.workunit.client.1.smithi082.stdout:9/246: fsync d8/d12/f1d 0 2024-02-15T22:41:11.312 INFO:tasks.workunit.client.1.smithi082.stdout:5/222: fsync d5/da/d22/f3f 0 2024-02-15T22:41:11.314 INFO:tasks.workunit.client.1.smithi082.stdout:1/218: dwrite d1/da/d14/d18/d1f/d2f/f3e [0,4194304] 0 2024-02-15T22:41:11.315 INFO:tasks.workunit.client.1.smithi082.stdout:1/219: chown d1/da/d11/c31 3673 1 2024-02-15T22:41:11.315 INFO:tasks.workunit.client.1.smithi082.stdout:4/183: dwrite d0/d8/d1b/f36 [0,4194304] 0 2024-02-15T22:41:11.315 INFO:tasks.workunit.client.1.smithi082.stdout:7/149: dwrite d12/d17/f1d [4194304,4194304] 0 2024-02-15T22:41:11.315 INFO:tasks.workunit.client.1.smithi082.stdout:7/150: readlink d12/d27/l2a 0 2024-02-15T22:41:11.316 INFO:tasks.workunit.client.1.smithi082.stdout:6/304: dwrite d2/d18/f44 [0,4194304] 0 2024-02-15T22:41:11.318 INFO:tasks.workunit.client.1.smithi082.stdout:9/247: symlink d8/d12/d30/l40 0 2024-02-15T22:41:11.320 INFO:tasks.workunit.client.1.smithi082.stdout:8/152: rmdir d1/d7 39 2024-02-15T22:41:11.322 INFO:tasks.workunit.client.1.smithi082.stdout:9/248: dread d8/d12/f29 [0,4194304] 0 2024-02-15T22:41:11.324 INFO:tasks.workunit.client.1.smithi082.stdout:5/223: unlink d5/c2c 0 2024-02-15T22:41:11.324 INFO:tasks.workunit.client.1.smithi082.stdout:5/224: fsync d5/da/f24 0 2024-02-15T22:41:11.327 INFO:tasks.workunit.client.1.smithi082.stdout:1/220: symlink d1/da/d14/l4a 0 2024-02-15T22:41:11.329 INFO:tasks.workunit.client.1.smithi082.stdout:4/184: creat d0/d8/d32/d39/f3f x:0 0 0 2024-02-15T22:41:11.333 INFO:tasks.workunit.client.1.smithi082.stdout:7/151: symlink d12/d17/l32 0 2024-02-15T22:41:11.336 INFO:tasks.workunit.client.1.smithi082.stdout:1/221: dread d1/f3d [0,4194304] 0 2024-02-15T22:41:11.338 INFO:tasks.workunit.client.1.smithi082.stdout:5/225: mkdir d5/da/d14/d45 0 2024-02-15T22:41:11.341 INFO:tasks.workunit.client.1.smithi082.stdout:7/152: mkdir d12/d27/d33 0 2024-02-15T22:41:11.344 INFO:tasks.workunit.client.1.smithi082.stdout:4/185: mknod d0/d16/c40 0 2024-02-15T22:41:11.345 INFO:tasks.workunit.client.1.smithi082.stdout:7/153: creat d12/d17/f34 x:0 0 0 2024-02-15T22:41:11.346 INFO:tasks.workunit.client.1.smithi082.stdout:8/153: dread d1/d7/d9/f17 [0,4194304] 0 2024-02-15T22:41:11.347 INFO:tasks.workunit.client.1.smithi082.stdout:8/154: getdents d1/d7/d9/d24/d33 0 2024-02-15T22:41:11.348 INFO:tasks.workunit.client.1.smithi082.stdout:5/226: dread d5/da/f1c [0,4194304] 0 2024-02-15T22:41:11.349 INFO:tasks.workunit.client.1.smithi082.stdout:5/227: symlink d5/da/dc/l46 0 2024-02-15T22:41:11.349 INFO:tasks.workunit.client.1.smithi082.stdout:5/228: readlink d5/da/d22/l34 0 2024-02-15T22:41:11.349 INFO:tasks.workunit.client.1.smithi082.stdout:1/222: write d1/da/ff [3970282,129851] 0 2024-02-15T22:41:11.350 INFO:tasks.workunit.client.1.smithi082.stdout:5/229: symlink d5/da/d14/d45/l47 0 2024-02-15T22:41:11.353 INFO:tasks.workunit.client.1.smithi082.stdout:1/223: link d1/da/c3c d1/da/d11/d3f/c4b 0 2024-02-15T22:41:11.353 INFO:tasks.workunit.client.1.smithi082.stdout:1/224: chown d1/da/d14/d18/l21 2103700555 1 2024-02-15T22:41:11.353 INFO:tasks.workunit.client.1.smithi082.stdout:1/225: chown d1/da/d14/d18/c38 62 1 2024-02-15T22:41:11.355 INFO:tasks.workunit.client.1.smithi082.stdout:3/149: dwrite d0/d19/f7 [0,4194304] 0 2024-02-15T22:41:11.356 INFO:tasks.workunit.client.1.smithi082.stdout:5/230: rename d5/da/d22/c2a to d5/da/dc/c48 0 2024-02-15T22:41:11.356 INFO:tasks.workunit.client.1.smithi082.stdout:0/194: dwrite d3/d19/d1c/f3f [0,4194304] 0 2024-02-15T22:41:11.360 INFO:tasks.workunit.client.1.smithi082.stdout:6/305: dwrite d2/f3 [0,4194304] 0 2024-02-15T22:41:11.360 INFO:tasks.workunit.client.1.smithi082.stdout:7/154: dread d12/d17/f19 [0,4194304] 0 2024-02-15T22:41:11.363 INFO:tasks.workunit.client.1.smithi082.stdout:1/226: dread d1/f4 [0,4194304] 0 2024-02-15T22:41:11.364 INFO:tasks.workunit.client.1.smithi082.stdout:0/195: mknod d3/d19/d20/c42 0 2024-02-15T22:41:11.366 INFO:tasks.workunit.client.1.smithi082.stdout:3/150: dread d0/d19/f7 [0,4194304] 0 2024-02-15T22:41:11.372 INFO:tasks.workunit.client.1.smithi082.stdout:5/231: write d5/da/d14/f31 [1430314,1317] 0 2024-02-15T22:41:11.372 INFO:tasks.workunit.client.1.smithi082.stdout:5/232: truncate d5/f39 997135 0 2024-02-15T22:41:11.373 INFO:tasks.workunit.client.1.smithi082.stdout:9/249: getdents d8 0 2024-02-15T22:41:11.373 INFO:tasks.workunit.client.1.smithi082.stdout:9/250: creat d8/d24/d2e/f41 x:0 0 0 2024-02-15T22:41:11.374 INFO:tasks.workunit.client.1.smithi082.stdout:6/306: read d2/f1c [1071985,7302] 0 2024-02-15T22:41:11.375 INFO:tasks.workunit.client.1.smithi082.stdout:7/155: mkdir d12/d27/d33/d35 0 2024-02-15T22:41:11.377 INFO:tasks.workunit.client.1.smithi082.stdout:1/227: truncate d1/da/d14/f28 1666856 0 2024-02-15T22:41:11.377 INFO:tasks.workunit.client.1.smithi082.stdout:3/151: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:11.377 INFO:tasks.workunit.client.1.smithi082.stdout:3/152: getdents d0/d19/d2e 0 2024-02-15T22:41:11.377 INFO:tasks.workunit.client.1.smithi082.stdout:3/153: dread - d0/d19/f1a zero size 2024-02-15T22:41:11.378 INFO:tasks.workunit.client.1.smithi082.stdout:3/154: dread - d0/dc/f26 zero size 2024-02-15T22:41:11.378 INFO:tasks.workunit.client.1.smithi082.stdout:3/155: write d0/dc/f20 [855356,101723] 0 2024-02-15T22:41:11.378 INFO:tasks.workunit.client.1.smithi082.stdout:3/156: read d0/d19/fb [1391558,74431] 0 2024-02-15T22:41:11.378 INFO:tasks.workunit.client.1.smithi082.stdout:3/157: fdatasync d0/f1c 0 2024-02-15T22:41:11.382 INFO:tasks.workunit.client.1.smithi082.stdout:6/307: mkdir d2/d18/d23/d60 0 2024-02-15T22:41:11.385 INFO:tasks.workunit.client.1.smithi082.stdout:7/156: unlink d12/d17/f34 0 2024-02-15T22:41:11.385 INFO:tasks.workunit.client.1.smithi082.stdout:7/157: write f7 [3825574,107535] 0 2024-02-15T22:41:11.385 INFO:tasks.workunit.client.1.smithi082.stdout:7/158: chown d12/d17/f25 1160846 1 2024-02-15T22:41:11.386 INFO:tasks.workunit.client.1.smithi082.stdout:0/196: mknod d3/c43 0 2024-02-15T22:41:11.386 INFO:tasks.workunit.client.1.smithi082.stdout:5/233: write d5/da/f23 [2172036,37236] 0 2024-02-15T22:41:11.386 INFO:tasks.workunit.client.1.smithi082.stdout:5/234: write d5/f3b [245386,101740] 0 2024-02-15T22:41:11.386 INFO:tasks.workunit.client.1.smithi082.stdout:5/235: fsync d5/da/dc/f10 0 2024-02-15T22:41:11.386 INFO:tasks.workunit.client.1.smithi082.stdout:6/308: mkdir d2/d18/d23/d3c/d61 0 2024-02-15T22:41:11.387 INFO:tasks.workunit.client.1.smithi082.stdout:7/159: rmdir d12/d27/d33 39 2024-02-15T22:41:11.387 INFO:tasks.workunit.client.1.smithi082.stdout:7/160: write d12/d17/f30 [725626,55641] 0 2024-02-15T22:41:11.389 INFO:tasks.workunit.client.1.smithi082.stdout:5/236: symlink d5/da/dc/l49 0 2024-02-15T22:41:11.389 INFO:tasks.workunit.client.1.smithi082.stdout:5/237: creat d5/da/f4a x:0 0 0 2024-02-15T22:41:11.390 INFO:tasks.workunit.client.1.smithi082.stdout:1/228: dread d1/f1d [0,4194304] 0 2024-02-15T22:41:11.391 INFO:tasks.workunit.client.1.smithi082.stdout:6/309: rmdir d2/d18/d23/d3c/d61 0 2024-02-15T22:41:11.391 INFO:tasks.workunit.client.1.smithi082.stdout:6/310: fsync d2/d18/d23/f35 0 2024-02-15T22:41:11.391 INFO:tasks.workunit.client.1.smithi082.stdout:6/311: chown d2/d18/d39/c5e 4 1 2024-02-15T22:41:11.393 INFO:tasks.workunit.client.1.smithi082.stdout:0/197: getdents d3/d19 0 2024-02-15T22:41:11.394 INFO:tasks.workunit.client.1.smithi082.stdout:4/186: dwrite d0/d8/d1b/dd/f2f [0,4194304] 0 2024-02-15T22:41:11.394 INFO:tasks.workunit.client.1.smithi082.stdout:8/155: dwrite d1/d7/de/f36 [0,4194304] 0 2024-02-15T22:41:11.394 INFO:tasks.workunit.client.1.smithi082.stdout:8/156: fsync d1/d7/d9/f17 0 2024-02-15T22:41:11.399 INFO:tasks.workunit.client.1.smithi082.stdout:5/238: rmdir d5/da/dc 39 2024-02-15T22:41:11.399 INFO:tasks.workunit.client.1.smithi082.stdout:5/239: read d5/da/f23 [3953056,45580] 0 2024-02-15T22:41:11.401 INFO:tasks.workunit.client.1.smithi082.stdout:1/229: truncate d1/da/d14/d18/d1f/d2f/f3e 149159 0 2024-02-15T22:41:11.403 INFO:tasks.workunit.client.1.smithi082.stdout:6/312: rename d2/d18/c2b to d2/d45/c62 0 2024-02-15T22:41:11.403 INFO:tasks.workunit.client.1.smithi082.stdout:6/313: chown d2/le 892224 1 2024-02-15T22:41:11.403 INFO:tasks.workunit.client.1.smithi082.stdout:6/314: chown d2/d18/d23/f35 30143657 1 2024-02-15T22:41:11.403 INFO:tasks.workunit.client.1.smithi082.stdout:6/315: getdents d2/d18/d23/d60 0 2024-02-15T22:41:11.410 INFO:tasks.workunit.client.1.smithi082.stdout:4/187: creat d0/d8/d1b/dd/f41 x:0 0 0 2024-02-15T22:41:11.415 INFO:tasks.workunit.client.1.smithi082.stdout:5/240: link d5/da/f4a d5/f4b 0 2024-02-15T22:41:11.415 INFO:tasks.workunit.client.1.smithi082.stdout:5/241: chown d5/da/d22/c28 17094028 1 2024-02-15T22:41:11.416 INFO:tasks.workunit.client.1.smithi082.stdout:5/242: dread d5/f39 [0,4194304] 0 2024-02-15T22:41:11.417 INFO:tasks.workunit.client.1.smithi082.stdout:6/316: mknod d2/d30/d3b/c63 0 2024-02-15T22:41:11.417 INFO:tasks.workunit.client.1.smithi082.stdout:1/230: dread d1/f1d [0,4194304] 0 2024-02-15T22:41:11.417 INFO:tasks.workunit.client.1.smithi082.stdout:1/231: fdatasync d1/f1b 0 2024-02-15T22:41:11.417 INFO:tasks.workunit.client.1.smithi082.stdout:1/232: fdatasync d1/da/f1c 0 2024-02-15T22:41:11.417 INFO:tasks.workunit.client.1.smithi082.stdout:1/233: write d1/f3d [1768802,95739] 0 2024-02-15T22:41:11.417 INFO:tasks.workunit.client.1.smithi082.stdout:1/234: fsync d1/da/d14/f2a 0 2024-02-15T22:41:11.417 INFO:tasks.workunit.client.1.smithi082.stdout:1/235: chown d1/da/d14/d18/d1f/d2f/f3b 196616436 1 2024-02-15T22:41:11.423 INFO:tasks.workunit.client.1.smithi082.stdout:2/209: sync 2024-02-15T22:41:11.425 INFO:tasks.workunit.client.1.smithi082.stdout:2/210: symlink d6/l3a 0 2024-02-15T22:41:11.425 INFO:tasks.workunit.client.1.smithi082.stdout:2/211: creat d6/d9/f3b x:0 0 0 2024-02-15T22:41:11.425 INFO:tasks.workunit.client.1.smithi082.stdout:2/212: readlink d6/dc/dd/d1d/l2d 0 2024-02-15T22:41:11.425 INFO:tasks.workunit.client.1.smithi082.stdout:2/213: stat d6/dc/d12 0 2024-02-15T22:41:11.425 INFO:tasks.workunit.client.1.smithi082.stdout:2/214: chown d6/d18 80659019 1 2024-02-15T22:41:11.427 INFO:tasks.workunit.client.1.smithi082.stdout:2/215: truncate d6/f7 1504994 0 2024-02-15T22:41:11.428 INFO:tasks.workunit.client.1.smithi082.stdout:2/216: fdatasync d6/d9/f17 0 2024-02-15T22:41:11.429 INFO:tasks.workunit.client.1.smithi082.stdout:2/217: mkdir d6/d3c 0 2024-02-15T22:41:11.429 INFO:tasks.workunit.client.1.smithi082.stdout:9/251: dwrite d8/d12/f1d [4194304,4194304] 0 2024-02-15T22:41:11.430 INFO:tasks.workunit.client.1.smithi082.stdout:2/218: mkdir d6/dc/dd/d1d/d3d 0 2024-02-15T22:41:11.432 INFO:tasks.workunit.client.1.smithi082.stdout:9/252: truncate f5 371743 0 2024-02-15T22:41:11.433 INFO:tasks.workunit.client.1.smithi082.stdout:2/219: unlink d6/f8 0 2024-02-15T22:41:11.434 INFO:tasks.workunit.client.1.smithi082.stdout:2/220: mknod d6/dc/dd/d21/c3e 0 2024-02-15T22:41:11.435 INFO:tasks.workunit.client.1.smithi082.stdout:9/253: rmdir d8/d12/d30 39 2024-02-15T22:41:11.451 INFO:tasks.workunit.client.1.smithi082.stdout:5/243: dwrite d5/da/dc/ff [0,4194304] 0 2024-02-15T22:41:11.452 INFO:tasks.workunit.client.1.smithi082.stdout:5/244: mknod d5/da/dc/d43/c4c 0 2024-02-15T22:41:11.454 INFO:tasks.workunit.client.1.smithi082.stdout:5/245: creat d5/da/dc/d43/f4d x:0 0 0 2024-02-15T22:41:11.455 INFO:tasks.workunit.client.1.smithi082.stdout:5/246: creat d5/da/d14/f4e x:0 0 0 2024-02-15T22:41:11.455 INFO:tasks.workunit.client.1.smithi082.stdout:5/247: write d5/da/f40 [434324,66343] 0 2024-02-15T22:41:11.458 INFO:tasks.workunit.client.1.smithi082.stdout:3/158: dwrite d0/dc/f20 [0,4194304] 0 2024-02-15T22:41:11.459 INFO:tasks.workunit.client.1.smithi082.stdout:3/159: chown d0/dc/fd 11 1 2024-02-15T22:41:11.459 INFO:tasks.workunit.client.1.smithi082.stdout:3/160: stat d0/d19/fe 0 2024-02-15T22:41:11.459 INFO:tasks.workunit.client.1.smithi082.stdout:3/161: write d0/d16/f12 [9355846,10760] 0 2024-02-15T22:41:11.459 INFO:tasks.workunit.client.1.smithi082.stdout:2/221: dwrite d6/d18/f22 [0,4194304] 0 2024-02-15T22:41:11.460 INFO:tasks.workunit.client.1.smithi082.stdout:6/317: dwrite d2/d30/d3b/f42 [0,4194304] 0 2024-02-15T22:41:11.460 INFO:tasks.workunit.client.1.smithi082.stdout:6/318: fdatasync d2/d18/f19 0 2024-02-15T22:41:11.462 INFO:tasks.workunit.client.1.smithi082.stdout:0/198: dwrite d3/f12 [0,4194304] 0 2024-02-15T22:41:11.462 INFO:tasks.workunit.client.1.smithi082.stdout:3/162: symlink d0/d16/l2f 0 2024-02-15T22:41:11.466 INFO:tasks.workunit.client.1.smithi082.stdout:2/222: rename d6/dc/l1b to d6/d9/l3f 0 2024-02-15T22:41:11.466 INFO:tasks.workunit.client.1.smithi082.stdout:3/163: rename d0 to d0/d19/d30 22 2024-02-15T22:41:11.466 INFO:tasks.workunit.client.1.smithi082.stdout:2/223: fdatasync d6/d18/f37 0 2024-02-15T22:41:11.469 INFO:tasks.workunit.client.1.smithi082.stdout:1/236: rmdir d1/da/d14 39 2024-02-15T22:41:11.473 INFO:tasks.workunit.client.1.smithi082.stdout:7/161: truncate f7 2896730 0 2024-02-15T22:41:11.473 INFO:tasks.workunit.client.1.smithi082.stdout:7/162: write f10 [943640,38510] 0 2024-02-15T22:41:11.476 INFO:tasks.workunit.client.1.smithi082.stdout:0/199: rename d3/f2f to d3/d19/f44 0 2024-02-15T22:41:11.476 INFO:tasks.workunit.client.1.smithi082.stdout:0/200: chown d3/d19/f24 926261546 1 2024-02-15T22:41:11.476 INFO:tasks.workunit.client.1.smithi082.stdout:7/163: creat d12/d27/d33/f36 x:0 0 0 2024-02-15T22:41:11.480 INFO:tasks.workunit.client.1.smithi082.stdout:0/201: rename d3/d16 to d3/d19/d25/d45 0 2024-02-15T22:41:11.480 INFO:tasks.workunit.client.1.smithi082.stdout:0/202: readlink d3/d19/d25/d45/l35 0 2024-02-15T22:41:11.481 INFO:tasks.workunit.client.1.smithi082.stdout:7/164: dread ff [0,4194304] 0 2024-02-15T22:41:11.485 INFO:tasks.workunit.client.1.smithi082.stdout:3/164: dread d0/f2 [4194304,4194304] 0 2024-02-15T22:41:11.485 INFO:tasks.workunit.client.1.smithi082.stdout:7/165: mkdir d12/d37 0 2024-02-15T22:41:11.489 INFO:tasks.workunit.client.1.smithi082.stdout:3/165: dread d0/d19/f7 [0,4194304] 0 2024-02-15T22:41:11.501 INFO:tasks.workunit.client.1.smithi082.stdout:3/166: write d0/d16/f1f [1456827,121948] 0 2024-02-15T22:41:11.501 INFO:tasks.workunit.client.1.smithi082.stdout:3/167: creat d0/d19/f31 x:0 0 0 2024-02-15T22:41:11.502 INFO:tasks.workunit.client.1.smithi082.stdout:5/248: dwrite d5/da/d22/f38 [0,4194304] 0 2024-02-15T22:41:11.502 INFO:tasks.workunit.client.1.smithi082.stdout:5/249: chown d5/da/f4a 2002 1 2024-02-15T22:41:11.502 INFO:tasks.workunit.client.1.smithi082.stdout:5/250: chown d5/da/d14/d45 1008235471 1 2024-02-15T22:41:11.503 INFO:tasks.workunit.client.1.smithi082.stdout:6/319: dwrite d2/d18/f44 [4194304,4194304] 0 2024-02-15T22:41:11.503 INFO:tasks.workunit.client.1.smithi082.stdout:6/320: rename d2/d18/d39 to d2/d18/d39/d64 22 2024-02-15T22:41:11.503 INFO:tasks.workunit.client.1.smithi082.stdout:6/321: write d2/d18/f19 [1819948,23622] 0 2024-02-15T22:41:11.503 INFO:tasks.workunit.client.1.smithi082.stdout:6/322: write d2/fd [6314702,742] 0 2024-02-15T22:41:11.503 INFO:tasks.workunit.client.1.smithi082.stdout:3/168: creat d0/d16/f32 x:0 0 0 2024-02-15T22:41:11.505 INFO:tasks.workunit.client.1.smithi082.stdout:9/254: write f5 [270115,50931] 0 2024-02-15T22:41:11.505 INFO:tasks.workunit.client.1.smithi082.stdout:2/224: dwrite d6/d9/f19 [0,4194304] 0 2024-02-15T22:41:11.507 INFO:tasks.workunit.client.1.smithi082.stdout:5/251: creat d5/da/dc/f4f x:0 0 0 2024-02-15T22:41:11.508 INFO:tasks.workunit.client.1.smithi082.stdout:5/252: fdatasync d5/da/dc/f3d 0 2024-02-15T22:41:11.510 INFO:tasks.workunit.client.1.smithi082.stdout:1/237: dread d1/f3d [0,4194304] 0 2024-02-15T22:41:11.518 INFO:tasks.workunit.client.1.smithi082.stdout:2/225: write f5 [20432,129608] 0 2024-02-15T22:41:11.522 INFO:tasks.workunit.client.1.smithi082.stdout:6/323: mkdir d2/d18/d23/d3c/d65 0 2024-02-15T22:41:11.523 INFO:tasks.workunit.client.1.smithi082.stdout:0/203: getdents d3 0 2024-02-15T22:41:11.527 INFO:tasks.workunit.client.1.smithi082.stdout:3/169: creat d0/f33 x:0 0 0 2024-02-15T22:41:11.530 INFO:tasks.workunit.client.1.smithi082.stdout:9/255: mknod d8/c42 0 2024-02-15T22:41:11.530 INFO:tasks.workunit.client.1.smithi082.stdout:9/256: chown d8/d12/l20 29323037 1 2024-02-15T22:41:11.531 INFO:tasks.workunit.client.1.smithi082.stdout:9/257: write d8/d24/d2e/f38 [3529996,111415] 0 2024-02-15T22:41:11.533 INFO:tasks.workunit.client.1.smithi082.stdout:2/226: write d6/d9/fe [1565331,102901] 0 2024-02-15T22:41:11.533 INFO:tasks.workunit.client.1.smithi082.stdout:2/227: chown d6/d9/f3b 1646122 1 2024-02-15T22:41:11.535 INFO:tasks.workunit.client.1.smithi082.stdout:5/253: dwrite d5/f3b [0,4194304] 0 2024-02-15T22:41:11.535 INFO:tasks.workunit.client.1.smithi082.stdout:1/238: mknod d1/da/d14/d18/d1f/d2f/c4c 0 2024-02-15T22:41:11.535 INFO:tasks.workunit.client.1.smithi082.stdout:5/254: creat d5/da/d14/f50 x:0 0 0 2024-02-15T22:41:11.535 INFO:tasks.workunit.client.1.smithi082.stdout:5/255: chown d5/l30 47235 1 2024-02-15T22:41:11.535 INFO:tasks.workunit.client.1.smithi082.stdout:5/256: fdatasync d5/da/dc/f15 0 2024-02-15T22:41:11.539 INFO:tasks.workunit.client.1.smithi082.stdout:6/324: mknod d2/d18/c66 0 2024-02-15T22:41:11.542 INFO:tasks.workunit.client.1.smithi082.stdout:0/204: symlink d3/d19/d20/d26/l46 0 2024-02-15T22:41:11.543 INFO:tasks.workunit.client.1.smithi082.stdout:3/170: mknod d0/d19/c34 0 2024-02-15T22:41:11.551 INFO:tasks.workunit.client.1.smithi082.stdout:5/257: mknod d5/da/dc/d43/c51 0 2024-02-15T22:41:11.552 INFO:tasks.workunit.client.1.smithi082.stdout:5/258: readlink d5/l30 0 2024-02-15T22:41:11.552 INFO:tasks.workunit.client.1.smithi082.stdout:5/259: write d5/da/d22/f35 [1258459,109087] 0 2024-02-15T22:41:11.552 INFO:tasks.workunit.client.1.smithi082.stdout:5/260: fsync d5/da/f3c 0 2024-02-15T22:41:11.552 INFO:tasks.workunit.client.1.smithi082.stdout:2/228: dwrite d6/d18/f22 [0,4194304] 0 2024-02-15T22:41:11.552 INFO:tasks.workunit.client.1.smithi082.stdout:6/325: mkdir d2/d18/d23/d67 0 2024-02-15T22:41:11.555 INFO:tasks.workunit.client.1.smithi082.stdout:0/205: unlink d3/d19/d25/d45/l3d 0 2024-02-15T22:41:11.558 INFO:tasks.workunit.client.1.smithi082.stdout:5/261: mkdir d5/da/d14/d45/d52 0 2024-02-15T22:41:11.561 INFO:tasks.workunit.client.1.smithi082.stdout:2/229: creat d6/dc/dd/d1d/f40 x:0 0 0 2024-02-15T22:41:11.561 INFO:tasks.workunit.client.1.smithi082.stdout:2/230: creat d6/dc/dd/f41 x:0 0 0 2024-02-15T22:41:11.561 INFO:tasks.workunit.client.1.smithi082.stdout:2/231: write f2 [4658247,11244] 0 2024-02-15T22:41:11.562 INFO:tasks.workunit.client.1.smithi082.stdout:0/206: symlink d3/l47 0 2024-02-15T22:41:11.563 INFO:tasks.workunit.client.1.smithi082.stdout:0/207: chown d3/d19/d20 20 1 2024-02-15T22:41:11.563 INFO:tasks.workunit.client.1.smithi082.stdout:0/208: stat d3/d19/d1c/c33 0 2024-02-15T22:41:11.565 INFO:tasks.workunit.client.1.smithi082.stdout:2/232: mknod d6/dc/dd/d1d/c42 0 2024-02-15T22:41:11.566 INFO:tasks.workunit.client.1.smithi082.stdout:2/233: fdatasync d6/dc/dd/d1d/f40 0 2024-02-15T22:41:11.567 INFO:tasks.workunit.client.1.smithi082.stdout:2/234: rename d6/dc/f16 to d6/dc/dd/d24/f43 0 2024-02-15T22:41:11.568 INFO:tasks.workunit.client.1.smithi082.stdout:2/235: link d6/l3a d6/dc/l44 0 2024-02-15T22:41:11.570 INFO:tasks.workunit.client.1.smithi082.stdout:2/236: rmdir d6/d9 39 2024-02-15T22:41:11.571 INFO:tasks.workunit.client.1.smithi082.stdout:3/171: dwrite d0/f2 [4194304,4194304] 0 2024-02-15T22:41:11.571 INFO:tasks.workunit.client.1.smithi082.stdout:2/237: symlink d6/dc/dd/d21/l45 0 2024-02-15T22:41:11.574 INFO:tasks.workunit.client.1.smithi082.stdout:2/238: rename d6/dc/dd/d1d/d3d to d6/dc/d12/d46 0 2024-02-15T22:41:11.574 INFO:tasks.workunit.client.1.smithi082.stdout:2/239: creat d6/d18/f47 x:0 0 0 2024-02-15T22:41:11.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/326: dwrite d2/d30/d3b/f42 [4194304,4194304] 0 2024-02-15T22:41:11.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/327: dread - d2/d18/d23/d3c/d47/f54 zero size 2024-02-15T22:41:11.576 INFO:tasks.workunit.client.1.smithi082.stdout:0/209: dread d3/f12 [0,4194304] 0 2024-02-15T22:41:11.580 INFO:tasks.workunit.client.1.smithi082.stdout:6/328: symlink d2/d18/d23/l68 0 2024-02-15T22:41:11.581 INFO:tasks.workunit.client.1.smithi082.stdout:6/329: mkdir d2/d18/d23/d3c/d47/d69 0 2024-02-15T22:41:11.582 INFO:tasks.workunit.client.1.smithi082.stdout:6/330: fdatasync d2/f1a 0 2024-02-15T22:41:11.583 INFO:tasks.workunit.client.1.smithi082.stdout:6/331: symlink d2/d18/l6a 0 2024-02-15T22:41:11.583 INFO:tasks.workunit.client.1.smithi082.stdout:6/332: dread - d2/d45/f56 zero size 2024-02-15T22:41:11.583 INFO:tasks.workunit.client.1.smithi082.stdout:6/333: creat d2/d30/d3b/f6b x:0 0 0 2024-02-15T22:41:11.584 INFO:tasks.workunit.client.1.smithi082.stdout:5/262: dwrite d5/f2e [0,4194304] 0 2024-02-15T22:41:11.585 INFO:tasks.workunit.client.1.smithi082.stdout:3/172: dread d0/f1c [0,4194304] 0 2024-02-15T22:41:11.585 INFO:tasks.workunit.client.1.smithi082.stdout:3/173: chown d0 325280332 1 2024-02-15T22:41:11.589 INFO:tasks.workunit.client.1.smithi082.stdout:5/263: mkdir d5/da/d14/d53 0 2024-02-15T22:41:11.593 INFO:tasks.workunit.client.1.smithi082.stdout:2/240: dwrite d6/f7 [0,4194304] 0 2024-02-15T22:41:11.593 INFO:tasks.workunit.client.1.smithi082.stdout:2/241: fdatasync d6/dc/dd/f41 0 2024-02-15T22:41:11.595 INFO:tasks.workunit.client.1.smithi082.stdout:2/242: symlink d6/dc/d12/d23/l48 0 2024-02-15T22:41:11.597 INFO:tasks.workunit.client.1.smithi082.stdout:0/210: read d3/fb [3060931,124578] 0 2024-02-15T22:41:11.597 INFO:tasks.workunit.client.1.smithi082.stdout:0/211: write d3/d19/f24 [643950,122894] 0 2024-02-15T22:41:11.597 INFO:tasks.workunit.client.1.smithi082.stdout:0/212: chown d3/d19/d25/d45/f18 15 1 2024-02-15T22:41:11.597 INFO:tasks.workunit.client.1.smithi082.stdout:0/213: fsync d3/f34 0 2024-02-15T22:41:11.597 INFO:tasks.workunit.client.1.smithi082.stdout:0/214: stat d3/d19/d20/c3b 0 2024-02-15T22:41:11.598 INFO:tasks.workunit.client.1.smithi082.stdout:2/243: mkdir d6/d9/d49 0 2024-02-15T22:41:11.598 INFO:tasks.workunit.client.1.smithi082.stdout:6/334: dread d2/d30/d3b/f42 [0,4194304] 0 2024-02-15T22:41:11.601 INFO:tasks.workunit.client.1.smithi082.stdout:0/215: rename d3/d19/d1c/f3f to d3/d19/d25/f48 0 2024-02-15T22:41:11.604 INFO:tasks.workunit.client.1.smithi082.stdout:2/244: mknod d6/dc/dd/d24/c4a 0 2024-02-15T22:41:11.604 INFO:tasks.workunit.client.1.smithi082.stdout:2/245: readlink d6/d9/l15 0 2024-02-15T22:41:11.604 INFO:tasks.workunit.client.1.smithi082.stdout:2/246: write d6/dc/dd/f41 [739150,61139] 0 2024-02-15T22:41:11.606 INFO:tasks.workunit.client.1.smithi082.stdout:6/335: symlink d2/d18/d23/d67/l6c 0 2024-02-15T22:41:11.608 INFO:tasks.workunit.client.1.smithi082.stdout:3/174: dwrite d0/f2 [4194304,4194304] 0 2024-02-15T22:41:11.609 INFO:tasks.workunit.client.1.smithi082.stdout:0/216: creat d3/f49 x:0 0 0 2024-02-15T22:41:11.620 INFO:tasks.workunit.client.1.smithi082.stdout:2/247: truncate f2 1421567 0 2024-02-15T22:41:11.620 INFO:tasks.workunit.client.1.smithi082.stdout:2/248: fdatasync d6/d9/fe 0 2024-02-15T22:41:11.622 INFO:tasks.workunit.client.1.smithi082.stdout:2/249: mkdir d6/dc/d12/d46/d4b 0 2024-02-15T22:41:11.622 INFO:tasks.workunit.client.1.smithi082.stdout:6/336: write d2/d18/f44 [7240602,29066] 0 2024-02-15T22:41:11.627 INFO:tasks.workunit.client.1.smithi082.stdout:3/175: write d0/f2 [4421685,81804] 0 2024-02-15T22:41:11.627 INFO:tasks.workunit.client.1.smithi082.stdout:0/217: dwrite d3/f11 [0,4194304] 0 2024-02-15T22:41:11.631 INFO:tasks.workunit.client.1.smithi082.stdout:0/218: symlink d3/d19/d20/d26/l4a 0 2024-02-15T22:41:11.631 INFO:tasks.workunit.client.1.smithi082.stdout:0/219: creat d3/f4b x:0 0 0 2024-02-15T22:41:11.657 INFO:tasks.workunit.client.1.smithi082.stdout:2/250: dwrite d6/dc/dd/d24/f43 [0,4194304] 0 2024-02-15T22:41:11.658 INFO:tasks.workunit.client.1.smithi082.stdout:2/251: fsync d6/dc/dd/f1a 0 2024-02-15T22:41:11.658 INFO:tasks.workunit.client.1.smithi082.stdout:2/252: creat d6/d18/f4c x:0 0 0 2024-02-15T22:41:11.658 INFO:tasks.workunit.client.1.smithi082.stdout:0/220: dwrite d3/f40 [0,4194304] 0 2024-02-15T22:41:11.660 INFO:tasks.workunit.client.1.smithi082.stdout:3/176: dwrite d0/f33 [0,4194304] 0 2024-02-15T22:41:11.660 INFO:tasks.workunit.client.1.smithi082.stdout:3/177: dread - d0/d19/d14/f2a zero size 2024-02-15T22:41:11.662 INFO:tasks.workunit.client.1.smithi082.stdout:2/253: rename d6/d9/f1e to d6/dc/d12/d46/d4b/f4d 0 2024-02-15T22:41:11.665 INFO:tasks.workunit.client.1.smithi082.stdout:3/178: dread d0/d16/f1f [0,4194304] 0 2024-02-15T22:41:11.665 INFO:tasks.workunit.client.1.smithi082.stdout:3/179: readlink d0/d16/la 0 2024-02-15T22:41:11.674 INFO:tasks.workunit.client.1.smithi082.stdout:2/254: dread d6/dc/dd/d24/f43 [0,4194304] 0 2024-02-15T22:41:11.675 INFO:tasks.workunit.client.1.smithi082.stdout:2/255: creat d6/d3c/f4e x:0 0 0 2024-02-15T22:41:11.676 INFO:tasks.workunit.client.1.smithi082.stdout:2/256: symlink d6/dc/d12/d46/d4b/l4f 0 2024-02-15T22:41:11.677 INFO:tasks.workunit.client.1.smithi082.stdout:2/257: truncate f5 1823950 0 2024-02-15T22:41:11.678 INFO:tasks.workunit.client.1.smithi082.stdout:2/258: rmdir d6/dc/d12/d23 39 2024-02-15T22:41:11.679 INFO:tasks.workunit.client.1.smithi082.stdout:2/259: fdatasync d6/dc/dd/d24/f43 0 2024-02-15T22:41:11.679 INFO:tasks.workunit.client.1.smithi082.stdout:2/260: dread - d6/d18/f37 zero size 2024-02-15T22:41:11.679 INFO:tasks.workunit.client.1.smithi082.stdout:0/221: dwrite d3/f30 [0,4194304] 0 2024-02-15T22:41:11.680 INFO:tasks.workunit.client.1.smithi082.stdout:2/261: truncate d6/d9/f19 720074 0 2024-02-15T22:41:11.684 INFO:tasks.workunit.client.1.smithi082.stdout:2/262: rename d6/dc/f2c to d6/dc/dd/d1d/f50 0 2024-02-15T22:41:11.684 INFO:tasks.workunit.client.1.smithi082.stdout:2/263: creat d6/dc/dd/d1d/f51 x:0 0 0 2024-02-15T22:41:11.688 INFO:tasks.workunit.client.1.smithi082.stdout:2/264: link d6/d18/l33 d6/dc/dd/l52 0 2024-02-15T22:41:11.688 INFO:tasks.workunit.client.1.smithi082.stdout:2/265: readlink d6/d9/l3f 0 2024-02-15T22:41:11.689 INFO:tasks.workunit.client.1.smithi082.stdout:2/266: mknod d6/dc/d12/d46/c53 0 2024-02-15T22:41:11.691 INFO:tasks.workunit.client.1.smithi082.stdout:2/267: rename f5 to d6/dc/dd/d24/f54 0 2024-02-15T22:41:11.691 INFO:tasks.workunit.client.1.smithi082.stdout:3/180: dwrite d0/dc/f20 [4194304,4194304] 0 2024-02-15T22:41:11.693 INFO:tasks.workunit.client.1.smithi082.stdout:2/268: unlink d6/dc/dd/d1d/f40 0 2024-02-15T22:41:11.695 INFO:tasks.workunit.client.1.smithi082.stdout:3/181: link d0/dc/f26 d0/d19/d14/d21/f35 0 2024-02-15T22:41:11.696 INFO:tasks.workunit.client.1.smithi082.stdout:0/222: truncate d3/f30 696616 0 2024-02-15T22:41:11.698 INFO:tasks.workunit.client.1.smithi082.stdout:3/182: rename d0/d19/f1a to d0/d19/f36 0 2024-02-15T22:41:11.699 INFO:tasks.workunit.client.1.smithi082.stdout:3/183: mknod d0/c37 0 2024-02-15T22:41:11.699 INFO:tasks.workunit.client.1.smithi082.stdout:3/184: chown d0/d16/f1f 0 1 2024-02-15T22:41:11.700 INFO:tasks.workunit.client.1.smithi082.stdout:2/269: getdents d6/dc/dd 0 2024-02-15T22:41:11.701 INFO:tasks.workunit.client.1.smithi082.stdout:3/185: creat d0/d19/d2e/f38 x:0 0 0 2024-02-15T22:41:11.701 INFO:tasks.workunit.client.1.smithi082.stdout:3/186: dread - d0/d19/f36 zero size 2024-02-15T22:41:11.702 INFO:tasks.workunit.client.1.smithi082.stdout:2/270: symlink d6/dc/dd/d24/l55 0 2024-02-15T22:41:11.702 INFO:tasks.workunit.client.1.smithi082.stdout:2/271: write d6/d9/fe [3220448,70036] 0 2024-02-15T22:41:11.704 INFO:tasks.workunit.client.1.smithi082.stdout:3/187: symlink d0/l39 0 2024-02-15T22:41:11.704 INFO:tasks.workunit.client.1.smithi082.stdout:3/188: write d0/d19/d14/d21/f35 [614124,4927] 0 2024-02-15T22:41:11.704 INFO:tasks.workunit.client.1.smithi082.stdout:2/272: creat d6/d9/d49/f56 x:0 0 0 2024-02-15T22:41:11.704 INFO:tasks.workunit.client.1.smithi082.stdout:2/273: dread - d6/d18/f47 zero size 2024-02-15T22:41:11.704 INFO:tasks.workunit.client.1.smithi082.stdout:2/274: creat d6/dc/dd/d1d/f57 x:0 0 0 2024-02-15T22:41:11.705 INFO:tasks.workunit.client.1.smithi082.stdout:0/223: dread d3/fb [0,4194304] 0 2024-02-15T22:41:11.709 INFO:tasks.workunit.client.1.smithi082.stdout:0/224: mknod d3/d19/d25/d45/c4c 0 2024-02-15T22:41:11.709 INFO:tasks.workunit.client.1.smithi082.stdout:0/225: stat d3 0 2024-02-15T22:41:11.710 INFO:tasks.workunit.client.1.smithi082.stdout:0/226: symlink d3/d19/d1c/l4d 0 2024-02-15T22:41:11.714 INFO:tasks.workunit.client.1.smithi082.stdout:3/189: dread d0/dc/fd [4194304,4194304] 0 2024-02-15T22:41:11.715 INFO:tasks.workunit.client.1.smithi082.stdout:2/275: write d6/d9/fe [4826708,89768] 0 2024-02-15T22:41:11.717 INFO:tasks.workunit.client.1.smithi082.stdout:2/276: rename d6/d9 to d6/dc/d58 0 2024-02-15T22:41:11.720 INFO:tasks.workunit.client.1.smithi082.stdout:2/277: dread d6/dc/dd/d24/f43 [0,4194304] 0 2024-02-15T22:41:11.721 INFO:tasks.workunit.client.1.smithi082.stdout:2/278: symlink d6/d18/l59 0 2024-02-15T22:41:11.721 INFO:tasks.workunit.client.1.smithi082.stdout:2/279: creat d6/dc/dd/d21/f5a x:0 0 0 2024-02-15T22:41:11.721 INFO:tasks.workunit.client.1.smithi082.stdout:2/280: read - d6/d18/f4c zero size 2024-02-15T22:41:11.722 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:11 smithi033 ceph-mon[29033]: pgmap v18: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 93 MiB/s rd, 134 MiB/s wr, 530 op/s 2024-02-15T22:41:11.722 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:11 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:11.722 INFO:tasks.workunit.client.1.smithi082.stdout:0/227: dread d3/f13 [0,4194304] 0 2024-02-15T22:41:11.723 INFO:tasks.workunit.client.1.smithi082.stdout:0/228: write d3/fe [4415926,77515] 0 2024-02-15T22:41:11.724 INFO:tasks.workunit.client.1.smithi082.stdout:0/229: creat d3/d19/d20/d26/f4e x:0 0 0 2024-02-15T22:41:11.724 INFO:tasks.workunit.client.1.smithi082.stdout:0/230: dread - d3/f49 zero size 2024-02-15T22:41:11.724 INFO:tasks.workunit.client.1.smithi082.stdout:0/231: truncate d3/fd 791358 0 2024-02-15T22:41:11.725 INFO:tasks.workunit.client.1.smithi082.stdout:0/232: rename d3/d19/d1c/l3c to d3/d19/d20/d26/l4f 0 2024-02-15T22:41:11.726 INFO:tasks.workunit.client.1.smithi082.stdout:0/233: creat d3/d19/d1c/f50 x:0 0 0 2024-02-15T22:41:11.726 INFO:tasks.workunit.client.1.smithi082.stdout:0/234: write d3/d19/d1c/f27 [1809564,46115] 0 2024-02-15T22:41:11.726 INFO:tasks.workunit.client.1.smithi082.stdout:0/235: fdatasync d3/d19/f2e 0 2024-02-15T22:41:11.726 INFO:tasks.workunit.client.1.smithi082.stdout:0/236: chown d3/d19/l36 130031 1 2024-02-15T22:41:11.728 INFO:tasks.workunit.client.1.smithi082.stdout:0/237: rename d3/f4b to d3/d19/d20/f51 0 2024-02-15T22:41:11.729 INFO:tasks.workunit.client.1.smithi082.stdout:2/281: dread d6/d18/f22 [0,4194304] 0 2024-02-15T22:41:11.730 INFO:tasks.workunit.client.1.smithi082.stdout:3/190: dread d0/f1c [0,4194304] 0 2024-02-15T22:41:11.730 INFO:tasks.workunit.client.1.smithi082.stdout:0/238: unlink d3/d19/d25/d45/c4c 0 2024-02-15T22:41:11.732 INFO:tasks.workunit.client.1.smithi082.stdout:3/191: rmdir d0/dc 39 2024-02-15T22:41:11.734 INFO:tasks.workunit.client.1.smithi082.stdout:8/157: sync 2024-02-15T22:41:11.739 INFO:tasks.workunit.client.1.smithi082.stdout:0/239: getdents d3/d19/d1c 0 2024-02-15T22:41:11.740 INFO:tasks.workunit.client.1.smithi082.stdout:8/158: dread d1/d7/d9/f17 [0,4194304] 0 2024-02-15T22:41:11.740 INFO:tasks.workunit.client.1.smithi082.stdout:8/159: fsync d1/f14 0 2024-02-15T22:41:11.741 INFO:tasks.workunit.client.1.smithi082.stdout:0/240: creat d3/d19/d1c/f52 x:0 0 0 2024-02-15T22:41:11.741 INFO:tasks.workunit.client.1.smithi082.stdout:0/241: creat d3/d19/d20/d26/f53 x:0 0 0 2024-02-15T22:41:11.742 INFO:tasks.workunit.client.1.smithi082.stdout:8/160: creat d1/d7/de/d1e/f39 x:0 0 0 2024-02-15T22:41:11.744 INFO:tasks.workunit.client.1.smithi082.stdout:0/242: symlink d3/d19/d25/l54 0 2024-02-15T22:41:11.745 INFO:tasks.workunit.client.1.smithi082.stdout:8/161: rename d1/f1c to d1/f3a 0 2024-02-15T22:41:11.745 INFO:tasks.workunit.client.1.smithi082.stdout:8/162: write d1/d7/de/f2f [570254,38953] 0 2024-02-15T22:41:11.745 INFO:tasks.workunit.client.1.smithi082.stdout:8/163: chown d1/d7/de/c2c 46 1 2024-02-15T22:41:11.746 INFO:tasks.workunit.client.1.smithi082.stdout:0/243: truncate d3/f11 1011193 0 2024-02-15T22:41:11.747 INFO:tasks.workunit.client.1.smithi082.stdout:8/164: symlink d1/d7/l3b 0 2024-02-15T22:41:11.748 INFO:tasks.workunit.client.1.smithi082.stdout:0/244: creat d3/d19/d25/d45/f55 x:0 0 0 2024-02-15T22:41:11.748 INFO:tasks.workunit.client.1.smithi082.stdout:0/245: stat d3/d19/f44 0 2024-02-15T22:41:11.749 INFO:tasks.workunit.client.1.smithi082.stdout:8/165: creat d1/d7/d9/d24/d30/f3c x:0 0 0 2024-02-15T22:41:11.751 INFO:tasks.workunit.client.1.smithi082.stdout:8/166: unlink d1/f38 0 2024-02-15T22:41:11.753 INFO:tasks.workunit.client.1.smithi082.stdout:8/167: dread d1/f23 [0,4194304] 0 2024-02-15T22:41:11.753 INFO:tasks.workunit.client.1.smithi082.stdout:8/168: write d1/f18 [1120332,107212] 0 2024-02-15T22:41:11.753 INFO:tasks.workunit.client.1.smithi082.stdout:2/282: dwrite d6/dc/d58/f19 [0,4194304] 0 2024-02-15T22:41:11.753 INFO:tasks.workunit.client.1.smithi082.stdout:3/192: dwrite d0/dc/fd [8388608,4194304] 0 2024-02-15T22:41:11.754 INFO:tasks.workunit.client.1.smithi082.stdout:3/193: creat d0/d16/f3a x:0 0 0 2024-02-15T22:41:11.754 INFO:tasks.workunit.client.1.smithi082.stdout:8/169: creat d1/d7/de/f3d x:0 0 0 2024-02-15T22:41:11.758 INFO:tasks.workunit.client.1.smithi082.stdout:2/283: creat d6/dc/dd/f5b x:0 0 0 2024-02-15T22:41:11.758 INFO:tasks.workunit.client.1.smithi082.stdout:2/284: dread - d6/d3c/f4e zero size 2024-02-15T22:41:11.762 INFO:tasks.workunit.client.1.smithi082.stdout:0/246: dwrite d3/f40 [0,4194304] 0 2024-02-15T22:41:11.764 INFO:tasks.workunit.client.1.smithi082.stdout:3/194: mknod d0/d19/d14/d21/c3b 0 2024-02-15T22:41:11.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/170: unlink d1/l6 0 2024-02-15T22:41:11.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/171: write d1/d7/d9/f17 [6201424,11086] 0 2024-02-15T22:41:11.766 INFO:tasks.workunit.client.1.smithi082.stdout:2/285: link d6/c31 d6/d3c/c5c 0 2024-02-15T22:41:11.766 INFO:tasks.workunit.client.1.smithi082.stdout:2/286: write d6/d18/f4c [781297,120827] 0 2024-02-15T22:41:11.768 INFO:tasks.workunit.client.1.smithi082.stdout:3/195: rename d0/l39 to d0/d19/d14/d21/l3c 0 2024-02-15T22:41:11.771 INFO:tasks.workunit.client.1.smithi082.stdout:8/172: rename d1/d7/de/f36 to d1/d7/de/f3e 0 2024-02-15T22:41:11.772 INFO:tasks.workunit.client.1.smithi082.stdout:8/173: read d1/f1b [162402,56704] 0 2024-02-15T22:41:11.772 INFO:tasks.workunit.client.1.smithi082.stdout:2/287: link d6/dc/dd/l52 d6/d18/l5d 0 2024-02-15T22:41:11.773 INFO:tasks.workunit.client.1.smithi082.stdout:8/174: fdatasync d1/f14 0 2024-02-15T22:41:11.774 INFO:tasks.workunit.client.1.smithi082.stdout:8/175: chown d1/d7/d9/d24/d30 1248 1 2024-02-15T22:41:11.774 INFO:tasks.workunit.client.1.smithi082.stdout:0/247: mkdir d3/d19/d25/d45/d56 0 2024-02-15T22:41:11.774 INFO:tasks.workunit.client.1.smithi082.stdout:8/176: write d1/d7/de/d1e/f27 [128740,6504] 0 2024-02-15T22:41:11.776 INFO:tasks.workunit.client.1.smithi082.stdout:3/196: truncate d0/f33 3719802 0 2024-02-15T22:41:11.776 INFO:tasks.workunit.client.1.smithi082.stdout:3/197: write d0/d16/f1f [2139149,102322] 0 2024-02-15T22:41:11.776 INFO:tasks.workunit.client.1.smithi082.stdout:2/288: write f2 [307126,70966] 0 2024-02-15T22:41:11.776 INFO:tasks.workunit.client.1.smithi082.stdout:2/289: write d6/d18/f47 [310593,64030] 0 2024-02-15T22:41:11.778 INFO:tasks.workunit.client.1.smithi082.stdout:8/177: mknod d1/d7/c3f 0 2024-02-15T22:41:11.778 INFO:tasks.workunit.client.1.smithi082.stdout:8/178: truncate d1/d7/de/f32 844530 0 2024-02-15T22:41:11.783 INFO:tasks.workunit.client.1.smithi082.stdout:8/179: mkdir d1/d40 0 2024-02-15T22:41:11.787 INFO:tasks.workunit.client.1.smithi082.stdout:8/180: dread d1/f3a [0,4194304] 0 2024-02-15T22:41:11.787 INFO:tasks.workunit.client.1.smithi082.stdout:8/181: write d1/d7/d9/d24/d30/f3c [856323,121202] 0 2024-02-15T22:41:11.789 INFO:tasks.workunit.client.1.smithi082.stdout:8/182: symlink d1/d7/d9/d24/d30/l41 0 2024-02-15T22:41:11.797 INFO:tasks.workunit.client.1.smithi082.stdout:8/183: dread d1/f5 [0,4194304] 0 2024-02-15T22:41:11.798 INFO:tasks.workunit.client.1.smithi082.stdout:8/184: chown d1/d7/de/c2c 1781629633 1 2024-02-15T22:41:11.802 INFO:tasks.workunit.client.1.smithi082.stdout:3/198: dwrite d0/d16/f3a [0,4194304] 0 2024-02-15T22:41:11.803 INFO:tasks.workunit.client.1.smithi082.stdout:3/199: fdatasync d0/d19/d14/f28 0 2024-02-15T22:41:11.803 INFO:tasks.workunit.client.1.smithi082.stdout:2/290: dwrite d6/dc/f38 [0,4194304] 0 2024-02-15T22:41:11.804 INFO:tasks.workunit.client.1.smithi082.stdout:0/248: dwrite d3/d19/d25/d45/f55 [0,4194304] 0 2024-02-15T22:41:11.805 INFO:tasks.workunit.client.1.smithi082.stdout:3/200: truncate d0/d19/f7 3956165 0 2024-02-15T22:41:11.810 INFO:tasks.workunit.client.1.smithi082.stdout:8/185: dread d1/d7/de/f3e [0,4194304] 0 2024-02-15T22:41:11.813 INFO:tasks.workunit.client.1.smithi082.stdout:8/186: mkdir d1/d7/d9/d42 0 2024-02-15T22:41:11.814 INFO:tasks.workunit.client.1.smithi082.stdout:8/187: write d1/d7/de/f2e [706545,51436] 0 2024-02-15T22:41:11.817 INFO:tasks.workunit.client.1.smithi082.stdout:8/188: mkdir d1/d7/d9/d24/d43 0 2024-02-15T22:41:11.838 INFO:tasks.workunit.client.1.smithi082.stdout:3/201: dwrite d0/f1c [4194304,4194304] 0 2024-02-15T22:41:11.839 INFO:tasks.workunit.client.1.smithi082.stdout:8/189: fsync d1/f18 0 2024-02-15T22:41:11.839 INFO:tasks.workunit.client.1.smithi082.stdout:8/190: fdatasync d1/f23 0 2024-02-15T22:41:11.840 INFO:tasks.workunit.client.1.smithi082.stdout:2/291: dwrite d6/dc/d58/f3b [0,4194304] 0 2024-02-15T22:41:11.840 INFO:tasks.workunit.client.1.smithi082.stdout:0/249: dwrite d3/d19/d25/d45/f1a [0,4194304] 0 2024-02-15T22:41:11.840 INFO:tasks.workunit.client.1.smithi082.stdout:0/250: stat d3/fe 0 2024-02-15T22:41:11.840 INFO:tasks.workunit.client.1.smithi082.stdout:0/251: write d3/d19/d25/d45/f39 [5503,16648] 0 2024-02-15T22:41:11.840 INFO:tasks.workunit.client.1.smithi082.stdout:0/252: creat d3/f57 x:0 0 0 2024-02-15T22:41:11.843 INFO:tasks.workunit.client.1.smithi082.stdout:2/292: mkdir d6/dc/d58/d49/d5e 0 2024-02-15T22:41:11.844 INFO:tasks.workunit.client.1.smithi082.stdout:8/191: getdents d1/d7/d9 0 2024-02-15T22:41:11.845 INFO:tasks.workunit.client.1.smithi082.stdout:8/192: write d1/d7/de/f3d [772268,57966] 0 2024-02-15T22:41:11.845 INFO:tasks.workunit.client.1.smithi082.stdout:8/193: write d1/f21 [417825,124175] 0 2024-02-15T22:41:11.845 INFO:tasks.workunit.client.1.smithi082.stdout:8/194: read d1/d7/de/d1e/f27 [1059213,80346] 0 2024-02-15T22:41:11.846 INFO:tasks.workunit.client.1.smithi082.stdout:8/195: read d1/d7/de/f2e [531216,19229] 0 2024-02-15T22:41:11.846 INFO:tasks.workunit.client.1.smithi082.stdout:8/196: creat d1/f44 x:0 0 0 2024-02-15T22:41:11.851 INFO:tasks.workunit.client.1.smithi082.stdout:0/253: creat d3/d19/f58 x:0 0 0 2024-02-15T22:41:11.851 INFO:tasks.workunit.client.1.smithi082.stdout:3/202: dwrite d0/d19/d2e/f38 [0,4194304] 0 2024-02-15T22:41:11.852 INFO:tasks.workunit.client.1.smithi082.stdout:2/293: rename d6/d18/l59 to d6/dc/d58/d49/l5f 0 2024-02-15T22:41:11.852 INFO:tasks.workunit.client.1.smithi082.stdout:2/294: dread - d6/d18/f37 zero size 2024-02-15T22:41:11.854 INFO:tasks.workunit.client.1.smithi082.stdout:8/197: mknod d1/d7/d9/d24/d30/c45 0 2024-02-15T22:41:11.855 INFO:tasks.workunit.client.1.smithi082.stdout:8/198: dread d1/d7/de/f32 [0,4194304] 0 2024-02-15T22:41:11.855 INFO:tasks.workunit.client.1.smithi082.stdout:0/254: symlink d3/d19/d25/d45/d56/l59 0 2024-02-15T22:41:11.855 INFO:tasks.workunit.client.1.smithi082.stdout:0/255: chown d3/d19/d20/d26 516832 1 2024-02-15T22:41:11.857 INFO:tasks.workunit.client.1.smithi082.stdout:3/203: creat d0/d19/d14/d21/f3d x:0 0 0 2024-02-15T22:41:11.857 INFO:tasks.workunit.client.1.smithi082.stdout:3/204: write d0/d19/f36 [738179,113137] 0 2024-02-15T22:41:11.857 INFO:tasks.workunit.client.1.smithi082.stdout:3/205: dread - d0/d19/d14/d21/f3d zero size 2024-02-15T22:41:11.859 INFO:tasks.workunit.client.1.smithi082.stdout:2/295: rename d6/dc/dd/f41 to d6/dc/d58/d49/d5e/f60 0 2024-02-15T22:41:11.861 INFO:tasks.workunit.client.1.smithi082.stdout:8/199: creat d1/d7/d9/d42/f46 x:0 0 0 2024-02-15T22:41:11.861 INFO:tasks.workunit.client.1.smithi082.stdout:8/200: write d1/d7/de/d1e/f39 [927949,43205] 0 2024-02-15T22:41:11.861 INFO:tasks.workunit.client.1.smithi082.stdout:8/201: write d1/d7/de/d1e/f27 [1605928,28713] 0 2024-02-15T22:41:11.861 INFO:tasks.workunit.client.1.smithi082.stdout:8/202: chown d1/d7/c1a 13537 1 2024-02-15T22:41:11.861 INFO:tasks.workunit.client.1.smithi082.stdout:8/203: chown d1/f44 206 1 2024-02-15T22:41:11.861 INFO:tasks.workunit.client.1.smithi082.stdout:8/204: write d1/f44 [13204,93171] 0 2024-02-15T22:41:11.862 INFO:tasks.workunit.client.1.smithi082.stdout:3/206: mkdir d0/d16/d3e 0 2024-02-15T22:41:11.866 INFO:tasks.workunit.client.1.smithi082.stdout:8/205: rename d1/d7/de/f3e to d1/d7/d9/f47 0 2024-02-15T22:41:11.866 INFO:tasks.workunit.client.1.smithi082.stdout:8/206: chown d1/d7/d9/c37 20 1 2024-02-15T22:41:11.868 INFO:tasks.workunit.client.1.smithi082.stdout:3/207: mkdir d0/dc/d3f 0 2024-02-15T22:41:11.869 INFO:tasks.workunit.client.1.smithi082.stdout:5/264: sync 2024-02-15T22:41:11.869 INFO:tasks.workunit.client.1.smithi082.stdout:7/166: sync 2024-02-15T22:41:11.870 INFO:tasks.workunit.client.1.smithi082.stdout:5/265: chown d5/da/d14/l44 132395919 1 2024-02-15T22:41:11.870 INFO:tasks.workunit.client.1.smithi082.stdout:7/167: creat d12/f38 x:0 0 0 2024-02-15T22:41:11.872 INFO:tasks.workunit.client.1.smithi082.stdout:5/266: rename d5/da/dc/l27 to d5/da/d14/d45/d52/l54 0 2024-02-15T22:41:11.873 INFO:tasks.workunit.client.1.smithi082.stdout:5/267: symlink d5/da/d14/d53/l55 0 2024-02-15T22:41:11.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:11 smithi082 ceph-mon[37153]: pgmap v18: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 93 MiB/s rd, 134 MiB/s wr, 530 op/s 2024-02-15T22:41:11.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:11 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:11.874 INFO:tasks.workunit.client.1.smithi082.stdout:5/268: mkdir d5/da/d56 0 2024-02-15T22:41:11.875 INFO:tasks.workunit.client.1.smithi082.stdout:5/269: mknod d5/da/dc/d43/c57 0 2024-02-15T22:41:11.875 INFO:tasks.workunit.client.1.smithi082.stdout:5/270: chown d5/da/d14/d45/l47 0 1 2024-02-15T22:41:11.877 INFO:tasks.workunit.client.1.smithi082.stdout:5/271: rename d5/da/f4a to d5/da/d14/d45/f58 0 2024-02-15T22:41:11.877 INFO:tasks.workunit.client.1.smithi082.stdout:5/272: chown d5/da/d22/l34 65717296 1 2024-02-15T22:41:11.878 INFO:tasks.workunit.client.1.smithi082.stdout:4/188: sync 2024-02-15T22:41:11.878 INFO:tasks.workunit.client.1.smithi082.stdout:9/258: sync 2024-02-15T22:41:11.878 INFO:tasks.workunit.client.1.smithi082.stdout:4/189: dread - d0/d8/d32/f33 zero size 2024-02-15T22:41:11.878 INFO:tasks.workunit.client.1.smithi082.stdout:1/239: sync 2024-02-15T22:41:11.878 INFO:tasks.workunit.client.1.smithi082.stdout:4/190: readlink d0/d8/d1b/l26 0 2024-02-15T22:41:11.878 INFO:tasks.workunit.client.1.smithi082.stdout:6/337: sync 2024-02-15T22:41:11.879 INFO:tasks.workunit.client.1.smithi082.stdout:5/273: mkdir d5/da/d22/d59 0 2024-02-15T22:41:11.880 INFO:tasks.workunit.client.1.smithi082.stdout:4/191: mkdir d0/d8/d1b/d42 0 2024-02-15T22:41:11.884 INFO:tasks.workunit.client.1.smithi082.stdout:0/256: dwrite d3/d19/d25/d45/f55 [0,4194304] 0 2024-02-15T22:41:11.884 INFO:tasks.workunit.client.1.smithi082.stdout:7/168: dread fb [0,4194304] 0 2024-02-15T22:41:11.884 INFO:tasks.workunit.client.1.smithi082.stdout:3/208: read d0/dc/fd [8425628,35205] 0 2024-02-15T22:41:11.885 INFO:tasks.workunit.client.1.smithi082.stdout:4/192: mknod d0/d8/d1b/c43 0 2024-02-15T22:41:11.887 INFO:tasks.workunit.client.1.smithi082.stdout:7/169: mknod d12/d27/c39 0 2024-02-15T22:41:11.888 INFO:tasks.workunit.client.1.smithi082.stdout:2/296: dwrite d6/dc/d58/d49/d5e/f60 [0,4194304] 0 2024-02-15T22:41:11.889 INFO:tasks.workunit.client.1.smithi082.stdout:8/207: dwrite d1/f1b [0,4194304] 0 2024-02-15T22:41:11.889 INFO:tasks.workunit.client.1.smithi082.stdout:6/338: rmdir d2/d18/d23/d60 0 2024-02-15T22:41:11.891 INFO:tasks.workunit.client.1.smithi082.stdout:7/170: rmdir d12/d27/d33/d35 0 2024-02-15T22:41:11.894 INFO:tasks.workunit.client.1.smithi082.stdout:2/297: truncate d6/d18/f22 3578393 0 2024-02-15T22:41:11.894 INFO:tasks.workunit.client.1.smithi082.stdout:2/298: chown d6/dc/d58 235 1 2024-02-15T22:41:11.898 INFO:tasks.workunit.client.1.smithi082.stdout:6/339: rename d2/d18/f34 to d2/d18/d23/d67/f6d 0 2024-02-15T22:41:11.898 INFO:tasks.workunit.client.1.smithi082.stdout:7/171: symlink d12/d17/l3a 0 2024-02-15T22:41:11.901 INFO:tasks.workunit.client.1.smithi082.stdout:0/257: write d3/d19/d25/f48 [3776756,42372] 0 2024-02-15T22:41:11.901 INFO:tasks.workunit.client.1.smithi082.stdout:0/258: fsync d3/d19/f44 0 2024-02-15T22:41:11.901 INFO:tasks.workunit.client.1.smithi082.stdout:2/299: creat d6/dc/d58/f61 x:0 0 0 2024-02-15T22:41:11.905 INFO:tasks.workunit.client.1.smithi082.stdout:6/340: unlink d2/fd 0 2024-02-15T22:41:11.907 INFO:tasks.workunit.client.1.smithi082.stdout:2/300: link d6/dc/d58/l3f d6/l62 0 2024-02-15T22:41:11.908 INFO:tasks.workunit.client.1.smithi082.stdout:6/341: creat d2/f6e x:0 0 0 2024-02-15T22:41:11.909 INFO:tasks.workunit.client.1.smithi082.stdout:7/172: mkdir d12/d3b 0 2024-02-15T22:41:11.910 INFO:tasks.workunit.client.1.smithi082.stdout:7/173: write ff [1141325,26376] 0 2024-02-15T22:41:11.911 INFO:tasks.workunit.client.1.smithi082.stdout:0/259: mknod d3/d19/d1c/c5a 0 2024-02-15T22:41:11.911 INFO:tasks.workunit.client.1.smithi082.stdout:0/260: truncate d3/f40 5030264 0 2024-02-15T22:41:11.911 INFO:tasks.workunit.client.1.smithi082.stdout:0/261: read - d3/d19/d20/d26/f4e zero size 2024-02-15T22:41:11.912 INFO:tasks.workunit.client.1.smithi082.stdout:2/301: mkdir d6/dc/d12/d46/d4b/d63 0 2024-02-15T22:41:11.912 INFO:tasks.workunit.client.1.smithi082.stdout:4/193: dwrite d0/d16/f22 [0,4194304] 0 2024-02-15T22:41:11.913 INFO:tasks.workunit.client.1.smithi082.stdout:6/342: link d2/f1a d2/d18/d23/d3c/f6f 0 2024-02-15T22:41:11.914 INFO:tasks.workunit.client.1.smithi082.stdout:7/174: creat d12/f3c x:0 0 0 2024-02-15T22:41:11.915 INFO:tasks.workunit.client.1.smithi082.stdout:1/240: dwrite d1/f39 [0,4194304] 0 2024-02-15T22:41:11.915 INFO:tasks.workunit.client.1.smithi082.stdout:8/208: dwrite d1/d7/f2a [0,4194304] 0 2024-02-15T22:41:11.916 INFO:tasks.workunit.client.1.smithi082.stdout:0/262: link d3/f12 d3/d19/d20/f5b 0 2024-02-15T22:41:11.917 INFO:tasks.workunit.client.1.smithi082.stdout:2/302: mknod d6/dc/d12/d46/d4b/d63/c64 0 2024-02-15T22:41:11.917 INFO:tasks.workunit.client.1.smithi082.stdout:2/303: creat d6/dc/dd/d24/f65 x:0 0 0 2024-02-15T22:41:11.922 INFO:tasks.workunit.client.1.smithi082.stdout:4/194: creat d0/d16/f44 x:0 0 0 2024-02-15T22:41:11.924 INFO:tasks.workunit.client.1.smithi082.stdout:6/343: rename d2/d30/l38 to d2/d18/d23/d3c/d47/d69/l70 0 2024-02-15T22:41:11.925 INFO:tasks.workunit.client.1.smithi082.stdout:5/274: rmdir d5/da/d14 39 2024-02-15T22:41:11.929 INFO:tasks.workunit.client.1.smithi082.stdout:1/241: link d1/f1d d1/f4d 0 2024-02-15T22:41:11.930 INFO:tasks.workunit.client.1.smithi082.stdout:8/209: dwrite d1/f23 [0,4194304] 0 2024-02-15T22:41:11.933 INFO:tasks.workunit.client.1.smithi082.stdout:0/263: symlink d3/d19/d20/d26/l5c 0 2024-02-15T22:41:11.937 INFO:tasks.workunit.client.1.smithi082.stdout:2/304: creat d6/dc/d12/d46/d4b/d63/f66 x:0 0 0 2024-02-15T22:41:11.938 INFO:tasks.workunit.client.1.smithi082.stdout:5/275: dwrite d5/da/f1c [0,4194304] 0 2024-02-15T22:41:11.945 INFO:tasks.workunit.client.1.smithi082.stdout:1/242: symlink d1/da/d14/d18/d1f/d2f/l4e 0 2024-02-15T22:41:11.948 INFO:tasks.workunit.client.1.smithi082.stdout:0/264: dwrite d3/d19/d25/d45/f1a [0,4194304] 0 2024-02-15T22:41:11.949 INFO:tasks.workunit.client.1.smithi082.stdout:8/210: rename d1/d7/d9/d24/d33 to d1/d7/d48 0 2024-02-15T22:41:11.949 INFO:tasks.workunit.client.1.smithi082.stdout:8/211: truncate d1/f14 7046878 0 2024-02-15T22:41:11.950 INFO:tasks.workunit.client.1.smithi082.stdout:2/305: mkdir d6/dc/d58/d49/d5e/d67 0 2024-02-15T22:41:11.955 INFO:tasks.workunit.client.1.smithi082.stdout:5/276: unlink d5/da/d22/f38 0 2024-02-15T22:41:11.955 INFO:tasks.workunit.client.1.smithi082.stdout:4/195: rmdir d0/d8/d32/d39 39 2024-02-15T22:41:11.958 INFO:tasks.workunit.client.1.smithi082.stdout:2/306: symlink d6/dc/l68 0 2024-02-15T22:41:11.959 INFO:tasks.workunit.client.1.smithi082.stdout:5/277: creat d5/da/d14/f5a x:0 0 0 2024-02-15T22:41:11.959 INFO:tasks.workunit.client.1.smithi082.stdout:5/278: fdatasync d5/da/d14/f1b 0 2024-02-15T22:41:11.962 INFO:tasks.workunit.client.1.smithi082.stdout:4/196: unlink d0/d16/f44 0 2024-02-15T22:41:11.963 INFO:tasks.workunit.client.1.smithi082.stdout:7/175: rmdir d12 39 2024-02-15T22:41:11.965 INFO:tasks.workunit.client.1.smithi082.stdout:7/176: read f10 [909154,12228] 0 2024-02-15T22:41:11.965 INFO:tasks.workunit.client.1.smithi082.stdout:1/243: dwrite d1/f1d [0,4194304] 0 2024-02-15T22:41:11.965 INFO:tasks.workunit.client.1.smithi082.stdout:1/244: write d1/da/d14/f28 [2146462,24688] 0 2024-02-15T22:41:11.966 INFO:tasks.workunit.client.1.smithi082.stdout:2/307: creat d6/dc/d12/d46/d4b/f69 x:0 0 0 2024-02-15T22:41:11.966 INFO:tasks.workunit.client.1.smithi082.stdout:7/177: fsync d12/f16 0 2024-02-15T22:41:11.970 INFO:tasks.workunit.client.1.smithi082.stdout:1/245: rename d1/f4d to d1/da/d14/d18/d1f/f4f 0 2024-02-15T22:41:11.970 INFO:tasks.workunit.client.1.smithi082.stdout:1/246: readlink d1/da/d14/l35 0 2024-02-15T22:41:11.970 INFO:tasks.workunit.client.1.smithi082.stdout:1/247: chown d1/da/d14/f2a 273480244 1 2024-02-15T22:41:11.971 INFO:tasks.workunit.client.1.smithi082.stdout:2/308: rmdir d6/dc/d58/d49/d5e 39 2024-02-15T22:41:11.974 INFO:tasks.workunit.client.1.smithi082.stdout:2/309: symlink d6/dc/d58/l6a 0 2024-02-15T22:41:11.974 INFO:tasks.workunit.client.1.smithi082.stdout:2/310: dread - d6/dc/dd/d1d/f57 zero size 2024-02-15T22:41:11.975 INFO:tasks.workunit.client.1.smithi082.stdout:0/265: getdents d3/d19/d20/d26 0 2024-02-15T22:41:11.975 INFO:tasks.workunit.client.1.smithi082.stdout:4/197: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:11.975 INFO:tasks.workunit.client.1.smithi082.stdout:4/198: dread - d0/d8/d1b/dd/f41 zero size 2024-02-15T22:41:11.975 INFO:tasks.workunit.client.1.smithi082.stdout:4/199: readlink d0/d8/l38 0 2024-02-15T22:41:11.975 INFO:tasks.workunit.client.1.smithi082.stdout:4/200: write d0/f23 [459291,101912] 0 2024-02-15T22:41:11.975 INFO:tasks.workunit.client.1.smithi082.stdout:4/201: chown d0/d16/f3a 87 1 2024-02-15T22:41:11.976 INFO:tasks.workunit.client.1.smithi082.stdout:8/212: dwrite d1/f19 [0,4194304] 0 2024-02-15T22:41:11.977 INFO:tasks.workunit.client.1.smithi082.stdout:8/213: chown d1/c28 55703 1 2024-02-15T22:41:11.977 INFO:tasks.workunit.client.1.smithi082.stdout:8/214: creat d1/d7/d9/d42/f49 x:0 0 0 2024-02-15T22:41:11.978 INFO:tasks.workunit.client.1.smithi082.stdout:2/311: mknod d6/d3c/c6b 0 2024-02-15T22:41:11.978 INFO:tasks.workunit.client.1.smithi082.stdout:2/312: dread - d6/dc/d58/f61 zero size 2024-02-15T22:41:11.978 INFO:tasks.workunit.client.1.smithi082.stdout:2/313: chown d6/d3c/f4e 93 1 2024-02-15T22:41:11.979 INFO:tasks.workunit.client.1.smithi082.stdout:4/202: mknod d0/d8/d1b/dd/d37/c45 0 2024-02-15T22:41:11.979 INFO:tasks.workunit.client.1.smithi082.stdout:0/266: dread d3/d19/d25/f48 [0,4194304] 0 2024-02-15T22:41:11.982 INFO:tasks.workunit.client.1.smithi082.stdout:7/178: dread d12/f2d [0,4194304] 0 2024-02-15T22:41:11.982 INFO:tasks.workunit.client.1.smithi082.stdout:7/179: chown d12/d17/f1f 4 1 2024-02-15T22:41:11.982 INFO:tasks.workunit.client.1.smithi082.stdout:8/215: mknod d1/d7/de/d1e/c4a 0 2024-02-15T22:41:11.984 INFO:tasks.workunit.client.1.smithi082.stdout:2/314: mkdir d6/dc/d6c 0 2024-02-15T22:41:11.987 INFO:tasks.workunit.client.1.smithi082.stdout:8/216: creat d1/d7/d9/d24/d30/f4b x:0 0 0 2024-02-15T22:41:11.989 INFO:tasks.workunit.client.1.smithi082.stdout:4/203: mkdir d0/d46 0 2024-02-15T22:41:11.990 INFO:tasks.workunit.client.1.smithi082.stdout:0/267: mknod d3/d19/d1c/c5d 0 2024-02-15T22:41:11.994 INFO:tasks.workunit.client.1.smithi082.stdout:7/180: dread d12/d17/f1f [0,4194304] 0 2024-02-15T22:41:11.994 INFO:tasks.workunit.client.1.smithi082.stdout:4/204: rename d0/d8/d1b/d42 to d0/d47 0 2024-02-15T22:41:11.995 INFO:tasks.workunit.client.1.smithi082.stdout:5/279: dwrite d5/da/d14/f5a [0,4194304] 0 2024-02-15T22:41:11.996 INFO:tasks.workunit.client.1.smithi082.stdout:2/315: dread d6/dc/d58/d49/d5e/f60 [0,4194304] 0 2024-02-15T22:41:11.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/181: readlink d12/l15 0 2024-02-15T22:41:11.997 INFO:tasks.workunit.client.1.smithi082.stdout:1/248: dwrite d1/da/f1c [4194304,4194304] 0 2024-02-15T22:41:11.997 INFO:tasks.workunit.client.1.smithi082.stdout:4/205: mknod d0/d8/d1b/dd/c48 0 2024-02-15T22:41:12.001 INFO:tasks.workunit.client.1.smithi082.stdout:5/280: creat d5/da/d56/f5b x:0 0 0 2024-02-15T22:41:12.002 INFO:tasks.workunit.client.1.smithi082.stdout:2/316: rename d6/dc/d58/f3b to d6/d3c/f6d 0 2024-02-15T22:41:12.002 INFO:tasks.workunit.client.1.smithi082.stdout:2/317: truncate d6/d18/f37 641777 0 2024-02-15T22:41:12.003 INFO:tasks.workunit.client.1.smithi082.stdout:7/182: readlink d12/l1b 0 2024-02-15T22:41:12.005 INFO:tasks.workunit.client.1.smithi082.stdout:8/217: dwrite d1/d7/de/f2f [0,4194304] 0 2024-02-15T22:41:12.006 INFO:tasks.workunit.client.1.smithi082.stdout:1/249: creat d1/da/d14/d18/d1f/f50 x:0 0 0 2024-02-15T22:41:12.006 INFO:tasks.workunit.client.1.smithi082.stdout:4/206: truncate d0/d8/fa 394132 0 2024-02-15T22:41:12.010 INFO:tasks.workunit.client.1.smithi082.stdout:5/281: creat d5/da/d22/d59/f5c x:0 0 0 2024-02-15T22:41:12.010 INFO:tasks.workunit.client.1.smithi082.stdout:2/318: rmdir d6/dc/d58/d49 39 2024-02-15T22:41:12.015 INFO:tasks.workunit.client.1.smithi082.stdout:8/218: symlink d1/d7/d48/l4c 0 2024-02-15T22:41:12.015 INFO:tasks.workunit.client.1.smithi082.stdout:8/219: creat d1/d7/de/f4d x:0 0 0 2024-02-15T22:41:12.016 INFO:tasks.workunit.client.1.smithi082.stdout:4/207: creat d0/d47/f49 x:0 0 0 2024-02-15T22:41:12.017 INFO:tasks.workunit.client.1.smithi082.stdout:2/319: mkdir d6/dc/d12/d23/d6e 0 2024-02-15T22:41:12.019 INFO:tasks.workunit.client.1.smithi082.stdout:5/282: dread d5/f2e [0,4194304] 0 2024-02-15T22:41:12.019 INFO:tasks.workunit.client.1.smithi082.stdout:5/283: chown d5/da/dc/l16 11949 1 2024-02-15T22:41:12.026 INFO:tasks.workunit.client.1.smithi082.stdout:2/320: rmdir d6/dc/d6c 0 2024-02-15T22:41:12.026 INFO:tasks.workunit.client.1.smithi082.stdout:2/321: write d6/dc/dd/d1d/f57 [357732,21372] 0 2024-02-15T22:41:12.026 INFO:tasks.workunit.client.1.smithi082.stdout:2/322: dread - d6/dc/dd/d24/f39 zero size 2024-02-15T22:41:12.027 INFO:tasks.workunit.client.1.smithi082.stdout:8/220: read d1/d7/d9/f47 [2151341,120480] 0 2024-02-15T22:41:12.027 INFO:tasks.workunit.client.1.smithi082.stdout:8/221: truncate d1/f3a 666389 0 2024-02-15T22:41:12.027 INFO:tasks.workunit.client.1.smithi082.stdout:8/222: write d1/d7/de/f2e [1161181,112916] 0 2024-02-15T22:41:12.027 INFO:tasks.workunit.client.1.smithi082.stdout:1/250: dwrite d1/da/d14/d18/d1f/d2f/f3b [0,4194304] 0 2024-02-15T22:41:12.028 INFO:tasks.workunit.client.1.smithi082.stdout:5/284: mknod d5/da/d56/c5d 0 2024-02-15T22:41:12.028 INFO:tasks.workunit.client.1.smithi082.stdout:5/285: write d5/da/d14/f50 [985478,58043] 0 2024-02-15T22:41:12.028 INFO:tasks.workunit.client.1.smithi082.stdout:5/286: creat d5/da/f5e x:0 0 0 2024-02-15T22:41:12.028 INFO:tasks.workunit.client.1.smithi082.stdout:5/287: truncate d5/da/d14/f18 512350 0 2024-02-15T22:41:12.029 INFO:tasks.workunit.client.1.smithi082.stdout:7/183: dwrite d12/d17/f19 [4194304,4194304] 0 2024-02-15T22:41:12.029 INFO:tasks.workunit.client.1.smithi082.stdout:7/184: chown d12 10548659 1 2024-02-15T22:41:12.029 INFO:tasks.workunit.client.1.smithi082.stdout:7/185: readlink d12/d27/l2b 0 2024-02-15T22:41:12.029 INFO:tasks.workunit.client.1.smithi082.stdout:4/208: mkdir d0/d16/d4a 0 2024-02-15T22:41:12.029 INFO:tasks.workunit.client.1.smithi082.stdout:4/209: truncate d0/d47/f49 215337 0 2024-02-15T22:41:12.030 INFO:tasks.workunit.client.1.smithi082.stdout:4/210: write d0/d16/f2d [3947680,66777] 0 2024-02-15T22:41:12.031 INFO:tasks.workunit.client.1.smithi082.stdout:2/323: rename d6/dc/dd/d21/c28 to d6/dc/d12/d46/c6f 0 2024-02-15T22:41:12.031 INFO:tasks.workunit.client.1.smithi082.stdout:2/324: truncate d6/dc/d12/d46/d4b/d63/f66 694918 0 2024-02-15T22:41:12.032 INFO:tasks.workunit.client.1.smithi082.stdout:8/223: mknod d1/d7/de/c4e 0 2024-02-15T22:41:12.032 INFO:tasks.workunit.client.1.smithi082.stdout:8/224: creat d1/f4f x:0 0 0 2024-02-15T22:41:12.035 INFO:tasks.workunit.client.1.smithi082.stdout:1/251: getdents d1/da/d14/d18 0 2024-02-15T22:41:12.035 INFO:tasks.workunit.client.1.smithi082.stdout:1/252: chown d1/da/d14/l35 0 1 2024-02-15T22:41:12.038 INFO:tasks.workunit.client.1.smithi082.stdout:5/288: unlink d5/da/d14/f31 0 2024-02-15T22:41:12.039 INFO:tasks.workunit.client.1.smithi082.stdout:7/186: mkdir d12/d17/d3d 0 2024-02-15T22:41:12.040 INFO:tasks.workunit.client.1.smithi082.stdout:7/187: fdatasync d12/d27/f2f 0 2024-02-15T22:41:12.041 INFO:tasks.workunit.client.1.smithi082.stdout:4/211: mknod d0/d8/d32/d39/c4b 0 2024-02-15T22:41:12.041 INFO:tasks.workunit.client.1.smithi082.stdout:4/212: truncate d0/d8/f34 923657 0 2024-02-15T22:41:12.041 INFO:tasks.workunit.client.1.smithi082.stdout:4/213: creat d0/d8/d1b/dd/f4c x:0 0 0 2024-02-15T22:41:12.042 INFO:tasks.workunit.client.1.smithi082.stdout:2/325: symlink d6/dc/l70 0 2024-02-15T22:41:12.042 INFO:tasks.workunit.client.1.smithi082.stdout:2/326: stat d6/d3c/c6b 0 2024-02-15T22:41:12.042 INFO:tasks.workunit.client.1.smithi082.stdout:2/327: write d6/d3c/f4e [675590,20337] 0 2024-02-15T22:41:12.043 INFO:tasks.workunit.client.1.smithi082.stdout:8/225: mkdir d1/d7/d9/d50 0 2024-02-15T22:41:12.052 INFO:tasks.workunit.client.1.smithi082.stdout:1/253: mkdir d1/da/d14/d18/d51 0 2024-02-15T22:41:12.053 INFO:tasks.workunit.client.1.smithi082.stdout:5/289: creat d5/da/d14/d53/f5f x:0 0 0 2024-02-15T22:41:12.055 INFO:tasks.workunit.client.1.smithi082.stdout:7/188: rename d12/d27/c39 to d12/d17/c3e 0 2024-02-15T22:41:12.055 INFO:tasks.workunit.client.1.smithi082.stdout:7/189: fsync f6 0 2024-02-15T22:41:12.057 INFO:tasks.workunit.client.1.smithi082.stdout:4/214: mkdir d0/d47/d4d 0 2024-02-15T22:41:12.057 INFO:tasks.workunit.client.1.smithi082.stdout:2/328: rmdir d6/dc/d12 39 2024-02-15T22:41:12.058 INFO:tasks.workunit.client.1.smithi082.stdout:2/329: fdatasync d6/dc/dd/d24/f30 0 2024-02-15T22:41:12.058 INFO:tasks.workunit.client.1.smithi082.stdout:2/330: write d6/d18/f47 [1133876,95858] 0 2024-02-15T22:41:12.058 INFO:tasks.workunit.client.1.smithi082.stdout:2/331: stat d6/dc/d58/fe 0 2024-02-15T22:41:12.059 INFO:tasks.workunit.client.1.smithi082.stdout:5/290: link d5/da/d14/f50 d5/da/d14/d45/f60 0 2024-02-15T22:41:12.059 INFO:tasks.workunit.client.1.smithi082.stdout:5/291: read d5/da/d14/f18 [373600,7000] 0 2024-02-15T22:41:12.059 INFO:tasks.workunit.client.1.smithi082.stdout:5/292: readlink d5/l30 0 2024-02-15T22:41:12.060 INFO:tasks.workunit.client.1.smithi082.stdout:7/190: creat d12/d3b/f3f x:0 0 0 2024-02-15T22:41:12.060 INFO:tasks.workunit.client.1.smithi082.stdout:4/215: read - d0/d16/f28 zero size 2024-02-15T22:41:12.061 INFO:tasks.workunit.client.1.smithi082.stdout:4/216: creat d0/d8/d32/f4e x:0 0 0 2024-02-15T22:41:12.063 INFO:tasks.workunit.client.1.smithi082.stdout:7/191: stat d12/f20 0 2024-02-15T22:41:12.064 INFO:tasks.workunit.client.1.smithi082.stdout:8/226: dwrite d1/f19 [0,4194304] 0 2024-02-15T22:41:12.064 INFO:tasks.workunit.client.1.smithi082.stdout:8/227: truncate d1/d7/d9/d42/f46 893876 0 2024-02-15T22:41:12.065 INFO:tasks.workunit.client.1.smithi082.stdout:4/217: mknod d0/d8/d1b/dd/c4f 0 2024-02-15T22:41:12.065 INFO:tasks.workunit.client.1.smithi082.stdout:4/218: stat d0/d16/f3a 0 2024-02-15T22:41:12.074 INFO:tasks.workunit.client.1.smithi082.stdout:5/293: rmdir d5 39 2024-02-15T22:41:12.075 INFO:tasks.workunit.client.1.smithi082.stdout:8/228: rename d1/d7/d9/c37 to d1/d7/c51 0 2024-02-15T22:41:12.076 INFO:tasks.workunit.client.1.smithi082.stdout:4/219: symlink d0/d16/d4a/l50 0 2024-02-15T22:41:12.076 INFO:tasks.workunit.client.1.smithi082.stdout:7/192: dwrite d12/d17/f23 [0,4194304] 0 2024-02-15T22:41:12.077 INFO:tasks.workunit.client.1.smithi082.stdout:5/294: creat d5/da/d14/f61 x:0 0 0 2024-02-15T22:41:12.077 INFO:tasks.workunit.client.1.smithi082.stdout:8/229: symlink d1/d7/d9/d42/l52 0 2024-02-15T22:41:12.079 INFO:tasks.workunit.client.1.smithi082.stdout:8/230: dread d1/f44 [0,4194304] 0 2024-02-15T22:41:12.079 INFO:tasks.workunit.client.1.smithi082.stdout:4/220: creat d0/d16/d4a/f51 x:0 0 0 2024-02-15T22:41:12.080 INFO:tasks.workunit.client.1.smithi082.stdout:4/221: write d0/d8/d1b/dd/f41 [324080,111610] 0 2024-02-15T22:41:12.080 INFO:tasks.workunit.client.1.smithi082.stdout:4/222: chown d0 81 1 2024-02-15T22:41:12.082 INFO:tasks.workunit.client.1.smithi082.stdout:7/193: creat d12/d17/d3d/f40 x:0 0 0 2024-02-15T22:41:12.084 INFO:tasks.workunit.client.1.smithi082.stdout:4/223: link d0/d8/fa d0/d16/d4a/f52 0 2024-02-15T22:41:12.084 INFO:tasks.workunit.client.1.smithi082.stdout:4/224: write d0/f2 [726976,98545] 0 2024-02-15T22:41:12.084 INFO:tasks.workunit.client.1.smithi082.stdout:4/225: write d0/d16/f3a [984206,63620] 0 2024-02-15T22:41:12.084 INFO:tasks.workunit.client.1.smithi082.stdout:7/194: mkdir d12/d3b/d41 0 2024-02-15T22:41:12.086 INFO:tasks.workunit.client.1.smithi082.stdout:7/195: mkdir d12/d17/d42 0 2024-02-15T22:41:12.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/196: write d12/f21 [1480862,123173] 0 2024-02-15T22:41:12.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/197: truncate d12/d17/d3d/f40 839403 0 2024-02-15T22:41:12.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/198: write d12/d17/d3d/f40 [1014238,22730] 0 2024-02-15T22:41:12.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/199: chown d12/d27/f2c 287774373 1 2024-02-15T22:41:12.095 INFO:tasks.workunit.client.1.smithi082.stdout:7/200: getdents d12/d17 0 2024-02-15T22:41:12.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/201: write fb [1791778,35709] 0 2024-02-15T22:41:12.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/202: chown d12/d17/c29 63311 1 2024-02-15T22:41:12.099 INFO:tasks.workunit.client.1.smithi082.stdout:7/203: mknod d12/d3b/d41/c43 0 2024-02-15T22:41:12.099 INFO:tasks.workunit.client.1.smithi082.stdout:7/204: creat d12/d3b/f44 x:0 0 0 2024-02-15T22:41:12.099 INFO:tasks.workunit.client.1.smithi082.stdout:5/295: dwrite d5/da/d14/f4e [0,4194304] 0 2024-02-15T22:41:12.100 INFO:tasks.workunit.client.1.smithi082.stdout:5/296: write d5/da/f3c [314820,17990] 0 2024-02-15T22:41:12.100 INFO:tasks.workunit.client.1.smithi082.stdout:7/205: rmdir d12/d3b/d41 39 2024-02-15T22:41:12.100 INFO:tasks.workunit.client.1.smithi082.stdout:7/206: truncate d12/d3b/f3f 926108 0 2024-02-15T22:41:12.103 INFO:tasks.workunit.client.1.smithi082.stdout:8/231: dwrite d1/d7/d9/d42/f49 [0,4194304] 0 2024-02-15T22:41:12.111 INFO:tasks.workunit.client.1.smithi082.stdout:8/232: dread d1/f19 [0,4194304] 0 2024-02-15T22:41:12.113 INFO:tasks.workunit.client.1.smithi082.stdout:8/233: unlink d1/c2 0 2024-02-15T22:41:12.114 INFO:tasks.workunit.client.1.smithi082.stdout:8/234: truncate d1/f18 1155398 0 2024-02-15T22:41:12.114 INFO:tasks.workunit.client.1.smithi082.stdout:4/226: dread d0/d16/f3a [0,4194304] 0 2024-02-15T22:41:12.116 INFO:tasks.workunit.client.1.smithi082.stdout:8/235: rename d1/c16 to d1/d40/c53 0 2024-02-15T22:41:12.117 INFO:tasks.workunit.client.1.smithi082.stdout:4/227: mknod d0/d47/d4d/c53 0 2024-02-15T22:41:12.119 INFO:tasks.workunit.client.1.smithi082.stdout:8/236: dread d1/d7/de/f3d [0,4194304] 0 2024-02-15T22:41:12.121 INFO:tasks.workunit.client.1.smithi082.stdout:5/297: dwrite d5/da/d14/f61 [0,4194304] 0 2024-02-15T22:41:12.121 INFO:tasks.workunit.client.1.smithi082.stdout:7/207: dread d12/f21 [0,4194304] 0 2024-02-15T22:41:12.121 INFO:tasks.workunit.client.1.smithi082.stdout:5/298: truncate d5/da/d14/d45/f58 482070 0 2024-02-15T22:41:12.122 INFO:tasks.workunit.client.1.smithi082.stdout:5/299: dread d5/da/d22/f2d [0,4194304] 0 2024-02-15T22:41:12.122 INFO:tasks.workunit.client.1.smithi082.stdout:7/208: write d12/d17/d3d/f40 [792651,27186] 0 2024-02-15T22:41:12.122 INFO:tasks.workunit.client.1.smithi082.stdout:7/209: getdents d12/d17 0 2024-02-15T22:41:12.122 INFO:tasks.workunit.client.1.smithi082.stdout:7/210: dread - d12/f38 zero size 2024-02-15T22:41:12.123 INFO:tasks.workunit.client.1.smithi082.stdout:8/237: rename d1/d7/de/f4d to d1/d7/f54 0 2024-02-15T22:41:12.123 INFO:tasks.workunit.client.1.smithi082.stdout:8/238: write d1/d7/de/f2e [1307924,75307] 0 2024-02-15T22:41:12.128 INFO:tasks.workunit.client.1.smithi082.stdout:8/239: write d1/f14 [722038,85453] 0 2024-02-15T22:41:12.129 INFO:tasks.workunit.client.1.smithi082.stdout:7/211: symlink d12/d27/l45 0 2024-02-15T22:41:12.130 INFO:tasks.workunit.client.1.smithi082.stdout:8/240: mknod d1/d7/d9/d50/c55 0 2024-02-15T22:41:12.132 INFO:tasks.workunit.client.1.smithi082.stdout:8/241: mkdir d1/d7/d9/d50/d56 0 2024-02-15T22:41:12.133 INFO:tasks.workunit.client.1.smithi082.stdout:8/242: mkdir d1/d7/de/d57 0 2024-02-15T22:41:12.134 INFO:tasks.workunit.client.1.smithi082.stdout:8/243: getdents d1/d7/d9/d24/d30 0 2024-02-15T22:41:12.134 INFO:tasks.workunit.client.1.smithi082.stdout:4/228: dwrite d0/d16/d4a/f51 [0,4194304] 0 2024-02-15T22:41:12.136 INFO:tasks.workunit.client.1.smithi082.stdout:8/244: rename d1/f44 to d1/d7/de/f58 0 2024-02-15T22:41:12.140 INFO:tasks.workunit.client.1.smithi082.stdout:8/245: link d1/d7/de/l15 d1/d7/d9/d24/l59 0 2024-02-15T22:41:12.140 INFO:tasks.workunit.client.1.smithi082.stdout:8/246: write d1/d7/de/f2e [2388270,29390] 0 2024-02-15T22:41:12.141 INFO:tasks.workunit.client.1.smithi082.stdout:4/229: rename d0/d8/d32/f33 to d0/f54 0 2024-02-15T22:41:12.143 INFO:tasks.workunit.client.1.smithi082.stdout:8/247: creat d1/d7/d9/d24/d30/f5a x:0 0 0 2024-02-15T22:41:12.143 INFO:tasks.workunit.client.1.smithi082.stdout:8/248: stat d1/d7/de/d1e/c29 0 2024-02-15T22:41:12.143 INFO:tasks.workunit.client.1.smithi082.stdout:8/249: stat d1/d7/d9/d50 0 2024-02-15T22:41:12.143 INFO:tasks.workunit.client.1.smithi082.stdout:4/230: mknod d0/d47/c55 0 2024-02-15T22:41:12.145 INFO:tasks.workunit.client.1.smithi082.stdout:8/250: mknod d1/d7/d9/d24/c5b 0 2024-02-15T22:41:12.146 INFO:tasks.workunit.client.1.smithi082.stdout:4/231: unlink d0/d8/fa 0 2024-02-15T22:41:12.150 INFO:tasks.workunit.client.1.smithi082.stdout:8/251: unlink d1/d7/de/l11 0 2024-02-15T22:41:12.151 INFO:tasks.workunit.client.1.smithi082.stdout:8/252: getdents d1/d7/d9/d50/d56 0 2024-02-15T22:41:12.151 INFO:tasks.workunit.client.1.smithi082.stdout:8/253: mknod d1/d7/d9/d50/c5c 0 2024-02-15T22:41:12.151 INFO:tasks.workunit.client.1.smithi082.stdout:8/254: truncate d1/f3a 865224 0 2024-02-15T22:41:12.152 INFO:tasks.workunit.client.1.smithi082.stdout:7/212: truncate d12/d17/d3d/f40 586290 0 2024-02-15T22:41:12.169 INFO:tasks.workunit.client.1.smithi082.stdout:7/213: mknod d12/c46 0 2024-02-15T22:41:12.169 INFO:tasks.workunit.client.1.smithi082.stdout:7/214: chown d12/d3b 3522 1 2024-02-15T22:41:12.176 INFO:tasks.workunit.client.1.smithi082.stdout:4/232: dwrite d0/d16/f22 [0,4194304] 0 2024-02-15T22:41:12.176 INFO:tasks.workunit.client.1.smithi082.stdout:4/233: fdatasync d0/d16/f28 0 2024-02-15T22:41:12.176 INFO:tasks.workunit.client.1.smithi082.stdout:4/234: write d0/f2 [2722620,56218] 0 2024-02-15T22:41:12.192 INFO:tasks.workunit.client.1.smithi082.stdout:4/235: truncate d0/d16/f22 3931146 0 2024-02-15T22:41:12.193 INFO:tasks.workunit.client.1.smithi082.stdout:8/255: dwrite d1/f21 [0,4194304] 0 2024-02-15T22:41:12.198 INFO:tasks.workunit.client.1.smithi082.stdout:7/215: dwrite d12/f21 [0,4194304] 0 2024-02-15T22:41:12.203 INFO:tasks.workunit.client.1.smithi082.stdout:7/216: rename f7 to d12/f47 0 2024-02-15T22:41:12.208 INFO:tasks.workunit.client.1.smithi082.stdout:7/217: write d12/f21 [5173505,121217] 0 2024-02-15T22:41:12.208 INFO:tasks.workunit.client.1.smithi082.stdout:7/218: getdents d12/d17/d42 0 2024-02-15T22:41:12.209 INFO:tasks.workunit.client.1.smithi082.stdout:7/219: symlink d12/d17/l48 0 2024-02-15T22:41:12.210 INFO:tasks.workunit.client.1.smithi082.stdout:7/220: mknod d12/d27/d33/c49 0 2024-02-15T22:41:12.210 INFO:tasks.workunit.client.1.smithi082.stdout:7/221: write d12/d17/f1a [428783,57422] 0 2024-02-15T22:41:12.211 INFO:tasks.workunit.client.1.smithi082.stdout:7/222: symlink d12/d3b/d41/l4a 0 2024-02-15T22:41:12.211 INFO:tasks.workunit.client.1.smithi082.stdout:7/223: mknod d12/d17/d3d/c4b 0 2024-02-15T22:41:12.212 INFO:tasks.workunit.client.1.smithi082.stdout:7/224: symlink d12/d17/d3d/l4c 0 2024-02-15T22:41:12.213 INFO:tasks.workunit.client.1.smithi082.stdout:7/225: mkdir d12/d17/d4d 0 2024-02-15T22:41:12.216 INFO:tasks.workunit.client.1.smithi082.stdout:9/259: sync 2024-02-15T22:41:12.216 INFO:tasks.workunit.client.1.smithi082.stdout:9/260: getdents d8/d12 0 2024-02-15T22:41:12.218 INFO:tasks.workunit.client.1.smithi082.stdout:4/236: dwrite d0/d8/d1b/f36 [0,4194304] 0 2024-02-15T22:41:12.220 INFO:tasks.workunit.client.1.smithi082.stdout:4/237: creat d0/d16/f56 x:0 0 0 2024-02-15T22:41:12.220 INFO:tasks.workunit.client.1.smithi082.stdout:4/238: creat d0/d8/d1b/dd/f57 x:0 0 0 2024-02-15T22:41:12.220 INFO:tasks.workunit.client.1.smithi082.stdout:4/239: creat d0/d16/d4a/f58 x:0 0 0 2024-02-15T22:41:12.222 INFO:tasks.workunit.client.1.smithi082.stdout:4/240: truncate d0/d16/f30 1185768 0 2024-02-15T22:41:12.271 INFO:tasks.workunit.client.1.smithi082.stdout:4/241: rename d0/d8/d1b/dd/f2f to d0/d8/d1b/f59 0 2024-02-15T22:41:12.276 INFO:tasks.workunit.client.1.smithi082.stdout:4/242: mknod d0/c5a 0 2024-02-15T22:41:12.288 INFO:tasks.workunit.client.1.smithi082.stdout:4/243: write d0/d8/d1b/f36 [336965,57162] 0 2024-02-15T22:41:12.290 INFO:tasks.workunit.client.1.smithi082.stdout:4/244: rmdir d0/d8/d1b/dd/d37 39 2024-02-15T22:41:12.292 INFO:tasks.workunit.client.1.smithi082.stdout:4/245: rename d0/d16/f21 to d0/d46/f5b 0 2024-02-15T22:41:12.293 INFO:tasks.workunit.client.1.smithi082.stdout:4/246: creat d0/d16/d4a/f5c x:0 0 0 2024-02-15T22:41:12.294 INFO:tasks.workunit.client.1.smithi082.stdout:4/247: mknod d0/d8/d1b/c5d 0 2024-02-15T22:41:12.294 INFO:tasks.workunit.client.1.smithi082.stdout:4/248: dread - d0/d16/f28 zero size 2024-02-15T22:41:12.294 INFO:tasks.workunit.client.1.smithi082.stdout:4/249: chown d0/f23 2230 1 2024-02-15T22:41:12.295 INFO:tasks.workunit.client.1.smithi082.stdout:4/250: write d0/d8/f34 [861624,9983] 0 2024-02-15T22:41:12.295 INFO:tasks.workunit.client.1.smithi082.stdout:4/251: write d0/d8/d1b/dd/ff [1885695,97939] 0 2024-02-15T22:41:12.295 INFO:tasks.workunit.client.1.smithi082.stdout:4/252: chown d0/d16/d4a/f58 5969 1 2024-02-15T22:41:12.315 INFO:tasks.workunit.client.1.smithi082.stdout:4/253: dwrite d0/d8/d32/f4e [0,4194304] 0 2024-02-15T22:41:12.318 INFO:tasks.workunit.client.1.smithi082.stdout:4/254: mknod d0/d8/d1b/dd/c5e 0 2024-02-15T22:41:12.318 INFO:tasks.workunit.client.1.smithi082.stdout:4/255: dread - d0/d8/d1b/dd/f57 zero size 2024-02-15T22:41:12.318 INFO:tasks.workunit.client.1.smithi082.stdout:4/256: stat d0/d16 0 2024-02-15T22:41:12.328 INFO:tasks.workunit.client.1.smithi082.stdout:6/344: sync 2024-02-15T22:41:12.328 INFO:tasks.workunit.client.1.smithi082.stdout:3/209: sync 2024-02-15T22:41:12.328 INFO:tasks.workunit.client.1.smithi082.stdout:0/268: sync 2024-02-15T22:41:12.328 INFO:tasks.workunit.client.1.smithi082.stdout:0/269: write d3/f6 [4542637,72036] 0 2024-02-15T22:41:12.331 INFO:tasks.workunit.client.1.smithi082.stdout:6/345: rename d2/f1a to d2/d18/d23/d67/f71 0 2024-02-15T22:41:12.332 INFO:tasks.workunit.client.1.smithi082.stdout:4/257: read d0/d8/f2e [4114336,1383] 0 2024-02-15T22:41:12.332 INFO:tasks.workunit.client.1.smithi082.stdout:0/270: link d3/d19/d25/d45/l35 d3/d19/l5e 0 2024-02-15T22:41:12.335 INFO:tasks.workunit.client.1.smithi082.stdout:6/346: mkdir d2/d18/d23/d3c/d47/d72 0 2024-02-15T22:41:12.336 INFO:tasks.workunit.client.1.smithi082.stdout:4/258: getdents d0/d8/d32/d39 0 2024-02-15T22:41:12.338 INFO:tasks.workunit.client.1.smithi082.stdout:0/271: unlink d3/d19/c1d 0 2024-02-15T22:41:12.340 INFO:tasks.workunit.client.1.smithi082.stdout:4/259: mknod d0/d8/d1b/c5f 0 2024-02-15T22:41:12.341 INFO:tasks.workunit.client.1.smithi082.stdout:0/272: dread - d3/d19/d1c/f50 zero size 2024-02-15T22:41:12.342 INFO:tasks.workunit.client.1.smithi082.stdout:3/210: read d0/dc/f20 [7587268,15017] 0 2024-02-15T22:41:12.342 INFO:tasks.workunit.client.1.smithi082.stdout:3/211: fsync d0/d19/d14/f28 0 2024-02-15T22:41:12.342 INFO:tasks.workunit.client.1.smithi082.stdout:3/212: creat d0/d19/d14/f40 x:0 0 0 2024-02-15T22:41:12.343 INFO:tasks.workunit.client.1.smithi082.stdout:0/273: mkdir d3/d19/d5f 0 2024-02-15T22:41:12.343 INFO:tasks.workunit.client.1.smithi082.stdout:0/274: write d3/d19/d20/d26/f53 [313848,47548] 0 2024-02-15T22:41:12.343 INFO:tasks.workunit.client.1.smithi082.stdout:6/347: dread d2/d18/d23/d3c/f3d [0,4194304] 0 2024-02-15T22:41:12.350 INFO:tasks.workunit.client.1.smithi082.stdout:3/213: mkdir d0/d19/d14/d21/d41 0 2024-02-15T22:41:12.350 INFO:tasks.workunit.client.1.smithi082.stdout:0/275: creat d3/d19/d5f/f60 x:0 0 0 2024-02-15T22:41:12.350 INFO:tasks.workunit.client.1.smithi082.stdout:0/276: write d3/f6 [3783705,55626] 0 2024-02-15T22:41:12.350 INFO:tasks.workunit.client.1.smithi082.stdout:0/277: write d3/d19/d20/d26/f4e [386598,110215] 0 2024-02-15T22:41:12.351 INFO:tasks.workunit.client.1.smithi082.stdout:6/348: creat d2/d18/d23/d3c/d47/d69/f73 x:0 0 0 2024-02-15T22:41:12.353 INFO:tasks.workunit.client.1.smithi082.stdout:6/349: symlink d2/d18/d23/d3c/d47/d72/l74 0 2024-02-15T22:41:12.353 INFO:tasks.workunit.client.1.smithi082.stdout:6/350: chown d2/d18/d23 1354145 1 2024-02-15T22:41:12.354 INFO:tasks.workunit.client.1.smithi082.stdout:6/351: mkdir d2/d18/d23/d3c/d47/d69/d75 0 2024-02-15T22:41:12.355 INFO:tasks.workunit.client.1.smithi082.stdout:6/352: truncate d2/f1c 4993729 0 2024-02-15T22:41:12.356 INFO:tasks.workunit.client.1.smithi082.stdout:6/353: mkdir d2/d18/d23/d3c/d47/d72/d76 0 2024-02-15T22:41:12.356 INFO:tasks.workunit.client.1.smithi082.stdout:6/354: getdents d2/d30 0 2024-02-15T22:41:12.368 INFO:tasks.workunit.client.1.smithi082.stdout:3/214: write d0/d19/d2e/f38 [1820702,81515] 0 2024-02-15T22:41:12.368 INFO:tasks.workunit.client.1.smithi082.stdout:3/215: chown d0/d19/d14/d21/l3c 490796333 1 2024-02-15T22:41:12.368 INFO:tasks.workunit.client.1.smithi082.stdout:3/216: write d0/d19/d2e/f38 [1445236,65481] 0 2024-02-15T22:41:12.368 INFO:tasks.workunit.client.1.smithi082.stdout:4/260: dwrite d0/d8/d1b/f59 [0,4194304] 0 2024-02-15T22:41:12.368 INFO:tasks.workunit.client.1.smithi082.stdout:6/355: dread d2/d18/d23/d3c/f6f [4194304,4194304] 0 2024-02-15T22:41:12.368 INFO:tasks.workunit.client.1.smithi082.stdout:6/356: creat d2/d18/d23/d3c/d47/d69/f77 x:0 0 0 2024-02-15T22:41:12.369 INFO:tasks.workunit.client.1.smithi082.stdout:6/357: write d2/d30/d3b/f49 [4790461,79139] 0 2024-02-15T22:41:12.369 INFO:tasks.workunit.client.1.smithi082.stdout:3/217: rename d0/d19/d14/l17 to d0/l42 0 2024-02-15T22:41:12.369 INFO:tasks.workunit.client.1.smithi082.stdout:3/218: getdents d0/d16/d3e 0 2024-02-15T22:41:12.369 INFO:tasks.workunit.client.1.smithi082.stdout:3/219: creat d0/f43 x:0 0 0 2024-02-15T22:41:12.369 INFO:tasks.workunit.client.1.smithi082.stdout:4/261: mknod d0/d8/d32/c60 0 2024-02-15T22:41:12.370 INFO:tasks.workunit.client.1.smithi082.stdout:4/262: fdatasync d0/d8/d1b/dd/f4c 0 2024-02-15T22:41:12.370 INFO:tasks.workunit.client.1.smithi082.stdout:0/278: dwrite d3/fa [0,4194304] 0 2024-02-15T22:41:12.370 INFO:tasks.workunit.client.1.smithi082.stdout:0/279: write d3/fd [979011,119185] 0 2024-02-15T22:41:12.370 INFO:tasks.workunit.client.1.smithi082.stdout:0/280: write d3/d19/f2e [215459,97855] 0 2024-02-15T22:41:12.372 INFO:tasks.workunit.client.1.smithi082.stdout:6/358: creat d2/d18/d23/d3c/d47/d72/f78 x:0 0 0 2024-02-15T22:41:12.376 INFO:tasks.workunit.client.1.smithi082.stdout:4/263: symlink d0/d16/l61 0 2024-02-15T22:41:12.377 INFO:tasks.workunit.client.1.smithi082.stdout:0/281: mknod d3/d19/d25/d45/c61 0 2024-02-15T22:41:12.378 INFO:tasks.workunit.client.1.smithi082.stdout:4/264: dread d0/d8/d1b/dd/f41 [0,4194304] 0 2024-02-15T22:41:12.379 INFO:tasks.workunit.client.1.smithi082.stdout:0/282: unlink d3/f13 0 2024-02-15T22:41:12.380 INFO:tasks.workunit.client.1.smithi082.stdout:4/265: mknod d0/d8/d1b/c62 0 2024-02-15T22:41:12.381 INFO:tasks.workunit.client.1.smithi082.stdout:0/283: creat d3/d19/d20/d26/f62 x:0 0 0 2024-02-15T22:41:12.381 INFO:tasks.workunit.client.1.smithi082.stdout:0/284: creat d3/d19/d5f/f63 x:0 0 0 2024-02-15T22:41:12.381 INFO:tasks.workunit.client.1.smithi082.stdout:4/266: creat d0/d16/d4a/f63 x:0 0 0 2024-02-15T22:41:12.383 INFO:tasks.workunit.client.1.smithi082.stdout:0/285: mkdir d3/d64 0 2024-02-15T22:41:12.384 INFO:tasks.workunit.client.1.smithi082.stdout:4/267: dread d0/d8/d1b/f35 [0,4194304] 0 2024-02-15T22:41:12.387 INFO:tasks.workunit.client.1.smithi082.stdout:6/359: dread d2/d18/f19 [0,4194304] 0 2024-02-15T22:41:12.387 INFO:tasks.workunit.client.1.smithi082.stdout:6/360: write d2/d18/d23/d3c/d47/d69/f73 [363582,12980] 0 2024-02-15T22:41:12.388 INFO:tasks.workunit.client.1.smithi082.stdout:3/220: dwrite d0/d16/f1f [0,4194304] 0 2024-02-15T22:41:12.388 INFO:tasks.workunit.client.1.smithi082.stdout:3/221: write d0/d19/f7 [4932784,124731] 0 2024-02-15T22:41:12.397 INFO:tasks.workunit.client.1.smithi082.stdout:4/268: write d0/d16/f2b [1751892,118636] 0 2024-02-15T22:41:12.397 INFO:tasks.workunit.client.1.smithi082.stdout:4/269: chown d0/d8/f3d 30278 1 2024-02-15T22:41:12.400 INFO:tasks.workunit.client.1.smithi082.stdout:6/361: write d2/d18/d23/f35 [3319009,34044] 0 2024-02-15T22:41:12.406 INFO:tasks.workunit.client.1.smithi082.stdout:3/222: symlink d0/dc/l44 0 2024-02-15T22:41:12.408 INFO:tasks.workunit.client.1.smithi082.stdout:4/270: mknod d0/d46/c64 0 2024-02-15T22:41:12.408 INFO:tasks.workunit.client.1.smithi082.stdout:4/271: dread - d0/d8/d1b/dd/f4c zero size 2024-02-15T22:41:12.408 INFO:tasks.workunit.client.1.smithi082.stdout:4/272: write d0/d8/f3d [4824151,62272] 0 2024-02-15T22:41:12.411 INFO:tasks.workunit.client.1.smithi082.stdout:6/362: rename d2/d18/d23/l24 to d2/d30/l79 0 2024-02-15T22:41:12.411 INFO:tasks.workunit.client.1.smithi082.stdout:3/223: stat d0/l8 0 2024-02-15T22:41:12.415 INFO:tasks.workunit.client.1.smithi082.stdout:6/363: mknod d2/d45/c7a 0 2024-02-15T22:41:12.418 INFO:tasks.workunit.client.1.smithi082.stdout:3/224: getdents d0/d19/d2e 0 2024-02-15T22:41:12.418 INFO:tasks.workunit.client.1.smithi082.stdout:3/225: stat d0/d19/d2e/f38 0 2024-02-15T22:41:12.418 INFO:tasks.workunit.client.1.smithi082.stdout:3/226: write d0/d19/d14/d21/f3d [235646,4895] 0 2024-02-15T22:41:12.418 INFO:tasks.workunit.client.1.smithi082.stdout:3/227: fdatasync d0/d16/f1f 0 2024-02-15T22:41:12.418 INFO:tasks.workunit.client.1.smithi082.stdout:3/228: creat d0/d19/f45 x:0 0 0 2024-02-15T22:41:12.418 INFO:tasks.workunit.client.1.smithi082.stdout:3/229: creat d0/f46 x:0 0 0 2024-02-15T22:41:12.420 INFO:tasks.workunit.client.1.smithi082.stdout:0/286: getdents d3/d19/d20/d26 0 2024-02-15T22:41:12.427 INFO:tasks.workunit.client.1.smithi082.stdout:0/287: rename d3/d19/d25/f48 to d3/d19/d1c/f65 0 2024-02-15T22:41:12.427 INFO:tasks.workunit.client.1.smithi082.stdout:6/364: write d2/d30/d3b/f49 [211932,51816] 0 2024-02-15T22:41:12.429 INFO:tasks.workunit.client.1.smithi082.stdout:6/365: rename d2/f4f to d2/d18/d23/d3c/d47/f7b 0 2024-02-15T22:41:12.429 INFO:tasks.workunit.client.1.smithi082.stdout:6/366: creat d2/d18/f7c x:0 0 0 2024-02-15T22:41:12.429 INFO:tasks.workunit.client.1.smithi082.stdout:6/367: fdatasync d2/f6e 0 2024-02-15T22:41:12.429 INFO:tasks.workunit.client.1.smithi082.stdout:6/368: fdatasync d2/d18/d23/d3c/d47/f7b 0 2024-02-15T22:41:12.430 INFO:tasks.workunit.client.1.smithi082.stdout:6/369: creat d2/d18/d39/f7d x:0 0 0 2024-02-15T22:41:12.435 INFO:tasks.workunit.client.1.smithi082.stdout:8/256: sync 2024-02-15T22:41:12.435 INFO:tasks.workunit.client.1.smithi082.stdout:1/254: sync 2024-02-15T22:41:12.435 INFO:tasks.workunit.client.1.smithi082.stdout:1/255: truncate d1/da/d14/f2d 5377052 0 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:1/256: truncate d1/f4 2918734 0 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:1/257: stat d1/da/l45 0 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:9/261: sync 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:5/300: sync 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:7/226: sync 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:7/227: truncate d12/f47 3767917 0 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:2/332: sync 2024-02-15T22:41:12.436 INFO:tasks.workunit.client.1.smithi082.stdout:3/230: dwrite d0/f2 [8388608,4194304] 0 2024-02-15T22:41:12.437 INFO:tasks.workunit.client.1.smithi082.stdout:4/273: dwrite d0/d16/d4a/f51 [0,4194304] 0 2024-02-15T22:41:12.439 INFO:tasks.workunit.client.1.smithi082.stdout:9/262: mknod d8/d24/d2e/c43 0 2024-02-15T22:41:12.440 INFO:tasks.workunit.client.1.smithi082.stdout:5/301: symlink d5/da/dc/d43/l62 0 2024-02-15T22:41:12.440 INFO:tasks.workunit.client.1.smithi082.stdout:7/228: truncate f10 430501 0 2024-02-15T22:41:12.443 INFO:tasks.workunit.client.1.smithi082.stdout:3/231: unlink d0/d19/d14/l22 0 2024-02-15T22:41:12.446 INFO:tasks.workunit.client.1.smithi082.stdout:1/258: getdents d1/da/d14/d18/d1f/d2f 0 2024-02-15T22:41:12.446 INFO:tasks.workunit.client.1.smithi082.stdout:9/263: creat d8/f44 x:0 0 0 2024-02-15T22:41:12.446 INFO:tasks.workunit.client.1.smithi082.stdout:9/264: chown d8/f11 5327780 1 2024-02-15T22:41:12.446 INFO:tasks.workunit.client.1.smithi082.stdout:9/265: write d8/f44 [875736,87949] 0 2024-02-15T22:41:12.447 INFO:tasks.workunit.client.1.smithi082.stdout:5/302: truncate d5/da/f26 316321 0 2024-02-15T22:41:12.447 INFO:tasks.workunit.client.1.smithi082.stdout:5/303: truncate d5/da/d22/f35 1538031 0 2024-02-15T22:41:12.447 INFO:tasks.workunit.client.1.smithi082.stdout:5/304: write d5/da/f25 [935750,34155] 0 2024-02-15T22:41:12.447 INFO:tasks.workunit.client.1.smithi082.stdout:1/259: dread - d1/da/d14/d18/f2b zero size 2024-02-15T22:41:12.447 INFO:tasks.workunit.client.1.smithi082.stdout:1/260: write d1/f4 [1802921,35302] 0 2024-02-15T22:41:12.448 INFO:tasks.workunit.client.1.smithi082.stdout:4/274: dread d0/f31 [0,4194304] 0 2024-02-15T22:41:12.448 INFO:tasks.workunit.client.1.smithi082.stdout:4/275: dread - d0/d16/d4a/f58 zero size 2024-02-15T22:41:12.448 INFO:tasks.workunit.client.1.smithi082.stdout:4/276: creat d0/d8/f65 x:0 0 0 2024-02-15T22:41:12.448 INFO:tasks.workunit.client.1.smithi082.stdout:9/266: symlink d8/d12/d30/l45 0 2024-02-15T22:41:12.448 INFO:tasks.workunit.client.1.smithi082.stdout:9/267: creat d8/d24/d2e/f46 x:0 0 0 2024-02-15T22:41:12.448 INFO:tasks.workunit.client.1.smithi082.stdout:9/268: creat d8/d24/d2e/f47 x:0 0 0 2024-02-15T22:41:12.449 INFO:tasks.workunit.client.1.smithi082.stdout:5/305: getdents d5/da 0 2024-02-15T22:41:12.451 INFO:tasks.workunit.client.1.smithi082.stdout:4/277: link d0/d8/d1b/dd/d37/c45 d0/d8/c66 0 2024-02-15T22:41:12.453 INFO:tasks.workunit.client.1.smithi082.stdout:8/257: dread d1/f5 [0,4194304] 0 2024-02-15T22:41:12.454 INFO:tasks.workunit.client.1.smithi082.stdout:0/288: dread d3/fd [0,4194304] 0 2024-02-15T22:41:12.455 INFO:tasks.workunit.client.1.smithi082.stdout:4/278: dread d0/d8/d1b/dd/f41 [0,4194304] 0 2024-02-15T22:41:12.455 INFO:tasks.workunit.client.1.smithi082.stdout:9/269: creat d8/d12/d33/d3e/f48 x:0 0 0 2024-02-15T22:41:12.455 INFO:tasks.workunit.client.1.smithi082.stdout:4/279: read d0/d8/d1b/dd/ff [241048,11906] 0 2024-02-15T22:41:12.457 INFO:tasks.workunit.client.1.smithi082.stdout:5/306: rename d5/c3a to d5/da/dc/c63 0 2024-02-15T22:41:12.458 INFO:tasks.workunit.client.1.smithi082.stdout:8/258: creat d1/d7/d48/f5d x:0 0 0 2024-02-15T22:41:12.459 INFO:tasks.workunit.client.1.smithi082.stdout:1/261: write d1/da/d14/d18/d1f/d2f/f3b [2176096,118579] 0 2024-02-15T22:41:12.461 INFO:tasks.workunit.client.1.smithi082.stdout:5/307: creat d5/da/d22/d59/f64 x:0 0 0 2024-02-15T22:41:12.461 INFO:tasks.workunit.client.1.smithi082.stdout:9/270: creat d8/d24/f49 x:0 0 0 2024-02-15T22:41:12.462 INFO:tasks.workunit.client.1.smithi082.stdout:9/271: read d8/f9 [3437431,82808] 0 2024-02-15T22:41:12.465 INFO:tasks.workunit.client.1.smithi082.stdout:5/308: creat d5/da/f65 x:0 0 0 2024-02-15T22:41:12.467 INFO:tasks.workunit.client.1.smithi082.stdout:0/289: dread d3/d19/d25/d45/f1a [0,4194304] 0 2024-02-15T22:41:12.468 INFO:tasks.workunit.client.1.smithi082.stdout:0/290: chown d3/d19/d5f 540 1 2024-02-15T22:41:12.468 INFO:tasks.workunit.client.1.smithi082.stdout:6/370: dwrite d2/d18/d23/d3c/f6f [4194304,4194304] 0 2024-02-15T22:41:12.468 INFO:tasks.workunit.client.1.smithi082.stdout:6/371: chown d2/d18/d39/c4d 563424 1 2024-02-15T22:41:12.470 INFO:tasks.workunit.client.1.smithi082.stdout:0/291: rename d3/d19/d20/d26/l4f to d3/d19/d20/d26/l66 0 2024-02-15T22:41:12.470 INFO:tasks.workunit.client.1.smithi082.stdout:0/292: read d3/d19/d25/d45/f2a [2682266,23061] 0 2024-02-15T22:41:12.470 INFO:tasks.workunit.client.1.smithi082.stdout:0/293: fsync d3/d19/d20/d26/f31 0 2024-02-15T22:41:12.473 INFO:tasks.workunit.client.1.smithi082.stdout:8/259: dread d1/d7/de/ff [0,4194304] 0 2024-02-15T22:41:12.473 INFO:tasks.workunit.client.1.smithi082.stdout:8/260: chown d1/d7/de/d1e/c29 301175 1 2024-02-15T22:41:12.474 INFO:tasks.workunit.client.1.smithi082.stdout:6/372: creat d2/d18/d23/d3c/d47/f7e x:0 0 0 2024-02-15T22:41:12.477 INFO:tasks.workunit.client.1.smithi082.stdout:0/294: truncate d3/fd 23231 0 2024-02-15T22:41:12.479 INFO:tasks.workunit.client.1.smithi082.stdout:8/261: mknod d1/d7/c5e 0 2024-02-15T22:41:12.479 INFO:tasks.workunit.client.1.smithi082.stdout:2/333: dwrite d6/dc/d58/f19 [0,4194304] 0 2024-02-15T22:41:12.480 INFO:tasks.workunit.client.1.smithi082.stdout:0/295: mknod d3/d19/d20/c67 0 2024-02-15T22:41:12.480 INFO:tasks.workunit.client.1.smithi082.stdout:0/296: write d3/d19/f44 [826492,41449] 0 2024-02-15T22:41:12.480 INFO:tasks.workunit.client.1.smithi082.stdout:5/309: dread d5/f3b [0,4194304] 0 2024-02-15T22:41:12.481 INFO:tasks.workunit.client.1.smithi082.stdout:5/310: write d5/da/d14/d53/f5f [819652,32616] 0 2024-02-15T22:41:12.482 INFO:tasks.workunit.client.1.smithi082.stdout:5/311: mknod d5/da/d14/c66 0 2024-02-15T22:41:12.482 INFO:tasks.workunit.client.1.smithi082.stdout:5/312: chown d5/da/dc/l16 9 1 2024-02-15T22:41:12.483 INFO:tasks.workunit.client.1.smithi082.stdout:5/313: read d5/da/f40 [432239,59216] 0 2024-02-15T22:41:12.484 INFO:tasks.workunit.client.1.smithi082.stdout:2/334: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:12.484 INFO:tasks.workunit.client.1.smithi082.stdout:2/335: readlink d6/dc/dd/d1d/l2d 0 2024-02-15T22:41:12.485 INFO:tasks.workunit.client.1.smithi082.stdout:2/336: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:12.485 INFO:tasks.workunit.client.1.smithi082.stdout:0/297: rename d3/d19/d1c/f27 to d3/d64/f68 0 2024-02-15T22:41:12.486 INFO:tasks.workunit.client.1.smithi082.stdout:2/337: mkdir d6/dc/dd/d24/d71 0 2024-02-15T22:41:12.487 INFO:tasks.workunit.client.1.smithi082.stdout:2/338: mkdir d6/dc/dd/d24/d72 0 2024-02-15T22:41:12.488 INFO:tasks.workunit.client.1.smithi082.stdout:2/339: truncate d6/dc/d12/d46/d4b/f4d 2115258 0 2024-02-15T22:41:12.490 INFO:tasks.workunit.client.1.smithi082.stdout:2/340: creat d6/dc/d58/d49/d5e/f73 x:0 0 0 2024-02-15T22:41:12.490 INFO:tasks.workunit.client.1.smithi082.stdout:2/341: readlink d6/dc/dd/d24/l55 0 2024-02-15T22:41:12.490 INFO:tasks.workunit.client.1.smithi082.stdout:2/342: fdatasync d6/dc/dd/d21/f36 0 2024-02-15T22:41:12.491 INFO:tasks.workunit.client.1.smithi082.stdout:2/343: chown d6/dc/d12/d46/d4b/l4f 738 1 2024-02-15T22:41:12.491 INFO:tasks.workunit.client.1.smithi082.stdout:2/344: truncate d6/dc/d12/d46/d4b/f69 156317 0 2024-02-15T22:41:12.492 INFO:tasks.workunit.client.1.smithi082.stdout:2/345: creat d6/dc/d12/f74 x:0 0 0 2024-02-15T22:41:12.494 INFO:tasks.workunit.client.1.smithi082.stdout:2/346: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:12.494 INFO:tasks.workunit.client.1.smithi082.stdout:2/347: creat d6/d18/f75 x:0 0 0 2024-02-15T22:41:12.495 INFO:tasks.workunit.client.1.smithi082.stdout:8/262: write d1/d7/d9/d42/f49 [3590620,4441] 0 2024-02-15T22:41:12.495 INFO:tasks.workunit.client.1.smithi082.stdout:8/263: chown d1/d7/de/f58 40 1 2024-02-15T22:41:12.496 INFO:tasks.workunit.client.1.smithi082.stdout:2/348: mkdir d6/dc/d12/d46/d76 0 2024-02-15T22:41:12.496 INFO:tasks.workunit.client.1.smithi082.stdout:2/349: chown d6/d3c 50 1 2024-02-15T22:41:12.502 INFO:tasks.workunit.client.1.smithi082.stdout:3/232: dwrite d0/f1c [0,4194304] 0 2024-02-15T22:41:12.502 INFO:tasks.workunit.client.1.smithi082.stdout:0/298: dread d3/d19/f21 [0,4194304] 0 2024-02-15T22:41:12.502 INFO:tasks.workunit.client.1.smithi082.stdout:0/299: chown d3/d19/d25/d45/f39 512864 1 2024-02-15T22:41:12.503 INFO:tasks.workunit.client.1.smithi082.stdout:4/280: dwrite d0/d8/d32/d39/f3f [0,4194304] 0 2024-02-15T22:41:12.503 INFO:tasks.workunit.client.1.smithi082.stdout:2/350: dread d6/d18/f47 [0,4194304] 0 2024-02-15T22:41:12.503 INFO:tasks.workunit.client.1.smithi082.stdout:2/351: write d6/dc/dd/d24/f30 [104585,130548] 0 2024-02-15T22:41:12.503 INFO:tasks.workunit.client.1.smithi082.stdout:0/300: mknod d3/d19/d20/d26/c69 0 2024-02-15T22:41:12.505 INFO:tasks.workunit.client.1.smithi082.stdout:0/301: link d3/f34 d3/d19/d20/d26/f6a 0 2024-02-15T22:41:12.506 INFO:tasks.workunit.client.1.smithi082.stdout:1/262: dwrite d1/da/ff [4194304,4194304] 0 2024-02-15T22:41:12.509 INFO:tasks.workunit.client.1.smithi082.stdout:9/272: dwrite d8/f18 [0,4194304] 0 2024-02-15T22:41:12.509 INFO:tasks.workunit.client.1.smithi082.stdout:6/373: dwrite d2/d18/d23/f35 [0,4194304] 0 2024-02-15T22:41:12.509 INFO:tasks.workunit.client.1.smithi082.stdout:6/374: write d2/d30/d3b/f49 [973964,29503] 0 2024-02-15T22:41:12.509 INFO:tasks.workunit.client.1.smithi082.stdout:6/375: truncate d2/d18/d23/d3c/d47/f54 976945 0 2024-02-15T22:41:12.510 INFO:tasks.workunit.client.1.smithi082.stdout:5/314: dwrite d5/da/d22/f35 [0,4194304] 0 2024-02-15T22:41:12.510 INFO:tasks.workunit.client.1.smithi082.stdout:1/263: creat d1/da/d14/d18/d1f/d2f/f52 x:0 0 0 2024-02-15T22:41:12.512 INFO:tasks.workunit.client.1.smithi082.stdout:3/233: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:12.512 INFO:tasks.workunit.client.1.smithi082.stdout:3/234: write d0/d19/f45 [163162,71055] 0 2024-02-15T22:41:12.512 INFO:tasks.workunit.client.1.smithi082.stdout:3/235: write d0/d19/d14/f2a [408164,98031] 0 2024-02-15T22:41:12.515 INFO:tasks.workunit.client.1.smithi082.stdout:2/352: write d6/d3c/f6d [963858,128673] 0 2024-02-15T22:41:12.515 INFO:tasks.workunit.client.1.smithi082.stdout:2/353: fdatasync d6/dc/d12/d23/f2f 0 2024-02-15T22:41:12.515 INFO:tasks.workunit.client.1.smithi082.stdout:2/354: write d6/dc/d12/d46/d4b/f69 [725744,9997] 0 2024-02-15T22:41:12.516 INFO:tasks.workunit.client.1.smithi082.stdout:6/376: creat d2/d18/d23/d3c/d65/f7f x:0 0 0 2024-02-15T22:41:12.521 INFO:tasks.workunit.client.1.smithi082.stdout:5/315: getdents d5/da/d14/d53 0 2024-02-15T22:41:12.524 INFO:tasks.workunit.client.1.smithi082.stdout:1/264: creat d1/da/d11/d3f/f53 x:0 0 0 2024-02-15T22:41:12.525 INFO:tasks.workunit.client.1.smithi082.stdout:3/236: symlink d0/dc/d3f/l47 0 2024-02-15T22:41:12.527 INFO:tasks.workunit.client.1.smithi082.stdout:6/377: mkdir d2/d18/d23/d3c/d47/d72/d80 0 2024-02-15T22:41:12.527 INFO:tasks.workunit.client.1.smithi082.stdout:6/378: dread - d2/d45/f56 zero size 2024-02-15T22:41:12.528 INFO:tasks.workunit.client.1.smithi082.stdout:4/281: dwrite d0/d8/d1b/f1d [0,4194304] 0 2024-02-15T22:41:12.529 INFO:tasks.workunit.client.1.smithi082.stdout:9/273: dwrite d8/d24/d2e/f47 [0,4194304] 0 2024-02-15T22:41:12.529 INFO:tasks.workunit.client.1.smithi082.stdout:9/274: read d8/d24/d2e/f38 [3276088,47180] 0 2024-02-15T22:41:12.542 INFO:tasks.workunit.client.1.smithi082.stdout:4/282: dread d0/d16/f22 [0,4194304] 0 2024-02-15T22:41:12.542 INFO:tasks.workunit.client.1.smithi082.stdout:4/283: dread - d0/f54 zero size 2024-02-15T22:41:12.543 INFO:tasks.workunit.client.1.smithi082.stdout:1/265: mknod d1/da/d11/c54 0 2024-02-15T22:41:12.545 INFO:tasks.workunit.client.1.smithi082.stdout:3/237: mkdir d0/d19/d48 0 2024-02-15T22:41:12.550 INFO:tasks.workunit.client.1.smithi082.stdout:6/379: dwrite d2/f5c [0,4194304] 0 2024-02-15T22:41:12.550 INFO:tasks.workunit.client.1.smithi082.stdout:6/380: creat d2/d18/f81 x:0 0 0 2024-02-15T22:41:12.550 INFO:tasks.workunit.client.1.smithi082.stdout:4/284: mknod d0/d8/d1b/c67 0 2024-02-15T22:41:12.551 INFO:tasks.workunit.client.1.smithi082.stdout:1/266: stat d1/da/d11/d3f/c4b 0 2024-02-15T22:41:12.551 INFO:tasks.workunit.client.1.smithi082.stdout:1/267: creat d1/da/d14/d18/d1f/d2f/f55 x:0 0 0 2024-02-15T22:41:12.551 INFO:tasks.workunit.client.1.smithi082.stdout:1/268: dread - d1/da/d14/d18/d1f/d2f/f52 zero size 2024-02-15T22:41:12.554 INFO:tasks.workunit.client.1.smithi082.stdout:9/275: dwrite d8/f44 [0,4194304] 0 2024-02-15T22:41:12.555 INFO:tasks.workunit.client.1.smithi082.stdout:9/276: dread d8/d12/f29 [0,4194304] 0 2024-02-15T22:41:12.555 INFO:tasks.workunit.client.1.smithi082.stdout:9/277: chown d8/f1f 34123289 1 2024-02-15T22:41:12.556 INFO:tasks.workunit.client.1.smithi082.stdout:6/381: truncate d2/d18/d23/d3c/d47/f7b 1888861 0 2024-02-15T22:41:12.556 INFO:tasks.workunit.client.1.smithi082.stdout:6/382: getdents d2/d18/d23/d3c/d47/d69/d75 0 2024-02-15T22:41:12.558 INFO:tasks.workunit.client.1.smithi082.stdout:4/285: dread d0/d8/d1b/f1d [0,4194304] 0 2024-02-15T22:41:12.558 INFO:tasks.workunit.client.1.smithi082.stdout:4/286: stat d0/f23 0 2024-02-15T22:41:12.559 INFO:tasks.workunit.client.1.smithi082.stdout:1/269: mknod d1/da/d14/d18/d51/c56 0 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:6/383: dread d2/d18/d23/d3c/d47/d69/f73 [0,4194304] 0 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:6/384: truncate d2/d30/d3b/f6b 290331 0 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:6/385: write d2/d18/d23/d3c/d47/d72/f78 [230454,57992] 0 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:6/386: chown d2/d18/d23/l68 1 1 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:6/387: chown d2/d18/d23/d3c/d47/f54 0 1 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:6/388: readlink d2/l17 0 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:9/278: mknod d8/c4a 0 2024-02-15T22:41:12.561 INFO:tasks.workunit.client.1.smithi082.stdout:9/279: creat d8/d24/f4b x:0 0 0 2024-02-15T22:41:12.562 INFO:tasks.workunit.client.1.smithi082.stdout:6/389: write d2/d18/d23/d3c/d47/d69/f73 [14097,80534] 0 2024-02-15T22:41:12.562 INFO:tasks.workunit.client.1.smithi082.stdout:6/390: dread - d2/d18/d23/d3c/d47/d69/f77 zero size 2024-02-15T22:41:12.562 INFO:tasks.workunit.client.1.smithi082.stdout:4/287: symlink d0/d8/d1b/dd/l68 0 2024-02-15T22:41:12.562 INFO:tasks.workunit.client.1.smithi082.stdout:4/288: chown d0/d8/d1b/dd/f4c 1197949 1 2024-02-15T22:41:12.562 INFO:tasks.workunit.client.1.smithi082.stdout:4/289: write d0/d8/f34 [1529236,25852] 0 2024-02-15T22:41:12.563 INFO:tasks.workunit.client.1.smithi082.stdout:3/238: dwrite d0/d19/d14/d21/f3d [0,4194304] 0 2024-02-15T22:41:12.563 INFO:tasks.workunit.client.1.smithi082.stdout:3/239: write d0/d19/fb [4046382,102203] 0 2024-02-15T22:41:12.563 INFO:tasks.workunit.client.1.smithi082.stdout:1/270: mkdir d1/d57 0 2024-02-15T22:41:12.563 INFO:tasks.workunit.client.1.smithi082.stdout:1/271: creat d1/da/d14/d18/d1f/f58 x:0 0 0 2024-02-15T22:41:12.565 INFO:tasks.workunit.client.1.smithi082.stdout:9/280: symlink d8/l4c 0 2024-02-15T22:41:12.572 INFO:tasks.workunit.client.1.smithi082.stdout:6/391: write d2/f1e [1061451,33948] 0 2024-02-15T22:41:12.572 INFO:tasks.workunit.client.1.smithi082.stdout:6/392: chown d2/d18/d23/c40 31 1 2024-02-15T22:41:12.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/281: truncate d8/f19 4350658 0 2024-02-15T22:41:12.572 INFO:tasks.workunit.client.1.smithi082.stdout:9/282: dread - d8/d12/d30/f3d zero size 2024-02-15T22:41:12.573 INFO:tasks.workunit.client.1.smithi082.stdout:3/240: dread d0/d19/d14/d21/f3d [0,4194304] 0 2024-02-15T22:41:12.573 INFO:tasks.workunit.client.1.smithi082.stdout:4/290: mknod d0/d16/c69 0 2024-02-15T22:41:12.574 INFO:tasks.workunit.client.1.smithi082.stdout:3/241: dread d0/dc/f26 [0,4194304] 0 2024-02-15T22:41:12.574 INFO:tasks.workunit.client.1.smithi082.stdout:3/242: chown d0/d19/d14/f40 1016965463 1 2024-02-15T22:41:12.576 INFO:tasks.workunit.client.1.smithi082.stdout:4/291: dread d0/d16/f3a [0,4194304] 0 2024-02-15T22:41:12.576 INFO:tasks.workunit.client.1.smithi082.stdout:4/292: write d0/d16/f3a [2001073,36601] 0 2024-02-15T22:41:12.576 INFO:tasks.workunit.client.1.smithi082.stdout:6/393: symlink d2/d18/d39/l82 0 2024-02-15T22:41:12.576 INFO:tasks.workunit.client.1.smithi082.stdout:6/394: dread - d2/d18/f7c zero size 2024-02-15T22:41:12.576 INFO:tasks.workunit.client.1.smithi082.stdout:6/395: write d2/f1c [2317726,88092] 0 2024-02-15T22:41:12.576 INFO:tasks.workunit.client.1.smithi082.stdout:6/396: readlink d2/d18/d39/l46 0 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:3/243: link d0/d19/f25 d0/dc/d3f/f49 0 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:3/244: chown d0/d16/l2f 147 1 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:3/245: creat d0/d16/f4a x:0 0 0 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:3/246: stat d0/d19/f7 0 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:4/293: readlink d0/d16/d4a/l50 0 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:4/294: fsync d0/d8/d1b/dd/f57 0 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:4/295: chown d0/d16/f30 11980 1 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:4/296: chown d0/d47/c55 44426 1 2024-02-15T22:41:12.578 INFO:tasks.workunit.client.1.smithi082.stdout:4/297: stat d0/d16/f56 0 2024-02-15T22:41:12.579 INFO:tasks.workunit.client.1.smithi082.stdout:3/247: symlink d0/d19/d14/l4b 0 2024-02-15T22:41:12.583 INFO:tasks.workunit.client.1.smithi082.stdout:3/248: rmdir d0/d19/d48 0 2024-02-15T22:41:12.583 INFO:tasks.workunit.client.1.smithi082.stdout:6/397: dread d2/d18/d23/d3c/f3d [0,4194304] 0 2024-02-15T22:41:12.586 INFO:tasks.workunit.client.1.smithi082.stdout:3/249: mkdir d0/d19/d2e/d4c 0 2024-02-15T22:41:12.587 INFO:tasks.workunit.client.1.smithi082.stdout:3/250: symlink d0/dc/d3f/l4d 0 2024-02-15T22:41:12.590 INFO:tasks.workunit.client.1.smithi082.stdout:3/251: dread d0/d19/f36 [0,4194304] 0 2024-02-15T22:41:12.590 INFO:tasks.workunit.client.1.smithi082.stdout:1/272: truncate d1/da/d14/f2d 4260483 0 2024-02-15T22:41:12.590 INFO:tasks.workunit.client.1.smithi082.stdout:3/252: fdatasync d0/d16/f1f 0 2024-02-15T22:41:12.590 INFO:tasks.workunit.client.1.smithi082.stdout:1/273: dread - d1/da/d11/f48 zero size 2024-02-15T22:41:12.591 INFO:tasks.workunit.client.1.smithi082.stdout:9/283: dwrite d8/d24/d2e/f34 [0,4194304] 0 2024-02-15T22:41:12.596 INFO:tasks.workunit.client.1.smithi082.stdout:9/284: rmdir d8/d12/d33/d3e 39 2024-02-15T22:41:12.599 INFO:tasks.workunit.client.1.smithi082.stdout:9/285: creat d8/d12/f4d x:0 0 0 2024-02-15T22:41:12.602 INFO:tasks.workunit.client.1.smithi082.stdout:4/298: rmdir d0/d8/d1b/dd 39 2024-02-15T22:41:12.605 INFO:tasks.workunit.client.1.smithi082.stdout:4/299: mkdir d0/d16/d4a/d6a 0 2024-02-15T22:41:12.607 INFO:tasks.workunit.client.1.smithi082.stdout:4/300: mknod d0/d16/c6b 0 2024-02-15T22:41:12.607 INFO:tasks.workunit.client.1.smithi082.stdout:4/301: stat d0/d8/d1b/f3b 0 2024-02-15T22:41:12.607 INFO:tasks.workunit.client.1.smithi082.stdout:4/302: read - d0/d8/d1b/dd/f4c zero size 2024-02-15T22:41:12.607 INFO:tasks.workunit.client.1.smithi082.stdout:4/303: stat d0 0 2024-02-15T22:41:12.608 INFO:tasks.workunit.client.1.smithi082.stdout:4/304: truncate d0/f23 152155 0 2024-02-15T22:41:12.609 INFO:tasks.workunit.client.1.smithi082.stdout:9/286: dread d8/f22 [0,4194304] 0 2024-02-15T22:41:12.610 INFO:tasks.workunit.client.1.smithi082.stdout:4/305: rename d0/d8/d1b/dd/d37/c45 to d0/c6c 0 2024-02-15T22:41:12.611 INFO:tasks.workunit.client.1.smithi082.stdout:9/287: creat d8/d12/d30/d3c/f4e x:0 0 0 2024-02-15T22:41:12.611 INFO:tasks.workunit.client.1.smithi082.stdout:9/288: readlink d8/l4c 0 2024-02-15T22:41:12.612 INFO:tasks.workunit.client.1.smithi082.stdout:4/306: symlink d0/d8/d32/d39/l6d 0 2024-02-15T22:41:12.614 INFO:tasks.workunit.client.1.smithi082.stdout:4/307: rename d0/d47/d4d/c53 to d0/d8/d32/d39/c6e 0 2024-02-15T22:41:12.614 INFO:tasks.workunit.client.1.smithi082.stdout:4/308: fdatasync d0/d16/d4a/f63 0 2024-02-15T22:41:12.614 INFO:tasks.workunit.client.1.smithi082.stdout:4/309: chown d0/d8/d1b/dd 489 1 2024-02-15T22:41:12.614 INFO:tasks.workunit.client.1.smithi082.stdout:4/310: symlink d0/d8/d32/d39/l6f 0 2024-02-15T22:41:12.615 INFO:tasks.workunit.client.1.smithi082.stdout:4/311: mkdir d0/d8/d1b/d70 0 2024-02-15T22:41:12.616 INFO:tasks.workunit.client.1.smithi082.stdout:4/312: mknod d0/d16/d4a/d6a/c71 0 2024-02-15T22:41:12.619 INFO:tasks.workunit.client.1.smithi082.stdout:6/398: dwrite d2/f1c [0,4194304] 0 2024-02-15T22:41:12.620 INFO:tasks.workunit.client.1.smithi082.stdout:3/253: dwrite d0/dc/f26 [0,4194304] 0 2024-02-15T22:41:12.620 INFO:tasks.workunit.client.1.smithi082.stdout:3/254: creat d0/f4e x:0 0 0 2024-02-15T22:41:12.621 INFO:tasks.workunit.client.1.smithi082.stdout:1/274: dwrite d1/da/d11/f48 [0,4194304] 0 2024-02-15T22:41:12.622 INFO:tasks.workunit.client.1.smithi082.stdout:6/399: truncate d2/f52 3283558 0 2024-02-15T22:41:12.623 INFO:tasks.workunit.client.1.smithi082.stdout:9/289: write d8/d24/d2e/f47 [2472452,104167] 0 2024-02-15T22:41:12.623 INFO:tasks.workunit.client.1.smithi082.stdout:9/290: truncate d8/d12/d33/f3b 805678 0 2024-02-15T22:41:12.623 INFO:tasks.workunit.client.1.smithi082.stdout:9/291: chown d8/d24 437932 1 2024-02-15T22:41:12.628 INFO:tasks.workunit.client.1.smithi082.stdout:3/255: symlink d0/dc/d3f/l4f 0 2024-02-15T22:41:12.628 INFO:tasks.workunit.client.1.smithi082.stdout:3/256: write d0/f43 [991603,95477] 0 2024-02-15T22:41:12.633 INFO:tasks.workunit.client.1.smithi082.stdout:6/400: rename d2/f1c to d2/d18/d23/d67/f83 0 2024-02-15T22:41:12.633 INFO:tasks.workunit.client.1.smithi082.stdout:6/401: chown d2/d45 253971242 1 2024-02-15T22:41:12.633 INFO:tasks.workunit.client.1.smithi082.stdout:6/402: dread - d2/d45/f56 zero size 2024-02-15T22:41:12.633 INFO:tasks.workunit.client.1.smithi082.stdout:6/403: chown d2/d30/d3b/f49 1996 1 2024-02-15T22:41:12.636 INFO:tasks.workunit.client.1.smithi082.stdout:9/292: write d8/f18 [2159739,63529] 0 2024-02-15T22:41:12.636 INFO:tasks.workunit.client.1.smithi082.stdout:9/293: truncate d8/d12/d30/d3c/f4e 463236 0 2024-02-15T22:41:12.653 INFO:tasks.workunit.client.1.smithi082.stdout:1/275: dwrite d1/da/d11/f16 [0,4194304] 0 2024-02-15T22:41:12.658 INFO:tasks.workunit.client.1.smithi082.stdout:4/313: dwrite d0/d8/d1b/f3b [0,4194304] 0 2024-02-15T22:41:12.658 INFO:tasks.workunit.client.1.smithi082.stdout:4/314: chown d0/d16/f3a 68105859 1 2024-02-15T22:41:12.659 INFO:tasks.workunit.client.1.smithi082.stdout:3/257: dwrite d0/d19/f25 [0,4194304] 0 2024-02-15T22:41:12.659 INFO:tasks.workunit.client.1.smithi082.stdout:3/258: write d0/d19/d14/f40 [438379,54994] 0 2024-02-15T22:41:12.659 INFO:tasks.workunit.client.1.smithi082.stdout:3/259: creat d0/d19/f50 x:0 0 0 2024-02-15T22:41:12.659 INFO:tasks.workunit.client.1.smithi082.stdout:9/294: dwrite d8/d24/d2e/f46 [0,4194304] 0 2024-02-15T22:41:12.664 INFO:tasks.workunit.client.1.smithi082.stdout:1/276: dread d1/da/d11/f16 [0,4194304] 0 2024-02-15T22:41:12.664 INFO:tasks.workunit.client.1.smithi082.stdout:1/277: fdatasync d1/da/d11/f33 0 2024-02-15T22:41:12.667 INFO:tasks.workunit.client.1.smithi082.stdout:4/315: dread d0/d8/d32/f4e [0,4194304] 0 2024-02-15T22:41:12.669 INFO:tasks.workunit.client.1.smithi082.stdout:3/260: creat d0/dc/f51 x:0 0 0 2024-02-15T22:41:12.676 INFO:tasks.workunit.client.1.smithi082.stdout:9/295: symlink d8/d12/d33/l4f 0 2024-02-15T22:41:12.677 INFO:tasks.workunit.client.1.smithi082.stdout:4/316: write d0/d8/d1b/f3b [2485620,84099] 0 2024-02-15T22:41:12.677 INFO:tasks.workunit.client.1.smithi082.stdout:1/278: creat d1/da/d14/d18/d51/f59 x:0 0 0 2024-02-15T22:41:12.678 INFO:tasks.workunit.client.1.smithi082.stdout:3/261: mknod d0/d16/d3e/c52 0 2024-02-15T22:41:12.688 INFO:tasks.workunit.client.1.smithi082.stdout:4/317: dread d0/d8/d1b/f36 [0,4194304] 0 2024-02-15T22:41:12.691 INFO:tasks.workunit.client.1.smithi082.stdout:3/262: write d0/f33 [908292,55577] 0 2024-02-15T22:41:12.692 INFO:tasks.workunit.client.1.smithi082.stdout:3/263: mkdir d0/d53 0 2024-02-15T22:41:12.693 INFO:tasks.workunit.client.1.smithi082.stdout:3/264: mknod d0/d19/d14/d21/c54 0 2024-02-15T22:41:12.695 INFO:tasks.workunit.client.1.smithi082.stdout:3/265: rename d0/l8 to d0/l55 0 2024-02-15T22:41:12.702 INFO:tasks.workunit.client.1.smithi082.stdout:1/279: dwrite d1/da/d14/f28 [0,4194304] 0 2024-02-15T22:41:12.704 INFO:tasks.workunit.client.1.smithi082.stdout:1/280: rename d1/da/d14/l4a to d1/da/d14/l5a 0 2024-02-15T22:41:12.704 INFO:tasks.workunit.client.1.smithi082.stdout:1/281: creat d1/f5b x:0 0 0 2024-02-15T22:41:12.704 INFO:tasks.workunit.client.1.smithi082.stdout:1/282: dread - d1/da/d11/d3f/f53 zero size 2024-02-15T22:41:12.704 INFO:tasks.workunit.client.1.smithi082.stdout:1/283: creat d1/da/d11/d3f/f5c x:0 0 0 2024-02-15T22:41:12.704 INFO:tasks.workunit.client.1.smithi082.stdout:1/284: chown d1/da/d14/d18/d1f/d2f/c4c 4006480 1 2024-02-15T22:41:12.708 INFO:tasks.workunit.client.1.smithi082.stdout:9/296: dwrite d8/f1c [0,4194304] 0 2024-02-15T22:41:12.708 INFO:tasks.workunit.client.1.smithi082.stdout:9/297: fdatasync d8/f2b 0 2024-02-15T22:41:12.710 INFO:tasks.workunit.client.1.smithi082.stdout:9/298: rmdir d8/d24 39 2024-02-15T22:41:12.711 INFO:tasks.workunit.client.1.smithi082.stdout:9/299: symlink d8/d12/l50 0 2024-02-15T22:41:12.711 INFO:tasks.workunit.client.1.smithi082.stdout:9/300: fsync d8/f1f 0 2024-02-15T22:41:12.712 INFO:tasks.workunit.client.1.smithi082.stdout:9/301: creat d8/d12/d30/f51 x:0 0 0 2024-02-15T22:41:12.714 INFO:tasks.workunit.client.1.smithi082.stdout:9/302: link d8/d12/l26 d8/d12/d33/l52 0 2024-02-15T22:41:12.715 INFO:tasks.workunit.client.1.smithi082.stdout:1/285: read d1/da/d14/f2d [414027,86358] 0 2024-02-15T22:41:12.717 INFO:tasks.workunit.client.1.smithi082.stdout:1/286: symlink d1/l5d 0 2024-02-15T22:41:12.718 INFO:tasks.workunit.client.1.smithi082.stdout:1/287: write d1/f3d [2678473,85165] 0 2024-02-15T22:41:12.718 INFO:tasks.workunit.client.1.smithi082.stdout:4/318: dwrite d0/d8/f3d [0,4194304] 0 2024-02-15T22:41:12.718 INFO:tasks.workunit.client.1.smithi082.stdout:4/319: stat d0/d8/d1b/dd/ff 0 2024-02-15T22:41:12.718 INFO:tasks.workunit.client.1.smithi082.stdout:4/320: readlink d0/d8/d1b/dd/l68 0 2024-02-15T22:41:12.718 INFO:tasks.workunit.client.1.smithi082.stdout:4/321: chown d0/d8/d1b/dd/l13 69254047 1 2024-02-15T22:41:12.719 INFO:tasks.workunit.client.1.smithi082.stdout:4/322: write d0/d16/f2d [3561329,118546] 0 2024-02-15T22:41:12.723 INFO:tasks.workunit.client.1.smithi082.stdout:3/266: dwrite d0/f43 [0,4194304] 0 2024-02-15T22:41:12.723 INFO:tasks.workunit.client.1.smithi082.stdout:3/267: write d0/d19/f36 [774935,29128] 0 2024-02-15T22:41:12.723 INFO:tasks.workunit.client.1.smithi082.stdout:3/268: read d0/f33 [3068177,95210] 0 2024-02-15T22:41:12.723 INFO:tasks.workunit.client.1.smithi082.stdout:3/269: readlink d0/dc/d3f/l4d 0 2024-02-15T22:41:12.723 INFO:tasks.workunit.client.1.smithi082.stdout:3/270: dread - d0/f46 zero size 2024-02-15T22:41:12.723 INFO:tasks.workunit.client.1.smithi082.stdout:3/271: readlink d0/d16/l2f 0 2024-02-15T22:41:12.723 INFO:tasks.workunit.client.1.smithi082.stdout:1/288: rmdir d1/da/d14/d18/d1f 39 2024-02-15T22:41:12.726 INFO:tasks.workunit.client.1.smithi082.stdout:4/323: mknod d0/d16/c72 0 2024-02-15T22:41:12.726 INFO:tasks.workunit.client.1.smithi082.stdout:4/324: creat d0/d8/d1b/f73 x:0 0 0 2024-02-15T22:41:12.726 INFO:tasks.workunit.client.1.smithi082.stdout:4/325: chown d0/d8/l1c 88274440 1 2024-02-15T22:41:12.729 INFO:tasks.workunit.client.1.smithi082.stdout:3/272: mkdir d0/d16/d3e/d56 0 2024-02-15T22:41:12.730 INFO:tasks.workunit.client.1.smithi082.stdout:1/289: truncate d1/f1b 2299510 0 2024-02-15T22:41:12.730 INFO:tasks.workunit.client.1.smithi082.stdout:1/290: write d1/da/d14/d18/f2b [495719,49376] 0 2024-02-15T22:41:12.730 INFO:tasks.workunit.client.1.smithi082.stdout:1/291: dread - d1/da/d14/d18/d1f/f58 zero size 2024-02-15T22:41:12.730 INFO:tasks.workunit.client.1.smithi082.stdout:1/292: write d1/f47 [920197,104400] 0 2024-02-15T22:41:12.730 INFO:tasks.workunit.client.1.smithi082.stdout:1/293: chown d1/da/d14/d18/d1f/d2f/f55 0 1 2024-02-15T22:41:12.731 INFO:tasks.workunit.client.1.smithi082.stdout:9/303: dwrite d8/f9 [0,4194304] 0 2024-02-15T22:41:12.731 INFO:tasks.workunit.client.1.smithi082.stdout:9/304: chown d8/d12/d33/d3e/f48 37768174 1 2024-02-15T22:41:12.732 INFO:tasks.workunit.client.1.smithi082.stdout:3/273: unlink d0/f1c 0 2024-02-15T22:41:12.742 INFO:tasks.workunit.client.1.smithi082.stdout:3/274: dread d0/f2 [4194304,4194304] 0 2024-02-15T22:41:12.756 INFO:tasks.workunit.client.1.smithi082.stdout:1/294: dwrite d1/f47 [0,4194304] 0 2024-02-15T22:41:12.757 INFO:tasks.workunit.client.1.smithi082.stdout:1/295: creat d1/da/d11/d3f/f5e x:0 0 0 2024-02-15T22:41:12.757 INFO:tasks.workunit.client.1.smithi082.stdout:1/296: fsync d1/da/d14/d18/d1f/d2f/f3e 0 2024-02-15T22:41:12.757 INFO:tasks.workunit.client.1.smithi082.stdout:9/305: dwrite d8/f1f [0,4194304] 0 2024-02-15T22:41:12.757 INFO:tasks.workunit.client.1.smithi082.stdout:1/297: write d1/f3d [3752191,101409] 0 2024-02-15T22:41:12.757 INFO:tasks.workunit.client.1.smithi082.stdout:1/298: dread - d1/da/d14/d18/d1f/f58 zero size 2024-02-15T22:41:12.783 INFO:tasks.workunit.client.1.smithi082.stdout:1/299: dwrite d1/da/d14/d18/d1f/d2f/f52 [0,4194304] 0 2024-02-15T22:41:12.783 INFO:tasks.workunit.client.1.smithi082.stdout:1/300: chown d1/da/d14/d18/f2b 7 1 2024-02-15T22:41:12.783 INFO:tasks.workunit.client.1.smithi082.stdout:9/306: dwrite d8/d24/f4b [0,4194304] 0 2024-02-15T22:41:12.787 INFO:tasks.workunit.client.1.smithi082.stdout:9/307: mkdir d8/d24/d2e/d53 0 2024-02-15T22:41:12.790 INFO:tasks.workunit.client.1.smithi082.stdout:1/301: dread d1/da/d11/f48 [0,4194304] 0 2024-02-15T22:41:12.791 INFO:tasks.workunit.client.1.smithi082.stdout:1/302: rename d1/da/d14/f43 to d1/d57/f5f 0 2024-02-15T22:41:12.792 INFO:tasks.workunit.client.1.smithi082.stdout:1/303: write d1/da/d11/d3f/f5c [153651,95427] 0 2024-02-15T22:41:12.792 INFO:tasks.workunit.client.1.smithi082.stdout:1/304: symlink d1/da/d11/d3f/l60 0 2024-02-15T22:41:12.795 INFO:tasks.workunit.client.1.smithi082.stdout:9/308: write d8/f1f [3356471,77456] 0 2024-02-15T22:41:12.795 INFO:tasks.workunit.client.1.smithi082.stdout:9/309: dread - d8/d12/d33/d3e/f48 zero size 2024-02-15T22:41:12.795 INFO:tasks.workunit.client.1.smithi082.stdout:9/310: stat d8/f18 0 2024-02-15T22:41:12.796 INFO:tasks.workunit.client.1.smithi082.stdout:1/305: dread d1/da/d14/d18/f2b [0,4194304] 0 2024-02-15T22:41:12.796 INFO:tasks.workunit.client.1.smithi082.stdout:1/306: readlink d1/da/l45 0 2024-02-15T22:41:12.797 INFO:tasks.workunit.client.1.smithi082.stdout:1/307: write d1/da/d14/d18/d1f/d2f/f3e [1130141,47272] 0 2024-02-15T22:41:12.797 INFO:tasks.workunit.client.1.smithi082.stdout:1/308: fdatasync d1/da/d14/d18/d51/f59 0 2024-02-15T22:41:12.797 INFO:tasks.workunit.client.1.smithi082.stdout:9/311: rename d8/l17 to d8/d24/d2e/l54 0 2024-02-15T22:41:12.797 INFO:tasks.workunit.client.1.smithi082.stdout:9/312: readlink d8/l3f 0 2024-02-15T22:41:12.798 INFO:tasks.workunit.client.1.smithi082.stdout:1/309: symlink d1/da/d11/l61 0 2024-02-15T22:41:12.798 INFO:tasks.workunit.client.1.smithi082.stdout:1/310: write d1/da/d14/d18/f2b [1370300,55472] 0 2024-02-15T22:41:12.798 INFO:tasks.workunit.client.1.smithi082.stdout:1/311: stat d1/da/d14/d18/f2b 0 2024-02-15T22:41:12.798 INFO:tasks.workunit.client.1.smithi082.stdout:9/313: mknod d8/c55 0 2024-02-15T22:41:12.799 INFO:tasks.workunit.client.1.smithi082.stdout:1/312: link d1/c36 d1/d57/c62 0 2024-02-15T22:41:12.799 INFO:tasks.workunit.client.1.smithi082.stdout:1/313: fdatasync d1/da/d14/d18/d1f/f58 0 2024-02-15T22:41:12.799 INFO:tasks.workunit.client.1.smithi082.stdout:1/314: read d1/da/ff [380670,45607] 0 2024-02-15T22:41:12.799 INFO:tasks.workunit.client.1.smithi082.stdout:1/315: fsync d1/f1d 0 2024-02-15T22:41:12.799 INFO:tasks.workunit.client.1.smithi082.stdout:1/316: chown d1/f47 114421 1 2024-02-15T22:41:12.800 INFO:tasks.workunit.client.1.smithi082.stdout:1/317: rename d1/da/d14/d18/d1f/c49 to d1/da/d11/d3f/c63 0 2024-02-15T22:41:12.800 INFO:tasks.workunit.client.1.smithi082.stdout:1/318: chown d1/da/d14/d18/d51/c56 208745 1 2024-02-15T22:41:12.800 INFO:tasks.workunit.client.1.smithi082.stdout:1/319: creat d1/da/d14/d18/d1f/f64 x:0 0 0 2024-02-15T22:41:12.801 INFO:tasks.workunit.client.1.smithi082.stdout:1/320: symlink d1/da/d11/d3f/l65 0 2024-02-15T22:41:12.801 INFO:tasks.workunit.client.1.smithi082.stdout:1/321: write d1/f1b [567893,38127] 0 2024-02-15T22:41:12.801 INFO:tasks.workunit.client.1.smithi082.stdout:1/322: fdatasync d1/da/d14/d18/d51/f59 0 2024-02-15T22:41:12.802 INFO:tasks.workunit.client.1.smithi082.stdout:1/323: unlink d1/da/d14/d18/d1f/d2f/f3b 0 2024-02-15T22:41:12.803 INFO:tasks.workunit.client.1.smithi082.stdout:1/324: truncate d1/da/d14/f2d 1290862 0 2024-02-15T22:41:12.805 INFO:tasks.workunit.client.1.smithi082.stdout:1/325: truncate d1/da/d14/f28 922478 0 2024-02-15T22:41:12.805 INFO:tasks.workunit.client.1.smithi082.stdout:1/326: creat d1/da/d14/d18/d1f/f66 x:0 0 0 2024-02-15T22:41:12.806 INFO:tasks.workunit.client.1.smithi082.stdout:9/314: write d8/f9 [1478013,93965] 0 2024-02-15T22:41:12.807 INFO:tasks.workunit.client.1.smithi082.stdout:1/327: mknod d1/da/d14/d18/d1f/d2f/c67 0 2024-02-15T22:41:12.808 INFO:tasks.workunit.client.1.smithi082.stdout:9/315: mkdir d8/d24/d2e/d56 0 2024-02-15T22:41:12.812 INFO:tasks.workunit.client.1.smithi082.stdout:1/328: link d1/da/d14/d18/d1f/f4f d1/da/d14/d18/d51/f68 0 2024-02-15T22:41:12.812 INFO:tasks.workunit.client.1.smithi082.stdout:1/329: creat d1/da/d11/d3f/f69 x:0 0 0 2024-02-15T22:41:12.817 INFO:tasks.workunit.client.1.smithi082.stdout:1/330: link d1/da/d14/d18/c38 d1/da/d14/d18/d1f/c6a 0 2024-02-15T22:41:12.817 INFO:tasks.workunit.client.1.smithi082.stdout:9/316: write d8/d24/f4b [749950,125280] 0 2024-02-15T22:41:12.817 INFO:tasks.workunit.client.1.smithi082.stdout:9/317: chown d8/d24/d2e/d56 19 1 2024-02-15T22:41:12.818 INFO:tasks.workunit.client.1.smithi082.stdout:1/331: mknod d1/da/d14/d18/d1f/c6b 0 2024-02-15T22:41:12.818 INFO:tasks.workunit.client.1.smithi082.stdout:1/332: creat d1/f6c x:0 0 0 2024-02-15T22:41:12.821 INFO:tasks.workunit.client.1.smithi082.stdout:9/318: unlink d8/d12/d30/l37 0 2024-02-15T22:41:12.821 INFO:tasks.workunit.client.1.smithi082.stdout:9/319: write d8/f1a [5104306,112966] 0 2024-02-15T22:41:12.823 INFO:tasks.workunit.client.1.smithi082.stdout:1/333: dread d1/da/d11/d3f/f5c [0,4194304] 0 2024-02-15T22:41:12.825 INFO:tasks.workunit.client.1.smithi082.stdout:9/320: getdents d8 0 2024-02-15T22:41:12.826 INFO:tasks.workunit.client.1.smithi082.stdout:9/321: creat d8/d24/d2e/d56/f57 x:0 0 0 2024-02-15T22:41:12.826 INFO:tasks.workunit.client.1.smithi082.stdout:9/322: fdatasync d8/d12/f1e 0 2024-02-15T22:41:12.826 INFO:tasks.workunit.client.1.smithi082.stdout:9/323: stat f5 0 2024-02-15T22:41:12.829 INFO:tasks.workunit.client.1.smithi082.stdout:9/324: creat d8/f58 x:0 0 0 2024-02-15T22:41:12.831 INFO:tasks.workunit.client.1.smithi082.stdout:1/334: read d1/f39 [3163599,21200] 0 2024-02-15T22:41:12.832 INFO:tasks.workunit.client.1.smithi082.stdout:1/335: readlink d1/da/d14/l27 0 2024-02-15T22:41:12.835 INFO:tasks.workunit.client.1.smithi082.stdout:1/336: mkdir d1/da/d14/d18/d6d 0 2024-02-15T22:41:12.846 INFO:tasks.workunit.client.1.smithi082.stdout:1/337: getdents d1/da/d14/d18/d1f/d2f 0 2024-02-15T22:41:12.846 INFO:tasks.workunit.client.1.smithi082.stdout:1/338: readlink d1/da/d14/d18/d1f/d2f/l4e 0 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:7/229: sync 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:2/355: sync 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:0/302: sync 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:8/264: sync 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:2/356: dread - d6/dc/dd/d1d/f51 zero size 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:2/357: dread - d6/dc/d58/d49/d5e/f73 zero size 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:7/230: write d12/d17/f19 [8599093,112332] 0 2024-02-15T22:41:12.849 INFO:tasks.workunit.client.1.smithi082.stdout:2/358: creat d6/dc/dd/d1d/f77 x:0 0 0 2024-02-15T22:41:12.850 INFO:tasks.workunit.client.1.smithi082.stdout:2/359: truncate d6/dc/d12/d23/f2f 781910 0 2024-02-15T22:41:12.850 INFO:tasks.workunit.client.1.smithi082.stdout:8/265: truncate d1/d7/de/f3d 700889 0 2024-02-15T22:41:12.853 INFO:tasks.workunit.client.1.smithi082.stdout:7/231: creat d12/d27/d33/f4e x:0 0 0 2024-02-15T22:41:12.854 INFO:tasks.workunit.client.1.smithi082.stdout:7/232: dread - d12/d17/f25 zero size 2024-02-15T22:41:12.857 INFO:tasks.workunit.client.1.smithi082.stdout:1/339: dread d1/da/d14/d18/d1f/f4f [0,4194304] 0 2024-02-15T22:41:12.857 INFO:tasks.workunit.client.1.smithi082.stdout:2/360: rename d6/d18/l5d to d6/dc/dd/d24/l78 0 2024-02-15T22:41:12.858 INFO:tasks.workunit.client.1.smithi082.stdout:0/303: dread d3/d19/d20/d26/f6a [0,4194304] 0 2024-02-15T22:41:12.858 INFO:tasks.workunit.client.1.smithi082.stdout:8/266: symlink d1/d7/d9/d24/d43/l5f 0 2024-02-15T22:41:12.858 INFO:tasks.workunit.client.1.smithi082.stdout:8/267: write d1/d7/d9/d24/d30/f3c [1558283,57208] 0 2024-02-15T22:41:12.859 INFO:tasks.workunit.client.1.smithi082.stdout:1/340: rmdir d1/da/d14/d18/d1f/d2f 39 2024-02-15T22:41:12.860 INFO:tasks.workunit.client.1.smithi082.stdout:0/304: truncate d3/f12 1734048 0 2024-02-15T22:41:12.861 INFO:tasks.workunit.client.1.smithi082.stdout:8/268: creat d1/d7/d9/f60 x:0 0 0 2024-02-15T22:41:12.864 INFO:tasks.workunit.client.1.smithi082.stdout:7/233: write d12/f21 [3936438,100629] 0 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:0/305: mkdir d3/d6b 0 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:8/269: symlink d1/d7/d9/d42/l61 0 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:0/306: write d3/d19/d20/d26/f31 [483034,20039] 0 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:8/270: truncate d1/d7/de/d1e/f27 2163626 0 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:0/307: chown d3/d19/f24 2 1 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:0/308: fdatasync d3/f34 0 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:8/271: write d1/f5 [2775277,21851] 0 2024-02-15T22:41:12.866 INFO:tasks.workunit.client.1.smithi082.stdout:7/234: unlink d12/d17/f30 0 2024-02-15T22:41:12.869 INFO:tasks.workunit.client.1.smithi082.stdout:0/309: write d3/f15 [350461,50790] 0 2024-02-15T22:41:12.869 INFO:tasks.workunit.client.1.smithi082.stdout:8/272: unlink d1/d7/l2d 0 2024-02-15T22:41:12.870 INFO:tasks.workunit.client.1.smithi082.stdout:7/235: truncate d12/f22 799695 0 2024-02-15T22:41:12.870 INFO:tasks.workunit.client.1.smithi082.stdout:7/236: write f10 [386176,69698] 0 2024-02-15T22:41:12.874 INFO:tasks.workunit.client.1.smithi082.stdout:8/273: unlink d1/d7/d9/d24/d30/f5a 0 2024-02-15T22:41:12.875 INFO:tasks.workunit.client.1.smithi082.stdout:7/237: truncate ff 348682 0 2024-02-15T22:41:12.876 INFO:tasks.workunit.client.1.smithi082.stdout:0/310: mkdir d3/d19/d25/d45/d6c 0 2024-02-15T22:41:12.878 INFO:tasks.workunit.client.1.smithi082.stdout:8/274: unlink d1/d7/de/c1d 0 2024-02-15T22:41:12.878 INFO:tasks.workunit.client.1.smithi082.stdout:7/238: symlink d12/d37/l4f 0 2024-02-15T22:41:12.879 INFO:tasks.workunit.client.1.smithi082.stdout:2/361: dwrite d6/dc/dd/d1d/f77 [0,4194304] 0 2024-02-15T22:41:12.879 INFO:tasks.workunit.client.1.smithi082.stdout:1/341: dwrite d1/da/d14/d18/d1f/f50 [0,4194304] 0 2024-02-15T22:41:12.880 INFO:tasks.workunit.client.1.smithi082.stdout:1/342: stat d1/l40 0 2024-02-15T22:41:12.880 INFO:tasks.workunit.client.1.smithi082.stdout:8/275: creat d1/d7/f62 x:0 0 0 2024-02-15T22:41:12.889 INFO:tasks.workunit.client.1.smithi082.stdout:1/343: symlink d1/d57/l6e 0 2024-02-15T22:41:12.889 INFO:tasks.workunit.client.1.smithi082.stdout:1/344: read - d1/da/d11/d3f/f53 zero size 2024-02-15T22:41:12.890 INFO:tasks.workunit.client.1.smithi082.stdout:8/276: symlink d1/d7/d9/d50/l63 0 2024-02-15T22:41:12.894 INFO:tasks.workunit.client.1.smithi082.stdout:1/345: creat d1/da/d14/d18/d6d/f6f x:0 0 0 2024-02-15T22:41:12.897 INFO:tasks.workunit.client.1.smithi082.stdout:8/277: rename d1/d7/de/f58 to d1/d7/d48/f64 0 2024-02-15T22:41:12.900 INFO:tasks.workunit.client.1.smithi082.stdout:1/346: link d1/da/d14/d18/f2b d1/da/d14/d18/d6d/f70 0 2024-02-15T22:41:12.900 INFO:tasks.workunit.client.1.smithi082.stdout:1/347: chown d1/da/d14/d18 0 1 2024-02-15T22:41:12.901 INFO:tasks.workunit.client.1.smithi082.stdout:8/278: symlink d1/d7/d9/d24/d43/l65 0 2024-02-15T22:41:12.905 INFO:tasks.workunit.client.1.smithi082.stdout:8/279: unlink d1/f19 0 2024-02-15T22:41:12.905 INFO:tasks.workunit.client.1.smithi082.stdout:8/280: creat d1/d7/d9/d24/d30/f66 x:0 0 0 2024-02-15T22:41:12.912 INFO:tasks.workunit.client.1.smithi082.stdout:0/311: dwrite d3/f34 [4194304,4194304] 0 2024-02-15T22:41:12.912 INFO:tasks.workunit.client.1.smithi082.stdout:2/362: dwrite d6/dc/d12/f74 [0,4194304] 0 2024-02-15T22:41:12.913 INFO:tasks.workunit.client.1.smithi082.stdout:2/363: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:12.918 INFO:tasks.workunit.client.1.smithi082.stdout:2/364: link d6/l62 d6/d18/l79 0 2024-02-15T22:41:12.918 INFO:tasks.workunit.client.1.smithi082.stdout:7/239: dwrite f3 [0,4194304] 0 2024-02-15T22:41:12.919 INFO:tasks.workunit.client.1.smithi082.stdout:0/312: mkdir d3/d19/d1c/d6d 0 2024-02-15T22:41:12.921 INFO:tasks.workunit.client.1.smithi082.stdout:2/365: rename d6/dc/dd/d1d/f51 to d6/dc/dd/d24/d71/f7a 0 2024-02-15T22:41:12.923 INFO:tasks.workunit.client.1.smithi082.stdout:2/366: mknod d6/d18/c7b 0 2024-02-15T22:41:12.923 INFO:tasks.workunit.client.1.smithi082.stdout:2/367: dread - d6/dc/d58/f61 zero size 2024-02-15T22:41:12.925 INFO:tasks.workunit.client.1.smithi082.stdout:2/368: creat d6/dc/d12/d46/f7c x:0 0 0 2024-02-15T22:41:12.925 INFO:tasks.workunit.client.1.smithi082.stdout:2/369: chown d6/dc/d12/d46/d4b/d63/f66 214523517 1 2024-02-15T22:41:12.927 INFO:tasks.workunit.client.1.smithi082.stdout:8/281: dwrite d1/f23 [4194304,4194304] 0 2024-02-15T22:41:12.928 INFO:tasks.workunit.client.1.smithi082.stdout:1/348: dwrite d1/da/f1c [0,4194304] 0 2024-02-15T22:41:12.928 INFO:tasks.workunit.client.1.smithi082.stdout:1/349: write d1/f5b [222267,108801] 0 2024-02-15T22:41:12.928 INFO:tasks.workunit.client.1.smithi082.stdout:1/350: write d1/da/d14/f2d [2102799,46967] 0 2024-02-15T22:41:12.929 INFO:tasks.workunit.client.1.smithi082.stdout:0/313: dread d3/f40 [0,4194304] 0 2024-02-15T22:41:12.929 INFO:tasks.workunit.client.1.smithi082.stdout:0/314: creat d3/d19/d5f/f6e x:0 0 0 2024-02-15T22:41:12.931 INFO:tasks.workunit.client.1.smithi082.stdout:1/351: rename d1/da/d14/d18/d1f/d2f/f55 to d1/da/d14/d18/d51/f71 0 2024-02-15T22:41:12.937 INFO:tasks.workunit.client.1.smithi082.stdout:8/282: write d1/d7/d9/f47 [831028,47385] 0 2024-02-15T22:41:12.941 INFO:tasks.workunit.client.1.smithi082.stdout:0/315: dread d3/d19/f21 [4194304,4194304] 0 2024-02-15T22:41:12.943 INFO:tasks.workunit.client.1.smithi082.stdout:8/283: getdents d1/d7/d9/d24/d43 0 2024-02-15T22:41:12.943 INFO:tasks.workunit.client.1.smithi082.stdout:8/284: read - d1/d7/de/d1e/f20 zero size 2024-02-15T22:41:12.943 INFO:tasks.workunit.client.1.smithi082.stdout:8/285: fdatasync d1/d7/d48/f5d 0 2024-02-15T22:41:12.943 INFO:tasks.workunit.client.1.smithi082.stdout:8/286: write d1/f3a [1564422,80590] 0 2024-02-15T22:41:12.944 INFO:tasks.workunit.client.1.smithi082.stdout:0/316: rename d3/d19/d5f/f60 to d3/d19/d25/d45/d56/f6f 0 2024-02-15T22:41:12.944 INFO:tasks.workunit.client.1.smithi082.stdout:7/240: truncate f3 197055 0 2024-02-15T22:41:12.945 INFO:tasks.workunit.client.1.smithi082.stdout:7/241: fsync d12/f3c 0 2024-02-15T22:41:12.947 INFO:tasks.workunit.client.1.smithi082.stdout:0/317: symlink d3/d19/d1c/d6d/l70 0 2024-02-15T22:41:12.947 INFO:tasks.workunit.client.1.smithi082.stdout:0/318: truncate d3/f57 753139 0 2024-02-15T22:41:12.949 INFO:tasks.workunit.client.1.smithi082.stdout:8/287: link d1/f3a d1/d7/d9/d50/f67 0 2024-02-15T22:41:12.953 INFO:tasks.workunit.client.1.smithi082.stdout:8/288: dread d1/d7/de/f2e [0,4194304] 0 2024-02-15T22:41:12.954 INFO:tasks.workunit.client.1.smithi082.stdout:8/289: creat d1/d7/de/f68 x:0 0 0 2024-02-15T22:41:12.954 INFO:tasks.workunit.client.1.smithi082.stdout:8/290: chown d1/d40 123053721 1 2024-02-15T22:41:12.954 INFO:tasks.workunit.client.1.smithi082.stdout:8/291: fdatasync d1/d7/de/d1e/f39 0 2024-02-15T22:41:12.954 INFO:tasks.workunit.client.1.smithi082.stdout:8/292: readlink d1/d7/l26 0 2024-02-15T22:41:12.954 INFO:tasks.workunit.client.1.smithi082.stdout:8/293: readlink d1/d7/l3b 0 2024-02-15T22:41:12.955 INFO:tasks.workunit.client.1.smithi082.stdout:7/242: write d12/d17/f23 [2229637,44190] 0 2024-02-15T22:41:12.959 INFO:tasks.workunit.client.1.smithi082.stdout:0/319: mkdir d3/d64/d71 0 2024-02-15T22:41:12.959 INFO:tasks.workunit.client.1.smithi082.stdout:0/320: fsync d3/f11 0 2024-02-15T22:41:12.959 INFO:tasks.workunit.client.1.smithi082.stdout:0/321: fdatasync d3/d64/f68 0 2024-02-15T22:41:12.961 INFO:tasks.workunit.client.1.smithi082.stdout:8/294: creat d1/d7/d9/d24/f69 x:0 0 0 2024-02-15T22:41:12.961 INFO:tasks.workunit.client.1.smithi082.stdout:8/295: write d1/d7/d9/d24/f69 [154929,93025] 0 2024-02-15T22:41:12.961 INFO:tasks.workunit.client.1.smithi082.stdout:4/326: sync 2024-02-15T22:41:12.961 INFO:tasks.workunit.client.1.smithi082.stdout:5/316: sync 2024-02-15T22:41:12.962 INFO:tasks.workunit.client.1.smithi082.stdout:6/404: sync 2024-02-15T22:41:12.962 INFO:tasks.workunit.client.1.smithi082.stdout:4/327: chown d0/d8/d1b/c29 527 1 2024-02-15T22:41:12.962 INFO:tasks.workunit.client.1.smithi082.stdout:4/328: chown d0/d8/d1b/f73 38049700 1 2024-02-15T22:41:12.963 INFO:tasks.workunit.client.1.smithi082.stdout:6/405: dread d2/d18/d23/d3c/d47/d72/f78 [0,4194304] 0 2024-02-15T22:41:12.963 INFO:tasks.workunit.client.1.smithi082.stdout:6/406: truncate d2/d30/d3b/f6b 533197 0 2024-02-15T22:41:12.964 INFO:tasks.workunit.client.1.smithi082.stdout:7/243: mknod d12/d3b/c50 0 2024-02-15T22:41:12.966 INFO:tasks.workunit.client.1.smithi082.stdout:0/322: creat d3/d19/d1c/d6d/f72 x:0 0 0 2024-02-15T22:41:12.966 INFO:tasks.workunit.client.1.smithi082.stdout:4/329: dread d0/f2 [0,4194304] 0 2024-02-15T22:41:12.967 INFO:tasks.workunit.client.1.smithi082.stdout:6/407: mkdir d2/d18/d23/d3c/d84 0 2024-02-15T22:41:12.968 INFO:tasks.workunit.client.1.smithi082.stdout:6/408: write d2/d30/d3b/f49 [5667686,63663] 0 2024-02-15T22:41:12.970 INFO:tasks.workunit.client.1.smithi082.stdout:7/244: mknod d12/d3b/d41/c51 0 2024-02-15T22:41:12.970 INFO:tasks.workunit.client.1.smithi082.stdout:7/245: dread - d12/f3c zero size 2024-02-15T22:41:12.970 INFO:tasks.workunit.client.1.smithi082.stdout:7/246: chown d12/d17/c24 2247647 1 2024-02-15T22:41:12.970 INFO:tasks.workunit.client.1.smithi082.stdout:7/247: chown d12/f22 62 1 2024-02-15T22:41:12.970 INFO:tasks.workunit.client.1.smithi082.stdout:0/323: mkdir d3/d64/d71/d73 0 2024-02-15T22:41:12.971 INFO:tasks.workunit.client.1.smithi082.stdout:8/296: mkdir d1/d7/d9/d42/d6a 0 2024-02-15T22:41:12.971 INFO:tasks.workunit.client.1.smithi082.stdout:4/330: symlink d0/d8/d1b/dd/l74 0 2024-02-15T22:41:12.971 INFO:tasks.workunit.client.1.smithi082.stdout:4/331: stat d0/d47/c55 0 2024-02-15T22:41:12.972 INFO:tasks.workunit.client.1.smithi082.stdout:6/409: mknod d2/d18/d23/c85 0 2024-02-15T22:41:12.972 INFO:tasks.workunit.client.1.smithi082.stdout:6/410: write d2/d18/d23/d3c/d47/d72/f78 [381441,35937] 0 2024-02-15T22:41:12.973 INFO:tasks.workunit.client.1.smithi082.stdout:8/297: creat d1/d7/d9/d50/d56/f6b x:0 0 0 2024-02-15T22:41:12.973 INFO:tasks.workunit.client.1.smithi082.stdout:8/298: chown d1/d7/de/d1e/f20 7768354 1 2024-02-15T22:41:12.973 INFO:tasks.workunit.client.1.smithi082.stdout:8/299: write d1/f18 [1608402,49466] 0 2024-02-15T22:41:12.974 INFO:tasks.workunit.client.1.smithi082.stdout:4/332: creat d0/f75 x:0 0 0 2024-02-15T22:41:12.975 INFO:tasks.workunit.client.1.smithi082.stdout:6/411: rmdir d2/d18/d23/d3c/d47/d72/d76 0 2024-02-15T22:41:12.976 INFO:tasks.workunit.client.1.smithi082.stdout:7/248: link l2 d12/d17/d4d/l52 0 2024-02-15T22:41:12.976 INFO:tasks.workunit.client.1.smithi082.stdout:7/249: write fb [4412454,52943] 0 2024-02-15T22:41:12.980 INFO:tasks.workunit.client.1.smithi082.stdout:8/300: creat d1/d7/d9/d42/d6a/f6c x:0 0 0 2024-02-15T22:41:12.980 INFO:tasks.workunit.client.1.smithi082.stdout:8/301: fdatasync d1/f4f 0 2024-02-15T22:41:12.980 INFO:tasks.workunit.client.1.smithi082.stdout:0/324: symlink d3/d19/d25/d45/l74 0 2024-02-15T22:41:12.981 INFO:tasks.workunit.client.1.smithi082.stdout:7/250: getdents d12/d17/d3d 0 2024-02-15T22:41:12.981 INFO:tasks.workunit.client.1.smithi082.stdout:8/302: dread d1/d7/d9/d24/d30/f3c [0,4194304] 0 2024-02-15T22:41:12.982 INFO:tasks.workunit.client.1.smithi082.stdout:6/412: dread d2/f1e [0,4194304] 0 2024-02-15T22:41:12.982 INFO:tasks.workunit.client.1.smithi082.stdout:6/413: readlink d2/la 0 2024-02-15T22:41:12.982 INFO:tasks.workunit.client.1.smithi082.stdout:6/414: dread - d2/d18/d39/f7d zero size 2024-02-15T22:41:12.983 INFO:tasks.workunit.client.1.smithi082.stdout:7/251: rename f10 to d12/d17/d42/f53 0 2024-02-15T22:41:12.983 INFO:tasks.workunit.client.1.smithi082.stdout:7/252: chown d12/d17/d42 1 1 2024-02-15T22:41:12.988 INFO:tasks.workunit.client.1.smithi082.stdout:6/415: rename d2/d18/d23/d3c/d47/f7e to d2/d30/f86 0 2024-02-15T22:41:12.988 INFO:tasks.workunit.client.1.smithi082.stdout:6/416: dread - d2/d18/d23/d3c/d47/d69/f77 zero size 2024-02-15T22:41:12.988 INFO:tasks.workunit.client.1.smithi082.stdout:6/417: fdatasync d2/d18/d23/f35 0 2024-02-15T22:41:12.992 INFO:tasks.workunit.client.1.smithi082.stdout:7/253: link d12/d17/f23 d12/d27/d33/f54 0 2024-02-15T22:41:12.996 INFO:tasks.workunit.client.1.smithi082.stdout:7/254: rmdir d12/d37 39 2024-02-15T22:41:12.998 INFO:tasks.workunit.client.1.smithi082.stdout:7/255: creat d12/d17/d3d/f55 x:0 0 0 2024-02-15T22:41:13.001 INFO:tasks.workunit.client.1.smithi082.stdout:7/256: dread f3 [0,4194304] 0 2024-02-15T22:41:13.003 INFO:tasks.workunit.client.1.smithi082.stdout:7/257: link d12/d3b/d41/c51 d12/d37/c56 0 2024-02-15T22:41:13.003 INFO:tasks.workunit.client.1.smithi082.stdout:7/258: read - d12/d17/f25 zero size 2024-02-15T22:41:13.003 INFO:tasks.workunit.client.1.smithi082.stdout:7/259: chown d12/f2d 365125666 1 2024-02-15T22:41:13.003 INFO:tasks.workunit.client.1.smithi082.stdout:7/260: write d12/f21 [2586670,73922] 0 2024-02-15T22:41:13.004 INFO:tasks.workunit.client.1.smithi082.stdout:7/261: unlink d12/d17/f1f 0 2024-02-15T22:41:13.005 INFO:tasks.workunit.client.1.smithi082.stdout:7/262: mkdir d12/d17/d3d/d57 0 2024-02-15T22:41:13.006 INFO:tasks.workunit.client.1.smithi082.stdout:7/263: creat d12/d17/d42/f58 x:0 0 0 2024-02-15T22:41:13.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/264: rmdir d12/d37 39 2024-02-15T22:41:13.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/265: fdatasync d12/d17/f1d 0 2024-02-15T22:41:13.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/266: truncate d12/d17/f25 86955 0 2024-02-15T22:41:13.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/267: readlink d12/d17/l3a 0 2024-02-15T22:41:13.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/268: chown d12/d37/l4f 124793795 1 2024-02-15T22:41:13.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/269: fdatasync d12/d17/d3d/f55 0 2024-02-15T22:41:13.009 INFO:tasks.workunit.client.1.smithi082.stdout:8/303: dwrite d1/f3a [0,4194304] 0 2024-02-15T22:41:13.011 INFO:tasks.workunit.client.1.smithi082.stdout:6/418: dwrite d2/d18/d39/f7d [0,4194304] 0 2024-02-15T22:41:13.011 INFO:tasks.workunit.client.1.smithi082.stdout:4/333: dwrite d0/f23 [0,4194304] 0 2024-02-15T22:41:13.012 INFO:tasks.workunit.client.1.smithi082.stdout:8/304: rename d1/d7/d9/f60 to d1/d40/f6d 0 2024-02-15T22:41:13.015 INFO:tasks.workunit.client.1.smithi082.stdout:7/270: dread d12/d17/f19 [4194304,4194304] 0 2024-02-15T22:41:13.020 INFO:tasks.workunit.client.1.smithi082.stdout:4/334: mknod d0/d8/c76 0 2024-02-15T22:41:13.021 INFO:tasks.workunit.client.1.smithi082.stdout:4/335: symlink d0/d8/d32/l77 0 2024-02-15T22:41:13.022 INFO:tasks.workunit.client.1.smithi082.stdout:6/419: read d2/d18/f44 [283403,120968] 0 2024-02-15T22:41:13.023 INFO:tasks.workunit.client.1.smithi082.stdout:8/305: dread d1/f1b [0,4194304] 0 2024-02-15T22:41:13.023 INFO:tasks.workunit.client.1.smithi082.stdout:8/306: chown d1/f3a 0 1 2024-02-15T22:41:13.023 INFO:tasks.workunit.client.1.smithi082.stdout:4/336: unlink d0/d8/d1b/dd/c48 0 2024-02-15T22:41:13.028 INFO:tasks.workunit.client.1.smithi082.stdout:4/337: link d0/l3 d0/d16/d4a/l78 0 2024-02-15T22:41:13.028 INFO:tasks.workunit.client.1.smithi082.stdout:4/338: dread - d0/d16/f56 zero size 2024-02-15T22:41:13.029 INFO:tasks.workunit.client.1.smithi082.stdout:4/339: creat d0/d46/f79 x:0 0 0 2024-02-15T22:41:13.031 INFO:tasks.workunit.client.1.smithi082.stdout:4/340: mknod d0/d8/d1b/d70/c7a 0 2024-02-15T22:41:13.033 INFO:tasks.workunit.client.1.smithi082.stdout:6/420: read d2/f3 [5324401,64002] 0 2024-02-15T22:41:13.034 INFO:tasks.workunit.client.1.smithi082.stdout:6/421: write d2/d30/d3b/f6b [354226,79118] 0 2024-02-15T22:41:13.035 INFO:tasks.workunit.client.1.smithi082.stdout:6/422: rename d2/d18/d23/d3c/d47/f59 to d2/d18/d23/d3c/d84/f87 0 2024-02-15T22:41:13.038 INFO:tasks.workunit.client.1.smithi082.stdout:7/271: dwrite d12/d27/f2f [0,4194304] 0 2024-02-15T22:41:13.039 INFO:tasks.workunit.client.1.smithi082.stdout:8/307: dwrite d1/d7/f62 [0,4194304] 0 2024-02-15T22:41:13.043 INFO:tasks.workunit.client.1.smithi082.stdout:6/423: dread d2/d18/d23/d3c/d47/f7b [0,4194304] 0 2024-02-15T22:41:13.043 INFO:tasks.workunit.client.1.smithi082.stdout:6/424: chown d2/d18/d23/d3c/d47/d69/l70 1925123509 1 2024-02-15T22:41:13.043 INFO:tasks.workunit.client.1.smithi082.stdout:6/425: write d2/f1e [2128077,49226] 0 2024-02-15T22:41:13.043 INFO:tasks.workunit.client.1.smithi082.stdout:6/426: fsync d2/d45/f56 0 2024-02-15T22:41:13.043 INFO:tasks.workunit.client.1.smithi082.stdout:6/427: chown d2/d18/d23/d3c/d84 39601 1 2024-02-15T22:41:13.043 INFO:tasks.workunit.client.1.smithi082.stdout:4/341: rmdir d0/d8/d1b/dd 39 2024-02-15T22:41:13.048 INFO:tasks.workunit.client.1.smithi082.stdout:4/342: dread d0/d16/d4a/f52 [0,4194304] 0 2024-02-15T22:41:13.052 INFO:tasks.workunit.client.1.smithi082.stdout:4/343: rename d0/d16/d4a/f5c to d0/f7b 0 2024-02-15T22:41:13.052 INFO:tasks.workunit.client.1.smithi082.stdout:4/344: chown d0/d8/d1b/f1d 5591957 1 2024-02-15T22:41:13.053 INFO:tasks.workunit.client.1.smithi082.stdout:6/428: rmdir d2/d18/d23 39 2024-02-15T22:41:13.054 INFO:tasks.workunit.client.1.smithi082.stdout:4/345: link d0/d8/d1b/f59 d0/d8/d32/d39/f7c 0 2024-02-15T22:41:13.056 INFO:tasks.workunit.client.1.smithi082.stdout:6/429: getdents d2/d30/d3b 0 2024-02-15T22:41:13.056 INFO:tasks.workunit.client.1.smithi082.stdout:6/430: creat d2/d18/d39/f88 x:0 0 0 2024-02-15T22:41:13.056 INFO:tasks.workunit.client.1.smithi082.stdout:6/431: chown d2/d18/d23/d3c/d47/d72/l74 1898 1 2024-02-15T22:41:13.057 INFO:tasks.workunit.client.1.smithi082.stdout:8/308: dwrite d1/f5 [4194304,4194304] 0 2024-02-15T22:41:13.057 INFO:tasks.workunit.client.1.smithi082.stdout:8/309: creat d1/d7/d48/f6e x:0 0 0 2024-02-15T22:41:13.057 INFO:tasks.workunit.client.1.smithi082.stdout:6/432: dread d2/d30/d3b/f6b [0,4194304] 0 2024-02-15T22:41:13.065 INFO:tasks.workunit.client.1.smithi082.stdout:8/310: dread d1/d7/d9/f17 [4194304,4194304] 0 2024-02-15T22:41:13.065 INFO:tasks.workunit.client.1.smithi082.stdout:8/311: fsync d1/f3a 0 2024-02-15T22:41:13.065 INFO:tasks.workunit.client.1.smithi082.stdout:8/312: fsync d1/d7/d9/f17 0 2024-02-15T22:41:13.065 INFO:tasks.workunit.client.1.smithi082.stdout:8/313: chown d1/d7/d9/d42/d6a/f6c 95114 1 2024-02-15T22:41:13.066 INFO:tasks.workunit.client.1.smithi082.stdout:4/346: dread d0/d8/d32/d39/f3f [0,4194304] 0 2024-02-15T22:41:13.067 INFO:tasks.workunit.client.1.smithi082.stdout:4/347: symlink d0/d16/l7d 0 2024-02-15T22:41:13.067 INFO:tasks.workunit.client.1.smithi082.stdout:4/348: write d0/f1 [1036773,13332] 0 2024-02-15T22:41:13.068 INFO:tasks.workunit.client.1.smithi082.stdout:4/349: mkdir d0/d8/d1b/d70/d7e 0 2024-02-15T22:41:13.068 INFO:tasks.workunit.client.1.smithi082.stdout:8/314: getdents d1/d7/d48 0 2024-02-15T22:41:13.070 INFO:tasks.workunit.client.1.smithi082.stdout:8/315: unlink d1/d7/d9/d42/l52 0 2024-02-15T22:41:13.070 INFO:tasks.workunit.client.1.smithi082.stdout:8/316: mkdir d1/d7/d48/d6f 0 2024-02-15T22:41:13.071 INFO:tasks.workunit.client.1.smithi082.stdout:8/317: symlink d1/l70 0 2024-02-15T22:41:13.072 INFO:tasks.workunit.client.1.smithi082.stdout:8/318: link d1/d7/d9/d42/l61 d1/d7/de/d1e/l71 0 2024-02-15T22:41:13.073 INFO:tasks.workunit.client.1.smithi082.stdout:8/319: dread d1/d7/de/f32 [0,4194304] 0 2024-02-15T22:41:13.075 INFO:tasks.workunit.client.1.smithi082.stdout:4/350: dread d0/d8/d32/d39/f3f [0,4194304] 0 2024-02-15T22:41:13.077 INFO:tasks.workunit.client.1.smithi082.stdout:4/351: creat d0/d8/d1b/d70/f7f x:0 0 0 2024-02-15T22:41:13.077 INFO:tasks.workunit.client.1.smithi082.stdout:4/352: write d0/d16/d4a/f58 [187451,16456] 0 2024-02-15T22:41:13.077 INFO:tasks.workunit.client.1.smithi082.stdout:4/353: creat d0/d8/f80 x:0 0 0 2024-02-15T22:41:13.079 INFO:tasks.workunit.client.1.smithi082.stdout:4/354: mknod d0/d8/d1b/dd/c81 0 2024-02-15T22:41:13.080 INFO:tasks.workunit.client.1.smithi082.stdout:4/355: mknod d0/d47/d4d/c82 0 2024-02-15T22:41:13.081 INFO:tasks.workunit.client.1.smithi082.stdout:4/356: unlink d0/d16/l61 0 2024-02-15T22:41:13.082 INFO:tasks.workunit.client.1.smithi082.stdout:4/357: mkdir d0/d16/d83 0 2024-02-15T22:41:13.088 INFO:tasks.workunit.client.1.smithi082.stdout:4/358: fsync d0/d8/d1b/d70/f7f 0 2024-02-15T22:41:13.097 INFO:tasks.workunit.client.1.smithi082.stdout:8/320: dwrite d1/f21 [0,4194304] 0 2024-02-15T22:41:13.097 INFO:tasks.workunit.client.1.smithi082.stdout:8/321: fsync d1/d7/d9/d24/d30/f66 0 2024-02-15T22:41:13.099 INFO:tasks.workunit.client.1.smithi082.stdout:8/322: mkdir d1/d7/d9/d24/d72 0 2024-02-15T22:41:13.099 INFO:tasks.workunit.client.1.smithi082.stdout:8/323: write d1/d7/d9/f17 [4613274,23977] 0 2024-02-15T22:41:13.110 INFO:tasks.workunit.client.1.smithi082.stdout:4/359: dwrite d0/d8/d1b/dd/f57 [0,4194304] 0 2024-02-15T22:41:13.113 INFO:tasks.workunit.client.1.smithi082.stdout:8/324: dwrite d1/d7/de/f32 [0,4194304] 0 2024-02-15T22:41:13.120 INFO:tasks.workunit.client.1.smithi082.stdout:8/325: write d1/d7/de/f32 [3778864,5919] 0 2024-02-15T22:41:13.120 INFO:tasks.workunit.client.1.smithi082.stdout:8/326: fdatasync d1/f1b 0 2024-02-15T22:41:13.121 INFO:tasks.workunit.client.1.smithi082.stdout:8/327: chown d1/d7/d9/f47 92149 1 2024-02-15T22:41:13.121 INFO:tasks.workunit.client.1.smithi082.stdout:8/328: write d1/d7/f54 [40302,14644] 0 2024-02-15T22:41:13.133 INFO:tasks.workunit.client.1.smithi082.stdout:4/360: dwrite d0/d16/f2b [0,4194304] 0 2024-02-15T22:41:13.139 INFO:tasks.workunit.client.1.smithi082.stdout:4/361: dread d0/d8/f34 [0,4194304] 0 2024-02-15T22:41:13.139 INFO:tasks.workunit.client.1.smithi082.stdout:8/329: dwrite d1/d7/de/f2f [0,4194304] 0 2024-02-15T22:41:13.140 INFO:tasks.workunit.client.1.smithi082.stdout:4/362: link d0/d16/l17 d0/d8/d32/d39/l84 0 2024-02-15T22:41:13.142 INFO:tasks.workunit.client.1.smithi082.stdout:8/330: mknod d1/d7/d9/d24/d30/c73 0 2024-02-15T22:41:13.143 INFO:tasks.workunit.client.1.smithi082.stdout:4/363: rename d0/d16/l7d to d0/d8/d1b/dd/l85 0 2024-02-15T22:41:13.144 INFO:tasks.workunit.client.1.smithi082.stdout:8/331: creat d1/d7/de/d57/f74 x:0 0 0 2024-02-15T22:41:13.151 INFO:tasks.workunit.client.1.smithi082.stdout:4/364: dread d0/d8/d32/d39/f7c [0,4194304] 0 2024-02-15T22:41:13.151 INFO:tasks.workunit.client.1.smithi082.stdout:4/365: chown d0/d8/d1b/dd/f57 0 1 2024-02-15T22:41:13.151 INFO:tasks.workunit.client.1.smithi082.stdout:4/366: fsync d0/d16/f2b 0 2024-02-15T22:41:13.152 INFO:tasks.workunit.client.1.smithi082.stdout:4/367: dread d0/d8/d1b/f35 [0,4194304] 0 2024-02-15T22:41:13.152 INFO:tasks.workunit.client.1.smithi082.stdout:4/368: readlink d0/d8/d1b/dd/l68 0 2024-02-15T22:41:13.153 INFO:tasks.workunit.client.1.smithi082.stdout:4/369: link d0/d8/d1b/dd/c81 d0/d47/c86 0 2024-02-15T22:41:13.153 INFO:tasks.workunit.client.1.smithi082.stdout:8/332: dread d1/d7/d9/d42/f49 [0,4194304] 0 2024-02-15T22:41:13.154 INFO:tasks.workunit.client.1.smithi082.stdout:8/333: mkdir d1/d7/d9/d24/d30/d75 0 2024-02-15T22:41:13.155 INFO:tasks.workunit.client.1.smithi082.stdout:8/334: readlink d1/l70 0 2024-02-15T22:41:13.155 INFO:tasks.workunit.client.1.smithi082.stdout:4/370: mkdir d0/d16/d87 0 2024-02-15T22:41:13.155 INFO:tasks.workunit.client.1.smithi082.stdout:4/371: dread - d0/d8/f80 zero size 2024-02-15T22:41:13.155 INFO:tasks.workunit.client.1.smithi082.stdout:4/372: truncate d0/d8/d1b/dd/ff 2413477 0 2024-02-15T22:41:13.156 INFO:tasks.workunit.client.1.smithi082.stdout:8/335: unlink d1/d7/d9/d24/d30/f66 0 2024-02-15T22:41:13.156 INFO:tasks.workunit.client.1.smithi082.stdout:4/373: creat d0/d47/d4d/f88 x:0 0 0 2024-02-15T22:41:13.157 INFO:tasks.workunit.client.1.smithi082.stdout:8/336: link d1/d7/de/d1e/f27 d1/d7/d9/d42/d6a/f76 0 2024-02-15T22:41:13.159 INFO:tasks.workunit.client.1.smithi082.stdout:4/374: link d0/d8/f3d d0/d47/f89 0 2024-02-15T22:41:13.159 INFO:tasks.workunit.client.1.smithi082.stdout:4/375: truncate d0/d8/d1b/f1d 2790072 0 2024-02-15T22:41:13.160 INFO:tasks.workunit.client.1.smithi082.stdout:8/337: symlink d1/d7/d9/l77 0 2024-02-15T22:41:13.162 INFO:tasks.workunit.client.1.smithi082.stdout:4/376: rmdir d0/d8/d1b/d70/d7e 0 2024-02-15T22:41:13.162 INFO:tasks.workunit.client.1.smithi082.stdout:4/377: creat d0/d46/f8a x:0 0 0 2024-02-15T22:41:13.162 INFO:tasks.workunit.client.1.smithi082.stdout:4/378: readlink d0/d8/d32/d39/l6f 0 2024-02-15T22:41:13.163 INFO:tasks.workunit.client.1.smithi082.stdout:4/379: dread - d0/d46/f79 zero size 2024-02-15T22:41:13.163 INFO:tasks.workunit.client.1.smithi082.stdout:4/380: chown d0/d16/f30 8949 1 2024-02-15T22:41:13.164 INFO:tasks.workunit.client.1.smithi082.stdout:8/338: fsync d1/d7/de/d57/f74 0 2024-02-15T22:41:13.166 INFO:tasks.workunit.client.1.smithi082.stdout:8/339: mkdir d1/d7/d78 0 2024-02-15T22:41:13.166 INFO:tasks.workunit.client.1.smithi082.stdout:8/340: truncate d1/f4f 886329 0 2024-02-15T22:41:13.167 INFO:tasks.workunit.client.1.smithi082.stdout:8/341: creat d1/d7/d9/d24/d72/f79 x:0 0 0 2024-02-15T22:41:13.168 INFO:tasks.workunit.client.1.smithi082.stdout:8/342: symlink d1/d7/de/d1e/l7a 0 2024-02-15T22:41:13.169 INFO:tasks.workunit.client.1.smithi082.stdout:8/343: fdatasync d1/d40/f6d 0 2024-02-15T22:41:13.169 INFO:tasks.workunit.client.1.smithi082.stdout:8/344: dread - d1/d7/de/d57/f74 zero size 2024-02-15T22:41:13.171 INFO:tasks.workunit.client.1.smithi082.stdout:8/345: dread d1/d7/de/f2e [0,4194304] 0 2024-02-15T22:41:13.171 INFO:tasks.workunit.client.1.smithi082.stdout:8/346: getdents d1/d7/d9/d24/d30/d75 0 2024-02-15T22:41:13.173 INFO:tasks.workunit.client.1.smithi082.stdout:4/381: fsync d0/d46/f8a 0 2024-02-15T22:41:13.173 INFO:tasks.workunit.client.1.smithi082.stdout:4/382: chown d0/d8/d1b/l26 0 1 2024-02-15T22:41:13.174 INFO:tasks.workunit.client.1.smithi082.stdout:4/383: unlink d0/d8/f65 0 2024-02-15T22:41:13.174 INFO:tasks.workunit.client.1.smithi082.stdout:4/384: fdatasync d0/d16/d4a/f52 0 2024-02-15T22:41:13.175 INFO:tasks.workunit.client.1.smithi082.stdout:4/385: creat d0/d16/f8b x:0 0 0 2024-02-15T22:41:13.176 INFO:tasks.workunit.client.1.smithi082.stdout:3/275: sync 2024-02-15T22:41:13.176 INFO:tasks.workunit.client.1.smithi082.stdout:9/325: sync 2024-02-15T22:41:13.176 INFO:tasks.workunit.client.1.smithi082.stdout:3/276: fsync d0/f46 0 2024-02-15T22:41:13.178 INFO:tasks.workunit.client.1.smithi082.stdout:9/326: rename d8/d12/d33/d3e/f48 to d8/d24/d2e/d53/f59 0 2024-02-15T22:41:13.178 INFO:tasks.workunit.client.1.smithi082.stdout:9/327: read d8/f18 [2435221,115722] 0 2024-02-15T22:41:13.180 INFO:tasks.workunit.client.1.smithi082.stdout:3/277: symlink d0/d19/d14/d21/d41/l57 0 2024-02-15T22:41:13.185 INFO:tasks.workunit.client.1.smithi082.stdout:8/347: write d1/f5 [5942503,44594] 0 2024-02-15T22:41:13.186 INFO:tasks.workunit.client.1.smithi082.stdout:8/348: mknod d1/d7/d9/d24/d30/c7b 0 2024-02-15T22:41:13.187 INFO:tasks.workunit.client.1.smithi082.stdout:8/349: mknod d1/d7/d48/d6f/c7c 0 2024-02-15T22:41:13.189 INFO:tasks.workunit.client.1.smithi082.stdout:8/350: symlink d1/d7/d9/d24/l7d 0 2024-02-15T22:41:13.197 INFO:tasks.workunit.client.1.smithi082.stdout:3/278: write d0/dc/d3f/f49 [1148224,59191] 0 2024-02-15T22:41:13.198 INFO:tasks.workunit.client.1.smithi082.stdout:4/386: dwrite d0/f54 [0,4194304] 0 2024-02-15T22:41:13.199 INFO:tasks.workunit.client.1.smithi082.stdout:3/279: link d0/f33 d0/d19/d14/d21/f58 0 2024-02-15T22:41:13.201 INFO:tasks.workunit.client.1.smithi082.stdout:4/387: symlink d0/d8/d1b/d70/l8c 0 2024-02-15T22:41:13.201 INFO:tasks.workunit.client.1.smithi082.stdout:4/388: dread - d0/d46/f79 zero size 2024-02-15T22:41:13.201 INFO:tasks.workunit.client.1.smithi082.stdout:4/389: creat d0/d8/d1b/f8d x:0 0 0 2024-02-15T22:41:13.201 INFO:tasks.workunit.client.1.smithi082.stdout:3/280: creat d0/d19/d2e/d4c/f59 x:0 0 0 2024-02-15T22:41:13.202 INFO:tasks.workunit.client.1.smithi082.stdout:4/390: creat d0/d16/d87/f8e x:0 0 0 2024-02-15T22:41:13.203 INFO:tasks.workunit.client.1.smithi082.stdout:3/281: symlink d0/l5a 0 2024-02-15T22:41:13.203 INFO:tasks.workunit.client.1.smithi082.stdout:3/282: creat d0/d19/f5b x:0 0 0 2024-02-15T22:41:13.204 INFO:tasks.workunit.client.1.smithi082.stdout:4/391: creat d0/d16/f8f x:0 0 0 2024-02-15T22:41:13.204 INFO:tasks.workunit.client.1.smithi082.stdout:4/392: dread - d0/d8/d1b/d70/f7f zero size 2024-02-15T22:41:13.204 INFO:tasks.workunit.client.1.smithi082.stdout:9/328: dwrite f5 [0,4194304] 0 2024-02-15T22:41:13.204 INFO:tasks.workunit.client.1.smithi082.stdout:8/351: dwrite d1/d7/de/ff [0,4194304] 0 2024-02-15T22:41:13.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/329: write d8/f2b [4256938,36330] 0 2024-02-15T22:41:13.209 INFO:tasks.workunit.client.1.smithi082.stdout:8/352: rename d1/d7/d9/d24/f69 to d1/d7/d9/d42/f7e 0 2024-02-15T22:41:13.210 INFO:tasks.workunit.client.1.smithi082.stdout:8/353: chown d1/d7/d48/d6f/c7c 46437 1 2024-02-15T22:41:13.210 INFO:tasks.workunit.client.1.smithi082.stdout:8/354: write d1/d7/de/f32 [2063126,64877] 0 2024-02-15T22:41:13.210 INFO:tasks.workunit.client.1.smithi082.stdout:8/355: creat d1/d7/d9/d24/d30/f7f x:0 0 0 2024-02-15T22:41:13.210 INFO:tasks.workunit.client.1.smithi082.stdout:8/356: creat d1/d7/de/f80 x:0 0 0 2024-02-15T22:41:13.212 INFO:tasks.workunit.client.1.smithi082.stdout:9/330: symlink d8/d24/d2e/l5a 0 2024-02-15T22:41:13.212 INFO:tasks.workunit.client.1.smithi082.stdout:9/331: truncate d8/f58 1031759 0 2024-02-15T22:41:13.212 INFO:tasks.workunit.client.1.smithi082.stdout:8/357: dread d1/d7/de/d1e/f39 [0,4194304] 0 2024-02-15T22:41:13.212 INFO:tasks.workunit.client.1.smithi082.stdout:8/358: write d1/d7/d9/d24/d30/f4b [52151,107480] 0 2024-02-15T22:41:13.215 INFO:tasks.workunit.client.1.smithi082.stdout:9/332: creat d8/d12/d33/d3e/f5b x:0 0 0 2024-02-15T22:41:13.215 INFO:tasks.workunit.client.1.smithi082.stdout:9/333: truncate d8/d12/f1d 6326081 0 2024-02-15T22:41:13.215 INFO:tasks.workunit.client.1.smithi082.stdout:9/334: fsync d8/d12/f1e 0 2024-02-15T22:41:13.215 INFO:tasks.workunit.client.1.smithi082.stdout:9/335: chown d8/d24/d2e 1 1 2024-02-15T22:41:13.217 INFO:tasks.workunit.client.1.smithi082.stdout:9/336: symlink d8/d24/l5c 0 2024-02-15T22:41:13.217 INFO:tasks.workunit.client.1.smithi082.stdout:9/337: fsync d8/d12/f4d 0 2024-02-15T22:41:13.218 INFO:tasks.workunit.client.1.smithi082.stdout:9/338: fdatasync d8/d24/d2e/f47 0 2024-02-15T22:41:13.218 INFO:tasks.workunit.client.1.smithi082.stdout:9/339: write d8/d24/d2e/f47 [3512879,64718] 0 2024-02-15T22:41:13.218 INFO:tasks.workunit.client.1.smithi082.stdout:4/393: read d0/f31 [2300940,20177] 0 2024-02-15T22:41:13.218 INFO:tasks.workunit.client.1.smithi082.stdout:9/340: creat d8/d12/d33/d3e/f5d x:0 0 0 2024-02-15T22:41:13.218 INFO:tasks.workunit.client.1.smithi082.stdout:9/341: write d8/d12/d33/d3e/f5d [531924,1453] 0 2024-02-15T22:41:13.219 INFO:tasks.workunit.client.1.smithi082.stdout:4/394: rename d0/d16/d4a/f58 to d0/d47/f90 0 2024-02-15T22:41:13.219 INFO:tasks.workunit.client.1.smithi082.stdout:4/395: write d0/f31 [2917621,8371] 0 2024-02-15T22:41:13.220 INFO:tasks.workunit.client.1.smithi082.stdout:3/283: dwrite d0/d16/f32 [0,4194304] 0 2024-02-15T22:41:13.220 INFO:tasks.workunit.client.1.smithi082.stdout:3/284: creat d0/dc/f5c x:0 0 0 2024-02-15T22:41:13.220 INFO:tasks.workunit.client.1.smithi082.stdout:4/396: creat d0/d16/d4a/d6a/f91 x:0 0 0 2024-02-15T22:41:13.220 INFO:tasks.workunit.client.1.smithi082.stdout:4/397: readlink d0/d8/d32/l77 0 2024-02-15T22:41:13.223 INFO:tasks.workunit.client.1.smithi082.stdout:3/285: symlink d0/d19/d14/d21/l5d 0 2024-02-15T22:41:13.224 INFO:tasks.workunit.client.1.smithi082.stdout:4/398: symlink d0/d8/d1b/d70/l92 0 2024-02-15T22:41:13.225 INFO:tasks.workunit.client.1.smithi082.stdout:4/399: dread - d0/d46/f79 zero size 2024-02-15T22:41:13.227 INFO:tasks.workunit.client.1.smithi082.stdout:3/286: rename d0/d19/d14/d21/d41/l57 to d0/dc/l5e 0 2024-02-15T22:41:13.228 INFO:tasks.workunit.client.1.smithi082.stdout:4/400: mknod d0/d8/d1b/c93 0 2024-02-15T22:41:13.229 INFO:tasks.workunit.client.1.smithi082.stdout:9/342: dread d8/d24/d2e/f46 [0,4194304] 0 2024-02-15T22:41:13.229 INFO:tasks.workunit.client.1.smithi082.stdout:3/287: creat d0/d16/d3e/f5f x:0 0 0 2024-02-15T22:41:13.230 INFO:tasks.workunit.client.1.smithi082.stdout:3/288: write d0/f2 [4102327,57575] 0 2024-02-15T22:41:13.231 INFO:tasks.workunit.client.1.smithi082.stdout:8/359: dwrite d1/d7/f54 [0,4194304] 0 2024-02-15T22:41:13.232 INFO:tasks.workunit.client.1.smithi082.stdout:4/401: unlink d0/d8/d1b/c43 0 2024-02-15T22:41:13.241 INFO:tasks.workunit.client.1.smithi082.stdout:9/343: dread d8/d12/d33/f39 [0,4194304] 0 2024-02-15T22:41:13.241 INFO:tasks.workunit.client.1.smithi082.stdout:9/344: readlink d8/d24/l5c 0 2024-02-15T22:41:13.252 INFO:tasks.workunit.client.1.smithi082.stdout:8/360: creat d1/d7/d9/f81 x:0 0 0 2024-02-15T22:41:13.253 INFO:tasks.workunit.client.1.smithi082.stdout:4/402: mknod d0/d8/d32/d39/c94 0 2024-02-15T22:41:13.255 INFO:tasks.workunit.client.1.smithi082.stdout:9/345: truncate d8/f2c 1427449 0 2024-02-15T22:41:13.257 INFO:tasks.workunit.client.1.smithi082.stdout:8/361: mknod d1/d7/de/d1e/c82 0 2024-02-15T22:41:13.263 INFO:tasks.workunit.client.1.smithi082.stdout:3/289: getdents d0/d16/d3e 0 2024-02-15T22:41:13.264 INFO:tasks.workunit.client.1.smithi082.stdout:3/290: read d0/d19/d14/f40 [308092,19154] 0 2024-02-15T22:41:13.267 INFO:tasks.workunit.client.1.smithi082.stdout:4/403: dread d0/d8/f2e [0,4194304] 0 2024-02-15T22:41:13.267 INFO:tasks.workunit.client.1.smithi082.stdout:4/404: creat d0/d8/f95 x:0 0 0 2024-02-15T22:41:13.268 INFO:tasks.workunit.client.1.smithi082.stdout:3/291: rename d0/dc/d3f/l4f to d0/d19/d2e/d4c/l60 0 2024-02-15T22:41:13.270 INFO:tasks.workunit.client.1.smithi082.stdout:4/405: mknod d0/d47/c96 0 2024-02-15T22:41:13.270 INFO:tasks.workunit.client.1.smithi082.stdout:4/406: dread - d0/d46/f8a zero size 2024-02-15T22:41:13.271 INFO:tasks.workunit.client.1.smithi082.stdout:3/292: symlink d0/d16/d3e/d56/l61 0 2024-02-15T22:41:13.275 INFO:tasks.workunit.client.1.smithi082.stdout:2/370: sync 2024-02-15T22:41:13.277 INFO:tasks.workunit.client.1.smithi082.stdout:2/371: mknod d6/dc/dd/c7d 0 2024-02-15T22:41:13.279 INFO:tasks.workunit.client.1.smithi082.stdout:2/372: rmdir d6/dc/d12/d46/d4b/d63 39 2024-02-15T22:41:13.279 INFO:tasks.workunit.client.1.smithi082.stdout:2/373: readlink d6/dc/d12/l32 0 2024-02-15T22:41:13.279 INFO:tasks.workunit.client.1.smithi082.stdout:2/374: creat d6/dc/d58/f7e x:0 0 0 2024-02-15T22:41:13.279 INFO:tasks.workunit.client.1.smithi082.stdout:8/362: dwrite d1/d7/d9/d42/d6a/f6c [0,4194304] 0 2024-02-15T22:41:13.280 INFO:tasks.workunit.client.1.smithi082.stdout:2/375: dread d6/d18/f37 [0,4194304] 0 2024-02-15T22:41:13.282 INFO:tasks.workunit.client.1.smithi082.stdout:2/376: write d6/dc/d12/d46/d4b/f69 [186832,25623] 0 2024-02-15T22:41:13.282 INFO:tasks.workunit.client.1.smithi082.stdout:2/377: chown d6/dc/dd/d24/d71 225581229 1 2024-02-15T22:41:13.287 INFO:tasks.workunit.client.1.smithi082.stdout:2/378: creat d6/dc/d12/d46/f7f x:0 0 0 2024-02-15T22:41:13.287 INFO:tasks.workunit.client.1.smithi082.stdout:3/293: dread d0/d19/d14/d21/f3d [0,4194304] 0 2024-02-15T22:41:13.288 INFO:tasks.workunit.client.1.smithi082.stdout:3/294: write d0/d19/fe [4422237,111726] 0 2024-02-15T22:41:13.288 INFO:tasks.workunit.client.1.smithi082.stdout:3/295: dread - d0/d19/d2e/d4c/f59 zero size 2024-02-15T22:41:13.292 INFO:tasks.workunit.client.1.smithi082.stdout:2/379: dread d6/dc/d58/f17 [0,4194304] 0 2024-02-15T22:41:13.292 INFO:tasks.workunit.client.1.smithi082.stdout:2/380: chown d6/dc/dd/d24/f39 860 1 2024-02-15T22:41:13.298 INFO:tasks.workunit.client.1.smithi082.stdout:3/296: rename d0/d19 to d0/d16/d62 0 2024-02-15T22:41:13.301 INFO:tasks.workunit.client.1.smithi082.stdout:8/363: dwrite d1/d7/d9/d24/d72/f79 [0,4194304] 0 2024-02-15T22:41:13.301 INFO:tasks.workunit.client.1.smithi082.stdout:8/364: fdatasync d1/f5 0 2024-02-15T22:41:13.307 INFO:tasks.workunit.client.1.smithi082.stdout:8/365: getdents d1/d7/de/d1e 0 2024-02-15T22:41:13.307 INFO:tasks.workunit.client.1.smithi082.stdout:2/381: dread d6/dc/d12/f74 [0,4194304] 0 2024-02-15T22:41:13.308 INFO:tasks.workunit.client.1.smithi082.stdout:2/382: fsync d6/dc/dd/d1d/f57 0 2024-02-15T22:41:13.311 INFO:tasks.workunit.client.1.smithi082.stdout:2/383: unlink d6/dc/dd/f5b 0 2024-02-15T22:41:13.313 INFO:tasks.workunit.client.1.smithi082.stdout:2/384: link d6/d18/l33 d6/l80 0 2024-02-15T22:41:13.326 INFO:tasks.workunit.client.1.smithi082.stdout:3/297: dwrite d0/dc/d3f/f49 [4194304,4194304] 0 2024-02-15T22:41:13.328 INFO:tasks.workunit.client.1.smithi082.stdout:3/298: rename d0/d16/d62/c2c to d0/d16/d62/c63 0 2024-02-15T22:41:13.328 INFO:tasks.workunit.client.1.smithi082.stdout:2/385: write d6/dc/f10 [8211006,85061] 0 2024-02-15T22:41:13.330 INFO:tasks.workunit.client.1.smithi082.stdout:2/386: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:13.331 INFO:tasks.workunit.client.1.smithi082.stdout:8/366: dwrite d1/d7/de/d57/f74 [0,4194304] 0 2024-02-15T22:41:13.334 INFO:tasks.workunit.client.1.smithi082.stdout:2/387: link d6/dc/d58/d49/l5f d6/dc/d12/l81 0 2024-02-15T22:41:13.334 INFO:tasks.workunit.client.1.smithi082.stdout:2/388: chown d6/dc/dd/d1d/l2d 34021 1 2024-02-15T22:41:13.334 INFO:tasks.workunit.client.1.smithi082.stdout:2/389: write d6/d3c/f6d [3601712,130413] 0 2024-02-15T22:41:13.339 INFO:tasks.workunit.client.1.smithi082.stdout:8/367: getdents d1/d7/d9/d50/d56 0 2024-02-15T22:41:13.341 INFO:tasks.workunit.client.1.smithi082.stdout:8/368: truncate d1/d7/d9/f17 4091955 0 2024-02-15T22:41:13.341 INFO:tasks.workunit.client.1.smithi082.stdout:8/369: write d1/d7/d9/d42/d6a/f76 [640748,27218] 0 2024-02-15T22:41:13.342 INFO:tasks.workunit.client.1.smithi082.stdout:8/370: truncate d1/d7/d9/d50/f67 3801407 0 2024-02-15T22:41:13.345 INFO:tasks.workunit.client.1.smithi082.stdout:8/371: rmdir d1/d7/d9/d42/d6a 39 2024-02-15T22:41:13.345 INFO:tasks.workunit.client.1.smithi082.stdout:8/372: fdatasync d1/d7/d9/d24/d30/f7f 0 2024-02-15T22:41:13.345 INFO:tasks.workunit.client.1.smithi082.stdout:8/373: truncate d1/d7/de/f80 686013 0 2024-02-15T22:41:13.346 INFO:tasks.workunit.client.1.smithi082.stdout:3/299: dread d0/d16/f12 [4194304,4194304] 0 2024-02-15T22:41:13.347 INFO:tasks.workunit.client.1.smithi082.stdout:3/300: creat d0/d16/d62/d2e/d4c/f64 x:0 0 0 2024-02-15T22:41:13.347 INFO:tasks.workunit.client.1.smithi082.stdout:3/301: readlink d0/l5a 0 2024-02-15T22:41:13.348 INFO:tasks.workunit.client.1.smithi082.stdout:3/302: write d0/d16/d62/f50 [230175,99251] 0 2024-02-15T22:41:13.352 INFO:tasks.workunit.client.1.smithi082.stdout:8/374: dread d1/d7/d9/f47 [0,4194304] 0 2024-02-15T22:41:13.353 INFO:tasks.workunit.client.1.smithi082.stdout:8/375: rmdir d1/d7/d9/d50 39 2024-02-15T22:41:13.355 INFO:tasks.workunit.client.1.smithi082.stdout:8/376: rename d1/d7/c3f to d1/d7/c83 0 2024-02-15T22:41:13.358 INFO:tasks.workunit.client.1.smithi082.stdout:8/377: link d1/d7/d48/l35 d1/d7/de/l84 0 2024-02-15T22:41:13.359 INFO:tasks.workunit.client.1.smithi082.stdout:8/378: mkdir d1/d7/d9/d24/d43/d85 0 2024-02-15T22:41:13.360 INFO:tasks.workunit.client.1.smithi082.stdout:8/379: creat d1/d7/d9/f86 x:0 0 0 2024-02-15T22:41:13.362 INFO:tasks.workunit.client.1.smithi082.stdout:8/380: rename d1/d7/d9/d24/d30/c73 to d1/d7/d9/d42/c87 0 2024-02-15T22:41:13.362 INFO:tasks.workunit.client.1.smithi082.stdout:8/381: creat d1/d7/d9/d24/d72/f88 x:0 0 0 2024-02-15T22:41:13.362 INFO:tasks.workunit.client.1.smithi082.stdout:8/382: chown d1/l1f 43342791 1 2024-02-15T22:41:13.363 INFO:tasks.workunit.client.1.smithi082.stdout:2/390: dwrite d6/dc/d58/fe [4194304,4194304] 0 2024-02-15T22:41:13.363 INFO:tasks.workunit.client.1.smithi082.stdout:2/391: dread - d6/dc/d12/d46/f7f zero size 2024-02-15T22:41:13.376 INFO:tasks.workunit.client.1.smithi082.stdout:3/303: dread d0/d16/d62/f50 [0,4194304] 0 2024-02-15T22:41:13.378 INFO:tasks.workunit.client.1.smithi082.stdout:3/304: link d0/f4e d0/dc/d3f/f65 0 2024-02-15T22:41:13.379 INFO:tasks.workunit.client.1.smithi082.stdout:3/305: mknod d0/d16/d3e/c66 0 2024-02-15T22:41:13.379 INFO:tasks.workunit.client.1.smithi082.stdout:3/306: chown d0/d16/la 116647950 1 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:1/352: sync 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:5/317: sync 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:1/353: stat d1/f47 0 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:1/354: dread - d1/da/d14/d18/d1f/f66 zero size 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:1/355: chown d1/da/d14/f2d 2091446 1 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:1/356: chown d1/f3d 1788214 1 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:5/318: mkdir d5/da/d67 0 2024-02-15T22:41:13.388 INFO:tasks.workunit.client.1.smithi082.stdout:5/319: read d5/f39 [363784,19632] 0 2024-02-15T22:41:13.389 INFO:tasks.workunit.client.1.smithi082.stdout:5/320: link d5/da/dc/d43/f4d d5/da/d67/f68 0 2024-02-15T22:41:13.389 INFO:tasks.workunit.client.1.smithi082.stdout:5/321: readlink d5/da/dc/d43/l62 0 2024-02-15T22:41:13.389 INFO:tasks.workunit.client.1.smithi082.stdout:5/322: write d5/da/f65 [849617,10764] 0 2024-02-15T22:41:13.393 INFO:tasks.workunit.client.1.smithi082.stdout:8/383: dwrite d1/d7/de/f32 [4194304,4194304] 0 2024-02-15T22:41:13.393 INFO:tasks.workunit.client.1.smithi082.stdout:8/384: write d1/d7/d9/d24/d72/f88 [139371,52141] 0 2024-02-15T22:41:13.393 INFO:tasks.workunit.client.1.smithi082.stdout:8/385: stat d1/c28 0 2024-02-15T22:41:13.393 INFO:tasks.workunit.client.1.smithi082.stdout:5/323: dread d5/da/f3c [0,4194304] 0 2024-02-15T22:41:13.397 INFO:tasks.workunit.client.1.smithi082.stdout:5/324: rmdir d5/da/d14 39 2024-02-15T22:41:13.397 INFO:tasks.workunit.client.1.smithi082.stdout:3/307: dread d0/d16/d62/f25 [0,4194304] 0 2024-02-15T22:41:13.397 INFO:tasks.workunit.client.1.smithi082.stdout:3/308: chown d0/d16/d62/f5b 62 1 2024-02-15T22:41:13.398 INFO:tasks.workunit.client.1.smithi082.stdout:5/325: write d5/f4b [29746,74383] 0 2024-02-15T22:41:13.398 INFO:tasks.workunit.client.1.smithi082.stdout:3/309: creat d0/d16/d62/d14/d21/d41/f67 x:0 0 0 2024-02-15T22:41:13.400 INFO:tasks.workunit.client.1.smithi082.stdout:5/326: mknod d5/da/d14/d45/d52/c69 0 2024-02-15T22:41:13.401 INFO:tasks.workunit.client.1.smithi082.stdout:3/310: mknod d0/d16/d3e/d56/c68 0 2024-02-15T22:41:13.401 INFO:tasks.workunit.client.1.smithi082.stdout:3/311: fdatasync d0/dc/d3f/f49 0 2024-02-15T22:41:13.403 INFO:tasks.workunit.client.1.smithi082.stdout:8/386: dread d1/d7/de/d1e/f39 [0,4194304] 0 2024-02-15T22:41:13.405 INFO:tasks.workunit.client.1.smithi082.stdout:5/327: rename d5/da/d14/l44 to d5/da/d22/d59/l6a 0 2024-02-15T22:41:13.406 INFO:tasks.workunit.client.1.smithi082.stdout:3/312: unlink d0/dc/d3f/l47 0 2024-02-15T22:41:13.406 INFO:tasks.workunit.client.1.smithi082.stdout:3/313: write d0/d16/f4a [194996,24457] 0 2024-02-15T22:41:13.406 INFO:tasks.workunit.client.1.smithi082.stdout:3/314: chown d0/d16/d62/c34 672 1 2024-02-15T22:41:13.406 INFO:tasks.workunit.client.1.smithi082.stdout:3/315: chown d0/d16/d62/fe 4005 1 2024-02-15T22:41:13.409 INFO:tasks.workunit.client.1.smithi082.stdout:5/328: rename d5/f3b to d5/da/d14/d45/f6b 0 2024-02-15T22:41:13.409 INFO:tasks.workunit.client.1.smithi082.stdout:5/329: stat d5/da/dc/d43 0 2024-02-15T22:41:13.409 INFO:tasks.workunit.client.1.smithi082.stdout:5/330: stat d5/f39 0 2024-02-15T22:41:13.410 INFO:tasks.workunit.client.1.smithi082.stdout:3/316: mkdir d0/d16/d62/d14/d21/d69 0 2024-02-15T22:41:13.411 INFO:tasks.workunit.client.1.smithi082.stdout:1/357: dwrite d1/da/d14/d18/f3a [0,4194304] 0 2024-02-15T22:41:13.413 INFO:tasks.workunit.client.1.smithi082.stdout:3/317: symlink d0/d16/d3e/d56/l6a 0 2024-02-15T22:41:13.413 INFO:tasks.workunit.client.1.smithi082.stdout:3/318: stat d0/d16/d62/f50 0 2024-02-15T22:41:13.413 INFO:tasks.workunit.client.1.smithi082.stdout:3/319: dread - d0/dc/f5c zero size 2024-02-15T22:41:13.415 INFO:tasks.workunit.client.1.smithi082.stdout:1/358: mknod d1/da/d14/d18/d51/c72 0 2024-02-15T22:41:13.415 INFO:tasks.workunit.client.1.smithi082.stdout:1/359: creat d1/da/d14/d18/d51/f73 x:0 0 0 2024-02-15T22:41:13.418 INFO:tasks.workunit.client.1.smithi082.stdout:1/360: link d1/da/d11/f16 d1/f74 0 2024-02-15T22:41:13.420 INFO:tasks.workunit.client.1.smithi082.stdout:1/361: write d1/f3d [2193682,41469] 0 2024-02-15T22:41:13.429 INFO:tasks.workunit.client.1.smithi082.stdout:3/320: getdents d0/d16/d3e/d56 0 2024-02-15T22:41:13.443 INFO:tasks.workunit.client.1.smithi082.stdout:3/321: dread d0/d16/d62/f25 [4194304,4194304] 0 2024-02-15T22:41:13.444 INFO:tasks.workunit.client.1.smithi082.stdout:3/322: rename d0/c37 to d0/d16/d62/d14/d21/d69/c6b 0 2024-02-15T22:41:13.445 INFO:tasks.workunit.client.1.smithi082.stdout:5/331: dwrite d5/f4b [0,4194304] 0 2024-02-15T22:41:13.446 INFO:tasks.workunit.client.1.smithi082.stdout:3/323: mkdir d0/d16/d62/d14/d21/d69/d6c 0 2024-02-15T22:41:13.446 INFO:tasks.workunit.client.1.smithi082.stdout:3/324: fsync d0/d16/d62/f5b 0 2024-02-15T22:41:13.446 INFO:tasks.workunit.client.1.smithi082.stdout:8/387: dwrite d1/d7/d9/d24/d72/f88 [0,4194304] 0 2024-02-15T22:41:13.447 INFO:tasks.workunit.client.1.smithi082.stdout:8/388: write d1/f14 [3463783,107903] 0 2024-02-15T22:41:13.448 INFO:tasks.workunit.client.1.smithi082.stdout:5/332: mknod d5/da/c6c 0 2024-02-15T22:41:13.450 INFO:tasks.workunit.client.1.smithi082.stdout:8/389: unlink d1/d7/de/c2c 0 2024-02-15T22:41:13.452 INFO:tasks.workunit.client.1.smithi082.stdout:8/390: symlink d1/d40/l89 0 2024-02-15T22:41:13.452 INFO:tasks.workunit.client.1.smithi082.stdout:8/391: write d1/d7/d48/f64 [972412,98706] 0 2024-02-15T22:41:13.452 INFO:tasks.workunit.client.1.smithi082.stdout:8/392: creat d1/d7/d9/d24/f8a x:0 0 0 2024-02-15T22:41:13.462 INFO:tasks.workunit.client.1.smithi082.stdout:5/333: dread d5/da/d14/f4e [0,4194304] 0 2024-02-15T22:41:13.466 INFO:tasks.workunit.client.1.smithi082.stdout:5/334: dread d5/da/f26 [0,4194304] 0 2024-02-15T22:41:13.466 INFO:tasks.workunit.client.1.smithi082.stdout:5/335: write d5/da/f26 [727326,4266] 0 2024-02-15T22:41:13.468 INFO:tasks.workunit.client.1.smithi082.stdout:5/336: creat d5/da/dc/f6d x:0 0 0 2024-02-15T22:41:13.470 INFO:tasks.workunit.client.1.smithi082.stdout:8/393: dread d1/d7/f54 [0,4194304] 0 2024-02-15T22:41:13.470 INFO:tasks.workunit.client.1.smithi082.stdout:3/325: dwrite d0/d16/d62/f36 [0,4194304] 0 2024-02-15T22:41:13.470 INFO:tasks.workunit.client.1.smithi082.stdout:8/394: creat d1/d7/d9/d42/f8b x:0 0 0 2024-02-15T22:41:13.470 INFO:tasks.workunit.client.1.smithi082.stdout:8/395: fdatasync d1/d7/d9/d24/d30/f7f 0 2024-02-15T22:41:13.470 INFO:tasks.workunit.client.1.smithi082.stdout:8/396: write d1/d7/d9/d24/d30/f3c [2601488,69682] 0 2024-02-15T22:41:13.470 INFO:tasks.workunit.client.1.smithi082.stdout:8/397: stat d1/d7/d9/d24/d30/d75 0 2024-02-15T22:41:13.473 INFO:tasks.workunit.client.1.smithi082.stdout:3/326: creat d0/d16/d62/f6d x:0 0 0 2024-02-15T22:41:13.474 INFO:tasks.workunit.client.1.smithi082.stdout:8/398: truncate d1/f18 1207747 0 2024-02-15T22:41:13.476 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:13 smithi033 ceph-mon[29033]: pgmap v19: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 137 MiB/s rd, 197 MiB/s wr, 681 op/s 2024-02-15T22:41:13.485 INFO:tasks.workunit.client.1.smithi082.stdout:3/327: mknod d0/dc/d3f/c6e 0 2024-02-15T22:41:13.486 INFO:tasks.workunit.client.1.smithi082.stdout:8/399: mknod d1/d7/d9/d42/c8c 0 2024-02-15T22:41:13.486 INFO:tasks.workunit.client.1.smithi082.stdout:8/400: fsync d1/d7/d9/d24/d30/f4b 0 2024-02-15T22:41:13.486 INFO:tasks.workunit.client.1.smithi082.stdout:8/401: symlink d1/l8d 0 2024-02-15T22:41:13.487 INFO:tasks.workunit.client.1.smithi082.stdout:8/402: mkdir d1/d7/d9/d42/d6a/d8e 0 2024-02-15T22:41:13.488 INFO:tasks.workunit.client.1.smithi082.stdout:8/403: symlink d1/d7/d9/d42/d6a/l8f 0 2024-02-15T22:41:13.489 INFO:tasks.workunit.client.1.smithi082.stdout:8/404: creat d1/d7/d9/d42/d6a/d8e/f90 x:0 0 0 2024-02-15T22:41:13.490 INFO:tasks.workunit.client.1.smithi082.stdout:7/272: sync 2024-02-15T22:41:13.490 INFO:tasks.workunit.client.1.smithi082.stdout:6/433: sync 2024-02-15T22:41:13.490 INFO:tasks.workunit.client.1.smithi082.stdout:9/346: sync 2024-02-15T22:41:13.490 INFO:tasks.workunit.client.1.smithi082.stdout:0/325: sync 2024-02-15T22:41:13.490 INFO:tasks.workunit.client.1.smithi082.stdout:7/273: chown d12/d3b/d41 196102 1 2024-02-15T22:41:13.490 INFO:tasks.workunit.client.1.smithi082.stdout:6/434: write d2/d18/d23/d3c/d47/f7b [1780080,25505] 0 2024-02-15T22:41:13.492 INFO:tasks.workunit.client.1.smithi082.stdout:0/326: truncate d3/d19/d20/d26/f53 135355 0 2024-02-15T22:41:13.494 INFO:tasks.workunit.client.1.smithi082.stdout:3/328: read d0/f43 [3136130,9297] 0 2024-02-15T22:41:13.494 INFO:tasks.workunit.client.1.smithi082.stdout:3/329: creat d0/f6f x:0 0 0 2024-02-15T22:41:13.495 INFO:tasks.workunit.client.1.smithi082.stdout:7/274: rename d12/d17/f23 to d12/d17/d3d/f59 0 2024-02-15T22:41:13.496 INFO:tasks.workunit.client.1.smithi082.stdout:6/435: mknod d2/d18/c89 0 2024-02-15T22:41:13.496 INFO:tasks.workunit.client.1.smithi082.stdout:6/436: chown d2/d18/d23/d67/f71 1006185780 1 2024-02-15T22:41:13.498 INFO:tasks.workunit.client.1.smithi082.stdout:0/327: truncate d3/d19/d25/d45/f55 689318 0 2024-02-15T22:41:13.499 INFO:tasks.workunit.client.1.smithi082.stdout:9/347: dread d8/f1c [0,4194304] 0 2024-02-15T22:41:13.502 INFO:tasks.workunit.client.1.smithi082.stdout:3/330: link d0/f33 d0/d16/d62/d2e/f70 0 2024-02-15T22:41:13.502 INFO:tasks.workunit.client.1.smithi082.stdout:3/331: getdents d0/d16/d3e/d56 0 2024-02-15T22:41:13.502 INFO:tasks.workunit.client.1.smithi082.stdout:3/332: write d0/f43 [2089016,106409] 0 2024-02-15T22:41:13.502 INFO:tasks.workunit.client.1.smithi082.stdout:3/333: write d0/f4e [52324,66647] 0 2024-02-15T22:41:13.502 INFO:tasks.workunit.client.1.smithi082.stdout:3/334: fsync d0/d16/d62/d14/f2a 0 2024-02-15T22:41:13.503 INFO:tasks.workunit.client.1.smithi082.stdout:7/275: mkdir d12/d3b/d5a 0 2024-02-15T22:41:13.504 INFO:tasks.workunit.client.1.smithi082.stdout:6/437: rename d2/d18/d23/d3c to d2/d18/d8a 0 2024-02-15T22:41:13.507 INFO:tasks.workunit.client.1.smithi082.stdout:0/328: rename d3/d19/c23 to d3/d19/c75 0 2024-02-15T22:41:13.507 INFO:tasks.workunit.client.1.smithi082.stdout:8/405: dwrite d1/d7/de/f32 [0,4194304] 0 2024-02-15T22:41:13.508 INFO:tasks.workunit.client.1.smithi082.stdout:9/348: mknod d8/d24/d2e/d56/c5e 0 2024-02-15T22:41:13.511 INFO:tasks.workunit.client.1.smithi082.stdout:3/335: truncate d0/d16/d62/f7 3665120 0 2024-02-15T22:41:13.513 INFO:tasks.workunit.client.1.smithi082.stdout:7/276: creat d12/d37/f5b x:0 0 0 2024-02-15T22:41:13.513 INFO:tasks.workunit.client.1.smithi082.stdout:7/277: truncate d12/d17/f25 808370 0 2024-02-15T22:41:13.514 INFO:tasks.workunit.client.1.smithi082.stdout:7/278: stat fb 0 2024-02-15T22:41:13.514 INFO:tasks.workunit.client.1.smithi082.stdout:6/438: creat d2/d18/d8a/d47/f8b x:0 0 0 2024-02-15T22:41:13.519 INFO:tasks.workunit.client.1.smithi082.stdout:6/439: rename d2/d18/f7c to d2/d18/d8a/d47/d72/f8c 0 2024-02-15T22:41:13.521 INFO:tasks.workunit.client.1.smithi082.stdout:0/329: mkdir d3/d19/d1c/d76 0 2024-02-15T22:41:13.522 INFO:tasks.workunit.client.1.smithi082.stdout:3/336: getdents d0 0 2024-02-15T22:41:13.522 INFO:tasks.workunit.client.1.smithi082.stdout:3/337: write d0/d16/d62/d14/d21/d41/f67 [77658,130831] 0 2024-02-15T22:41:13.524 INFO:tasks.workunit.client.1.smithi082.stdout:7/279: link d12/d17/c3e d12/c5c 0 2024-02-15T22:41:13.524 INFO:tasks.workunit.client.1.smithi082.stdout:7/280: chown d12/d27/l2b 883129159 1 2024-02-15T22:41:13.525 INFO:tasks.workunit.client.1.smithi082.stdout:6/440: truncate d2/d18/d23/d67/f71 1132468 0 2024-02-15T22:41:13.525 INFO:tasks.workunit.client.1.smithi082.stdout:6/441: write d2/d18/d8a/d47/d72/f8c [607203,65596] 0 2024-02-15T22:41:13.526 INFO:tasks.workunit.client.1.smithi082.stdout:0/330: mkdir d3/d19/d1c/d6d/d77 0 2024-02-15T22:41:13.527 INFO:tasks.workunit.client.1.smithi082.stdout:6/442: symlink d2/d18/d8a/d47/d72/d80/l8d 0 2024-02-15T22:41:13.528 INFO:tasks.workunit.client.1.smithi082.stdout:0/331: mknod d3/d6b/c78 0 2024-02-15T22:41:13.529 INFO:tasks.workunit.client.1.smithi082.stdout:6/443: link d2/d18/d39/c43 d2/d18/d8a/d84/c8e 0 2024-02-15T22:41:13.530 INFO:tasks.workunit.client.1.smithi082.stdout:0/332: creat d3/d64/d71/f79 x:0 0 0 2024-02-15T22:41:13.530 INFO:tasks.workunit.client.1.smithi082.stdout:0/333: chown d3/d19/d25/d45/f18 1 1 2024-02-15T22:41:13.531 INFO:tasks.workunit.client.1.smithi082.stdout:6/444: creat d2/d18/d8a/f8f x:0 0 0 2024-02-15T22:41:13.531 INFO:tasks.workunit.client.1.smithi082.stdout:0/334: creat d3/d64/d71/d73/f7a x:0 0 0 2024-02-15T22:41:13.536 INFO:tasks.workunit.client.1.smithi082.stdout:9/349: dwrite d8/d24/d2e/f34 [0,4194304] 0 2024-02-15T22:41:13.536 INFO:tasks.workunit.client.1.smithi082.stdout:9/350: chown d8/d24/d2e/d56 3 1 2024-02-15T22:41:13.537 INFO:tasks.workunit.client.1.smithi082.stdout:9/351: mknod d8/d12/c5f 0 2024-02-15T22:41:13.538 INFO:tasks.workunit.client.1.smithi082.stdout:9/352: write d8/d12/d33/d3e/f5d [732036,108543] 0 2024-02-15T22:41:13.538 INFO:tasks.workunit.client.1.smithi082.stdout:9/353: write d8/d12/d33/d3e/f5b [1021549,80429] 0 2024-02-15T22:41:13.538 INFO:tasks.workunit.client.1.smithi082.stdout:0/335: dread d3/d19/d1c/f65 [0,4194304] 0 2024-02-15T22:41:13.538 INFO:tasks.workunit.client.1.smithi082.stdout:0/336: chown d3/d19/f2e 2 1 2024-02-15T22:41:13.538 INFO:tasks.workunit.client.1.smithi082.stdout:0/337: dread - d3/d64/d71/d73/f7a zero size 2024-02-15T22:41:13.539 INFO:tasks.workunit.client.1.smithi082.stdout:0/338: symlink d3/d6b/l7b 0 2024-02-15T22:41:13.540 INFO:tasks.workunit.client.1.smithi082.stdout:0/339: fsync d3/d19/d20/d26/f53 0 2024-02-15T22:41:13.540 INFO:tasks.workunit.client.1.smithi082.stdout:0/340: fsync d3/fd 0 2024-02-15T22:41:13.540 INFO:tasks.workunit.client.1.smithi082.stdout:0/341: dread - d3/d19/d5f/f6e zero size 2024-02-15T22:41:13.541 INFO:tasks.workunit.client.1.smithi082.stdout:0/342: mkdir d3/d19/d20/d7c 0 2024-02-15T22:41:13.541 INFO:tasks.workunit.client.1.smithi082.stdout:0/343: chown d3/d19/d25/d45/f1a 1 1 2024-02-15T22:41:13.542 INFO:tasks.workunit.client.1.smithi082.stdout:0/344: mknod d3/d19/c7d 0 2024-02-15T22:41:13.542 INFO:tasks.workunit.client.1.smithi082.stdout:0/345: write d3/fd [513918,23995] 0 2024-02-15T22:41:13.542 INFO:tasks.workunit.client.1.smithi082.stdout:0/346: getdents d3/d64 0 2024-02-15T22:41:13.546 INFO:tasks.workunit.client.1.smithi082.stdout:9/354: write d8/d12/f1e [388828,86065] 0 2024-02-15T22:41:13.548 INFO:tasks.workunit.client.1.smithi082.stdout:9/355: rename d8/d24/f49 to d8/d24/d2e/d56/f60 0 2024-02-15T22:41:13.548 INFO:tasks.workunit.client.1.smithi082.stdout:8/406: dwrite d1/d7/de/d1e/f39 [0,4194304] 0 2024-02-15T22:41:13.553 INFO:tasks.workunit.client.1.smithi082.stdout:3/338: dwrite d0/d16/d62/f50 [0,4194304] 0 2024-02-15T22:41:13.554 INFO:tasks.workunit.client.1.smithi082.stdout:7/281: dwrite d12/d17/f1a [0,4194304] 0 2024-02-15T22:41:13.558 INFO:tasks.workunit.client.1.smithi082.stdout:3/339: mkdir d0/d16/d62/d14/d71 0 2024-02-15T22:41:13.558 INFO:tasks.workunit.client.1.smithi082.stdout:9/356: dread d8/f2b [0,4194304] 0 2024-02-15T22:41:13.561 INFO:tasks.workunit.client.1.smithi082.stdout:8/407: dread d1/d7/d9/f17 [0,4194304] 0 2024-02-15T22:41:13.561 INFO:tasks.workunit.client.1.smithi082.stdout:8/408: dread - d1/d7/d48/f6e zero size 2024-02-15T22:41:13.561 INFO:tasks.workunit.client.1.smithi082.stdout:8/409: readlink d1/d7/d9/d24/d30/l41 0 2024-02-15T22:41:13.562 INFO:tasks.workunit.client.1.smithi082.stdout:6/445: dread d2/d18/d8a/f6f [0,4194304] 0 2024-02-15T22:41:13.564 INFO:tasks.workunit.client.1.smithi082.stdout:9/357: dread d8/f1c [0,4194304] 0 2024-02-15T22:41:13.566 INFO:tasks.workunit.client.1.smithi082.stdout:7/282: symlink d12/d27/l5d 0 2024-02-15T22:41:13.566 INFO:tasks.workunit.client.1.smithi082.stdout:7/283: fsync d12/d27/f2f 0 2024-02-15T22:41:13.569 INFO:tasks.workunit.client.1.smithi082.stdout:3/340: truncate d0/f2 1666370 0 2024-02-15T22:41:13.573 INFO:tasks.workunit.client.1.smithi082.stdout:6/446: creat d2/d18/d23/f90 x:0 0 0 2024-02-15T22:41:13.575 INFO:tasks.workunit.client.1.smithi082.stdout:8/410: dwrite d1/f4f [0,4194304] 0 2024-02-15T22:41:13.575 INFO:tasks.workunit.client.1.smithi082.stdout:8/411: creat d1/d7/de/d57/f91 x:0 0 0 2024-02-15T22:41:13.575 INFO:tasks.workunit.client.1.smithi082.stdout:9/358: rename d8/d24/d2e/c43 to d8/d24/c61 0 2024-02-15T22:41:13.575 INFO:tasks.workunit.client.1.smithi082.stdout:9/359: readlink d8/d12/d33/l52 0 2024-02-15T22:41:13.576 INFO:tasks.workunit.client.1.smithi082.stdout:7/284: rmdir d12/d17/d4d 39 2024-02-15T22:41:13.579 INFO:tasks.workunit.client.1.smithi082.stdout:3/341: link d0/d16/d62/d14/d21/c3b d0/d16/d62/d14/d21/d69/d6c/c72 0 2024-02-15T22:41:13.586 INFO:tasks.workunit.client.1.smithi082.stdout:7/285: creat d12/d17/f5e x:0 0 0 2024-02-15T22:41:13.589 INFO:tasks.workunit.client.1.smithi082.stdout:8/412: dread d1/d7/d9/d24/d72/f88 [0,4194304] 0 2024-02-15T22:41:13.601 INFO:tasks.workunit.client.1.smithi082.stdout:6/447: dwrite d2/d18/d23/d67/f83 [4194304,4194304] 0 2024-02-15T22:41:13.602 INFO:tasks.workunit.client.1.smithi082.stdout:6/448: creat d2/d18/d8a/d47/f91 x:0 0 0 2024-02-15T22:41:13.614 INFO:tasks.workunit.client.1.smithi082.stdout:6/449: read d2/d18/d23/f35 [1424444,52084] 0 2024-02-15T22:41:13.617 INFO:tasks.workunit.client.1.smithi082.stdout:3/342: dwrite d0/dc/f51 [0,4194304] 0 2024-02-15T22:41:13.617 INFO:tasks.workunit.client.1.smithi082.stdout:3/343: chown d0/d16/d62/d14/f28 9 1 2024-02-15T22:41:13.617 INFO:tasks.workunit.client.1.smithi082.stdout:6/450: dread d2/d18/d8a/d47/f7b [0,4194304] 0 2024-02-15T22:41:13.618 INFO:tasks.workunit.client.1.smithi082.stdout:9/360: dwrite d8/d24/d2e/f47 [0,4194304] 0 2024-02-15T22:41:13.620 INFO:tasks.workunit.client.1.smithi082.stdout:7/286: dwrite d12/d17/d3d/f59 [0,4194304] 0 2024-02-15T22:41:13.620 INFO:tasks.workunit.client.1.smithi082.stdout:7/287: fsync d12/d17/d3d/f59 0 2024-02-15T22:41:13.620 INFO:tasks.workunit.client.1.smithi082.stdout:7/288: write d12/d27/d33/f36 [250389,84398] 0 2024-02-15T22:41:13.620 INFO:tasks.workunit.client.1.smithi082.stdout:7/289: chown d12/d37/f5b 15272 1 2024-02-15T22:41:13.621 INFO:tasks.workunit.client.1.smithi082.stdout:8/413: dwrite d1/d7/de/d1e/f27 [0,4194304] 0 2024-02-15T22:41:13.622 INFO:tasks.workunit.client.1.smithi082.stdout:6/451: mkdir d2/d30/d92 0 2024-02-15T22:41:13.622 INFO:tasks.workunit.client.1.smithi082.stdout:9/361: symlink d8/d12/d33/l62 0 2024-02-15T22:41:13.625 INFO:tasks.workunit.client.1.smithi082.stdout:7/290: link d12/d27/f2c d12/d17/f5f 0 2024-02-15T22:41:13.625 INFO:tasks.workunit.client.1.smithi082.stdout:7/291: fsync d12/d27/d33/f4e 0 2024-02-15T22:41:13.628 INFO:tasks.workunit.client.1.smithi082.stdout:9/362: rename d8/d24/d2e/f47 to d8/d12/d33/f63 0 2024-02-15T22:41:13.629 INFO:tasks.workunit.client.1.smithi082.stdout:7/292: creat d12/d3b/d41/f60 x:0 0 0 2024-02-15T22:41:13.630 INFO:tasks.workunit.client.1.smithi082.stdout:9/363: mkdir d8/d12/d33/d64 0 2024-02-15T22:41:13.631 INFO:tasks.workunit.client.1.smithi082.stdout:7/293: symlink d12/d3b/d41/l61 0 2024-02-15T22:41:13.631 INFO:tasks.workunit.client.1.smithi082.stdout:8/414: write d1/d7/d9/d42/d6a/f76 [2616188,7736] 0 2024-02-15T22:41:13.631 INFO:tasks.workunit.client.1.smithi082.stdout:8/415: truncate d1/d7/d9/d42/d6a/f76 4603480 0 2024-02-15T22:41:13.632 INFO:tasks.workunit.client.1.smithi082.stdout:6/452: dread d2/d18/d8a/f3d [0,4194304] 0 2024-02-15T22:41:13.632 INFO:tasks.workunit.client.1.smithi082.stdout:7/294: unlink d12/d27/d33/f4e 0 2024-02-15T22:41:13.634 INFO:tasks.workunit.client.1.smithi082.stdout:6/453: rename d2/cb to d2/d45/c93 0 2024-02-15T22:41:13.634 INFO:tasks.workunit.client.1.smithi082.stdout:6/454: read d2/d18/f44 [4131306,30751] 0 2024-02-15T22:41:13.635 INFO:tasks.workunit.client.1.smithi082.stdout:3/344: dwrite d0/dc/d3f/f49 [4194304,4194304] 0 2024-02-15T22:41:13.635 INFO:tasks.workunit.client.1.smithi082.stdout:7/295: creat d12/d27/f62 x:0 0 0 2024-02-15T22:41:13.635 INFO:tasks.workunit.client.1.smithi082.stdout:7/296: chown d12/d17/d3d/d57 1 1 2024-02-15T22:41:13.639 INFO:tasks.workunit.client.1.smithi082.stdout:6/455: mknod d2/d18/d23/d67/c94 0 2024-02-15T22:41:13.641 INFO:tasks.workunit.client.1.smithi082.stdout:7/297: link d12/d37/l4f d12/d17/d42/l63 0 2024-02-15T22:41:13.643 INFO:tasks.workunit.client.1.smithi082.stdout:6/456: rename d2/lc to d2/d18/d8a/d47/l95 0 2024-02-15T22:41:13.643 INFO:tasks.workunit.client.1.smithi082.stdout:7/298: write d12/f16 [5047547,128000] 0 2024-02-15T22:41:13.644 INFO:tasks.workunit.client.1.smithi082.stdout:7/299: dread d12/d3b/f3f [0,4194304] 0 2024-02-15T22:41:13.644 INFO:tasks.workunit.client.1.smithi082.stdout:7/300: write f6 [1017029,9287] 0 2024-02-15T22:41:13.645 INFO:tasks.workunit.client.1.smithi082.stdout:6/457: unlink d2/d18/d39/c4d 0 2024-02-15T22:41:13.647 INFO:tasks.workunit.client.1.smithi082.stdout:3/345: write d0/dc/d3f/f49 [7097310,109190] 0 2024-02-15T22:41:13.653 INFO:tasks.workunit.client.1.smithi082.stdout:4/407: sync 2024-02-15T22:41:13.653 INFO:tasks.workunit.client.1.smithi082.stdout:2/392: sync 2024-02-15T22:41:13.653 INFO:tasks.workunit.client.1.smithi082.stdout:2/393: write d6/dc/dd/d21/f5a [532573,26849] 0 2024-02-15T22:41:13.655 INFO:tasks.workunit.client.1.smithi082.stdout:6/458: rmdir d2/d18/d8a/d47 39 2024-02-15T22:41:13.656 INFO:tasks.workunit.client.1.smithi082.stdout:4/408: link d0/d16/d4a/l78 d0/d16/l97 0 2024-02-15T22:41:13.656 INFO:tasks.workunit.client.1.smithi082.stdout:4/409: readlink d0/d8/d32/d39/l84 0 2024-02-15T22:41:13.656 INFO:tasks.workunit.client.1.smithi082.stdout:4/410: truncate d0/f7b 946394 0 2024-02-15T22:41:13.656 INFO:tasks.workunit.client.1.smithi082.stdout:4/411: dread - d0/d8/d1b/f8d zero size 2024-02-15T22:41:13.657 INFO:tasks.workunit.client.1.smithi082.stdout:2/394: getdents d6/dc/d12 0 2024-02-15T22:41:13.657 INFO:tasks.workunit.client.1.smithi082.stdout:2/395: fsync d6/f26 0 2024-02-15T22:41:13.657 INFO:tasks.workunit.client.1.smithi082.stdout:2/396: truncate d6/dc/d12/d46/f7f 208397 0 2024-02-15T22:41:13.657 INFO:tasks.workunit.client.1.smithi082.stdout:2/397: write d6/dc/dd/f1a [488425,113974] 0 2024-02-15T22:41:13.657 INFO:tasks.workunit.client.1.smithi082.stdout:2/398: write d6/dc/dd/d21/f5a [1195712,113750] 0 2024-02-15T22:41:13.658 INFO:tasks.workunit.client.1.smithi082.stdout:6/459: rmdir d2/d30/d92 0 2024-02-15T22:41:13.658 INFO:tasks.workunit.client.1.smithi082.stdout:4/412: stat d0/d47/c86 0 2024-02-15T22:41:13.659 INFO:tasks.workunit.client.1.smithi082.stdout:7/301: dwrite d12/f20 [0,4194304] 0 2024-02-15T22:41:13.673 INFO:tasks.workunit.client.1.smithi082.stdout:3/346: dwrite d0/d16/d62/f25 [4194304,4194304] 0 2024-02-15T22:41:13.673 INFO:tasks.workunit.client.1.smithi082.stdout:3/347: chown d0/l1d 1 1 2024-02-15T22:41:13.673 INFO:tasks.workunit.client.1.smithi082.stdout:3/348: fsync d0/d16/d62/d14/f2a 0 2024-02-15T22:41:13.673 INFO:tasks.workunit.client.1.smithi082.stdout:3/349: stat d0/d16/d62/d14/d21/c54 0 2024-02-15T22:41:13.673 INFO:tasks.workunit.client.1.smithi082.stdout:3/350: chown d0/d16/l2f 1 1 2024-02-15T22:41:13.673 INFO:tasks.workunit.client.1.smithi082.stdout:3/351: fsync d0/d16/f3a 0 2024-02-15T22:41:13.682 INFO:tasks.workunit.client.1.smithi082.stdout:3/352: dread d0/d16/f32 [0,4194304] 0 2024-02-15T22:41:13.682 INFO:tasks.workunit.client.1.smithi082.stdout:3/353: fdatasync d0/d16/d62/d14/d21/d41/f67 0 2024-02-15T22:41:13.728 INFO:tasks.workunit.client.1.smithi082.stdout:2/399: mknod d6/dc/c82 0 2024-02-15T22:41:13.728 INFO:tasks.workunit.client.1.smithi082.stdout:6/460: symlink d2/d18/d8a/d47/l96 0 2024-02-15T22:41:13.729 INFO:tasks.workunit.client.1.smithi082.stdout:4/413: unlink d0/d8/d32/l77 0 2024-02-15T22:41:13.730 INFO:tasks.workunit.client.1.smithi082.stdout:7/302: creat d12/f64 x:0 0 0 2024-02-15T22:41:13.736 INFO:tasks.workunit.client.1.smithi082.stdout:2/400: mknod d6/dc/dd/d21/c83 0 2024-02-15T22:41:13.737 INFO:tasks.workunit.client.1.smithi082.stdout:6/461: symlink d2/d18/d8a/d47/d69/l97 0 2024-02-15T22:41:13.738 INFO:tasks.workunit.client.1.smithi082.stdout:6/462: creat d2/f98 x:0 0 0 2024-02-15T22:41:13.738 INFO:tasks.workunit.client.1.smithi082.stdout:6/463: fdatasync d2/d18/d23/d67/f6d 0 2024-02-15T22:41:13.738 INFO:tasks.workunit.client.1.smithi082.stdout:4/414: truncate d0/f2 2244258 0 2024-02-15T22:41:13.738 INFO:tasks.workunit.client.1.smithi082.stdout:4/415: write d0/d16/d4a/f63 [561978,120500] 0 2024-02-15T22:41:13.740 INFO:tasks.workunit.client.1.smithi082.stdout:3/354: getdents d0/dc 0 2024-02-15T22:41:13.740 INFO:tasks.workunit.client.1.smithi082.stdout:3/355: dread - d0/f46 zero size 2024-02-15T22:41:13.740 INFO:tasks.workunit.client.1.smithi082.stdout:3/356: getdents d0/d16/d3e/d56 0 2024-02-15T22:41:13.741 INFO:tasks.workunit.client.1.smithi082.stdout:2/401: rmdir d6/dc/d58/d49 39 2024-02-15T22:41:13.741 INFO:tasks.workunit.client.1.smithi082.stdout:2/402: write d6/dc/d58/f7e [351519,107711] 0 2024-02-15T22:41:13.743 INFO:tasks.workunit.client.1.smithi082.stdout:7/303: rmdir d12/d3b/d41 39 2024-02-15T22:41:13.743 INFO:tasks.workunit.client.1.smithi082.stdout:7/304: chown d12/f3c 425789489 1 2024-02-15T22:41:13.743 INFO:tasks.workunit.client.1.smithi082.stdout:7/305: write d12/f2d [1603145,46980] 0 2024-02-15T22:41:13.744 INFO:tasks.workunit.client.1.smithi082.stdout:3/357: symlink d0/d16/d62/l73 0 2024-02-15T22:41:13.745 INFO:tasks.workunit.client.1.smithi082.stdout:2/403: mknod d6/dc/c84 0 2024-02-15T22:41:13.746 INFO:tasks.workunit.client.1.smithi082.stdout:3/358: symlink d0/d53/l74 0 2024-02-15T22:41:13.747 INFO:tasks.workunit.client.1.smithi082.stdout:3/359: mknod d0/d16/d62/c75 0 2024-02-15T22:41:13.749 INFO:tasks.workunit.client.1.smithi082.stdout:3/360: creat d0/dc/d3f/f76 x:0 0 0 2024-02-15T22:41:13.749 INFO:tasks.workunit.client.1.smithi082.stdout:3/361: write d0/d16/d62/f36 [4927438,16017] 0 2024-02-15T22:41:13.750 INFO:tasks.workunit.client.1.smithi082.stdout:3/362: mknod d0/d16/d62/d14/d71/c77 0 2024-02-15T22:41:13.750 INFO:tasks.workunit.client.1.smithi082.stdout:3/363: readlink d0/l1d 0 2024-02-15T22:41:13.750 INFO:tasks.workunit.client.1.smithi082.stdout:3/364: truncate d0/d16/d62/d14/d21/f3d 4901232 0 2024-02-15T22:41:13.750 INFO:tasks.workunit.client.1.smithi082.stdout:3/365: creat d0/dc/d3f/f78 x:0 0 0 2024-02-15T22:41:13.751 INFO:tasks.workunit.client.1.smithi082.stdout:3/366: mkdir d0/d16/d62/d79 0 2024-02-15T22:41:13.752 INFO:tasks.workunit.client.1.smithi082.stdout:3/367: symlink d0/d16/d3e/l7a 0 2024-02-15T22:41:13.753 INFO:tasks.workunit.client.1.smithi082.stdout:7/306: write d12/f16 [3719215,100721] 0 2024-02-15T22:41:13.754 INFO:tasks.workunit.client.1.smithi082.stdout:7/307: symlink d12/d37/l65 0 2024-02-15T22:41:13.758 INFO:tasks.workunit.client.1.smithi082.stdout:6/464: dwrite d2/d18/d8a/d65/f7f [0,4194304] 0 2024-02-15T22:41:13.758 INFO:tasks.workunit.client.1.smithi082.stdout:6/465: dread - d2/d30/f86 zero size 2024-02-15T22:41:13.758 INFO:tasks.workunit.client.1.smithi082.stdout:6/466: creat d2/d18/f99 x:0 0 0 2024-02-15T22:41:13.758 INFO:tasks.workunit.client.1.smithi082.stdout:7/308: rename d12/f38 to d12/d3b/d41/f66 0 2024-02-15T22:41:13.759 INFO:tasks.workunit.client.1.smithi082.stdout:2/404: write d6/dc/d12/f74 [3341207,1411] 0 2024-02-15T22:41:13.759 INFO:tasks.workunit.client.1.smithi082.stdout:2/405: fsync d6/dc/dd/d1d/f50 0 2024-02-15T22:41:13.759 INFO:tasks.workunit.client.1.smithi082.stdout:2/406: fsync d6/dc/d12/d23/f2f 0 2024-02-15T22:41:13.762 INFO:tasks.workunit.client.1.smithi082.stdout:2/407: truncate d6/dc/dd/d1d/f57 251704 0 2024-02-15T22:41:13.764 INFO:tasks.workunit.client.1.smithi082.stdout:7/309: rmdir d12/d27/d33 39 2024-02-15T22:41:13.764 INFO:tasks.workunit.client.1.smithi082.stdout:7/310: write fb [447961,23846] 0 2024-02-15T22:41:13.764 INFO:tasks.workunit.client.1.smithi082.stdout:7/311: read d12/f21 [5186787,101634] 0 2024-02-15T22:41:13.764 INFO:tasks.workunit.client.1.smithi082.stdout:7/312: fsync d12/d17/d42/f58 0 2024-02-15T22:41:13.764 INFO:tasks.workunit.client.1.smithi082.stdout:7/313: chown d12/d17/d4d 50899380 1 2024-02-15T22:41:13.764 INFO:tasks.workunit.client.1.smithi082.stdout:7/314: stat d12/d17/d3d/f59 0 2024-02-15T22:41:13.765 INFO:tasks.workunit.client.1.smithi082.stdout:1/362: sync 2024-02-15T22:41:13.769 INFO:tasks.workunit.client.1.smithi082.stdout:3/368: dwrite d0/d16/d62/d14/d21/d41/f67 [0,4194304] 0 2024-02-15T22:41:13.779 INFO:tasks.workunit.client.1.smithi082.stdout:4/416: truncate d0/f2 2049510 0 2024-02-15T22:41:13.780 INFO:tasks.workunit.client.1.smithi082.stdout:1/363: write d1/da/d14/d18/f3a [1872689,69611] 0 2024-02-15T22:41:13.781 INFO:tasks.workunit.client.1.smithi082.stdout:4/417: rename d0/d47/f89 to d0/d46/f98 0 2024-02-15T22:41:13.783 INFO:tasks.workunit.client.1.smithi082.stdout:1/364: mkdir d1/da/d11/d3f/d75 0 2024-02-15T22:41:13.784 INFO:tasks.workunit.client.1.smithi082.stdout:4/418: creat d0/d47/f99 x:0 0 0 2024-02-15T22:41:13.786 INFO:tasks.workunit.client.1.smithi082.stdout:1/365: mkdir d1/da/d14/d18/d1f/d76 0 2024-02-15T22:41:13.786 INFO:tasks.workunit.client.1.smithi082.stdout:1/366: creat d1/da/d14/d18/d1f/f77 x:0 0 0 2024-02-15T22:41:13.791 INFO:tasks.workunit.client.1.smithi082.stdout:2/408: dwrite d6/dc/dd/d21/f5a [0,4194304] 0 2024-02-15T22:41:13.791 INFO:tasks.workunit.client.1.smithi082.stdout:2/409: write d6/dc/dd/d24/f65 [954111,74195] 0 2024-02-15T22:41:13.791 INFO:tasks.workunit.client.1.smithi082.stdout:2/410: getdents d6/dc/d12/d46/d76 0 2024-02-15T22:41:13.791 INFO:tasks.workunit.client.1.smithi082.stdout:6/467: dwrite d2/f52 [0,4194304] 0 2024-02-15T22:41:13.791 INFO:tasks.workunit.client.1.smithi082.stdout:6/468: write d2/d18/d8a/d47/f7b [836079,54045] 0 2024-02-15T22:41:13.792 INFO:tasks.workunit.client.1.smithi082.stdout:7/315: dwrite d12/d17/d3d/f55 [0,4194304] 0 2024-02-15T22:41:13.796 INFO:tasks.workunit.client.1.smithi082.stdout:6/469: creat d2/d18/d8a/d47/d69/d75/f9a x:0 0 0 2024-02-15T22:41:13.797 INFO:tasks.workunit.client.1.smithi082.stdout:6/470: mknod d2/d18/d8a/d84/c9b 0 2024-02-15T22:41:13.797 INFO:tasks.workunit.client.1.smithi082.stdout:6/471: mknod d2/d30/c9c 0 2024-02-15T22:41:13.804 INFO:tasks.workunit.client.1.smithi082.stdout:7/316: write d12/d17/f1d [368072,91410] 0 2024-02-15T22:41:13.805 INFO:tasks.workunit.client.1.smithi082.stdout:7/317: truncate ff 22935 0 2024-02-15T22:41:13.805 INFO:tasks.workunit.client.1.smithi082.stdout:7/318: read d12/f16 [4622534,8899] 0 2024-02-15T22:41:13.806 INFO:tasks.workunit.client.1.smithi082.stdout:2/411: write d6/dc/dd/d1d/f1f [1381223,81999] 0 2024-02-15T22:41:13.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/472: write d2/d18/d23/d67/f83 [6883416,4790] 0 2024-02-15T22:41:13.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/473: fsync d2/d18/d8a/d47/d72/f8c 0 2024-02-15T22:41:13.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/474: truncate d2/d45/f56 373882 0 2024-02-15T22:41:13.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/475: write d2/d18/f44 [3442215,130017] 0 2024-02-15T22:41:13.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/476: truncate d2/d18/d8a/d47/d69/f77 955203 0 2024-02-15T22:41:13.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/477: creat d2/d18/d23/f9d x:0 0 0 2024-02-15T22:41:13.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/478: chown d2/d18/d23/d67/f6d 31 1 2024-02-15T22:41:13.812 INFO:tasks.workunit.client.1.smithi082.stdout:6/479: rename d2/l17 to d2/d18/d39/l9e 0 2024-02-15T22:41:13.812 INFO:tasks.workunit.client.1.smithi082.stdout:6/480: write d2/d18/d8a/d47/f8b [454842,30893] 0 2024-02-15T22:41:13.813 INFO:tasks.workunit.client.1.smithi082.stdout:7/319: dread d12/d27/f2f [0,4194304] 0 2024-02-15T22:41:13.813 INFO:tasks.workunit.client.1.smithi082.stdout:7/320: chown d12/d17/d3d/f59 30072774 1 2024-02-15T22:41:13.813 INFO:tasks.workunit.client.1.smithi082.stdout:7/321: write d12/d17/d42/f58 [311672,28995] 0 2024-02-15T22:41:13.813 INFO:tasks.workunit.client.1.smithi082.stdout:6/481: link d2/f52 d2/d18/d8a/d47/d72/f9f 0 2024-02-15T22:41:13.814 INFO:tasks.workunit.client.1.smithi082.stdout:7/322: mkdir d12/d17/d42/d67 0 2024-02-15T22:41:13.815 INFO:tasks.workunit.client.1.smithi082.stdout:6/482: mkdir d2/d30/d3b/da0 0 2024-02-15T22:41:13.815 INFO:tasks.workunit.client.1.smithi082.stdout:4/419: dwrite d0/d8/d1b/f35 [0,4194304] 0 2024-02-15T22:41:13.817 INFO:tasks.workunit.client.1.smithi082.stdout:1/367: dwrite d1/da/d11/d3f/f69 [0,4194304] 0 2024-02-15T22:41:13.817 INFO:tasks.workunit.client.1.smithi082.stdout:7/323: rename d12/d37/c56 to d12/d17/d42/c68 0 2024-02-15T22:41:13.817 INFO:tasks.workunit.client.1.smithi082.stdout:7/324: write d12/d17/f1a [4984887,18764] 0 2024-02-15T22:41:13.819 INFO:tasks.workunit.client.1.smithi082.stdout:4/420: mknod d0/d8/c9a 0 2024-02-15T22:41:13.819 INFO:tasks.workunit.client.1.smithi082.stdout:4/421: chown d0/d8/d1b/dd/f41 21 1 2024-02-15T22:41:13.819 INFO:tasks.workunit.client.1.smithi082.stdout:4/422: readlink d0/d8/d1b/dd/l13 0 2024-02-15T22:41:13.819 INFO:tasks.workunit.client.1.smithi082.stdout:4/423: chown d0 34 1 2024-02-15T22:41:13.821 INFO:tasks.workunit.client.1.smithi082.stdout:2/412: write d6/dc/d58/fe [6343393,106985] 0 2024-02-15T22:41:13.825 INFO:tasks.workunit.client.1.smithi082.stdout:6/483: write d2/d18/d8a/d47/d72/f9f [2451825,99216] 0 2024-02-15T22:41:13.847 INFO:tasks.workunit.client.1.smithi082.stdout:1/368: creat d1/da/d11/d3f/d75/f78 x:0 0 0 2024-02-15T22:41:13.851 INFO:tasks.workunit.client.1.smithi082.stdout:7/325: mknod d12/d17/d42/d67/c69 0 2024-02-15T22:41:13.851 INFO:tasks.workunit.client.1.smithi082.stdout:7/326: read d12/f2d [1852772,109493] 0 2024-02-15T22:41:13.851 INFO:tasks.workunit.client.1.smithi082.stdout:7/327: truncate d12/d27/f62 38938 0 2024-02-15T22:41:13.851 INFO:tasks.workunit.client.1.smithi082.stdout:7/328: write d12/d3b/f44 [847220,2466] 0 2024-02-15T22:41:13.853 INFO:tasks.workunit.client.1.smithi082.stdout:4/424: rename d0/d8/f2e to d0/d16/d87/f9b 0 2024-02-15T22:41:13.853 INFO:tasks.workunit.client.1.smithi082.stdout:4/425: stat d0/d8/d1b/d70 0 2024-02-15T22:41:13.855 INFO:tasks.workunit.client.1.smithi082.stdout:2/413: symlink d6/dc/d58/d49/l85 0 2024-02-15T22:41:13.860 INFO:tasks.workunit.client.1.smithi082.stdout:7/329: dread d12/d17/d3d/f55 [0,4194304] 0 2024-02-15T22:41:13.862 INFO:tasks.workunit.client.1.smithi082.stdout:6/484: mknod d2/d18/d8a/d84/ca1 0 2024-02-15T22:41:13.862 INFO:tasks.workunit.client.1.smithi082.stdout:6/485: chown d2/d18 385866510 1 2024-02-15T22:41:13.862 INFO:tasks.workunit.client.1.smithi082.stdout:6/486: chown d2/c2a 1 1 2024-02-15T22:41:13.862 INFO:tasks.workunit.client.1.smithi082.stdout:6/487: write d2/d18/d23/f9d [64079,98873] 0 2024-02-15T22:41:13.862 INFO:tasks.workunit.client.1.smithi082.stdout:6/488: truncate d2/d18/d8a/f8f 961945 0 2024-02-15T22:41:13.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:13 smithi082 ceph-mon[37153]: pgmap v19: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 137 MiB/s rd, 197 MiB/s wr, 681 op/s 2024-02-15T22:41:13.879 INFO:tasks.workunit.client.1.smithi082.stdout:6/489: dwrite d2/d18/d8a/d47/d69/f73 [0,4194304] 0 2024-02-15T22:41:13.879 INFO:tasks.workunit.client.1.smithi082.stdout:6/490: chown d2/d18/f44 20808 1 2024-02-15T22:41:13.893 INFO:tasks.workunit.client.1.smithi082.stdout:2/414: unlink d6/dc/d12/d46/d4b/f4d 0 2024-02-15T22:41:13.898 INFO:tasks.workunit.client.1.smithi082.stdout:5/337: sync 2024-02-15T22:41:13.898 INFO:tasks.workunit.client.1.smithi082.stdout:0/347: sync 2024-02-15T22:41:13.898 INFO:tasks.workunit.client.1.smithi082.stdout:5/338: fsync d5/da/d22/d59/f64 0 2024-02-15T22:41:13.898 INFO:tasks.workunit.client.1.smithi082.stdout:0/348: write d3/d19/d25/d45/f2a [1560135,84489] 0 2024-02-15T22:41:13.898 INFO:tasks.workunit.client.1.smithi082.stdout:0/349: write d3/d19/d5f/f6e [586356,94090] 0 2024-02-15T22:41:13.905 INFO:tasks.workunit.client.1.smithi082.stdout:6/491: link d2/d18/l6a d2/d18/d8a/d47/d69/la2 0 2024-02-15T22:41:13.905 INFO:tasks.workunit.client.1.smithi082.stdout:6/492: chown d2/d18/d8a/f8f 13 1 2024-02-15T22:41:13.906 INFO:tasks.workunit.client.1.smithi082.stdout:6/493: stat d2/d18/d23/d67/f6d 0 2024-02-15T22:41:13.908 INFO:tasks.workunit.client.1.smithi082.stdout:1/369: link d1/l26 d1/da/d14/d18/l79 0 2024-02-15T22:41:13.908 INFO:tasks.workunit.client.1.smithi082.stdout:1/370: write d1/da/d11/f33 [664624,114177] 0 2024-02-15T22:41:13.910 INFO:tasks.workunit.client.1.smithi082.stdout:4/426: rename d0/d47/f49 to d0/d16/f9c 0 2024-02-15T22:41:13.910 INFO:tasks.workunit.client.1.smithi082.stdout:7/330: getdents d12/d17/d42/d67 0 2024-02-15T22:41:13.912 INFO:tasks.workunit.client.1.smithi082.stdout:6/494: creat d2/d18/d23/d67/fa3 x:0 0 0 2024-02-15T22:41:13.912 INFO:tasks.workunit.client.1.smithi082.stdout:6/495: dread - d2/d18/d8a/d47/d69/d75/f9a zero size 2024-02-15T22:41:13.914 INFO:tasks.workunit.client.1.smithi082.stdout:1/371: mkdir d1/da/d14/d18/d1f/d7a 0 2024-02-15T22:41:13.914 INFO:tasks.workunit.client.1.smithi082.stdout:1/372: write d1/f3d [3910536,52849] 0 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:2/415: dwrite d6/dc/d58/f19 [0,4194304] 0 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:0/350: dread d3/d19/d20/d26/f6a [0,4194304] 0 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:0/351: write d3/d64/d71/d73/f7a [824128,70495] 0 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:0/352: fsync d3/f11 0 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:2/416: write d6/dc/d12/d46/f7f [303798,123534] 0 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:2/417: chown d6/l62 29069 1 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:0/353: creat d3/d19/f7e x:0 0 0 2024-02-15T22:41:13.915 INFO:tasks.workunit.client.1.smithi082.stdout:0/354: chown d3/d19/d25/l54 6 1 2024-02-15T22:41:13.916 INFO:tasks.workunit.client.1.smithi082.stdout:7/331: mkdir d12/d17/d3d/d57/d6a 0 2024-02-15T22:41:13.917 INFO:tasks.workunit.client.1.smithi082.stdout:7/332: dread d12/f22 [0,4194304] 0 2024-02-15T22:41:13.918 INFO:tasks.workunit.client.1.smithi082.stdout:6/496: unlink d2/d18/d23/l68 0 2024-02-15T22:41:13.920 INFO:tasks.workunit.client.1.smithi082.stdout:1/373: mknod d1/da/d14/d18/d1f/c7b 0 2024-02-15T22:41:13.924 INFO:tasks.workunit.client.1.smithi082.stdout:5/339: dwrite d5/da/dc/d43/f4d [0,4194304] 0 2024-02-15T22:41:13.927 INFO:tasks.workunit.client.1.smithi082.stdout:2/418: link d6/dc/l68 d6/dc/d12/d46/l86 0 2024-02-15T22:41:13.928 INFO:tasks.workunit.client.1.smithi082.stdout:0/355: mkdir d3/d6b/d7f 0 2024-02-15T22:41:13.928 INFO:tasks.workunit.client.1.smithi082.stdout:0/356: fdatasync d3/d64/d71/f79 0 2024-02-15T22:41:13.930 INFO:tasks.workunit.client.1.smithi082.stdout:4/427: link d0/d8/l38 d0/d16/d4a/l9d 0 2024-02-15T22:41:13.932 INFO:tasks.workunit.client.1.smithi082.stdout:1/374: mknod d1/da/d14/d18/d51/c7c 0 2024-02-15T22:41:13.934 INFO:tasks.workunit.client.1.smithi082.stdout:7/333: dwrite d12/d17/d42/f58 [0,4194304] 0 2024-02-15T22:41:13.935 INFO:tasks.workunit.client.1.smithi082.stdout:7/334: write d12/d3b/f44 [1751251,15982] 0 2024-02-15T22:41:13.945 INFO:tasks.workunit.client.1.smithi082.stdout:4/428: dwrite d0/d8/d1b/f1d [0,4194304] 0 2024-02-15T22:41:13.945 INFO:tasks.workunit.client.1.smithi082.stdout:4/429: write d0/d8/d1b/f1d [4614663,75291] 0 2024-02-15T22:41:13.945 INFO:tasks.workunit.client.1.smithi082.stdout:4/430: stat d0/d47/f99 0 2024-02-15T22:41:13.945 INFO:tasks.workunit.client.1.smithi082.stdout:4/431: truncate d0/d8/d1b/f8d 874871 0 2024-02-15T22:41:13.945 INFO:tasks.workunit.client.1.smithi082.stdout:4/432: write d0/d46/f8a [123237,47234] 0 2024-02-15T22:41:13.945 INFO:tasks.workunit.client.1.smithi082.stdout:4/433: chown d0/d16/d4a/f52 130488 1 2024-02-15T22:41:13.946 INFO:tasks.workunit.client.1.smithi082.stdout:2/419: rename d6/dc/dd/d24/l55 to d6/dc/d58/l87 0 2024-02-15T22:41:13.946 INFO:tasks.workunit.client.1.smithi082.stdout:2/420: fdatasync d6/d18/f4c 0 2024-02-15T22:41:13.946 INFO:tasks.workunit.client.1.smithi082.stdout:2/421: readlink d6/d18/l33 0 2024-02-15T22:41:13.946 INFO:tasks.workunit.client.1.smithi082.stdout:1/375: mknod d1/da/d11/c7d 0 2024-02-15T22:41:13.951 INFO:tasks.workunit.client.1.smithi082.stdout:7/335: rename d12/d3b/c50 to d12/d17/d42/c6b 0 2024-02-15T22:41:13.952 INFO:tasks.workunit.client.1.smithi082.stdout:7/336: chown d12/d27/l2a 7420304 1 2024-02-15T22:41:13.954 INFO:tasks.workunit.client.1.smithi082.stdout:7/337: link d12/c46 d12/d17/d42/c6c 0 2024-02-15T22:41:13.954 INFO:tasks.workunit.client.1.smithi082.stdout:7/338: readlink ld 0 2024-02-15T22:41:13.954 INFO:tasks.workunit.client.1.smithi082.stdout:7/339: chown d12/d17/d3d/f55 348421304 1 2024-02-15T22:41:13.954 INFO:tasks.workunit.client.1.smithi082.stdout:7/340: creat d12/d27/f6d x:0 0 0 2024-02-15T22:41:13.955 INFO:tasks.workunit.client.1.smithi082.stdout:2/422: getdents d6/d3c 0 2024-02-15T22:41:13.957 INFO:tasks.workunit.client.1.smithi082.stdout:4/434: dread d0/d8/d1b/f59 [0,4194304] 0 2024-02-15T22:41:13.959 INFO:tasks.workunit.client.1.smithi082.stdout:4/435: mknod d0/d16/d83/c9e 0 2024-02-15T22:41:13.959 INFO:tasks.workunit.client.1.smithi082.stdout:4/436: dread - d0/d16/f56 zero size 2024-02-15T22:41:13.965 INFO:tasks.workunit.client.1.smithi082.stdout:1/376: dwrite d1/f3d [0,4194304] 0 2024-02-15T22:41:13.966 INFO:tasks.workunit.client.1.smithi082.stdout:9/364: sync 2024-02-15T22:41:13.966 INFO:tasks.workunit.client.1.smithi082.stdout:8/416: sync 2024-02-15T22:41:13.970 INFO:tasks.workunit.client.1.smithi082.stdout:9/365: mkdir d8/d12/d30/d3c/d65 0 2024-02-15T22:41:13.972 INFO:tasks.workunit.client.1.smithi082.stdout:8/417: mknod d1/d7/d9/d50/c92 0 2024-02-15T22:41:13.973 INFO:tasks.workunit.client.1.smithi082.stdout:8/418: mknod d1/d7/d9/d24/d72/c93 0 2024-02-15T22:41:13.974 INFO:tasks.workunit.client.1.smithi082.stdout:7/341: rename d12/d17/d3d/d57 to d12/d27/d6e 0 2024-02-15T22:41:13.974 INFO:tasks.workunit.client.1.smithi082.stdout:7/342: write d12/d3b/f44 [2523566,12871] 0 2024-02-15T22:41:13.976 INFO:tasks.workunit.client.1.smithi082.stdout:2/423: rename d6/c29 to d6/d18/c88 0 2024-02-15T22:41:13.977 INFO:tasks.workunit.client.1.smithi082.stdout:2/424: dread d6/d18/f37 [0,4194304] 0 2024-02-15T22:41:13.980 INFO:tasks.workunit.client.1.smithi082.stdout:2/425: dread d6/dc/dd/d24/f30 [0,4194304] 0 2024-02-15T22:41:13.980 INFO:tasks.workunit.client.1.smithi082.stdout:1/377: dwrite d1/da/d11/f16 [0,4194304] 0 2024-02-15T22:41:13.980 INFO:tasks.workunit.client.1.smithi082.stdout:4/437: rename d0/d8/c66 to d0/d47/c9f 0 2024-02-15T22:41:13.981 INFO:tasks.workunit.client.1.smithi082.stdout:2/426: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:13.981 INFO:tasks.workunit.client.1.smithi082.stdout:1/378: symlink d1/d57/l7e 0 2024-02-15T22:41:13.984 INFO:tasks.workunit.client.1.smithi082.stdout:2/427: unlink d6/dc/d58/f7e 0 2024-02-15T22:41:13.990 INFO:tasks.workunit.client.1.smithi082.stdout:3/369: sync 2024-02-15T22:41:13.991 INFO:tasks.workunit.client.1.smithi082.stdout:4/438: rename d0/d8/d1b/f3b to d0/fa0 0 2024-02-15T22:41:13.991 INFO:tasks.workunit.client.1.smithi082.stdout:7/343: dwrite d12/d27/f2c [0,4194304] 0 2024-02-15T22:41:13.991 INFO:tasks.workunit.client.1.smithi082.stdout:3/370: creat d0/d16/d62/d14/d21/d69/d6c/f7b x:0 0 0 2024-02-15T22:41:13.994 INFO:tasks.workunit.client.1.smithi082.stdout:9/366: rename d8/f9 to d8/d12/d33/d3e/f66 0 2024-02-15T22:41:13.994 INFO:tasks.workunit.client.1.smithi082.stdout:2/428: write d6/dc/d58/d49/d5e/f60 [3751315,130364] 0 2024-02-15T22:41:13.995 INFO:tasks.workunit.client.1.smithi082.stdout:2/429: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:13.995 INFO:tasks.workunit.client.1.smithi082.stdout:2/430: chown d6/dc/d12/d46/d4b/d63/c64 557 1 2024-02-15T22:41:13.995 INFO:tasks.workunit.client.1.smithi082.stdout:2/431: creat d6/dc/f89 x:0 0 0 2024-02-15T22:41:13.995 INFO:tasks.workunit.client.1.smithi082.stdout:2/432: write d6/dc/dd/d1d/f1f [4415985,33819] 0 2024-02-15T22:41:13.998 INFO:tasks.workunit.client.1.smithi082.stdout:7/344: stat d12/d37/l4f 0 2024-02-15T22:41:14.000 INFO:tasks.workunit.client.1.smithi082.stdout:4/439: dread d0/d8/d32/d39/f3f [0,4194304] 0 2024-02-15T22:41:14.000 INFO:tasks.workunit.client.1.smithi082.stdout:7/345: dread d12/d17/d3d/f40 [0,4194304] 0 2024-02-15T22:41:14.000 INFO:tasks.workunit.client.1.smithi082.stdout:7/346: write d12/d3b/d41/f60 [71063,122366] 0 2024-02-15T22:41:14.001 INFO:tasks.workunit.client.1.smithi082.stdout:7/347: fsync d12/d37/f5b 0 2024-02-15T22:41:14.001 INFO:tasks.workunit.client.1.smithi082.stdout:8/419: rename d1/d7/d9/d50/c92 to d1/d7/d9/d24/d72/c94 0 2024-02-15T22:41:14.001 INFO:tasks.workunit.client.1.smithi082.stdout:9/367: mkdir d8/d12/d67 0 2024-02-15T22:41:14.002 INFO:tasks.workunit.client.1.smithi082.stdout:1/379: rmdir d1/da 39 2024-02-15T22:41:14.002 INFO:tasks.workunit.client.1.smithi082.stdout:1/380: chown d1/da/d11/d3f/d75/f78 109732 1 2024-02-15T22:41:14.003 INFO:tasks.workunit.client.1.smithi082.stdout:2/433: dread d6/dc/d58/d49/d5e/f60 [0,4194304] 0 2024-02-15T22:41:14.007 INFO:tasks.workunit.client.1.smithi082.stdout:4/440: mknod d0/d47/ca1 0 2024-02-15T22:41:14.009 INFO:tasks.workunit.client.1.smithi082.stdout:8/420: unlink d1/d7/d48/d6f/c7c 0 2024-02-15T22:41:14.031 INFO:tasks.workunit.client.1.smithi082.stdout:9/368: creat d8/d24/d2e/f68 x:0 0 0 2024-02-15T22:41:14.033 INFO:tasks.workunit.client.1.smithi082.stdout:1/381: mkdir d1/da/d14/d7f 0 2024-02-15T22:41:14.033 INFO:tasks.workunit.client.1.smithi082.stdout:1/382: write d1/da/d14/d18/f3a [194633,3710] 0 2024-02-15T22:41:14.034 INFO:tasks.workunit.client.1.smithi082.stdout:1/383: dread - d1/da/d14/d18/d51/f59 zero size 2024-02-15T22:41:14.038 INFO:tasks.workunit.client.1.smithi082.stdout:9/369: write d8/d12/f1d [4999484,129687] 0 2024-02-15T22:41:14.038 INFO:tasks.workunit.client.1.smithi082.stdout:9/370: creat d8/d12/f69 x:0 0 0 2024-02-15T22:41:14.038 INFO:tasks.workunit.client.1.smithi082.stdout:9/371: write d8/d24/d2e/f41 [578558,107317] 0 2024-02-15T22:41:14.039 INFO:tasks.workunit.client.1.smithi082.stdout:4/441: truncate d0/f1 465016 0 2024-02-15T22:41:14.040 INFO:tasks.workunit.client.1.smithi082.stdout:7/348: rmdir d12/d27 39 2024-02-15T22:41:14.045 INFO:tasks.workunit.client.1.smithi082.stdout:1/384: write d1/f3d [2348519,80727] 0 2024-02-15T22:41:14.048 INFO:tasks.workunit.client.1.smithi082.stdout:4/442: mkdir d0/d16/d87/da2 0 2024-02-15T22:41:14.049 INFO:tasks.workunit.client.1.smithi082.stdout:8/421: rmdir d1/d7/de/d57 39 2024-02-15T22:41:14.051 INFO:tasks.workunit.client.1.smithi082.stdout:9/372: rmdir d8/d24/d2e/d56 39 2024-02-15T22:41:14.052 INFO:tasks.workunit.client.1.smithi082.stdout:1/385: symlink d1/da/d14/d18/l80 0 2024-02-15T22:41:14.052 INFO:tasks.workunit.client.1.smithi082.stdout:1/386: chown d1/f1d 62085877 1 2024-02-15T22:41:14.054 INFO:tasks.workunit.client.1.smithi082.stdout:1/387: rename d1/da/d14/d18/d1f/f77 to d1/da/d14/d18/d51/f81 0 2024-02-15T22:41:14.055 INFO:tasks.workunit.client.1.smithi082.stdout:4/443: write d0/d8/d1b/f59 [9290,17656] 0 2024-02-15T22:41:14.055 INFO:tasks.workunit.client.1.smithi082.stdout:4/444: dread - d0/d16/d4a/d6a/f91 zero size 2024-02-15T22:41:14.056 INFO:tasks.workunit.client.1.smithi082.stdout:1/388: truncate d1/da/d11/f48 3113118 0 2024-02-15T22:41:14.056 INFO:tasks.workunit.client.1.smithi082.stdout:1/389: creat d1/da/d11/f82 x:0 0 0 2024-02-15T22:41:14.057 INFO:tasks.workunit.client.1.smithi082.stdout:7/349: dwrite f6 [0,4194304] 0 2024-02-15T22:41:14.057 INFO:tasks.workunit.client.1.smithi082.stdout:7/350: fdatasync d12/d17/d3d/f55 0 2024-02-15T22:41:14.061 INFO:tasks.workunit.client.1.smithi082.stdout:8/422: dread d1/d7/d9/d42/f49 [0,4194304] 0 2024-02-15T22:41:14.063 INFO:tasks.workunit.client.1.smithi082.stdout:7/351: mknod d12/d3b/c6f 0 2024-02-15T22:41:14.063 INFO:tasks.workunit.client.1.smithi082.stdout:7/352: creat d12/d37/f70 x:0 0 0 2024-02-15T22:41:14.064 INFO:tasks.workunit.client.1.smithi082.stdout:4/445: rmdir d0/d16/d4a 39 2024-02-15T22:41:14.064 INFO:tasks.workunit.client.1.smithi082.stdout:4/446: read - d0/f75 zero size 2024-02-15T22:41:14.069 INFO:tasks.workunit.client.1.smithi082.stdout:9/373: dwrite d8/d12/d33/d3e/f5b [0,4194304] 0 2024-02-15T22:41:14.069 INFO:tasks.workunit.client.1.smithi082.stdout:7/353: unlink d12/f3c 0 2024-02-15T22:41:14.074 INFO:tasks.workunit.client.1.smithi082.stdout:9/374: rename d8/d12/d33/d3e/f5d to d8/d24/d2e/f6a 0 2024-02-15T22:41:14.076 INFO:tasks.workunit.client.1.smithi082.stdout:7/354: creat d12/d17/d42/d67/f71 x:0 0 0 2024-02-15T22:41:14.077 INFO:tasks.workunit.client.1.smithi082.stdout:9/375: creat d8/d12/d30/d3c/d65/f6b x:0 0 0 2024-02-15T22:41:14.078 INFO:tasks.workunit.client.1.smithi082.stdout:7/355: mknod d12/d3b/c72 0 2024-02-15T22:41:14.079 INFO:tasks.workunit.client.1.smithi082.stdout:9/376: symlink d8/d12/d30/d3c/l6c 0 2024-02-15T22:41:14.079 INFO:tasks.workunit.client.1.smithi082.stdout:9/377: write d8/d24/d2e/d56/f57 [982400,109075] 0 2024-02-15T22:41:14.079 INFO:tasks.workunit.client.1.smithi082.stdout:9/378: truncate d8/f1a 5750986 0 2024-02-15T22:41:14.080 INFO:tasks.workunit.client.1.smithi082.stdout:7/356: symlink d12/d27/d6e/l73 0 2024-02-15T22:41:14.080 INFO:tasks.workunit.client.1.smithi082.stdout:7/357: chown d12/d17 1099893 1 2024-02-15T22:41:14.081 INFO:tasks.workunit.client.1.smithi082.stdout:9/379: rmdir d8/d24 39 2024-02-15T22:41:14.081 INFO:tasks.workunit.client.1.smithi082.stdout:9/380: creat d8/d24/d2e/f6d x:0 0 0 2024-02-15T22:41:14.082 INFO:tasks.workunit.client.1.smithi082.stdout:7/358: mkdir d12/d27/d74 0 2024-02-15T22:41:14.082 INFO:tasks.workunit.client.1.smithi082.stdout:7/359: truncate d12/d27/f62 471985 0 2024-02-15T22:41:14.082 INFO:tasks.workunit.client.1.smithi082.stdout:7/360: rename d12/d27/d6e to d12/d27/d6e/d6a/d75 22 2024-02-15T22:41:14.085 INFO:tasks.workunit.client.1.smithi082.stdout:7/361: symlink d12/d27/d33/l76 0 2024-02-15T22:41:14.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/362: unlink d12/l1b 0 2024-02-15T22:41:14.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/363: fsync d12/d17/f25 0 2024-02-15T22:41:14.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/364: truncate d12/f22 1523661 0 2024-02-15T22:41:14.088 INFO:tasks.workunit.client.1.smithi082.stdout:7/365: truncate d12/d3b/f3f 221322 0 2024-02-15T22:41:14.088 INFO:tasks.workunit.client.1.smithi082.stdout:7/366: write f3 [1119649,30714] 0 2024-02-15T22:41:14.091 INFO:tasks.workunit.client.1.smithi082.stdout:7/367: rename d12/d27/d33/f54 to d12/d17/d42/f77 0 2024-02-15T22:41:14.091 INFO:tasks.workunit.client.1.smithi082.stdout:7/368: write d12/f22 [802719,3783] 0 2024-02-15T22:41:14.092 INFO:tasks.workunit.client.1.smithi082.stdout:7/369: symlink d12/d17/d42/l78 0 2024-02-15T22:41:14.093 INFO:tasks.workunit.client.1.smithi082.stdout:7/370: mkdir d12/d17/d42/d67/d79 0 2024-02-15T22:41:14.093 INFO:tasks.workunit.client.1.smithi082.stdout:7/371: fdatasync f6 0 2024-02-15T22:41:14.093 INFO:tasks.workunit.client.1.smithi082.stdout:7/372: write ff [1043201,60114] 0 2024-02-15T22:41:14.095 INFO:tasks.workunit.client.1.smithi082.stdout:9/381: dwrite d8/d12/d33/f63 [4194304,4194304] 0 2024-02-15T22:41:14.095 INFO:tasks.workunit.client.1.smithi082.stdout:9/382: write d8/f2c [1624467,31854] 0 2024-02-15T22:41:14.095 INFO:tasks.workunit.client.1.smithi082.stdout:9/383: write d8/f58 [1971100,117676] 0 2024-02-15T22:41:14.095 INFO:tasks.workunit.client.1.smithi082.stdout:9/384: write d8/f22 [4889062,101686] 0 2024-02-15T22:41:14.095 INFO:tasks.workunit.client.1.smithi082.stdout:7/373: rename d12/d27/f2f to d12/d17/d42/d67/f7a 0 2024-02-15T22:41:14.095 INFO:tasks.workunit.client.1.smithi082.stdout:7/374: truncate d12/d17/d3d/f40 1551716 0 2024-02-15T22:41:14.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/375: link d12/d17/d42/c68 d12/d27/d74/c7b 0 2024-02-15T22:41:14.099 INFO:tasks.workunit.client.1.smithi082.stdout:9/385: getdents d8/d12 0 2024-02-15T22:41:14.099 INFO:tasks.workunit.client.1.smithi082.stdout:9/386: creat d8/d12/d30/d3c/d65/f6e x:0 0 0 2024-02-15T22:41:14.099 INFO:tasks.workunit.client.1.smithi082.stdout:9/387: write d8/d24/d2e/d56/f57 [894499,7401] 0 2024-02-15T22:41:14.104 INFO:tasks.workunit.client.1.smithi082.stdout:7/376: rmdir d12/d37 39 2024-02-15T22:41:14.104 INFO:tasks.workunit.client.1.smithi082.stdout:7/377: chown d12/d3b/d41/f60 1242 1 2024-02-15T22:41:14.105 INFO:tasks.workunit.client.1.smithi082.stdout:7/378: mknod d12/d3b/c7c 0 2024-02-15T22:41:14.107 INFO:tasks.workunit.client.1.smithi082.stdout:7/379: truncate f6 2192583 0 2024-02-15T22:41:14.108 INFO:tasks.workunit.client.1.smithi082.stdout:7/380: mkdir d12/d17/d4d/d7d 0 2024-02-15T22:41:14.109 INFO:tasks.workunit.client.1.smithi082.stdout:7/381: symlink d12/d17/d42/d67/d79/l7e 0 2024-02-15T22:41:14.116 INFO:tasks.workunit.client.1.smithi082.stdout:9/388: dwrite d8/f2b [4194304,4194304] 0 2024-02-15T22:41:14.116 INFO:tasks.workunit.client.1.smithi082.stdout:9/389: write d8/d24/d2e/d56/f60 [211859,102787] 0 2024-02-15T22:41:14.117 INFO:tasks.workunit.client.1.smithi082.stdout:9/390: write d8/d12/f2f [68219,51174] 0 2024-02-15T22:41:14.117 INFO:tasks.workunit.client.1.smithi082.stdout:9/391: write d8/d12/d30/f51 [344711,1050] 0 2024-02-15T22:41:14.118 INFO:tasks.workunit.client.1.smithi082.stdout:9/392: symlink d8/d24/d2e/d53/l6f 0 2024-02-15T22:41:14.119 INFO:tasks.workunit.client.1.smithi082.stdout:9/393: mkdir d8/d12/d67/d70 0 2024-02-15T22:41:14.120 INFO:tasks.workunit.client.1.smithi082.stdout:9/394: truncate d8/f18 4120973 0 2024-02-15T22:41:14.122 INFO:tasks.workunit.client.1.smithi082.stdout:9/395: mkdir d8/d12/d30/d3c/d71 0 2024-02-15T22:41:14.122 INFO:tasks.workunit.client.1.smithi082.stdout:9/396: fdatasync d8/d12/d30/f3d 0 2024-02-15T22:41:14.122 INFO:tasks.workunit.client.1.smithi082.stdout:9/397: truncate d8/d24/d2e/d56/f60 826717 0 2024-02-15T22:41:14.124 INFO:tasks.workunit.client.1.smithi082.stdout:7/382: dread d12/d17/f1a [0,4194304] 0 2024-02-15T22:41:14.135 INFO:tasks.workunit.client.1.smithi082.stdout:7/383: dread d12/f21 [0,4194304] 0 2024-02-15T22:41:14.135 INFO:tasks.workunit.client.1.smithi082.stdout:7/384: fdatasync d12/d27/f62 0 2024-02-15T22:41:14.135 INFO:tasks.workunit.client.1.smithi082.stdout:7/385: truncate ff 1490095 0 2024-02-15T22:41:14.137 INFO:tasks.workunit.client.1.smithi082.stdout:7/386: rename d12/d17/l48 to d12/d3b/d41/l7f 0 2024-02-15T22:41:14.139 INFO:tasks.workunit.client.1.smithi082.stdout:9/398: dwrite d8/d12/d30/d3c/d65/f6e [0,4194304] 0 2024-02-15T22:41:14.144 INFO:tasks.workunit.client.1.smithi082.stdout:7/387: write d12/d17/d42/f53 [325980,75359] 0 2024-02-15T22:41:14.144 INFO:tasks.workunit.client.1.smithi082.stdout:7/388: stat d12/f2d 0 2024-02-15T22:41:14.156 INFO:tasks.workunit.client.1.smithi082.stdout:9/399: dwrite d8/f44 [0,4194304] 0 2024-02-15T22:41:14.156 INFO:tasks.workunit.client.1.smithi082.stdout:9/400: chown d8/d12/d33 1648 1 2024-02-15T22:41:14.171 INFO:tasks.workunit.client.1.smithi082.stdout:9/401: dwrite d8/d24/d2e/f6a [0,4194304] 0 2024-02-15T22:41:14.174 INFO:tasks.workunit.client.1.smithi082.stdout:9/402: dread d8/d24/d2e/d56/f57 [0,4194304] 0 2024-02-15T22:41:14.200 INFO:tasks.workunit.client.1.smithi082.stdout:7/389: rename fb to d12/d3b/f80 0 2024-02-15T22:41:14.202 INFO:tasks.workunit.client.1.smithi082.stdout:9/403: creat d8/d24/d2e/d56/f72 x:0 0 0 2024-02-15T22:41:14.203 INFO:tasks.workunit.client.1.smithi082.stdout:9/404: mknod d8/d12/d33/d64/c73 0 2024-02-15T22:41:14.203 INFO:tasks.workunit.client.1.smithi082.stdout:9/405: truncate d8/d24/d2e/d56/f72 400590 0 2024-02-15T22:41:14.204 INFO:tasks.workunit.client.1.smithi082.stdout:9/406: fsync d8/d12/d30/f3d 0 2024-02-15T22:41:14.204 INFO:tasks.workunit.client.1.smithi082.stdout:9/407: write d8/d12/f4d [581135,115885] 0 2024-02-15T22:41:14.210 INFO:tasks.workunit.client.1.smithi082.stdout:7/390: dread d12/d17/f5f [0,4194304] 0 2024-02-15T22:41:14.211 INFO:tasks.workunit.client.1.smithi082.stdout:7/391: mkdir d12/d17/d42/d67/d81 0 2024-02-15T22:41:14.216 INFO:tasks.workunit.client.1.smithi082.stdout:7/392: dread d12/f22 [0,4194304] 0 2024-02-15T22:41:14.216 INFO:tasks.workunit.client.1.smithi082.stdout:7/393: fdatasync d12/f21 0 2024-02-15T22:41:14.217 INFO:tasks.workunit.client.1.smithi082.stdout:7/394: creat d12/d27/d74/f82 x:0 0 0 2024-02-15T22:41:14.217 INFO:tasks.workunit.client.1.smithi082.stdout:7/395: stat d12/d17/f1a 0 2024-02-15T22:41:14.217 INFO:tasks.workunit.client.1.smithi082.stdout:7/396: stat d12/l15 0 2024-02-15T22:41:14.218 INFO:tasks.workunit.client.1.smithi082.stdout:7/397: symlink d12/d27/d33/l83 0 2024-02-15T22:41:14.218 INFO:tasks.workunit.client.1.smithi082.stdout:7/398: mknod d12/d17/d42/d67/d79/c84 0 2024-02-15T22:41:14.219 INFO:tasks.workunit.client.1.smithi082.stdout:7/399: chown d12/d17/c1e 244323 1 2024-02-15T22:41:14.219 INFO:tasks.workunit.client.1.smithi082.stdout:7/400: mkdir d12/d37/d85 0 2024-02-15T22:41:14.219 INFO:tasks.workunit.client.1.smithi082.stdout:7/401: readlink la 0 2024-02-15T22:41:14.221 INFO:tasks.workunit.client.1.smithi082.stdout:9/408: dwrite d8/d24/d2e/d56/f72 [0,4194304] 0 2024-02-15T22:41:14.228 INFO:tasks.workunit.client.1.smithi082.stdout:7/402: dread d12/d17/f1a [0,4194304] 0 2024-02-15T22:41:14.229 INFO:tasks.workunit.client.1.smithi082.stdout:7/403: write d12/f47 [3344295,84923] 0 2024-02-15T22:41:14.229 INFO:tasks.workunit.client.1.smithi082.stdout:7/404: chown d12/d3b/d41/l4a 1 1 2024-02-15T22:41:14.229 INFO:tasks.workunit.client.1.smithi082.stdout:7/405: creat d12/d3b/f86 x:0 0 0 2024-02-15T22:41:14.233 INFO:tasks.workunit.client.1.smithi082.stdout:9/409: write f5 [852527,27811] 0 2024-02-15T22:41:14.257 INFO:tasks.workunit.client.1.smithi082.stdout:9/410: dwrite d8/d12/d33/f3b [0,4194304] 0 2024-02-15T22:41:14.257 INFO:tasks.workunit.client.1.smithi082.stdout:9/411: dread - d8/d12/d30/d3c/d65/f6b zero size 2024-02-15T22:41:14.260 INFO:tasks.workunit.client.1.smithi082.stdout:9/412: rmdir d8/d24/d2e/d56 39 2024-02-15T22:41:14.297 INFO:tasks.workunit.client.1.smithi082.stdout:9/413: getdents d8/d12/d30/d3c 0 2024-02-15T22:41:14.297 INFO:tasks.workunit.client.1.smithi082.stdout:9/414: read d8/d24/f4b [868224,118806] 0 2024-02-15T22:41:14.297 INFO:tasks.workunit.client.1.smithi082.stdout:9/415: getdents d8/d12/d30/d3c 0 2024-02-15T22:41:14.300 INFO:tasks.workunit.client.1.smithi082.stdout:9/416: rename d8/d12/d30/l40 to d8/d12/d33/d64/l74 0 2024-02-15T22:41:14.301 INFO:tasks.workunit.client.1.smithi082.stdout:9/417: rmdir d8/d12/d30/d3c 39 2024-02-15T22:41:14.301 INFO:tasks.workunit.client.1.smithi082.stdout:9/418: write d8/d24/d2e/f41 [599874,61066] 0 2024-02-15T22:41:14.301 INFO:tasks.workunit.client.1.smithi082.stdout:9/419: readlink d8/d12/l31 0 2024-02-15T22:41:14.301 INFO:tasks.workunit.client.1.smithi082.stdout:9/420: chown d8/d24/d2e/d53/l6f 6 1 2024-02-15T22:41:14.317 INFO:tasks.workunit.client.1.smithi082.stdout:9/421: dwrite d8/f18 [4194304,4194304] 0 2024-02-15T22:41:14.321 INFO:tasks.workunit.client.1.smithi082.stdout:9/422: dread d8/f1a [4194304,4194304] 0 2024-02-15T22:41:14.323 INFO:tasks.workunit.client.1.smithi082.stdout:9/423: symlink d8/d12/d33/l75 0 2024-02-15T22:41:14.325 INFO:tasks.workunit.client.1.smithi082.stdout:9/424: dread d8/d24/d2e/d56/f57 [0,4194304] 0 2024-02-15T22:41:14.338 INFO:tasks.workunit.client.1.smithi082.stdout:9/425: dread d8/d12/d33/f63 [4194304,4194304] 0 2024-02-15T22:41:14.365 INFO:tasks.workunit.client.1.smithi082.stdout:6/497: sync 2024-02-15T22:41:14.365 INFO:tasks.workunit.client.1.smithi082.stdout:5/340: sync 2024-02-15T22:41:14.365 INFO:tasks.workunit.client.1.smithi082.stdout:5/341: chown d5/da/dc/d43 10 1 2024-02-15T22:41:14.365 INFO:tasks.workunit.client.1.smithi082.stdout:9/426: dwrite d8/d24/d2e/d53/f59 [0,4194304] 0 2024-02-15T22:41:14.365 INFO:tasks.workunit.client.1.smithi082.stdout:5/342: write d5/f2e [4858344,121152] 0 2024-02-15T22:41:14.368 INFO:tasks.workunit.client.1.smithi082.stdout:5/343: getdents d5/da/d56 0 2024-02-15T22:41:14.368 INFO:tasks.workunit.client.1.smithi082.stdout:9/427: rmdir d8/d24/d2e 39 2024-02-15T22:41:14.371 INFO:tasks.workunit.client.1.smithi082.stdout:5/344: rmdir d5/da/d22/d59 39 2024-02-15T22:41:14.372 INFO:tasks.workunit.client.1.smithi082.stdout:5/345: mkdir d5/da/d56/d6e 0 2024-02-15T22:41:14.375 INFO:tasks.workunit.client.1.smithi082.stdout:5/346: dread d5/f32 [0,4194304] 0 2024-02-15T22:41:14.376 INFO:tasks.workunit.client.1.smithi082.stdout:5/347: symlink d5/da/l6f 0 2024-02-15T22:41:14.380 INFO:tasks.workunit.client.1.smithi082.stdout:9/428: dread d8/f2b [0,4194304] 0 2024-02-15T22:41:14.401 INFO:tasks.workunit.client.1.smithi082.stdout:9/429: dwrite d8/d24/d2e/f6d [0,4194304] 0 2024-02-15T22:41:14.401 INFO:tasks.workunit.client.1.smithi082.stdout:9/430: fsync d8/f2b 0 2024-02-15T22:41:14.401 INFO:tasks.workunit.client.1.smithi082.stdout:5/348: dwrite d5/da/f26 [0,4194304] 0 2024-02-15T22:41:14.401 INFO:tasks.workunit.client.1.smithi082.stdout:5/349: dread - d5/da/dc/f4f zero size 2024-02-15T22:41:14.403 INFO:tasks.workunit.client.1.smithi082.stdout:5/350: dread d5/da/f65 [0,4194304] 0 2024-02-15T22:41:14.403 INFO:tasks.workunit.client.1.smithi082.stdout:9/431: creat d8/d12/d67/d70/f76 x:0 0 0 2024-02-15T22:41:14.427 INFO:tasks.workunit.client.1.smithi082.stdout:9/432: dwrite d8/d12/f1e [0,4194304] 0 2024-02-15T22:41:14.427 INFO:tasks.workunit.client.1.smithi082.stdout:5/351: dwrite d5/da/d22/d59/f5c [0,4194304] 0 2024-02-15T22:41:14.430 INFO:tasks.workunit.client.1.smithi082.stdout:5/352: rename d5/da/d14/f1b to d5/da/d14/d53/f70 0 2024-02-15T22:41:14.430 INFO:tasks.workunit.client.1.smithi082.stdout:5/353: dread - d5/da/f5e zero size 2024-02-15T22:41:14.431 INFO:tasks.workunit.client.1.smithi082.stdout:5/354: creat d5/da/d14/d53/f71 x:0 0 0 2024-02-15T22:41:14.431 INFO:tasks.workunit.client.1.smithi082.stdout:5/355: write d5/da/dc/f15 [1876235,75926] 0 2024-02-15T22:41:14.431 INFO:tasks.workunit.client.1.smithi082.stdout:5/356: chown d5/da/dc/l49 6 1 2024-02-15T22:41:14.432 INFO:tasks.workunit.client.1.smithi082.stdout:5/357: symlink d5/da/d14/l72 0 2024-02-15T22:41:14.432 INFO:tasks.workunit.client.1.smithi082.stdout:5/358: stat d5/da 0 2024-02-15T22:41:14.432 INFO:tasks.workunit.client.1.smithi082.stdout:5/359: mkdir d5/da/d56/d6e/d73 0 2024-02-15T22:41:14.435 INFO:tasks.workunit.client.1.smithi082.stdout:5/360: dread d5/da/f24 [0,4194304] 0 2024-02-15T22:41:14.436 INFO:tasks.workunit.client.1.smithi082.stdout:5/361: symlink d5/l74 0 2024-02-15T22:41:14.437 INFO:tasks.workunit.client.1.smithi082.stdout:5/362: creat d5/da/d14/f75 x:0 0 0 2024-02-15T22:41:14.437 INFO:tasks.workunit.client.1.smithi082.stdout:5/363: write d5/da/dc/f10 [4622360,99923] 0 2024-02-15T22:41:14.438 INFO:tasks.workunit.client.1.smithi082.stdout:5/364: creat d5/da/d67/f76 x:0 0 0 2024-02-15T22:41:14.438 INFO:tasks.workunit.client.1.smithi082.stdout:5/365: mknod d5/da/d14/d45/d52/c77 0 2024-02-15T22:41:14.440 INFO:tasks.workunit.client.1.smithi082.stdout:9/433: dread d8/f18 [4194304,4194304] 0 2024-02-15T22:41:14.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/434: mkdir d8/d12/d33/d64/d77 0 2024-02-15T22:41:14.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/435: chown d8/d12/f69 1066890083 1 2024-02-15T22:41:14.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/436: fdatasync d8/d24/d2e/d56/f57 0 2024-02-15T22:41:14.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/437: creat d8/d12/d67/d70/f78 x:0 0 0 2024-02-15T22:41:14.443 INFO:tasks.workunit.client.1.smithi082.stdout:9/438: mknod d8/d12/d67/c79 0 2024-02-15T22:41:14.444 INFO:tasks.workunit.client.1.smithi082.stdout:9/439: mknod d8/c7a 0 2024-02-15T22:41:14.445 INFO:tasks.workunit.client.1.smithi082.stdout:9/440: rmdir d8/d24/d2e/d56 39 2024-02-15T22:41:14.446 INFO:tasks.workunit.client.1.smithi082.stdout:9/441: rename d8/l4c to d8/d12/d67/l7b 0 2024-02-15T22:41:14.448 INFO:tasks.workunit.client.1.smithi082.stdout:9/442: mkdir d8/d12/d33/d64/d7c 0 2024-02-15T22:41:14.449 INFO:tasks.workunit.client.1.smithi082.stdout:5/366: getdents d5/da/d14/d45/d52 0 2024-02-15T22:41:14.450 INFO:tasks.workunit.client.1.smithi082.stdout:5/367: mknod d5/da/d22/d59/c78 0 2024-02-15T22:41:14.450 INFO:tasks.workunit.client.1.smithi082.stdout:5/368: chown d5/da/d67/f76 309475548 1 2024-02-15T22:41:14.452 INFO:tasks.workunit.client.1.smithi082.stdout:5/369: symlink d5/da/d67/l79 0 2024-02-15T22:41:14.453 INFO:tasks.workunit.client.1.smithi082.stdout:5/370: symlink d5/da/dc/l7a 0 2024-02-15T22:41:14.469 INFO:tasks.workunit.client.1.smithi082.stdout:5/371: dwrite d5/da/dc/d43/f4d [0,4194304] 0 2024-02-15T22:41:14.469 INFO:tasks.workunit.client.1.smithi082.stdout:5/372: chown d5/c41 120767193 1 2024-02-15T22:41:14.469 INFO:tasks.workunit.client.1.smithi082.stdout:5/373: write d5/da/f5e [463223,50984] 0 2024-02-15T22:41:14.469 INFO:tasks.workunit.client.1.smithi082.stdout:5/374: stat d5/da/d22/l34 0 2024-02-15T22:41:14.471 INFO:tasks.workunit.client.1.smithi082.stdout:5/375: write d5/da/d14/f50 [151166,6342] 0 2024-02-15T22:41:14.471 INFO:tasks.workunit.client.1.smithi082.stdout:5/376: truncate d5/da/d14/d53/f5f 780588 0 2024-02-15T22:41:14.471 INFO:tasks.workunit.client.1.smithi082.stdout:5/377: chown d5/f2e 479002958 1 2024-02-15T22:41:14.472 INFO:tasks.workunit.client.1.smithi082.stdout:5/378: creat d5/da/d14/d53/f7b x:0 0 0 2024-02-15T22:41:14.473 INFO:tasks.workunit.client.1.smithi082.stdout:5/379: symlink d5/da/d56/d6e/d73/l7c 0 2024-02-15T22:41:14.473 INFO:tasks.workunit.client.1.smithi082.stdout:5/380: mknod d5/da/d14/d45/d52/c7d 0 2024-02-15T22:41:14.474 INFO:tasks.workunit.client.1.smithi082.stdout:5/381: symlink d5/l7e 0 2024-02-15T22:41:14.475 INFO:tasks.workunit.client.1.smithi082.stdout:5/382: mknod d5/da/c7f 0 2024-02-15T22:41:14.475 INFO:tasks.workunit.client.1.smithi082.stdout:5/383: chown d5/da/d14/d53/f71 46190 1 2024-02-15T22:41:14.475 INFO:tasks.workunit.client.1.smithi082.stdout:5/384: truncate d5/da/d22/f3f 1216497 0 2024-02-15T22:41:14.476 INFO:tasks.workunit.client.1.smithi082.stdout:5/385: write d5/da/d14/d53/f7b [537447,81482] 0 2024-02-15T22:41:14.476 INFO:tasks.workunit.client.1.smithi082.stdout:5/386: stat d5/da/d56 0 2024-02-15T22:41:14.476 INFO:tasks.workunit.client.1.smithi082.stdout:5/387: creat d5/da/d22/d59/f80 x:0 0 0 2024-02-15T22:41:14.477 INFO:tasks.workunit.client.1.smithi082.stdout:5/388: creat d5/da/d56/d6e/f81 x:0 0 0 2024-02-15T22:41:14.478 INFO:tasks.workunit.client.1.smithi082.stdout:5/389: getdents d5/da/d56 0 2024-02-15T22:41:14.483 INFO:tasks.workunit.client.1.smithi082.stdout:5/390: getdents d5/da/d22/d59 0 2024-02-15T22:41:14.483 INFO:tasks.workunit.client.1.smithi082.stdout:5/391: truncate d5/da/d14/f75 348069 0 2024-02-15T22:41:14.600 INFO:tasks.workunit.client.1.smithi082.stdout:0/357: sync 2024-02-15T22:41:14.600 INFO:tasks.workunit.client.1.smithi082.stdout:3/371: sync 2024-02-15T22:41:14.600 INFO:tasks.workunit.client.1.smithi082.stdout:0/358: chown d3/d19/d25/d45/f2a 5 1 2024-02-15T22:41:14.601 INFO:tasks.workunit.client.1.smithi082.stdout:3/372: rename d0/l55 to d0/d16/d62/d14/d21/d41/l7c 0 2024-02-15T22:41:14.601 INFO:tasks.workunit.client.1.smithi082.stdout:3/373: stat d0/d16/d62/d14 0 2024-02-15T22:41:14.602 INFO:tasks.workunit.client.1.smithi082.stdout:3/374: mkdir d0/d16/d62/d14/d21/d7d 0 2024-02-15T22:41:14.609 INFO:tasks.workunit.client.1.smithi082.stdout:3/375: dread d0/dc/f51 [0,4194304] 0 2024-02-15T22:41:14.624 INFO:tasks.workunit.client.1.smithi082.stdout:3/376: dwrite d0/d16/d62/d2e/d4c/f64 [0,4194304] 0 2024-02-15T22:41:14.638 INFO:tasks.workunit.client.1.smithi082.stdout:3/377: dwrite d0/d16/f3a [0,4194304] 0 2024-02-15T22:41:14.638 INFO:tasks.workunit.client.1.smithi082.stdout:3/378: fsync d0/f2 0 2024-02-15T22:41:14.638 INFO:tasks.workunit.client.1.smithi082.stdout:3/379: chown d0/d16/d62/d14/d21/f35 49773444 1 2024-02-15T22:41:14.647 INFO:tasks.workunit.client.1.smithi082.stdout:3/380: write d0/d16/f32 [1935068,47443] 0 2024-02-15T22:41:14.657 INFO:tasks.workunit.client.1.smithi082.stdout:1/390: sync 2024-02-15T22:41:14.657 INFO:tasks.workunit.client.1.smithi082.stdout:2/434: sync 2024-02-15T22:41:14.659 INFO:tasks.workunit.client.1.smithi082.stdout:2/435: unlink d6/dc/d12/d46/c53 0 2024-02-15T22:41:14.659 INFO:tasks.workunit.client.1.smithi082.stdout:2/436: chown d6/dc/f89 2 1 2024-02-15T22:41:14.659 INFO:tasks.workunit.client.1.smithi082.stdout:2/437: creat d6/dc/dd/f8a x:0 0 0 2024-02-15T22:41:14.659 INFO:tasks.workunit.client.1.smithi082.stdout:2/438: chown d6/d3c/c5c 74 1 2024-02-15T22:41:14.668 INFO:tasks.workunit.client.1.smithi082.stdout:2/439: dread d6/dc/d58/f19 [0,4194304] 0 2024-02-15T22:41:14.677 INFO:tasks.workunit.client.1.smithi082.stdout:1/391: dwrite d1/da/d11/d3f/f53 [0,4194304] 0 2024-02-15T22:41:14.677 INFO:tasks.workunit.client.1.smithi082.stdout:3/381: dwrite d0/dc/f5c [0,4194304] 0 2024-02-15T22:41:14.677 INFO:tasks.workunit.client.1.smithi082.stdout:3/382: creat d0/d16/d62/f7e x:0 0 0 2024-02-15T22:41:14.678 INFO:tasks.workunit.client.1.smithi082.stdout:3/383: chown d0/d16/d62/l73 0 1 2024-02-15T22:41:14.682 INFO:tasks.workunit.client.1.smithi082.stdout:1/392: link d1/da/d14/d18/d51/c56 d1/da/d14/d18/d1f/c83 0 2024-02-15T22:41:14.682 INFO:tasks.workunit.client.1.smithi082.stdout:1/393: creat d1/da/d14/d18/d1f/f84 x:0 0 0 2024-02-15T22:41:14.683 INFO:tasks.workunit.client.1.smithi082.stdout:1/394: fsync d1/f3d 0 2024-02-15T22:41:14.683 INFO:tasks.workunit.client.1.smithi082.stdout:1/395: write d1/da/d14/d18/d1f/f4f [4978781,110507] 0 2024-02-15T22:41:14.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/384: dwrite d0/d16/f32 [0,4194304] 0 2024-02-15T22:41:14.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/385: readlink d0/d16/d62/d14/d21/l3c 0 2024-02-15T22:41:14.701 INFO:tasks.workunit.client.1.smithi082.stdout:3/386: creat d0/d53/f7f x:0 0 0 2024-02-15T22:41:14.701 INFO:tasks.workunit.client.1.smithi082.stdout:3/387: write d0/d16/d62/d14/f40 [215805,94729] 0 2024-02-15T22:41:14.702 INFO:tasks.workunit.client.1.smithi082.stdout:3/388: rename d0/d16/d62/d2e/d4c/l60 to d0/d16/d62/d2e/d4c/l80 0 2024-02-15T22:41:14.705 INFO:tasks.workunit.client.1.smithi082.stdout:1/396: dwrite d1/da/d11/d3f/f46 [0,4194304] 0 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:9/443: sync 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:8/423: sync 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:5/392: sync 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:6/498: sync 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:8/424: chown d1/d7 3066209 1 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:4/447: sync 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:7/406: sync 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:7/407: fdatasync d12/d27/f6d 0 2024-02-15T22:41:14.707 INFO:tasks.workunit.client.1.smithi082.stdout:7/408: chown d12/d17/d42/c6b 227 1 2024-02-15T22:41:14.708 INFO:tasks.workunit.client.1.smithi082.stdout:5/393: creat d5/da/d56/d6e/f82 x:0 0 0 2024-02-15T22:41:14.708 INFO:tasks.workunit.client.1.smithi082.stdout:1/397: unlink d1/da/d14/f2a 0 2024-02-15T22:41:14.709 INFO:tasks.workunit.client.1.smithi082.stdout:9/444: link d8/l15 d8/d12/d33/d3e/l7d 0 2024-02-15T22:41:14.709 INFO:tasks.workunit.client.1.smithi082.stdout:9/445: getdents d8/d12 0 2024-02-15T22:41:14.711 INFO:tasks.workunit.client.1.smithi082.stdout:8/425: symlink d1/d7/d48/l95 0 2024-02-15T22:41:14.711 INFO:tasks.workunit.client.1.smithi082.stdout:8/426: readlink d1/d7/l3b 0 2024-02-15T22:41:14.712 INFO:tasks.workunit.client.1.smithi082.stdout:6/499: getdents d2/d18/d8a/d65 0 2024-02-15T22:41:14.716 INFO:tasks.workunit.client.1.smithi082.stdout:4/448: getdents d0 0 2024-02-15T22:41:14.716 INFO:tasks.workunit.client.1.smithi082.stdout:4/449: readlink d0/d16/l97 0 2024-02-15T22:41:14.716 INFO:tasks.workunit.client.1.smithi082.stdout:4/450: creat d0/d8/d32/fa3 x:0 0 0 2024-02-15T22:41:14.716 INFO:tasks.workunit.client.1.smithi082.stdout:4/451: truncate d0/d16/f30 2214241 0 2024-02-15T22:41:14.717 INFO:tasks.workunit.client.1.smithi082.stdout:9/446: dread d8/d24/d2e/f38 [0,4194304] 0 2024-02-15T22:41:14.717 INFO:tasks.workunit.client.1.smithi082.stdout:9/447: getdents d8/d12/d33/d64/d77 0 2024-02-15T22:41:14.717 INFO:tasks.workunit.client.1.smithi082.stdout:9/448: write d8/d12/f69 [608125,27990] 0 2024-02-15T22:41:14.717 INFO:tasks.workunit.client.1.smithi082.stdout:7/409: rename d12/f47 to d12/d17/d42/f87 0 2024-02-15T22:41:14.718 INFO:tasks.workunit.client.1.smithi082.stdout:5/394: creat d5/da/d22/f83 x:0 0 0 2024-02-15T22:41:14.719 INFO:tasks.workunit.client.1.smithi082.stdout:1/398: unlink d1/da/d11/f16 0 2024-02-15T22:41:14.719 INFO:tasks.workunit.client.1.smithi082.stdout:5/395: write d5/da/f25 [898515,18101] 0 2024-02-15T22:41:14.721 INFO:tasks.workunit.client.1.smithi082.stdout:6/500: rmdir d2/d30/d3b/da0 0 2024-02-15T22:41:14.721 INFO:tasks.workunit.client.1.smithi082.stdout:6/501: readlink d2/la 0 2024-02-15T22:41:14.721 INFO:tasks.workunit.client.1.smithi082.stdout:6/502: write d2/d18/d8a/d47/f7b [1589540,67773] 0 2024-02-15T22:41:14.723 INFO:tasks.workunit.client.1.smithi082.stdout:4/452: mkdir d0/d8/d32/d39/da4 0 2024-02-15T22:41:14.724 INFO:tasks.workunit.client.1.smithi082.stdout:4/453: dread d0/d16/d4a/f52 [0,4194304] 0 2024-02-15T22:41:14.725 INFO:tasks.workunit.client.1.smithi082.stdout:7/410: unlink d12/d27/f62 0 2024-02-15T22:41:14.727 INFO:tasks.workunit.client.1.smithi082.stdout:1/399: creat d1/da/d14/d7f/f85 x:0 0 0 2024-02-15T22:41:14.728 INFO:tasks.workunit.client.1.smithi082.stdout:5/396: mkdir d5/da/d22/d59/d84 0 2024-02-15T22:41:14.728 INFO:tasks.workunit.client.1.smithi082.stdout:5/397: creat d5/da/d14/d53/f85 x:0 0 0 2024-02-15T22:41:14.729 INFO:tasks.workunit.client.1.smithi082.stdout:8/427: dwrite d1/d7/d9/d42/f46 [0,4194304] 0 2024-02-15T22:41:14.730 INFO:tasks.workunit.client.1.smithi082.stdout:9/449: rmdir d8/d12/d33 39 2024-02-15T22:41:14.731 INFO:tasks.workunit.client.1.smithi082.stdout:9/450: creat d8/d12/d30/f7e x:0 0 0 2024-02-15T22:41:14.733 INFO:tasks.workunit.client.1.smithi082.stdout:7/411: creat d12/d3b/d41/f88 x:0 0 0 2024-02-15T22:41:14.733 INFO:tasks.workunit.client.1.smithi082.stdout:7/412: fsync d12/f2d 0 2024-02-15T22:41:14.733 INFO:tasks.workunit.client.1.smithi082.stdout:7/413: stat d12/d3b 0 2024-02-15T22:41:14.733 INFO:tasks.workunit.client.1.smithi082.stdout:7/414: creat d12/d3b/f89 x:0 0 0 2024-02-15T22:41:14.733 INFO:tasks.workunit.client.1.smithi082.stdout:7/415: write d12/d3b/f89 [820048,98767] 0 2024-02-15T22:41:14.733 INFO:tasks.workunit.client.1.smithi082.stdout:7/416: write d12/d3b/f3f [908129,46979] 0 2024-02-15T22:41:14.736 INFO:tasks.workunit.client.1.smithi082.stdout:1/400: rename d1/da/d14/d18/d1f/f58 to d1/da/d14/d18/d6d/f86 0 2024-02-15T22:41:14.736 INFO:tasks.workunit.client.1.smithi082.stdout:1/401: stat d1/da/d14/d18/d1f/f64 0 2024-02-15T22:41:14.739 INFO:tasks.workunit.client.1.smithi082.stdout:5/398: creat d5/da/d56/f86 x:0 0 0 2024-02-15T22:41:14.741 INFO:tasks.workunit.client.1.smithi082.stdout:4/454: dwrite d0/d8/d1b/dd/f41 [0,4194304] 0 2024-02-15T22:41:14.742 INFO:tasks.workunit.client.1.smithi082.stdout:8/428: truncate d1/f21 632753 0 2024-02-15T22:41:14.742 INFO:tasks.workunit.client.1.smithi082.stdout:8/429: chown d1/l1f 5 1 2024-02-15T22:41:14.743 INFO:tasks.workunit.client.1.smithi082.stdout:9/451: symlink d8/d24/d2e/d53/l7f 0 2024-02-15T22:41:14.743 INFO:tasks.workunit.client.1.smithi082.stdout:9/452: getdents d8/d12 0 2024-02-15T22:41:14.745 INFO:tasks.workunit.client.1.smithi082.stdout:1/402: mknod d1/da/d11/d3f/c87 0 2024-02-15T22:41:14.747 INFO:tasks.workunit.client.1.smithi082.stdout:5/399: mknod d5/da/d22/c87 0 2024-02-15T22:41:14.747 INFO:tasks.workunit.client.1.smithi082.stdout:5/400: fdatasync d5/da/d67/f68 0 2024-02-15T22:41:14.751 INFO:tasks.workunit.client.1.smithi082.stdout:5/401: rename d5/da/d14/d45/l47 to d5/da/d56/l88 0 2024-02-15T22:41:14.753 INFO:tasks.workunit.client.1.smithi082.stdout:5/402: mkdir d5/da/d22/d59/d84/d89 0 2024-02-15T22:41:14.753 INFO:tasks.workunit.client.1.smithi082.stdout:5/403: chown d5/da/dc/l16 310020 1 2024-02-15T22:41:14.753 INFO:tasks.workunit.client.1.smithi082.stdout:4/455: dread d0/d8/d1b/f35 [0,4194304] 0 2024-02-15T22:41:14.753 INFO:tasks.workunit.client.1.smithi082.stdout:4/456: chown d0/d8/d1b/d70/l92 10 1 2024-02-15T22:41:14.755 INFO:tasks.workunit.client.1.smithi082.stdout:5/404: rename d5/da/d22/c87 to d5/c8a 0 2024-02-15T22:41:14.755 INFO:tasks.workunit.client.1.smithi082.stdout:8/430: dread d1/d7/de/d1e/f27 [0,4194304] 0 2024-02-15T22:41:14.757 INFO:tasks.workunit.client.1.smithi082.stdout:4/457: symlink d0/d47/la5 0 2024-02-15T22:41:14.758 INFO:tasks.workunit.client.1.smithi082.stdout:5/405: symlink d5/da/d22/d59/d84/l8b 0 2024-02-15T22:41:14.758 INFO:tasks.workunit.client.1.smithi082.stdout:5/406: chown d5/da/d56/d6e 386 1 2024-02-15T22:41:14.758 INFO:tasks.workunit.client.1.smithi082.stdout:5/407: chown d5/da/d14/f50 34 1 2024-02-15T22:41:14.762 INFO:tasks.workunit.client.1.smithi082.stdout:4/458: rename d0/d16/d83 to d0/d47/da6 0 2024-02-15T22:41:14.762 INFO:tasks.workunit.client.1.smithi082.stdout:5/408: dread d5/da/d22/f3f [0,4194304] 0 2024-02-15T22:41:14.762 INFO:tasks.workunit.client.1.smithi082.stdout:5/409: chown d5/da/dc/ff 412 1 2024-02-15T22:41:14.763 INFO:tasks.workunit.client.1.smithi082.stdout:8/431: mkdir d1/d7/d9/d96 0 2024-02-15T22:41:14.764 INFO:tasks.workunit.client.1.smithi082.stdout:1/403: write d1/f1d [3693600,47507] 0 2024-02-15T22:41:14.766 INFO:tasks.workunit.client.1.smithi082.stdout:1/404: fsync d1/da/d14/d18/d1f/f50 0 2024-02-15T22:41:14.766 INFO:tasks.workunit.client.1.smithi082.stdout:1/405: readlink d1/da/d14/l35 0 2024-02-15T22:41:14.766 INFO:tasks.workunit.client.1.smithi082.stdout:1/406: dread - d1/da/d14/d7f/f85 zero size 2024-02-15T22:41:14.766 INFO:tasks.workunit.client.1.smithi082.stdout:1/407: write d1/da/d14/d18/d1f/f64 [115222,65999] 0 2024-02-15T22:41:14.770 INFO:tasks.workunit.client.1.smithi082.stdout:1/408: creat d1/d57/f88 x:0 0 0 2024-02-15T22:41:14.775 INFO:tasks.workunit.client.1.smithi082.stdout:7/417: dwrite d12/f16 [0,4194304] 0 2024-02-15T22:41:14.775 INFO:tasks.workunit.client.1.smithi082.stdout:4/459: dread d0/d8/d32/f4e [0,4194304] 0 2024-02-15T22:41:14.776 INFO:tasks.workunit.client.1.smithi082.stdout:1/409: dread d1/da/d14/d18/d1f/d2f/f3e [0,4194304] 0 2024-02-15T22:41:14.778 INFO:tasks.workunit.client.1.smithi082.stdout:4/460: truncate d0/d16/f3a 1119001 0 2024-02-15T22:41:14.779 INFO:tasks.workunit.client.1.smithi082.stdout:9/453: dwrite d8/d12/d67/d70/f76 [0,4194304] 0 2024-02-15T22:41:14.779 INFO:tasks.workunit.client.1.smithi082.stdout:1/410: mkdir d1/da/d14/d18/d6d/d89 0 2024-02-15T22:41:14.780 INFO:tasks.workunit.client.1.smithi082.stdout:5/410: dwrite d5/da/d14/d53/f5f [0,4194304] 0 2024-02-15T22:41:14.782 INFO:tasks.workunit.client.1.smithi082.stdout:4/461: unlink d0/d8/d1b/d70/l92 0 2024-02-15T22:41:14.784 INFO:tasks.workunit.client.1.smithi082.stdout:8/432: dread d1/f5 [4194304,4194304] 0 2024-02-15T22:41:14.785 INFO:tasks.workunit.client.1.smithi082.stdout:7/418: dread d12/d3b/f44 [0,4194304] 0 2024-02-15T22:41:14.788 INFO:tasks.workunit.client.1.smithi082.stdout:1/411: creat d1/da/d14/d18/d1f/d7a/f8a x:0 0 0 2024-02-15T22:41:14.788 INFO:tasks.workunit.client.1.smithi082.stdout:1/412: fdatasync d1/da/d14/d18/d1f/f66 0 2024-02-15T22:41:14.790 INFO:tasks.workunit.client.1.smithi082.stdout:9/454: dread d8/d24/f4b [0,4194304] 0 2024-02-15T22:41:14.790 INFO:tasks.workunit.client.1.smithi082.stdout:9/455: write d8/f1c [2565866,80798] 0 2024-02-15T22:41:14.790 INFO:tasks.workunit.client.1.smithi082.stdout:9/456: write d8/f18 [3712055,58378] 0 2024-02-15T22:41:14.790 INFO:tasks.workunit.client.1.smithi082.stdout:5/411: write d5/da/d22/d59/f5c [1822423,127861] 0 2024-02-15T22:41:14.791 INFO:tasks.workunit.client.1.smithi082.stdout:4/462: mkdir d0/d47/da6/da7 0 2024-02-15T22:41:14.791 INFO:tasks.workunit.client.1.smithi082.stdout:4/463: readlink d0/d8/d1b/dd/l13 0 2024-02-15T22:41:14.791 INFO:tasks.workunit.client.1.smithi082.stdout:7/419: write d12/d3b/f3f [531466,2406] 0 2024-02-15T22:41:14.792 INFO:tasks.workunit.client.1.smithi082.stdout:1/413: chown d1/f74 0 1 2024-02-15T22:41:14.794 INFO:tasks.workunit.client.1.smithi082.stdout:9/457: symlink d8/d12/d67/l80 0 2024-02-15T22:41:14.798 INFO:tasks.workunit.client.1.smithi082.stdout:1/414: creat d1/da/d14/f8b x:0 0 0 2024-02-15T22:41:14.801 INFO:tasks.workunit.client.1.smithi082.stdout:9/458: rename d8/d12/f4d to d8/d24/d2e/f81 0 2024-02-15T22:41:14.801 INFO:tasks.workunit.client.1.smithi082.stdout:9/459: fsync d8/d12/d30/d3c/f4e 0 2024-02-15T22:41:14.801 INFO:tasks.workunit.client.1.smithi082.stdout:0/359: sync 2024-02-15T22:41:14.801 INFO:tasks.workunit.client.1.smithi082.stdout:0/360: truncate d3/f57 790931 0 2024-02-15T22:41:14.802 INFO:tasks.workunit.client.1.smithi082.stdout:8/433: dwrite d1/d7/d9/d24/f8a [0,4194304] 0 2024-02-15T22:41:14.802 INFO:tasks.workunit.client.1.smithi082.stdout:4/464: getdents d0/d8/d32 0 2024-02-15T22:41:14.803 INFO:tasks.workunit.client.1.smithi082.stdout:4/465: chown d0/d8/d1b/l26 1829999 1 2024-02-15T22:41:14.803 INFO:tasks.workunit.client.1.smithi082.stdout:8/434: write d1/d7/d48/f64 [1740883,128446] 0 2024-02-15T22:41:14.804 INFO:tasks.workunit.client.1.smithi082.stdout:7/420: truncate d12/d3b/f89 478857 0 2024-02-15T22:41:14.807 INFO:tasks.workunit.client.1.smithi082.stdout:9/460: mkdir d8/d24/d2e/d56/d82 0 2024-02-15T22:41:14.811 INFO:tasks.workunit.client.1.smithi082.stdout:4/466: truncate d0/f31 1438315 0 2024-02-15T22:41:14.813 INFO:tasks.workunit.client.1.smithi082.stdout:8/435: rmdir d1/d7/d9/d96 0 2024-02-15T22:41:14.815 INFO:tasks.workunit.client.1.smithi082.stdout:4/467: read d0/d8/d1b/f35 [1397337,36928] 0 2024-02-15T22:41:14.816 INFO:tasks.workunit.client.1.smithi082.stdout:4/468: creat d0/fa8 x:0 0 0 2024-02-15T22:41:14.819 INFO:tasks.workunit.client.1.smithi082.stdout:7/421: read d12/d27/f2c [1972494,107345] 0 2024-02-15T22:41:14.820 INFO:tasks.workunit.client.1.smithi082.stdout:7/422: getdents d12/d3b/d5a 0 2024-02-15T22:41:14.820 INFO:tasks.workunit.client.1.smithi082.stdout:7/423: fdatasync d12/f64 0 2024-02-15T22:41:14.820 INFO:tasks.workunit.client.1.smithi082.stdout:7/424: fdatasync d12/d17/f5f 0 2024-02-15T22:41:14.821 INFO:tasks.workunit.client.1.smithi082.stdout:5/412: dwrite d5/da/d14/d53/f7b [0,4194304] 0 2024-02-15T22:41:14.822 INFO:tasks.workunit.client.1.smithi082.stdout:5/413: chown d5/da/d56/l88 21288 1 2024-02-15T22:41:14.822 INFO:tasks.workunit.client.1.smithi082.stdout:5/414: fdatasync d5/f39 0 2024-02-15T22:41:14.824 INFO:tasks.workunit.client.1.smithi082.stdout:8/436: dread d1/f4f [0,4194304] 0 2024-02-15T22:41:14.824 INFO:tasks.workunit.client.1.smithi082.stdout:0/361: dwrite d3/fe [4194304,4194304] 0 2024-02-15T22:41:14.824 INFO:tasks.workunit.client.1.smithi082.stdout:0/362: fdatasync d3/f6 0 2024-02-15T22:41:14.825 INFO:tasks.workunit.client.1.smithi082.stdout:1/415: dwrite d1/da/d11/d3f/f46 [0,4194304] 0 2024-02-15T22:41:14.825 INFO:tasks.workunit.client.1.smithi082.stdout:1/416: write d1/da/d14/f8b [223000,88636] 0 2024-02-15T22:41:14.825 INFO:tasks.workunit.client.1.smithi082.stdout:1/417: fdatasync d1/da/d14/d18/d1f/d2f/f3e 0 2024-02-15T22:41:14.834 INFO:tasks.workunit.client.1.smithi082.stdout:5/415: mknod d5/da/d22/d59/c8c 0 2024-02-15T22:41:14.834 INFO:tasks.workunit.client.1.smithi082.stdout:5/416: creat d5/da/d56/f8d x:0 0 0 2024-02-15T22:41:14.834 INFO:tasks.workunit.client.1.smithi082.stdout:5/417: truncate d5/da/d14/d53/f85 789525 0 2024-02-15T22:41:14.834 INFO:tasks.workunit.client.1.smithi082.stdout:5/418: chown d5/da/dc/l49 1750699 1 2024-02-15T22:41:14.834 INFO:tasks.workunit.client.1.smithi082.stdout:5/419: chown d5/c8a 6763745 1 2024-02-15T22:41:14.835 INFO:tasks.workunit.client.1.smithi082.stdout:5/420: write d5/da/d22/f3f [1090887,85913] 0 2024-02-15T22:41:14.837 INFO:tasks.workunit.client.1.smithi082.stdout:8/437: unlink d1/c28 0 2024-02-15T22:41:14.841 INFO:tasks.workunit.client.1.smithi082.stdout:1/418: mkdir d1/da/d11/d8c 0 2024-02-15T22:41:14.844 INFO:tasks.workunit.client.1.smithi082.stdout:5/421: rename d5/da/d14/d53/f5f to d5/da/d56/d6e/d73/f8e 0 2024-02-15T22:41:14.845 INFO:tasks.workunit.client.1.smithi082.stdout:1/419: stat d1/f1b 0 2024-02-15T22:41:14.847 INFO:tasks.workunit.client.1.smithi082.stdout:5/422: getdents d5/da/d67 0 2024-02-15T22:41:14.855 INFO:tasks.workunit.client.1.smithi082.stdout:9/461: dwrite d8/f18 [8388608,4194304] 0 2024-02-15T22:41:14.856 INFO:tasks.workunit.client.1.smithi082.stdout:0/363: dwrite d3/fd [0,4194304] 0 2024-02-15T22:41:14.856 INFO:tasks.workunit.client.1.smithi082.stdout:8/438: dwrite d1/d7/f54 [0,4194304] 0 2024-02-15T22:41:14.856 INFO:tasks.workunit.client.1.smithi082.stdout:1/420: dread d1/da/d14/d18/f3a [0,4194304] 0 2024-02-15T22:41:14.856 INFO:tasks.workunit.client.1.smithi082.stdout:7/425: dwrite d12/d17/d3d/f59 [4194304,4194304] 0 2024-02-15T22:41:14.856 INFO:tasks.workunit.client.1.smithi082.stdout:9/462: dread d8/d12/f29 [0,4194304] 0 2024-02-15T22:41:14.859 INFO:tasks.workunit.client.1.smithi082.stdout:2/440: sync 2024-02-15T22:41:14.860 INFO:tasks.workunit.client.1.smithi082.stdout:3/389: sync 2024-02-15T22:41:14.860 INFO:tasks.workunit.client.1.smithi082.stdout:3/390: chown d0/f46 10775 1 2024-02-15T22:41:14.860 INFO:tasks.workunit.client.1.smithi082.stdout:2/441: creat d6/dc/d12/d46/d4b/f8b x:0 0 0 2024-02-15T22:41:14.860 INFO:tasks.workunit.client.1.smithi082.stdout:2/442: truncate d6/d3c/f4e 722978 0 2024-02-15T22:41:14.862 INFO:tasks.workunit.client.1.smithi082.stdout:0/364: rmdir d3/d19/d1c/d6d/d77 0 2024-02-15T22:41:14.864 INFO:tasks.workunit.client.1.smithi082.stdout:1/421: mknod d1/da/d14/d7f/c8d 0 2024-02-15T22:41:14.864 INFO:tasks.workunit.client.1.smithi082.stdout:1/422: creat d1/da/d14/d18/d51/f8e x:0 0 0 2024-02-15T22:41:14.864 INFO:tasks.workunit.client.1.smithi082.stdout:1/423: read d1/da/d14/d18/d51/f68 [3964064,49587] 0 2024-02-15T22:41:14.866 INFO:tasks.workunit.client.1.smithi082.stdout:5/423: rmdir d5/da/d14 39 2024-02-15T22:41:14.866 INFO:tasks.workunit.client.1.smithi082.stdout:5/424: readlink d5/da/d14/d53/l55 0 2024-02-15T22:41:14.866 INFO:tasks.workunit.client.1.smithi082.stdout:5/425: chown d5/da/l6f 13103850 1 2024-02-15T22:41:14.867 INFO:tasks.workunit.client.1.smithi082.stdout:5/426: write d5/f39 [235239,14681] 0 2024-02-15T22:41:14.871 INFO:tasks.workunit.client.1.smithi082.stdout:3/391: creat d0/d16/d62/d2e/f81 x:0 0 0 2024-02-15T22:41:14.871 INFO:tasks.workunit.client.1.smithi082.stdout:2/443: mkdir d6/d3c/d8c 0 2024-02-15T22:41:14.873 INFO:tasks.workunit.client.1.smithi082.stdout:1/424: dread d1/f1d [4194304,4194304] 0 2024-02-15T22:41:14.874 INFO:tasks.workunit.client.1.smithi082.stdout:0/365: truncate d3/d19/d20/d26/f31 262393 0 2024-02-15T22:41:14.878 INFO:tasks.workunit.client.1.smithi082.stdout:5/427: symlink d5/da/l8f 0 2024-02-15T22:41:14.880 INFO:tasks.workunit.client.1.smithi082.stdout:3/392: rename d0/f4e to d0/d16/d62/d14/d21/d69/f82 0 2024-02-15T22:41:14.882 INFO:tasks.workunit.client.1.smithi082.stdout:2/444: creat d6/dc/d58/d49/d5e/d67/f8d x:0 0 0 2024-02-15T22:41:14.882 INFO:tasks.workunit.client.1.smithi082.stdout:3/393: dread d0/d16/d62/d14/f40 [0,4194304] 0 2024-02-15T22:41:14.883 INFO:tasks.workunit.client.1.smithi082.stdout:1/425: mknod d1/da/d14/d18/d1f/d7a/c8f 0 2024-02-15T22:41:14.884 INFO:tasks.workunit.client.1.smithi082.stdout:5/428: creat d5/da/d67/f90 x:0 0 0 2024-02-15T22:41:14.887 INFO:tasks.workunit.client.1.smithi082.stdout:5/429: getdents d5/da/d14/d45 0 2024-02-15T22:41:14.890 INFO:tasks.workunit.client.1.smithi082.stdout:6/503: sync 2024-02-15T22:41:14.890 INFO:tasks.workunit.client.1.smithi082.stdout:6/504: write d2/d18/f81 [486856,117297] 0 2024-02-15T22:41:14.890 INFO:tasks.workunit.client.1.smithi082.stdout:6/505: readlink d2/d18/l58 0 2024-02-15T22:41:14.890 INFO:tasks.workunit.client.1.smithi082.stdout:6/506: truncate d2/d18/d8a/f8f 1891731 0 2024-02-15T22:41:14.890 INFO:tasks.workunit.client.1.smithi082.stdout:6/507: fdatasync d2/d18/f44 0 2024-02-15T22:41:14.891 INFO:tasks.workunit.client.1.smithi082.stdout:8/439: dwrite d1/d7/de/f68 [0,4194304] 0 2024-02-15T22:41:14.891 INFO:tasks.workunit.client.1.smithi082.stdout:3/394: getdents d0/dc/d3f 0 2024-02-15T22:41:14.892 INFO:tasks.workunit.client.1.smithi082.stdout:7/426: dwrite d12/f64 [0,4194304] 0 2024-02-15T22:41:14.892 INFO:tasks.workunit.client.1.smithi082.stdout:7/427: chown d12/d27/d33/f36 3374 1 2024-02-15T22:41:14.894 INFO:tasks.workunit.client.1.smithi082.stdout:6/508: link d2/d18/d8a/d47/d69/d75/f9a d2/d18/fa4 0 2024-02-15T22:41:14.899 INFO:tasks.workunit.client.1.smithi082.stdout:8/440: creat d1/d7/d9/d24/d43/d85/f97 x:0 0 0 2024-02-15T22:41:14.899 INFO:tasks.workunit.client.1.smithi082.stdout:8/441: chown d1/d7/d9/d42/d6a/f76 9699 1 2024-02-15T22:41:14.900 INFO:tasks.workunit.client.1.smithi082.stdout:6/509: dread d2/d18/d8a/d47/f8b [0,4194304] 0 2024-02-15T22:41:14.900 INFO:tasks.workunit.client.1.smithi082.stdout:6/510: chown d2/d18/l58 5318160 1 2024-02-15T22:41:14.901 INFO:tasks.workunit.client.1.smithi082.stdout:3/395: rename d0/d16/d62/d14/f28 to d0/d16/d62/d14/d21/d7d/f83 0 2024-02-15T22:41:14.901 INFO:tasks.workunit.client.1.smithi082.stdout:2/445: rmdir d6/dc/d58 39 2024-02-15T22:41:14.904 INFO:tasks.workunit.client.1.smithi082.stdout:7/428: mknod d12/d17/d42/d67/c8a 0 2024-02-15T22:41:14.905 INFO:tasks.workunit.client.1.smithi082.stdout:2/446: truncate d6/d3c/f6d 1230309 0 2024-02-15T22:41:14.906 INFO:tasks.workunit.client.1.smithi082.stdout:3/396: getdents d0/d53 0 2024-02-15T22:41:14.907 INFO:tasks.workunit.client.1.smithi082.stdout:7/429: rmdir d12/d17/d3d 39 2024-02-15T22:41:14.907 INFO:tasks.workunit.client.1.smithi082.stdout:7/430: stat d12/d3b/f80 0 2024-02-15T22:41:14.909 INFO:tasks.workunit.client.1.smithi082.stdout:3/397: rename d0/d16/d62/d2e/d4c to d0/d16/d62/d2e/d84 0 2024-02-15T22:41:14.913 INFO:tasks.workunit.client.1.smithi082.stdout:1/426: dwrite d1/da/d14/d18/d51/f68 [0,4194304] 0 2024-02-15T22:41:14.913 INFO:tasks.workunit.client.1.smithi082.stdout:1/427: readlink d1/da/d11/l61 0 2024-02-15T22:41:14.914 INFO:tasks.workunit.client.1.smithi082.stdout:1/428: write d1/da/d14/d18/f2b [1225573,98511] 0 2024-02-15T22:41:14.916 INFO:tasks.workunit.client.1.smithi082.stdout:1/429: mknod d1/da/d14/c90 0 2024-02-15T22:41:14.919 INFO:tasks.workunit.client.1.smithi082.stdout:1/430: mknod d1/da/d14/c91 0 2024-02-15T22:41:14.920 INFO:tasks.workunit.client.1.smithi082.stdout:8/442: write d1/d7/d9/d42/f46 [1577439,53536] 0 2024-02-15T22:41:14.920 INFO:tasks.workunit.client.1.smithi082.stdout:1/431: creat d1/da/d14/d18/d1f/d76/f92 x:0 0 0 2024-02-15T22:41:14.921 INFO:tasks.workunit.client.1.smithi082.stdout:6/511: dread d2/d18/d23/f35 [0,4194304] 0 2024-02-15T22:41:14.921 INFO:tasks.workunit.client.1.smithi082.stdout:5/430: dwrite d5/da/d56/d6e/f82 [0,4194304] 0 2024-02-15T22:41:14.922 INFO:tasks.workunit.client.1.smithi082.stdout:8/443: write d1/d7/d9/d24/d30/f3c [298317,123097] 0 2024-02-15T22:41:14.922 INFO:tasks.workunit.client.1.smithi082.stdout:8/444: creat d1/d7/d9/d24/d72/f98 x:0 0 0 2024-02-15T22:41:14.922 INFO:tasks.workunit.client.1.smithi082.stdout:1/432: unlink d1/f1b 0 2024-02-15T22:41:14.922 INFO:tasks.workunit.client.1.smithi082.stdout:1/433: readlink d1/da/d14/l27 0 2024-02-15T22:41:14.925 INFO:tasks.workunit.client.1.smithi082.stdout:6/512: creat d2/fa5 x:0 0 0 2024-02-15T22:41:14.926 INFO:tasks.workunit.client.1.smithi082.stdout:5/431: symlink d5/da/d56/d6e/l91 0 2024-02-15T22:41:14.929 INFO:tasks.workunit.client.1.smithi082.stdout:7/431: dwrite d12/d17/f19 [0,4194304] 0 2024-02-15T22:41:14.929 INFO:tasks.workunit.client.1.smithi082.stdout:7/432: read d12/d3b/f3f [602851,64064] 0 2024-02-15T22:41:14.929 INFO:tasks.workunit.client.1.smithi082.stdout:7/433: chown d12/d3b/f89 14729398 1 2024-02-15T22:41:14.930 INFO:tasks.workunit.client.1.smithi082.stdout:1/434: mkdir d1/da/d11/d93 0 2024-02-15T22:41:14.931 INFO:tasks.workunit.client.1.smithi082.stdout:1/435: readlink d1/da/d11/l61 0 2024-02-15T22:41:14.933 INFO:tasks.workunit.client.1.smithi082.stdout:5/432: mkdir d5/da/d14/d45/d52/d92 0 2024-02-15T22:41:14.933 INFO:tasks.workunit.client.1.smithi082.stdout:5/433: chown d5/da/d14/d45/d52/c77 864906 1 2024-02-15T22:41:14.935 INFO:tasks.workunit.client.1.smithi082.stdout:1/436: dread d1/da/d14/f8b [0,4194304] 0 2024-02-15T22:41:14.935 INFO:tasks.workunit.client.1.smithi082.stdout:1/437: creat d1/d57/f94 x:0 0 0 2024-02-15T22:41:14.935 INFO:tasks.workunit.client.1.smithi082.stdout:1/438: write d1/d57/f5f [40069,56793] 0 2024-02-15T22:41:14.935 INFO:tasks.workunit.client.1.smithi082.stdout:8/445: rename d1/d7/de/d1e/c29 to d1/d7/d9/c99 0 2024-02-15T22:41:14.935 INFO:tasks.workunit.client.1.smithi082.stdout:8/446: chown d1/d7/de/d1e/c82 26108 1 2024-02-15T22:41:14.936 INFO:tasks.workunit.client.1.smithi082.stdout:8/447: chown d1/d7/de/l84 417565 1 2024-02-15T22:41:14.936 INFO:tasks.workunit.client.1.smithi082.stdout:8/448: readlink d1/d7/d9/l77 0 2024-02-15T22:41:14.936 INFO:tasks.workunit.client.1.smithi082.stdout:7/434: dread d12/d17/f5f [0,4194304] 0 2024-02-15T22:41:14.936 INFO:tasks.workunit.client.1.smithi082.stdout:5/434: symlink d5/da/d14/l93 0 2024-02-15T22:41:14.938 INFO:tasks.workunit.client.1.smithi082.stdout:1/439: creat d1/da/d14/d18/d1f/d2f/f95 x:0 0 0 2024-02-15T22:41:14.952 INFO:tasks.workunit.client.1.smithi082.stdout:5/435: dread d5/da/d14/d53/f7b [0,4194304] 0 2024-02-15T22:41:14.952 INFO:tasks.workunit.client.1.smithi082.stdout:6/513: dwrite d2/d18/d8a/d84/f87 [0,4194304] 0 2024-02-15T22:41:14.952 INFO:tasks.workunit.client.1.smithi082.stdout:6/514: chown d2/d18/d8a/d47/d72/f78 115735 1 2024-02-15T22:41:14.952 INFO:tasks.workunit.client.1.smithi082.stdout:5/436: write d5/da/d14/d53/f71 [1026000,44781] 0 2024-02-15T22:41:14.962 INFO:tasks.workunit.client.1.smithi082.stdout:8/449: mknod d1/d7/de/d1e/c9a 0 2024-02-15T22:41:14.962 INFO:tasks.workunit.client.1.smithi082.stdout:8/450: creat d1/d7/d9/d42/d6a/d8e/f9b x:0 0 0 2024-02-15T22:41:14.962 INFO:tasks.workunit.client.1.smithi082.stdout:8/451: truncate d1/d7/d9/f86 158250 0 2024-02-15T22:41:14.964 INFO:tasks.workunit.client.1.smithi082.stdout:1/440: truncate d1/da/d14/d18/d1f/d2f/f3e 278649 0 2024-02-15T22:41:14.969 INFO:tasks.workunit.client.1.smithi082.stdout:6/515: mkdir d2/d30/da6 0 2024-02-15T22:41:14.971 INFO:tasks.workunit.client.1.smithi082.stdout:5/437: creat d5/da/d14/f94 x:0 0 0 2024-02-15T22:41:14.973 INFO:tasks.workunit.client.1.smithi082.stdout:8/452: truncate d1/d7/d9/d24/d72/f79 20977 0 2024-02-15T22:41:14.973 INFO:tasks.workunit.client.1.smithi082.stdout:8/453: stat d1/d7/de/f2e 0 2024-02-15T22:41:14.973 INFO:tasks.workunit.client.1.smithi082.stdout:8/454: rename d1/d7/d9/d50 to d1/d7/d9/d50/d56/d9c 22 2024-02-15T22:41:14.975 INFO:tasks.workunit.client.1.smithi082.stdout:7/435: rmdir d12/d17 39 2024-02-15T22:41:14.976 INFO:tasks.workunit.client.1.smithi082.stdout:7/436: write f6 [1486279,113816] 0 2024-02-15T22:41:14.977 INFO:tasks.workunit.client.1.smithi082.stdout:1/441: chown d1/f39 126 1 2024-02-15T22:41:14.979 INFO:tasks.workunit.client.1.smithi082.stdout:6/516: mkdir d2/d18/d8a/da7 0 2024-02-15T22:41:14.979 INFO:tasks.workunit.client.1.smithi082.stdout:6/517: chown d2/la 5043 1 2024-02-15T22:41:14.980 INFO:tasks.workunit.client.1.smithi082.stdout:5/438: dread d5/da/d56/d6e/f82 [0,4194304] 0 2024-02-15T22:41:14.980 INFO:tasks.workunit.client.1.smithi082.stdout:8/455: mknod d1/d7/d9/d50/c9d 0 2024-02-15T22:41:14.981 INFO:tasks.workunit.client.1.smithi082.stdout:7/437: mkdir d12/d27/d74/d8b 0 2024-02-15T22:41:14.982 INFO:tasks.workunit.client.1.smithi082.stdout:1/442: mknod d1/d57/c96 0 2024-02-15T22:41:14.984 INFO:tasks.workunit.client.1.smithi082.stdout:6/518: creat d2/d18/d8a/d65/fa8 x:0 0 0 2024-02-15T22:41:14.987 INFO:tasks.workunit.client.1.smithi082.stdout:5/439: rename d5/da/d14/f50 to d5/da/d22/d59/f95 0 2024-02-15T22:41:14.988 INFO:tasks.workunit.client.1.smithi082.stdout:8/456: creat d1/d7/d9/d50/d56/f9e x:0 0 0 2024-02-15T22:41:14.992 INFO:tasks.workunit.client.1.smithi082.stdout:6/519: mknod d2/d18/d8a/da7/ca9 0 2024-02-15T22:41:14.992 INFO:tasks.workunit.client.1.smithi082.stdout:6/520: write d2/d18/d39/f88 [258316,108074] 0 2024-02-15T22:41:14.992 INFO:tasks.workunit.client.1.smithi082.stdout:6/521: chown d2/d45/c7a 1973 1 2024-02-15T22:41:14.995 INFO:tasks.workunit.client.1.smithi082.stdout:5/440: dread d5/da/d67/f68 [0,4194304] 0 2024-02-15T22:41:14.996 INFO:tasks.workunit.client.1.smithi082.stdout:8/457: creat d1/d7/d48/f9f x:0 0 0 2024-02-15T22:41:14.997 INFO:tasks.workunit.client.1.smithi082.stdout:6/522: rmdir d2/d18/d8a/d47/d72/d80 39 2024-02-15T22:41:14.999 INFO:tasks.workunit.client.1.smithi082.stdout:5/441: creat d5/da/f96 x:0 0 0 2024-02-15T22:41:14.999 INFO:tasks.workunit.client.1.smithi082.stdout:5/442: creat d5/da/d14/f97 x:0 0 0 2024-02-15T22:41:14.999 INFO:tasks.workunit.client.1.smithi082.stdout:5/443: chown d5/f4b 742148 1 2024-02-15T22:41:14.999 INFO:tasks.workunit.client.1.smithi082.stdout:5/444: chown d5/da/f40 1514137 1 2024-02-15T22:41:15.000 INFO:tasks.workunit.client.1.smithi082.stdout:8/458: rename d1/d7/de/l84 to d1/la0 0 2024-02-15T22:41:15.000 INFO:tasks.workunit.client.1.smithi082.stdout:8/459: read - d1/d7/d9/d24/d72/f98 zero size 2024-02-15T22:41:15.001 INFO:tasks.workunit.client.1.smithi082.stdout:6/523: getdents d2/d30/d3b 0 2024-02-15T22:41:15.001 INFO:tasks.workunit.client.1.smithi082.stdout:6/524: read d2/d18/d23/f35 [4190176,130616] 0 2024-02-15T22:41:15.004 INFO:tasks.workunit.client.1.smithi082.stdout:5/445: mkdir d5/da/d56/d98 0 2024-02-15T22:41:15.005 INFO:tasks.workunit.client.1.smithi082.stdout:6/525: link d2/d18/d8a/d47/d72/f8c d2/d30/da6/faa 0 2024-02-15T22:41:15.005 INFO:tasks.workunit.client.1.smithi082.stdout:6/526: stat d2/d18/d8a/d47/d69/d75/f9a 0 2024-02-15T22:41:15.005 INFO:tasks.workunit.client.1.smithi082.stdout:1/443: dwrite d1/f47 [0,4194304] 0 2024-02-15T22:41:15.005 INFO:tasks.workunit.client.1.smithi082.stdout:5/446: mknod d5/da/c99 0 2024-02-15T22:41:15.009 INFO:tasks.workunit.client.1.smithi082.stdout:5/447: creat d5/da/d14/d45/d52/d92/f9a x:0 0 0 2024-02-15T22:41:15.012 INFO:tasks.workunit.client.1.smithi082.stdout:5/448: getdents d5/da/d22/d59/d84 0 2024-02-15T22:41:15.016 INFO:tasks.workunit.client.1.smithi082.stdout:5/449: symlink d5/da/d22/d59/d84/l9b 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/527: dwrite d2/f6e [0,4194304] 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:1/444: dwrite d1/da/d14/d18/d6d/f86 [0,4194304] 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:1/445: chown d1/f1d 96 1 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/528: write d2/d45/f56 [727970,128932] 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/529: creat d2/fab x:0 0 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:8/460: dwrite d1/d7/d48/f9f [0,4194304] 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/530: write d2/d18/d8a/d47/d72/f8c [1271028,80163] 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/531: stat d2/d18/d8a/d84/f87 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/532: creat d2/d18/d23/d67/fac x:0 0 0 2024-02-15T22:41:15.032 INFO:tasks.workunit.client.1.smithi082.stdout:6/533: readlink d2/d18/d39/l46 0 2024-02-15T22:41:15.036 INFO:tasks.workunit.client.1.smithi082.stdout:5/450: getdents d5/da 0 2024-02-15T22:41:15.040 INFO:tasks.workunit.client.1.smithi082.stdout:1/446: rename d1/da/d14/d18/d51/f68 to d1/da/d14/d18/d51/f97 0 2024-02-15T22:41:15.045 INFO:tasks.workunit.client.1.smithi082.stdout:6/534: write d2/d18/d23/d67/f83 [2667791,27728] 0 2024-02-15T22:41:15.045 INFO:tasks.workunit.client.1.smithi082.stdout:6/535: creat d2/fad x:0 0 0 2024-02-15T22:41:15.045 INFO:tasks.workunit.client.1.smithi082.stdout:5/451: unlink d5/da/d14/f4e 0 2024-02-15T22:41:15.047 INFO:tasks.workunit.client.1.smithi082.stdout:1/447: readlink d1/l5d 0 2024-02-15T22:41:15.049 INFO:tasks.workunit.client.1.smithi082.stdout:1/448: mkdir d1/da/d14/d18/d98 0 2024-02-15T22:41:15.049 INFO:tasks.workunit.client.1.smithi082.stdout:5/452: dread d5/da/f5e [0,4194304] 0 2024-02-15T22:41:15.050 INFO:tasks.workunit.client.1.smithi082.stdout:1/449: creat d1/da/d11/d8c/f99 x:0 0 0 2024-02-15T22:41:15.051 INFO:tasks.workunit.client.1.smithi082.stdout:1/450: mkdir d1/d9a 0 2024-02-15T22:41:15.052 INFO:tasks.workunit.client.1.smithi082.stdout:8/461: dwrite d1/d7/d9/d24/f8a [0,4194304] 0 2024-02-15T22:41:15.053 INFO:tasks.workunit.client.1.smithi082.stdout:1/451: dread d1/f5b [0,4194304] 0 2024-02-15T22:41:15.053 INFO:tasks.workunit.client.1.smithi082.stdout:1/452: creat d1/da/d14/d18/d1f/f9b x:0 0 0 2024-02-15T22:41:15.055 INFO:tasks.workunit.client.1.smithi082.stdout:8/462: rename d1/d40/c53 to d1/d7/d9/d50/d56/ca1 0 2024-02-15T22:41:15.058 INFO:tasks.workunit.client.1.smithi082.stdout:1/453: truncate d1/f1d 1107917 0 2024-02-15T22:41:15.058 INFO:tasks.workunit.client.1.smithi082.stdout:1/454: dread - d1/da/d14/d18/d51/f81 zero size 2024-02-15T22:41:15.063 INFO:tasks.workunit.client.1.smithi082.stdout:1/455: dread d1/da/d14/f28 [0,4194304] 0 2024-02-15T22:41:15.063 INFO:tasks.workunit.client.1.smithi082.stdout:1/456: readlink d1/da/d14/d18/d1f/d2f/l32 0 2024-02-15T22:41:15.064 INFO:tasks.workunit.client.1.smithi082.stdout:6/536: dread d2/d18/d8a/d65/f7f [0,4194304] 0 2024-02-15T22:41:15.065 INFO:tasks.workunit.client.1.smithi082.stdout:6/537: chown d2/f98 30584 1 2024-02-15T22:41:15.065 INFO:tasks.workunit.client.1.smithi082.stdout:6/538: fdatasync d2/d18/d23/d67/f83 0 2024-02-15T22:41:15.065 INFO:tasks.workunit.client.1.smithi082.stdout:6/539: write d2/d18/d23/d67/f6d [794439,30625] 0 2024-02-15T22:41:15.072 INFO:tasks.workunit.client.1.smithi082.stdout:1/457: read d1/da/d14/d18/d6d/f86 [1217727,16374] 0 2024-02-15T22:41:15.076 INFO:tasks.workunit.client.1.smithi082.stdout:6/540: dread d2/d18/f44 [0,4194304] 0 2024-02-15T22:41:15.077 INFO:tasks.workunit.client.1.smithi082.stdout:6/541: mkdir d2/d18/d8a/d47/dae 0 2024-02-15T22:41:15.077 INFO:tasks.workunit.client.1.smithi082.stdout:6/542: chown d2/d18/l5b 32551938 1 2024-02-15T22:41:15.077 INFO:tasks.workunit.client.1.smithi082.stdout:6/543: readlink d2/le 0 2024-02-15T22:41:15.078 INFO:tasks.workunit.client.1.smithi082.stdout:6/544: unlink d2/d18/f81 0 2024-02-15T22:41:15.079 INFO:tasks.workunit.client.1.smithi082.stdout:5/453: dwrite d5/da/d14/f94 [0,4194304] 0 2024-02-15T22:41:15.079 INFO:tasks.workunit.client.1.smithi082.stdout:5/454: write d5/da/dc/f10 [267097,122121] 0 2024-02-15T22:41:15.079 INFO:tasks.workunit.client.1.smithi082.stdout:8/463: dwrite d1/d7/d48/f6e [0,4194304] 0 2024-02-15T22:41:15.079 INFO:tasks.workunit.client.1.smithi082.stdout:6/545: mknod d2/d18/d23/d67/caf 0 2024-02-15T22:41:15.083 INFO:tasks.workunit.client.1.smithi082.stdout:5/455: truncate d5/da/d22/f3f 857764 0 2024-02-15T22:41:15.084 INFO:tasks.workunit.client.1.smithi082.stdout:1/458: write d1/da/d11/f48 [2392479,14458] 0 2024-02-15T22:41:15.086 INFO:tasks.workunit.client.1.smithi082.stdout:0/366: sync 2024-02-15T22:41:15.086 INFO:tasks.workunit.client.1.smithi082.stdout:4/469: sync 2024-02-15T22:41:15.086 INFO:tasks.workunit.client.1.smithi082.stdout:9/463: sync 2024-02-15T22:41:15.086 INFO:tasks.workunit.client.1.smithi082.stdout:4/470: truncate d0/d16/f28 717321 0 2024-02-15T22:41:15.086 INFO:tasks.workunit.client.1.smithi082.stdout:4/471: dread - d0/d46/f79 zero size 2024-02-15T22:41:15.088 INFO:tasks.workunit.client.1.smithi082.stdout:5/456: creat d5/da/d22/d59/d84/d89/f9c x:0 0 0 2024-02-15T22:41:15.088 INFO:tasks.workunit.client.1.smithi082.stdout:5/457: fdatasync d5/da/d14/f75 0 2024-02-15T22:41:15.091 INFO:tasks.workunit.client.1.smithi082.stdout:1/459: unlink d1/da/d14/l27 0 2024-02-15T22:41:15.092 INFO:tasks.workunit.client.1.smithi082.stdout:0/367: mkdir d3/d19/d25/d80 0 2024-02-15T22:41:15.092 INFO:tasks.workunit.client.1.smithi082.stdout:0/368: fsync d3/d19/d25/d45/f2a 0 2024-02-15T22:41:15.092 INFO:tasks.workunit.client.1.smithi082.stdout:0/369: read - d3/d19/d5f/f63 zero size 2024-02-15T22:41:15.092 INFO:tasks.workunit.client.1.smithi082.stdout:9/464: creat d8/d12/d33/d64/f83 x:0 0 0 2024-02-15T22:41:15.094 INFO:tasks.workunit.client.1.smithi082.stdout:4/472: mknod d0/d16/d4a/d6a/ca9 0 2024-02-15T22:41:15.095 INFO:tasks.workunit.client.1.smithi082.stdout:8/464: getdents d1/d7/d9/d24/d43/d85 0 2024-02-15T22:41:15.095 INFO:tasks.workunit.client.1.smithi082.stdout:8/465: readlink d1/d7/l3b 0 2024-02-15T22:41:15.095 INFO:tasks.workunit.client.1.smithi082.stdout:8/466: dread - d1/d7/d9/f81 zero size 2024-02-15T22:41:15.097 INFO:tasks.workunit.client.1.smithi082.stdout:5/458: link d5/da/f40 d5/da/dc/d43/f9d 0 2024-02-15T22:41:15.097 INFO:tasks.workunit.client.1.smithi082.stdout:5/459: fdatasync d5/da/d22/d59/d84/d89/f9c 0 2024-02-15T22:41:15.097 INFO:tasks.workunit.client.1.smithi082.stdout:5/460: chown d5/da/d22/d59/c8c 1 1 2024-02-15T22:41:15.098 INFO:tasks.workunit.client.1.smithi082.stdout:1/460: symlink d1/da/d14/d18/d51/l9c 0 2024-02-15T22:41:15.098 INFO:tasks.workunit.client.1.smithi082.stdout:1/461: fdatasync d1/da/d14/d18/d1f/d76/f92 0 2024-02-15T22:41:15.100 INFO:tasks.workunit.client.1.smithi082.stdout:8/467: symlink d1/d7/d9/d42/d6a/d8e/la2 0 2024-02-15T22:41:15.102 INFO:tasks.workunit.client.1.smithi082.stdout:0/370: symlink d3/d19/d1c/l81 0 2024-02-15T22:41:15.102 INFO:tasks.workunit.client.1.smithi082.stdout:0/371: read - d3/d19/d1c/d6d/f72 zero size 2024-02-15T22:41:15.106 INFO:tasks.workunit.client.1.smithi082.stdout:6/546: dwrite d2/d18/d8a/f3d [0,4194304] 0 2024-02-15T22:41:15.106 INFO:tasks.workunit.client.1.smithi082.stdout:9/465: dread d8/f2b [4194304,4194304] 0 2024-02-15T22:41:15.110 INFO:tasks.workunit.client.1.smithi082.stdout:9/466: mknod d8/c84 0 2024-02-15T22:41:15.110 INFO:tasks.workunit.client.1.smithi082.stdout:9/467: write d8/d12/d30/d3c/d65/f6b [943207,47387] 0 2024-02-15T22:41:15.111 INFO:tasks.workunit.client.1.smithi082.stdout:6/547: mknod d2/d30/da6/cb0 0 2024-02-15T22:41:15.126 INFO:tasks.workunit.client.1.smithi082.stdout:9/468: truncate d8/d24/d2e/f6a 3368875 0 2024-02-15T22:41:15.156 INFO:tasks.workunit.client.1.smithi082.stdout:8/468: dwrite d1/d7/d9/d42/d6a/f76 [0,4194304] 0 2024-02-15T22:41:15.156 INFO:tasks.workunit.client.1.smithi082.stdout:6/548: dwrite d2/f5c [0,4194304] 0 2024-02-15T22:41:15.157 INFO:tasks.workunit.client.1.smithi082.stdout:5/461: dwrite d5/da/d67/f68 [0,4194304] 0 2024-02-15T22:41:15.157 INFO:tasks.workunit.client.1.smithi082.stdout:4/473: dwrite d0/f23 [0,4194304] 0 2024-02-15T22:41:15.157 INFO:tasks.workunit.client.1.smithi082.stdout:4/474: readlink d0/l3 0 2024-02-15T22:41:15.157 INFO:tasks.workunit.client.1.smithi082.stdout:4/475: fsync d0/f54 0 2024-02-15T22:41:15.158 INFO:tasks.workunit.client.1.smithi082.stdout:0/372: dwrite d3/d19/f58 [0,4194304] 0 2024-02-15T22:41:15.159 INFO:tasks.workunit.client.1.smithi082.stdout:6/549: getdents d2/d18/d8a/d47/d72 0 2024-02-15T22:41:15.159 INFO:tasks.workunit.client.1.smithi082.stdout:6/550: dread - d2/d18/f99 zero size 2024-02-15T22:41:15.159 INFO:tasks.workunit.client.1.smithi082.stdout:6/551: truncate d2/d18/d8a/d65/f7f 4985936 0 2024-02-15T22:41:15.167 INFO:tasks.workunit.client.1.smithi082.stdout:5/462: rename d5/l7e to d5/da/d14/d45/d52/d92/l9e 0 2024-02-15T22:41:15.168 INFO:tasks.workunit.client.1.smithi082.stdout:4/476: unlink d0/d16/d87/f9b 0 2024-02-15T22:41:15.172 INFO:tasks.workunit.client.1.smithi082.stdout:6/552: mkdir d2/d18/d8a/d47/d69/db1 0 2024-02-15T22:41:15.173 INFO:tasks.workunit.client.1.smithi082.stdout:5/463: rmdir d5/da/d14/d45 39 2024-02-15T22:41:15.174 INFO:tasks.workunit.client.1.smithi082.stdout:2/447: sync 2024-02-15T22:41:15.174 INFO:tasks.workunit.client.1.smithi082.stdout:4/477: rmdir d0/d8/d32 39 2024-02-15T22:41:15.176 INFO:tasks.workunit.client.1.smithi082.stdout:6/553: mknod d2/d18/d8a/d47/d69/db1/cb2 0 2024-02-15T22:41:15.176 INFO:tasks.workunit.client.1.smithi082.stdout:6/554: write d2/d30/da6/faa [1741083,94277] 0 2024-02-15T22:41:15.176 INFO:tasks.workunit.client.1.smithi082.stdout:6/555: creat d2/d45/fb3 x:0 0 0 2024-02-15T22:41:15.177 INFO:tasks.workunit.client.1.smithi082.stdout:6/556: stat d2/d18/d8a/d47/d69/d75/f9a 0 2024-02-15T22:41:15.177 INFO:tasks.workunit.client.1.smithi082.stdout:5/464: mknod d5/da/d22/d59/d84/c9f 0 2024-02-15T22:41:15.179 INFO:tasks.workunit.client.1.smithi082.stdout:2/448: unlink d6/dc/d58/d49/l85 0 2024-02-15T22:41:15.179 INFO:tasks.workunit.client.1.smithi082.stdout:2/449: write d6/dc/dd/d24/d71/f7a [685964,52588] 0 2024-02-15T22:41:15.180 INFO:tasks.workunit.client.1.smithi082.stdout:6/557: truncate d2/d18/d8a/d47/f54 866733 0 2024-02-15T22:41:15.182 INFO:tasks.workunit.client.1.smithi082.stdout:4/478: dread d0/f31 [0,4194304] 0 2024-02-15T22:41:15.182 INFO:tasks.workunit.client.1.smithi082.stdout:2/450: mkdir d6/dc/dd/d21/d8e 0 2024-02-15T22:41:15.184 INFO:tasks.workunit.client.1.smithi082.stdout:4/479: unlink d0/d47/f90 0 2024-02-15T22:41:15.186 INFO:tasks.workunit.client.1.smithi082.stdout:5/465: rename d5/da/d14/d45/d52 to d5/da/d67/da0 0 2024-02-15T22:41:15.187 INFO:tasks.workunit.client.1.smithi082.stdout:8/469: dwrite d1/d7/d9/d50/f67 [0,4194304] 0 2024-02-15T22:41:15.187 INFO:tasks.workunit.client.1.smithi082.stdout:8/470: dread - d1/d7/de/d1e/f20 zero size 2024-02-15T22:41:15.187 INFO:tasks.workunit.client.1.smithi082.stdout:8/471: chown d1/d7/d9/d24/d43/l65 0 1 2024-02-15T22:41:15.189 INFO:tasks.workunit.client.1.smithi082.stdout:4/480: mkdir d0/d8/d1b/dd/daa 0 2024-02-15T22:41:15.189 INFO:tasks.workunit.client.1.smithi082.stdout:0/373: dwrite d3/d19/d25/d45/f55 [0,4194304] 0 2024-02-15T22:41:15.189 INFO:tasks.workunit.client.1.smithi082.stdout:9/469: dwrite d8/d12/d30/d3c/d65/f6b [0,4194304] 0 2024-02-15T22:41:15.189 INFO:tasks.workunit.client.1.smithi082.stdout:9/470: readlink d8/d12/d33/l75 0 2024-02-15T22:41:15.191 INFO:tasks.workunit.client.1.smithi082.stdout:5/466: mknod d5/da/d22/d59/d84/d89/ca1 0 2024-02-15T22:41:15.191 INFO:tasks.workunit.client.1.smithi082.stdout:5/467: creat d5/da/d56/fa2 x:0 0 0 2024-02-15T22:41:15.194 INFO:tasks.workunit.client.1.smithi082.stdout:4/481: link d0/d46/f79 d0/d8/d32/d39/fab 0 2024-02-15T22:41:15.194 INFO:tasks.workunit.client.1.smithi082.stdout:6/558: read d2/d18/d8a/f3d [3482286,68705] 0 2024-02-15T22:41:15.197 INFO:tasks.workunit.client.1.smithi082.stdout:5/468: mkdir d5/da/d22/d59/da3 0 2024-02-15T22:41:15.198 INFO:tasks.workunit.client.1.smithi082.stdout:5/469: fdatasync d5/da/d14/d53/f85 0 2024-02-15T22:41:15.198 INFO:tasks.workunit.client.1.smithi082.stdout:5/470: creat d5/da/d22/fa4 x:0 0 0 2024-02-15T22:41:15.199 INFO:tasks.workunit.client.1.smithi082.stdout:4/482: creat d0/d8/d1b/fac x:0 0 0 2024-02-15T22:41:15.200 INFO:tasks.workunit.client.1.smithi082.stdout:2/451: dwrite d6/dc/d58/d49/d5e/f60 [0,4194304] 0 2024-02-15T22:41:15.200 INFO:tasks.workunit.client.1.smithi082.stdout:2/452: fdatasync d6/dc/dd/d1d/f1f 0 2024-02-15T22:41:15.200 INFO:tasks.workunit.client.1.smithi082.stdout:2/453: dread - d6/dc/dd/f8a zero size 2024-02-15T22:41:15.201 INFO:tasks.workunit.client.1.smithi082.stdout:6/559: rmdir d2/d18/d8a/d84 39 2024-02-15T22:41:15.203 INFO:tasks.workunit.client.1.smithi082.stdout:9/471: write d8/d12/d30/d3c/d65/f6b [2047673,16591] 0 2024-02-15T22:41:15.207 INFO:tasks.workunit.client.1.smithi082.stdout:2/454: creat d6/dc/d12/d46/f8f x:0 0 0 2024-02-15T22:41:15.212 INFO:tasks.workunit.client.1.smithi082.stdout:2/455: mkdir d6/dc/d12/d23/d90 0 2024-02-15T22:41:15.212 INFO:tasks.workunit.client.1.smithi082.stdout:2/456: fsync d6/dc/d58/f19 0 2024-02-15T22:41:15.212 INFO:tasks.workunit.client.1.smithi082.stdout:2/457: readlink d6/dc/d58/l3f 0 2024-02-15T22:41:15.212 INFO:tasks.workunit.client.1.smithi082.stdout:2/458: chown d6/dc/d12/d46 61461 1 2024-02-15T22:41:15.212 INFO:tasks.workunit.client.1.smithi082.stdout:2/459: read d6/dc/dd/d24/f54 [296116,72809] 0 2024-02-15T22:41:15.213 INFO:tasks.workunit.client.1.smithi082.stdout:0/374: dwrite d3/d64/d71/d73/f7a [0,4194304] 0 2024-02-15T22:41:15.215 INFO:tasks.workunit.client.1.smithi082.stdout:2/460: rename d6/dc/d12/d23/f2f to d6/dc/d12/d46/d76/f91 0 2024-02-15T22:41:15.219 INFO:tasks.workunit.client.1.smithi082.stdout:2/461: unlink f2 0 2024-02-15T22:41:15.228 INFO:tasks.workunit.client.1.smithi082.stdout:0/375: dread d3/d19/f21 [0,4194304] 0 2024-02-15T22:41:15.228 INFO:tasks.workunit.client.1.smithi082.stdout:0/376: readlink d3/d19/d1c/d6d/l70 0 2024-02-15T22:41:15.239 INFO:tasks.workunit.client.1.smithi082.stdout:6/560: dwrite d2/f1e [0,4194304] 0 2024-02-15T22:41:15.239 INFO:tasks.workunit.client.1.smithi082.stdout:6/561: stat d2/d18/d8a/f8f 0 2024-02-15T22:41:15.240 INFO:tasks.workunit.client.1.smithi082.stdout:5/471: dwrite d5/da/d14/d45/f60 [0,4194304] 0 2024-02-15T22:41:15.240 INFO:tasks.workunit.client.1.smithi082.stdout:5/472: read - d5/da/d67/f90 zero size 2024-02-15T22:41:15.240 INFO:tasks.workunit.client.1.smithi082.stdout:9/472: dwrite d8/d12/f1d [4194304,4194304] 0 2024-02-15T22:41:15.241 INFO:tasks.workunit.client.1.smithi082.stdout:4/483: dwrite d0/d46/f79 [0,4194304] 0 2024-02-15T22:41:15.241 INFO:tasks.workunit.client.1.smithi082.stdout:4/484: dread - d0/d8/d1b/dd/f4c zero size 2024-02-15T22:41:15.241 INFO:tasks.workunit.client.1.smithi082.stdout:4/485: chown d0/d47/f99 21375692 1 2024-02-15T22:41:15.241 INFO:tasks.workunit.client.1.smithi082.stdout:9/473: write d8/d24/d2e/d56/f60 [491442,5412] 0 2024-02-15T22:41:15.241 INFO:tasks.workunit.client.1.smithi082.stdout:9/474: chown d8/d24/d2e 0 1 2024-02-15T22:41:15.241 INFO:tasks.workunit.client.1.smithi082.stdout:6/562: creat d2/d18/d8a/d47/d72/d80/fb4 x:0 0 0 2024-02-15T22:41:15.241 INFO:tasks.workunit.client.1.smithi082.stdout:2/462: dwrite d6/f7 [0,4194304] 0 2024-02-15T22:41:15.245 INFO:tasks.workunit.client.1.smithi082.stdout:5/473: mknod d5/da/d56/d98/ca5 0 2024-02-15T22:41:15.245 INFO:tasks.workunit.client.1.smithi082.stdout:5/474: read d5/da/d22/d59/f5c [3091575,43419] 0 2024-02-15T22:41:15.245 INFO:tasks.workunit.client.1.smithi082.stdout:5/475: fsync d5/da/f25 0 2024-02-15T22:41:15.245 INFO:tasks.workunit.client.1.smithi082.stdout:5/476: chown d5/da/d56/d98 140 1 2024-02-15T22:41:15.249 INFO:tasks.workunit.client.1.smithi082.stdout:4/486: unlink d0/d8/d1b/dd/l85 0 2024-02-15T22:41:15.250 INFO:tasks.workunit.client.1.smithi082.stdout:6/563: symlink d2/d18/d8a/d47/d72/lb5 0 2024-02-15T22:41:15.251 INFO:tasks.workunit.client.1.smithi082.stdout:6/564: write d2/d18/d23/d67/f6d [101943,117639] 0 2024-02-15T22:41:15.251 INFO:tasks.workunit.client.1.smithi082.stdout:6/565: fsync d2/fa5 0 2024-02-15T22:41:15.252 INFO:tasks.workunit.client.1.smithi082.stdout:2/463: mknod d6/dc/d12/d46/d4b/d63/c92 0 2024-02-15T22:41:15.253 INFO:tasks.workunit.client.1.smithi082.stdout:5/477: rmdir d5/da/dc/d43 39 2024-02-15T22:41:15.253 INFO:tasks.workunit.client.1.smithi082.stdout:5/478: write d5/da/d56/f8d [438151,11957] 0 2024-02-15T22:41:15.254 INFO:tasks.workunit.client.1.smithi082.stdout:6/566: unlink d2/d18/fa4 0 2024-02-15T22:41:15.254 INFO:tasks.workunit.client.1.smithi082.stdout:6/567: read - d2/d18/d23/d67/fac zero size 2024-02-15T22:41:15.256 INFO:tasks.workunit.client.1.smithi082.stdout:2/464: stat d6/l62 0 2024-02-15T22:41:15.259 INFO:tasks.workunit.client.1.smithi082.stdout:5/479: link d5/da/d56/fa2 d5/da/d22/d59/fa6 0 2024-02-15T22:41:15.259 INFO:tasks.workunit.client.1.smithi082.stdout:5/480: chown d5/da/dc/ff 2 1 2024-02-15T22:41:15.267 INFO:tasks.workunit.client.1.smithi082.stdout:2/465: mknod d6/dc/d12/c93 0 2024-02-15T22:41:15.268 INFO:tasks.workunit.client.1.smithi082.stdout:5/481: symlink d5/da/d22/d59/da3/la7 0 2024-02-15T22:41:15.268 INFO:tasks.workunit.client.1.smithi082.stdout:5/482: creat d5/da/d56/fa8 x:0 0 0 2024-02-15T22:41:15.268 INFO:tasks.workunit.client.1.smithi082.stdout:5/483: chown d5/da/d14/d53/f7b 3 1 2024-02-15T22:41:15.268 INFO:tasks.workunit.client.1.smithi082.stdout:2/466: creat d6/dc/d12/d46/d4b/d63/f94 x:0 0 0 2024-02-15T22:41:15.269 INFO:tasks.workunit.client.1.smithi082.stdout:2/467: read d6/dc/f10 [7972961,49774] 0 2024-02-15T22:41:15.270 INFO:tasks.workunit.client.1.smithi082.stdout:5/484: getdents d5/da/d56/d98 0 2024-02-15T22:41:15.275 INFO:tasks.workunit.client.1.smithi082.stdout:9/475: dwrite f5 [4194304,4194304] 0 2024-02-15T22:41:15.275 INFO:tasks.workunit.client.1.smithi082.stdout:6/568: dwrite d2/d18/d23/f9d [0,4194304] 0 2024-02-15T22:41:15.284 INFO:tasks.workunit.client.1.smithi082.stdout:5/485: write d5/da/d14/d45/f60 [2079868,115722] 0 2024-02-15T22:41:15.289 INFO:tasks.workunit.client.1.smithi082.stdout:2/468: dwrite d6/dc/d58/d49/f56 [0,4194304] 0 2024-02-15T22:41:15.300 INFO:tasks.workunit.client.1.smithi082.stdout:6/569: dwrite d2/fad [0,4194304] 0 2024-02-15T22:41:15.305 INFO:tasks.workunit.client.1.smithi082.stdout:9/476: dwrite d8/d24/d2e/f6d [0,4194304] 0 2024-02-15T22:41:15.306 INFO:tasks.workunit.client.1.smithi082.stdout:9/477: mknod d8/c85 0 2024-02-15T22:41:15.307 INFO:tasks.workunit.client.1.smithi082.stdout:9/478: getdents d8/d24/d2e/d56 0 2024-02-15T22:41:15.308 INFO:tasks.workunit.client.1.smithi082.stdout:3/398: sync 2024-02-15T22:41:15.308 INFO:tasks.workunit.client.1.smithi082.stdout:7/438: sync 2024-02-15T22:41:15.308 INFO:tasks.workunit.client.1.smithi082.stdout:7/439: truncate d12/d37/f5b 212353 0 2024-02-15T22:41:15.308 INFO:tasks.workunit.client.1.smithi082.stdout:7/440: chown d12/d17/d3d/l4c 12761 1 2024-02-15T22:41:15.308 INFO:tasks.workunit.client.1.smithi082.stdout:9/479: mknod d8/d24/d2e/d56/d82/c86 0 2024-02-15T22:41:15.310 INFO:tasks.workunit.client.1.smithi082.stdout:7/441: unlink d12/d3b/d41/l61 0 2024-02-15T22:41:15.310 INFO:tasks.workunit.client.1.smithi082.stdout:7/442: fsync d12/d17/d3d/f59 0 2024-02-15T22:41:15.313 INFO:tasks.workunit.client.1.smithi082.stdout:9/480: mkdir d8/d24/d87 0 2024-02-15T22:41:15.313 INFO:tasks.workunit.client.1.smithi082.stdout:7/443: mknod d12/d37/c8c 0 2024-02-15T22:41:15.314 INFO:tasks.workunit.client.1.smithi082.stdout:2/469: dwrite d6/dc/d58/d49/d5e/d67/f8d [0,4194304] 0 2024-02-15T22:41:15.315 INFO:tasks.workunit.client.1.smithi082.stdout:9/481: link d8/c7a d8/d12/d30/d3c/d71/c88 0 2024-02-15T22:41:15.316 INFO:tasks.workunit.client.1.smithi082.stdout:7/444: mknod d12/d27/c8d 0 2024-02-15T22:41:15.317 INFO:tasks.workunit.client.1.smithi082.stdout:7/445: read - d12/d27/f6d zero size 2024-02-15T22:41:15.319 INFO:tasks.workunit.client.1.smithi082.stdout:2/470: creat d6/dc/d12/d23/d6e/f95 x:0 0 0 2024-02-15T22:41:15.321 INFO:tasks.workunit.client.1.smithi082.stdout:9/482: creat d8/d12/f89 x:0 0 0 2024-02-15T22:41:15.322 INFO:tasks.workunit.client.1.smithi082.stdout:7/446: symlink d12/d27/d6e/l8e 0 2024-02-15T22:41:15.322 INFO:tasks.workunit.client.1.smithi082.stdout:7/447: write d12/f16 [5525702,61646] 0 2024-02-15T22:41:15.335 INFO:tasks.workunit.client.1.smithi082.stdout:9/483: write d8/f22 [92224,53101] 0 2024-02-15T22:41:15.335 INFO:tasks.workunit.client.1.smithi082.stdout:9/484: write d8/d12/d33/d3e/f66 [883390,5737] 0 2024-02-15T22:41:15.335 INFO:tasks.workunit.client.1.smithi082.stdout:9/485: chown d8/d24/d2e/d53/f59 1574426 1 2024-02-15T22:41:15.336 INFO:tasks.workunit.client.1.smithi082.stdout:6/570: dwrite d2/d18/d23/f90 [0,4194304] 0 2024-02-15T22:41:15.341 INFO:tasks.workunit.client.1.smithi082.stdout:3/399: dwrite d0/d16/d62/f50 [0,4194304] 0 2024-02-15T22:41:15.347 INFO:tasks.workunit.client.1.smithi082.stdout:2/471: dwrite d6/dc/d58/f19 [0,4194304] 0 2024-02-15T22:41:15.348 INFO:tasks.workunit.client.1.smithi082.stdout:7/448: dwrite d12/d17/d3d/f55 [4194304,4194304] 0 2024-02-15T22:41:15.350 INFO:tasks.workunit.client.1.smithi082.stdout:7/449: dread d12/d37/f5b [0,4194304] 0 2024-02-15T22:41:15.351 INFO:tasks.workunit.client.1.smithi082.stdout:7/450: symlink d12/d3b/d5a/l8f 0 2024-02-15T22:41:15.354 INFO:tasks.workunit.client.1.smithi082.stdout:2/472: dread d6/d3c/f4e [0,4194304] 0 2024-02-15T22:41:15.367 INFO:tasks.workunit.client.1.smithi082.stdout:2/473: write d6/dc/f38 [591823,41434] 0 2024-02-15T22:41:15.367 INFO:tasks.workunit.client.1.smithi082.stdout:2/474: write d6/dc/d12/d46/d76/f91 [1108402,100024] 0 2024-02-15T22:41:15.368 INFO:tasks.workunit.client.1.smithi082.stdout:2/475: symlink d6/dc/d58/d49/l96 0 2024-02-15T22:41:15.369 INFO:tasks.workunit.client.1.smithi082.stdout:2/476: readlink d6/dc/d58/l15 0 2024-02-15T22:41:15.370 INFO:tasks.workunit.client.1.smithi082.stdout:2/477: mknod d6/dc/dd/d1d/c97 0 2024-02-15T22:41:15.372 INFO:tasks.workunit.client.1.smithi082.stdout:6/571: dwrite d2/d30/d3b/f49 [0,4194304] 0 2024-02-15T22:41:15.373 INFO:tasks.workunit.client.1.smithi082.stdout:9/486: dwrite d8/f1f [0,4194304] 0 2024-02-15T22:41:15.373 INFO:tasks.workunit.client.1.smithi082.stdout:9/487: chown d8/d12/d67/d70/f76 1121 1 2024-02-15T22:41:15.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:15 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:15.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:15 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:15.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:15 smithi082 ceph-mon[37153]: Reconfiguring grafana.smithi033 (dependencies changed)... 2024-02-15T22:41:15.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:15 smithi082 ceph-mon[37153]: Reconfiguring daemon grafana.smithi033 on smithi033 2024-02-15T22:41:15.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:15 smithi082 ceph-mon[37153]: pgmap v20: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 100 MiB/s wr, 551 op/s 2024-02-15T22:41:15.375 INFO:tasks.workunit.client.1.smithi082.stdout:3/400: dwrite d0/d16/d3e/f5f [0,4194304] 0 2024-02-15T22:41:15.376 INFO:tasks.workunit.client.1.smithi082.stdout:9/488: creat d8/d24/d2e/d56/f8a x:0 0 0 2024-02-15T22:41:15.376 INFO:tasks.workunit.client.1.smithi082.stdout:7/451: dwrite d12/d27/f6d [0,4194304] 0 2024-02-15T22:41:15.376 INFO:tasks.workunit.client.1.smithi082.stdout:7/452: readlink d12/d37/l65 0 2024-02-15T22:41:15.376 INFO:tasks.workunit.client.1.smithi082.stdout:7/453: stat d12/d3b/d5a/l8f 0 2024-02-15T22:41:15.390 INFO:tasks.workunit.client.1.smithi082.stdout:9/489: dread d8/d24/d2e/d53/f59 [0,4194304] 0 2024-02-15T22:41:15.390 INFO:tasks.workunit.client.1.smithi082.stdout:7/454: rename d12/d3b/f80 to d12/d37/d85/f90 0 2024-02-15T22:41:15.392 INFO:tasks.workunit.client.1.smithi082.stdout:6/572: dwrite d2/d18/d23/d67/fac [0,4194304] 0 2024-02-15T22:41:15.395 INFO:tasks.workunit.client.1.smithi082.stdout:6/573: symlink d2/d18/d8a/d47/d69/db1/lb6 0 2024-02-15T22:41:15.397 INFO:tasks.workunit.client.1.smithi082.stdout:6/574: symlink d2/d18/d8a/d47/d69/d75/lb7 0 2024-02-15T22:41:15.397 INFO:tasks.workunit.client.1.smithi082.stdout:6/575: truncate d2/fab 451284 0 2024-02-15T22:41:15.397 INFO:tasks.workunit.client.1.smithi082.stdout:6/576: write d2/d18/d23/f35 [433997,53023] 0 2024-02-15T22:41:15.399 INFO:tasks.workunit.client.1.smithi082.stdout:1/462: sync 2024-02-15T22:41:15.400 INFO:tasks.workunit.client.1.smithi082.stdout:1/463: dread - d1/da/d14/d18/d1f/f66 zero size 2024-02-15T22:41:15.400 INFO:tasks.workunit.client.1.smithi082.stdout:1/464: read - d1/d57/f88 zero size 2024-02-15T22:41:15.400 INFO:tasks.workunit.client.1.smithi082.stdout:1/465: dread - d1/da/d14/d18/d1f/f84 zero size 2024-02-15T22:41:15.402 INFO:tasks.workunit.client.1.smithi082.stdout:9/490: dread d8/d12/d33/f3b [0,4194304] 0 2024-02-15T22:41:15.402 INFO:tasks.workunit.client.1.smithi082.stdout:9/491: write d8/f11 [9405591,90608] 0 2024-02-15T22:41:15.405 INFO:tasks.workunit.client.1.smithi082.stdout:1/466: unlink d1/da/d14/d18/d1f/d2f/l32 0 2024-02-15T22:41:15.406 INFO:tasks.workunit.client.1.smithi082.stdout:1/467: stat d1/f4 0 2024-02-15T22:41:15.408 INFO:tasks.workunit.client.1.smithi082.stdout:1/468: symlink d1/da/d11/d3f/l9d 0 2024-02-15T22:41:15.409 INFO:tasks.workunit.client.1.smithi082.stdout:6/577: dread d2/fad [0,4194304] 0 2024-02-15T22:41:15.409 INFO:tasks.workunit.client.1.smithi082.stdout:9/492: dread d8/d12/f29 [0,4194304] 0 2024-02-15T22:41:15.409 INFO:tasks.workunit.client.1.smithi082.stdout:9/493: write d8/d12/f29 [744762,35287] 0 2024-02-15T22:41:15.411 INFO:tasks.workunit.client.1.smithi082.stdout:6/578: mknod d2/d18/d39/cb8 0 2024-02-15T22:41:15.413 INFO:tasks.workunit.client.1.smithi082.stdout:6/579: symlink d2/d18/d8a/d47/d69/db1/lb9 0 2024-02-15T22:41:15.423 INFO:tasks.workunit.client.1.smithi082.stdout:9/494: dread f5 [4194304,4194304] 0 2024-02-15T22:41:15.424 INFO:tasks.workunit.client.1.smithi082.stdout:9/495: unlink d8/d12/l31 0 2024-02-15T22:41:15.425 INFO:tasks.workunit.client.1.smithi082.stdout:9/496: mkdir d8/d12/d33/d64/d8b 0 2024-02-15T22:41:15.425 INFO:tasks.workunit.client.1.smithi082.stdout:9/497: fsync d8/d12/d30/d3c/d65/f6b 0 2024-02-15T22:41:15.426 INFO:tasks.workunit.client.1.smithi082.stdout:9/498: stat d8/d24/c61 0 2024-02-15T22:41:15.437 INFO:tasks.workunit.client.1.smithi082.stdout:1/469: dwrite d1/da/d11/d3f/d75/f78 [0,4194304] 0 2024-02-15T22:41:15.438 INFO:tasks.workunit.client.1.smithi082.stdout:9/499: write d8/d12/f1e [3828002,54030] 0 2024-02-15T22:41:15.440 INFO:tasks.workunit.client.1.smithi082.stdout:9/500: getdents d8/d12/d33 0 2024-02-15T22:41:15.440 INFO:tasks.workunit.client.1.smithi082.stdout:6/580: dwrite d2/d18/d8a/d65/f7f [4194304,4194304] 0 2024-02-15T22:41:15.441 INFO:tasks.workunit.client.1.smithi082.stdout:9/501: link d8/d24/d2e/f81 d8/d24/d87/f8c 0 2024-02-15T22:41:15.449 INFO:tasks.workunit.client.1.smithi082.stdout:9/502: fdatasync d8/f2b 0 2024-02-15T22:41:15.449 INFO:tasks.workunit.client.1.smithi082.stdout:9/503: chown d8/d24/d87 33695857 1 2024-02-15T22:41:15.450 INFO:tasks.workunit.client.1.smithi082.stdout:9/504: symlink d8/d24/d2e/d53/l8d 0 2024-02-15T22:41:15.452 INFO:tasks.workunit.client.1.smithi082.stdout:9/505: creat d8/d24/d2e/d53/f8e x:0 0 0 2024-02-15T22:41:15.454 INFO:tasks.workunit.client.1.smithi082.stdout:9/506: getdents d8/d12/d30/d3c/d65 0 2024-02-15T22:41:15.454 INFO:tasks.workunit.client.1.smithi082.stdout:1/470: dread d1/da/d11/d3f/f46 [0,4194304] 0 2024-02-15T22:41:15.456 INFO:tasks.workunit.client.1.smithi082.stdout:9/507: rename d8/d12/f1d to d8/d12/d33/d64/d7c/f8f 0 2024-02-15T22:41:15.456 INFO:tasks.workunit.client.1.smithi082.stdout:9/508: creat d8/d12/f90 x:0 0 0 2024-02-15T22:41:15.459 INFO:tasks.workunit.client.1.smithi082.stdout:9/509: link d8/d12/d67/l7b d8/d12/d33/d64/l91 0 2024-02-15T22:41:15.459 INFO:tasks.workunit.client.1.smithi082.stdout:9/510: fdatasync d8/f1c 0 2024-02-15T22:41:15.459 INFO:tasks.workunit.client.1.smithi082.stdout:1/471: getdents d1/d57 0 2024-02-15T22:41:15.462 INFO:tasks.workunit.client.1.smithi082.stdout:9/511: rename d8/c55 to d8/d24/d2e/d56/d82/c92 0 2024-02-15T22:41:15.464 INFO:tasks.workunit.client.1.smithi082.stdout:6/581: dwrite d2/d18/d8a/d47/d72/f8c [0,4194304] 0 2024-02-15T22:41:15.464 INFO:tasks.workunit.client.1.smithi082.stdout:6/582: fdatasync d2/d18/d8a/d47/d69/f73 0 2024-02-15T22:41:15.465 INFO:tasks.workunit.client.1.smithi082.stdout:9/512: creat d8/d12/d30/d3c/f93 x:0 0 0 2024-02-15T22:41:15.466 INFO:tasks.workunit.client.1.smithi082.stdout:1/472: getdents d1/da/d14/d18/d1f/d7a 0 2024-02-15T22:41:15.471 INFO:tasks.workunit.client.1.smithi082.stdout:6/583: mknod d2/d30/cba 0 2024-02-15T22:41:15.471 INFO:tasks.workunit.client.1.smithi082.stdout:6/584: chown d2/d18/d8a/d47/d72/f78 31 1 2024-02-15T22:41:15.473 INFO:tasks.workunit.client.1.smithi082.stdout:9/513: creat d8/d12/d33/d64/d7c/f94 x:0 0 0 2024-02-15T22:41:15.474 INFO:tasks.workunit.client.1.smithi082.stdout:9/514: mknod d8/c95 0 2024-02-15T22:41:15.475 INFO:tasks.workunit.client.1.smithi082.stdout:1/473: dread d1/da/d14/f2d [0,4194304] 0 2024-02-15T22:41:15.476 INFO:tasks.workunit.client.1.smithi082.stdout:9/515: unlink d8/d12/d67/d70/f78 0 2024-02-15T22:41:15.477 INFO:tasks.workunit.client.1.smithi082.stdout:1/474: truncate d1/da/d11/d3f/d75/f78 1094283 0 2024-02-15T22:41:15.482 INFO:tasks.workunit.client.1.smithi082.stdout:1/475: dread d1/da/d14/d18/d1f/f64 [0,4194304] 0 2024-02-15T22:41:15.484 INFO:tasks.workunit.client.1.smithi082.stdout:6/585: dread d2/d18/d23/f9d [0,4194304] 0 2024-02-15T22:41:15.484 INFO:tasks.workunit.client.1.smithi082.stdout:6/586: chown d2/d45/c5d 366485 1 2024-02-15T22:41:15.484 INFO:tasks.workunit.client.1.smithi082.stdout:6/587: stat d2/d18/f44 0 2024-02-15T22:41:15.484 INFO:tasks.workunit.client.1.smithi082.stdout:1/476: rename d1/da/f1c to d1/da/d11/f9e 0 2024-02-15T22:41:15.486 INFO:tasks.workunit.client.1.smithi082.stdout:6/588: dread d2/d18/d8a/d47/f8b [0,4194304] 0 2024-02-15T22:41:15.486 INFO:tasks.workunit.client.1.smithi082.stdout:1/477: rmdir d1/d9a 0 2024-02-15T22:41:15.486 INFO:tasks.workunit.client.1.smithi082.stdout:1/478: write d1/da/d14/d18/d1f/d76/f92 [518083,71543] 0 2024-02-15T22:41:15.486 INFO:tasks.workunit.client.1.smithi082.stdout:1/479: chown d1/f5b 84 1 2024-02-15T22:41:15.487 INFO:tasks.workunit.client.1.smithi082.stdout:6/589: link d2/c26 d2/d18/d23/cbb 0 2024-02-15T22:41:15.494 INFO:tasks.workunit.client.1.smithi082.stdout:1/480: rename d1/da/d11/d3f/c87 to d1/da/d14/d18/c9f 0 2024-02-15T22:41:15.494 INFO:tasks.workunit.client.1.smithi082.stdout:1/481: truncate d1/da/d14/d18/d6d/f86 4215317 0 2024-02-15T22:41:15.496 INFO:tasks.workunit.client.1.smithi082.stdout:6/590: rename d2/d30/c50 to d2/cbc 0 2024-02-15T22:41:15.496 INFO:tasks.workunit.client.1.smithi082.stdout:6/591: fdatasync d2/d18/d8a/d47/f7b 0 2024-02-15T22:41:15.496 INFO:tasks.workunit.client.1.smithi082.stdout:6/592: chown d2/d18/d8a/d84/c9b 9603092 1 2024-02-15T22:41:15.497 INFO:tasks.workunit.client.1.smithi082.stdout:6/593: read d2/d45/f56 [652533,59041] 0 2024-02-15T22:41:15.498 INFO:tasks.workunit.client.1.smithi082.stdout:6/594: write d2/d18/d8a/d47/d72/d80/fb4 [127845,123313] 0 2024-02-15T22:41:15.498 INFO:tasks.workunit.client.1.smithi082.stdout:6/595: mknod d2/cbd 0 2024-02-15T22:41:15.498 INFO:tasks.workunit.client.1.smithi082.stdout:6/596: fsync d2/d18/d23/d67/f71 0 2024-02-15T22:41:15.499 INFO:tasks.workunit.client.1.smithi082.stdout:1/482: write d1/f1d [281073,44706] 0 2024-02-15T22:41:15.499 INFO:tasks.workunit.client.1.smithi082.stdout:6/597: dread d2/d18/d8a/f8f [0,4194304] 0 2024-02-15T22:41:15.501 INFO:tasks.workunit.client.1.smithi082.stdout:1/483: read d1/da/d14/f28 [54665,125074] 0 2024-02-15T22:41:15.501 INFO:tasks.workunit.client.1.smithi082.stdout:1/484: dread - d1/da/d14/d18/d6d/f6f zero size 2024-02-15T22:41:15.501 INFO:tasks.workunit.client.1.smithi082.stdout:1/485: dread - d1/da/d14/d18/d6d/f6f zero size 2024-02-15T22:41:15.501 INFO:tasks.workunit.client.1.smithi082.stdout:1/486: truncate d1/da/d14/d18/d1f/f84 280553 0 2024-02-15T22:41:15.501 INFO:tasks.workunit.client.1.smithi082.stdout:9/516: dwrite d8/f22 [0,4194304] 0 2024-02-15T22:41:15.503 INFO:tasks.workunit.client.1.smithi082.stdout:6/598: fsync d2/d18/d8a/d47/d72/d80/fb4 0 2024-02-15T22:41:15.512 INFO:tasks.workunit.client.1.smithi082.stdout:9/517: dread d8/d12/d33/f39 [0,4194304] 0 2024-02-15T22:41:15.514 INFO:tasks.workunit.client.1.smithi082.stdout:1/487: rmdir d1/da/d14/d18/d51 39 2024-02-15T22:41:15.514 INFO:tasks.workunit.client.1.smithi082.stdout:1/488: fdatasync d1/da/d14/d18/d51/f71 0 2024-02-15T22:41:15.515 INFO:tasks.workunit.client.1.smithi082.stdout:9/518: mkdir d8/d12/d33/d64/d8b/d96 0 2024-02-15T22:41:15.515 INFO:tasks.workunit.client.1.smithi082.stdout:9/519: chown d8/d12/d33/l52 445892 1 2024-02-15T22:41:15.516 INFO:tasks.workunit.client.1.smithi082.stdout:9/520: mkdir d8/d12/d67/d70/d97 0 2024-02-15T22:41:15.516 INFO:tasks.workunit.client.1.smithi082.stdout:9/521: read d8/f19 [312090,9722] 0 2024-02-15T22:41:15.517 INFO:tasks.workunit.client.1.smithi082.stdout:1/489: rename d1/da/d11/d3f/l9d to d1/da/d14/d18/la0 0 2024-02-15T22:41:15.517 INFO:tasks.workunit.client.1.smithi082.stdout:1/490: stat d1/da/d11/d3f/d75/f78 0 2024-02-15T22:41:15.517 INFO:tasks.workunit.client.1.smithi082.stdout:1/491: chown d1/da/d11/d93 14471201 1 2024-02-15T22:41:15.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:15 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:15.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:15 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:15.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:15 smithi033 ceph-mon[29033]: Reconfiguring grafana.smithi033 (dependencies changed)... 2024-02-15T22:41:15.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:15 smithi033 ceph-mon[29033]: Reconfiguring daemon grafana.smithi033 on smithi033 2024-02-15T22:41:15.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:15 smithi033 ceph-mon[29033]: pgmap v20: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 100 MiB/s wr, 551 op/s 2024-02-15T22:41:15.520 INFO:tasks.workunit.client.1.smithi082.stdout:1/492: mknod d1/da/d14/d18/ca1 0 2024-02-15T22:41:15.521 INFO:tasks.workunit.client.1.smithi082.stdout:1/493: creat d1/da/d14/d18/d1f/d7a/fa2 x:0 0 0 2024-02-15T22:41:15.522 INFO:tasks.workunit.client.1.smithi082.stdout:1/494: creat d1/da/d14/fa3 x:0 0 0 2024-02-15T22:41:15.522 INFO:tasks.workunit.client.1.smithi082.stdout:1/495: chown d1/da/d14/d18/d6d/f86 195761 1 2024-02-15T22:41:15.523 INFO:tasks.workunit.client.1.smithi082.stdout:6/599: dwrite d2/d18/d23/f35 [0,4194304] 0 2024-02-15T22:41:15.524 INFO:tasks.workunit.client.1.smithi082.stdout:1/496: read d1/da/d14/d18/d1f/d2f/f3e [185388,82843] 0 2024-02-15T22:41:15.524 INFO:tasks.workunit.client.1.smithi082.stdout:1/497: chown d1/da/d14/l42 1018755 1 2024-02-15T22:41:15.525 INFO:tasks.workunit.client.1.smithi082.stdout:8/472: sync 2024-02-15T22:41:15.525 INFO:tasks.workunit.client.1.smithi082.stdout:4/487: sync 2024-02-15T22:41:15.526 INFO:tasks.workunit.client.1.smithi082.stdout:0/377: sync 2024-02-15T22:41:15.526 INFO:tasks.workunit.client.1.smithi082.stdout:0/378: fsync d3/d64/f68 0 2024-02-15T22:41:15.526 INFO:tasks.workunit.client.1.smithi082.stdout:4/488: write d0/d46/f5b [1176407,16544] 0 2024-02-15T22:41:15.526 INFO:tasks.workunit.client.1.smithi082.stdout:8/473: write d1/d7/de/d57/f91 [352787,16731] 0 2024-02-15T22:41:15.526 INFO:tasks.workunit.client.1.smithi082.stdout:8/474: chown d1/d7/d9/d42/d6a/f76 112229971 1 2024-02-15T22:41:15.526 INFO:tasks.workunit.client.1.smithi082.stdout:4/489: creat d0/d47/d4d/fad x:0 0 0 2024-02-15T22:41:15.526 INFO:tasks.workunit.client.1.smithi082.stdout:9/522: rmdir d8/d12/d33/d64 39 2024-02-15T22:41:15.530 INFO:tasks.workunit.client.1.smithi082.stdout:4/490: creat d0/d8/d32/d39/da4/fae x:0 0 0 2024-02-15T22:41:15.531 INFO:tasks.workunit.client.1.smithi082.stdout:9/523: mknod d8/d24/d2e/c98 0 2024-02-15T22:41:15.532 INFO:tasks.workunit.client.1.smithi082.stdout:8/475: mknod d1/d7/d9/ca3 0 2024-02-15T22:41:15.534 INFO:tasks.workunit.client.1.smithi082.stdout:1/498: dread d1/da/d14/d18/d6d/f86 [0,4194304] 0 2024-02-15T22:41:15.534 INFO:tasks.workunit.client.1.smithi082.stdout:9/524: mkdir d8/d12/d33/d64/d7c/d99 0 2024-02-15T22:41:15.535 INFO:tasks.workunit.client.1.smithi082.stdout:4/491: getdents d0/d8/d1b/d70 0 2024-02-15T22:41:15.537 INFO:tasks.workunit.client.1.smithi082.stdout:1/499: truncate d1/da/d11/f9e 2529919 0 2024-02-15T22:41:15.539 INFO:tasks.workunit.client.1.smithi082.stdout:1/500: unlink d1/da/d14/d18/l80 0 2024-02-15T22:41:15.539 INFO:tasks.workunit.client.1.smithi082.stdout:6/600: dread d2/d18/d23/f90 [0,4194304] 0 2024-02-15T22:41:15.540 INFO:tasks.workunit.client.1.smithi082.stdout:6/601: symlink d2/d45/lbe 0 2024-02-15T22:41:15.548 INFO:tasks.workunit.client.1.smithi082.stdout:0/379: dwrite d3/d19/f24 [0,4194304] 0 2024-02-15T22:41:15.548 INFO:tasks.workunit.client.1.smithi082.stdout:0/380: fsync d3/d19/d1c/f52 0 2024-02-15T22:41:15.551 INFO:tasks.workunit.client.1.smithi082.stdout:0/381: mknod d3/d19/d20/d7c/c82 0 2024-02-15T22:41:15.551 INFO:tasks.workunit.client.1.smithi082.stdout:0/382: chown d3/fa 1 1 2024-02-15T22:41:15.552 INFO:tasks.workunit.client.1.smithi082.stdout:0/383: creat d3/d19/d20/d7c/f83 x:0 0 0 2024-02-15T22:41:15.552 INFO:tasks.workunit.client.1.smithi082.stdout:0/384: truncate d3/d19/f44 868942 0 2024-02-15T22:41:15.552 INFO:tasks.workunit.client.1.smithi082.stdout:0/385: write d3/f34 [8935316,57566] 0 2024-02-15T22:41:15.553 INFO:tasks.workunit.client.1.smithi082.stdout:0/386: creat d3/d19/d25/d80/f84 x:0 0 0 2024-02-15T22:41:15.573 INFO:tasks.workunit.client.1.smithi082.stdout:1/501: dwrite d1/f47 [0,4194304] 0 2024-02-15T22:41:15.573 INFO:tasks.workunit.client.1.smithi082.stdout:1/502: fsync d1/da/f24 0 2024-02-15T22:41:15.573 INFO:tasks.workunit.client.1.smithi082.stdout:1/503: write d1/da/d14/d18/f3a [5183409,81073] 0 2024-02-15T22:41:15.581 INFO:tasks.workunit.client.1.smithi082.stdout:4/492: dwrite d0/d8/d32/d39/fab [0,4194304] 0 2024-02-15T22:41:15.581 INFO:tasks.workunit.client.1.smithi082.stdout:0/387: dwrite d3/f11 [0,4194304] 0 2024-02-15T22:41:15.583 INFO:tasks.workunit.client.1.smithi082.stdout:6/602: dwrite d2/d45/f56 [0,4194304] 0 2024-02-15T22:41:15.584 INFO:tasks.workunit.client.1.smithi082.stdout:8/476: dwrite d1/d7/de/f2f [0,4194304] 0 2024-02-15T22:41:15.584 INFO:tasks.workunit.client.1.smithi082.stdout:4/493: unlink d0/d8/d32/d39/c94 0 2024-02-15T22:41:15.587 INFO:tasks.workunit.client.1.smithi082.stdout:8/477: creat d1/d7/d9/fa4 x:0 0 0 2024-02-15T22:41:15.597 INFO:tasks.workunit.client.1.smithi082.stdout:8/478: dread d1/d7/d9/d50/f67 [0,4194304] 0 2024-02-15T22:41:15.597 INFO:tasks.workunit.client.1.smithi082.stdout:6/603: write d2/d30/d3b/f42 [4836994,27383] 0 2024-02-15T22:41:15.598 INFO:tasks.workunit.client.1.smithi082.stdout:8/479: mkdir d1/d7/d9/d42/d6a/da5 0 2024-02-15T22:41:15.599 INFO:tasks.workunit.client.1.smithi082.stdout:8/480: mkdir d1/d7/d9/d24/d43/da6 0 2024-02-15T22:41:15.599 INFO:tasks.workunit.client.1.smithi082.stdout:8/481: fsync d1/d7/d9/d42/f8b 0 2024-02-15T22:41:15.600 INFO:tasks.workunit.client.1.smithi082.stdout:8/482: mknod d1/d7/d9/d42/d6a/da5/ca7 0 2024-02-15T22:41:15.601 INFO:tasks.workunit.client.1.smithi082.stdout:8/483: link d1/d7/de/f68 d1/d7/d9/d50/fa8 0 2024-02-15T22:41:15.602 INFO:tasks.workunit.client.1.smithi082.stdout:8/484: mknod d1/d7/de/ca9 0 2024-02-15T22:41:15.602 INFO:tasks.workunit.client.1.smithi082.stdout:8/485: readlink d1/d7/d9/d42/d6a/l8f 0 2024-02-15T22:41:15.614 INFO:tasks.workunit.client.1.smithi082.stdout:1/504: dwrite d1/da/d11/d3f/f46 [0,4194304] 0 2024-02-15T22:41:15.614 INFO:tasks.workunit.client.1.smithi082.stdout:6/604: write d2/d18/d8a/d65/f7f [6542744,68768] 0 2024-02-15T22:41:15.614 INFO:tasks.workunit.client.1.smithi082.stdout:0/388: dwrite d3/d64/d71/f79 [0,4194304] 0 2024-02-15T22:41:15.616 INFO:tasks.workunit.client.1.smithi082.stdout:1/505: symlink d1/d57/la4 0 2024-02-15T22:41:15.618 INFO:tasks.workunit.client.1.smithi082.stdout:1/506: write d1/f3d [5099466,28988] 0 2024-02-15T22:41:15.618 INFO:tasks.workunit.client.1.smithi082.stdout:1/507: creat d1/da/d14/d18/d1f/d2f/fa5 x:0 0 0 2024-02-15T22:41:15.619 INFO:tasks.workunit.client.1.smithi082.stdout:1/508: dread - d1/da/d14/d18/d1f/d2f/fa5 zero size 2024-02-15T22:41:15.621 INFO:tasks.workunit.client.1.smithi082.stdout:1/509: symlink d1/da/d14/d18/d51/la6 0 2024-02-15T22:41:15.621 INFO:tasks.workunit.client.1.smithi082.stdout:4/494: dwrite d0/f54 [0,4194304] 0 2024-02-15T22:41:15.621 INFO:tasks.workunit.client.1.smithi082.stdout:1/510: write d1/da/d11/d3f/d75/f78 [1692102,114837] 0 2024-02-15T22:41:15.622 INFO:tasks.workunit.client.1.smithi082.stdout:8/486: dwrite d1/d7/d9/d24/d72/f79 [0,4194304] 0 2024-02-15T22:41:15.623 INFO:tasks.workunit.client.1.smithi082.stdout:4/495: rename d0/d8/d1b/dd/c5e to d0/d8/d1b/d70/caf 0 2024-02-15T22:41:15.624 INFO:tasks.workunit.client.1.smithi082.stdout:4/496: read d0/d8/f3d [4653020,3001] 0 2024-02-15T22:41:15.624 INFO:tasks.workunit.client.1.smithi082.stdout:8/487: mknod d1/d7/d9/d24/d43/caa 0 2024-02-15T22:41:15.625 INFO:tasks.workunit.client.1.smithi082.stdout:4/497: rmdir d0/d8/d1b/d70 39 2024-02-15T22:41:15.627 INFO:tasks.workunit.client.1.smithi082.stdout:1/511: dread d1/da/d14/d18/d6d/f70 [0,4194304] 0 2024-02-15T22:41:15.627 INFO:tasks.workunit.client.1.smithi082.stdout:0/389: dread d3/d19/d25/d45/f18 [0,4194304] 0 2024-02-15T22:41:15.627 INFO:tasks.workunit.client.1.smithi082.stdout:0/390: stat d3/d19/d20/d26/f31 0 2024-02-15T22:41:15.627 INFO:tasks.workunit.client.1.smithi082.stdout:8/488: mkdir d1/d7/d9/d50/d56/dab 0 2024-02-15T22:41:15.629 INFO:tasks.workunit.client.1.smithi082.stdout:0/391: unlink d3/d19/d20/d7c/f83 0 2024-02-15T22:41:15.629 INFO:tasks.workunit.client.1.smithi082.stdout:0/392: readlink d3/l47 0 2024-02-15T22:41:15.631 INFO:tasks.workunit.client.1.smithi082.stdout:8/489: mknod d1/d7/d9/d50/d56/cac 0 2024-02-15T22:41:15.632 INFO:tasks.workunit.client.1.smithi082.stdout:8/490: symlink d1/d7/d9/d24/d30/lad 0 2024-02-15T22:41:15.634 INFO:tasks.workunit.client.1.smithi082.stdout:8/491: creat d1/d7/d9/d24/d43/fae x:0 0 0 2024-02-15T22:41:15.634 INFO:tasks.workunit.client.1.smithi082.stdout:8/492: truncate d1/d7/d9/d24/d72/f98 179356 0 2024-02-15T22:41:15.636 INFO:tasks.workunit.client.1.smithi082.stdout:6/605: dwrite d2/d30/f86 [0,4194304] 0 2024-02-15T22:41:15.640 INFO:tasks.workunit.client.1.smithi082.stdout:1/512: dread d1/da/d14/d18/d1f/d2f/f52 [0,4194304] 0 2024-02-15T22:41:15.642 INFO:tasks.workunit.client.1.smithi082.stdout:4/498: dread d0/d8/d1b/f1d [0,4194304] 0 2024-02-15T22:41:15.645 INFO:tasks.workunit.client.1.smithi082.stdout:6/606: mknod d2/cbf 0 2024-02-15T22:41:15.646 INFO:tasks.workunit.client.1.smithi082.stdout:1/513: mkdir d1/da/d14/d18/d1f/d76/da7 0 2024-02-15T22:41:15.646 INFO:tasks.workunit.client.1.smithi082.stdout:1/514: write d1/da/d14/d7f/f85 [983811,20013] 0 2024-02-15T22:41:15.646 INFO:tasks.workunit.client.1.smithi082.stdout:1/515: dread - d1/d57/f94 zero size 2024-02-15T22:41:15.646 INFO:tasks.workunit.client.1.smithi082.stdout:6/607: dread d2/d18/d8a/f8f [0,4194304] 0 2024-02-15T22:41:15.646 INFO:tasks.workunit.client.1.smithi082.stdout:4/499: symlink d0/d8/d1b/dd/d37/lb0 0 2024-02-15T22:41:15.647 INFO:tasks.workunit.client.1.smithi082.stdout:0/393: dwrite d3/d19/d5f/f63 [0,4194304] 0 2024-02-15T22:41:15.647 INFO:tasks.workunit.client.1.smithi082.stdout:0/394: chown l1 0 1 2024-02-15T22:41:15.648 INFO:tasks.workunit.client.1.smithi082.stdout:1/516: link d1/da/d11/d3f/c63 d1/da/d11/ca8 0 2024-02-15T22:41:15.648 INFO:tasks.workunit.client.1.smithi082.stdout:1/517: write d1/d57/f5f [341754,33846] 0 2024-02-15T22:41:15.651 INFO:tasks.workunit.client.1.smithi082.stdout:6/608: rename d2/d18/c89 to d2/d18/d8a/cc0 0 2024-02-15T22:41:15.651 INFO:tasks.workunit.client.1.smithi082.stdout:6/609: write d2/f98 [988117,38515] 0 2024-02-15T22:41:15.656 INFO:tasks.workunit.client.1.smithi082.stdout:0/395: link d3/d19/d25/d45/l74 d3/d64/l85 0 2024-02-15T22:41:15.661 INFO:tasks.workunit.client.1.smithi082.stdout:0/396: link d3/d19/d20/d26/c69 d3/d19/d25/d45/c86 0 2024-02-15T22:41:15.663 INFO:tasks.workunit.client.1.smithi082.stdout:0/397: mkdir d3/d6b/d7f/d87 0 2024-02-15T22:41:15.664 INFO:tasks.workunit.client.1.smithi082.stdout:0/398: mkdir d3/d19/d1c/d76/d88 0 2024-02-15T22:41:15.667 INFO:tasks.workunit.client.1.smithi082.stdout:4/500: dwrite d0/d16/f9c [0,4194304] 0 2024-02-15T22:41:15.668 INFO:tasks.workunit.client.1.smithi082.stdout:5/486: sync 2024-02-15T22:41:15.668 INFO:tasks.workunit.client.1.smithi082.stdout:5/487: fdatasync d5/da/d14/d45/f6b 0 2024-02-15T22:41:15.669 INFO:tasks.workunit.client.1.smithi082.stdout:6/610: dwrite d2/d30/d3b/f49 [0,4194304] 0 2024-02-15T22:41:15.671 INFO:tasks.workunit.client.1.smithi082.stdout:4/501: mknod d0/d47/da6/da7/cb1 0 2024-02-15T22:41:15.671 INFO:tasks.workunit.client.1.smithi082.stdout:4/502: write d0/fa8 [731056,9741] 0 2024-02-15T22:41:15.672 INFO:tasks.workunit.client.1.smithi082.stdout:5/488: mknod d5/da/d22/d59/da3/ca9 0 2024-02-15T22:41:15.673 INFO:tasks.workunit.client.1.smithi082.stdout:4/503: creat d0/d8/d32/d39/fb2 x:0 0 0 2024-02-15T22:41:15.674 INFO:tasks.workunit.client.1.smithi082.stdout:0/399: write d3/f11 [3596809,58839] 0 2024-02-15T22:41:15.674 INFO:tasks.workunit.client.1.smithi082.stdout:0/400: write d3/d19/d20/d26/f4e [543045,11309] 0 2024-02-15T22:41:15.674 INFO:tasks.workunit.client.1.smithi082.stdout:0/401: write d3/d19/d25/d45/d56/f6f [3510,6565] 0 2024-02-15T22:41:15.675 INFO:tasks.workunit.client.1.smithi082.stdout:4/504: readlink d0/d16/l19 0 2024-02-15T22:41:15.676 INFO:tasks.workunit.client.1.smithi082.stdout:0/402: link d3/fe d3/d19/d20/d26/f89 0 2024-02-15T22:41:15.678 INFO:tasks.workunit.client.1.smithi082.stdout:0/403: dread d3/d19/f2e [0,4194304] 0 2024-02-15T22:41:15.678 INFO:tasks.workunit.client.1.smithi082.stdout:4/505: unlink d0/d47/c96 0 2024-02-15T22:41:15.679 INFO:tasks.workunit.client.1.smithi082.stdout:0/404: getdents d3/d64 0 2024-02-15T22:41:15.679 INFO:tasks.workunit.client.1.smithi082.stdout:0/405: readlink d3/d19/d20/l22 0 2024-02-15T22:41:15.680 INFO:tasks.workunit.client.1.smithi082.stdout:5/489: dread d5/da/d22/f35 [0,4194304] 0 2024-02-15T22:41:15.681 INFO:tasks.workunit.client.1.smithi082.stdout:0/406: creat d3/d19/d25/d45/d56/f8a x:0 0 0 2024-02-15T22:41:15.684 INFO:tasks.workunit.client.1.smithi082.stdout:5/490: rmdir d5/da/d67/da0 39 2024-02-15T22:41:15.685 INFO:tasks.workunit.client.1.smithi082.stdout:4/506: rmdir d0/d8/d32/d39 39 2024-02-15T22:41:15.686 INFO:tasks.workunit.client.1.smithi082.stdout:4/507: read d0/d16/d4a/f52 [16901,94351] 0 2024-02-15T22:41:15.686 INFO:tasks.workunit.client.1.smithi082.stdout:4/508: creat d0/d8/d1b/fb3 x:0 0 0 2024-02-15T22:41:15.686 INFO:tasks.workunit.client.1.smithi082.stdout:4/509: fdatasync d0/d8/f80 0 2024-02-15T22:41:15.687 INFO:tasks.workunit.client.1.smithi082.stdout:5/491: mkdir d5/da/d56/d98/daa 0 2024-02-15T22:41:15.687 INFO:tasks.workunit.client.1.smithi082.stdout:0/407: fsync d3/d19/d20/d26/f89 0 2024-02-15T22:41:15.689 INFO:tasks.workunit.client.1.smithi082.stdout:4/510: rmdir d0/d16/d4a 39 2024-02-15T22:41:15.690 INFO:tasks.workunit.client.1.smithi082.stdout:5/492: symlink d5/da/d56/lab 0 2024-02-15T22:41:15.697 INFO:tasks.workunit.client.1.smithi082.stdout:4/511: dread d0/f54 [0,4194304] 0 2024-02-15T22:41:15.701 INFO:tasks.workunit.client.1.smithi082.stdout:5/493: write d5/da/f26 [3545738,21326] 0 2024-02-15T22:41:15.705 INFO:tasks.workunit.client.1.smithi082.stdout:5/494: write d5/da/d22/f35 [892334,123435] 0 2024-02-15T22:41:15.705 INFO:tasks.workunit.client.1.smithi082.stdout:0/408: dwrite d3/d64/d71/f79 [0,4194304] 0 2024-02-15T22:41:15.705 INFO:tasks.workunit.client.1.smithi082.stdout:5/495: write d5/da/d56/fa2 [521054,59247] 0 2024-02-15T22:41:15.707 INFO:tasks.workunit.client.1.smithi082.stdout:5/496: symlink d5/da/d56/lac 0 2024-02-15T22:41:15.707 INFO:tasks.workunit.client.1.smithi082.stdout:5/497: write d5/da/d22/d59/f80 [271048,74366] 0 2024-02-15T22:41:15.707 INFO:tasks.workunit.client.1.smithi082.stdout:5/498: chown d5/da/d22/d59/f64 56434539 1 2024-02-15T22:41:15.708 INFO:tasks.workunit.client.1.smithi082.stdout:0/409: mknod d3/d19/d20/d26/c8b 0 2024-02-15T22:41:15.708 INFO:tasks.workunit.client.1.smithi082.stdout:0/410: chown d3/d19/d20/c3b 1933763 1 2024-02-15T22:41:15.712 INFO:tasks.workunit.client.1.smithi082.stdout:5/499: mkdir d5/da/dc/dad 0 2024-02-15T22:41:15.713 INFO:tasks.workunit.client.1.smithi082.stdout:5/500: mknod d5/da/d56/d6e/cae 0 2024-02-15T22:41:15.713 INFO:tasks.workunit.client.1.smithi082.stdout:5/501: creat d5/da/d22/d59/d84/d89/faf x:0 0 0 2024-02-15T22:41:15.713 INFO:tasks.workunit.client.1.smithi082.stdout:5/502: creat d5/da/d67/fb0 x:0 0 0 2024-02-15T22:41:15.715 INFO:tasks.workunit.client.1.smithi082.stdout:5/503: read - d5/da/d22/fa4 zero size 2024-02-15T22:41:15.715 INFO:tasks.workunit.client.1.smithi082.stdout:5/504: chown d5/da/d22/d59/da3 1017 1 2024-02-15T22:41:15.716 INFO:tasks.workunit.client.1.smithi082.stdout:5/505: mknod d5/da/d14/d53/cb1 0 2024-02-15T22:41:15.716 INFO:tasks.workunit.client.1.smithi082.stdout:5/506: write d5/da/d14/d53/f85 [1202102,75327] 0 2024-02-15T22:41:15.717 INFO:tasks.workunit.client.1.smithi082.stdout:4/512: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:41:15.717 INFO:tasks.workunit.client.1.smithi082.stdout:5/507: link d5/l74 d5/da/d22/lb2 0 2024-02-15T22:41:15.717 INFO:tasks.workunit.client.1.smithi082.stdout:4/513: creat d0/d8/d32/fb4 x:0 0 0 2024-02-15T22:41:15.718 INFO:tasks.workunit.client.1.smithi082.stdout:5/508: creat d5/da/d56/d6e/d73/fb3 x:0 0 0 2024-02-15T22:41:15.721 INFO:tasks.workunit.client.1.smithi082.stdout:5/509: mknod d5/da/d22/cb4 0 2024-02-15T22:41:15.731 INFO:tasks.workunit.client.1.smithi082.stdout:0/411: dwrite d3/f57 [0,4194304] 0 2024-02-15T22:41:15.731 INFO:tasks.workunit.client.1.smithi082.stdout:4/514: dread d0/d16/f2d [0,4194304] 0 2024-02-15T22:41:15.731 INFO:tasks.workunit.client.1.smithi082.stdout:4/515: creat d0/d8/d32/fb5 x:0 0 0 2024-02-15T22:41:15.732 INFO:tasks.workunit.client.1.smithi082.stdout:5/510: dread d5/da/d22/d59/fa6 [0,4194304] 0 2024-02-15T22:41:15.732 INFO:tasks.workunit.client.1.smithi082.stdout:5/511: fdatasync d5/da/d14/d53/f7b 0 2024-02-15T22:41:15.735 INFO:tasks.workunit.client.1.smithi082.stdout:5/512: creat d5/da/d22/d59/fb5 x:0 0 0 2024-02-15T22:41:15.736 INFO:tasks.workunit.client.1.smithi082.stdout:5/513: link l3 d5/da/d22/d59/da3/lb6 0 2024-02-15T22:41:15.741 INFO:tasks.workunit.client.1.smithi082.stdout:4/516: dread d0/fa0 [0,4194304] 0 2024-02-15T22:41:15.742 INFO:tasks.workunit.client.1.smithi082.stdout:0/412: dread d3/d19/f58 [0,4194304] 0 2024-02-15T22:41:15.742 INFO:tasks.workunit.client.1.smithi082.stdout:4/517: creat d0/d8/d1b/dd/fb6 x:0 0 0 2024-02-15T22:41:15.742 INFO:tasks.workunit.client.1.smithi082.stdout:4/518: stat d0/d16/f22 0 2024-02-15T22:41:15.743 INFO:tasks.workunit.client.1.smithi082.stdout:0/413: creat d3/d6b/d7f/f8c x:0 0 0 2024-02-15T22:41:15.743 INFO:tasks.workunit.client.1.smithi082.stdout:0/414: creat d3/d6b/d7f/f8d x:0 0 0 2024-02-15T22:41:15.743 INFO:tasks.workunit.client.1.smithi082.stdout:0/415: fdatasync d3/d19/f24 0 2024-02-15T22:41:15.743 INFO:tasks.workunit.client.1.smithi082.stdout:4/519: symlink d0/d47/d4d/lb7 0 2024-02-15T22:41:15.745 INFO:tasks.workunit.client.1.smithi082.stdout:0/416: mknod d3/d6b/c8e 0 2024-02-15T22:41:15.745 INFO:tasks.workunit.client.1.smithi082.stdout:0/417: creat d3/d19/d25/d80/f8f x:0 0 0 2024-02-15T22:41:15.745 INFO:tasks.workunit.client.1.smithi082.stdout:0/418: creat d3/d19/d25/d45/d56/f90 x:0 0 0 2024-02-15T22:41:15.746 INFO:tasks.workunit.client.1.smithi082.stdout:5/514: dread d5/da/d14/d45/f6b [0,4194304] 0 2024-02-15T22:41:15.746 INFO:tasks.workunit.client.1.smithi082.stdout:5/515: write d5/da/d14/d53/f70 [715522,31937] 0 2024-02-15T22:41:15.746 INFO:tasks.workunit.client.1.smithi082.stdout:5/516: truncate d5/da/d22/d59/d84/d89/faf 680135 0 2024-02-15T22:41:15.746 INFO:tasks.workunit.client.1.smithi082.stdout:5/517: truncate d5/da/d22/d59/fb5 794706 0 2024-02-15T22:41:15.748 INFO:tasks.workunit.client.1.smithi082.stdout:4/520: rename d0/d8/d1b/dd/l3e to d0/d16/lb8 0 2024-02-15T22:41:15.749 INFO:tasks.workunit.client.1.smithi082.stdout:5/518: getdents d5/da/d14/d53 0 2024-02-15T22:41:15.749 INFO:tasks.workunit.client.1.smithi082.stdout:5/519: creat d5/da/d22/fb7 x:0 0 0 2024-02-15T22:41:15.750 INFO:tasks.workunit.client.1.smithi082.stdout:4/521: link d0/d8/d1b/fb3 d0/d47/fb9 0 2024-02-15T22:41:15.751 INFO:tasks.workunit.client.1.smithi082.stdout:4/522: creat d0/d8/fba x:0 0 0 2024-02-15T22:41:15.753 INFO:tasks.workunit.client.1.smithi082.stdout:5/520: creat d5/da/dc/dad/fb8 x:0 0 0 2024-02-15T22:41:15.754 INFO:tasks.workunit.client.1.smithi082.stdout:0/419: rename d3/d64/d71/d73 to d3/d64/d71/d91 0 2024-02-15T22:41:15.754 INFO:tasks.workunit.client.1.smithi082.stdout:0/420: write d3/d19/f7e [331219,15577] 0 2024-02-15T22:41:15.754 INFO:tasks.workunit.client.1.smithi082.stdout:0/421: write d3/d19/f29 [609417,99942] 0 2024-02-15T22:41:15.755 INFO:tasks.workunit.client.1.smithi082.stdout:0/422: chown d3/d6b/d7f/d87 4502 1 2024-02-15T22:41:15.756 INFO:tasks.workunit.client.1.smithi082.stdout:5/521: rename d5/da/dc/l16 to d5/da/d22/d59/da3/lb9 0 2024-02-15T22:41:15.756 INFO:tasks.workunit.client.1.smithi082.stdout:5/522: write d5/da/f25 [266351,35548] 0 2024-02-15T22:41:15.757 INFO:tasks.workunit.client.1.smithi082.stdout:0/423: mkdir d3/d19/d5f/d92 0 2024-02-15T22:41:15.759 INFO:tasks.workunit.client.1.smithi082.stdout:5/523: rmdir d5/da/d22/d59/d84/d89 39 2024-02-15T22:41:15.760 INFO:tasks.workunit.client.1.smithi082.stdout:4/523: dread d0/d8/d32/d39/fab [0,4194304] 0 2024-02-15T22:41:15.762 INFO:tasks.workunit.client.1.smithi082.stdout:4/524: link d0/d16/d4a/f51 d0/d16/d4a/d6a/fbb 0 2024-02-15T22:41:15.762 INFO:tasks.workunit.client.1.smithi082.stdout:4/525: fsync d0/d46/f5b 0 2024-02-15T22:41:15.766 INFO:tasks.workunit.client.1.smithi082.stdout:0/424: dread d3/d19/f21 [0,4194304] 0 2024-02-15T22:41:15.773 INFO:tasks.workunit.client.1.smithi082.stdout:4/526: dread d0/d16/d4a/f51 [0,4194304] 0 2024-02-15T22:41:15.776 INFO:tasks.workunit.client.1.smithi082.stdout:4/527: dread d0/f54 [0,4194304] 0 2024-02-15T22:41:15.779 INFO:tasks.workunit.client.1.smithi082.stdout:4/528: dread d0/d8/d1b/dd/ff [0,4194304] 0 2024-02-15T22:41:15.779 INFO:tasks.workunit.client.1.smithi082.stdout:4/529: creat d0/d8/d1b/dd/fbc x:0 0 0 2024-02-15T22:41:15.779 INFO:tasks.workunit.client.1.smithi082.stdout:5/524: dwrite d5/da/d14/d45/f6b [4194304,4194304] 0 2024-02-15T22:41:15.783 INFO:tasks.workunit.client.1.smithi082.stdout:5/525: link d5/f39 d5/da/d22/d59/d84/d89/fba 0 2024-02-15T22:41:15.783 INFO:tasks.workunit.client.1.smithi082.stdout:5/526: chown d5/da/d22/d59/fb5 843228882 1 2024-02-15T22:41:15.783 INFO:tasks.workunit.client.1.smithi082.stdout:5/527: mknod d5/da/d22/d59/cbb 0 2024-02-15T22:41:15.785 INFO:tasks.workunit.client.1.smithi082.stdout:5/528: rmdir d5/da/d56/d98/daa 0 2024-02-15T22:41:15.785 INFO:tasks.workunit.client.1.smithi082.stdout:5/529: fdatasync d5/da/dc/f3d 0 2024-02-15T22:41:15.785 INFO:tasks.workunit.client.1.smithi082.stdout:5/530: chown d5/da/d14/c13 0 1 2024-02-15T22:41:15.785 INFO:tasks.workunit.client.1.smithi082.stdout:5/531: creat d5/da/d56/d6e/fbc x:0 0 0 2024-02-15T22:41:15.802 INFO:tasks.workunit.client.1.smithi082.stdout:4/530: dwrite d0/d8/d1b/fac [0,4194304] 0 2024-02-15T22:41:15.802 INFO:tasks.workunit.client.1.smithi082.stdout:5/532: dwrite d5/da/d14/d53/f71 [0,4194304] 0 2024-02-15T22:41:15.802 INFO:tasks.workunit.client.1.smithi082.stdout:5/533: write d5/da/d56/fa2 [1128076,51263] 0 2024-02-15T22:41:15.803 INFO:tasks.workunit.client.1.smithi082.stdout:5/534: stat d5/da/dc/f6d 0 2024-02-15T22:41:15.825 INFO:tasks.workunit.client.1.smithi082.stdout:5/535: dwrite d5/da/f1c [0,4194304] 0 2024-02-15T22:41:15.826 INFO:tasks.workunit.client.1.smithi082.stdout:4/531: dwrite d0/d16/d4a/f51 [0,4194304] 0 2024-02-15T22:41:15.826 INFO:tasks.workunit.client.1.smithi082.stdout:5/536: mknod d5/da/d56/d6e/cbd 0 2024-02-15T22:41:15.827 INFO:tasks.workunit.client.1.smithi082.stdout:4/532: rename d0/d8/c2a to d0/cbd 0 2024-02-15T22:41:15.828 INFO:tasks.workunit.client.1.smithi082.stdout:5/537: dread d5/da/d22/d59/d84/d89/fba [0,4194304] 0 2024-02-15T22:41:15.829 INFO:tasks.workunit.client.1.smithi082.stdout:5/538: unlink d5/da/d14/f5a 0 2024-02-15T22:41:15.830 INFO:tasks.workunit.client.1.smithi082.stdout:5/539: creat d5/da/dc/d43/fbe x:0 0 0 2024-02-15T22:41:15.855 INFO:tasks.workunit.client.1.smithi082.stdout:5/540: dwrite d5/da/dc/f6d [0,4194304] 0 2024-02-15T22:41:15.857 INFO:tasks.workunit.client.1.smithi082.stdout:5/541: mkdir d5/da/d67/dbf 0 2024-02-15T22:41:15.859 INFO:tasks.workunit.client.1.smithi082.stdout:4/533: dwrite d0/d8/d32/d39/f3f [0,4194304] 0 2024-02-15T22:41:15.859 INFO:tasks.workunit.client.1.smithi082.stdout:4/534: chown d0/d16/d4a/l50 787687422 1 2024-02-15T22:41:15.866 INFO:tasks.workunit.client.1.smithi082.stdout:5/542: write d5/f4b [2478982,36779] 0 2024-02-15T22:41:15.866 INFO:tasks.workunit.client.1.smithi082.stdout:5/543: fsync d5/da/d22/fb7 0 2024-02-15T22:41:15.866 INFO:tasks.workunit.client.1.smithi082.stdout:5/544: write d5/da/dc/d43/f9d [152541,9077] 0 2024-02-15T22:41:15.880 INFO:tasks.workunit.client.1.smithi082.stdout:4/535: dwrite d0/d16/f2d [4194304,4194304] 0 2024-02-15T22:41:15.880 INFO:tasks.workunit.client.1.smithi082.stdout:4/536: chown d0/d46/c64 137 1 2024-02-15T22:41:15.881 INFO:tasks.workunit.client.1.smithi082.stdout:4/537: symlink d0/d8/d1b/dd/lbe 0 2024-02-15T22:41:15.883 INFO:tasks.workunit.client.1.smithi082.stdout:4/538: unlink d0/d8/f95 0 2024-02-15T22:41:15.883 INFO:tasks.workunit.client.1.smithi082.stdout:4/539: creat d0/d8/d32/fbf x:0 0 0 2024-02-15T22:41:15.884 INFO:tasks.workunit.client.1.smithi082.stdout:4/540: mkdir d0/dc0 0 2024-02-15T22:41:15.885 INFO:tasks.workunit.client.1.smithi082.stdout:4/541: link d0/d8/d1b/dd/fb6 d0/d47/d4d/fc1 0 2024-02-15T22:41:15.885 INFO:tasks.workunit.client.1.smithi082.stdout:4/542: chown d0/d8/d1b/c62 260423 1 2024-02-15T22:41:15.888 INFO:tasks.workunit.client.1.smithi082.stdout:4/543: rename d0/d47/f99 to d0/fc2 0 2024-02-15T22:41:15.888 INFO:tasks.workunit.client.1.smithi082.stdout:5/545: dwrite d5/da/d14/f75 [0,4194304] 0 2024-02-15T22:41:15.909 INFO:tasks.workunit.client.1.smithi082.stdout:4/544: dwrite d0/d46/f8a [0,4194304] 0 2024-02-15T22:41:15.911 INFO:tasks.workunit.client.1.smithi082.stdout:4/545: mknod d0/d8/d1b/dd/daa/cc3 0 2024-02-15T22:41:15.912 INFO:tasks.workunit.client.1.smithi082.stdout:5/546: dwrite d5/f39 [0,4194304] 0 2024-02-15T22:41:15.912 INFO:tasks.workunit.client.1.smithi082.stdout:5/547: chown d5/da/d67/da0/c77 4 1 2024-02-15T22:41:15.912 INFO:tasks.workunit.client.1.smithi082.stdout:4/546: link d0/d8/f80 d0/d8/d1b/dd/fc4 0 2024-02-15T22:41:15.915 INFO:tasks.workunit.client.1.smithi082.stdout:5/548: symlink d5/lc0 0 2024-02-15T22:41:15.915 INFO:tasks.workunit.client.1.smithi082.stdout:5/549: dread - d5/da/d22/f83 zero size 2024-02-15T22:41:15.916 INFO:tasks.workunit.client.1.smithi082.stdout:5/550: fsync d5/da/d22/f35 0 2024-02-15T22:41:15.916 INFO:tasks.workunit.client.1.smithi082.stdout:5/551: creat d5/da/d14/d45/fc1 x:0 0 0 2024-02-15T22:41:15.917 INFO:tasks.workunit.client.1.smithi082.stdout:5/552: write d5/da/d14/d45/fc1 [397251,127527] 0 2024-02-15T22:41:15.917 INFO:tasks.workunit.client.1.smithi082.stdout:5/553: symlink d5/da/d22/d59/lc2 0 2024-02-15T22:41:15.919 INFO:tasks.workunit.client.1.smithi082.stdout:5/554: creat d5/da/d67/da0/d92/fc3 x:0 0 0 2024-02-15T22:41:15.919 INFO:tasks.workunit.client.1.smithi082.stdout:5/555: dread - d5/da/f96 zero size 2024-02-15T22:41:15.920 INFO:tasks.workunit.client.1.smithi082.stdout:5/556: link d5/da/d56/d6e/fbc d5/da/d67/da0/fc4 0 2024-02-15T22:41:15.921 INFO:tasks.workunit.client.1.smithi082.stdout:0/425: sync 2024-02-15T22:41:15.921 INFO:tasks.workunit.client.1.smithi082.stdout:7/455: sync 2024-02-15T22:41:15.921 INFO:tasks.workunit.client.1.smithi082.stdout:2/478: sync 2024-02-15T22:41:15.921 INFO:tasks.workunit.client.1.smithi082.stdout:6/611: sync 2024-02-15T22:41:15.921 INFO:tasks.workunit.client.1.smithi082.stdout:9/525: sync 2024-02-15T22:41:15.921 INFO:tasks.workunit.client.1.smithi082.stdout:0/426: fsync d3/d19/d1c/d6d/f72 0 2024-02-15T22:41:15.922 INFO:tasks.workunit.client.1.smithi082.stdout:0/427: readlink d3/d6b/l7b 0 2024-02-15T22:41:15.922 INFO:tasks.workunit.client.1.smithi082.stdout:1/518: sync 2024-02-15T22:41:15.922 INFO:tasks.workunit.client.1.smithi082.stdout:0/428: fdatasync d3/d19/d25/d45/d56/f6f 0 2024-02-15T22:41:15.922 INFO:tasks.workunit.client.1.smithi082.stdout:3/401: sync 2024-02-15T22:41:15.922 INFO:tasks.workunit.client.1.smithi082.stdout:8/493: sync 2024-02-15T22:41:15.923 INFO:tasks.workunit.client.1.smithi082.stdout:9/526: truncate d8/d24/d2e/f6a 1688528 0 2024-02-15T22:41:15.925 INFO:tasks.workunit.client.1.smithi082.stdout:2/479: rename d6/dc/d58/l35 to d6/dc/dd/d21/l98 0 2024-02-15T22:41:15.925 INFO:tasks.workunit.client.1.smithi082.stdout:2/480: truncate d6/f26 1116737 0 2024-02-15T22:41:15.927 INFO:tasks.workunit.client.1.smithi082.stdout:7/456: mkdir d12/d17/d42/d67/d81/d91 0 2024-02-15T22:41:15.929 INFO:tasks.workunit.client.1.smithi082.stdout:0/429: mkdir d3/d19/d93 0 2024-02-15T22:41:15.931 INFO:tasks.workunit.client.1.smithi082.stdout:3/402: creat d0/d16/d62/d14/f85 x:0 0 0 2024-02-15T22:41:15.932 INFO:tasks.workunit.client.1.smithi082.stdout:9/527: symlink d8/d12/d30/l9a 0 2024-02-15T22:41:15.932 INFO:tasks.workunit.client.1.smithi082.stdout:9/528: write d8/d12/d30/f7e [532971,121466] 0 2024-02-15T22:41:15.932 INFO:tasks.workunit.client.1.smithi082.stdout:9/529: chown d8/f18 43070 1 2024-02-15T22:41:15.933 INFO:tasks.workunit.client.1.smithi082.stdout:1/519: rename d1/da/d14/l5a to d1/da/d11/d93/la9 0 2024-02-15T22:41:15.936 INFO:tasks.workunit.client.1.smithi082.stdout:2/481: link d6/dc/dd/d1d/c2e d6/dc/d12/c99 0 2024-02-15T22:41:15.939 INFO:tasks.workunit.client.1.smithi082.stdout:3/403: mkdir d0/d16/d62/d14/d71/d86 0 2024-02-15T22:41:15.942 INFO:tasks.workunit.client.1.smithi082.stdout:2/482: unlink d6/dc/d12/d46/d4b/d63/c92 0 2024-02-15T22:41:15.942 INFO:tasks.workunit.client.1.smithi082.stdout:2/483: chown d6/dc/d12/d23/d90 6 1 2024-02-15T22:41:15.943 INFO:tasks.workunit.client.1.smithi082.stdout:0/430: rmdir d3/d64/d71 39 2024-02-15T22:41:15.943 INFO:tasks.workunit.client.1.smithi082.stdout:0/431: creat d3/d19/d1c/d6d/f94 x:0 0 0 2024-02-15T22:41:15.945 INFO:tasks.workunit.client.1.smithi082.stdout:3/404: mkdir d0/d16/d62/d14/d21/d69/d87 0 2024-02-15T22:41:15.950 INFO:tasks.workunit.client.1.smithi082.stdout:8/494: write d1/d7/f54 [708809,3495] 0 2024-02-15T22:41:15.950 INFO:tasks.workunit.client.1.smithi082.stdout:9/530: dread d8/f58 [0,4194304] 0 2024-02-15T22:41:15.954 INFO:tasks.workunit.client.1.smithi082.stdout:9/531: creat d8/d12/d30/d3c/d65/f9b x:0 0 0 2024-02-15T22:41:15.954 INFO:tasks.workunit.client.1.smithi082.stdout:1/520: write d1/da/d14/d18/d1f/f50 [3896836,89636] 0 2024-02-15T22:41:15.955 INFO:tasks.workunit.client.1.smithi082.stdout:6/612: dwrite d2/d18/d23/f90 [0,4194304] 0 2024-02-15T22:41:15.956 INFO:tasks.workunit.client.1.smithi082.stdout:9/532: creat d8/d24/d87/f9c x:0 0 0 2024-02-15T22:41:15.959 INFO:tasks.workunit.client.1.smithi082.stdout:5/557: dwrite d5/da/d22/f35 [0,4194304] 0 2024-02-15T22:41:15.959 INFO:tasks.workunit.client.1.smithi082.stdout:5/558: read - d5/da/d22/d59/d84/d89/f9c zero size 2024-02-15T22:41:15.959 INFO:tasks.workunit.client.1.smithi082.stdout:1/521: symlink d1/da/d14/d7f/laa 0 2024-02-15T22:41:15.959 INFO:tasks.workunit.client.1.smithi082.stdout:1/522: stat d1/da/d14/d18/d6d/d89 0 2024-02-15T22:41:15.960 INFO:tasks.workunit.client.1.smithi082.stdout:8/495: dread d1/d7/de/f2e [0,4194304] 0 2024-02-15T22:41:15.960 INFO:tasks.workunit.client.1.smithi082.stdout:8/496: chown d1/d7/d9/f81 305736 1 2024-02-15T22:41:15.960 INFO:tasks.workunit.client.1.smithi082.stdout:8/497: readlink d1/d7/d9/l77 0 2024-02-15T22:41:15.962 INFO:tasks.workunit.client.1.smithi082.stdout:6/613: mkdir d2/d18/d8a/d47/d69/dc1 0 2024-02-15T22:41:15.964 INFO:tasks.workunit.client.1.smithi082.stdout:5/559: creat d5/da/d67/da0/fc5 x:0 0 0 2024-02-15T22:41:15.966 INFO:tasks.workunit.client.1.smithi082.stdout:7/457: dwrite d12/d17/f25 [0,4194304] 0 2024-02-15T22:41:15.966 INFO:tasks.workunit.client.1.smithi082.stdout:7/458: chown d12/d27/d6e/l8e 6 1 2024-02-15T22:41:15.966 INFO:tasks.workunit.client.1.smithi082.stdout:7/459: write d12/d3b/f86 [381186,79588] 0 2024-02-15T22:41:15.967 INFO:tasks.workunit.client.1.smithi082.stdout:8/498: creat d1/d7/d48/d6f/faf x:0 0 0 2024-02-15T22:41:15.972 INFO:tasks.workunit.client.1.smithi082.stdout:7/460: creat d12/d3b/d5a/f92 x:0 0 0 2024-02-15T22:41:15.973 INFO:tasks.workunit.client.1.smithi082.stdout:7/461: truncate d12/d17/d42/f87 2702922 0 2024-02-15T22:41:15.974 INFO:tasks.workunit.client.1.smithi082.stdout:7/462: creat d12/d27/d6e/f93 x:0 0 0 2024-02-15T22:41:15.975 INFO:tasks.workunit.client.1.smithi082.stdout:7/463: unlink d12/f21 0 2024-02-15T22:41:15.976 INFO:tasks.workunit.client.1.smithi082.stdout:9/533: write d8/d24/d2e/d53/f59 [3108990,130293] 0 2024-02-15T22:41:15.986 INFO:tasks.workunit.client.1.smithi082.stdout:2/484: dwrite d6/dc/dd/d1d/f1f [0,4194304] 0 2024-02-15T22:41:15.986 INFO:tasks.workunit.client.1.smithi082.stdout:2/485: creat d6/dc/dd/f9a x:0 0 0 2024-02-15T22:41:15.988 INFO:tasks.workunit.client.1.smithi082.stdout:2/486: mkdir d6/dc/d58/d9b 0 2024-02-15T22:41:16.004 INFO:tasks.workunit.client.1.smithi082.stdout:2/487: write d6/dc/dd/d24/f43 [1642457,67162] 0 2024-02-15T22:41:16.005 INFO:tasks.workunit.client.1.smithi082.stdout:2/488: readlink d6/dc/dd/d21/l98 0 2024-02-15T22:41:16.005 INFO:tasks.workunit.client.1.smithi082.stdout:0/432: dwrite d3/d6b/d7f/f8c [0,4194304] 0 2024-02-15T22:41:16.007 INFO:tasks.workunit.client.1.smithi082.stdout:0/433: creat d3/d19/d5f/d92/f95 x:0 0 0 2024-02-15T22:41:16.008 INFO:tasks.workunit.client.1.smithi082.stdout:3/405: dwrite d0/d16/d62/d2e/f38 [4194304,4194304] 0 2024-02-15T22:41:16.009 INFO:tasks.workunit.client.1.smithi082.stdout:1/523: dwrite d1/da/d14/d18/d6d/f86 [0,4194304] 0 2024-02-15T22:41:16.009 INFO:tasks.workunit.client.1.smithi082.stdout:5/560: dwrite d5/da/d14/f75 [0,4194304] 0 2024-02-15T22:41:16.010 INFO:tasks.workunit.client.1.smithi082.stdout:2/489: dread d6/d18/f4c [0,4194304] 0 2024-02-15T22:41:16.010 INFO:tasks.workunit.client.1.smithi082.stdout:5/561: creat d5/da/d67/da0/fc6 x:0 0 0 2024-02-15T22:41:16.010 INFO:tasks.workunit.client.1.smithi082.stdout:2/490: write d6/dc/f89 [250870,42058] 0 2024-02-15T22:41:16.010 INFO:tasks.workunit.client.1.smithi082.stdout:0/434: rmdir d3/d19/d25/d45/d6c 0 2024-02-15T22:41:16.010 INFO:tasks.workunit.client.1.smithi082.stdout:0/435: write d3/d19/d5f/d92/f95 [581455,125785] 0 2024-02-15T22:41:16.011 INFO:tasks.workunit.client.1.smithi082.stdout:0/436: chown d3/d19/d20/d26/f62 181521 1 2024-02-15T22:41:16.011 INFO:tasks.workunit.client.1.smithi082.stdout:9/534: dwrite d8/d24/d2e/d56/f8a [0,4194304] 0 2024-02-15T22:41:16.011 INFO:tasks.workunit.client.1.smithi082.stdout:0/437: creat d3/d19/d5f/f96 x:0 0 0 2024-02-15T22:41:16.011 INFO:tasks.workunit.client.1.smithi082.stdout:7/464: fsync d12/d3b/f86 0 2024-02-15T22:41:16.011 INFO:tasks.workunit.client.1.smithi082.stdout:7/465: write d12/d3b/d41/f88 [1022540,46292] 0 2024-02-15T22:41:16.011 INFO:tasks.workunit.client.1.smithi082.stdout:6/614: dwrite d2/d18/d8a/d47/d72/f78 [0,4194304] 0 2024-02-15T22:41:16.011 INFO:tasks.workunit.client.1.smithi082.stdout:8/499: dwrite d1/d7/d48/f9f [4194304,4194304] 0 2024-02-15T22:41:16.014 INFO:tasks.workunit.client.1.smithi082.stdout:3/406: mknod d0/dc/d3f/c88 0 2024-02-15T22:41:16.018 INFO:tasks.workunit.client.1.smithi082.stdout:5/562: creat d5/da/fc7 x:0 0 0 2024-02-15T22:41:16.021 INFO:tasks.workunit.client.1.smithi082.stdout:9/535: creat d8/d12/d33/d64/d8b/d96/f9d x:0 0 0 2024-02-15T22:41:16.023 INFO:tasks.workunit.client.1.smithi082.stdout:0/438: mknod d3/d19/d20/d26/c97 0 2024-02-15T22:41:16.023 INFO:tasks.workunit.client.1.smithi082.stdout:0/439: dread - d3/d19/d5f/f96 zero size 2024-02-15T22:41:16.027 INFO:tasks.workunit.client.1.smithi082.stdout:6/615: mknod d2/d18/d8a/d47/d72/cc2 0 2024-02-15T22:41:16.028 INFO:tasks.workunit.client.1.smithi082.stdout:6/616: write d2/f52 [198111,50977] 0 2024-02-15T22:41:16.030 INFO:tasks.workunit.client.1.smithi082.stdout:8/500: link d1/d7/d9/d24/d43/l5f d1/d40/lb0 0 2024-02-15T22:41:16.031 INFO:tasks.workunit.client.1.smithi082.stdout:3/407: rmdir d0/dc/d3f 39 2024-02-15T22:41:16.031 INFO:tasks.workunit.client.1.smithi082.stdout:3/408: creat d0/d16/d62/d2e/f89 x:0 0 0 2024-02-15T22:41:16.035 INFO:tasks.workunit.client.1.smithi082.stdout:2/491: rmdir d6/dc/d12/d46/d4b 39 2024-02-15T22:41:16.038 INFO:tasks.workunit.client.1.smithi082.stdout:0/440: creat d3/d64/d71/d91/f98 x:0 0 0 2024-02-15T22:41:16.039 INFO:tasks.workunit.client.1.smithi082.stdout:9/536: dread d8/d12/d30/d3c/d65/f6e [0,4194304] 0 2024-02-15T22:41:16.039 INFO:tasks.workunit.client.1.smithi082.stdout:9/537: chown d8/d12/d33/l52 600 1 2024-02-15T22:41:16.039 INFO:tasks.workunit.client.1.smithi082.stdout:6/617: rename d2/d30/d3b/f6b to d2/d30/da6/fc3 0 2024-02-15T22:41:16.040 INFO:tasks.workunit.client.1.smithi082.stdout:6/618: readlink d2/d18/d8a/d47/d72/l74 0 2024-02-15T22:41:16.040 INFO:tasks.workunit.client.1.smithi082.stdout:1/524: dwrite d1/da/d11/d3f/d75/f78 [0,4194304] 0 2024-02-15T22:41:16.040 INFO:tasks.workunit.client.1.smithi082.stdout:7/466: dwrite d12/d37/f70 [0,4194304] 0 2024-02-15T22:41:16.041 INFO:tasks.workunit.client.1.smithi082.stdout:8/501: creat d1/d7/d78/fb1 x:0 0 0 2024-02-15T22:41:16.041 INFO:tasks.workunit.client.1.smithi082.stdout:8/502: write d1/f5 [7315436,80903] 0 2024-02-15T22:41:16.042 INFO:tasks.workunit.client.1.smithi082.stdout:2/492: dread d6/d3c/f6d [0,4194304] 0 2024-02-15T22:41:16.044 INFO:tasks.workunit.client.1.smithi082.stdout:3/409: symlink d0/d16/d62/l8a 0 2024-02-15T22:41:16.044 INFO:tasks.workunit.client.1.smithi082.stdout:5/563: dwrite d5/da/d14/d53/f85 [0,4194304] 0 2024-02-15T22:41:16.045 INFO:tasks.workunit.client.1.smithi082.stdout:0/441: truncate d3/fb 6910281 0 2024-02-15T22:41:16.045 INFO:tasks.workunit.client.1.smithi082.stdout:0/442: read d3/fe [13983,111063] 0 2024-02-15T22:41:16.048 INFO:tasks.workunit.client.1.smithi082.stdout:9/538: mkdir d8/d24/d9e 0 2024-02-15T22:41:16.048 INFO:tasks.workunit.client.1.smithi082.stdout:9/539: stat d8/d12/d30 0 2024-02-15T22:41:16.050 INFO:tasks.workunit.client.1.smithi082.stdout:6/619: link d2/d18/d8a/d47/l53 d2/d18/d8a/d84/lc4 0 2024-02-15T22:41:16.054 INFO:tasks.workunit.client.1.smithi082.stdout:5/564: dread d5/da/d14/d53/f71 [0,4194304] 0 2024-02-15T22:41:16.054 INFO:tasks.workunit.client.1.smithi082.stdout:5/565: write d5/da/d67/da0/d92/f9a [730486,118345] 0 2024-02-15T22:41:16.054 INFO:tasks.workunit.client.1.smithi082.stdout:5/566: creat d5/da/d22/d59/fc8 x:0 0 0 2024-02-15T22:41:16.054 INFO:tasks.workunit.client.1.smithi082.stdout:5/567: dread - d5/da/d67/fb0 zero size 2024-02-15T22:41:16.055 INFO:tasks.workunit.client.1.smithi082.stdout:1/525: dread d1/da/d11/d3f/f69 [0,4194304] 0 2024-02-15T22:41:16.058 INFO:tasks.workunit.client.1.smithi082.stdout:1/526: dread d1/f1d [0,4194304] 0 2024-02-15T22:41:16.066 INFO:tasks.workunit.client.1.smithi082.stdout:7/467: dwrite d12/d17/d42/f58 [0,4194304] 0 2024-02-15T22:41:16.066 INFO:tasks.workunit.client.1.smithi082.stdout:7/468: stat d12/d37/d85 0 2024-02-15T22:41:16.068 INFO:tasks.workunit.client.1.smithi082.stdout:8/503: rmdir d1/d7/de/d57 39 2024-02-15T22:41:16.070 INFO:tasks.workunit.client.1.smithi082.stdout:2/493: creat d6/dc/dd/d24/d71/f9c x:0 0 0 2024-02-15T22:41:16.074 INFO:tasks.workunit.client.1.smithi082.stdout:0/443: mkdir d3/d19/d25/d45/d56/d99 0 2024-02-15T22:41:16.075 INFO:tasks.workunit.client.1.smithi082.stdout:9/540: mknod d8/d24/d2e/d53/c9f 0 2024-02-15T22:41:16.076 INFO:tasks.workunit.client.1.smithi082.stdout:9/541: creat d8/d12/d67/d70/fa0 x:0 0 0 2024-02-15T22:41:16.076 INFO:tasks.workunit.client.1.smithi082.stdout:9/542: readlink d8/d12/d33/d3e/l7d 0 2024-02-15T22:41:16.076 INFO:tasks.workunit.client.1.smithi082.stdout:9/543: readlink d8/d12/d33/l75 0 2024-02-15T22:41:16.077 INFO:tasks.workunit.client.1.smithi082.stdout:6/620: mkdir d2/d45/dc5 0 2024-02-15T22:41:16.082 INFO:tasks.workunit.client.1.smithi082.stdout:1/527: getdents d1/da/d11/d93 0 2024-02-15T22:41:16.085 INFO:tasks.workunit.client.1.smithi082.stdout:8/504: dwrite d1/d7/d9/d50/f67 [0,4194304] 0 2024-02-15T22:41:16.085 INFO:tasks.workunit.client.1.smithi082.stdout:8/505: chown d1/f21 97447 1 2024-02-15T22:41:16.086 INFO:tasks.workunit.client.1.smithi082.stdout:8/506: write d1/d7/de/f2e [1141891,91246] 0 2024-02-15T22:41:16.086 INFO:tasks.workunit.client.1.smithi082.stdout:7/469: link d12/d27/d33/c49 d12/d37/d85/c94 0 2024-02-15T22:41:16.086 INFO:tasks.workunit.client.1.smithi082.stdout:7/470: write d12/d17/d42/f77 [8996077,3953] 0 2024-02-15T22:41:16.086 INFO:tasks.workunit.client.1.smithi082.stdout:7/471: chown d12/d17/d3d/l4c 649438 1 2024-02-15T22:41:16.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/472: write d12/d17/d3d/f40 [1394834,58834] 0 2024-02-15T22:41:16.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/473: readlink d12/d17/l3a 0 2024-02-15T22:41:16.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/474: stat d12/d3b/d41/c43 0 2024-02-15T22:41:16.087 INFO:tasks.workunit.client.1.smithi082.stdout:7/475: write d12/d27/d74/f82 [236558,93600] 0 2024-02-15T22:41:16.088 INFO:tasks.workunit.client.1.smithi082.stdout:2/494: rename d6/dc/d58/d49/d5e/d67/f8d to d6/d3c/f9d 0 2024-02-15T22:41:16.089 INFO:tasks.workunit.client.1.smithi082.stdout:6/621: dread d2/d30/d3b/f42 [0,4194304] 0 2024-02-15T22:41:16.089 INFO:tasks.workunit.client.1.smithi082.stdout:6/622: stat d2/d18/d8a/f3d 0 2024-02-15T22:41:16.089 INFO:tasks.workunit.client.1.smithi082.stdout:1/528: dread d1/da/d11/d3f/f5c [0,4194304] 0 2024-02-15T22:41:16.089 INFO:tasks.workunit.client.1.smithi082.stdout:0/444: symlink d3/d19/d25/d45/d56/d99/l9a 0 2024-02-15T22:41:16.091 INFO:tasks.workunit.client.1.smithi082.stdout:9/544: rmdir d8/d12/d30/d3c/d71 39 2024-02-15T22:41:16.093 INFO:tasks.workunit.client.1.smithi082.stdout:5/568: getdents d5/da/d56/d6e/d73 0 2024-02-15T22:41:16.097 INFO:tasks.workunit.client.1.smithi082.stdout:8/507: creat d1/d7/d9/d24/d43/d85/fb2 x:0 0 0 2024-02-15T22:41:16.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/476: stat d12/d17/c24 0 2024-02-15T22:41:16.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/477: chown d12/d17/c24 30577 1 2024-02-15T22:41:16.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/478: creat d12/d3b/f95 x:0 0 0 2024-02-15T22:41:16.099 INFO:tasks.workunit.client.1.smithi082.stdout:4/547: sync 2024-02-15T22:41:16.099 INFO:tasks.workunit.client.1.smithi082.stdout:4/548: dread - d0/d16/f8f zero size 2024-02-15T22:41:16.099 INFO:tasks.workunit.client.1.smithi082.stdout:2/495: creat d6/dc/d12/d46/d4b/d63/f9e x:0 0 0 2024-02-15T22:41:16.101 INFO:tasks.workunit.client.1.smithi082.stdout:6/623: creat d2/d18/d8a/da7/fc6 x:0 0 0 2024-02-15T22:41:16.104 INFO:tasks.workunit.client.1.smithi082.stdout:5/569: dread d5/da/dc/d43/f4d [0,4194304] 0 2024-02-15T22:41:16.104 INFO:tasks.workunit.client.1.smithi082.stdout:5/570: fdatasync d5/da/d56/fa8 0 2024-02-15T22:41:16.105 INFO:tasks.workunit.client.1.smithi082.stdout:0/445: rename d3/d19/d25/d45/f1a to d3/d19/d1c/d76/f9b 0 2024-02-15T22:41:16.106 INFO:tasks.workunit.client.1.smithi082.stdout:1/529: dwrite d1/da/d14/f28 [0,4194304] 0 2024-02-15T22:41:16.106 INFO:tasks.workunit.client.1.smithi082.stdout:9/545: mkdir d8/d12/d33/d64/d7c/da1 0 2024-02-15T22:41:16.108 INFO:tasks.workunit.client.1.smithi082.stdout:5/571: dread d5/da/dc/f3d [0,4194304] 0 2024-02-15T22:41:16.109 INFO:tasks.workunit.client.1.smithi082.stdout:5/572: write d5/da/dc/d43/fbe [519446,30070] 0 2024-02-15T22:41:16.109 INFO:tasks.workunit.client.1.smithi082.stdout:5/573: creat d5/da/d67/fc9 x:0 0 0 2024-02-15T22:41:16.109 INFO:tasks.workunit.client.1.smithi082.stdout:7/479: creat d12/d17/d42/d67/d79/f96 x:0 0 0 2024-02-15T22:41:16.112 INFO:tasks.workunit.client.1.smithi082.stdout:2/496: mkdir d6/dc/dd/d21/d9f 0 2024-02-15T22:41:16.113 INFO:tasks.workunit.client.1.smithi082.stdout:6/624: write d2/d18/d23/f35 [2532051,111093] 0 2024-02-15T22:41:16.113 INFO:tasks.workunit.client.1.smithi082.stdout:0/446: mkdir d3/d19/d25/d45/d56/d9c 0 2024-02-15T22:41:16.117 INFO:tasks.workunit.client.1.smithi082.stdout:1/530: rename d1/da/d14/d18/d51/c56 to d1/da/d14/d18/d98/cab 0 2024-02-15T22:41:16.118 INFO:tasks.workunit.client.1.smithi082.stdout:9/546: mknod d8/d12/d33/d64/ca2 0 2024-02-15T22:41:16.121 INFO:tasks.workunit.client.1.smithi082.stdout:5/574: creat d5/fca x:0 0 0 2024-02-15T22:41:16.123 INFO:tasks.workunit.client.1.smithi082.stdout:7/480: creat d12/d17/d42/f97 x:0 0 0 2024-02-15T22:41:16.124 INFO:tasks.workunit.client.1.smithi082.stdout:8/508: dwrite d1/d7/f54 [4194304,4194304] 0 2024-02-15T22:41:16.125 INFO:tasks.workunit.client.1.smithi082.stdout:4/549: mkdir d0/d16/d4a/dc5 0 2024-02-15T22:41:16.126 INFO:tasks.workunit.client.1.smithi082.stdout:2/497: creat d6/dc/d12/d46/fa0 x:0 0 0 2024-02-15T22:41:16.127 INFO:tasks.workunit.client.1.smithi082.stdout:2/498: write d6/d18/f4c [243702,109889] 0 2024-02-15T22:41:16.128 INFO:tasks.workunit.client.1.smithi082.stdout:0/447: rmdir d3/d6b/d7f/d87 0 2024-02-15T22:41:16.129 INFO:tasks.workunit.client.1.smithi082.stdout:6/625: dwrite d2/d18/d23/d67/f6d [0,4194304] 0 2024-02-15T22:41:16.130 INFO:tasks.workunit.client.1.smithi082.stdout:9/547: unlink d8/d12/f1e 0 2024-02-15T22:41:16.133 INFO:tasks.workunit.client.1.smithi082.stdout:1/531: dread d1/da/d11/d3f/f46 [0,4194304] 0 2024-02-15T22:41:16.134 INFO:tasks.workunit.client.1.smithi082.stdout:5/575: rename d5/f32 to d5/da/d56/d98/fcb 0 2024-02-15T22:41:16.134 INFO:tasks.workunit.client.1.smithi082.stdout:2/499: rename d6/dc/dd/d24 to d6/dc/dd/d24/d71/da1 22 2024-02-15T22:41:16.134 INFO:tasks.workunit.client.1.smithi082.stdout:2/500: readlink d6/dc/d12/d46/d4b/l4f 0 2024-02-15T22:41:16.135 INFO:tasks.workunit.client.1.smithi082.stdout:7/481: getdents d12/d27/d33 0 2024-02-15T22:41:16.137 INFO:tasks.workunit.client.1.smithi082.stdout:4/550: creat d0/d47/fc6 x:0 0 0 2024-02-15T22:41:16.140 INFO:tasks.workunit.client.1.smithi082.stdout:6/626: creat d2/d18/d8a/d47/d72/fc7 x:0 0 0 2024-02-15T22:41:16.140 INFO:tasks.workunit.client.1.smithi082.stdout:9/548: mknod d8/d12/ca3 0 2024-02-15T22:41:16.141 INFO:tasks.workunit.client.1.smithi082.stdout:1/532: truncate d1/da/d11/d3f/f46 3836818 0 2024-02-15T22:41:16.142 INFO:tasks.workunit.client.1.smithi082.stdout:5/576: mknod d5/da/dc/ccc 0 2024-02-15T22:41:16.144 INFO:tasks.workunit.client.1.smithi082.stdout:2/501: fdatasync d6/d18/f4c 0 2024-02-15T22:41:16.145 INFO:tasks.workunit.client.1.smithi082.stdout:2/502: write d6/dc/d12/d46/d4b/f8b [321195,66724] 0 2024-02-15T22:41:16.145 INFO:tasks.workunit.client.1.smithi082.stdout:2/503: write d6/dc/d12/d46/d4b/d63/f9e [727651,103869] 0 2024-02-15T22:41:16.145 INFO:tasks.workunit.client.1.smithi082.stdout:2/504: write d6/dc/d12/d46/f8f [304148,63657] 0 2024-02-15T22:41:16.145 INFO:tasks.workunit.client.1.smithi082.stdout:2/505: truncate d6/dc/d12/d46/fa0 624520 0 2024-02-15T22:41:16.146 INFO:tasks.workunit.client.1.smithi082.stdout:8/509: dwrite d1/f5 [0,4194304] 0 2024-02-15T22:41:16.147 INFO:tasks.workunit.client.1.smithi082.stdout:0/448: rename d3/d6b/d7f/f8c to d3/d64/d71/d91/f9d 0 2024-02-15T22:41:16.147 INFO:tasks.workunit.client.1.smithi082.stdout:0/449: fsync d3/d19/d25/d80/f84 0 2024-02-15T22:41:16.148 INFO:tasks.workunit.client.1.smithi082.stdout:2/506: write d6/f26 [324561,41742] 0 2024-02-15T22:41:16.149 INFO:tasks.workunit.client.1.smithi082.stdout:4/551: read d0/d16/f9c [68588,112161] 0 2024-02-15T22:41:16.149 INFO:tasks.workunit.client.1.smithi082.stdout:4/552: fdatasync d0/d8/d1b/dd/fb6 0 2024-02-15T22:41:16.149 INFO:tasks.workunit.client.1.smithi082.stdout:4/553: write d0/d16/f9c [1296531,2618] 0 2024-02-15T22:41:16.150 INFO:tasks.workunit.client.1.smithi082.stdout:7/482: creat d12/d37/f98 x:0 0 0 2024-02-15T22:41:16.150 INFO:tasks.workunit.client.1.smithi082.stdout:7/483: fdatasync d12/f64 0 2024-02-15T22:41:16.150 INFO:tasks.workunit.client.1.smithi082.stdout:6/627: link d2/d30/c3f d2/cc8 0 2024-02-15T22:41:16.150 INFO:tasks.workunit.client.1.smithi082.stdout:6/628: creat d2/d45/fc9 x:0 0 0 2024-02-15T22:41:16.150 INFO:tasks.workunit.client.1.smithi082.stdout:6/629: stat d2/d18/d8a/d65/fa8 0 2024-02-15T22:41:16.150 INFO:tasks.workunit.client.1.smithi082.stdout:0/450: write d3/d19/f58 [2115860,107070] 0 2024-02-15T22:41:16.151 INFO:tasks.workunit.client.1.smithi082.stdout:1/533: mknod d1/da/d11/d3f/d75/cac 0 2024-02-15T22:41:16.151 INFO:tasks.workunit.client.1.smithi082.stdout:1/534: dread - d1/da/d14/d18/d1f/d2f/fa5 zero size 2024-02-15T22:41:16.157 INFO:tasks.workunit.client.1.smithi082.stdout:8/510: dread d1/d7/d9/f17 [0,4194304] 0 2024-02-15T22:41:16.159 INFO:tasks.workunit.client.1.smithi082.stdout:2/507: dread d6/dc/d58/d49/f56 [0,4194304] 0 2024-02-15T22:41:16.163 INFO:tasks.workunit.client.1.smithi082.stdout:4/554: rename d0/d16/d4a/f51 to d0/d46/fc7 0 2024-02-15T22:41:16.164 INFO:tasks.workunit.client.1.smithi082.stdout:7/484: mknod d12/d37/c99 0 2024-02-15T22:41:16.164 INFO:tasks.workunit.client.1.smithi082.stdout:5/577: dwrite d5/da/dc/dad/fb8 [0,4194304] 0 2024-02-15T22:41:16.164 INFO:tasks.workunit.client.1.smithi082.stdout:5/578: stat d5/da/d67 0 2024-02-15T22:41:16.166 INFO:tasks.workunit.client.1.smithi082.stdout:8/511: mknod d1/d7/d9/d24/d30/d75/cb3 0 2024-02-15T22:41:16.168 INFO:tasks.workunit.client.1.smithi082.stdout:6/630: rename d2/c12 to d2/d18/d8a/d65/cca 0 2024-02-15T22:41:16.169 INFO:tasks.workunit.client.1.smithi082.stdout:4/555: symlink d0/d47/lc8 0 2024-02-15T22:41:16.170 INFO:tasks.workunit.client.1.smithi082.stdout:7/485: symlink d12/d27/d6e/d6a/l9a 0 2024-02-15T22:41:16.170 INFO:tasks.workunit.client.1.smithi082.stdout:7/486: truncate d12/d3b/d41/f88 1390349 0 2024-02-15T22:41:16.172 INFO:tasks.workunit.client.1.smithi082.stdout:5/579: mknod d5/da/d67/dbf/ccd 0 2024-02-15T22:41:16.172 INFO:tasks.workunit.client.1.smithi082.stdout:5/580: dread - d5/da/d56/d6e/d73/fb3 zero size 2024-02-15T22:41:16.173 INFO:tasks.workunit.client.1.smithi082.stdout:1/535: mknod d1/da/d14/d18/cad 0 2024-02-15T22:41:16.174 INFO:tasks.workunit.client.1.smithi082.stdout:1/536: creat d1/da/d11/fae x:0 0 0 2024-02-15T22:41:16.176 INFO:tasks.workunit.client.1.smithi082.stdout:6/631: rename d2/d18/d39/cb8 to d2/d18/d23/ccb 0 2024-02-15T22:41:16.176 INFO:tasks.workunit.client.1.smithi082.stdout:6/632: fsync d2/d18/d8a/d47/f91 0 2024-02-15T22:41:16.176 INFO:tasks.workunit.client.1.smithi082.stdout:6/633: write d2/fa5 [524883,55980] 0 2024-02-15T22:41:16.176 INFO:tasks.workunit.client.1.smithi082.stdout:6/634: chown d2/f6e 228735 1 2024-02-15T22:41:16.176 INFO:tasks.workunit.client.1.smithi082.stdout:5/581: getdents d5/da/d56/d98 0 2024-02-15T22:41:16.176 INFO:tasks.workunit.client.1.smithi082.stdout:5/582: creat d5/da/dc/d43/fce x:0 0 0 2024-02-15T22:41:16.179 INFO:tasks.workunit.client.1.smithi082.stdout:1/537: rename d1/da/cd to d1/d57/caf 0 2024-02-15T22:41:16.179 INFO:tasks.workunit.client.1.smithi082.stdout:1/538: write d1/f5b [1012110,5061] 0 2024-02-15T22:41:16.179 INFO:tasks.workunit.client.1.smithi082.stdout:1/539: stat d1/f39 0 2024-02-15T22:41:16.181 INFO:tasks.workunit.client.1.smithi082.stdout:6/635: getdents d2/d18/d8a 0 2024-02-15T22:41:16.181 INFO:tasks.workunit.client.1.smithi082.stdout:6/636: chown d2/fab 23964473 1 2024-02-15T22:41:16.183 INFO:tasks.workunit.client.1.smithi082.stdout:6/637: truncate d2/d18/d23/f90 2962564 0 2024-02-15T22:41:16.184 INFO:tasks.workunit.client.1.smithi082.stdout:8/512: write d1/d7/de/f2f [2180781,88227] 0 2024-02-15T22:41:16.185 INFO:tasks.workunit.client.1.smithi082.stdout:1/540: getdents d1/da/d14/d18/d1f/d76 0 2024-02-15T22:41:16.186 INFO:tasks.workunit.client.1.smithi082.stdout:1/541: write d1/d57/f88 [959162,125377] 0 2024-02-15T22:41:16.187 INFO:tasks.workunit.client.1.smithi082.stdout:6/638: creat d2/d18/d8a/d47/d69/db1/fcc x:0 0 0 2024-02-15T22:41:16.191 INFO:tasks.workunit.client.1.smithi082.stdout:5/583: rename d5/da/d22 to d5/da/dc/dad/dcf 0 2024-02-15T22:41:16.191 INFO:tasks.workunit.client.1.smithi082.stdout:5/584: chown d5/f2e 2056 1 2024-02-15T22:41:16.194 INFO:tasks.workunit.client.1.smithi082.stdout:7/487: dwrite d12/d17/d42/d67/f71 [0,4194304] 0 2024-02-15T22:41:16.195 INFO:tasks.workunit.client.1.smithi082.stdout:7/488: fsync f6 0 2024-02-15T22:41:16.195 INFO:tasks.workunit.client.1.smithi082.stdout:7/489: fdatasync d12/d17/f25 0 2024-02-15T22:41:16.195 INFO:tasks.workunit.client.1.smithi082.stdout:2/508: dwrite d6/dc/dd/d24/d71/f9c [0,4194304] 0 2024-02-15T22:41:16.196 INFO:tasks.workunit.client.1.smithi082.stdout:0/451: dwrite d3/d19/d25/d80/f84 [0,4194304] 0 2024-02-15T22:41:16.200 INFO:tasks.workunit.client.1.smithi082.stdout:8/513: read d1/d7/de/d1e/f39 [3107899,32203] 0 2024-02-15T22:41:16.203 INFO:tasks.workunit.client.1.smithi082.stdout:4/556: dwrite d0/d8/d32/d39/fab [4194304,4194304] 0 2024-02-15T22:41:16.203 INFO:tasks.workunit.client.1.smithi082.stdout:4/557: chown d0/d16 1120 1 2024-02-15T22:41:16.206 INFO:tasks.workunit.client.1.smithi082.stdout:2/509: link d6/dc/dd/d24/f54 d6/dc/d58/d49/fa2 0 2024-02-15T22:41:16.210 INFO:tasks.workunit.client.1.smithi082.stdout:0/452: link d3/d19/d20/d7c/c82 d3/d64/d71/d91/c9e 0 2024-02-15T22:41:16.212 INFO:tasks.workunit.client.1.smithi082.stdout:8/514: dread d1/d7/f54 [0,4194304] 0 2024-02-15T22:41:16.217 INFO:tasks.workunit.client.1.smithi082.stdout:4/558: write d0/d8/d1b/dd/f57 [2773657,6942] 0 2024-02-15T22:41:16.217 INFO:tasks.workunit.client.1.smithi082.stdout:4/559: write d0/d8/d1b/f59 [1665215,14495] 0 2024-02-15T22:41:16.225 INFO:tasks.workunit.client.1.smithi082.stdout:0/453: symlink d3/d64/l9f 0 2024-02-15T22:41:16.226 INFO:tasks.workunit.client.1.smithi082.stdout:4/560: dread d0/f31 [0,4194304] 0 2024-02-15T22:41:16.226 INFO:tasks.workunit.client.1.smithi082.stdout:4/561: creat d0/d8/d1b/dd/fc9 x:0 0 0 2024-02-15T22:41:16.227 INFO:tasks.workunit.client.1.smithi082.stdout:8/515: unlink d1/l70 0 2024-02-15T22:41:16.228 INFO:tasks.workunit.client.1.smithi082.stdout:0/454: mkdir d3/d19/d5f/da0 0 2024-02-15T22:41:16.228 INFO:tasks.workunit.client.1.smithi082.stdout:0/455: read d3/f6 [7812643,103700] 0 2024-02-15T22:41:16.228 INFO:tasks.workunit.client.1.smithi082.stdout:0/456: readlink d3/d19/d25/l54 0 2024-02-15T22:41:16.229 INFO:tasks.workunit.client.1.smithi082.stdout:8/516: mknod d1/d7/d9/d42/cb4 0 2024-02-15T22:41:16.230 INFO:tasks.workunit.client.1.smithi082.stdout:8/517: creat d1/d7/d9/d24/d43/fb5 x:0 0 0 2024-02-15T22:41:16.231 INFO:tasks.workunit.client.1.smithi082.stdout:0/457: link d3/d19/d20/d26/f31 d3/d19/d5f/da0/fa1 0 2024-02-15T22:41:16.231 INFO:tasks.workunit.client.1.smithi082.stdout:0/458: write d3/f30 [1474833,35641] 0 2024-02-15T22:41:16.231 INFO:tasks.workunit.client.1.smithi082.stdout:1/542: dwrite d1/da/d11/f48 [0,4194304] 0 2024-02-15T22:41:16.231 INFO:tasks.workunit.client.1.smithi082.stdout:1/543: write d1/f3d [1539101,40749] 0 2024-02-15T22:41:16.233 INFO:tasks.workunit.client.1.smithi082.stdout:5/585: dwrite d5/da/f3c [0,4194304] 0 2024-02-15T22:41:16.233 INFO:tasks.workunit.client.1.smithi082.stdout:2/510: dwrite d6/dc/d58/f61 [0,4194304] 0 2024-02-15T22:41:16.233 INFO:tasks.workunit.client.1.smithi082.stdout:2/511: write d6/d18/f75 [659612,119060] 0 2024-02-15T22:41:16.233 INFO:tasks.workunit.client.1.smithi082.stdout:7/490: dwrite d12/d3b/f3f [0,4194304] 0 2024-02-15T22:41:16.234 INFO:tasks.workunit.client.1.smithi082.stdout:8/518: unlink d1/d7/d9/d42/f7e 0 2024-02-15T22:41:16.234 INFO:tasks.workunit.client.1.smithi082.stdout:8/519: write d1/d7/d9/d24/d30/f7f [790163,12857] 0 2024-02-15T22:41:16.234 INFO:tasks.workunit.client.1.smithi082.stdout:8/520: chown d1/d7/d9/d50/c9d 43465 1 2024-02-15T22:41:16.236 INFO:tasks.workunit.client.1.smithi082.stdout:1/544: chown d1/c36 141265 1 2024-02-15T22:41:16.237 INFO:tasks.workunit.client.1.smithi082.stdout:1/545: chown d1/da/d14/d18/d6d/f6f 0 1 2024-02-15T22:41:16.240 INFO:tasks.workunit.client.1.smithi082.stdout:5/586: symlink d5/da/d67/da0/ld0 0 2024-02-15T22:41:16.243 INFO:tasks.workunit.client.1.smithi082.stdout:2/512: link d6/dc/l70 d6/dc/dd/d24/d72/la3 0 2024-02-15T22:41:16.244 INFO:tasks.workunit.client.1.smithi082.stdout:2/513: fsync d6/dc/d12/d46/d4b/d63/f94 0 2024-02-15T22:41:16.246 INFO:tasks.workunit.client.1.smithi082.stdout:7/491: mknod d12/d27/d33/c9b 0 2024-02-15T22:41:16.247 INFO:tasks.workunit.client.1.smithi082.stdout:7/492: dread d12/d37/f5b [0,4194304] 0 2024-02-15T22:41:16.248 INFO:tasks.workunit.client.1.smithi082.stdout:8/521: mkdir d1/d7/d9/d24/d43/da6/db6 0 2024-02-15T22:41:16.250 INFO:tasks.workunit.client.1.smithi082.stdout:2/514: symlink d6/dc/d12/d23/d90/la4 0 2024-02-15T22:41:16.250 INFO:tasks.workunit.client.1.smithi082.stdout:2/515: chown d6/dc/dd/d1d/f50 12 1 2024-02-15T22:41:16.254 INFO:tasks.workunit.client.1.smithi082.stdout:7/493: link ff d12/d17/d4d/d7d/f9c 0 2024-02-15T22:41:16.255 INFO:tasks.workunit.client.1.smithi082.stdout:7/494: write d12/d3b/d41/f66 [159938,10482] 0 2024-02-15T22:41:16.255 INFO:tasks.workunit.client.1.smithi082.stdout:4/562: dwrite d0/f2 [0,4194304] 0 2024-02-15T22:41:16.256 INFO:tasks.workunit.client.1.smithi082.stdout:8/522: rename d1/d7/d48/f5d to d1/d7/de/fb7 0 2024-02-15T22:41:16.259 INFO:tasks.workunit.client.1.smithi082.stdout:4/563: creat d0/d16/d87/da2/fca x:0 0 0 2024-02-15T22:41:16.259 INFO:tasks.workunit.client.1.smithi082.stdout:4/564: creat d0/d8/d32/fcb x:0 0 0 2024-02-15T22:41:16.259 INFO:tasks.workunit.client.1.smithi082.stdout:4/565: chown d0/d8/d1b/dd/d37/lb0 257011881 1 2024-02-15T22:41:16.259 INFO:tasks.workunit.client.1.smithi082.stdout:8/523: rmdir d1/d7/d9/d42/d6a/da5 39 2024-02-15T22:41:16.259 INFO:tasks.workunit.client.1.smithi082.stdout:7/495: dread d12/d17/d42/f87 [0,4194304] 0 2024-02-15T22:41:16.259 INFO:tasks.workunit.client.1.smithi082.stdout:7/496: chown d12/d3b/f86 2696291 1 2024-02-15T22:41:16.261 INFO:tasks.workunit.client.1.smithi082.stdout:2/516: rmdir d6/d18 39 2024-02-15T22:41:16.261 INFO:tasks.workunit.client.1.smithi082.stdout:2/517: dread - d6/dc/dd/d1d/f50 zero size 2024-02-15T22:41:16.261 INFO:tasks.workunit.client.1.smithi082.stdout:2/518: readlink d6/dc/d12/l32 0 2024-02-15T22:41:16.262 INFO:tasks.workunit.client.1.smithi082.stdout:2/519: creat d6/dc/dd/d24/d71/fa5 x:0 0 0 2024-02-15T22:41:16.262 INFO:tasks.workunit.client.1.smithi082.stdout:2/520: truncate d6/dc/d12/d46/f7f 1320529 0 2024-02-15T22:41:16.262 INFO:tasks.workunit.client.1.smithi082.stdout:2/521: chown d6/dc/dd/d24/d71 608602292 1 2024-02-15T22:41:16.266 INFO:tasks.workunit.client.1.smithi082.stdout:1/546: dread d1/f3d [0,4194304] 0 2024-02-15T22:41:16.266 INFO:tasks.workunit.client.1.smithi082.stdout:4/566: symlink d0/d8/d1b/d70/lcc 0 2024-02-15T22:41:16.266 INFO:tasks.workunit.client.1.smithi082.stdout:4/567: fdatasync d0/d47/d4d/fc1 0 2024-02-15T22:41:16.266 INFO:tasks.workunit.client.1.smithi082.stdout:2/522: dread d6/d18/f4c [0,4194304] 0 2024-02-15T22:41:16.268 INFO:tasks.workunit.client.1.smithi082.stdout:1/547: mknod d1/da/d14/d18/d1f/d76/da7/cb0 0 2024-02-15T22:41:16.268 INFO:tasks.workunit.client.1.smithi082.stdout:1/548: chown d1/da/d14/d18/d1f/d76/f92 49 1 2024-02-15T22:41:16.269 INFO:tasks.workunit.client.1.smithi082.stdout:4/568: mkdir d0/dc0/dcd 0 2024-02-15T22:41:16.269 INFO:tasks.workunit.client.1.smithi082.stdout:4/569: stat d0/d46/c64 0 2024-02-15T22:41:16.269 INFO:tasks.workunit.client.1.smithi082.stdout:4/570: chown d0/d8/f80 0 1 2024-02-15T22:41:16.269 INFO:tasks.workunit.client.1.smithi082.stdout:4/571: dread - d0/d47/d4d/f88 zero size 2024-02-15T22:41:16.270 INFO:tasks.workunit.client.1.smithi082.stdout:4/572: read - d0/d8/d32/fa3 zero size 2024-02-15T22:41:16.270 INFO:tasks.workunit.client.1.smithi082.stdout:4/573: write d0/d8/d1b/f59 [2341089,121707] 0 2024-02-15T22:41:16.270 INFO:tasks.workunit.client.1.smithi082.stdout:4/574: chown d0/fa0 344530306 1 2024-02-15T22:41:16.271 INFO:tasks.workunit.client.1.smithi082.stdout:1/549: link d1/da/d14/d18/d1f/f9b d1/da/d11/fb1 0 2024-02-15T22:41:16.274 INFO:tasks.workunit.client.1.smithi082.stdout:4/575: link d0/d16/l19 d0/d16/d87/lce 0 2024-02-15T22:41:16.276 INFO:tasks.workunit.client.1.smithi082.stdout:1/550: link d1/da/d14/d18/d1f/c83 d1/da/d14/d18/d98/cb2 0 2024-02-15T22:41:16.277 INFO:tasks.workunit.client.1.smithi082.stdout:4/576: mkdir d0/dc0/dcd/dcf 0 2024-02-15T22:41:16.277 INFO:tasks.workunit.client.1.smithi082.stdout:4/577: dread - d0/d47/d4d/fc1 zero size 2024-02-15T22:41:16.280 INFO:tasks.workunit.client.1.smithi082.stdout:4/578: rename d0/d16/d4a/l9d to d0/d8/d1b/ld0 0 2024-02-15T22:41:16.280 INFO:tasks.workunit.client.1.smithi082.stdout:4/579: creat d0/d47/d4d/fd1 x:0 0 0 2024-02-15T22:41:16.282 INFO:tasks.workunit.client.1.smithi082.stdout:4/580: mknod d0/d16/d4a/d6a/cd2 0 2024-02-15T22:41:16.283 INFO:tasks.workunit.client.1.smithi082.stdout:4/581: rmdir d0/dc0 39 2024-02-15T22:41:16.284 INFO:tasks.workunit.client.1.smithi082.stdout:7/497: dwrite d12/d27/d33/f36 [0,4194304] 0 2024-02-15T22:41:16.284 INFO:tasks.workunit.client.1.smithi082.stdout:4/582: mkdir d0/d46/dd3 0 2024-02-15T22:41:16.284 INFO:tasks.workunit.client.1.smithi082.stdout:4/583: dread - d0/d8/d1b/dd/fc4 zero size 2024-02-15T22:41:16.284 INFO:tasks.workunit.client.1.smithi082.stdout:4/584: truncate d0/d16/f8f 909210 0 2024-02-15T22:41:16.286 INFO:tasks.workunit.client.1.smithi082.stdout:7/498: mknod d12/d17/d4d/c9d 0 2024-02-15T22:41:16.288 INFO:tasks.workunit.client.1.smithi082.stdout:4/585: mknod d0/d47/da6/da7/cd4 0 2024-02-15T22:41:16.288 INFO:tasks.workunit.client.1.smithi082.stdout:4/586: write d0/d8/d1b/dd/f57 [2676871,105838] 0 2024-02-15T22:41:16.289 INFO:tasks.workunit.client.1.smithi082.stdout:7/499: mkdir d12/d27/d6e/d6a/d9e 0 2024-02-15T22:41:16.292 INFO:tasks.workunit.client.1.smithi082.stdout:4/587: unlink d0/d16/c72 0 2024-02-15T22:41:16.293 INFO:tasks.workunit.client.1.smithi082.stdout:1/551: dwrite d1/da/d14/d18/d1f/d2f/f95 [0,4194304] 0 2024-02-15T22:41:16.293 INFO:tasks.workunit.client.1.smithi082.stdout:1/552: readlink d1/da/d11/d3f/l65 0 2024-02-15T22:41:16.293 INFO:tasks.workunit.client.1.smithi082.stdout:1/553: chown d1/da/d11/d3f 988 1 2024-02-15T22:41:16.293 INFO:tasks.workunit.client.1.smithi082.stdout:7/500: truncate d12/d17/d3d/f55 7449365 0 2024-02-15T22:41:16.295 INFO:tasks.workunit.client.1.smithi082.stdout:4/588: unlink d0/d8/d1b/dd/lbe 0 2024-02-15T22:41:16.301 INFO:tasks.workunit.client.1.smithi082.stdout:7/501: mknod d12/d37/d85/c9f 0 2024-02-15T22:41:16.302 INFO:tasks.workunit.client.1.smithi082.stdout:4/589: creat d0/d16/fd5 x:0 0 0 2024-02-15T22:41:16.306 INFO:tasks.workunit.client.1.smithi082.stdout:1/554: rmdir d1/da/d11 39 2024-02-15T22:41:16.306 INFO:tasks.workunit.client.1.smithi082.stdout:1/555: stat d1/da/d14/d18/d6d 0 2024-02-15T22:41:16.307 INFO:tasks.workunit.client.1.smithi082.stdout:7/502: truncate d12/d3b/f86 307827 0 2024-02-15T22:41:16.309 INFO:tasks.workunit.client.1.smithi082.stdout:4/590: creat d0/d47/da6/da7/fd6 x:0 0 0 2024-02-15T22:41:16.309 INFO:tasks.workunit.client.1.smithi082.stdout:4/591: fsync d0/d8/d1b/dd/ff 0 2024-02-15T22:41:16.310 INFO:tasks.workunit.client.1.smithi082.stdout:1/556: mkdir d1/da/d11/d8c/db3 0 2024-02-15T22:41:16.310 INFO:tasks.workunit.client.1.smithi082.stdout:1/557: write d1/da/d14/d18/d6d/f6f [952543,48051] 0 2024-02-15T22:41:16.311 INFO:tasks.workunit.client.1.smithi082.stdout:7/503: mkdir d12/d17/d42/d67/d81/d91/da0 0 2024-02-15T22:41:16.311 INFO:tasks.workunit.client.1.smithi082.stdout:7/504: stat d12/d17/f5f 0 2024-02-15T22:41:16.312 INFO:tasks.workunit.client.1.smithi082.stdout:4/592: rename d0/d8/d1b/f1d to d0/d8/d1b/d70/fd7 0 2024-02-15T22:41:16.315 INFO:tasks.workunit.client.1.smithi082.stdout:7/505: creat d12/d17/d42/d67/d81/fa1 x:0 0 0 2024-02-15T22:41:16.316 INFO:tasks.workunit.client.1.smithi082.stdout:4/593: mkdir d0/d47/dd8 0 2024-02-15T22:41:16.319 INFO:tasks.workunit.client.1.smithi082.stdout:8/524: dwrite d1/f14 [0,4194304] 0 2024-02-15T22:41:16.320 INFO:tasks.workunit.client.1.smithi082.stdout:7/506: mkdir d12/d27/d74/da2 0 2024-02-15T22:41:16.322 INFO:tasks.workunit.client.1.smithi082.stdout:4/594: mkdir d0/d16/d4a/d6a/dd9 0 2024-02-15T22:41:16.322 INFO:tasks.workunit.client.1.smithi082.stdout:4/595: chown d0/f31 50556 1 2024-02-15T22:41:16.326 INFO:tasks.workunit.client.1.smithi082.stdout:4/596: unlink d0/d8/f3d 0 2024-02-15T22:41:16.331 INFO:tasks.workunit.client.1.smithi082.stdout:4/597: symlink d0/dc0/lda 0 2024-02-15T22:41:16.331 INFO:tasks.workunit.client.1.smithi082.stdout:8/525: write d1/f4f [3592533,62765] 0 2024-02-15T22:41:16.336 INFO:tasks.workunit.client.1.smithi082.stdout:4/598: symlink d0/d16/d4a/d6a/dd9/ldb 0 2024-02-15T22:41:16.336 INFO:tasks.workunit.client.1.smithi082.stdout:4/599: creat d0/d8/fdc x:0 0 0 2024-02-15T22:41:16.336 INFO:tasks.workunit.client.1.smithi082.stdout:7/507: dread d12/d27/f6d [0,4194304] 0 2024-02-15T22:41:16.336 INFO:tasks.workunit.client.1.smithi082.stdout:7/508: chown d12/d3b/c6f 1 1 2024-02-15T22:41:16.340 INFO:tasks.workunit.client.1.smithi082.stdout:1/558: truncate d1/da/d14/d18/d6d/f6f 81163 0 2024-02-15T22:41:16.340 INFO:tasks.workunit.client.1.smithi082.stdout:1/559: write d1/da/d14/d18/d51/f71 [245523,43026] 0 2024-02-15T22:41:16.341 INFO:tasks.workunit.client.1.smithi082.stdout:7/509: getdents d12/d17/d42/d67/d81/d91 0 2024-02-15T22:41:16.343 INFO:tasks.workunit.client.1.smithi082.stdout:1/560: mkdir d1/da/d14/db4 0 2024-02-15T22:41:16.344 INFO:tasks.workunit.client.1.smithi082.stdout:7/510: mkdir d12/d17/da3 0 2024-02-15T22:41:16.346 INFO:tasks.workunit.client.1.smithi082.stdout:1/561: truncate d1/f1d 976363 0 2024-02-15T22:41:16.347 INFO:tasks.workunit.client.1.smithi082.stdout:4/600: read d0/d8/d32/d39/f3f [2389537,129756] 0 2024-02-15T22:41:16.349 INFO:tasks.workunit.client.1.smithi082.stdout:7/511: mknod d12/d37/d85/ca4 0 2024-02-15T22:41:16.349 INFO:tasks.workunit.client.1.smithi082.stdout:7/512: dread - d12/d17/d42/d67/d81/fa1 zero size 2024-02-15T22:41:16.349 INFO:tasks.workunit.client.1.smithi082.stdout:1/562: readlink d1/da/d14/d18/l21 0 2024-02-15T22:41:16.351 INFO:tasks.workunit.client.1.smithi082.stdout:7/513: creat d12/d17/fa5 x:0 0 0 2024-02-15T22:41:16.351 INFO:tasks.workunit.client.1.smithi082.stdout:7/514: truncate d12/d17/d3d/f55 8170775 0 2024-02-15T22:41:16.351 INFO:tasks.workunit.client.1.smithi082.stdout:7/515: fdatasync d12/f64 0 2024-02-15T22:41:16.353 INFO:tasks.workunit.client.1.smithi082.stdout:7/516: mkdir d12/d3b/d41/da6 0 2024-02-15T22:41:16.353 INFO:tasks.workunit.client.1.smithi082.stdout:7/517: chown d12/d17/c3e 5369 1 2024-02-15T22:41:16.355 INFO:tasks.workunit.client.1.smithi082.stdout:7/518: dread d12/d17/d42/f87 [0,4194304] 0 2024-02-15T22:41:16.370 INFO:tasks.workunit.client.1.smithi082.stdout:7/519: dread d12/d27/d33/f36 [0,4194304] 0 2024-02-15T22:41:16.371 INFO:tasks.workunit.client.1.smithi082.stdout:7/520: mkdir d12/d27/d33/da7 0 2024-02-15T22:41:16.372 INFO:tasks.workunit.client.1.smithi082.stdout:7/521: truncate d12/f20 2255920 0 2024-02-15T22:41:16.373 INFO:tasks.workunit.client.1.smithi082.stdout:7/522: mkdir d12/d17/d3d/da8 0 2024-02-15T22:41:16.376 INFO:tasks.workunit.client.1.smithi082.stdout:4/601: dwrite d0/fa0 [4194304,4194304] 0 2024-02-15T22:41:16.377 INFO:tasks.workunit.client.1.smithi082.stdout:4/602: write d0/d8/d32/d39/fb2 [135980,110263] 0 2024-02-15T22:41:16.388 INFO:tasks.workunit.client.1.smithi082.stdout:4/603: read d0/f1 [3805280,21721] 0 2024-02-15T22:41:16.388 INFO:tasks.workunit.client.1.smithi082.stdout:4/604: read - d0/d8/d32/fa3 zero size 2024-02-15T22:41:16.389 INFO:tasks.workunit.client.1.smithi082.stdout:4/605: symlink d0/d16/d4a/dc5/ldd 0 2024-02-15T22:41:16.389 INFO:tasks.workunit.client.1.smithi082.stdout:4/606: symlink d0/dc0/dcd/dcf/lde 0 2024-02-15T22:41:16.392 INFO:tasks.workunit.client.1.smithi082.stdout:4/607: dread d0/f31 [0,4194304] 0 2024-02-15T22:41:16.403 INFO:tasks.workunit.client.1.smithi082.stdout:7/523: dwrite d12/d27/f6d [4194304,4194304] 0 2024-02-15T22:41:16.403 INFO:tasks.workunit.client.1.smithi082.stdout:7/524: creat d12/d3b/fa9 x:0 0 0 2024-02-15T22:41:16.408 INFO:tasks.workunit.client.1.smithi082.stdout:4/608: read d0/d46/f79 [7504484,84857] 0 2024-02-15T22:41:16.410 INFO:tasks.workunit.client.1.smithi082.stdout:4/609: mkdir d0/d47/ddf 0 2024-02-15T22:41:16.410 INFO:tasks.workunit.client.1.smithi082.stdout:4/610: fsync d0/d47/da6/da7/fd6 0 2024-02-15T22:41:16.410 INFO:tasks.workunit.client.1.smithi082.stdout:4/611: mknod d0/ce0 0 2024-02-15T22:41:16.411 INFO:tasks.workunit.client.1.smithi082.stdout:4/612: mknod d0/d8/d32/d39/da4/ce1 0 2024-02-15T22:41:16.412 INFO:tasks.workunit.client.1.smithi082.stdout:4/613: truncate d0/d16/d4a/d6a/fbb 1734249 0 2024-02-15T22:41:16.424 INFO:tasks.workunit.client.1.smithi082.stdout:4/614: write d0/d8/d1b/dd/f41 [1193232,86390] 0 2024-02-15T22:41:16.426 INFO:tasks.workunit.client.1.smithi082.stdout:4/615: mkdir d0/d16/d4a/d6a/dd9/de2 0 2024-02-15T22:41:16.426 INFO:tasks.workunit.client.1.smithi082.stdout:4/616: mkdir d0/dc0/dcd/de3 0 2024-02-15T22:41:16.427 INFO:tasks.workunit.client.1.smithi082.stdout:4/617: getdents d0/d47/dd8 0 2024-02-15T22:41:16.427 INFO:tasks.workunit.client.1.smithi082.stdout:4/618: creat d0/d46/fe4 x:0 0 0 2024-02-15T22:41:16.429 INFO:tasks.workunit.client.1.smithi082.stdout:4/619: mknod d0/d16/d87/da2/ce5 0 2024-02-15T22:41:16.431 INFO:tasks.workunit.client.1.smithi082.stdout:7/525: dwrite d12/d37/f98 [0,4194304] 0 2024-02-15T22:41:16.440 INFO:tasks.workunit.client.1.smithi082.stdout:4/620: dread d0/d8/d32/d39/fab [4194304,4194304] 0 2024-02-15T22:41:16.440 INFO:tasks.workunit.client.1.smithi082.stdout:4/621: fdatasync d0/d8/d1b/dd/fb6 0 2024-02-15T22:41:16.442 INFO:tasks.workunit.client.1.smithi082.stdout:4/622: creat d0/d47/dd8/fe6 x:0 0 0 2024-02-15T22:41:16.443 INFO:tasks.workunit.client.1.smithi082.stdout:4/623: symlink d0/dc0/le7 0 2024-02-15T22:41:16.443 INFO:tasks.workunit.client.1.smithi082.stdout:4/624: read d0/d46/f98 [4572400,78527] 0 2024-02-15T22:41:16.448 INFO:tasks.workunit.client.1.smithi082.stdout:4/625: symlink d0/dc0/dcd/dcf/le8 0 2024-02-15T22:41:16.448 INFO:tasks.workunit.client.1.smithi082.stdout:4/626: creat d0/d46/fe9 x:0 0 0 2024-02-15T22:41:16.453 INFO:tasks.workunit.client.1.smithi082.stdout:7/526: dwrite d12/d17/d42/f87 [0,4194304] 0 2024-02-15T22:41:16.453 INFO:tasks.workunit.client.1.smithi082.stdout:7/527: stat d12/d17/l3a 0 2024-02-15T22:41:16.453 INFO:tasks.workunit.client.1.smithi082.stdout:7/528: stat d12/d37/f70 0 2024-02-15T22:41:16.453 INFO:tasks.workunit.client.1.smithi082.stdout:7/529: readlink d12/d17/l3a 0 2024-02-15T22:41:16.453 INFO:tasks.workunit.client.1.smithi082.stdout:7/530: getdents d12/d27/d33/da7 0 2024-02-15T22:41:16.453 INFO:tasks.workunit.client.1.smithi082.stdout:7/531: write d12/d17/d42/f53 [2281426,69468] 0 2024-02-15T22:41:16.453 INFO:tasks.workunit.client.1.smithi082.stdout:7/532: mkdir d12/d27/d33/daa 0 2024-02-15T22:41:16.455 INFO:tasks.workunit.client.1.smithi082.stdout:7/533: link d12/d3b/fa9 d12/d3b/d41/da6/fab 0 2024-02-15T22:41:16.461 INFO:tasks.workunit.client.1.smithi082.stdout:7/534: dread d12/d17/d4d/d7d/f9c [0,4194304] 0 2024-02-15T22:41:16.463 INFO:tasks.workunit.client.1.smithi082.stdout:7/535: rename d12/d17/d42/f77 to d12/d17/d4d/d7d/fac 0 2024-02-15T22:41:16.463 INFO:tasks.workunit.client.1.smithi082.stdout:7/536: write d12/d3b/f89 [835189,84530] 0 2024-02-15T22:41:16.464 INFO:tasks.workunit.client.1.smithi082.stdout:7/537: mknod d12/d17/da3/cad 0 2024-02-15T22:41:16.465 INFO:tasks.workunit.client.1.smithi082.stdout:7/538: rename d12/d3b/d41/c43 to d12/d17/cae 0 2024-02-15T22:41:16.466 INFO:tasks.workunit.client.1.smithi082.stdout:7/539: symlink d12/d27/d74/da2/laf 0 2024-02-15T22:41:16.467 INFO:tasks.workunit.client.1.smithi082.stdout:4/627: dwrite d0/d8/d32/f4e [0,4194304] 0 2024-02-15T22:41:16.473 INFO:tasks.workunit.client.1.smithi082.stdout:4/628: write d0/f54 [3010531,53959] 0 2024-02-15T22:41:16.475 INFO:tasks.workunit.client.1.smithi082.stdout:4/629: mknod d0/dc0/dcd/de3/cea 0 2024-02-15T22:41:16.479 INFO:tasks.workunit.client.1.smithi082.stdout:7/540: rmdir d12/d27 39 2024-02-15T22:41:16.481 INFO:tasks.workunit.client.1.smithi082.stdout:7/541: rename d12/d27/c8d to d12/d27/d6e/d6a/cb0 0 2024-02-15T22:41:16.481 INFO:tasks.workunit.client.1.smithi082.stdout:7/542: truncate d12/d17/d3d/f59 2701816 0 2024-02-15T22:41:16.483 INFO:tasks.workunit.client.1.smithi082.stdout:7/543: symlink d12/d17/d42/lb1 0 2024-02-15T22:41:16.483 INFO:tasks.workunit.client.1.smithi082.stdout:7/544: chown d12 26946841 1 2024-02-15T22:41:16.483 INFO:tasks.workunit.client.1.smithi082.stdout:7/545: write d12/f22 [1939930,120252] 0 2024-02-15T22:41:16.484 INFO:tasks.workunit.client.1.smithi082.stdout:7/546: mkdir d12/d27/d6e/d6a/db2 0 2024-02-15T22:41:16.484 INFO:tasks.workunit.client.1.smithi082.stdout:7/547: truncate d12/f20 1183221 0 2024-02-15T22:41:16.489 INFO:tasks.workunit.client.1.smithi082.stdout:4/630: dread d0/d46/f79 [0,4194304] 0 2024-02-15T22:41:16.489 INFO:tasks.workunit.client.1.smithi082.stdout:4/631: creat d0/d8/d1b/dd/feb x:0 0 0 2024-02-15T22:41:16.491 INFO:tasks.workunit.client.1.smithi082.stdout:4/632: link d0/d16/l17 d0/d47/lec 0 2024-02-15T22:41:16.491 INFO:tasks.workunit.client.1.smithi082.stdout:4/633: dread - d0/fc2 zero size 2024-02-15T22:41:16.492 INFO:tasks.workunit.client.1.smithi082.stdout:4/634: fsync d0/d8/d32/fbf 0 2024-02-15T22:41:16.492 INFO:tasks.workunit.client.1.smithi082.stdout:4/635: read - d0/d47/fb9 zero size 2024-02-15T22:41:16.492 INFO:tasks.workunit.client.1.smithi082.stdout:4/636: stat d0/d46/fe4 0 2024-02-15T22:41:16.492 INFO:tasks.workunit.client.1.smithi082.stdout:3/410: sync 2024-02-15T22:41:16.492 INFO:tasks.workunit.client.1.smithi082.stdout:9/549: sync 2024-02-15T22:41:16.493 INFO:tasks.workunit.client.1.smithi082.stdout:4/637: mknod d0/d8/d1b/dd/ced 0 2024-02-15T22:41:16.493 INFO:tasks.workunit.client.1.smithi082.stdout:4/638: chown d0/d47/la5 116 1 2024-02-15T22:41:16.494 INFO:tasks.workunit.client.1.smithi082.stdout:9/550: mkdir d8/d12/d33/da4 0 2024-02-15T22:41:16.494 INFO:tasks.workunit.client.1.smithi082.stdout:9/551: creat d8/d24/d2e/d56/fa5 x:0 0 0 2024-02-15T22:41:16.494 INFO:tasks.workunit.client.1.smithi082.stdout:9/552: chown d8/d24/d2e 3 1 2024-02-15T22:41:16.494 INFO:tasks.workunit.client.1.smithi082.stdout:9/553: write d8/d12/d30/d3c/f4e [628437,33627] 0 2024-02-15T22:41:16.498 INFO:tasks.workunit.client.1.smithi082.stdout:3/411: rename d0/f2 to d0/d16/d62/d14/d21/d69/d6c/f8b 0 2024-02-15T22:41:16.498 INFO:tasks.workunit.client.1.smithi082.stdout:3/412: fsync d0/dc/f51 0 2024-02-15T22:41:16.498 INFO:tasks.workunit.client.1.smithi082.stdout:3/413: write d0/d16/d62/d2e/f70 [2172819,99764] 0 2024-02-15T22:41:16.498 INFO:tasks.workunit.client.1.smithi082.stdout:7/548: dread d12/d27/f6d [0,4194304] 0 2024-02-15T22:41:16.500 INFO:tasks.workunit.client.1.smithi082.stdout:4/639: creat d0/d47/da6/fee x:0 0 0 2024-02-15T22:41:16.500 INFO:tasks.workunit.client.1.smithi082.stdout:4/640: dread - d0/d46/fe9 zero size 2024-02-15T22:41:16.500 INFO:tasks.workunit.client.1.smithi082.stdout:4/641: truncate d0/d47/fc6 944320 0 2024-02-15T22:41:16.502 INFO:tasks.workunit.client.1.smithi082.stdout:9/554: creat d8/d24/fa6 x:0 0 0 2024-02-15T22:41:16.505 INFO:tasks.workunit.client.1.smithi082.stdout:3/414: getdents d0/d16/d62/d14/d21 0 2024-02-15T22:41:16.506 INFO:tasks.workunit.client.1.smithi082.stdout:4/642: mknod d0/d16/d87/da2/cef 0 2024-02-15T22:41:16.508 INFO:tasks.workunit.client.1.smithi082.stdout:3/415: rename d0/dc/d3f/l4d to d0/dc/d3f/l8c 0 2024-02-15T22:41:16.508 INFO:tasks.workunit.client.1.smithi082.stdout:3/416: chown d0/d16/d62/f45 13185183 1 2024-02-15T22:41:16.509 INFO:tasks.workunit.client.1.smithi082.stdout:7/549: rename d12/d37/d85/c9f to d12/cb3 0 2024-02-15T22:41:16.510 INFO:tasks.workunit.client.1.smithi082.stdout:3/417: mkdir d0/d16/d62/d2e/d8d 0 2024-02-15T22:41:16.510 INFO:tasks.workunit.client.1.smithi082.stdout:3/418: readlink d0/d16/d62/l73 0 2024-02-15T22:41:16.511 INFO:tasks.workunit.client.1.smithi082.stdout:7/550: symlink d12/d17/d42/d67/d81/d91/da0/lb4 0 2024-02-15T22:41:16.511 INFO:tasks.workunit.client.1.smithi082.stdout:3/419: creat d0/d16/d62/d14/d21/d7d/f8e x:0 0 0 2024-02-15T22:41:16.525 INFO:tasks.workunit.client.1.smithi082.stdout:3/420: read d0/dc/f20 [1924854,125740] 0 2024-02-15T22:41:16.525 INFO:tasks.workunit.client.1.smithi082.stdout:3/421: write d0/d16/d62/f6d [44607,121455] 0 2024-02-15T22:41:16.534 INFO:tasks.workunit.client.1.smithi082.stdout:9/555: dwrite d8/d24/d2e/f6d [4194304,4194304] 0 2024-02-15T22:41:16.535 INFO:tasks.workunit.client.1.smithi082.stdout:9/556: mknod d8/d24/d2e/d53/ca7 0 2024-02-15T22:41:16.536 INFO:tasks.workunit.client.1.smithi082.stdout:9/557: symlink d8/d12/d33/d64/d8b/d96/la8 0 2024-02-15T22:41:16.544 INFO:tasks.workunit.client.1.smithi082.stdout:7/551: dwrite d12/d3b/f44 [0,4194304] 0 2024-02-15T22:41:16.545 INFO:tasks.workunit.client.1.smithi082.stdout:4/643: dwrite d0/d8/d1b/dd/feb [0,4194304] 0 2024-02-15T22:41:16.548 INFO:tasks.workunit.client.1.smithi082.stdout:4/644: mknod d0/dc0/dcd/de3/cf0 0 2024-02-15T22:41:16.548 INFO:tasks.workunit.client.1.smithi082.stdout:3/422: dwrite d0/d16/d62/f45 [0,4194304] 0 2024-02-15T22:41:16.549 INFO:tasks.workunit.client.1.smithi082.stdout:4/645: symlink d0/d8/d1b/dd/d37/lf1 0 2024-02-15T22:41:16.552 INFO:tasks.workunit.client.1.smithi082.stdout:3/423: link d0/d16/d62/d14/f85 d0/d16/d62/d14/d21/d69/d87/f8f 0 2024-02-15T22:41:16.553 INFO:tasks.workunit.client.1.smithi082.stdout:3/424: truncate d0/d16/d62/d14/f2a 43008 0 2024-02-15T22:41:16.553 INFO:tasks.workunit.client.1.smithi082.stdout:3/425: readlink d0/d53/l74 0 2024-02-15T22:41:16.561 INFO:tasks.workunit.client.1.smithi082.stdout:9/558: dwrite f5 [0,4194304] 0 2024-02-15T22:41:16.564 INFO:tasks.workunit.client.1.smithi082.stdout:3/426: dread d0/dc/f26 [0,4194304] 0 2024-02-15T22:41:16.575 INFO:tasks.workunit.client.1.smithi082.stdout:7/552: dwrite d12/d17/d42/d67/f71 [4194304,4194304] 0 2024-02-15T22:41:16.576 INFO:tasks.workunit.client.1.smithi082.stdout:9/559: mknod d8/d24/d87/ca9 0 2024-02-15T22:41:16.579 INFO:tasks.workunit.client.1.smithi082.stdout:7/553: link d12/d17/d4d/d7d/f9c d12/d17/d42/d67/d81/d91/da0/fb5 0 2024-02-15T22:41:16.579 INFO:tasks.workunit.client.1.smithi082.stdout:7/554: stat d12/d17/d42/d67/d81/d91 0 2024-02-15T22:41:16.579 INFO:tasks.workunit.client.1.smithi082.stdout:7/555: fdatasync d12/d3b/d5a/f92 0 2024-02-15T22:41:16.579 INFO:tasks.workunit.client.1.smithi082.stdout:7/556: chown d12/d17/d4d 448071 1 2024-02-15T22:41:16.581 INFO:tasks.workunit.client.1.smithi082.stdout:9/560: link d8/d12/d33/d64/ca2 d8/d12/caa 0 2024-02-15T22:41:16.582 INFO:tasks.workunit.client.1.smithi082.stdout:7/557: unlink f3 0 2024-02-15T22:41:16.583 INFO:tasks.workunit.client.1.smithi082.stdout:9/561: mkdir d8/d12/d33/d64/d77/dab 0 2024-02-15T22:41:16.586 INFO:tasks.workunit.client.1.smithi082.stdout:7/558: unlink d12/d37/c8c 0 2024-02-15T22:41:16.586 INFO:tasks.workunit.client.1.smithi082.stdout:7/559: write d12/d3b/f86 [1056498,36501] 0 2024-02-15T22:41:16.590 INFO:tasks.workunit.client.1.smithi082.stdout:7/560: rmdir d12/d27/d33/daa 0 2024-02-15T22:41:16.590 INFO:tasks.workunit.client.1.smithi082.stdout:7/561: creat d12/d17/fb6 x:0 0 0 2024-02-15T22:41:16.590 INFO:tasks.workunit.client.1.smithi082.stdout:7/562: creat d12/d3b/d5a/fb7 x:0 0 0 2024-02-15T22:41:16.590 INFO:tasks.workunit.client.1.smithi082.stdout:7/563: fsync d12/d37/f98 0 2024-02-15T22:41:16.592 INFO:tasks.workunit.client.1.smithi082.stdout:9/562: dread d8/d12/d33/d3e/f5b [0,4194304] 0 2024-02-15T22:41:16.593 INFO:tasks.workunit.client.1.smithi082.stdout:9/563: chown d8/d12/d33/d3e/f66 3294 1 2024-02-15T22:41:16.593 INFO:tasks.workunit.client.1.smithi082.stdout:7/564: symlink d12/d27/d74/d8b/lb8 0 2024-02-15T22:41:16.594 INFO:tasks.workunit.client.1.smithi082.stdout:9/564: rename d8/d24/d2e/d56/d82 to d8/d12/d33/da4/dac 0 2024-02-15T22:41:16.594 INFO:tasks.workunit.client.1.smithi082.stdout:9/565: fdatasync d8/d24/d2e/d56/f60 0 2024-02-15T22:41:16.595 INFO:tasks.workunit.client.1.smithi082.stdout:7/565: dread d12/d3b/f89 [0,4194304] 0 2024-02-15T22:41:16.596 INFO:tasks.workunit.client.1.smithi082.stdout:9/566: creat d8/d12/d33/da4/fad x:0 0 0 2024-02-15T22:41:16.596 INFO:tasks.workunit.client.1.smithi082.stdout:4/646: dwrite d0/d16/f8f [0,4194304] 0 2024-02-15T22:41:16.596 INFO:tasks.workunit.client.1.smithi082.stdout:3/427: dwrite d0/d53/f7f [0,4194304] 0 2024-02-15T22:41:16.596 INFO:tasks.workunit.client.1.smithi082.stdout:3/428: chown d0/l1d 819755679 1 2024-02-15T22:41:16.597 INFO:tasks.workunit.client.1.smithi082.stdout:7/566: symlink d12/d17/d42/d67/d79/lb9 0 2024-02-15T22:41:16.598 INFO:tasks.workunit.client.1.smithi082.stdout:9/567: creat d8/d12/d33/d64/d77/dab/fae x:0 0 0 2024-02-15T22:41:16.598 INFO:tasks.workunit.client.1.smithi082.stdout:9/568: chown d8/d12/d30/d3c 0 1 2024-02-15T22:41:16.600 INFO:tasks.workunit.client.1.smithi082.stdout:4/647: mknod d0/d8/d1b/dd/cf2 0 2024-02-15T22:41:16.600 INFO:tasks.workunit.client.1.smithi082.stdout:4/648: creat d0/d47/da6/ff3 x:0 0 0 2024-02-15T22:41:16.600 INFO:tasks.workunit.client.1.smithi082.stdout:4/649: truncate d0/d16/d4a/f63 1105078 0 2024-02-15T22:41:16.603 INFO:tasks.workunit.client.1.smithi082.stdout:3/429: link d0/f43 d0/d16/d62/f90 0 2024-02-15T22:41:16.604 INFO:tasks.workunit.client.1.smithi082.stdout:7/567: unlink d12/d3b/c72 0 2024-02-15T22:41:16.604 INFO:tasks.workunit.client.1.smithi082.stdout:7/568: chown d12/d17/f5f 624 1 2024-02-15T22:41:16.605 INFO:tasks.workunit.client.1.smithi082.stdout:9/569: mkdir d8/d12/d33/d64/daf 0 2024-02-15T22:41:16.605 INFO:tasks.workunit.client.1.smithi082.stdout:9/570: readlink d8/d12/d33/l52 0 2024-02-15T22:41:16.607 INFO:tasks.workunit.client.1.smithi082.stdout:3/430: mkdir d0/d16/d62/d14/d21/d69/d91 0 2024-02-15T22:41:16.607 INFO:tasks.workunit.client.1.smithi082.stdout:3/431: read - d0/dc/d3f/f76 zero size 2024-02-15T22:41:16.608 INFO:tasks.workunit.client.1.smithi082.stdout:3/432: chown d0/d16/d62/f45 1 1 2024-02-15T22:41:16.608 INFO:tasks.workunit.client.1.smithi082.stdout:3/433: read d0/f33 [2559002,46573] 0 2024-02-15T22:41:16.608 INFO:tasks.workunit.client.1.smithi082.stdout:7/569: mknod d12/d3b/d41/cba 0 2024-02-15T22:41:16.609 INFO:tasks.workunit.client.1.smithi082.stdout:9/571: creat d8/d12/d67/d70/d97/fb0 x:0 0 0 2024-02-15T22:41:16.609 INFO:tasks.workunit.client.1.smithi082.stdout:9/572: chown d8/d12 2 1 2024-02-15T22:41:16.610 INFO:tasks.workunit.client.1.smithi082.stdout:3/434: symlink d0/d16/d3e/l92 0 2024-02-15T22:41:16.611 INFO:tasks.workunit.client.1.smithi082.stdout:7/570: getdents d12/d17/d4d/d7d 0 2024-02-15T22:41:16.613 INFO:tasks.workunit.client.1.smithi082.stdout:7/571: mkdir d12/d27/d6e/d6a/db2/dbb 0 2024-02-15T22:41:16.613 INFO:tasks.workunit.client.1.smithi082.stdout:7/572: chown d12/d3b/d41/cba 56322698 1 2024-02-15T22:41:16.614 INFO:tasks.workunit.client.1.smithi082.stdout:7/573: rmdir d12/d27/d74/d8b 39 2024-02-15T22:41:16.616 INFO:tasks.workunit.client.1.smithi082.stdout:7/574: mkdir d12/d17/d42/d67/d81/d91/dbc 0 2024-02-15T22:41:16.616 INFO:tasks.workunit.client.1.smithi082.stdout:7/575: truncate d12/d17/d42/d67/d79/f96 982361 0 2024-02-15T22:41:16.616 INFO:tasks.workunit.client.1.smithi082.stdout:7/576: chown d12/f16 3155 1 2024-02-15T22:41:16.617 INFO:tasks.workunit.client.1.smithi082.stdout:7/577: mkdir d12/d37/dbd 0 2024-02-15T22:41:16.617 INFO:tasks.workunit.client.1.smithi082.stdout:7/578: chown d12/d37/l65 72690515 1 2024-02-15T22:41:16.617 INFO:tasks.workunit.client.1.smithi082.stdout:7/579: truncate d12/d17/d42/f87 4735090 0 2024-02-15T22:41:16.617 INFO:tasks.workunit.client.1.smithi082.stdout:7/580: chown d12/f64 146378661 1 2024-02-15T22:41:16.617 INFO:tasks.workunit.client.1.smithi082.stdout:7/581: write d12/d3b/d5a/fb7 [657315,111921] 0 2024-02-15T22:41:16.618 INFO:tasks.workunit.client.1.smithi082.stdout:4/650: dwrite d0/d8/fba [0,4194304] 0 2024-02-15T22:41:16.618 INFO:tasks.workunit.client.1.smithi082.stdout:7/582: mkdir d12/d27/d6e/d6a/d9e/dbe 0 2024-02-15T22:41:16.619 INFO:tasks.workunit.client.1.smithi082.stdout:3/435: write d0/d53/f7f [285385,81051] 0 2024-02-15T22:41:16.622 INFO:tasks.workunit.client.1.smithi082.stdout:4/651: rename d0/d8/d1b/dd/f4c to d0/d16/d4a/d6a/ff4 0 2024-02-15T22:41:16.622 INFO:tasks.workunit.client.1.smithi082.stdout:7/583: truncate d12/f64 548607 0 2024-02-15T22:41:16.624 INFO:tasks.workunit.client.1.smithi082.stdout:3/436: creat d0/d16/d62/d2e/d8d/f93 x:0 0 0 2024-02-15T22:41:16.624 INFO:tasks.workunit.client.1.smithi082.stdout:3/437: chown d0/d16/d62/d14/d21/d69/d87/f8f 162 1 2024-02-15T22:41:16.625 INFO:tasks.workunit.client.1.smithi082.stdout:6/639: sync 2024-02-15T22:41:16.625 INFO:tasks.workunit.client.1.smithi082.stdout:6/640: readlink d2/d30/l79 0 2024-02-15T22:41:16.625 INFO:tasks.workunit.client.1.smithi082.stdout:6/641: fsync d2/d18/d8a/d47/d72/f78 0 2024-02-15T22:41:16.627 INFO:tasks.workunit.client.1.smithi082.stdout:4/652: rename d0/d8/d32/fa3 to d0/d8/d1b/dd/daa/ff5 0 2024-02-15T22:41:16.628 INFO:tasks.workunit.client.1.smithi082.stdout:7/584: symlink d12/d17/d42/lbf 0 2024-02-15T22:41:16.629 INFO:tasks.workunit.client.1.smithi082.stdout:3/438: mknod d0/d16/d62/d14/d21/d41/c94 0 2024-02-15T22:41:16.629 INFO:tasks.workunit.client.1.smithi082.stdout:3/439: dread - d0/d16/d62/d14/d21/d7d/f8e zero size 2024-02-15T22:41:16.630 INFO:tasks.workunit.client.1.smithi082.stdout:7/585: mkdir d12/d17/d42/d67/d81/dc0 0 2024-02-15T22:41:16.630 INFO:tasks.workunit.client.1.smithi082.stdout:7/586: chown d12/d37/d85/c94 19 1 2024-02-15T22:41:16.630 INFO:tasks.workunit.client.1.smithi082.stdout:3/440: mknod d0/d16/d3e/c95 0 2024-02-15T22:41:16.637 INFO:tasks.workunit.client.1.smithi082.stdout:4/653: dread d0/d8/d32/d39/f7c [0,4194304] 0 2024-02-15T22:41:16.638 INFO:tasks.workunit.client.1.smithi082.stdout:3/441: dread d0/dc/f51 [0,4194304] 0 2024-02-15T22:41:16.645 INFO:tasks.workunit.client.1.smithi082.stdout:3/442: rmdir d0/d16/d62/d14 39 2024-02-15T22:41:16.646 INFO:tasks.workunit.client.1.smithi082.stdout:7/587: truncate d12/d17/d42/d67/d79/f96 598284 0 2024-02-15T22:41:16.647 INFO:tasks.workunit.client.1.smithi082.stdout:3/443: creat d0/d16/d62/d14/d21/d69/d91/f96 x:0 0 0 2024-02-15T22:41:16.647 INFO:tasks.workunit.client.1.smithi082.stdout:3/444: fsync d0/d16/d62/d14/d21/d7d/f83 0 2024-02-15T22:41:16.648 INFO:tasks.workunit.client.1.smithi082.stdout:3/445: stat d0/d16/d62/d14/f85 0 2024-02-15T22:41:16.649 INFO:tasks.workunit.client.1.smithi082.stdout:7/588: symlink d12/d37/dbd/lc1 0 2024-02-15T22:41:16.662 INFO:tasks.workunit.client.1.smithi082.stdout:4/654: dwrite d0/d8/d1b/dd/f41 [0,4194304] 0 2024-02-15T22:41:16.662 INFO:tasks.workunit.client.1.smithi082.stdout:4/655: write d0/d46/fe9 [15994,38336] 0 2024-02-15T22:41:16.663 INFO:tasks.workunit.client.1.smithi082.stdout:4/656: rename d0/d47/fc6 to d0/d8/d1b/ff6 0 2024-02-15T22:41:16.664 INFO:tasks.workunit.client.1.smithi082.stdout:3/446: dwrite d0/d16/d62/d14/d21/d7d/f83 [4194304,4194304] 0 2024-02-15T22:41:16.664 INFO:tasks.workunit.client.1.smithi082.stdout:4/657: creat d0/d47/ff7 x:0 0 0 2024-02-15T22:41:16.666 INFO:tasks.workunit.client.1.smithi082.stdout:4/658: unlink d0/d8/d1b/dd/f41 0 2024-02-15T22:41:16.667 INFO:tasks.workunit.client.1.smithi082.stdout:4/659: truncate d0/d8/d32/d39/fab 4074862 0 2024-02-15T22:41:16.674 INFO:tasks.workunit.client.1.smithi082.stdout:3/447: dread d0/d16/d62/d14/d21/d7d/f83 [0,4194304] 0 2024-02-15T22:41:16.679 INFO:tasks.workunit.client.1.smithi082.stdout:3/448: dread d0/d16/f4a [0,4194304] 0 2024-02-15T22:41:16.681 INFO:tasks.workunit.client.1.smithi082.stdout:3/449: rename d0/dc/d3f/f65 to d0/d16/f97 0 2024-02-15T22:41:16.682 INFO:tasks.workunit.client.1.smithi082.stdout:3/450: truncate d0/d16/f12 7229140 0 2024-02-15T22:41:16.683 INFO:tasks.workunit.client.1.smithi082.stdout:3/451: symlink d0/d16/d62/d14/d21/d7d/l98 0 2024-02-15T22:41:16.683 INFO:tasks.workunit.client.1.smithi082.stdout:3/452: write d0/d16/d62/d14/d21/f58 [1451716,36870] 0 2024-02-15T22:41:16.684 INFO:tasks.workunit.client.1.smithi082.stdout:3/453: truncate d0/d16/f4a 1221056 0 2024-02-15T22:41:16.684 INFO:tasks.workunit.client.1.smithi082.stdout:3/454: write d0/d16/d62/d2e/f70 [910538,65487] 0 2024-02-15T22:41:16.685 INFO:tasks.workunit.client.1.smithi082.stdout:4/660: dwrite d0/d8/d32/f4e [0,4194304] 0 2024-02-15T22:41:16.686 INFO:tasks.workunit.client.1.smithi082.stdout:4/661: truncate d0/d46/f79 2208587 0 2024-02-15T22:41:16.686 INFO:tasks.workunit.client.1.smithi082.stdout:4/662: stat d0/d16/f56 0 2024-02-15T22:41:16.686 INFO:tasks.workunit.client.1.smithi082.stdout:4/663: chown d0/d8/l1c 322 1 2024-02-15T22:41:16.687 INFO:tasks.workunit.client.1.smithi082.stdout:4/664: dread d0/d16/d4a/f52 [0,4194304] 0 2024-02-15T22:41:16.687 INFO:tasks.workunit.client.1.smithi082.stdout:4/665: creat d0/d8/d1b/ff8 x:0 0 0 2024-02-15T22:41:16.689 INFO:tasks.workunit.client.1.smithi082.stdout:4/666: mkdir d0/d46/df9 0 2024-02-15T22:41:16.690 INFO:tasks.workunit.client.1.smithi082.stdout:4/667: mkdir d0/d8/d1b/dd/d37/dfa 0 2024-02-15T22:41:16.690 INFO:tasks.workunit.client.1.smithi082.stdout:4/668: chown d0/d8/d1b/ce 366 1 2024-02-15T22:41:16.697 INFO:tasks.workunit.client.1.smithi082.stdout:3/455: dread d0/d16/d62/f36 [0,4194304] 0 2024-02-15T22:41:16.698 INFO:tasks.workunit.client.1.smithi082.stdout:3/456: mknod d0/d16/d62/d14/d21/d69/d91/c99 0 2024-02-15T22:41:16.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/457: creat d0/d16/d62/d14/d21/d7d/f9a x:0 0 0 2024-02-15T22:41:16.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/458: write d0/d16/f4a [1925663,18849] 0 2024-02-15T22:41:16.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/459: chown d0/d16/d62/f7 0 1 2024-02-15T22:41:16.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/460: dread - d0/d16/d62/d2e/d8d/f93 zero size 2024-02-15T22:41:16.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/461: fsync d0/d16/d62/d14/d21/f35 0 2024-02-15T22:41:16.701 INFO:tasks.workunit.client.1.smithi082.stdout:3/462: write d0/d16/d62/d14/d21/d69/d6c/f8b [1386239,101659] 0 2024-02-15T22:41:16.712 INFO:tasks.workunit.client.1.smithi082.stdout:4/669: dwrite d0/d8/d32/d39/fab [0,4194304] 0 2024-02-15T22:41:16.714 INFO:tasks.workunit.client.1.smithi082.stdout:4/670: symlink d0/d47/da6/da7/lfb 0 2024-02-15T22:41:16.738 INFO:tasks.workunit.client.1.smithi082.stdout:3/463: dwrite d0/d16/d62/d14/d21/d69/d6c/f8b [0,4194304] 0 2024-02-15T22:41:16.738 INFO:tasks.workunit.client.1.smithi082.stdout:4/671: dwrite d0/d46/f79 [0,4194304] 0 2024-02-15T22:41:16.739 INFO:tasks.workunit.client.1.smithi082.stdout:3/464: getdents d0/d16/d62/d14/d21/d69/d87 0 2024-02-15T22:41:16.747 INFO:tasks.workunit.client.1.smithi082.stdout:4/672: rmdir d0/d47 39 2024-02-15T22:41:16.753 INFO:tasks.workunit.client.1.smithi082.stdout:3/465: dwrite d0/d16/d62/d2e/f89 [0,4194304] 0 2024-02-15T22:41:16.760 INFO:tasks.workunit.client.1.smithi082.stdout:3/466: dread d0/dc/f20 [0,4194304] 0 2024-02-15T22:41:16.761 INFO:tasks.workunit.client.1.smithi082.stdout:4/673: dwrite d0/d47/da6/ff3 [0,4194304] 0 2024-02-15T22:41:16.761 INFO:tasks.workunit.client.1.smithi082.stdout:3/467: unlink d0/f33 0 2024-02-15T22:41:16.763 INFO:tasks.workunit.client.1.smithi082.stdout:4/674: creat d0/dc0/dcd/ffc x:0 0 0 2024-02-15T22:41:16.764 INFO:tasks.workunit.client.1.smithi082.stdout:3/468: truncate d0/d16/d62/f50 4123080 0 2024-02-15T22:41:16.765 INFO:tasks.workunit.client.1.smithi082.stdout:4/675: mknod d0/d47/cfd 0 2024-02-15T22:41:16.765 INFO:tasks.workunit.client.1.smithi082.stdout:4/676: fdatasync d0/d16/f56 0 2024-02-15T22:41:16.766 INFO:tasks.workunit.client.1.smithi082.stdout:3/469: symlink d0/d16/d62/d2e/d84/l9b 0 2024-02-15T22:41:16.766 INFO:tasks.workunit.client.1.smithi082.stdout:3/470: fdatasync d0/d16/d62/d14/d21/f58 0 2024-02-15T22:41:16.766 INFO:tasks.workunit.client.1.smithi082.stdout:3/471: fsync d0/d16/d62/d14/d21/f58 0 2024-02-15T22:41:16.766 INFO:tasks.workunit.client.1.smithi082.stdout:3/472: chown d0/d16/d62/d14/d21/d69/d6c/f7b 8 1 2024-02-15T22:41:16.769 INFO:tasks.workunit.client.1.smithi082.stdout:3/473: rename d0/d16/d62/d2e/f70 to d0/dc/f9c 0 2024-02-15T22:41:16.770 INFO:tasks.workunit.client.1.smithi082.stdout:4/677: getdents d0/d8 0 2024-02-15T22:41:16.772 INFO:tasks.workunit.client.1.smithi082.stdout:3/474: creat d0/d53/f9d x:0 0 0 2024-02-15T22:41:16.774 INFO:tasks.workunit.client.1.smithi082.stdout:4/678: creat d0/d8/d1b/d70/ffe x:0 0 0 2024-02-15T22:41:16.774 INFO:tasks.workunit.client.1.smithi082.stdout:3/475: symlink d0/d53/l9e 0 2024-02-15T22:41:16.777 INFO:tasks.workunit.client.1.smithi082.stdout:4/679: creat d0/d16/d4a/d6a/dd9/fff x:0 0 0 2024-02-15T22:41:16.778 INFO:tasks.workunit.client.1.smithi082.stdout:3/476: link d0/dc/d3f/f78 d0/d16/d62/f9f 0 2024-02-15T22:41:16.778 INFO:tasks.workunit.client.1.smithi082.stdout:3/477: creat d0/d16/d62/fa0 x:0 0 0 2024-02-15T22:41:16.779 INFO:tasks.workunit.client.1.smithi082.stdout:3/478: write d0/d16/d62/d14/f40 [1142248,99691] 0 2024-02-15T22:41:16.783 INFO:tasks.workunit.client.1.smithi082.stdout:4/680: rmdir d0/d47 39 2024-02-15T22:41:16.785 INFO:tasks.workunit.client.1.smithi082.stdout:4/681: symlink d0/d8/d1b/dd/d37/l100 0 2024-02-15T22:41:16.785 INFO:tasks.workunit.client.1.smithi082.stdout:4/682: write d0/d16/f56 [670088,98925] 0 2024-02-15T22:41:16.794 INFO:tasks.workunit.client.1.smithi082.stdout:3/479: dwrite d0/d16/d62/f25 [4194304,4194304] 0 2024-02-15T22:41:16.795 INFO:tasks.workunit.client.1.smithi082.stdout:3/480: dread - d0/d16/d62/d14/d21/d69/d91/f96 zero size 2024-02-15T22:41:16.795 INFO:tasks.workunit.client.1.smithi082.stdout:3/481: write d0/d16/d62/d14/d21/d69/d6c/f7b [282673,94139] 0 2024-02-15T22:41:16.796 INFO:tasks.workunit.client.1.smithi082.stdout:3/482: rmdir d0/d53 39 2024-02-15T22:41:16.797 INFO:tasks.workunit.client.1.smithi082.stdout:3/483: creat d0/d16/d62/d14/d21/d69/d91/fa1 x:0 0 0 2024-02-15T22:41:16.798 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T22:41:16.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-15T22:41:16.799 INFO:tasks.workunit.client.1.smithi082.stdout:3/484: rename d0/d53 to d0/d16/d62/d14/d71/da2 0 2024-02-15T22:41:16.799 INFO:tasks.workunit.client.1.smithi082.stdout:3/485: mknod d0/d16/d62/d14/d21/d69/ca3 0 2024-02-15T22:41:16.800 INFO:tasks.workunit.client.1.smithi082.stdout:3/486: mknod d0/d16/d62/d14/d21/d7d/ca4 0 2024-02-15T22:41:16.800 INFO:tasks.workunit.client.1.smithi082.stdout:3/487: write d0/d16/d62/f7e [776786,20616] 0 2024-02-15T22:41:16.801 INFO:tasks.workunit.client.1.smithi082.stdout:3/488: link d0/d16/d62/d14/d21/d69/d91/fa1 d0/d16/d62/d14/d21/fa5 0 2024-02-15T22:41:16.802 INFO:tasks.workunit.client.1.smithi082.stdout:3/489: mkdir d0/d16/d62/d79/da6 0 2024-02-15T22:41:16.804 INFO:tasks.workunit.client.1.smithi082.stdout:4/683: dwrite d0/d8/d32/d39/fab [0,4194304] 0 2024-02-15T22:41:16.804 INFO:tasks.workunit.client.1.smithi082.stdout:4/684: stat d0/d16/d87 0 2024-02-15T22:41:16.806 INFO:tasks.workunit.client.1.smithi082.stdout:4/685: rename d0/d16/d4a/d6a/dd9/ldb to d0/d46/dd3/l101 0 2024-02-15T22:41:16.807 INFO:tasks.workunit.client.1.smithi082.stdout:4/686: creat d0/d47/d4d/f102 x:0 0 0 2024-02-15T22:41:16.820 INFO:tasks.workunit.client.1.smithi082.stdout:4/687: dread d0/f23 [0,4194304] 0 2024-02-15T22:41:16.820 INFO:tasks.workunit.client.1.smithi082.stdout:3/490: dwrite d0/d16/d62/d14/d21/d69/d91/f96 [0,4194304] 0 2024-02-15T22:41:16.824 INFO:tasks.workunit.client.1.smithi082.stdout:4/688: symlink d0/d8/d1b/d70/l103 0 2024-02-15T22:41:16.824 INFO:tasks.workunit.client.1.smithi082.stdout:4/689: readlink d0/d16/l17 0 2024-02-15T22:41:16.824 INFO:tasks.workunit.client.1.smithi082.stdout:4/690: fsync d0/fc2 0 2024-02-15T22:41:16.825 INFO:tasks.workunit.client.1.smithi082.stdout:3/491: unlink d0/d16/d62/f5b 0 2024-02-15T22:41:16.825 INFO:tasks.workunit.client.1.smithi082.stdout:3/492: getdents d0/d16/d62/d14/d71/d86 0 2024-02-15T22:41:16.825 INFO:tasks.workunit.client.1.smithi082.stdout:3/493: dread - d0/d16/d62/f9f zero size 2024-02-15T22:41:16.825 INFO:tasks.workunit.client.1.smithi082.stdout:3/494: stat d0/d16/d62/d14/d71/da2/l74 0 2024-02-15T22:41:16.827 INFO:tasks.workunit.client.1.smithi082.stdout:4/691: link d0/d8/d1b/dd/fbc d0/d47/f104 0 2024-02-15T22:41:16.829 INFO:tasks.workunit.client.1.smithi082.stdout:4/692: symlink d0/d46/df9/l105 0 2024-02-15T22:41:16.829 INFO:tasks.workunit.client.1.smithi082.stdout:4/693: fsync d0/d47/d4d/fc1 0 2024-02-15T22:41:16.831 INFO:tasks.workunit.client.1.smithi082.stdout:3/495: link d0/dc/l2d d0/dc/la7 0 2024-02-15T22:41:16.834 INFO:tasks.workunit.client.1.smithi082.stdout:0/459: sync 2024-02-15T22:41:16.834 INFO:tasks.workunit.client.1.smithi082.stdout:1/563: sync 2024-02-15T22:41:16.834 INFO:tasks.workunit.client.1.smithi082.stdout:2/523: sync 2024-02-15T22:41:16.834 INFO:tasks.workunit.client.1.smithi082.stdout:8/526: sync 2024-02-15T22:41:16.834 INFO:tasks.workunit.client.1.smithi082.stdout:5/587: sync 2024-02-15T22:41:16.834 INFO:tasks.workunit.client.1.smithi082.stdout:0/460: fdatasync d3/d19/f58 0 2024-02-15T22:41:16.836 INFO:tasks.workunit.client.1.smithi082.stdout:9/573: sync 2024-02-15T22:41:16.836 INFO:tasks.workunit.client.1.smithi082.stdout:9/574: creat d8/d12/d33/d64/d77/dab/fb1 x:0 0 0 2024-02-15T22:41:16.836 INFO:tasks.workunit.client.1.smithi082.stdout:6/642: sync 2024-02-15T22:41:16.836 INFO:tasks.workunit.client.1.smithi082.stdout:6/643: fdatasync d2/d18/f44 0 2024-02-15T22:41:16.836 INFO:tasks.workunit.client.1.smithi082.stdout:7/589: sync 2024-02-15T22:41:16.837 INFO:tasks.workunit.client.1.smithi082.stdout:2/524: getdents d6/d3c 0 2024-02-15T22:41:16.840 INFO:tasks.workunit.client.1.smithi082.stdout:7/590: rmdir d12/d27/d6e/d6a/db2 39 2024-02-15T22:41:16.841 INFO:tasks.workunit.client.1.smithi082.stdout:4/694: dread d0/d16/f2b [0,4194304] 0 2024-02-15T22:41:16.846 INFO:tasks.workunit.client.1.smithi082.stdout:0/461: rmdir d3/d19/d5f 39 2024-02-15T22:41:16.847 INFO:tasks.workunit.client.1.smithi082.stdout:1/564: dread d1/da/d11/f9e [0,4194304] 0 2024-02-15T22:41:16.850 INFO:tasks.workunit.client.1.smithi082.stdout:7/591: mkdir d12/d27/dc2 0 2024-02-15T22:41:16.851 INFO:tasks.workunit.client.1.smithi082.stdout:4/695: mknod d0/d8/d32/c106 0 2024-02-15T22:41:16.853 INFO:tasks.workunit.client.1.smithi082.stdout:0/462: symlink d3/d64/d71/la2 0 2024-02-15T22:41:16.853 INFO:tasks.workunit.client.1.smithi082.stdout:4/696: dread d0/d16/f28 [0,4194304] 0 2024-02-15T22:41:16.853 INFO:tasks.workunit.client.1.smithi082.stdout:4/697: stat d0/d16/d4a/d6a/dd9 0 2024-02-15T22:41:16.854 INFO:tasks.workunit.client.1.smithi082.stdout:4/698: creat d0/d16/d4a/d6a/dd9/f107 x:0 0 0 2024-02-15T22:41:16.854 INFO:tasks.workunit.client.1.smithi082.stdout:1/565: rmdir d1/da/d11/d3f/d75 39 2024-02-15T22:41:16.855 INFO:tasks.workunit.client.1.smithi082.stdout:7/592: creat d12/d17/d42/d67/d81/d91/dbc/fc3 x:0 0 0 2024-02-15T22:41:16.855 INFO:tasks.workunit.client.1.smithi082.stdout:7/593: dread - d12/d17/d42/d67/d81/d91/dbc/fc3 zero size 2024-02-15T22:41:16.860 INFO:tasks.workunit.client.1.smithi082.stdout:4/699: unlink d0/d8/d1b/d70/l103 0 2024-02-15T22:41:16.860 INFO:tasks.workunit.client.1.smithi082.stdout:7/594: mkdir d12/d27/dc4 0 2024-02-15T22:41:16.860 INFO:tasks.workunit.client.1.smithi082.stdout:7/595: symlink d12/d17/d42/d67/d81/dc0/lc5 0 2024-02-15T22:41:16.870 INFO:tasks.workunit.client.1.smithi082.stdout:4/700: dread d0/d16/f30 [0,4194304] 0 2024-02-15T22:41:16.871 INFO:tasks.workunit.client.1.smithi082.stdout:4/701: mkdir d0/d47/da6/da7/d108 0 2024-02-15T22:41:16.872 INFO:tasks.workunit.client.1.smithi082.stdout:4/702: creat d0/d47/da6/da7/d108/f109 x:0 0 0 2024-02-15T22:41:16.874 INFO:tasks.workunit.client.1.smithi082.stdout:4/703: symlink d0/d46/l10a 0 2024-02-15T22:41:16.874 INFO:tasks.workunit.client.1.smithi082.stdout:4/704: stat d0/f75 0 2024-02-15T22:41:16.876 INFO:tasks.workunit.client.1.smithi082.stdout:7/596: dread d12/d37/f98 [0,4194304] 0 2024-02-15T22:41:16.877 INFO:tasks.workunit.client.1.smithi082.stdout:7/597: mkdir d12/d27/d6e/d6a/db2/dbb/dc6 0 2024-02-15T22:41:16.879 INFO:tasks.workunit.client.1.smithi082.stdout:7/598: creat d12/d17/d3d/fc7 x:0 0 0 2024-02-15T22:41:16.879 INFO:tasks.workunit.client.1.smithi082.stdout:7/599: dread - d12/d27/d6e/f93 zero size 2024-02-15T22:41:16.879 INFO:tasks.workunit.client.1.smithi082.stdout:8/527: dwrite d1/d7/de/f80 [0,4194304] 0 2024-02-15T22:41:16.879 INFO:tasks.workunit.client.1.smithi082.stdout:8/528: readlink d1/d40/lb0 0 2024-02-15T22:41:16.879 INFO:tasks.workunit.client.1.smithi082.stdout:8/529: write d1/d7/d9/d24/d43/fae [639353,73093] 0 2024-02-15T22:41:16.879 INFO:tasks.workunit.client.1.smithi082.stdout:8/530: fsync d1/d7/d9/f47 0 2024-02-15T22:41:16.880 INFO:tasks.workunit.client.1.smithi082.stdout:8/531: chown d1/d7/d9/d50/d56/f6b 351501850 1 2024-02-15T22:41:16.880 INFO:tasks.workunit.client.1.smithi082.stdout:5/588: dwrite d5/da/d14/f94 [0,4194304] 0 2024-02-15T22:41:16.881 INFO:tasks.workunit.client.1.smithi082.stdout:7/600: dread d12/d17/d42/d67/d81/d91/da0/fb5 [0,4194304] 0 2024-02-15T22:41:16.882 INFO:tasks.workunit.client.1.smithi082.stdout:8/532: mkdir d1/d7/d9/d24/d43/da6/db8 0 2024-02-15T22:41:16.882 INFO:tasks.workunit.client.1.smithi082.stdout:8/533: write d1/d7/d48/f6e [4688327,115708] 0 2024-02-15T22:41:16.883 INFO:tasks.workunit.client.1.smithi082.stdout:5/589: mknod d5/da/d67/dbf/cd1 0 2024-02-15T22:41:16.883 INFO:tasks.workunit.client.1.smithi082.stdout:7/601: dread d12/d17/d4d/d7d/f9c [0,4194304] 0 2024-02-15T22:41:16.884 INFO:tasks.workunit.client.1.smithi082.stdout:8/534: unlink d1/d7/d9/d24/d30/c7b 0 2024-02-15T22:41:16.886 INFO:tasks.workunit.client.1.smithi082.stdout:6/644: dwrite d2/f1e [0,4194304] 0 2024-02-15T22:41:16.886 INFO:tasks.workunit.client.1.smithi082.stdout:6/645: creat d2/d18/d8a/d65/fcd x:0 0 0 2024-02-15T22:41:16.886 INFO:tasks.workunit.client.1.smithi082.stdout:6/646: fdatasync d2/d18/f44 0 2024-02-15T22:41:16.886 INFO:tasks.workunit.client.1.smithi082.stdout:5/590: rename d5/da/dc/dad/dcf/d59/f80 to d5/da/dc/dad/dcf/d59/d84/fd2 0 2024-02-15T22:41:16.886 INFO:tasks.workunit.client.1.smithi082.stdout:7/602: dread d12/d3b/d41/f66 [0,4194304] 0 2024-02-15T22:41:16.886 INFO:tasks.workunit.client.1.smithi082.stdout:7/603: chown d12/d3b/f89 158 1 2024-02-15T22:41:16.886 INFO:tasks.workunit.client.1.smithi082.stdout:7/604: stat d12/d17/l3a 0 2024-02-15T22:41:16.887 INFO:tasks.workunit.client.1.smithi082.stdout:8/535: truncate d1/f5 2526121 0 2024-02-15T22:41:16.887 INFO:tasks.workunit.client.1.smithi082.stdout:2/525: dwrite d6/dc/dd/d21/f36 [0,4194304] 0 2024-02-15T22:41:16.888 INFO:tasks.workunit.client.1.smithi082.stdout:6/647: mknod d2/d18/d8a/d65/cce 0 2024-02-15T22:41:16.888 INFO:tasks.workunit.client.1.smithi082.stdout:8/536: mknod d1/d7/de/d57/cb9 0 2024-02-15T22:41:16.890 INFO:tasks.workunit.client.1.smithi082.stdout:2/526: truncate d6/f26 371699 0 2024-02-15T22:41:16.891 INFO:tasks.workunit.client.1.smithi082.stdout:8/537: mknod d1/d40/cba 0 2024-02-15T22:41:16.892 INFO:tasks.workunit.client.1.smithi082.stdout:2/527: creat d6/dc/d58/d49/fa6 x:0 0 0 2024-02-15T22:41:16.892 INFO:tasks.workunit.client.1.smithi082.stdout:8/538: mkdir d1/d40/dbb 0 2024-02-15T22:41:16.893 INFO:tasks.workunit.client.1.smithi082.stdout:8/539: stat d1/d7/d9/f17 0 2024-02-15T22:41:16.899 INFO:tasks.workunit.client.1.smithi082.stdout:3/496: dwrite d0/d16/d62/d14/d21/d69/d87/f8f [0,4194304] 0 2024-02-15T22:41:16.899 INFO:tasks.workunit.client.1.smithi082.stdout:6/648: write d2/f5c [3355958,78306] 0 2024-02-15T22:41:16.899 INFO:tasks.workunit.client.1.smithi082.stdout:4/705: dwrite d0/d8/d1b/d70/f7f [0,4194304] 0 2024-02-15T22:41:16.900 INFO:tasks.workunit.client.1.smithi082.stdout:4/706: chown d0/d16/f3a 2 1 2024-02-15T22:41:16.900 INFO:tasks.workunit.client.1.smithi082.stdout:4/707: stat d0/d16/d4a/d6a/f91 0 2024-02-15T22:41:16.900 INFO:tasks.workunit.client.1.smithi082.stdout:0/463: dwrite d3/fe [4194304,4194304] 0 2024-02-15T22:41:16.900 INFO:tasks.workunit.client.1.smithi082.stdout:0/464: stat d3/d19/d25/d45/d56/d99 0 2024-02-15T22:41:16.903 INFO:tasks.workunit.client.1.smithi082.stdout:0/465: rename d3/d19/l36 to d3/d19/d93/la3 0 2024-02-15T22:41:16.904 INFO:tasks.workunit.client.1.smithi082.stdout:8/540: read d1/d7/f62 [3735396,96764] 0 2024-02-15T22:41:16.904 INFO:tasks.workunit.client.1.smithi082.stdout:8/541: chown d1/d7/d9/d42/d6a/l8f 31 1 2024-02-15T22:41:16.910 INFO:tasks.workunit.client.1.smithi082.stdout:2/528: dwrite d6/dc/f38 [0,4194304] 0 2024-02-15T22:41:16.910 INFO:tasks.workunit.client.1.smithi082.stdout:4/708: dread d0/d16/f22 [0,4194304] 0 2024-02-15T22:41:16.912 INFO:tasks.workunit.client.1.smithi082.stdout:3/497: write d0/d16/d3e/f5f [2733677,9269] 0 2024-02-15T22:41:16.914 INFO:tasks.workunit.client.1.smithi082.stdout:0/466: write d3/d19/d20/d26/f6a [6243733,15219] 0 2024-02-15T22:41:16.914 INFO:tasks.workunit.client.1.smithi082.stdout:4/709: dread d0/f7b [0,4194304] 0 2024-02-15T22:41:16.917 INFO:tasks.workunit.client.1.smithi082.stdout:3/498: rename d0/d16/d62/d2e/f38 to d0/d16/d62/d14/fa8 0 2024-02-15T22:41:16.918 INFO:tasks.workunit.client.1.smithi082.stdout:2/529: dread d6/dc/d58/f61 [0,4194304] 0 2024-02-15T22:41:16.919 INFO:tasks.workunit.client.1.smithi082.stdout:3/499: creat d0/fa9 x:0 0 0 2024-02-15T22:41:16.923 INFO:tasks.workunit.client.1.smithi082.stdout:8/542: fsync d1/f5 0 2024-02-15T22:41:16.923 INFO:tasks.workunit.client.1.smithi082.stdout:2/530: mkdir d6/dc/d12/d23/da7 0 2024-02-15T22:41:16.923 INFO:tasks.workunit.client.1.smithi082.stdout:8/543: dread - d1/d7/de/d1e/f20 zero size 2024-02-15T22:41:16.924 INFO:tasks.workunit.client.1.smithi082.stdout:3/500: write d0/d16/d62/f7 [791097,21561] 0 2024-02-15T22:41:16.924 INFO:tasks.workunit.client.1.smithi082.stdout:2/531: mknod d6/dc/d12/d46/ca8 0 2024-02-15T22:41:16.925 INFO:tasks.workunit.client.1.smithi082.stdout:2/532: write d6/dc/d58/d49/fa2 [1956143,53202] 0 2024-02-15T22:41:16.926 INFO:tasks.workunit.client.1.smithi082.stdout:2/533: dread d6/dc/d12/d46/d4b/d63/f66 [0,4194304] 0 2024-02-15T22:41:16.926 INFO:tasks.workunit.client.1.smithi082.stdout:8/544: symlink d1/d7/d48/lbc 0 2024-02-15T22:41:16.926 INFO:tasks.workunit.client.1.smithi082.stdout:0/467: dread d3/d19/f24 [0,4194304] 0 2024-02-15T22:41:16.927 INFO:tasks.workunit.client.1.smithi082.stdout:0/468: truncate d3/d19/d1c/f52 402238 0 2024-02-15T22:41:16.927 INFO:tasks.workunit.client.1.smithi082.stdout:0/469: dread - d3/d19/d5f/f96 zero size 2024-02-15T22:41:16.929 INFO:tasks.workunit.client.1.smithi082.stdout:2/534: unlink d6/dc/dd/d21/l98 0 2024-02-15T22:41:16.929 INFO:tasks.workunit.client.1.smithi082.stdout:2/535: dread - d6/dc/d12/d46/f7c zero size 2024-02-15T22:41:16.931 INFO:tasks.workunit.client.1.smithi082.stdout:8/545: link d1/d7/d9/d42/d6a/d8e/la2 d1/d7/d9/d42/d6a/da5/lbd 0 2024-02-15T22:41:16.931 INFO:tasks.workunit.client.1.smithi082.stdout:8/546: chown d1/d7/de/f3d 6421 1 2024-02-15T22:41:16.931 INFO:tasks.workunit.client.1.smithi082.stdout:8/547: fsync d1/d7/de/fb7 0 2024-02-15T22:41:16.932 INFO:tasks.workunit.client.1.smithi082.stdout:0/470: mknod d3/d19/d25/d45/d56/ca4 0 2024-02-15T22:41:16.932 INFO:tasks.workunit.client.1.smithi082.stdout:0/471: chown d3/f15 27958277 1 2024-02-15T22:41:16.932 INFO:tasks.workunit.client.1.smithi082.stdout:0/472: readlink d3/d19/d93/la3 0 2024-02-15T22:41:16.934 INFO:tasks.workunit.client.1.smithi082.stdout:2/536: mkdir d6/dc/d12/d46/da9 0 2024-02-15T22:41:16.934 INFO:tasks.workunit.client.1.smithi082.stdout:2/537: dread - d6/dc/d58/d49/fa6 zero size 2024-02-15T22:41:16.934 INFO:tasks.workunit.client.1.smithi082.stdout:2/538: fsync d6/dc/dd/d1d/f50 0 2024-02-15T22:41:16.936 INFO:tasks.workunit.client.1.smithi082.stdout:8/548: creat d1/d7/d9/d42/d6a/da5/fbe x:0 0 0 2024-02-15T22:41:16.945 INFO:tasks.workunit.client.1.smithi082.stdout:0/473: dread d3/d19/d25/d80/f84 [0,4194304] 0 2024-02-15T22:41:16.950 INFO:tasks.workunit.client.1.smithi082.stdout:8/549: dread d1/d7/de/d1e/f27 [0,4194304] 0 2024-02-15T22:41:16.951 INFO:tasks.workunit.client.1.smithi082.stdout:8/550: rmdir d1/d7/d9/d24/d43/da6 39 2024-02-15T22:41:16.951 INFO:tasks.workunit.client.1.smithi082.stdout:8/551: mknod d1/d7/d9/d24/d43/cbf 0 2024-02-15T22:41:16.952 INFO:tasks.workunit.client.1.smithi082.stdout:8/552: symlink d1/d7/d9/d24/d43/lc0 0 2024-02-15T22:41:16.954 INFO:tasks.workunit.client.1.smithi082.stdout:4/710: dwrite d0/f1 [4194304,4194304] 0 2024-02-15T22:41:16.955 INFO:tasks.workunit.client.1.smithi082.stdout:4/711: mknod d0/dc0/c10b 0 2024-02-15T22:41:16.956 INFO:tasks.workunit.client.1.smithi082.stdout:2/539: dwrite d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:16.956 INFO:tasks.workunit.client.1.smithi082.stdout:2/540: write d6/dc/dd/f9a [145734,71941] 0 2024-02-15T22:41:16.956 INFO:tasks.workunit.client.1.smithi082.stdout:2/541: fsync d6/dc/d12/d46/d4b/f8b 0 2024-02-15T22:41:16.962 INFO:tasks.workunit.client.1.smithi082.stdout:3/501: dwrite d0/d16/d62/d14/d21/d69/d6c/f8b [0,4194304] 0 2024-02-15T22:41:16.968 INFO:tasks.workunit.client.1.smithi082.stdout:0/474: rename d3/d19/d25/d45/d56 to d3/d19/d5f/da5 0 2024-02-15T22:41:16.972 INFO:tasks.workunit.client.1.smithi082.stdout:3/502: dread d0/d16/d62/d14/d71/da2/f7f [0,4194304] 0 2024-02-15T22:41:16.974 INFO:tasks.workunit.client.1.smithi082.stdout:3/503: rename d0/dc/d3f/l8c to d0/d16/laa 0 2024-02-15T22:41:16.975 INFO:tasks.workunit.client.1.smithi082.stdout:3/504: rename d0/d16/d62/d2e/d8d/f93 to d0/d16/d62/d79/fab 0 2024-02-15T22:41:16.994 INFO:tasks.workunit.client.1.smithi082.stdout:8/553: dwrite d1/f23 [4194304,4194304] 0 2024-02-15T22:41:16.994 INFO:tasks.workunit.client.1.smithi082.stdout:2/542: dwrite d6/d18/f37 [0,4194304] 0 2024-02-15T22:41:16.994 INFO:tasks.workunit.client.1.smithi082.stdout:4/712: dwrite d0/d16/f2b [0,4194304] 0 2024-02-15T22:41:16.995 INFO:tasks.workunit.client.1.smithi082.stdout:8/554: unlink d1/d7/d9/d24/d43/cbf 0 2024-02-15T22:41:16.995 INFO:tasks.workunit.client.1.smithi082.stdout:8/555: chown d1/d7/d9/d24/d72/c93 25819 1 2024-02-15T22:41:16.995 INFO:tasks.workunit.client.1.smithi082.stdout:8/556: chown d1/d7/d48/l95 101 1 2024-02-15T22:41:16.996 INFO:tasks.workunit.client.1.smithi082.stdout:3/505: dwrite d0/d16/d62/f36 [0,4194304] 0 2024-02-15T22:41:16.997 INFO:tasks.workunit.client.1.smithi082.stdout:2/543: symlink d6/dc/dd/d24/d72/laa 0 2024-02-15T22:41:16.998 INFO:tasks.workunit.client.1.smithi082.stdout:4/713: mkdir d0/d16/d87/d10c 0 2024-02-15T22:41:16.998 INFO:tasks.workunit.client.1.smithi082.stdout:4/714: chown d0/d8/d1b/dd/d37 13083591 1 2024-02-15T22:41:16.999 INFO:tasks.workunit.client.1.smithi082.stdout:3/506: rename d0/d16/f32 to d0/d16/d62/d14/d71/fac 0 2024-02-15T22:41:17.007 INFO:tasks.workunit.client.1.smithi082.stdout:2/544: creat d6/dc/d58/d49/d5e/d67/fab x:0 0 0 2024-02-15T22:41:17.008 INFO:tasks.workunit.client.1.smithi082.stdout:4/715: symlink d0/d8/d1b/dd/daa/l10d 0 2024-02-15T22:41:17.009 INFO:tasks.workunit.client.1.smithi082.stdout:2/545: write d6/d18/f47 [929482,35849] 0 2024-02-15T22:41:17.009 INFO:tasks.workunit.client.1.smithi082.stdout:3/507: mknod d0/d16/d62/d14/cad 0 2024-02-15T22:41:17.011 INFO:tasks.workunit.client.1.smithi082.stdout:4/716: symlink d0/d8/d1b/dd/l10e 0 2024-02-15T22:41:17.013 INFO:tasks.workunit.client.1.smithi082.stdout:4/717: creat d0/d8/d1b/dd/daa/f10f x:0 0 0 2024-02-15T22:41:17.013 INFO:tasks.workunit.client.1.smithi082.stdout:4/718: read - d0/d47/ff7 zero size 2024-02-15T22:41:17.017 INFO:tasks.workunit.client.1.smithi082.stdout:4/719: rename d0/d8/d1b/dd/d37/lb0 to d0/d16/d4a/d6a/dd9/de2/l110 0 2024-02-15T22:41:17.017 INFO:tasks.workunit.client.1.smithi082.stdout:4/720: write d0/d16/fd5 [837352,89428] 0 2024-02-15T22:41:17.019 INFO:tasks.workunit.client.1.smithi082.stdout:2/546: rmdir d6/dc/d58/d49 39 2024-02-15T22:41:17.021 INFO:tasks.workunit.client.1.smithi082.stdout:3/508: write d0/d16/d62/f50 [3311005,33065] 0 2024-02-15T22:41:17.021 INFO:tasks.workunit.client.1.smithi082.stdout:2/547: symlink d6/d3c/lac 0 2024-02-15T22:41:17.022 INFO:tasks.workunit.client.1.smithi082.stdout:3/509: mknod d0/d16/d62/d14/d21/d69/d87/cae 0 2024-02-15T22:41:17.022 INFO:tasks.workunit.client.1.smithi082.stdout:3/510: truncate d0/d16/d62/d14/d21/d7d/f8e 966643 0 2024-02-15T22:41:17.024 INFO:tasks.workunit.client.1.smithi082.stdout:2/548: link d6/dc/d12/d46/f8f d6/fad 0 2024-02-15T22:41:17.025 INFO:tasks.workunit.client.1.smithi082.stdout:2/549: mkdir d6/dc/d12/d46/d76/dae 0 2024-02-15T22:41:17.025 INFO:tasks.workunit.client.1.smithi082.stdout:2/550: fsync d6/dc/d58/d49/d5e/d67/fab 0 2024-02-15T22:41:17.041 INFO:tasks.workunit.client.1.smithi082.stdout:4/721: dwrite d0/d8/d32/d39/f3f [0,4194304] 0 2024-02-15T22:41:17.041 INFO:tasks.workunit.client.1.smithi082.stdout:3/511: dwrite d0/d16/d62/d14/d71/fac [0,4194304] 0 2024-02-15T22:41:17.042 INFO:tasks.workunit.client.1.smithi082.stdout:4/722: creat d0/d16/f111 x:0 0 0 2024-02-15T22:41:17.044 INFO:tasks.workunit.client.1.smithi082.stdout:4/723: unlink d0/d47/d4d/f102 0 2024-02-15T22:41:17.044 INFO:tasks.workunit.client.1.smithi082.stdout:4/724: stat d0/d47/da6 0 2024-02-15T22:41:17.045 INFO:tasks.workunit.client.1.smithi082.stdout:3/512: rename d0/d16/d62/d14/d21/c54 to d0/d16/d62/d14/d21/d7d/caf 0 2024-02-15T22:41:17.047 INFO:tasks.workunit.client.1.smithi082.stdout:3/513: getdents d0/d16/d62/d14 0 2024-02-15T22:41:17.047 INFO:tasks.workunit.client.1.smithi082.stdout:3/514: truncate d0/d16/d62/f36 3681757 0 2024-02-15T22:41:17.049 INFO:tasks.workunit.client.1.smithi082.stdout:3/515: mkdir d0/d16/d3e/d56/db0 0 2024-02-15T22:41:17.050 INFO:tasks.workunit.client.1.smithi082.stdout:3/516: dread d0/d16/d62/f7e [0,4194304] 0 2024-02-15T22:41:17.051 INFO:tasks.workunit.client.1.smithi082.stdout:4/725: write d0/d8/d1b/d70/f7f [234973,70255] 0 2024-02-15T22:41:17.070 INFO:tasks.workunit.client.1.smithi082.stdout:9/575: sync 2024-02-15T22:41:17.071 INFO:tasks.workunit.client.1.smithi082.stdout:9/576: unlink d8/d12/d33/da4/dac/c86 0 2024-02-15T22:41:17.072 INFO:tasks.workunit.client.1.smithi082.stdout:9/577: creat d8/d12/d33/d64/daf/fb2 x:0 0 0 2024-02-15T22:41:17.073 INFO:tasks.workunit.client.1.smithi082.stdout:3/517: dwrite d0/d16/d62/fa0 [0,4194304] 0 2024-02-15T22:41:17.077 INFO:tasks.workunit.client.1.smithi082.stdout:3/518: rename d0/d16/d62/d14/d21/d7d/caf to d0/d16/d62/d14/d21/d69/cb1 0 2024-02-15T22:41:17.077 INFO:tasks.workunit.client.1.smithi082.stdout:4/726: dwrite d0/d8/fdc [0,4194304] 0 2024-02-15T22:41:17.077 INFO:tasks.workunit.client.1.smithi082.stdout:4/727: stat d0/d8/d1b/dd/l10e 0 2024-02-15T22:41:17.078 INFO:tasks.workunit.client.1.smithi082.stdout:3/519: symlink d0/d16/d62/d14/d71/d86/lb2 0 2024-02-15T22:41:17.079 INFO:tasks.workunit.client.1.smithi082.stdout:3/520: read d0/d16/d62/d14/d21/d7d/f8e [789764,15952] 0 2024-02-15T22:41:17.083 INFO:tasks.workunit.client.1.smithi082.stdout:3/521: unlink d0/d16/d62/d14/cad 0 2024-02-15T22:41:17.083 INFO:tasks.workunit.client.1.smithi082.stdout:3/522: write d0/d16/d62/d14/d71/da2/f9d [472753,97161] 0 2024-02-15T22:41:17.092 INFO:tasks.workunit.client.1.smithi082.stdout:9/578: dwrite d8/d12/d33/d64/d7c/f94 [0,4194304] 0 2024-02-15T22:41:17.092 INFO:tasks.workunit.client.1.smithi082.stdout:9/579: fsync d8/d12/d33/d64/d77/dab/fb1 0 2024-02-15T22:41:17.092 INFO:tasks.workunit.client.1.smithi082.stdout:9/580: readlink d8/d12/d33/d64/l91 0 2024-02-15T22:41:17.094 INFO:tasks.workunit.client.1.smithi082.stdout:9/581: truncate d8/d24/d2e/f46 3967042 0 2024-02-15T22:41:17.100 INFO:tasks.workunit.client.1.smithi082.stdout:4/728: dwrite d0/d16/f8b [0,4194304] 0 2024-02-15T22:41:17.100 INFO:tasks.workunit.client.1.smithi082.stdout:3/523: dwrite d0/d16/d62/fe [0,4194304] 0 2024-02-15T22:41:17.103 INFO:tasks.workunit.client.1.smithi082.stdout:3/524: link d0/d16/d62/d14/d21/d7d/f8e d0/d16/d62/d14/d71/fb3 0 2024-02-15T22:41:17.110 INFO:tasks.workunit.client.1.smithi082.stdout:4/729: write d0/d16/f8f [251794,80306] 0 2024-02-15T22:41:17.112 INFO:tasks.workunit.client.1.smithi082.stdout:3/525: truncate d0/d16/d62/fe 3484973 0 2024-02-15T22:41:17.112 INFO:tasks.workunit.client.1.smithi082.stdout:3/526: fdatasync d0/d16/d62/d14/d21/d7d/f9a 0 2024-02-15T22:41:17.113 INFO:tasks.workunit.client.1.smithi082.stdout:3/527: symlink d0/d16/d62/d14/d21/d69/d6c/lb4 0 2024-02-15T22:41:17.113 INFO:tasks.workunit.client.1.smithi082.stdout:3/528: write d0/fa9 [969070,60226] 0 2024-02-15T22:41:17.113 INFO:tasks.workunit.client.1.smithi082.stdout:3/529: fsync d0/d16/d62/f45 0 2024-02-15T22:41:17.113 INFO:tasks.workunit.client.1.smithi082.stdout:3/530: chown d0/d16/d62/d14/d71/c77 25 1 2024-02-15T22:41:17.114 INFO:tasks.workunit.client.1.smithi082.stdout:3/531: stat d0/d16/laa 0 2024-02-15T22:41:17.114 INFO:tasks.workunit.client.1.smithi082.stdout:9/582: dwrite d8/d12/d33/d64/d7c/f8f [4194304,4194304] 0 2024-02-15T22:41:17.114 INFO:tasks.workunit.client.1.smithi082.stdout:9/583: fsync d8/d24/fa6 0 2024-02-15T22:41:17.115 INFO:tasks.workunit.client.1.smithi082.stdout:3/532: creat d0/d16/d3e/d56/fb5 x:0 0 0 2024-02-15T22:41:17.117 INFO:tasks.workunit.client.1.smithi082.stdout:3/533: mknod d0/d16/d62/d14/d71/da2/cb6 0 2024-02-15T22:41:17.117 INFO:tasks.workunit.client.1.smithi082.stdout:3/534: dread - d0/d16/d62/d14/d21/fa5 zero size 2024-02-15T22:41:17.117 INFO:tasks.workunit.client.1.smithi082.stdout:3/535: dread - d0/dc/d3f/f78 zero size 2024-02-15T22:41:17.118 INFO:tasks.workunit.client.1.smithi082.stdout:3/536: dread d0/d16/d62/d14/f2a [0,4194304] 0 2024-02-15T22:41:17.118 INFO:tasks.workunit.client.1.smithi082.stdout:3/537: fdatasync d0/d16/d62/f9f 0 2024-02-15T22:41:17.123 INFO:tasks.workunit.client.1.smithi082.stdout:9/584: dread d8/f18 [4194304,4194304] 0 2024-02-15T22:41:17.123 INFO:tasks.workunit.client.1.smithi082.stdout:9/585: chown d8/d12/l50 0 1 2024-02-15T22:41:17.129 INFO:tasks.workunit.client.1.smithi082.stdout:3/538: rmdir d0 39 2024-02-15T22:41:17.131 INFO:tasks.workunit.client.1.smithi082.stdout:3/539: creat d0/d16/d62/d14/fb7 x:0 0 0 2024-02-15T22:41:17.131 INFO:tasks.workunit.client.1.smithi082.stdout:3/540: fsync d0/d16/d62/d14/d21/d69/d91/f96 0 2024-02-15T22:41:17.131 INFO:tasks.workunit.client.1.smithi082.stdout:3/541: symlink d0/d16/d62/d14/lb8 0 2024-02-15T22:41:17.140 INFO:tasks.workunit.client.1.smithi082.stdout:9/586: dwrite d8/d12/f90 [0,4194304] 0 2024-02-15T22:41:17.140 INFO:tasks.workunit.client.1.smithi082.stdout:9/587: creat d8/d12/d33/d64/daf/fb3 x:0 0 0 2024-02-15T22:41:17.140 INFO:tasks.workunit.client.1.smithi082.stdout:9/588: chown d8/d12/d33/l75 104504 1 2024-02-15T22:41:17.157 INFO:tasks.workunit.client.1.smithi082.stdout:6/649: sync 2024-02-15T22:41:17.157 INFO:tasks.workunit.client.1.smithi082.stdout:1/566: sync 2024-02-15T22:41:17.157 INFO:tasks.workunit.client.1.smithi082.stdout:6/650: dread - d2/d18/d23/d67/fa3 zero size 2024-02-15T22:41:17.157 INFO:tasks.workunit.client.1.smithi082.stdout:6/651: chown d2/d18/d23/c40 52506495 1 2024-02-15T22:41:17.157 INFO:tasks.workunit.client.1.smithi082.stdout:5/591: sync 2024-02-15T22:41:17.157 INFO:tasks.workunit.client.1.smithi082.stdout:5/592: chown d5/da/d56/f5b 942 1 2024-02-15T22:41:17.158 INFO:tasks.workunit.client.1.smithi082.stdout:3/542: dwrite d0/d16/d62/f25 [0,4194304] 0 2024-02-15T22:41:17.159 INFO:tasks.workunit.client.1.smithi082.stdout:1/567: symlink d1/da/d14/db4/lb5 0 2024-02-15T22:41:17.159 INFO:tasks.workunit.client.1.smithi082.stdout:1/568: readlink d1/da/d14/d18/d51/l9c 0 2024-02-15T22:41:17.159 INFO:tasks.workunit.client.1.smithi082.stdout:9/589: dwrite d8/d12/f69 [0,4194304] 0 2024-02-15T22:41:17.160 INFO:tasks.workunit.client.1.smithi082.stdout:9/590: truncate d8/f2c 2389692 0 2024-02-15T22:41:17.160 INFO:tasks.workunit.client.1.smithi082.stdout:9/591: stat d8/d12/d67/d70/f76 0 2024-02-15T22:41:17.161 INFO:tasks.workunit.client.1.smithi082.stdout:6/652: link d2/d18/d8a/f3d d2/d18/d8a/d65/fcf 0 2024-02-15T22:41:17.161 INFO:tasks.workunit.client.1.smithi082.stdout:7/605: sync 2024-02-15T22:41:17.161 INFO:tasks.workunit.client.1.smithi082.stdout:0/475: sync 2024-02-15T22:41:17.162 INFO:tasks.workunit.client.1.smithi082.stdout:6/653: write d2/d18/d8a/d47/f54 [539286,5184] 0 2024-02-15T22:41:17.162 INFO:tasks.workunit.client.1.smithi082.stdout:6/654: write d2/d18/d23/d67/fa3 [1001714,44631] 0 2024-02-15T22:41:17.163 INFO:tasks.workunit.client.1.smithi082.stdout:1/569: mkdir d1/da/d11/d93/db6 0 2024-02-15T22:41:17.167 INFO:tasks.workunit.client.1.smithi082.stdout:9/592: rename d8/d12/d30/f7e to d8/d12/d33/da4/dac/fb4 0 2024-02-15T22:41:17.168 INFO:tasks.workunit.client.1.smithi082.stdout:3/543: getdents d0/d16/d62/d14 0 2024-02-15T22:41:17.169 INFO:tasks.workunit.client.1.smithi082.stdout:3/544: rmdir d0/d16/d62 39 2024-02-15T22:41:17.170 INFO:tasks.workunit.client.1.smithi082.stdout:1/570: getdents d1/da/d14/d7f 0 2024-02-15T22:41:17.171 INFO:tasks.workunit.client.1.smithi082.stdout:1/571: creat d1/da/d14/d18/d1f/d2f/fb7 x:0 0 0 2024-02-15T22:41:17.171 INFO:tasks.workunit.client.1.smithi082.stdout:7/606: dread d12/d27/f2c [0,4194304] 0 2024-02-15T22:41:17.172 INFO:tasks.workunit.client.1.smithi082.stdout:9/593: getdents d8/d12/d67/d70/d97 0 2024-02-15T22:41:17.172 INFO:tasks.workunit.client.1.smithi082.stdout:9/594: write d8/d12/d33/d64/d77/dab/fae [837784,101979] 0 2024-02-15T22:41:17.173 INFO:tasks.workunit.client.1.smithi082.stdout:0/476: dread d3/d19/d5f/f63 [0,4194304] 0 2024-02-15T22:41:17.177 INFO:tasks.workunit.client.1.smithi082.stdout:1/572: mknod d1/da/d14/d18/d1f/d76/cb8 0 2024-02-15T22:41:17.177 INFO:tasks.workunit.client.1.smithi082.stdout:1/573: creat d1/da/d14/d18/d1f/d7a/fb9 x:0 0 0 2024-02-15T22:41:17.179 INFO:tasks.workunit.client.1.smithi082.stdout:5/593: dwrite d5/da/dc/dad/dcf/d59/f95 [0,4194304] 0 2024-02-15T22:41:17.180 INFO:tasks.workunit.client.1.smithi082.stdout:7/607: rename d12/d17/d3d/fc7 to d12/d27/d74/d8b/fc8 0 2024-02-15T22:41:17.180 INFO:tasks.workunit.client.1.smithi082.stdout:7/608: read f6 [166131,92136] 0 2024-02-15T22:41:17.183 INFO:tasks.workunit.client.1.smithi082.stdout:3/545: dread d0/d16/d62/f50 [0,4194304] 0 2024-02-15T22:41:17.188 INFO:tasks.workunit.client.1.smithi082.stdout:5/594: creat d5/da/dc/dad/dcf/d59/da3/fd3 x:0 0 0 2024-02-15T22:41:17.189 INFO:tasks.workunit.client.1.smithi082.stdout:7/609: link d12/d3b/f3f d12/d27/d6e/d6a/d9e/fc9 0 2024-02-15T22:41:17.190 INFO:tasks.workunit.client.1.smithi082.stdout:3/546: symlink d0/d16/d62/d2e/lb9 0 2024-02-15T22:41:17.191 INFO:tasks.workunit.client.1.smithi082.stdout:5/595: mknod d5/da/d56/d6e/cd4 0 2024-02-15T22:41:17.191 INFO:tasks.workunit.client.1.smithi082.stdout:5/596: chown d5/da/f26 721939 1 2024-02-15T22:41:17.192 INFO:tasks.workunit.client.1.smithi082.stdout:7/610: creat d12/d3b/d41/da6/fca x:0 0 0 2024-02-15T22:41:17.193 INFO:tasks.workunit.client.1.smithi082.stdout:7/611: write ff [1097458,18156] 0 2024-02-15T22:41:17.194 INFO:tasks.workunit.client.1.smithi082.stdout:3/547: symlink d0/d16/d3e/d56/db0/lba 0 2024-02-15T22:41:17.196 INFO:tasks.workunit.client.1.smithi082.stdout:3/548: unlink d0/d16/d62/d14/d71/fb3 0 2024-02-15T22:41:17.197 INFO:tasks.workunit.client.1.smithi082.stdout:7/612: dread d12/d27/f2c [0,4194304] 0 2024-02-15T22:41:17.197 INFO:tasks.workunit.client.1.smithi082.stdout:7/613: chown d12/d17/d3d/f55 112582 1 2024-02-15T22:41:17.197 INFO:tasks.workunit.client.1.smithi082.stdout:6/655: dwrite d2/d18/d23/f90 [0,4194304] 0 2024-02-15T22:41:17.197 INFO:tasks.workunit.client.1.smithi082.stdout:6/656: chown d2/d18/d8a/d65/fa8 300994196 1 2024-02-15T22:41:17.198 INFO:tasks.workunit.client.1.smithi082.stdout:6/657: stat d2/d18/d8a/d47/d69/d75/lb7 0 2024-02-15T22:41:17.198 INFO:tasks.workunit.client.1.smithi082.stdout:6/658: fsync d2/d18/d8a/f3d 0 2024-02-15T22:41:17.198 INFO:tasks.workunit.client.1.smithi082.stdout:7/614: mkdir d12/d27/d6e/d6a/d9e/dbe/dcb 0 2024-02-15T22:41:17.199 INFO:tasks.workunit.client.1.smithi082.stdout:7/615: stat d12/d17/d4d/d7d/fac 0 2024-02-15T22:41:17.199 INFO:tasks.workunit.client.1.smithi082.stdout:7/616: write d12/d37/f5b [470396,108808] 0 2024-02-15T22:41:17.199 INFO:tasks.workunit.client.1.smithi082.stdout:7/617: write d12/d37/d85/f90 [3913145,17692] 0 2024-02-15T22:41:17.199 INFO:tasks.workunit.client.1.smithi082.stdout:0/477: dwrite d3/f40 [0,4194304] 0 2024-02-15T22:41:17.200 INFO:tasks.workunit.client.1.smithi082.stdout:9/595: dwrite d8/d12/d33/d64/d7c/f8f [0,4194304] 0 2024-02-15T22:41:17.201 INFO:tasks.workunit.client.1.smithi082.stdout:7/618: truncate d12/f2d 1184011 0 2024-02-15T22:41:17.202 INFO:tasks.workunit.client.1.smithi082.stdout:0/478: unlink d3/d19/d20/c67 0 2024-02-15T22:41:17.203 INFO:tasks.workunit.client.1.smithi082.stdout:1/574: getdents d1/da/d14/d18/d1f/d76 0 2024-02-15T22:41:17.204 INFO:tasks.workunit.client.1.smithi082.stdout:0/479: write d3/d19/d5f/d92/f95 [458107,119102] 0 2024-02-15T22:41:17.206 INFO:tasks.workunit.client.1.smithi082.stdout:7/619: mkdir d12/d37/d85/dcc 0 2024-02-15T22:41:17.207 INFO:tasks.workunit.client.1.smithi082.stdout:1/575: mknod d1/da/d11/cba 0 2024-02-15T22:41:17.209 INFO:tasks.workunit.client.1.smithi082.stdout:0/480: mknod d3/d64/d71/ca6 0 2024-02-15T22:41:17.209 INFO:tasks.workunit.client.1.smithi082.stdout:0/481: stat d3/d19/d20/c3b 0 2024-02-15T22:41:17.210 INFO:tasks.workunit.client.1.smithi082.stdout:7/620: mknod d12/d27/d74/ccd 0 2024-02-15T22:41:17.210 INFO:tasks.workunit.client.1.smithi082.stdout:7/621: readlink d12/d17/d42/d67/d81/d91/da0/lb4 0 2024-02-15T22:41:17.210 INFO:tasks.workunit.client.1.smithi082.stdout:1/576: rmdir d1/da/d11/d93 39 2024-02-15T22:41:17.210 INFO:tasks.workunit.client.1.smithi082.stdout:1/577: dread - d1/da/d11/f82 zero size 2024-02-15T22:41:17.213 INFO:tasks.workunit.client.1.smithi082.stdout:0/482: creat d3/d19/d5f/da5/d99/fa7 x:0 0 0 2024-02-15T22:41:17.214 INFO:tasks.workunit.client.1.smithi082.stdout:3/549: dwrite d0/f43 [0,4194304] 0 2024-02-15T22:41:17.214 INFO:tasks.workunit.client.1.smithi082.stdout:7/622: unlink d12/d3b/fa9 0 2024-02-15T22:41:17.216 INFO:tasks.workunit.client.1.smithi082.stdout:6/659: dread d2/fad [0,4194304] 0 2024-02-15T22:41:17.216 INFO:tasks.workunit.client.1.smithi082.stdout:6/660: read - d2/d45/fb3 zero size 2024-02-15T22:41:17.216 INFO:tasks.workunit.client.1.smithi082.stdout:9/596: dread d8/d12/d33/f39 [0,4194304] 0 2024-02-15T22:41:17.218 INFO:tasks.workunit.client.1.smithi082.stdout:0/483: symlink d3/d6b/la8 0 2024-02-15T22:41:17.219 INFO:tasks.workunit.client.1.smithi082.stdout:1/578: read d1/da/d11/f9e [1709238,92143] 0 2024-02-15T22:41:17.219 INFO:tasks.workunit.client.1.smithi082.stdout:3/550: stat d0/d16/d62/d14/d21/f35 0 2024-02-15T22:41:17.223 INFO:tasks.workunit.client.1.smithi082.stdout:6/661: mkdir d2/d18/d8a/d47/d69/dd0 0 2024-02-15T22:41:17.223 INFO:tasks.workunit.client.1.smithi082.stdout:6/662: dread - d2/d45/fb3 zero size 2024-02-15T22:41:17.226 INFO:tasks.workunit.client.1.smithi082.stdout:9/597: write d8/d24/d2e/d56/f8a [4143587,60094] 0 2024-02-15T22:41:17.230 INFO:tasks.workunit.client.1.smithi082.stdout:0/484: getdents d3/d19/d20/d26 0 2024-02-15T22:41:17.232 INFO:tasks.workunit.client.1.smithi082.stdout:1/579: link d1/da/d11/f33 d1/da/d14/db4/fbb 0 2024-02-15T22:41:17.232 INFO:tasks.workunit.client.1.smithi082.stdout:3/551: truncate d0/d16/f12 4228603 0 2024-02-15T22:41:17.233 INFO:tasks.workunit.client.1.smithi082.stdout:3/552: readlink d0/d16/d3e/d56/l6a 0 2024-02-15T22:41:17.236 INFO:tasks.workunit.client.1.smithi082.stdout:9/598: mkdir d8/db5 0 2024-02-15T22:41:17.236 INFO:tasks.workunit.client.1.smithi082.stdout:9/599: chown d8/c95 261 1 2024-02-15T22:41:17.238 INFO:tasks.workunit.client.1.smithi082.stdout:7/623: rename d12/d3b/d41/da6 to d12/d3b/d5a/dce 0 2024-02-15T22:41:17.239 INFO:tasks.workunit.client.1.smithi082.stdout:9/600: rename d8/d24/d2e/d53/f8e to d8/d12/d33/d3e/fb6 0 2024-02-15T22:41:17.240 INFO:tasks.workunit.client.1.smithi082.stdout:7/624: symlink d12/d27/d6e/d6a/lcf 0 2024-02-15T22:41:17.242 INFO:tasks.workunit.client.1.smithi082.stdout:0/485: dread d3/f57 [0,4194304] 0 2024-02-15T22:41:17.242 INFO:tasks.workunit.client.1.smithi082.stdout:0/486: write d3/d19/f29 [1114926,87865] 0 2024-02-15T22:41:17.242 INFO:tasks.workunit.client.1.smithi082.stdout:0/487: creat d3/d19/d5f/da5/d99/fa9 x:0 0 0 2024-02-15T22:41:17.242 INFO:tasks.workunit.client.1.smithi082.stdout:9/601: creat d8/d12/d33/d3e/fb7 x:0 0 0 2024-02-15T22:41:17.243 INFO:tasks.workunit.client.1.smithi082.stdout:1/580: dread d1/da/d11/d3f/f46 [0,4194304] 0 2024-02-15T22:41:17.244 INFO:tasks.workunit.client.1.smithi082.stdout:0/488: rmdir d3/d19/d1c/d76 39 2024-02-15T22:41:17.244 INFO:tasks.workunit.client.1.smithi082.stdout:0/489: write d3/d19/f21 [5734028,89992] 0 2024-02-15T22:41:17.247 INFO:tasks.workunit.client.1.smithi082.stdout:0/490: dread d3/d64/f68 [0,4194304] 0 2024-02-15T22:41:17.257 INFO:tasks.workunit.client.1.smithi082.stdout:7/625: dwrite d12/d17/d3d/f40 [0,4194304] 0 2024-02-15T22:41:17.257 INFO:tasks.workunit.client.1.smithi082.stdout:7/626: truncate d12/d27/d74/d8b/fc8 520500 0 2024-02-15T22:41:17.301 INFO:tasks.workunit.client.1.smithi082.stdout:9/602: symlink d8/d24/d9e/lb8 0 2024-02-15T22:41:17.304 INFO:tasks.workunit.client.1.smithi082.stdout:1/581: creat d1/da/d14/d18/d6d/d89/fbc x:0 0 0 2024-02-15T22:41:17.305 INFO:tasks.workunit.client.1.smithi082.stdout:0/491: mknod d3/d19/d5f/da5/d99/caa 0 2024-02-15T22:41:17.306 INFO:tasks.workunit.client.1.smithi082.stdout:1/582: write d1/da/d14/db4/fbb [162125,55712] 0 2024-02-15T22:41:17.306 INFO:tasks.workunit.client.1.smithi082.stdout:1/583: truncate d1/da/d14/d18/d1f/d7a/fb9 227091 0 2024-02-15T22:41:17.306 INFO:tasks.workunit.client.1.smithi082.stdout:1/584: stat d1/da/d11/d3f/f46 0 2024-02-15T22:41:17.306 INFO:tasks.workunit.client.1.smithi082.stdout:1/585: chown d1/da/d14/d18/d51/f81 22872368 1 2024-02-15T22:41:17.309 INFO:tasks.workunit.client.1.smithi082.stdout:7/627: symlink d12/d27/d6e/d6a/d9e/ld0 0 2024-02-15T22:41:17.315 INFO:tasks.workunit.client.1.smithi082.stdout:9/603: unlink d8/d24/fa6 0 2024-02-15T22:41:17.317 INFO:tasks.workunit.client.1.smithi082.stdout:0/492: creat d3/d19/d25/fab x:0 0 0 2024-02-15T22:41:17.322 INFO:tasks.workunit.client.1.smithi082.stdout:7/628: creat d12/d27/d74/fd1 x:0 0 0 2024-02-15T22:41:17.322 INFO:tasks.workunit.client.1.smithi082.stdout:7/629: creat d12/d17/d42/d67/d79/fd2 x:0 0 0 2024-02-15T22:41:17.331 INFO:tasks.workunit.client.1.smithi082.stdout:7/630: truncate d12/d27/f6d 5730853 0 2024-02-15T22:41:17.331 INFO:tasks.workunit.client.1.smithi082.stdout:9/604: rmdir d8/d24/d2e/d53 39 2024-02-15T22:41:17.334 INFO:tasks.workunit.client.1.smithi082.stdout:7/631: rename d12/d27/d6e/d6a/d9e/fc9 to d12/d17/d42/d67/d81/d91/dbc/fd3 0 2024-02-15T22:41:17.336 INFO:tasks.workunit.client.1.smithi082.stdout:9/605: truncate d8/d24/d2e/f6d 481589 0 2024-02-15T22:41:17.338 INFO:tasks.workunit.client.1.smithi082.stdout:7/632: mknod d12/d17/d3d/cd4 0 2024-02-15T22:41:17.338 INFO:tasks.workunit.client.1.smithi082.stdout:7/633: fsync d12/d17/d42/d67/d81/d91/dbc/fc3 0 2024-02-15T22:41:17.339 INFO:tasks.workunit.client.1.smithi082.stdout:0/493: dwrite d3/d19/d1c/f65 [4194304,4194304] 0 2024-02-15T22:41:17.340 INFO:tasks.workunit.client.1.smithi082.stdout:7/634: getdents d12/d3b/d41 0 2024-02-15T22:41:17.343 INFO:tasks.workunit.client.1.smithi082.stdout:7/635: mkdir d12/d27/d6e/d6a/d9e/dbe/dcb/dd5 0 2024-02-15T22:41:17.347 INFO:tasks.workunit.client.1.smithi082.stdout:9/606: dread d8/d12/d33/f39 [0,4194304] 0 2024-02-15T22:41:17.354 INFO:tasks.workunit.client.1.smithi082.stdout:0/494: dread d3/f6 [0,4194304] 0 2024-02-15T22:41:17.355 INFO:tasks.workunit.client.1.smithi082.stdout:7/636: dread d12/d17/f1d [4194304,4194304] 0 2024-02-15T22:41:17.355 INFO:tasks.workunit.client.1.smithi082.stdout:7/637: write d12/d37/f5b [1406969,111366] 0 2024-02-15T22:41:17.357 INFO:tasks.workunit.client.1.smithi082.stdout:2/551: sync 2024-02-15T22:41:17.357 INFO:tasks.workunit.client.1.smithi082.stdout:8/557: sync 2024-02-15T22:41:17.357 INFO:tasks.workunit.client.1.smithi082.stdout:8/558: stat d1/d7/d9/d42/d6a/d8e/f9b 0 2024-02-15T22:41:17.358 INFO:tasks.workunit.client.1.smithi082.stdout:2/552: write d6/dc/d12/d46/d4b/d63/f9e [1257723,116421] 0 2024-02-15T22:41:17.358 INFO:tasks.workunit.client.1.smithi082.stdout:2/553: fsync d6/dc/d12/d23/d6e/f95 0 2024-02-15T22:41:17.358 INFO:tasks.workunit.client.1.smithi082.stdout:2/554: chown d6/dc/d58/l3f 134 1 2024-02-15T22:41:17.358 INFO:tasks.workunit.client.1.smithi082.stdout:9/607: write d8/f11 [7202963,58640] 0 2024-02-15T22:41:17.361 INFO:tasks.workunit.client.1.smithi082.stdout:7/638: rename d12/d17/c1e to d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/cd6 0 2024-02-15T22:41:17.366 INFO:tasks.workunit.client.1.smithi082.stdout:0/495: rmdir d3/d19/d25/d45 39 2024-02-15T22:41:17.373 INFO:tasks.workunit.client.1.smithi082.stdout:7/639: symlink d12/d17/d4d/d7d/ld7 0 2024-02-15T22:41:17.374 INFO:tasks.workunit.client.1.smithi082.stdout:7/640: mknod d12/d27/d74/d8b/cd8 0 2024-02-15T22:41:17.376 INFO:tasks.workunit.client.1.smithi082.stdout:9/608: write d8/f22 [1042898,102491] 0 2024-02-15T22:41:17.379 INFO:tasks.workunit.client.1.smithi082.stdout:9/609: truncate d8/d12/f90 3338237 0 2024-02-15T22:41:17.393 INFO:tasks.workunit.client.1.smithi082.stdout:2/555: dwrite d6/dc/dd/d1d/f50 [0,4194304] 0 2024-02-15T22:41:17.398 INFO:tasks.workunit.client.1.smithi082.stdout:8/559: dwrite d1/d7/d9/d42/d6a/f6c [0,4194304] 0 2024-02-15T22:41:17.398 INFO:tasks.workunit.client.1.smithi082.stdout:8/560: readlink d1/d7/d48/lbc 0 2024-02-15T22:41:17.399 INFO:tasks.workunit.client.1.smithi082.stdout:8/561: fdatasync d1/f4f 0 2024-02-15T22:41:17.399 INFO:tasks.workunit.client.1.smithi082.stdout:8/562: write d1/d7/d9/d24/d43/d85/fb2 [129690,52491] 0 2024-02-15T22:41:17.399 INFO:tasks.workunit.client.1.smithi082.stdout:8/563: write d1/f14 [4620701,82715] 0 2024-02-15T22:41:17.399 INFO:tasks.workunit.client.1.smithi082.stdout:8/564: chown d1/d7/c5e 5 1 2024-02-15T22:41:17.399 INFO:tasks.workunit.client.1.smithi082.stdout:0/496: dwrite d3/d64/d71/d91/f98 [0,4194304] 0 2024-02-15T22:41:17.399 INFO:tasks.workunit.client.1.smithi082.stdout:0/497: write d3/d19/d20/d26/f6a [1937840,38940] 0 2024-02-15T22:41:17.401 INFO:tasks.workunit.client.1.smithi082.stdout:8/565: rename d1/f23 to d1/d7/d9/d50/d56/dab/fc1 0 2024-02-15T22:41:17.406 INFO:tasks.workunit.client.1.smithi082.stdout:8/566: dread d1/d7/de/f2e [0,4194304] 0 2024-02-15T22:41:17.407 INFO:tasks.workunit.client.1.smithi082.stdout:8/567: truncate d1/d7/de/d1e/f20 311736 0 2024-02-15T22:41:17.410 INFO:tasks.workunit.client.1.smithi082.stdout:2/556: dread d6/d3c/f9d [0,4194304] 0 2024-02-15T22:41:17.410 INFO:tasks.workunit.client.1.smithi082.stdout:9/610: dwrite d8/d24/d2e/d56/f72 [0,4194304] 0 2024-02-15T22:41:17.412 INFO:tasks.workunit.client.1.smithi082.stdout:2/557: dread d6/dc/d12/d46/fa0 [0,4194304] 0 2024-02-15T22:41:17.415 INFO:tasks.workunit.client.1.smithi082.stdout:2/558: dread d6/dc/d12/d46/f8f [0,4194304] 0 2024-02-15T22:41:17.416 INFO:tasks.workunit.client.1.smithi082.stdout:2/559: truncate d6/dc/dd/d1d/f1f 4816428 0 2024-02-15T22:41:17.416 INFO:tasks.workunit.client.1.smithi082.stdout:8/568: dread d1/f18 [0,4194304] 0 2024-02-15T22:41:17.420 INFO:tasks.workunit.client.1.smithi082.stdout:2/560: creat d6/d18/faf x:0 0 0 2024-02-15T22:41:17.420 INFO:tasks.workunit.client.1.smithi082.stdout:2/561: write d6/dc/d58/d49/d5e/d67/fab [82131,113182] 0 2024-02-15T22:41:17.437 INFO:tasks.workunit.client.1.smithi082.stdout:0/498: dwrite d3/d19/d20/d26/f53 [0,4194304] 0 2024-02-15T22:41:17.437 INFO:tasks.workunit.client.1.smithi082.stdout:0/499: write d3/d19/d5f/da5/f6f [292831,32954] 0 2024-02-15T22:41:17.438 INFO:tasks.workunit.client.1.smithi082.stdout:0/500: dread - d3/d19/d20/f51 zero size 2024-02-15T22:41:17.438 INFO:tasks.workunit.client.1.smithi082.stdout:0/501: readlink d3/d19/d20/l22 0 2024-02-15T22:41:17.442 INFO:tasks.workunit.client.1.smithi082.stdout:9/611: dwrite d8/d24/f4b [0,4194304] 0 2024-02-15T22:41:17.443 INFO:tasks.workunit.client.1.smithi082.stdout:9/612: mknod d8/d12/d30/d3c/cb9 0 2024-02-15T22:41:17.443 INFO:tasks.workunit.client.1.smithi082.stdout:4/730: sync 2024-02-15T22:41:17.443 INFO:tasks.workunit.client.1.smithi082.stdout:4/731: write d0/d8/d1b/d70/f7f [2551164,13482] 0 2024-02-15T22:41:17.448 INFO:tasks.workunit.client.1.smithi082.stdout:8/569: dwrite d1/d7/d9/d24/d43/d85/fb2 [0,4194304] 0 2024-02-15T22:41:17.448 INFO:tasks.workunit.client.1.smithi082.stdout:8/570: readlink d1/d7/d9/d50/l63 0 2024-02-15T22:41:17.448 INFO:tasks.workunit.client.1.smithi082.stdout:9/613: rmdir d8/d24/d2e/d56 39 2024-02-15T22:41:17.450 INFO:tasks.workunit.client.1.smithi082.stdout:4/732: dread d0/d46/f5b [0,4194304] 0 2024-02-15T22:41:17.453 INFO:tasks.workunit.client.1.smithi082.stdout:8/571: mkdir d1/d7/d9/d42/d6a/dc2 0 2024-02-15T22:41:17.472 INFO:tasks.workunit.client.1.smithi082.stdout:0/502: dwrite d3/f57 [4194304,4194304] 0 2024-02-15T22:41:17.472 INFO:tasks.workunit.client.1.smithi082.stdout:9/614: dwrite d8/d24/d2e/d53/f59 [4194304,4194304] 0 2024-02-15T22:41:17.472 INFO:tasks.workunit.client.1.smithi082.stdout:9/615: chown d8/d12/d33/d64/d7c/d99 27068 1 2024-02-15T22:41:17.489 INFO:tasks.workunit.client.1.smithi082.stdout:0/503: dwrite d3/d19/d20/d26/f4e [0,4194304] 0 2024-02-15T22:41:17.489 INFO:tasks.workunit.client.1.smithi082.stdout:0/504: read - d3/d19/d5f/da5/d99/fa9 zero size 2024-02-15T22:41:17.491 INFO:tasks.workunit.client.1.smithi082.stdout:0/505: mkdir d3/d6b/dac 0 2024-02-15T22:41:17.493 INFO:tasks.workunit.client.1.smithi082.stdout:0/506: creat d3/d19/d5f/fad x:0 0 0 2024-02-15T22:41:17.495 INFO:tasks.workunit.client.1.smithi082.stdout:0/507: mknod d3/d6b/cae 0 2024-02-15T22:41:17.496 INFO:tasks.workunit.client.1.smithi082.stdout:0/508: creat d3/faf x:0 0 0 2024-02-15T22:41:17.497 INFO:tasks.workunit.client.1.smithi082.stdout:0/509: unlink d3/d19/d25/d45/f2a 0 2024-02-15T22:41:17.498 INFO:tasks.workunit.client.1.smithi082.stdout:0/510: creat d3/d19/d5f/da5/d9c/fb0 x:0 0 0 2024-02-15T22:41:17.500 INFO:tasks.workunit.client.1.smithi082.stdout:0/511: mkdir d3/d19/d5f/da5/d99/db1 0 2024-02-15T22:41:17.501 INFO:tasks.workunit.client.1.smithi082.stdout:0/512: rename d3/d19/d20/c3b to d3/d19/d1c/d76/cb2 0 2024-02-15T22:41:17.502 INFO:tasks.workunit.client.1.smithi082.stdout:0/513: chown d3/d6b/d7f 4786 1 2024-02-15T22:41:17.503 INFO:tasks.workunit.client.1.smithi082.stdout:0/514: mkdir d3/d19/d5f/da5/d99/db3 0 2024-02-15T22:41:17.506 INFO:tasks.workunit.client.1.smithi082.stdout:0/515: link d3/d19/d20/d26/f6a d3/d6b/dac/fb4 0 2024-02-15T22:41:17.519 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:17 smithi033 ceph-mon[29033]: pgmap v21: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 100 MiB/s wr, 551 op/s 2024-02-15T22:41:17.524 INFO:tasks.workunit.client.1.smithi082.stdout:0/516: dwrite d3/d19/f44 [0,4194304] 0 2024-02-15T22:41:17.524 INFO:tasks.workunit.client.1.smithi082.stdout:0/517: stat d3/d19/d5f/da5/d99/db1 0 2024-02-15T22:41:17.525 INFO:tasks.workunit.client.1.smithi082.stdout:0/518: write d3/d19/d5f/da5/d9c/fb0 [824552,65396] 0 2024-02-15T22:41:17.525 INFO:tasks.workunit.client.1.smithi082.stdout:0/519: truncate d3/d6b/d7f/f8d 592522 0 2024-02-15T22:41:17.526 INFO:tasks.workunit.client.1.smithi082.stdout:0/520: symlink d3/d19/lb5 0 2024-02-15T22:41:17.526 INFO:tasks.workunit.client.1.smithi082.stdout:0/521: creat d3/d19/fb6 x:0 0 0 2024-02-15T22:41:17.526 INFO:tasks.workunit.client.1.smithi082.stdout:0/522: chown d3/d19/d5f/da5/f6f 735530535 1 2024-02-15T22:41:17.530 INFO:tasks.workunit.client.1.smithi082.stdout:0/523: getdents d3/d19/d1c/d76 0 2024-02-15T22:41:17.530 INFO:tasks.workunit.client.1.smithi082.stdout:0/524: chown d3/d6b/dac/fb4 3968 1 2024-02-15T22:41:17.532 INFO:tasks.workunit.client.1.smithi082.stdout:0/525: dread d3/f15 [0,4194304] 0 2024-02-15T22:41:17.532 INFO:tasks.workunit.client.1.smithi082.stdout:0/526: fdatasync d3/d19/d20/d26/f89 0 2024-02-15T22:41:17.533 INFO:tasks.workunit.client.1.smithi082.stdout:0/527: creat d3/d19/d93/fb7 x:0 0 0 2024-02-15T22:41:17.535 INFO:tasks.workunit.client.1.smithi082.stdout:0/528: rename d3/d19/d25/d80/f8f to d3/d64/d71/d91/fb8 0 2024-02-15T22:41:17.535 INFO:tasks.workunit.client.1.smithi082.stdout:0/529: dread - d3/d19/d1c/d6d/f72 zero size 2024-02-15T22:41:17.535 INFO:tasks.workunit.client.1.smithi082.stdout:0/530: chown d3/d19/d5f/da5/d99 42821657 1 2024-02-15T22:41:17.538 INFO:tasks.workunit.client.1.smithi082.stdout:0/531: dread d3/d19/f58 [0,4194304] 0 2024-02-15T22:41:17.539 INFO:tasks.workunit.client.1.smithi082.stdout:0/532: symlink d3/d19/d93/lb9 0 2024-02-15T22:41:17.539 INFO:tasks.workunit.client.1.smithi082.stdout:0/533: write d3/d19/d5f/da5/f8a [480422,75725] 0 2024-02-15T22:41:17.539 INFO:tasks.workunit.client.1.smithi082.stdout:0/534: stat d3/d19/l5e 0 2024-02-15T22:41:17.548 INFO:tasks.workunit.client.1.smithi082.stdout:0/535: dread d3/fd [0,4194304] 0 2024-02-15T22:41:17.548 INFO:tasks.workunit.client.1.smithi082.stdout:0/536: stat d3/d19/d5f/d92/f95 0 2024-02-15T22:41:17.548 INFO:tasks.workunit.client.1.smithi082.stdout:0/537: write d3/f34 [244430,112335] 0 2024-02-15T22:41:17.551 INFO:tasks.workunit.client.1.smithi082.stdout:0/538: write d3/d19/f24 [1050413,23304] 0 2024-02-15T22:41:17.560 INFO:tasks.workunit.client.1.smithi082.stdout:0/539: write d3/d19/f44 [1716967,119163] 0 2024-02-15T22:41:17.561 INFO:tasks.workunit.client.1.smithi082.stdout:0/540: creat d3/d6b/d7f/fba x:0 0 0 2024-02-15T22:41:17.561 INFO:tasks.workunit.client.1.smithi082.stdout:0/541: fdatasync d3/d64/d71/d91/f7a 0 2024-02-15T22:41:17.562 INFO:tasks.workunit.client.1.smithi082.stdout:0/542: rename d3/c3e to d3/d19/d20/d7c/cbb 0 2024-02-15T22:41:17.562 INFO:tasks.workunit.client.1.smithi082.stdout:0/543: fdatasync d3/d19/d5f/fad 0 2024-02-15T22:41:17.562 INFO:tasks.workunit.client.1.smithi082.stdout:0/544: chown d3/d19/d1c/l81 3003 1 2024-02-15T22:41:17.563 INFO:tasks.workunit.client.1.smithi082.stdout:0/545: chown d3/fa 203930 1 2024-02-15T22:41:17.567 INFO:tasks.workunit.client.1.smithi082.stdout:0/546: getdents d3 0 2024-02-15T22:41:17.575 INFO:tasks.workunit.client.1.smithi082.stdout:0/547: rename d3/d64/d71/d91 to d3/d19/d5f/da0/dbc 0 2024-02-15T22:41:17.576 INFO:tasks.workunit.client.1.smithi082.stdout:0/548: link d3/d19/d5f/f96 d3/d19/d5f/da5/d99/db1/fbd 0 2024-02-15T22:41:17.583 INFO:tasks.workunit.client.1.smithi082.stdout:0/549: dread d3/fe [4194304,4194304] 0 2024-02-15T22:41:17.587 INFO:tasks.workunit.client.1.smithi082.stdout:0/550: dread d3/f12 [0,4194304] 0 2024-02-15T22:41:17.600 INFO:tasks.workunit.client.1.smithi082.stdout:0/551: dwrite d3/d19/d1c/f52 [0,4194304] 0 2024-02-15T22:41:17.602 INFO:tasks.workunit.client.1.smithi082.stdout:0/552: mkdir d3/d19/d93/dbe 0 2024-02-15T22:41:17.602 INFO:tasks.workunit.client.1.smithi082.stdout:0/553: write d3/d19/d20/d26/f6a [4435791,45183] 0 2024-02-15T22:41:17.602 INFO:tasks.workunit.client.1.smithi082.stdout:0/554: getdents d3/d19/d5f/da5 0 2024-02-15T22:41:17.603 INFO:tasks.workunit.client.1.smithi082.stdout:0/555: fsync d3/d19/d5f/da5/f90 0 2024-02-15T22:41:17.604 INFO:tasks.workunit.client.1.smithi082.stdout:0/556: dread d3/d64/f68 [0,4194304] 0 2024-02-15T22:41:17.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:17 smithi082 ceph-mon[37153]: pgmap v21: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 100 MiB/s wr, 551 op/s 2024-02-15T22:41:17.629 INFO:tasks.workunit.client.1.smithi082.stdout:5/597: sync 2024-02-15T22:41:17.629 INFO:tasks.workunit.client.1.smithi082.stdout:6/663: sync 2024-02-15T22:41:17.629 INFO:tasks.workunit.client.1.smithi082.stdout:6/664: mknod d2/d18/d39/cd1 0 2024-02-15T22:41:17.629 INFO:tasks.workunit.client.1.smithi082.stdout:6/665: write d2/d18/d8a/d47/d72/f9f [642808,17073] 0 2024-02-15T22:41:17.630 INFO:tasks.workunit.client.1.smithi082.stdout:6/666: creat d2/d18/fd2 x:0 0 0 2024-02-15T22:41:17.631 INFO:tasks.workunit.client.1.smithi082.stdout:6/667: getdents d2/d18/d8a/d47/d72/d80 0 2024-02-15T22:41:17.637 INFO:tasks.workunit.client.1.smithi082.stdout:5/598: write d5/da/dc/ff [3174480,56208] 0 2024-02-15T22:41:17.637 INFO:tasks.workunit.client.1.smithi082.stdout:5/599: readlink d5/da/dc/dad/dcf/d59/l6a 0 2024-02-15T22:41:17.637 INFO:tasks.workunit.client.1.smithi082.stdout:5/600: dread - d5/da/d67/fb0 zero size 2024-02-15T22:41:17.639 INFO:tasks.workunit.client.1.smithi082.stdout:5/601: mkdir d5/da/dc/dd5 0 2024-02-15T22:41:17.640 INFO:tasks.workunit.client.1.smithi082.stdout:5/602: write d5/da/dc/d43/fbe [210399,38500] 0 2024-02-15T22:41:17.642 INFO:tasks.workunit.client.1.smithi082.stdout:5/603: rename d5/da/dc/c48 to d5/da/d67/cd6 0 2024-02-15T22:41:17.642 INFO:tasks.workunit.client.1.smithi082.stdout:5/604: write d5/f4b [3115077,8962] 0 2024-02-15T22:41:17.644 INFO:tasks.workunit.client.1.smithi082.stdout:5/605: symlink d5/da/dc/dd5/ld7 0 2024-02-15T22:41:17.644 INFO:tasks.workunit.client.1.smithi082.stdout:5/606: readlink d5/da/dc/dad/dcf/lb2 0 2024-02-15T22:41:17.644 INFO:tasks.workunit.client.1.smithi082.stdout:5/607: mkdir d5/dd8 0 2024-02-15T22:41:17.646 INFO:tasks.workunit.client.1.smithi082.stdout:5/608: rename d5/da/d56/d98/fcb to d5/da/dc/dad/fd9 0 2024-02-15T22:41:17.660 INFO:tasks.workunit.client.1.smithi082.stdout:5/609: dwrite d5/da/f1c [0,4194304] 0 2024-02-15T22:41:17.661 INFO:tasks.workunit.client.1.smithi082.stdout:5/610: dread - d5/da/dc/dad/dcf/d59/d84/d89/f9c zero size 2024-02-15T22:41:17.672 INFO:tasks.workunit.client.1.smithi082.stdout:5/611: read d5/da/dc/dad/dcf/d59/d84/d89/fba [3138382,54011] 0 2024-02-15T22:41:17.672 INFO:tasks.workunit.client.1.smithi082.stdout:5/612: creat d5/da/d67/da0/d92/fda x:0 0 0 2024-02-15T22:41:17.678 INFO:tasks.workunit.client.1.smithi082.stdout:5/613: dread d5/f4b [0,4194304] 0 2024-02-15T22:41:17.691 INFO:tasks.workunit.client.1.smithi082.stdout:5/614: dwrite d5/da/d56/f8d [0,4194304] 0 2024-02-15T22:41:17.693 INFO:tasks.workunit.client.1.smithi082.stdout:5/615: mkdir d5/da/d56/d98/ddb 0 2024-02-15T22:41:17.695 INFO:tasks.workunit.client.1.smithi082.stdout:5/616: getdents d5 0 2024-02-15T22:41:17.695 INFO:tasks.workunit.client.1.smithi082.stdout:5/617: read d5/da/dc/dad/dcf/d59/d84/d89/faf [609986,3266] 0 2024-02-15T22:41:17.696 INFO:tasks.workunit.client.1.smithi082.stdout:5/618: creat d5/da/dc/fdc x:0 0 0 2024-02-15T22:41:17.696 INFO:tasks.workunit.client.1.smithi082.stdout:5/619: chown d5/da/d56/d6e/d73/fb3 10289 1 2024-02-15T22:41:17.702 INFO:tasks.workunit.client.1.smithi082.stdout:5/620: dread d5/da/d14/d45/f6b [4194304,4194304] 0 2024-02-15T22:41:17.704 INFO:tasks.workunit.client.1.smithi082.stdout:5/621: dread d5/da/f40 [0,4194304] 0 2024-02-15T22:41:17.704 INFO:tasks.workunit.client.1.smithi082.stdout:5/622: symlink d5/da/dc/dad/dcf/d59/ldd 0 2024-02-15T22:41:17.706 INFO:tasks.workunit.client.1.smithi082.stdout:5/623: rename d5/da/d56/d6e/d73 to d5/da/d67/da0/dde 0 2024-02-15T22:41:17.706 INFO:tasks.workunit.client.1.smithi082.stdout:5/624: write d5/da/dc/f3d [301992,105279] 0 2024-02-15T22:41:17.715 INFO:tasks.workunit.client.1.smithi082.stdout:5/625: write d5/da/dc/dad/fb8 [3042160,22992] 0 2024-02-15T22:41:17.740 INFO:tasks.workunit.client.1.smithi082.stdout:5/626: dwrite d5/da/dc/f3d [0,4194304] 0 2024-02-15T22:41:17.742 INFO:tasks.workunit.client.1.smithi082.stdout:7/641: sync 2024-02-15T22:41:17.742 INFO:tasks.workunit.client.1.smithi082.stdout:1/586: sync 2024-02-15T22:41:17.742 INFO:tasks.workunit.client.1.smithi082.stdout:3/553: sync 2024-02-15T22:41:17.742 INFO:tasks.workunit.client.1.smithi082.stdout:1/587: fdatasync d1/da/d14/d18/d51/f59 0 2024-02-15T22:41:17.743 INFO:tasks.workunit.client.1.smithi082.stdout:1/588: dread d1/da/d14/d18/d6d/f6f [0,4194304] 0 2024-02-15T22:41:17.743 INFO:tasks.workunit.client.1.smithi082.stdout:3/554: creat d0/dc/d3f/fbb x:0 0 0 2024-02-15T22:41:17.744 INFO:tasks.workunit.client.1.smithi082.stdout:7/642: creat d12/d27/d6e/d6a/d9e/dbe/dcb/fd9 x:0 0 0 2024-02-15T22:41:17.744 INFO:tasks.workunit.client.1.smithi082.stdout:3/555: dread d0/d16/d62/f7e [0,4194304] 0 2024-02-15T22:41:17.744 INFO:tasks.workunit.client.1.smithi082.stdout:1/589: mknod d1/da/d14/d18/d1f/d76/cbd 0 2024-02-15T22:41:17.744 INFO:tasks.workunit.client.1.smithi082.stdout:1/590: stat d1/f3d 0 2024-02-15T22:41:17.745 INFO:tasks.workunit.client.1.smithi082.stdout:7/643: getdents d12/d27/d6e/d6a/d9e 0 2024-02-15T22:41:17.746 INFO:tasks.workunit.client.1.smithi082.stdout:7/644: mkdir d12/d27/dc2/dda 0 2024-02-15T22:41:17.746 INFO:tasks.workunit.client.1.smithi082.stdout:7/645: readlink d12/d3b/d5a/l8f 0 2024-02-15T22:41:17.746 INFO:tasks.workunit.client.1.smithi082.stdout:7/646: symlink d12/d27/d74/da2/ldb 0 2024-02-15T22:41:17.750 INFO:tasks.workunit.client.1.smithi082.stdout:5/627: dread d5/da/d14/f75 [0,4194304] 0 2024-02-15T22:41:17.756 INFO:tasks.workunit.client.1.smithi082.stdout:7/647: write d12/d17/f19 [1397151,83729] 0 2024-02-15T22:41:17.767 INFO:tasks.workunit.client.1.smithi082.stdout:3/556: dwrite d0/d16/d62/d14/d21/d7d/f83 [0,4194304] 0 2024-02-15T22:41:17.778 INFO:tasks.workunit.client.1.smithi082.stdout:7/648: dwrite d12/d27/d6e/d6a/d9e/dbe/dcb/fd9 [0,4194304] 0 2024-02-15T22:41:17.778 INFO:tasks.workunit.client.1.smithi082.stdout:3/557: dread d0/d16/d62/d14/d21/d7d/f83 [0,4194304] 0 2024-02-15T22:41:17.778 INFO:tasks.workunit.client.1.smithi082.stdout:7/649: chown d12/d17/d42/d67/d79/f96 1855417196 1 2024-02-15T22:41:17.779 INFO:tasks.workunit.client.1.smithi082.stdout:3/558: readlink d0/d16/d62/d2e/d84/l80 0 2024-02-15T22:41:17.779 INFO:tasks.workunit.client.1.smithi082.stdout:7/650: truncate d12/d3b/d41/f60 547313 0 2024-02-15T22:41:17.779 INFO:tasks.workunit.client.1.smithi082.stdout:1/591: dwrite d1/da/d14/d18/f2b [0,4194304] 0 2024-02-15T22:41:17.780 INFO:tasks.workunit.client.1.smithi082.stdout:3/559: mknod d0/d16/d62/cbc 0 2024-02-15T22:41:17.780 INFO:tasks.workunit.client.1.smithi082.stdout:7/651: rmdir d12/d3b/d5a/dce 39 2024-02-15T22:41:17.784 INFO:tasks.workunit.client.1.smithi082.stdout:1/592: creat d1/da/d14/d18/fbe x:0 0 0 2024-02-15T22:41:17.784 INFO:tasks.workunit.client.1.smithi082.stdout:7/652: truncate d12/d17/d42/f87 3069156 0 2024-02-15T22:41:17.785 INFO:tasks.workunit.client.1.smithi082.stdout:1/593: creat d1/da/d11/d93/fbf x:0 0 0 2024-02-15T22:41:17.786 INFO:tasks.workunit.client.1.smithi082.stdout:7/653: mknod d12/d27/d6e/cdc 0 2024-02-15T22:41:17.786 INFO:tasks.workunit.client.1.smithi082.stdout:1/594: mknod d1/da/d11/cc0 0 2024-02-15T22:41:17.787 INFO:tasks.workunit.client.1.smithi082.stdout:7/654: mknod d12/d27/d6e/d6a/d9e/cdd 0 2024-02-15T22:41:17.787 INFO:tasks.workunit.client.1.smithi082.stdout:7/655: dread - d12/d17/d42/d67/d81/d91/dbc/fc3 zero size 2024-02-15T22:41:17.790 INFO:tasks.workunit.client.1.smithi082.stdout:7/656: read d12/d3b/f89 [819368,46349] 0 2024-02-15T22:41:17.791 INFO:tasks.workunit.client.1.smithi082.stdout:7/657: rmdir d12/d17/d42/d67/d81/d91/dbc 39 2024-02-15T22:41:17.804 INFO:tasks.workunit.client.1.smithi082.stdout:1/595: dread d1/da/d11/d3f/d75/f78 [0,4194304] 0 2024-02-15T22:41:17.805 INFO:tasks.workunit.client.1.smithi082.stdout:3/560: dwrite d0/d16/d62/f45 [4194304,4194304] 0 2024-02-15T22:41:17.805 INFO:tasks.workunit.client.1.smithi082.stdout:1/596: symlink d1/da/d14/d18/d6d/lc1 0 2024-02-15T22:41:17.807 INFO:tasks.workunit.client.1.smithi082.stdout:7/658: dwrite d12/d17/d42/d67/d79/fd2 [0,4194304] 0 2024-02-15T22:41:17.809 INFO:tasks.workunit.client.1.smithi082.stdout:1/597: mkdir d1/da/d14/d18/d6d/dc2 0 2024-02-15T22:41:17.809 INFO:tasks.workunit.client.1.smithi082.stdout:1/598: chown d1/f3d 3 1 2024-02-15T22:41:17.810 INFO:tasks.workunit.client.1.smithi082.stdout:7/659: dread d12/d3b/d41/f88 [0,4194304] 0 2024-02-15T22:41:17.810 INFO:tasks.workunit.client.1.smithi082.stdout:7/660: creat d12/d27/d74/fde x:0 0 0 2024-02-15T22:41:17.810 INFO:tasks.workunit.client.1.smithi082.stdout:7/661: chown d12 134 1 2024-02-15T22:41:17.810 INFO:tasks.workunit.client.1.smithi082.stdout:7/662: stat d12/d17/d3d 0 2024-02-15T22:41:17.815 INFO:tasks.workunit.client.1.smithi082.stdout:1/599: truncate d1/f74 2290480 0 2024-02-15T22:41:17.818 INFO:tasks.workunit.client.1.smithi082.stdout:3/561: rename d0/dc/f20 to d0/dc/fbd 0 2024-02-15T22:41:17.823 INFO:tasks.workunit.client.1.smithi082.stdout:4/733: sync 2024-02-15T22:41:17.823 INFO:tasks.workunit.client.1.smithi082.stdout:2/562: sync 2024-02-15T22:41:17.823 INFO:tasks.workunit.client.1.smithi082.stdout:4/734: chown d0/d16/d4a/d6a/c71 7929189 1 2024-02-15T22:41:17.823 INFO:tasks.workunit.client.1.smithi082.stdout:4/735: stat d0/d16/d87/da2 0 2024-02-15T22:41:17.824 INFO:tasks.workunit.client.1.smithi082.stdout:2/563: creat d6/dc/d12/d46/d4b/d63/fb0 x:0 0 0 2024-02-15T22:41:17.824 INFO:tasks.workunit.client.1.smithi082.stdout:2/564: chown d6/dc/d12/d46/ca8 69062809 1 2024-02-15T22:41:17.824 INFO:tasks.workunit.client.1.smithi082.stdout:2/565: chown d6/fad 38 1 2024-02-15T22:41:17.828 INFO:tasks.workunit.client.1.smithi082.stdout:2/566: dread d6/d18/f75 [0,4194304] 0 2024-02-15T22:41:17.832 INFO:tasks.workunit.client.1.smithi082.stdout:3/562: dread d0/d16/d62/f25 [4194304,4194304] 0 2024-02-15T22:41:17.832 INFO:tasks.workunit.client.1.smithi082.stdout:3/563: read d0/d16/d62/d14/d71/da2/f7f [151,34574] 0 2024-02-15T22:41:17.832 INFO:tasks.workunit.client.1.smithi082.stdout:7/663: dwrite d12/d17/d42/f87 [0,4194304] 0 2024-02-15T22:41:17.832 INFO:tasks.workunit.client.1.smithi082.stdout:7/664: dread - d12/d17/f5e zero size 2024-02-15T22:41:17.832 INFO:tasks.workunit.client.1.smithi082.stdout:3/564: mkdir d0/d16/d62/d14/d21/d69/dbe 0 2024-02-15T22:41:17.833 INFO:tasks.workunit.client.1.smithi082.stdout:3/565: dread - d0/d16/d3e/d56/fb5 zero size 2024-02-15T22:41:17.833 INFO:tasks.workunit.client.1.smithi082.stdout:3/566: truncate d0/d16/d62/f31 590850 0 2024-02-15T22:41:17.837 INFO:tasks.workunit.client.1.smithi082.stdout:1/600: dwrite d1/da/d11/d93/fbf [0,4194304] 0 2024-02-15T22:41:17.842 INFO:tasks.workunit.client.1.smithi082.stdout:1/601: creat d1/da/d14/d18/d1f/d76/fc3 x:0 0 0 2024-02-15T22:41:17.842 INFO:tasks.workunit.client.1.smithi082.stdout:1/602: write d1/da/d14/d18/fbe [851076,37801] 0 2024-02-15T22:41:17.843 INFO:tasks.workunit.client.1.smithi082.stdout:7/665: dread d12/d37/d85/f90 [0,4194304] 0 2024-02-15T22:41:17.844 INFO:tasks.workunit.client.1.smithi082.stdout:1/603: unlink d1/d57/f88 0 2024-02-15T22:41:17.845 INFO:tasks.workunit.client.1.smithi082.stdout:7/666: rename d12/d17/c29 to d12/d27/d6e/d6a/cdf 0 2024-02-15T22:41:17.845 INFO:tasks.workunit.client.1.smithi082.stdout:1/604: getdents d1/da/d14/d18/d51 0 2024-02-15T22:41:17.847 INFO:tasks.workunit.client.1.smithi082.stdout:1/605: creat d1/da/d14/d18/d51/fc4 x:0 0 0 2024-02-15T22:41:17.847 INFO:tasks.workunit.client.1.smithi082.stdout:3/567: dwrite d0/dc/f51 [0,4194304] 0 2024-02-15T22:41:17.848 INFO:tasks.workunit.client.1.smithi082.stdout:1/606: mkdir d1/da/d11/d93/db6/dc5 0 2024-02-15T22:41:17.849 INFO:tasks.workunit.client.1.smithi082.stdout:3/568: mknod d0/d16/d62/d14/d71/cbf 0 2024-02-15T22:41:17.850 INFO:tasks.workunit.client.1.smithi082.stdout:1/607: link d1/da/d11/d3f/f5e d1/fc6 0 2024-02-15T22:41:17.851 INFO:tasks.workunit.client.1.smithi082.stdout:1/608: mkdir d1/da/d11/d8c/dc7 0 2024-02-15T22:41:17.851 INFO:tasks.workunit.client.1.smithi082.stdout:1/609: getdents d1/da/d14/d18/d6d/dc2 0 2024-02-15T22:41:17.852 INFO:tasks.workunit.client.1.smithi082.stdout:3/569: dread d0/d16/d62/f25 [4194304,4194304] 0 2024-02-15T22:41:17.853 INFO:tasks.workunit.client.1.smithi082.stdout:3/570: write d0/d16/d62/d14/d21/d69/f82 [946220,21573] 0 2024-02-15T22:41:17.853 INFO:tasks.workunit.client.1.smithi082.stdout:3/571: readlink d0/d16/d62/d14/lb8 0 2024-02-15T22:41:17.856 INFO:tasks.workunit.client.1.smithi082.stdout:3/572: dread d0/d16/d62/d14/d21/d7d/f83 [0,4194304] 0 2024-02-15T22:41:17.856 INFO:tasks.workunit.client.1.smithi082.stdout:7/667: dread d12/d17/f1d [0,4194304] 0 2024-02-15T22:41:17.856 INFO:tasks.workunit.client.1.smithi082.stdout:3/573: mknod d0/d16/d62/d14/d71/da2/cc0 0 2024-02-15T22:41:17.859 INFO:tasks.workunit.client.1.smithi082.stdout:3/574: rename d0/d16/d3e/c52 to d0/d16/d62/d14/d21/cc1 0 2024-02-15T22:41:17.860 INFO:tasks.workunit.client.1.smithi082.stdout:1/610: dread d1/f4 [0,4194304] 0 2024-02-15T22:41:17.861 INFO:tasks.workunit.client.1.smithi082.stdout:1/611: chown d1/da/d11/ca8 1 1 2024-02-15T22:41:17.861 INFO:tasks.workunit.client.1.smithi082.stdout:3/575: rename d0/d16/d3e/c95 to d0/dc/d3f/cc2 0 2024-02-15T22:41:17.861 INFO:tasks.workunit.client.1.smithi082.stdout:3/576: chown d0/fa9 3 1 2024-02-15T22:41:17.863 INFO:tasks.workunit.client.1.smithi082.stdout:7/668: getdents d12/d17 0 2024-02-15T22:41:17.864 INFO:tasks.workunit.client.1.smithi082.stdout:7/669: link d12/d37/l4f d12/d17/d42/d67/d81/le0 0 2024-02-15T22:41:17.866 INFO:tasks.workunit.client.1.smithi082.stdout:3/577: getdents d0/d16/d62/d14/d71 0 2024-02-15T22:41:17.867 INFO:tasks.workunit.client.1.smithi082.stdout:3/578: mknod d0/d16/d3e/cc3 0 2024-02-15T22:41:17.867 INFO:tasks.workunit.client.1.smithi082.stdout:3/579: chown d0/d16/d62/d14/d21/d69/d91/fa1 1841 1 2024-02-15T22:41:17.873 INFO:tasks.workunit.client.1.smithi082.stdout:7/670: dread d12/d37/f70 [0,4194304] 0 2024-02-15T22:41:17.875 INFO:tasks.workunit.client.1.smithi082.stdout:7/671: symlink d12/d27/d6e/d6a/d9e/dbe/dcb/le1 0 2024-02-15T22:41:17.875 INFO:tasks.workunit.client.1.smithi082.stdout:7/672: readlink d12/d27/d74/d8b/lb8 0 2024-02-15T22:41:17.876 INFO:tasks.workunit.client.1.smithi082.stdout:7/673: creat d12/d37/dbd/fe2 x:0 0 0 2024-02-15T22:41:17.876 INFO:tasks.workunit.client.1.smithi082.stdout:7/674: readlink d12/d17/d42/d67/d79/l7e 0 2024-02-15T22:41:17.877 INFO:tasks.workunit.client.1.smithi082.stdout:7/675: unlink d12/d27/d33/c49 0 2024-02-15T22:41:17.886 INFO:tasks.workunit.client.1.smithi082.stdout:1/612: dwrite d1/d57/f94 [0,4194304] 0 2024-02-15T22:41:17.886 INFO:tasks.workunit.client.1.smithi082.stdout:3/580: dwrite d0/d16/d62/d14/d71/fac [0,4194304] 0 2024-02-15T22:41:17.894 INFO:tasks.workunit.client.1.smithi082.stdout:3/581: rename d0/d16/d62/d2e/d8d to d0/dc/d3f/dc4 0 2024-02-15T22:41:17.895 INFO:tasks.workunit.client.1.smithi082.stdout:1/613: mkdir d1/dc8 0 2024-02-15T22:41:17.897 INFO:tasks.workunit.client.1.smithi082.stdout:3/582: mkdir d0/d16/d3e/dc5 0 2024-02-15T22:41:17.898 INFO:tasks.workunit.client.1.smithi082.stdout:9/616: sync 2024-02-15T22:41:17.898 INFO:tasks.workunit.client.1.smithi082.stdout:8/572: sync 2024-02-15T22:41:17.898 INFO:tasks.workunit.client.1.smithi082.stdout:6/668: sync 2024-02-15T22:41:17.898 INFO:tasks.workunit.client.1.smithi082.stdout:8/573: stat d1/d7/c1a 0 2024-02-15T22:41:17.899 INFO:tasks.workunit.client.1.smithi082.stdout:1/614: mkdir d1/da/d14/d18/d6d/dc9 0 2024-02-15T22:41:17.899 INFO:tasks.workunit.client.1.smithi082.stdout:1/615: creat d1/da/d14/fca x:0 0 0 2024-02-15T22:41:17.899 INFO:tasks.workunit.client.1.smithi082.stdout:0/557: sync 2024-02-15T22:41:17.900 INFO:tasks.workunit.client.1.smithi082.stdout:3/583: mknod d0/d16/d62/d14/cc6 0 2024-02-15T22:41:17.900 INFO:tasks.workunit.client.1.smithi082.stdout:3/584: write d0/d16/f97 [1184556,60996] 0 2024-02-15T22:41:17.902 INFO:tasks.workunit.client.1.smithi082.stdout:9/617: rename d8/d12/f89 to d8/d12/d30/d3c/d71/fba 0 2024-02-15T22:41:17.902 INFO:tasks.workunit.client.1.smithi082.stdout:9/618: chown d8/d12/d33/d3e/fb7 2184051 1 2024-02-15T22:41:17.902 INFO:tasks.workunit.client.1.smithi082.stdout:9/619: stat d8/d12/d33/d64/d8b/d96/la8 0 2024-02-15T22:41:17.902 INFO:tasks.workunit.client.1.smithi082.stdout:9/620: fsync d8/d24/d2e/d56/f60 0 2024-02-15T22:41:17.904 INFO:tasks.workunit.client.1.smithi082.stdout:8/574: getdents d1/d7/d9/d24/d43/da6 0 2024-02-15T22:41:17.906 INFO:tasks.workunit.client.1.smithi082.stdout:1/616: creat d1/dc8/fcb x:0 0 0 2024-02-15T22:41:17.907 INFO:tasks.workunit.client.1.smithi082.stdout:0/558: mknod d3/d19/d5f/cbf 0 2024-02-15T22:41:17.908 INFO:tasks.workunit.client.1.smithi082.stdout:3/585: truncate d0/d16/f4a 1878977 0 2024-02-15T22:41:17.908 INFO:tasks.workunit.client.1.smithi082.stdout:3/586: chown d0/dc/d3f 24058 1 2024-02-15T22:41:17.910 INFO:tasks.workunit.client.1.smithi082.stdout:9/621: rename d8/d12/d33/da4/dac/fb4 to d8/d12/d33/fbb 0 2024-02-15T22:41:17.911 INFO:tasks.workunit.client.1.smithi082.stdout:3/587: dread d0/d16/d62/f6d [0,4194304] 0 2024-02-15T22:41:17.911 INFO:tasks.workunit.client.1.smithi082.stdout:6/669: getdents d2/d18/d8a/d47/d72 0 2024-02-15T22:41:17.911 INFO:tasks.workunit.client.1.smithi082.stdout:6/670: fsync d2/fab 0 2024-02-15T22:41:17.915 INFO:tasks.workunit.client.1.smithi082.stdout:1/617: rename d1/da/d14/d18/d1f/d76/fc3 to d1/da/d11/d8c/fcc 0 2024-02-15T22:41:17.915 INFO:tasks.workunit.client.1.smithi082.stdout:8/575: dread d1/d7/d9/d42/f49 [0,4194304] 0 2024-02-15T22:41:17.915 INFO:tasks.workunit.client.1.smithi082.stdout:8/576: chown d1/d7/d48/d6f 348855 1 2024-02-15T22:41:17.916 INFO:tasks.workunit.client.1.smithi082.stdout:9/622: mknod d8/d12/d67/d70/d97/cbc 0 2024-02-15T22:41:17.917 INFO:tasks.workunit.client.1.smithi082.stdout:0/559: dread d3/d19/f21 [0,4194304] 0 2024-02-15T22:41:17.917 INFO:tasks.workunit.client.1.smithi082.stdout:0/560: fdatasync d3/d19/f44 0 2024-02-15T22:41:17.917 INFO:tasks.workunit.client.1.smithi082.stdout:0/561: fsync d3/d19/fb6 0 2024-02-15T22:41:17.919 INFO:tasks.workunit.client.1.smithi082.stdout:3/588: mkdir d0/d16/d62/d14/d21/d69/d87/dc7 0 2024-02-15T22:41:17.920 INFO:tasks.workunit.client.1.smithi082.stdout:1/618: rename d1/da/d14/d18/d98/cb2 to d1/da/d11/d93/db6/ccd 0 2024-02-15T22:41:17.922 INFO:tasks.workunit.client.1.smithi082.stdout:8/577: creat d1/d7/d9/d50/fc3 x:0 0 0 2024-02-15T22:41:17.922 INFO:tasks.workunit.client.1.smithi082.stdout:6/671: dread d2/d18/d8a/d47/d69/f73 [0,4194304] 0 2024-02-15T22:41:17.930 INFO:tasks.workunit.client.1.smithi082.stdout:8/578: creat d1/d7/de/d1e/fc4 x:0 0 0 2024-02-15T22:41:17.930 INFO:tasks.workunit.client.1.smithi082.stdout:9/623: write d8/d12/d67/d70/f76 [3781864,107710] 0 2024-02-15T22:41:17.932 INFO:tasks.workunit.client.1.smithi082.stdout:0/562: getdents d3/d19/d5f 0 2024-02-15T22:41:17.935 INFO:tasks.workunit.client.1.smithi082.stdout:6/672: write d2/d45/f56 [3815328,113704] 0 2024-02-15T22:41:17.936 INFO:tasks.workunit.client.1.smithi082.stdout:6/673: stat d2/d18/f99 0 2024-02-15T22:41:17.936 INFO:tasks.workunit.client.1.smithi082.stdout:6/674: dread - d2/d18/d8a/d65/fcd zero size 2024-02-15T22:41:17.939 INFO:tasks.workunit.client.1.smithi082.stdout:9/624: symlink d8/d12/d30/d3c/d65/lbd 0 2024-02-15T22:41:17.939 INFO:tasks.workunit.client.1.smithi082.stdout:9/625: write d8/d24/d2e/f68 [456822,57987] 0 2024-02-15T22:41:17.944 INFO:tasks.workunit.client.1.smithi082.stdout:8/579: rename d1/d7/d9/d24/d72 to d1/d7/d9/d42/dc5 0 2024-02-15T22:41:17.944 INFO:tasks.workunit.client.1.smithi082.stdout:8/580: write d1/d7/d9/d50/d56/f6b [412901,46787] 0 2024-02-15T22:41:17.947 INFO:tasks.workunit.client.1.smithi082.stdout:9/626: rename d8/d24/d2e/f6d to d8/d12/fbe 0 2024-02-15T22:41:17.948 INFO:tasks.workunit.client.1.smithi082.stdout:9/627: fsync d8/d24/d2e/f38 0 2024-02-15T22:41:17.948 INFO:tasks.workunit.client.1.smithi082.stdout:9/628: write d8/f1c [3939692,74405] 0 2024-02-15T22:41:17.948 INFO:tasks.workunit.client.1.smithi082.stdout:9/629: chown d8/c85 70906 1 2024-02-15T22:41:17.948 INFO:tasks.workunit.client.1.smithi082.stdout:8/581: dread d1/d7/f62 [0,4194304] 0 2024-02-15T22:41:17.950 INFO:tasks.workunit.client.1.smithi082.stdout:8/582: creat d1/d40/dbb/fc6 x:0 0 0 2024-02-15T22:41:17.951 INFO:tasks.workunit.client.1.smithi082.stdout:8/583: creat d1/d7/d9/d50/d56/dab/fc7 x:0 0 0 2024-02-15T22:41:17.951 INFO:tasks.workunit.client.1.smithi082.stdout:8/584: truncate d1/d7/d9/f81 425286 0 2024-02-15T22:41:17.952 INFO:tasks.workunit.client.1.smithi082.stdout:8/585: mkdir d1/d7/d9/d50/dc8 0 2024-02-15T22:41:17.952 INFO:tasks.workunit.client.1.smithi082.stdout:8/586: readlink d1/d7/d9/d50/l63 0 2024-02-15T22:41:17.952 INFO:tasks.workunit.client.1.smithi082.stdout:8/587: readlink d1/l8d 0 2024-02-15T22:41:17.953 INFO:tasks.workunit.client.1.smithi082.stdout:8/588: mknod d1/d7/d9/d42/d6a/cc9 0 2024-02-15T22:41:17.953 INFO:tasks.workunit.client.1.smithi082.stdout:8/589: readlink d1/d7/d9/d24/l7d 0 2024-02-15T22:41:17.955 INFO:tasks.workunit.client.1.smithi082.stdout:1/619: dwrite d1/da/d14/d18/d1f/f84 [0,4194304] 0 2024-02-15T22:41:17.958 INFO:tasks.workunit.client.1.smithi082.stdout:3/589: dwrite d0/dc/f9c [0,4194304] 0 2024-02-15T22:41:17.960 INFO:tasks.workunit.client.1.smithi082.stdout:3/590: unlink d0/dc/c27 0 2024-02-15T22:41:17.970 INFO:tasks.workunit.client.1.smithi082.stdout:6/675: dwrite d2/d18/d23/d67/fa3 [0,4194304] 0 2024-02-15T22:41:17.971 INFO:tasks.workunit.client.1.smithi082.stdout:0/563: dwrite d3/d19/d5f/da0/dbc/f7a [0,4194304] 0 2024-02-15T22:41:17.971 INFO:tasks.workunit.client.1.smithi082.stdout:1/620: write d1/d57/f94 [3614266,122725] 0 2024-02-15T22:41:17.972 INFO:tasks.workunit.client.1.smithi082.stdout:9/630: dwrite d8/d24/d2e/d56/f72 [0,4194304] 0 2024-02-15T22:41:17.973 INFO:tasks.workunit.client.1.smithi082.stdout:3/591: dread d0/d16/d62/fa0 [0,4194304] 0 2024-02-15T22:41:17.980 INFO:tasks.workunit.client.1.smithi082.stdout:9/631: dread d8/f11 [0,4194304] 0 2024-02-15T22:41:17.992 INFO:tasks.workunit.client.1.smithi082.stdout:9/632: mknod d8/d24/d2e/cbf 0 2024-02-15T22:41:17.993 INFO:tasks.workunit.client.1.smithi082.stdout:9/633: rmdir d8/d12/d30/d3c/d71 39 2024-02-15T22:41:17.995 INFO:tasks.workunit.client.1.smithi082.stdout:9/634: symlink d8/d12/d67/d70/lc0 0 2024-02-15T22:41:17.995 INFO:tasks.workunit.client.1.smithi082.stdout:9/635: fsync d8/f1c 0 2024-02-15T22:41:17.996 INFO:tasks.workunit.client.1.smithi082.stdout:9/636: mkdir d8/d12/d33/d64/d7c/da1/dc1 0 2024-02-15T22:41:17.997 INFO:tasks.workunit.client.1.smithi082.stdout:0/564: dwrite d3/d19/f44 [0,4194304] 0 2024-02-15T22:41:17.999 INFO:tasks.workunit.client.1.smithi082.stdout:1/621: dwrite d1/da/d14/d18/d51/f8e [0,4194304] 0 2024-02-15T22:41:17.999 INFO:tasks.workunit.client.1.smithi082.stdout:1/622: dread - d1/da/d14/d18/d51/fc4 zero size 2024-02-15T22:41:18.001 INFO:tasks.workunit.client.1.smithi082.stdout:9/637: dread d8/f58 [0,4194304] 0 2024-02-15T22:41:18.001 INFO:tasks.workunit.client.1.smithi082.stdout:9/638: write d8/f1c [1706274,116532] 0 2024-02-15T22:41:18.001 INFO:tasks.workunit.client.1.smithi082.stdout:9/639: write d8/d12/d67/d70/f76 [1403426,28492] 0 2024-02-15T22:41:18.001 INFO:tasks.workunit.client.1.smithi082.stdout:9/640: chown d8/d12/d67/d70/d97/cbc 22956 1 2024-02-15T22:41:18.001 INFO:tasks.workunit.client.1.smithi082.stdout:9/641: write d8/d12/d33/d3e/f66 [1899712,81228] 0 2024-02-15T22:41:18.003 INFO:tasks.workunit.client.1.smithi082.stdout:1/623: dread d1/da/d11/f9e [0,4194304] 0 2024-02-15T22:41:18.004 INFO:tasks.workunit.client.1.smithi082.stdout:3/592: write d0/dc/f26 [2624360,64848] 0 2024-02-15T22:41:18.004 INFO:tasks.workunit.client.1.smithi082.stdout:9/642: symlink d8/d12/lc2 0 2024-02-15T22:41:18.007 INFO:tasks.workunit.client.1.smithi082.stdout:1/624: rename d1/da/d14/d7f/f85 to d1/da/d11/d93/db6/dc5/fce 0 2024-02-15T22:41:18.008 INFO:tasks.workunit.client.1.smithi082.stdout:0/565: dread d3/f40 [0,4194304] 0 2024-02-15T22:41:18.012 INFO:tasks.workunit.client.1.smithi082.stdout:9/643: dread d8/f18 [4194304,4194304] 0 2024-02-15T22:41:18.013 INFO:tasks.workunit.client.1.smithi082.stdout:3/593: symlink d0/d16/d3e/d56/lc8 0 2024-02-15T22:41:18.016 INFO:tasks.workunit.client.1.smithi082.stdout:5/628: sync 2024-02-15T22:41:18.016 INFO:tasks.workunit.client.1.smithi082.stdout:5/629: truncate d5/da/dc/dad/dcf/f83 479124 0 2024-02-15T22:41:18.017 INFO:tasks.workunit.client.1.smithi082.stdout:0/566: mknod d3/d19/d5f/da0/cc0 0 2024-02-15T22:41:18.017 INFO:tasks.workunit.client.1.smithi082.stdout:0/567: chown d3/d19/d5f/da5/d99/db1/fbd 56367 1 2024-02-15T22:41:18.018 INFO:tasks.workunit.client.1.smithi082.stdout:9/644: mkdir d8/d12/d33/d64/dc3 0 2024-02-15T22:41:18.021 INFO:tasks.workunit.client.1.smithi082.stdout:3/594: mkdir d0/dc/d3f/dc4/dc9 0 2024-02-15T22:41:18.023 INFO:tasks.workunit.client.1.smithi082.stdout:0/568: rename d3/d6b/d7f/fba to d3/d19/fc1 0 2024-02-15T22:41:18.024 INFO:tasks.workunit.client.1.smithi082.stdout:9/645: link d8/f19 d8/d24/d9e/fc4 0 2024-02-15T22:41:18.027 INFO:tasks.workunit.client.1.smithi082.stdout:3/595: rmdir d0/d16/d62/d79/da6 0 2024-02-15T22:41:18.029 INFO:tasks.workunit.client.1.smithi082.stdout:9/646: unlink d8/d24/d2e/c98 0 2024-02-15T22:41:18.029 INFO:tasks.workunit.client.1.smithi082.stdout:9/647: stat d8/f19 0 2024-02-15T22:41:18.030 INFO:tasks.workunit.client.1.smithi082.stdout:3/596: rmdir d0/dc/d3f/dc4 39 2024-02-15T22:41:18.032 INFO:tasks.workunit.client.1.smithi082.stdout:3/597: creat d0/d16/d3e/fca x:0 0 0 2024-02-15T22:41:18.035 INFO:tasks.workunit.client.1.smithi082.stdout:1/625: dwrite d1/da/d14/fca [0,4194304] 0 2024-02-15T22:41:18.035 INFO:tasks.workunit.client.1.smithi082.stdout:1/626: write d1/da/d14/f2d [2404124,124226] 0 2024-02-15T22:41:18.039 INFO:tasks.workunit.client.1.smithi082.stdout:1/627: mknod d1/da/d14/ccf 0 2024-02-15T22:41:18.039 INFO:tasks.workunit.client.1.smithi082.stdout:1/628: stat d1/da/d14/fca 0 2024-02-15T22:41:18.042 INFO:tasks.workunit.client.1.smithi082.stdout:5/630: dwrite d5/da/dc/dad/dcf/d59/fa6 [0,4194304] 0 2024-02-15T22:41:18.042 INFO:tasks.workunit.client.1.smithi082.stdout:5/631: readlink d5/l74 0 2024-02-15T22:41:18.042 INFO:tasks.workunit.client.1.smithi082.stdout:0/569: dwrite d3/d19/d5f/f6e [0,4194304] 0 2024-02-15T22:41:18.042 INFO:tasks.workunit.client.1.smithi082.stdout:0/570: chown d3/d19/d5f/da5 65273 1 2024-02-15T22:41:18.042 INFO:tasks.workunit.client.1.smithi082.stdout:0/571: stat d3/d6b/c8e 0 2024-02-15T22:41:18.042 INFO:tasks.workunit.client.1.smithi082.stdout:0/572: truncate d3/d19/d20/d26/f53 4991040 0 2024-02-15T22:41:18.052 INFO:tasks.workunit.client.1.smithi082.stdout:3/598: dwrite d0/d16/d62/d14/d21/d7d/f8e [0,4194304] 0 2024-02-15T22:41:18.055 INFO:tasks.workunit.client.1.smithi082.stdout:5/632: dread d5/da/dc/d43/f4d [0,4194304] 0 2024-02-15T22:41:18.055 INFO:tasks.workunit.client.1.smithi082.stdout:5/633: dread - d5/da/d67/da0/fc4 zero size 2024-02-15T22:41:18.058 INFO:tasks.workunit.client.1.smithi082.stdout:3/599: write d0/d16/d62/d14/d21/d41/f67 [4456904,99493] 0 2024-02-15T22:41:18.062 INFO:tasks.workunit.client.1.smithi082.stdout:3/600: mkdir d0/d16/d62/d79/dcb 0 2024-02-15T22:41:18.063 INFO:tasks.workunit.client.1.smithi082.stdout:0/573: dwrite d3/d19/d25/d45/f39 [0,4194304] 0 2024-02-15T22:41:18.064 INFO:tasks.workunit.client.1.smithi082.stdout:0/574: truncate d3/d19/d5f/da5/f8a 1563034 0 2024-02-15T22:41:18.064 INFO:tasks.workunit.client.1.smithi082.stdout:3/601: unlink d0/d16/d62/f25 0 2024-02-15T22:41:18.064 INFO:tasks.workunit.client.1.smithi082.stdout:3/602: fdatasync d0/d16/d62/f9f 0 2024-02-15T22:41:18.068 INFO:tasks.workunit.client.1.smithi082.stdout:7/676: sync 2024-02-15T22:41:18.068 INFO:tasks.workunit.client.1.smithi082.stdout:2/567: sync 2024-02-15T22:41:18.068 INFO:tasks.workunit.client.1.smithi082.stdout:4/736: sync 2024-02-15T22:41:18.068 INFO:tasks.workunit.client.1.smithi082.stdout:4/737: truncate d0/d8/d1b/dd/daa/ff5 204405 0 2024-02-15T22:41:18.068 INFO:tasks.workunit.client.1.smithi082.stdout:4/738: fsync d0/d16/d87/da2/fca 0 2024-02-15T22:41:18.068 INFO:tasks.workunit.client.1.smithi082.stdout:4/739: fdatasync d0/d8/d1b/dd/feb 0 2024-02-15T22:41:18.069 INFO:tasks.workunit.client.1.smithi082.stdout:4/740: truncate d0/d47/d4d/f88 983906 0 2024-02-15T22:41:18.070 INFO:tasks.workunit.client.1.smithi082.stdout:5/634: dread d5/da/dc/dad/dcf/d59/f95 [0,4194304] 0 2024-02-15T22:41:18.070 INFO:tasks.workunit.client.1.smithi082.stdout:2/568: dread d6/f26 [0,4194304] 0 2024-02-15T22:41:18.070 INFO:tasks.workunit.client.1.smithi082.stdout:3/603: mkdir d0/d16/d62/d2e/dcc 0 2024-02-15T22:41:18.074 INFO:tasks.workunit.client.1.smithi082.stdout:0/575: write d3/d19/f44 [1825753,56741] 0 2024-02-15T22:41:18.076 INFO:tasks.workunit.client.1.smithi082.stdout:4/741: unlink d0/dc0/lda 0 2024-02-15T22:41:18.081 INFO:tasks.workunit.client.1.smithi082.stdout:3/604: read d0/d16/d62/d14/d21/d69/d87/f8f [304868,74452] 0 2024-02-15T22:41:18.081 INFO:tasks.workunit.client.1.smithi082.stdout:3/605: truncate d0/d16/d62/d14/d21/d69/d91/fa1 578276 0 2024-02-15T22:41:18.081 INFO:tasks.workunit.client.1.smithi082.stdout:3/606: readlink d0/d16/d3e/l92 0 2024-02-15T22:41:18.089 INFO:tasks.workunit.client.1.smithi082.stdout:2/569: mkdir d6/dc/d12/db1 0 2024-02-15T22:41:18.089 INFO:tasks.workunit.client.1.smithi082.stdout:2/570: truncate d6/dc/d12/d46/f7c 606500 0 2024-02-15T22:41:18.089 INFO:tasks.workunit.client.1.smithi082.stdout:2/571: fsync d6/dc/d12/d46/d4b/f8b 0 2024-02-15T22:41:18.090 INFO:tasks.workunit.client.1.smithi082.stdout:7/677: rename d12/l14 to d12/d27/d74/le3 0 2024-02-15T22:41:18.090 INFO:tasks.workunit.client.1.smithi082.stdout:7/678: truncate d12/d37/f70 4460950 0 2024-02-15T22:41:18.091 INFO:tasks.workunit.client.1.smithi082.stdout:5/635: dwrite d5/da/d14/f94 [0,4194304] 0 2024-02-15T22:41:18.093 INFO:tasks.workunit.client.1.smithi082.stdout:0/576: symlink d3/d19/d1c/d6d/lc2 0 2024-02-15T22:41:18.098 INFO:tasks.workunit.client.1.smithi082.stdout:2/572: rmdir d6/dc/d58 39 2024-02-15T22:41:18.103 INFO:tasks.workunit.client.1.smithi082.stdout:4/742: dwrite d0/d16/f56 [0,4194304] 0 2024-02-15T22:41:18.104 INFO:tasks.workunit.client.1.smithi082.stdout:4/743: write d0/d16/f9c [4299276,7421] 0 2024-02-15T22:41:18.104 INFO:tasks.workunit.client.1.smithi082.stdout:4/744: write d0/d8/d1b/dd/fbc [185585,39411] 0 2024-02-15T22:41:18.104 INFO:tasks.workunit.client.1.smithi082.stdout:4/745: fdatasync d0/d8/d32/f4e 0 2024-02-15T22:41:18.104 INFO:tasks.workunit.client.1.smithi082.stdout:0/577: link d3/d19/d1c/d6d/f94 d3/d19/d20/d26/fc3 0 2024-02-15T22:41:18.104 INFO:tasks.workunit.client.1.smithi082.stdout:3/607: dwrite d0/dc/d3f/fbb [0,4194304] 0 2024-02-15T22:41:18.107 INFO:tasks.workunit.client.1.smithi082.stdout:7/679: mkdir d12/de4 0 2024-02-15T22:41:18.111 INFO:tasks.workunit.client.1.smithi082.stdout:5/636: rmdir d5/da/d14 39 2024-02-15T22:41:18.111 INFO:tasks.workunit.client.1.smithi082.stdout:5/637: write d5/da/d67/f76 [205105,58787] 0 2024-02-15T22:41:18.111 INFO:tasks.workunit.client.1.smithi082.stdout:5/638: fdatasync d5/da/d14/d45/fc1 0 2024-02-15T22:41:18.115 INFO:tasks.workunit.client.1.smithi082.stdout:4/746: symlink d0/d47/da6/da7/l112 0 2024-02-15T22:41:18.116 INFO:tasks.workunit.client.1.smithi082.stdout:0/578: symlink d3/d19/d5f/d92/lc4 0 2024-02-15T22:41:18.122 INFO:tasks.workunit.client.1.smithi082.stdout:3/608: rename d0/d16/d62/d14/d71/da2/cb6 to d0/d16/d62/d14/d71/da2/ccd 0 2024-02-15T22:41:18.124 INFO:tasks.workunit.client.1.smithi082.stdout:2/573: getdents d6/dc/dd/d24 0 2024-02-15T22:41:18.125 INFO:tasks.workunit.client.1.smithi082.stdout:7/680: chown d12/c2e 2 1 2024-02-15T22:41:18.127 INFO:tasks.workunit.client.1.smithi082.stdout:5/639: mknod d5/da/dc/dd5/cdf 0 2024-02-15T22:41:18.128 INFO:tasks.workunit.client.1.smithi082.stdout:4/747: mknod d0/d47/dd8/c113 0 2024-02-15T22:41:18.128 INFO:tasks.workunit.client.1.smithi082.stdout:4/748: write d0/d47/dd8/fe6 [916216,52479] 0 2024-02-15T22:41:18.128 INFO:tasks.workunit.client.1.smithi082.stdout:4/749: fdatasync d0/d47/d4d/fd1 0 2024-02-15T22:41:18.131 INFO:tasks.workunit.client.1.smithi082.stdout:0/579: rmdir d3/d19/d20/d26 39 2024-02-15T22:41:18.131 INFO:tasks.workunit.client.1.smithi082.stdout:0/580: creat d3/d19/d25/d80/fc5 x:0 0 0 2024-02-15T22:41:18.135 INFO:tasks.workunit.client.1.smithi082.stdout:7/681: write d12/d3b/f44 [428456,105065] 0 2024-02-15T22:41:18.135 INFO:tasks.workunit.client.1.smithi082.stdout:7/682: truncate d12/d27/d74/f82 497507 0 2024-02-15T22:41:18.135 INFO:tasks.workunit.client.1.smithi082.stdout:7/683: readlink d12/d3b/d5a/l8f 0 2024-02-15T22:41:18.135 INFO:tasks.workunit.client.1.smithi082.stdout:4/750: dread d0/d8/d32/d39/fb2 [0,4194304] 0 2024-02-15T22:41:18.135 INFO:tasks.workunit.client.1.smithi082.stdout:4/751: write d0/d16/fd5 [1381227,82991] 0 2024-02-15T22:41:18.137 INFO:tasks.workunit.client.1.smithi082.stdout:2/574: dwrite d6/dc/d12/d46/d76/f91 [0,4194304] 0 2024-02-15T22:41:18.137 INFO:tasks.workunit.client.1.smithi082.stdout:2/575: dread - d6/dc/dd/d24/d71/fa5 zero size 2024-02-15T22:41:18.141 INFO:tasks.workunit.client.1.smithi082.stdout:3/609: symlink d0/d16/d62/d14/d21/d7d/lce 0 2024-02-15T22:41:18.141 INFO:tasks.workunit.client.1.smithi082.stdout:3/610: readlink d0/d16/l10 0 2024-02-15T22:41:18.142 INFO:tasks.workunit.client.1.smithi082.stdout:5/640: rename d5/da/dc/dad/dcf/d59/l6a to d5/da/d14/d45/le0 0 2024-02-15T22:41:18.145 INFO:tasks.workunit.client.1.smithi082.stdout:0/581: truncate d3/d6b/dac/fb4 6346762 0 2024-02-15T22:41:18.145 INFO:tasks.workunit.client.1.smithi082.stdout:0/582: chown d3/d19/d5f/da5 1 1 2024-02-15T22:41:18.147 INFO:tasks.workunit.client.1.smithi082.stdout:2/576: write d6/dc/dd/d1d/f50 [2323070,79665] 0 2024-02-15T22:41:18.147 INFO:tasks.workunit.client.1.smithi082.stdout:2/577: chown d6/dc/d12/d46/d4b/d63/f66 112435597 1 2024-02-15T22:41:18.147 INFO:tasks.workunit.client.1.smithi082.stdout:2/578: creat d6/d18/fb2 x:0 0 0 2024-02-15T22:41:18.147 INFO:tasks.workunit.client.1.smithi082.stdout:2/579: write d6/dc/d58/d49/fa2 [1444776,120521] 0 2024-02-15T22:41:18.148 INFO:tasks.workunit.client.1.smithi082.stdout:2/580: stat d6/dc/d58/d49/d5e/f60 0 2024-02-15T22:41:18.148 INFO:tasks.workunit.client.1.smithi082.stdout:7/684: rmdir d12/d17/d42/d67/d81/d91/dbc 39 2024-02-15T22:41:18.149 INFO:tasks.workunit.client.1.smithi082.stdout:4/752: dwrite d0/d8/d32/fb4 [0,4194304] 0 2024-02-15T22:41:18.157 INFO:tasks.workunit.client.1.smithi082.stdout:3/611: symlink d0/d16/d3e/d56/db0/lcf 0 2024-02-15T22:41:18.157 INFO:tasks.workunit.client.1.smithi082.stdout:0/583: dread d3/f57 [4194304,4194304] 0 2024-02-15T22:41:18.159 INFO:tasks.workunit.client.1.smithi082.stdout:5/641: unlink d5/da/l8f 0 2024-02-15T22:41:18.159 INFO:tasks.workunit.client.1.smithi082.stdout:5/642: chown d5/da/d14/c3e 1334566 1 2024-02-15T22:41:18.163 INFO:tasks.workunit.client.1.smithi082.stdout:2/581: creat d6/dc/d12/d23/d90/fb3 x:0 0 0 2024-02-15T22:41:18.163 INFO:tasks.workunit.client.1.smithi082.stdout:2/582: fdatasync d6/dc/dd/d24/f39 0 2024-02-15T22:41:18.163 INFO:tasks.workunit.client.1.smithi082.stdout:2/583: chown d6/dc/dd/d1d/c2e 1 1 2024-02-15T22:41:18.163 INFO:tasks.workunit.client.1.smithi082.stdout:8/590: sync 2024-02-15T22:41:18.163 INFO:tasks.workunit.client.1.smithi082.stdout:7/685: truncate d12/d17/f25 435976 0 2024-02-15T22:41:18.166 INFO:tasks.workunit.client.1.smithi082.stdout:4/753: mkdir d0/d47/da6/d114 0 2024-02-15T22:41:18.167 INFO:tasks.workunit.client.1.smithi082.stdout:3/612: creat d0/d16/d62/d14/d21/d69/d6c/fd0 x:0 0 0 2024-02-15T22:41:18.168 INFO:tasks.workunit.client.1.smithi082.stdout:0/584: getdents d3/d19/d5f/d92 0 2024-02-15T22:41:18.169 INFO:tasks.workunit.client.1.smithi082.stdout:5/643: getdents d5/da/dc/dad/dcf/d59 0 2024-02-15T22:41:18.169 INFO:tasks.workunit.client.1.smithi082.stdout:5/644: fsync d5/da/d14/d45/f60 0 2024-02-15T22:41:18.169 INFO:tasks.workunit.client.1.smithi082.stdout:5/645: chown d5/da/dc/c19 144240 1 2024-02-15T22:41:18.171 INFO:tasks.workunit.client.1.smithi082.stdout:2/584: rename d6/d3c/f4e to d6/dc/d12/fb4 0 2024-02-15T22:41:18.171 INFO:tasks.workunit.client.1.smithi082.stdout:2/585: write d6/dc/d12/d46/f7f [1088675,11348] 0 2024-02-15T22:41:18.173 INFO:tasks.workunit.client.1.smithi082.stdout:4/754: unlink d0/d16/d87/da2/cef 0 2024-02-15T22:41:18.173 INFO:tasks.workunit.client.1.smithi082.stdout:4/755: write d0/f2 [108916,1325] 0 2024-02-15T22:41:18.174 INFO:tasks.workunit.client.1.smithi082.stdout:3/613: symlink d0/d16/d3e/ld1 0 2024-02-15T22:41:18.176 INFO:tasks.workunit.client.1.smithi082.stdout:5/646: creat d5/da/d14/fe1 x:0 0 0 2024-02-15T22:41:18.179 INFO:tasks.workunit.client.1.smithi082.stdout:4/756: truncate d0/d8/f34 1163376 0 2024-02-15T22:41:18.180 INFO:tasks.workunit.client.1.smithi082.stdout:3/614: symlink d0/d16/d62/d2e/dcc/ld2 0 2024-02-15T22:41:18.181 INFO:tasks.workunit.client.1.smithi082.stdout:0/585: getdents d3/d19/d25/d80 0 2024-02-15T22:41:18.183 INFO:tasks.workunit.client.1.smithi082.stdout:5/647: symlink d5/da/dc/dad/dcf/d59/d84/d89/le2 0 2024-02-15T22:41:18.187 INFO:tasks.workunit.client.1.smithi082.stdout:3/615: read d0/d16/d62/f7 [3608838,106911] 0 2024-02-15T22:41:18.189 INFO:tasks.workunit.client.1.smithi082.stdout:2/586: dwrite d6/d18/faf [0,4194304] 0 2024-02-15T22:41:18.189 INFO:tasks.workunit.client.1.smithi082.stdout:2/587: dread - d6/dc/d58/d49/d5e/f73 zero size 2024-02-15T22:41:18.191 INFO:tasks.workunit.client.1.smithi082.stdout:4/757: link d0/d8/d32/d39/l84 d0/d16/d4a/d6a/dd9/de2/l115 0 2024-02-15T22:41:18.193 INFO:tasks.workunit.client.1.smithi082.stdout:0/586: mknod d3/d19/d5f/da5/d99/db1/cc6 0 2024-02-15T22:41:18.193 INFO:tasks.workunit.client.1.smithi082.stdout:0/587: dread - d3/faf zero size 2024-02-15T22:41:18.193 INFO:tasks.workunit.client.1.smithi082.stdout:0/588: fdatasync d3/d19/d25/d45/f39 0 2024-02-15T22:41:18.197 INFO:tasks.workunit.client.1.smithi082.stdout:2/588: dread d6/dc/dd/d1d/f77 [0,4194304] 0 2024-02-15T22:41:18.198 INFO:tasks.workunit.client.1.smithi082.stdout:8/591: rename d1/d7/d9/d42/d6a/d8e to d1/d7/d9/d24/d43/da6/db6/dca 0 2024-02-15T22:41:18.201 INFO:tasks.workunit.client.1.smithi082.stdout:3/616: creat d0/d16/d62/d14/d71/da2/fd3 x:0 0 0 2024-02-15T22:41:18.201 INFO:tasks.workunit.client.1.smithi082.stdout:3/617: chown d0/d16/d62/d14/d71/d86 43 1 2024-02-15T22:41:18.201 INFO:tasks.workunit.client.1.smithi082.stdout:3/618: chown d0/d16/d62/d2e/d84/l9b 1 1 2024-02-15T22:41:18.209 INFO:tasks.workunit.client.1.smithi082.stdout:8/592: dread d1/d7/d9/d42/f46 [0,4194304] 0 2024-02-15T22:41:18.216 INFO:tasks.workunit.client.1.smithi082.stdout:0/589: mknod d3/d19/d5f/da5/d99/db3/cc7 0 2024-02-15T22:41:18.216 INFO:tasks.workunit.client.1.smithi082.stdout:0/590: chown d3/d19/d20/d26/f89 7422738 1 2024-02-15T22:41:18.220 INFO:tasks.workunit.client.1.smithi082.stdout:5/648: rmdir d5/da/dc/d43 39 2024-02-15T22:41:18.223 INFO:tasks.workunit.client.1.smithi082.stdout:7/686: rename d12/c2e to d12/d17/d42/d67/d81/d91/dbc/ce5 0 2024-02-15T22:41:18.226 INFO:tasks.workunit.client.1.smithi082.stdout:8/593: dwrite d1/d7/d9/f81 [0,4194304] 0 2024-02-15T22:41:18.229 INFO:tasks.workunit.client.1.smithi082.stdout:3/619: creat d0/d16/d62/d79/fd4 x:0 0 0 2024-02-15T22:41:18.229 INFO:tasks.workunit.client.1.smithi082.stdout:6/676: sync 2024-02-15T22:41:18.231 INFO:tasks.workunit.client.1.smithi082.stdout:6/677: dread d2/fa5 [0,4194304] 0 2024-02-15T22:41:18.231 INFO:tasks.workunit.client.1.smithi082.stdout:6/678: chown d2/d18/d8a/d47/d69/d75/f9a 3 1 2024-02-15T22:41:18.232 INFO:tasks.workunit.client.1.smithi082.stdout:6/679: chown d2/d18/d8a/d47/d72/fc7 46584 1 2024-02-15T22:41:18.233 INFO:tasks.workunit.client.1.smithi082.stdout:0/591: creat d3/d6b/dac/fc8 x:0 0 0 2024-02-15T22:41:18.235 INFO:tasks.workunit.client.1.smithi082.stdout:8/594: write d1/d7/d9/d50/f67 [875410,59607] 0 2024-02-15T22:41:18.237 INFO:tasks.workunit.client.1.smithi082.stdout:8/595: write d1/f18 [1006383,106281] 0 2024-02-15T22:41:18.237 INFO:tasks.workunit.client.1.smithi082.stdout:8/596: creat d1/d7/d78/fcb x:0 0 0 2024-02-15T22:41:18.237 INFO:tasks.workunit.client.1.smithi082.stdout:5/649: mkdir d5/da/de3 0 2024-02-15T22:41:18.237 INFO:tasks.workunit.client.1.smithi082.stdout:5/650: stat d5/da/f23 0 2024-02-15T22:41:18.238 INFO:tasks.workunit.client.1.smithi082.stdout:5/651: write d5/da/d14/d53/f7b [5237236,90811] 0 2024-02-15T22:41:18.238 INFO:tasks.workunit.client.1.smithi082.stdout:3/620: read d0/dc/f51 [2323930,22681] 0 2024-02-15T22:41:18.238 INFO:tasks.workunit.client.1.smithi082.stdout:3/621: creat d0/d16/d62/d14/d21/d69/d6c/fd5 x:0 0 0 2024-02-15T22:41:18.242 INFO:tasks.workunit.client.1.smithi082.stdout:4/758: rename d0/d47/fb9 to d0/d47/da6/da7/d108/f116 0 2024-02-15T22:41:18.244 INFO:tasks.workunit.client.1.smithi082.stdout:7/687: mknod d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/ce6 0 2024-02-15T22:41:18.244 INFO:tasks.workunit.client.1.smithi082.stdout:1/629: sync 2024-02-15T22:41:18.244 INFO:tasks.workunit.client.1.smithi082.stdout:9/648: sync 2024-02-15T22:41:18.251 INFO:tasks.workunit.client.1.smithi082.stdout:6/680: mknod d2/d18/d8a/d47/d69/dc1/cd3 0 2024-02-15T22:41:18.251 INFO:tasks.workunit.client.1.smithi082.stdout:6/681: stat d2/d18/l58 0 2024-02-15T22:41:18.253 INFO:tasks.workunit.client.1.smithi082.stdout:4/759: write d0/d16/f56 [46686,100905] 0 2024-02-15T22:41:18.255 INFO:tasks.workunit.client.1.smithi082.stdout:0/592: mknod d3/d19/d5f/da5/d9c/cc9 0 2024-02-15T22:41:18.258 INFO:tasks.workunit.client.1.smithi082.stdout:8/597: mkdir d1/dcc 0 2024-02-15T22:41:18.261 INFO:tasks.workunit.client.1.smithi082.stdout:5/652: mkdir d5/da/dc/dad/dcf/d59/d84/de4 0 2024-02-15T22:41:18.262 INFO:tasks.workunit.client.1.smithi082.stdout:9/649: dwrite d8/d24/d87/f8c [0,4194304] 0 2024-02-15T22:41:18.266 INFO:tasks.workunit.client.1.smithi082.stdout:2/589: rename d6/dc/dd/d24/f30 to d6/d3c/d8c/fb5 0 2024-02-15T22:41:18.266 INFO:tasks.workunit.client.1.smithi082.stdout:2/590: truncate d6/dc/d12/d46/f7c 1172943 0 2024-02-15T22:41:18.268 INFO:tasks.workunit.client.1.smithi082.stdout:7/688: mkdir d12/d37/dbd/de7 0 2024-02-15T22:41:18.268 INFO:tasks.workunit.client.1.smithi082.stdout:7/689: fdatasync d12/d17/d42/d67/d81/d91/dbc/fc3 0 2024-02-15T22:41:18.268 INFO:tasks.workunit.client.1.smithi082.stdout:7/690: chown ff 7 1 2024-02-15T22:41:18.269 INFO:tasks.workunit.client.1.smithi082.stdout:1/630: creat d1/da/d11/d3f/fd0 x:0 0 0 2024-02-15T22:41:18.273 INFO:tasks.workunit.client.1.smithi082.stdout:6/682: getdents d2/d18/d8a/d47/d69 0 2024-02-15T22:41:18.277 INFO:tasks.workunit.client.1.smithi082.stdout:0/593: mknod d3/d6b/dac/cca 0 2024-02-15T22:41:18.277 INFO:tasks.workunit.client.1.smithi082.stdout:0/594: readlink d3/d6b/la8 0 2024-02-15T22:41:18.277 INFO:tasks.workunit.client.1.smithi082.stdout:0/595: write d3/d19/d5f/d92/f95 [828055,84150] 0 2024-02-15T22:41:18.281 INFO:tasks.workunit.client.1.smithi082.stdout:5/653: mkdir d5/da/dc/dd5/de5 0 2024-02-15T22:41:18.281 INFO:tasks.workunit.client.1.smithi082.stdout:5/654: write d5/da/f65 [1014859,54269] 0 2024-02-15T22:41:18.281 INFO:tasks.workunit.client.1.smithi082.stdout:5/655: readlink l3 0 2024-02-15T22:41:18.287 INFO:tasks.workunit.client.1.smithi082.stdout:7/691: write d12/d17/d3d/f55 [1124706,124887] 0 2024-02-15T22:41:18.287 INFO:tasks.workunit.client.1.smithi082.stdout:6/683: unlink d2/d18/l58 0 2024-02-15T22:41:18.292 INFO:tasks.workunit.client.1.smithi082.stdout:7/692: write d12/f20 [1099054,52724] 0 2024-02-15T22:41:18.292 INFO:tasks.workunit.client.1.smithi082.stdout:7/693: creat d12/d27/d6e/d6a/d9e/dbe/dcb/fe8 x:0 0 0 2024-02-15T22:41:18.292 INFO:tasks.workunit.client.1.smithi082.stdout:0/596: read d3/d19/d25/d45/f39 [2447246,55904] 0 2024-02-15T22:41:18.293 INFO:tasks.workunit.client.1.smithi082.stdout:2/591: rename d6/dc/d12/d23/d90 to d6/dc/d58/d49/db6 0 2024-02-15T22:41:18.293 INFO:tasks.workunit.client.1.smithi082.stdout:4/760: read d0/d46/fc7 [240642,39403] 0 2024-02-15T22:41:18.294 INFO:tasks.workunit.client.1.smithi082.stdout:4/761: fdatasync d0/d8/d32/d39/f7c 0 2024-02-15T22:41:18.295 INFO:tasks.workunit.client.1.smithi082.stdout:5/656: write d5/da/d56/f8d [2054672,18359] 0 2024-02-15T22:41:18.297 INFO:tasks.workunit.client.1.smithi082.stdout:7/694: creat d12/d17/d42/d67/d81/dc0/fe9 x:0 0 0 2024-02-15T22:41:18.298 INFO:tasks.workunit.client.1.smithi082.stdout:0/597: symlink d3/d19/d1c/d76/lcb 0 2024-02-15T22:41:18.298 INFO:tasks.workunit.client.1.smithi082.stdout:0/598: chown d3/d19/d1c/d6d/f72 378032 1 2024-02-15T22:41:18.300 INFO:tasks.workunit.client.1.smithi082.stdout:5/657: symlink d5/da/dc/le6 0 2024-02-15T22:41:18.302 INFO:tasks.workunit.client.1.smithi082.stdout:6/684: write d2/d18/d8a/d47/d69/f73 [3098299,59554] 0 2024-02-15T22:41:18.302 INFO:tasks.workunit.client.1.smithi082.stdout:7/695: rename d12/d17/d4d/d7d/fac to d12/d3b/fea 0 2024-02-15T22:41:18.303 INFO:tasks.workunit.client.1.smithi082.stdout:9/650: dwrite d8/d12/d33/d64/d7c/f8f [0,4194304] 0 2024-02-15T22:41:18.304 INFO:tasks.workunit.client.1.smithi082.stdout:8/598: dwrite d1/d7/d9/d24/d43/d85/fb2 [0,4194304] 0 2024-02-15T22:41:18.304 INFO:tasks.workunit.client.1.smithi082.stdout:8/599: chown d1/d7/d9/d24/d43/lc0 1822 1 2024-02-15T22:41:18.308 INFO:tasks.workunit.client.1.smithi082.stdout:1/631: dwrite d1/da/d14/d18/d6d/f6f [0,4194304] 0 2024-02-15T22:41:18.308 INFO:tasks.workunit.client.1.smithi082.stdout:1/632: write d1/fc6 [462648,70615] 0 2024-02-15T22:41:18.310 INFO:tasks.workunit.client.1.smithi082.stdout:5/658: unlink d5/da/d67/da0/c77 0 2024-02-15T22:41:18.310 INFO:tasks.workunit.client.1.smithi082.stdout:7/696: write d12/d3b/fea [2464288,67471] 0 2024-02-15T22:41:18.311 INFO:tasks.workunit.client.1.smithi082.stdout:7/697: write d12/d37/f70 [5382536,126303] 0 2024-02-15T22:41:18.312 INFO:tasks.workunit.client.1.smithi082.stdout:4/762: write d0/d46/f79 [3692238,49968] 0 2024-02-15T22:41:18.313 INFO:tasks.workunit.client.1.smithi082.stdout:0/599: dread d3/d19/d25/d45/f39 [0,4194304] 0 2024-02-15T22:41:18.314 INFO:tasks.workunit.client.1.smithi082.stdout:2/592: dwrite d6/dc/d58/d49/db6/fb3 [0,4194304] 0 2024-02-15T22:41:18.316 INFO:tasks.workunit.client.1.smithi082.stdout:6/685: mknod d2/d18/cd4 0 2024-02-15T22:41:18.323 INFO:tasks.workunit.client.1.smithi082.stdout:9/651: rename d8/d24/d2e/d56 to d8/d12/dc5 0 2024-02-15T22:41:18.323 INFO:tasks.workunit.client.1.smithi082.stdout:9/652: fsync d8/d12/d30/d3c/d65/f6e 0 2024-02-15T22:41:18.324 INFO:tasks.workunit.client.1.smithi082.stdout:8/600: mknod d1/d7/de/d1e/ccd 0 2024-02-15T22:41:18.326 INFO:tasks.workunit.client.1.smithi082.stdout:4/763: dread d0/fa0 [4194304,4194304] 0 2024-02-15T22:41:18.335 INFO:tasks.workunit.client.1.smithi082.stdout:1/633: mkdir d1/da/d14/d18/d1f/d7a/dd1 0 2024-02-15T22:41:18.336 INFO:tasks.workunit.client.1.smithi082.stdout:7/698: dwrite d12/d27/f2c [0,4194304] 0 2024-02-15T22:41:18.336 INFO:tasks.workunit.client.1.smithi082.stdout:7/699: creat d12/d3b/feb x:0 0 0 2024-02-15T22:41:18.336 INFO:tasks.workunit.client.1.smithi082.stdout:9/653: dread d8/d12/dc5/f72 [0,4194304] 0 2024-02-15T22:41:18.337 INFO:tasks.workunit.client.1.smithi082.stdout:9/654: chown d8/c84 60021798 1 2024-02-15T22:41:18.338 INFO:tasks.workunit.client.1.smithi082.stdout:5/659: unlink d5/da/dc/l49 0 2024-02-15T22:41:18.338 INFO:tasks.workunit.client.1.smithi082.stdout:5/660: dread - d5/da/dc/d43/fce zero size 2024-02-15T22:41:18.341 INFO:tasks.workunit.client.1.smithi082.stdout:0/600: unlink d3/d19/d20/d7c/c82 0 2024-02-15T22:41:18.344 INFO:tasks.workunit.client.1.smithi082.stdout:2/593: mknod d6/cb7 0 2024-02-15T22:41:18.346 INFO:tasks.workunit.client.1.smithi082.stdout:6/686: symlink d2/d18/d8a/d47/ld5 0 2024-02-15T22:41:18.348 INFO:tasks.workunit.client.1.smithi082.stdout:8/601: mkdir d1/d40/dbb/dce 0 2024-02-15T22:41:18.348 INFO:tasks.workunit.client.1.smithi082.stdout:8/602: write d1/f4f [3456529,10450] 0 2024-02-15T22:41:18.349 INFO:tasks.workunit.client.1.smithi082.stdout:4/764: rmdir d0/d16/d4a/dc5 39 2024-02-15T22:41:18.356 INFO:tasks.workunit.client.1.smithi082.stdout:0/601: read d3/d64/d71/f79 [3076334,46609] 0 2024-02-15T22:41:18.359 INFO:tasks.workunit.client.1.smithi082.stdout:7/700: creat d12/d27/d6e/d6a/d9e/dbe/fec x:0 0 0 2024-02-15T22:41:18.364 INFO:tasks.workunit.client.1.smithi082.stdout:9/655: dwrite d8/d12/d33/f3b [4194304,4194304] 0 2024-02-15T22:41:18.367 INFO:tasks.workunit.client.1.smithi082.stdout:8/603: dwrite d1/d7/d9/d24/d43/fae [0,4194304] 0 2024-02-15T22:41:18.367 INFO:tasks.workunit.client.1.smithi082.stdout:8/604: readlink d1/d7/d9/d42/d6a/da5/lbd 0 2024-02-15T22:41:18.367 INFO:tasks.workunit.client.1.smithi082.stdout:8/605: write d1/d7/d9/d50/f67 [3494063,78920] 0 2024-02-15T22:41:18.372 INFO:tasks.workunit.client.1.smithi082.stdout:9/656: dread d8/d12/d30/d3c/f4e [0,4194304] 0 2024-02-15T22:41:18.373 INFO:tasks.workunit.client.1.smithi082.stdout:5/661: rename d5/da/d67/fb0 to d5/fe7 0 2024-02-15T22:41:18.373 INFO:tasks.workunit.client.1.smithi082.stdout:5/662: write d5/f2e [5928511,32697] 0 2024-02-15T22:41:18.374 INFO:tasks.workunit.client.1.smithi082.stdout:2/594: creat d6/dc/d12/db1/fb8 x:0 0 0 2024-02-15T22:41:18.374 INFO:tasks.workunit.client.1.smithi082.stdout:6/687: rmdir d2/d18/d8a/d47/d72 39 2024-02-15T22:41:18.378 INFO:tasks.workunit.client.1.smithi082.stdout:8/606: mkdir d1/d40/dbb/dcf 0 2024-02-15T22:41:18.383 INFO:tasks.workunit.client.1.smithi082.stdout:7/701: dwrite d12/d17/f5f [0,4194304] 0 2024-02-15T22:41:18.385 INFO:tasks.workunit.client.1.smithi082.stdout:4/765: rename d0/d8/d32/d39/l6f to d0/d47/da6/l117 0 2024-02-15T22:41:18.386 INFO:tasks.workunit.client.1.smithi082.stdout:0/602: dwrite d3/d6b/dac/fc8 [0,4194304] 0 2024-02-15T22:41:18.387 INFO:tasks.workunit.client.1.smithi082.stdout:5/663: symlink d5/da/d67/da0/d92/le8 0 2024-02-15T22:41:18.387 INFO:tasks.workunit.client.1.smithi082.stdout:5/664: write d5/f4b [2942855,92768] 0 2024-02-15T22:41:18.390 INFO:tasks.workunit.client.1.smithi082.stdout:2/595: mknod d6/dc/d12/d23/cb9 0 2024-02-15T22:41:18.397 INFO:tasks.workunit.client.1.smithi082.stdout:4/766: symlink d0/d47/da6/l118 0 2024-02-15T22:41:18.397 INFO:tasks.workunit.client.1.smithi082.stdout:4/767: creat d0/d8/d1b/f119 x:0 0 0 2024-02-15T22:41:18.401 INFO:tasks.workunit.client.1.smithi082.stdout:9/657: rename d8/d24/d9e to d8/d12/d33/d64/d77/dc6 0 2024-02-15T22:41:18.401 INFO:tasks.workunit.client.1.smithi082.stdout:9/658: creat d8/d12/d33/d3e/fc7 x:0 0 0 2024-02-15T22:41:18.403 INFO:tasks.workunit.client.1.smithi082.stdout:8/607: dwrite d1/d7/de/d1e/fc4 [0,4194304] 0 2024-02-15T22:41:18.403 INFO:tasks.workunit.client.1.smithi082.stdout:8/608: chown d1 249 1 2024-02-15T22:41:18.408 INFO:tasks.workunit.client.1.smithi082.stdout:0/603: mkdir d3/d19/d5f/da5/d9c/dcc 0 2024-02-15T22:41:18.409 INFO:tasks.workunit.client.1.smithi082.stdout:7/702: dwrite d12/d17/d4d/d7d/f9c [0,4194304] 0 2024-02-15T22:41:18.409 INFO:tasks.workunit.client.1.smithi082.stdout:7/703: write d12/d3b/d41/f66 [226180,77554] 0 2024-02-15T22:41:18.409 INFO:tasks.workunit.client.1.smithi082.stdout:7/704: write d12/d17/d3d/f55 [3081808,60524] 0 2024-02-15T22:41:18.409 INFO:tasks.workunit.client.1.smithi082.stdout:7/705: write d12/d27/d6e/f93 [720055,128951] 0 2024-02-15T22:41:18.410 INFO:tasks.workunit.client.1.smithi082.stdout:2/596: symlink d6/dc/d12/d46/d4b/lba 0 2024-02-15T22:41:18.411 INFO:tasks.workunit.client.1.smithi082.stdout:5/665: dwrite d5/da/d67/da0/fc4 [0,4194304] 0 2024-02-15T22:41:18.414 INFO:tasks.workunit.client.1.smithi082.stdout:4/768: creat d0/d46/f11a x:0 0 0 2024-02-15T22:41:18.418 INFO:tasks.workunit.client.1.smithi082.stdout:6/688: rename d2/fad to d2/d45/dc5/fd6 0 2024-02-15T22:41:18.418 INFO:tasks.workunit.client.1.smithi082.stdout:6/689: fdatasync d2/d18/d23/d67/fa3 0 2024-02-15T22:41:18.419 INFO:tasks.workunit.client.1.smithi082.stdout:6/690: fdatasync d2/f5c 0 2024-02-15T22:41:18.424 INFO:tasks.workunit.client.1.smithi082.stdout:9/659: creat d8/db5/fc8 x:0 0 0 2024-02-15T22:41:18.427 INFO:tasks.workunit.client.1.smithi082.stdout:2/597: write d6/dc/f10 [3104642,2254] 0 2024-02-15T22:41:18.429 INFO:tasks.workunit.client.1.smithi082.stdout:8/609: link d1/d7/d48/f64 d1/d7/d78/fd0 0 2024-02-15T22:41:18.434 INFO:tasks.workunit.client.1.smithi082.stdout:0/604: dwrite d3/f15 [0,4194304] 0 2024-02-15T22:41:18.437 INFO:tasks.workunit.client.1.smithi082.stdout:4/769: dwrite d0/d46/fe4 [0,4194304] 0 2024-02-15T22:41:18.441 INFO:tasks.workunit.client.1.smithi082.stdout:7/706: rmdir d12/d37/d85 39 2024-02-15T22:41:18.446 INFO:tasks.workunit.client.1.smithi082.stdout:5/666: rmdir d5/da/d67/da0/dde 39 2024-02-15T22:41:18.451 INFO:tasks.workunit.client.1.smithi082.stdout:6/691: link d2/f98 d2/d18/d8a/d47/d69/db1/fd7 0 2024-02-15T22:41:18.453 INFO:tasks.workunit.client.1.smithi082.stdout:9/660: creat d8/d12/d33/d64/d7c/fc9 x:0 0 0 2024-02-15T22:41:18.453 INFO:tasks.workunit.client.1.smithi082.stdout:9/661: fdatasync d8/d12/d33/f63 0 2024-02-15T22:41:18.455 INFO:tasks.workunit.client.1.smithi082.stdout:9/662: dread d8/d12/d30/d3c/f4e [0,4194304] 0 2024-02-15T22:41:18.455 INFO:tasks.workunit.client.1.smithi082.stdout:9/663: fdatasync d8/f1a 0 2024-02-15T22:41:18.458 INFO:tasks.workunit.client.1.smithi082.stdout:2/598: mkdir d6/dc/dd/d24/d72/dbb 0 2024-02-15T22:41:18.468 INFO:tasks.workunit.client.1.smithi082.stdout:2/599: write d6/dc/dd/d1d/f77 [3461712,52464] 0 2024-02-15T22:41:18.468 INFO:tasks.workunit.client.1.smithi082.stdout:2/600: truncate d6/dc/dd/d24/d71/fa5 798904 0 2024-02-15T22:41:18.468 INFO:tasks.workunit.client.1.smithi082.stdout:8/610: getdents d1/d7/d48 0 2024-02-15T22:41:18.468 INFO:tasks.workunit.client.1.smithi082.stdout:8/611: creat d1/d7/de/d1e/fd1 x:0 0 0 2024-02-15T22:41:18.469 INFO:tasks.workunit.client.1.smithi082.stdout:4/770: dwrite d0/d8/d1b/dd/ff [0,4194304] 0 2024-02-15T22:41:18.469 INFO:tasks.workunit.client.1.smithi082.stdout:5/667: getdents d5/da/d67 0 2024-02-15T22:41:18.473 INFO:tasks.workunit.client.1.smithi082.stdout:2/601: rename d6/d18/f37 to d6/dc/dd/d21/d9f/fbc 0 2024-02-15T22:41:18.473 INFO:tasks.workunit.client.1.smithi082.stdout:2/602: creat d6/dc/dd/d1d/fbd x:0 0 0 2024-02-15T22:41:18.473 INFO:tasks.workunit.client.1.smithi082.stdout:2/603: chown d6/dc/d58/l6a 4 1 2024-02-15T22:41:18.476 INFO:tasks.workunit.client.1.smithi082.stdout:4/771: symlink d0/d47/da6/d114/l11b 0 2024-02-15T22:41:18.476 INFO:tasks.workunit.client.1.smithi082.stdout:4/772: chown d0/d8/d32 10884765 1 2024-02-15T22:41:18.485 INFO:tasks.workunit.client.1.smithi082.stdout:2/604: dread d6/dc/dd/d21/d9f/fbc [0,4194304] 0 2024-02-15T22:41:18.486 INFO:tasks.workunit.client.1.smithi082.stdout:4/773: dread d0/d8/d1b/d70/fd7 [0,4194304] 0 2024-02-15T22:41:18.486 INFO:tasks.workunit.client.1.smithi082.stdout:4/774: truncate d0/d8/d32/d39/da4/fae 161129 0 2024-02-15T22:41:18.486 INFO:tasks.workunit.client.1.smithi082.stdout:4/775: write d0/d8/d1b/f8d [295386,89079] 0 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:0/605: dwrite d3/d19/d1c/f50 [0,4194304] 0 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/707: dwrite d12/d3b/fea [0,4194304] 0 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/708: fdatasync d12/d17/d42/d67/d79/f96 0 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/709: fdatasync d12/d17/d42/f53 0 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/710: getdents d12/d27/d6e/d6a/db2/dbb/dc6 0 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/711: chown d12/d17/cae 46141416 1 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/712: truncate d12/d3b/d5a/fb7 1558071 0 2024-02-15T22:41:18.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/713: write d12/d17/d42/f53 [3158201,98183] 0 2024-02-15T22:41:18.491 INFO:tasks.workunit.client.1.smithi082.stdout:0/606: unlink d3/f30 0 2024-02-15T22:41:18.491 INFO:tasks.workunit.client.1.smithi082.stdout:0/607: chown d3/d64/l9f 204 1 2024-02-15T22:41:18.492 INFO:tasks.workunit.client.1.smithi082.stdout:7/714: dread - d12/d3b/d5a/dce/fab zero size 2024-02-15T22:41:18.494 INFO:tasks.workunit.client.1.smithi082.stdout:0/608: creat d3/d19/d5f/da0/dbc/fcd x:0 0 0 2024-02-15T22:41:18.494 INFO:tasks.workunit.client.1.smithi082.stdout:0/609: chown d3 9913 1 2024-02-15T22:41:18.499 INFO:tasks.workunit.client.1.smithi082.stdout:9/664: dwrite d8/f11 [0,4194304] 0 2024-02-15T22:41:18.499 INFO:tasks.workunit.client.1.smithi082.stdout:2/605: dread d6/dc/d58/fe [4194304,4194304] 0 2024-02-15T22:41:18.500 INFO:tasks.workunit.client.1.smithi082.stdout:6/692: dwrite d2/d18/d8a/d47/d72/d80/fb4 [0,4194304] 0 2024-02-15T22:41:18.501 INFO:tasks.workunit.client.1.smithi082.stdout:9/665: rmdir d8/d12/d33/d64/dc3 0 2024-02-15T22:41:18.502 INFO:tasks.workunit.client.1.smithi082.stdout:9/666: write d8/d12/d33/fbb [469819,108659] 0 2024-02-15T22:41:18.503 INFO:tasks.workunit.client.1.smithi082.stdout:2/606: rename d6/dc/dd/l52 to d6/dc/d58/d49/lbe 0 2024-02-15T22:41:18.505 INFO:tasks.workunit.client.1.smithi082.stdout:6/693: dread d2/fa5 [0,4194304] 0 2024-02-15T22:41:18.506 INFO:tasks.workunit.client.1.smithi082.stdout:6/694: dread d2/d18/d8a/f8f [0,4194304] 0 2024-02-15T22:41:18.506 INFO:tasks.workunit.client.1.smithi082.stdout:8/612: dwrite d1/d7/d9/d42/f46 [0,4194304] 0 2024-02-15T22:41:18.506 INFO:tasks.workunit.client.1.smithi082.stdout:8/613: stat d1/d7/de/d57/cb9 0 2024-02-15T22:41:18.507 INFO:tasks.workunit.client.1.smithi082.stdout:8/614: stat d1/d7/d9/d24/d43/da6/db6/dca/f9b 0 2024-02-15T22:41:18.507 INFO:tasks.workunit.client.1.smithi082.stdout:8/615: chown d1/d7/d9/d24/d43/lc0 96657 1 2024-02-15T22:41:18.507 INFO:tasks.workunit.client.1.smithi082.stdout:5/668: dwrite d5/da/dc/f15 [0,4194304] 0 2024-02-15T22:41:18.511 INFO:tasks.workunit.client.1.smithi082.stdout:9/667: mknod d8/d12/dc5/cca 0 2024-02-15T22:41:18.511 INFO:tasks.workunit.client.1.smithi082.stdout:9/668: write d8/d24/d2e/f6a [2124240,114961] 0 2024-02-15T22:41:18.513 INFO:tasks.workunit.client.1.smithi082.stdout:2/607: mknod d6/dc/d12/d23/d6e/cbf 0 2024-02-15T22:41:18.513 INFO:tasks.workunit.client.1.smithi082.stdout:2/608: chown d6/dc/dd/d21/l45 65405 1 2024-02-15T22:41:18.513 INFO:tasks.workunit.client.1.smithi082.stdout:2/609: dread - d6/dc/dd/d1d/fbd zero size 2024-02-15T22:41:18.513 INFO:tasks.workunit.client.1.smithi082.stdout:2/610: dread - d6/dc/d12/db1/fb8 zero size 2024-02-15T22:41:18.514 INFO:tasks.workunit.client.1.smithi082.stdout:6/695: creat d2/d18/d8a/d47/d69/dd0/fd8 x:0 0 0 2024-02-15T22:41:18.514 INFO:tasks.workunit.client.1.smithi082.stdout:6/696: creat d2/d18/d8a/d65/fd9 x:0 0 0 2024-02-15T22:41:18.517 INFO:tasks.workunit.client.1.smithi082.stdout:8/616: link d1/d7/de/l15 d1/d7/d9/d24/d30/ld2 0 2024-02-15T22:41:18.523 INFO:tasks.workunit.client.1.smithi082.stdout:4/776: dwrite d0/d8/d1b/f35 [0,4194304] 0 2024-02-15T22:41:18.523 INFO:tasks.workunit.client.1.smithi082.stdout:4/777: chown d0/d16/f3a 165438140 1 2024-02-15T22:41:18.523 INFO:tasks.workunit.client.1.smithi082.stdout:4/778: readlink d0/d46/dd3/l101 0 2024-02-15T22:41:18.528 INFO:tasks.workunit.client.1.smithi082.stdout:2/611: write d6/d3c/f9d [2306069,89638] 0 2024-02-15T22:41:18.528 INFO:tasks.workunit.client.1.smithi082.stdout:2/612: chown d6/dc/d12/c25 103432 1 2024-02-15T22:41:18.528 INFO:tasks.workunit.client.1.smithi082.stdout:0/610: dwrite d3/f12 [0,4194304] 0 2024-02-15T22:41:18.528 INFO:tasks.workunit.client.1.smithi082.stdout:0/611: chown d3/d19/d5f/da5/l59 0 1 2024-02-15T22:41:18.528 INFO:tasks.workunit.client.1.smithi082.stdout:5/669: dwrite d5/da/dc/dad/dcf/d59/fb5 [0,4194304] 0 2024-02-15T22:41:18.528 INFO:tasks.workunit.client.1.smithi082.stdout:5/670: fdatasync d5/da/d56/d6e/f81 0 2024-02-15T22:41:18.542 INFO:tasks.workunit.client.1.smithi082.stdout:9/669: mkdir d8/d24/d87/dcb 0 2024-02-15T22:41:18.549 INFO:tasks.workunit.client.1.smithi082.stdout:6/697: symlink d2/d18/d8a/d47/d69/dc1/lda 0 2024-02-15T22:41:18.550 INFO:tasks.workunit.client.1.smithi082.stdout:2/613: dwrite d6/dc/d58/d49/db6/fb3 [4194304,4194304] 0 2024-02-15T22:41:18.551 INFO:tasks.workunit.client.1.smithi082.stdout:2/614: fsync d6/dc/dd/d1d/f50 0 2024-02-15T22:41:18.551 INFO:tasks.workunit.client.1.smithi082.stdout:8/617: mknod d1/d7/d9/d24/d43/da6/db8/cd3 0 2024-02-15T22:41:18.552 INFO:tasks.workunit.client.1.smithi082.stdout:4/779: dwrite d0/f23 [0,4194304] 0 2024-02-15T22:41:18.553 INFO:tasks.workunit.client.1.smithi082.stdout:6/698: write d2/f3 [1038681,124518] 0 2024-02-15T22:41:18.557 INFO:tasks.workunit.client.1.smithi082.stdout:5/671: mkdir d5/da/de3/de9 0 2024-02-15T22:41:18.561 INFO:tasks.workunit.client.1.smithi082.stdout:2/615: creat d6/dc/dd/d24/fc0 x:0 0 0 2024-02-15T22:41:18.561 INFO:tasks.workunit.client.1.smithi082.stdout:2/616: readlink d6/lf 0 2024-02-15T22:41:18.561 INFO:tasks.workunit.client.1.smithi082.stdout:3/622: sync 2024-02-15T22:41:18.561 INFO:tasks.workunit.client.1.smithi082.stdout:8/618: mkdir d1/d7/d9/d42/d6a/da5/dd4 0 2024-02-15T22:41:18.563 INFO:tasks.workunit.client.1.smithi082.stdout:4/780: symlink d0/d16/d4a/dc5/l11c 0 2024-02-15T22:41:18.567 INFO:tasks.workunit.client.1.smithi082.stdout:5/672: rmdir d5/da/dc/dad/dcf/d59/d84/de4 0 2024-02-15T22:41:18.568 INFO:tasks.workunit.client.1.smithi082.stdout:5/673: fsync d5/da/d67/da0/d92/fda 0 2024-02-15T22:41:18.568 INFO:tasks.workunit.client.1.smithi082.stdout:5/674: chown d5/da/dc/dad/dcf/d59/d84/d89/ca1 14107988 1 2024-02-15T22:41:18.570 INFO:tasks.workunit.client.1.smithi082.stdout:3/623: dread d0/f43 [0,4194304] 0 2024-02-15T22:41:18.572 INFO:tasks.workunit.client.1.smithi082.stdout:4/781: symlink d0/d16/d4a/d6a/l11d 0 2024-02-15T22:41:18.574 INFO:tasks.workunit.client.1.smithi082.stdout:1/634: sync 2024-02-15T22:41:18.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/699: rmdir d2/d18/d8a/d47/d69/dd0 39 2024-02-15T22:41:18.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/700: write d2/f3 [1127649,40106] 0 2024-02-15T22:41:18.575 INFO:tasks.workunit.client.1.smithi082.stdout:2/617: dread d6/d18/faf [0,4194304] 0 2024-02-15T22:41:18.577 INFO:tasks.workunit.client.1.smithi082.stdout:6/701: dread d2/f98 [0,4194304] 0 2024-02-15T22:41:18.578 INFO:tasks.workunit.client.1.smithi082.stdout:3/624: rmdir d0/d16/d62/d14/d21 39 2024-02-15T22:41:18.579 INFO:tasks.workunit.client.1.smithi082.stdout:1/635: mknod d1/da/d11/d8c/cd2 0 2024-02-15T22:41:18.582 INFO:tasks.workunit.client.1.smithi082.stdout:2/618: creat d6/dc/d58/fc1 x:0 0 0 2024-02-15T22:41:18.582 INFO:tasks.workunit.client.1.smithi082.stdout:2/619: readlink d6/dc/d58/d49/lbe 0 2024-02-15T22:41:18.582 INFO:tasks.workunit.client.1.smithi082.stdout:2/620: read - d6/dc/d12/d23/d6e/f95 zero size 2024-02-15T22:41:18.584 INFO:tasks.workunit.client.1.smithi082.stdout:5/675: rmdir d5/da/dc/dad/dcf/d59/da3 39 2024-02-15T22:41:18.585 INFO:tasks.workunit.client.1.smithi082.stdout:3/625: write d0/d16/f3a [3684624,20993] 0 2024-02-15T22:41:18.587 INFO:tasks.workunit.client.1.smithi082.stdout:1/636: dread d1/da/d14/d18/d51/f71 [0,4194304] 0 2024-02-15T22:41:18.587 INFO:tasks.workunit.client.1.smithi082.stdout:3/626: dread d0/d16/d62/d14/f2a [0,4194304] 0 2024-02-15T22:41:18.587 INFO:tasks.workunit.client.1.smithi082.stdout:3/627: readlink d0/d16/d62/d2e/dcc/ld2 0 2024-02-15T22:41:18.587 INFO:tasks.workunit.client.1.smithi082.stdout:3/628: write d0/d16/d3e/f5f [3806190,98245] 0 2024-02-15T22:41:18.589 INFO:tasks.workunit.client.1.smithi082.stdout:2/621: unlink d6/f26 0 2024-02-15T22:41:18.591 INFO:tasks.workunit.client.1.smithi082.stdout:3/629: truncate d0/d16/d62/d14/d21/d69/d87/f8f 2484351 0 2024-02-15T22:41:18.596 INFO:tasks.workunit.client.1.smithi082.stdout:3/630: creat d0/d16/d62/d14/d21/d7d/fd6 x:0 0 0 2024-02-15T22:41:18.605 INFO:tasks.workunit.client.1.smithi082.stdout:4/782: dwrite d0/d46/fe4 [0,4194304] 0 2024-02-15T22:41:18.607 INFO:tasks.workunit.client.1.smithi082.stdout:4/783: symlink d0/d46/dd3/l11e 0 2024-02-15T22:41:18.608 INFO:tasks.workunit.client.1.smithi082.stdout:8/619: dwrite d1/d7/de/f32 [4194304,4194304] 0 2024-02-15T22:41:18.609 INFO:tasks.workunit.client.1.smithi082.stdout:4/784: symlink d0/dc0/dcd/de3/l11f 0 2024-02-15T22:41:18.611 INFO:tasks.workunit.client.1.smithi082.stdout:8/620: rename d1/f1b to d1/d7/d9/d42/fd5 0 2024-02-15T22:41:18.611 INFO:tasks.workunit.client.1.smithi082.stdout:8/621: write d1/d7/de/d1e/fc4 [4702563,58565] 0 2024-02-15T22:41:18.612 INFO:tasks.workunit.client.1.smithi082.stdout:4/785: mkdir d0/d47/da6/d120 0 2024-02-15T22:41:18.612 INFO:tasks.workunit.client.1.smithi082.stdout:4/786: write d0/dc0/dcd/ffc [220203,33131] 0 2024-02-15T22:41:18.618 INFO:tasks.workunit.client.1.smithi082.stdout:5/676: dwrite d5/da/d67/da0/dde/f8e [0,4194304] 0 2024-02-15T22:41:18.618 INFO:tasks.workunit.client.1.smithi082.stdout:2/622: dwrite d6/dc/d12/d46/d4b/d63/fb0 [0,4194304] 0 2024-02-15T22:41:18.618 INFO:tasks.workunit.client.1.smithi082.stdout:2/623: truncate d6/d18/f75 1675400 0 2024-02-15T22:41:18.619 INFO:tasks.workunit.client.1.smithi082.stdout:5/677: rmdir d5/da/dc/dad/dcf/d59 39 2024-02-15T22:41:18.623 INFO:tasks.workunit.client.1.smithi082.stdout:3/631: dwrite d0/d16/d62/d79/fd4 [0,4194304] 0 2024-02-15T22:41:18.623 INFO:tasks.workunit.client.1.smithi082.stdout:8/622: dread d1/d7/d9/d42/dc5/f79 [0,4194304] 0 2024-02-15T22:41:18.624 INFO:tasks.workunit.client.1.smithi082.stdout:2/624: unlink d6/d18/c34 0 2024-02-15T22:41:18.627 INFO:tasks.workunit.client.1.smithi082.stdout:5/678: creat d5/da/dc/dad/dcf/d59/d84/d89/fea x:0 0 0 2024-02-15T22:41:18.631 INFO:tasks.workunit.client.1.smithi082.stdout:4/787: dwrite d0/d8/d1b/f119 [0,4194304] 0 2024-02-15T22:41:18.632 INFO:tasks.workunit.client.1.smithi082.stdout:4/788: dread - d0/d47/da6/da7/d108/f116 zero size 2024-02-15T22:41:18.632 INFO:tasks.workunit.client.1.smithi082.stdout:8/623: creat d1/d7/d9/d24/d43/da6/db8/fd6 x:0 0 0 2024-02-15T22:41:18.637 INFO:tasks.workunit.client.1.smithi082.stdout:3/632: write d0/d16/d62/d2e/d84/f64 [3111718,78834] 0 2024-02-15T22:41:18.637 INFO:tasks.workunit.client.1.smithi082.stdout:5/679: write d5/da/dc/d43/f4d [3873048,47347] 0 2024-02-15T22:41:18.637 INFO:tasks.workunit.client.1.smithi082.stdout:5/680: read - d5/da/d67/da0/fc6 zero size 2024-02-15T22:41:18.637 INFO:tasks.workunit.client.1.smithi082.stdout:5/681: truncate d5/da/d14/d53/f70 1240959 0 2024-02-15T22:41:18.637 INFO:tasks.workunit.client.1.smithi082.stdout:4/789: mknod d0/dc0/dcd/c121 0 2024-02-15T22:41:18.639 INFO:tasks.workunit.client.1.smithi082.stdout:8/624: rename d1/d7/de/d1e/f39 to d1/d7/d9/d24/d43/da6/db6/fd7 0 2024-02-15T22:41:18.643 INFO:tasks.workunit.client.1.smithi082.stdout:3/633: rename d0/d16/d62/fa0 to d0/d16/d62/d79/fd7 0 2024-02-15T22:41:18.644 INFO:tasks.workunit.client.1.smithi082.stdout:8/625: mkdir d1/d7/d9/d42/d6a/da5/dd4/dd8 0 2024-02-15T22:41:18.646 INFO:tasks.workunit.client.1.smithi082.stdout:2/625: dwrite d6/dc/d12/d46/d4b/f69 [0,4194304] 0 2024-02-15T22:41:18.647 INFO:tasks.workunit.client.1.smithi082.stdout:5/682: rename d5/da/d14/l72 to d5/leb 0 2024-02-15T22:41:18.650 INFO:tasks.workunit.client.1.smithi082.stdout:8/626: creat d1/d40/dbb/dce/fd9 x:0 0 0 2024-02-15T22:41:18.650 INFO:tasks.workunit.client.1.smithi082.stdout:4/790: dread d0/d8/d32/d39/fab [0,4194304] 0 2024-02-15T22:41:18.653 INFO:tasks.workunit.client.1.smithi082.stdout:2/626: symlink d6/dc/d12/d23/lc2 0 2024-02-15T22:41:18.654 INFO:tasks.workunit.client.1.smithi082.stdout:2/627: fdatasync d6/dc/d58/d49/d5e/f73 0 2024-02-15T22:41:18.655 INFO:tasks.workunit.client.1.smithi082.stdout:5/683: symlink d5/da/de3/lec 0 2024-02-15T22:41:18.658 INFO:tasks.workunit.client.1.smithi082.stdout:3/634: mknod d0/dc/d3f/dc4/cd8 0 2024-02-15T22:41:18.660 INFO:tasks.workunit.client.1.smithi082.stdout:8/627: symlink d1/dcc/lda 0 2024-02-15T22:41:18.660 INFO:tasks.workunit.client.1.smithi082.stdout:8/628: truncate d1/d7/d78/fb1 698045 0 2024-02-15T22:41:18.662 INFO:tasks.workunit.client.1.smithi082.stdout:5/684: dread d5/da/f23 [0,4194304] 0 2024-02-15T22:41:18.663 INFO:tasks.workunit.client.1.smithi082.stdout:4/791: creat d0/dc0/dcd/de3/f122 x:0 0 0 2024-02-15T22:41:18.669 INFO:tasks.workunit.client.1.smithi082.stdout:2/628: rmdir d6/dc/dd/d21/d8e 0 2024-02-15T22:41:18.669 INFO:tasks.workunit.client.1.smithi082.stdout:2/629: chown d6/l62 80454 1 2024-02-15T22:41:18.669 INFO:tasks.workunit.client.1.smithi082.stdout:2/630: readlink d6/dc/d58/l6a 0 2024-02-15T22:41:18.669 INFO:tasks.workunit.client.1.smithi082.stdout:2/631: truncate d6/dc/dd/d24/d71/f7a 866063 0 2024-02-15T22:41:18.669 INFO:tasks.workunit.client.1.smithi082.stdout:8/629: write d1/d7/de/d57/f74 [1839459,80939] 0 2024-02-15T22:41:18.669 INFO:tasks.workunit.client.1.smithi082.stdout:3/635: write d0/d16/f12 [257856,82819] 0 2024-02-15T22:41:18.670 INFO:tasks.workunit.client.1.smithi082.stdout:4/792: mknod d0/d8/d32/d39/c123 0 2024-02-15T22:41:18.674 INFO:tasks.workunit.client.1.smithi082.stdout:2/632: truncate d6/dc/d12/d46/d4b/d63/fb0 283158 0 2024-02-15T22:41:18.674 INFO:tasks.workunit.client.1.smithi082.stdout:2/633: creat d6/dc/d12/d46/d4b/d63/fc3 x:0 0 0 2024-02-15T22:41:18.674 INFO:tasks.workunit.client.1.smithi082.stdout:2/634: chown d6/d18/f22 8373 1 2024-02-15T22:41:18.674 INFO:tasks.workunit.client.1.smithi082.stdout:2/635: chown d6/dc/d12/d46/d76/f91 13 1 2024-02-15T22:41:18.674 INFO:tasks.workunit.client.1.smithi082.stdout:2/636: fdatasync d6/dc/dd/d24/d71/fa5 0 2024-02-15T22:41:18.675 INFO:tasks.workunit.client.1.smithi082.stdout:3/636: creat d0/d16/d3e/d56/fd9 x:0 0 0 2024-02-15T22:41:18.677 INFO:tasks.workunit.client.1.smithi082.stdout:4/793: creat d0/d47/da6/d120/f124 x:0 0 0 2024-02-15T22:41:18.683 INFO:tasks.workunit.client.1.smithi082.stdout:2/637: dread d6/dc/dd/d24/d71/f9c [0,4194304] 0 2024-02-15T22:41:18.683 INFO:tasks.workunit.client.1.smithi082.stdout:2/638: readlink d6/dc/d12/d23/lc2 0 2024-02-15T22:41:18.683 INFO:tasks.workunit.client.1.smithi082.stdout:4/794: symlink d0/d46/df9/l125 0 2024-02-15T22:41:18.689 INFO:tasks.workunit.client.1.smithi082.stdout:3/637: rename d0/d16/f3a to d0/dc/d3f/fda 0 2024-02-15T22:41:18.691 INFO:tasks.workunit.client.1.smithi082.stdout:3/638: mknod d0/d16/d62/d79/cdb 0 2024-02-15T22:41:18.696 INFO:tasks.workunit.client.1.smithi082.stdout:3/639: symlink d0/d16/d62/d14/d21/d69/d87/ldc 0 2024-02-15T22:41:18.697 INFO:tasks.workunit.client.1.smithi082.stdout:3/640: chown d0/c5 21345051 1 2024-02-15T22:41:18.697 INFO:tasks.workunit.client.1.smithi082.stdout:3/641: truncate d0/dc/fd 10681845 0 2024-02-15T22:41:18.697 INFO:tasks.workunit.client.1.smithi082.stdout:3/642: fsync d0/d16/d62/f31 0 2024-02-15T22:41:18.700 INFO:tasks.workunit.client.1.smithi082.stdout:3/643: creat d0/d16/d62/d14/d21/d69/dbe/fdd x:0 0 0 2024-02-15T22:41:18.708 INFO:tasks.workunit.client.1.smithi082.stdout:2/639: dwrite d6/dc/dd/d1d/fbd [0,4194304] 0 2024-02-15T22:41:18.709 INFO:tasks.workunit.client.1.smithi082.stdout:4/795: dwrite d0/d16/f2b [0,4194304] 0 2024-02-15T22:41:18.714 INFO:tasks.workunit.client.1.smithi082.stdout:3/644: dwrite d0/d16/d3e/d56/fd9 [0,4194304] 0 2024-02-15T22:41:18.716 INFO:tasks.workunit.client.1.smithi082.stdout:2/640: unlink d6/d18/fb2 0 2024-02-15T22:41:18.722 INFO:tasks.workunit.client.1.smithi082.stdout:2/641: creat d6/dc/dd/d24/d72/fc4 x:0 0 0 2024-02-15T22:41:18.725 INFO:tasks.workunit.client.1.smithi082.stdout:3/645: dread d0/d16/d62/f7 [0,4194304] 0 2024-02-15T22:41:18.725 INFO:tasks.workunit.client.1.smithi082.stdout:3/646: stat d0/d16/d62/d14/d71/d86/lb2 0 2024-02-15T22:41:18.726 INFO:tasks.workunit.client.1.smithi082.stdout:4/796: dwrite d0/fc2 [0,4194304] 0 2024-02-15T22:41:18.726 INFO:tasks.workunit.client.1.smithi082.stdout:3/647: symlink d0/d16/d62/d79/dcb/lde 0 2024-02-15T22:41:18.729 INFO:tasks.workunit.client.1.smithi082.stdout:2/642: write d6/dc/d58/f17 [1066557,111413] 0 2024-02-15T22:41:18.729 INFO:tasks.workunit.client.1.smithi082.stdout:2/643: fsync d6/dc/d58/d49/fa6 0 2024-02-15T22:41:18.729 INFO:tasks.workunit.client.1.smithi082.stdout:2/644: chown d6/dc/d58/l15 1856577 1 2024-02-15T22:41:18.730 INFO:tasks.workunit.client.1.smithi082.stdout:4/797: creat d0/d47/da6/da7/f126 x:0 0 0 2024-02-15T22:41:18.730 INFO:tasks.workunit.client.1.smithi082.stdout:4/798: write d0/d8/d1b/fb3 [267414,122873] 0 2024-02-15T22:41:18.730 INFO:tasks.workunit.client.1.smithi082.stdout:3/648: rmdir d0/d16/d62/d2e/dcc 39 2024-02-15T22:41:18.731 INFO:tasks.workunit.client.1.smithi082.stdout:2/645: creat d6/dc/d12/d23/da7/fc5 x:0 0 0 2024-02-15T22:41:18.734 INFO:tasks.workunit.client.1.smithi082.stdout:3/649: creat d0/d16/d62/d14/d21/d69/d87/fdf x:0 0 0 2024-02-15T22:41:18.734 INFO:tasks.workunit.client.1.smithi082.stdout:3/650: stat d0/d16/d62/f50 0 2024-02-15T22:41:18.735 INFO:tasks.workunit.client.1.smithi082.stdout:4/799: link d0/d8/d1b/dd/l68 d0/d46/l127 0 2024-02-15T22:41:18.735 INFO:tasks.workunit.client.1.smithi082.stdout:4/800: chown d0/d8/d1b/fb3 4576 1 2024-02-15T22:41:18.736 INFO:tasks.workunit.client.1.smithi082.stdout:4/801: write d0/d8/d1b/dd/fbc [624913,56208] 0 2024-02-15T22:41:18.736 INFO:tasks.workunit.client.1.smithi082.stdout:3/651: rmdir d0/d16/d62/d14/d21 39 2024-02-15T22:41:18.736 INFO:tasks.workunit.client.1.smithi082.stdout:3/652: chown d0/d16/d62/d14/d21/d41/f67 0 1 2024-02-15T22:41:18.739 INFO:tasks.workunit.client.1.smithi082.stdout:4/802: rename d0/d46/dd3 to d0/d47/da6/d128 0 2024-02-15T22:41:18.740 INFO:tasks.workunit.client.1.smithi082.stdout:3/653: symlink d0/le0 0 2024-02-15T22:41:18.741 INFO:tasks.workunit.client.1.smithi082.stdout:4/803: symlink d0/d47/d4d/l129 0 2024-02-15T22:41:18.743 INFO:tasks.workunit.client.1.smithi082.stdout:3/654: mkdir d0/d16/d3e/d56/db0/de1 0 2024-02-15T22:41:18.743 INFO:tasks.workunit.client.1.smithi082.stdout:4/804: creat d0/d8/d32/d39/da4/f12a x:0 0 0 2024-02-15T22:41:18.745 INFO:tasks.workunit.client.1.smithi082.stdout:3/655: creat d0/d16/d62/d14/d21/d69/d91/fe2 x:0 0 0 2024-02-15T22:41:18.745 INFO:tasks.workunit.client.1.smithi082.stdout:4/805: rmdir d0/d47/dd8 39 2024-02-15T22:41:18.745 INFO:tasks.workunit.client.1.smithi082.stdout:4/806: chown d0/d47/da6/da7/d108/f109 123525151 1 2024-02-15T22:41:18.747 INFO:tasks.workunit.client.1.smithi082.stdout:4/807: link d0/c6c d0/d16/d4a/d6a/dd9/c12b 0 2024-02-15T22:41:18.748 INFO:tasks.workunit.client.1.smithi082.stdout:4/808: rmdir d0/d47/dd8 39 2024-02-15T22:41:18.751 INFO:tasks.workunit.client.1.smithi082.stdout:4/809: rmdir d0/d47/da6/d120 39 2024-02-15T22:41:18.751 INFO:tasks.workunit.client.1.smithi082.stdout:2/646: dwrite d6/dc/dd/f8a [0,4194304] 0 2024-02-15T22:41:18.753 INFO:tasks.workunit.client.1.smithi082.stdout:4/810: link d0/d16/fd5 d0/dc0/dcd/f12c 0 2024-02-15T22:41:18.758 INFO:tasks.workunit.client.1.smithi082.stdout:2/647: write d6/d18/faf [206313,58711] 0 2024-02-15T22:41:18.759 INFO:tasks.workunit.client.1.smithi082.stdout:3/656: dread d0/d16/d62/d2e/f89 [0,4194304] 0 2024-02-15T22:41:18.759 INFO:tasks.workunit.client.1.smithi082.stdout:3/657: write d0/d16/d62/f6d [302514,112324] 0 2024-02-15T22:41:18.759 INFO:tasks.workunit.client.1.smithi082.stdout:3/658: dread d0/d16/d62/d14/d21/fa5 [0,4194304] 0 2024-02-15T22:41:18.761 INFO:tasks.workunit.client.1.smithi082.stdout:2/648: unlink d6/d18/c88 0 2024-02-15T22:41:18.761 INFO:tasks.workunit.client.1.smithi082.stdout:2/649: write d6/fad [322559,46735] 0 2024-02-15T22:41:18.769 INFO:tasks.workunit.client.1.smithi082.stdout:2/650: dread d6/dc/dd/d21/f5a [0,4194304] 0 2024-02-15T22:41:18.778 INFO:tasks.workunit.client.1.smithi082.stdout:4/811: dwrite d0/d8/d32/fbf [0,4194304] 0 2024-02-15T22:41:18.779 INFO:tasks.workunit.client.1.smithi082.stdout:3/659: dwrite d0/d16/d62/d14/d21/d69/d87/f8f [0,4194304] 0 2024-02-15T22:41:18.779 INFO:tasks.workunit.client.1.smithi082.stdout:3/660: write d0/d16/d62/d14/d21/d69/d91/fa1 [1510333,122398] 0 2024-02-15T22:41:18.779 INFO:tasks.workunit.client.1.smithi082.stdout:3/661: chown d0/d16/d3e/d56/fd9 5 1 2024-02-15T22:41:18.788 INFO:tasks.workunit.client.1.smithi082.stdout:4/812: write d0/d8/d32/f4e [3036121,69390] 0 2024-02-15T22:41:18.800 INFO:tasks.workunit.client.1.smithi082.stdout:2/651: dwrite d6/fad [0,4194304] 0 2024-02-15T22:41:18.801 INFO:tasks.workunit.client.1.smithi082.stdout:2/652: symlink d6/lc6 0 2024-02-15T22:41:18.801 INFO:tasks.workunit.client.1.smithi082.stdout:2/653: readlink d6/d18/l33 0 2024-02-15T22:41:18.805 INFO:tasks.workunit.client.1.smithi082.stdout:2/654: dread d6/dc/dd/f9a [0,4194304] 0 2024-02-15T22:41:18.810 INFO:tasks.workunit.client.1.smithi082.stdout:3/662: dwrite d0/d16/d62/d2e/d84/f64 [4194304,4194304] 0 2024-02-15T22:41:18.812 INFO:tasks.workunit.client.1.smithi082.stdout:4/813: dwrite d0/d46/fc7 [0,4194304] 0 2024-02-15T22:41:18.821 INFO:tasks.workunit.client.1.smithi082.stdout:4/814: truncate d0/d8/d1b/d70/fd7 2643569 0 2024-02-15T22:41:18.835 INFO:tasks.workunit.client.1.smithi082.stdout:4/815: dread d0/d46/fc7 [0,4194304] 0 2024-02-15T22:41:18.835 INFO:tasks.workunit.client.1.smithi082.stdout:4/816: write d0/d16/d87/f8e [338408,85513] 0 2024-02-15T22:41:18.836 INFO:tasks.workunit.client.1.smithi082.stdout:7/715: sync 2024-02-15T22:41:18.839 INFO:tasks.workunit.client.1.smithi082.stdout:2/655: dwrite d6/dc/f38 [0,4194304] 0 2024-02-15T22:41:18.839 INFO:tasks.workunit.client.1.smithi082.stdout:2/656: readlink d6/d18/l79 0 2024-02-15T22:41:18.839 INFO:tasks.workunit.client.1.smithi082.stdout:2/657: chown d6/dc/d12/d46/f7c 949297 1 2024-02-15T22:41:18.841 INFO:tasks.workunit.client.1.smithi082.stdout:3/663: dwrite d0/dc/d3f/f76 [0,4194304] 0 2024-02-15T22:41:18.851 INFO:tasks.workunit.client.1.smithi082.stdout:4/817: dwrite d0/f31 [0,4194304] 0 2024-02-15T22:41:18.851 INFO:tasks.workunit.client.1.smithi082.stdout:4/818: chown d0/d46/df9/l125 30810892 1 2024-02-15T22:41:18.933 INFO:tasks.workunit.client.1.smithi082.stdout:7/716: unlink d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/cd6 0 2024-02-15T22:41:18.936 INFO:tasks.workunit.client.1.smithi082.stdout:2/658: truncate d6/dc/d58/d49/d5e/f60 1705487 0 2024-02-15T22:41:18.941 INFO:tasks.workunit.client.1.smithi082.stdout:7/717: write d12/d37/f70 [2756527,69393] 0 2024-02-15T22:41:18.947 INFO:tasks.workunit.client.1.smithi082.stdout:2/659: dread d6/dc/dd/d1d/f1f [0,4194304] 0 2024-02-15T22:41:18.947 INFO:tasks.workunit.client.1.smithi082.stdout:2/660: chown d6/dc/dd/d21/d9f/fbc 46 1 2024-02-15T22:41:18.947 INFO:tasks.workunit.client.1.smithi082.stdout:2/661: dread - d6/dc/d58/d49/d5e/f73 zero size 2024-02-15T22:41:18.953 INFO:tasks.workunit.client.1.smithi082.stdout:3/664: unlink d0/d16/d62/d14/d71/d86/lb2 0 2024-02-15T22:41:18.964 INFO:tasks.workunit.client.1.smithi082.stdout:7/718: mkdir d12/d27/d6e/d6a/db2/ded 0 2024-02-15T22:41:18.965 INFO:tasks.workunit.client.1.smithi082.stdout:3/665: write d0/dc/d3f/f78 [618748,85359] 0 2024-02-15T22:41:18.965 INFO:tasks.workunit.client.1.smithi082.stdout:3/666: fdatasync d0/d16/d62/f7 0 2024-02-15T22:41:18.995 INFO:tasks.workunit.client.1.smithi082.stdout:7/719: dwrite d12/d27/f6d [0,4194304] 0 2024-02-15T22:41:18.995 INFO:tasks.workunit.client.1.smithi082.stdout:3/667: dwrite d0/d16/d3e/f5f [0,4194304] 0 2024-02-15T22:41:18.995 INFO:tasks.workunit.client.1.smithi082.stdout:3/668: truncate d0/dc/d3f/f76 4282344 0 2024-02-15T22:41:19.009 INFO:tasks.workunit.client.1.smithi082.stdout:3/669: dwrite d0/d16/f97 [0,4194304] 0 2024-02-15T22:41:19.028 INFO:tasks.workunit.client.1.smithi082.stdout:7/720: write d12/d3b/d5a/dce/fca [698845,38919] 0 2024-02-15T22:41:19.059 INFO:tasks.workunit.client.1.smithi082.stdout:3/670: truncate d0/d16/d62/d79/fd7 359820 0 2024-02-15T22:41:19.059 INFO:tasks.workunit.client.1.smithi082.stdout:3/671: fdatasync d0/d16/d62/f31 0 2024-02-15T22:41:19.068 INFO:tasks.workunit.client.1.smithi082.stdout:3/672: mknod d0/d16/d62/d14/d21/d69/d6c/ce3 0 2024-02-15T22:41:19.068 INFO:tasks.workunit.client.1.smithi082.stdout:3/673: chown d0/d16/d3e/ld1 0 1 2024-02-15T22:41:19.069 INFO:tasks.workunit.client.1.smithi082.stdout:3/674: creat d0/d16/d62/d14/fe4 x:0 0 0 2024-02-15T22:41:19.069 INFO:tasks.workunit.client.1.smithi082.stdout:3/675: write d0/d16/d62/d14/d21/d69/d91/fa1 [2193972,39552] 0 2024-02-15T22:41:19.071 INFO:tasks.workunit.client.1.smithi082.stdout:3/676: write d0/fa9 [401371,11845] 0 2024-02-15T22:41:19.072 INFO:tasks.workunit.client.1.smithi082.stdout:3/677: mknod d0/d16/d62/d14/d21/d69/d87/ce5 0 2024-02-15T22:41:19.073 INFO:tasks.workunit.client.1.smithi082.stdout:7/721: dread d12/d37/d85/f90 [0,4194304] 0 2024-02-15T22:41:19.074 INFO:tasks.workunit.client.1.smithi082.stdout:3/678: mkdir d0/d16/d62/d14/d21/d69/de6 0 2024-02-15T22:41:19.074 INFO:tasks.workunit.client.1.smithi082.stdout:3/679: creat d0/d16/d62/d14/d21/d69/d91/fe7 x:0 0 0 2024-02-15T22:41:19.078 INFO:tasks.workunit.client.1.smithi082.stdout:7/722: unlink d12/d17/f19 0 2024-02-15T22:41:19.080 INFO:tasks.workunit.client.1.smithi082.stdout:7/723: symlink d12/d17/d3d/da8/lee 0 2024-02-15T22:41:19.083 INFO:tasks.workunit.client.1.smithi082.stdout:3/680: read d0/d16/d62/d14/d71/fac [2114043,50654] 0 2024-02-15T22:41:19.086 INFO:tasks.workunit.client.1.smithi082.stdout:3/681: symlink d0/d16/d62/d14/d21/d41/le8 0 2024-02-15T22:41:19.089 INFO:tasks.workunit.client.1.smithi082.stdout:3/682: unlink d0/d16/d62/d14/d21/d69/d91/fe2 0 2024-02-15T22:41:19.089 INFO:tasks.workunit.client.1.smithi082.stdout:3/683: dread - d0/d16/d3e/d56/fb5 zero size 2024-02-15T22:41:19.093 INFO:tasks.workunit.client.1.smithi082.stdout:3/684: unlink d0/d16/d62/d14/d21/d69/ca3 0 2024-02-15T22:41:19.096 INFO:tasks.workunit.client.1.smithi082.stdout:3/685: creat d0/d16/d62/d14/d21/d41/fe9 x:0 0 0 2024-02-15T22:41:19.097 INFO:tasks.workunit.client.1.smithi082.stdout:3/686: mknod d0/d16/d62/d14/d71/da2/cea 0 2024-02-15T22:41:19.099 INFO:tasks.workunit.client.1.smithi082.stdout:7/724: dwrite d12/d3b/feb [0,4194304] 0 2024-02-15T22:41:19.115 INFO:tasks.workunit.client.1.smithi082.stdout:3/687: mkdir d0/dc/d3f/deb 0 2024-02-15T22:41:19.115 INFO:tasks.workunit.client.1.smithi082.stdout:3/688: write d0/d16/d62/d14/d21/d7d/fd6 [1014683,110684] 0 2024-02-15T22:41:19.120 INFO:tasks.workunit.client.1.smithi082.stdout:6/702: sync 2024-02-15T22:41:19.120 INFO:tasks.workunit.client.1.smithi082.stdout:8/630: sync 2024-02-15T22:41:19.120 INFO:tasks.workunit.client.1.smithi082.stdout:8/631: fsync d1/d7/d9/d24/d43/fb5 0 2024-02-15T22:41:19.120 INFO:tasks.workunit.client.1.smithi082.stdout:4/819: sync 2024-02-15T22:41:19.120 INFO:tasks.workunit.client.1.smithi082.stdout:9/670: sync 2024-02-15T22:41:19.120 INFO:tasks.workunit.client.1.smithi082.stdout:1/637: sync 2024-02-15T22:41:19.121 INFO:tasks.workunit.client.1.smithi082.stdout:8/632: mkdir d1/d7/de/d1e/ddb 0 2024-02-15T22:41:19.121 INFO:tasks.workunit.client.1.smithi082.stdout:8/633: fdatasync d1/d7/de/d1e/fd1 0 2024-02-15T22:41:19.121 INFO:tasks.workunit.client.1.smithi082.stdout:8/634: chown d1/dcc/lda 7220364 1 2024-02-15T22:41:19.124 INFO:tasks.workunit.client.1.smithi082.stdout:5/685: sync 2024-02-15T22:41:19.124 INFO:tasks.workunit.client.1.smithi082.stdout:4/820: truncate d0/d8/d1b/dd/feb 2537968 0 2024-02-15T22:41:19.124 INFO:tasks.workunit.client.1.smithi082.stdout:4/821: dread - d0/d8/d1b/dd/fc4 zero size 2024-02-15T22:41:19.124 INFO:tasks.workunit.client.1.smithi082.stdout:0/612: sync 2024-02-15T22:41:19.124 INFO:tasks.workunit.client.1.smithi082.stdout:0/613: fdatasync d3/d19/fc1 0 2024-02-15T22:41:19.124 INFO:tasks.workunit.client.1.smithi082.stdout:2/662: sync 2024-02-15T22:41:19.126 INFO:tasks.workunit.client.1.smithi082.stdout:9/671: symlink d8/d24/lcc 0 2024-02-15T22:41:19.128 INFO:tasks.workunit.client.1.smithi082.stdout:2/663: dread d6/d3c/d8c/fb5 [0,4194304] 0 2024-02-15T22:41:19.129 INFO:tasks.workunit.client.1.smithi082.stdout:1/638: getdents d1/da 0 2024-02-15T22:41:19.131 INFO:tasks.workunit.client.1.smithi082.stdout:0/614: creat d3/d19/d93/dbe/fce x:0 0 0 2024-02-15T22:41:19.133 INFO:tasks.workunit.client.1.smithi082.stdout:0/615: write d3/d64/f68 [1488713,79242] 0 2024-02-15T22:41:19.134 INFO:tasks.workunit.client.1.smithi082.stdout:1/639: creat d1/da/d14/d18/d6d/dc9/fd3 x:0 0 0 2024-02-15T22:41:19.141 INFO:tasks.workunit.client.1.smithi082.stdout:1/640: link d1/da/d14/d18/cad d1/da/d14/d18/cd4 0 2024-02-15T22:41:19.141 INFO:tasks.workunit.client.1.smithi082.stdout:1/641: truncate d1/da/d14/d18/d6d/d89/fbc 953269 0 2024-02-15T22:41:19.145 INFO:tasks.workunit.client.1.smithi082.stdout:1/642: rename d1/da/d11/d8c/cd2 to d1/da/d11/d3f/cd5 0 2024-02-15T22:41:19.147 INFO:tasks.workunit.client.1.smithi082.stdout:2/664: dread d6/dc/f10 [4194304,4194304] 0 2024-02-15T22:41:19.147 INFO:tasks.workunit.client.1.smithi082.stdout:2/665: readlink d6/dc/d58/d49/lbe 0 2024-02-15T22:41:19.149 INFO:tasks.workunit.client.1.smithi082.stdout:6/703: dwrite d2/d18/d8a/d65/f7f [4194304,4194304] 0 2024-02-15T22:41:19.149 INFO:tasks.workunit.client.1.smithi082.stdout:2/666: truncate d6/dc/d58/fe 6071923 0 2024-02-15T22:41:19.154 INFO:tasks.workunit.client.1.smithi082.stdout:2/667: creat d6/dc/fc7 x:0 0 0 2024-02-15T22:41:19.155 INFO:tasks.workunit.client.1.smithi082.stdout:5/686: dread d5/da/d14/f75 [0,4194304] 0 2024-02-15T22:41:19.156 INFO:tasks.workunit.client.1.smithi082.stdout:2/668: truncate d6/dc/dd/d1d/f1f 2780806 0 2024-02-15T22:41:19.157 INFO:tasks.workunit.client.1.smithi082.stdout:5/687: mknod d5/da/dc/dad/dcf/ced 0 2024-02-15T22:41:19.158 INFO:tasks.workunit.client.1.smithi082.stdout:5/688: chown d5/da/d67/da0/dde 0 1 2024-02-15T22:41:19.158 INFO:tasks.workunit.client.1.smithi082.stdout:5/689: dread - d5/da/dc/dad/dcf/fb7 zero size 2024-02-15T22:41:19.159 INFO:tasks.workunit.client.1.smithi082.stdout:2/669: creat d6/dc/d12/d23/fc8 x:0 0 0 2024-02-15T22:41:19.165 INFO:tasks.workunit.client.1.smithi082.stdout:3/689: dwrite d0/d16/d62/d14/f85 [0,4194304] 0 2024-02-15T22:41:19.167 INFO:tasks.workunit.client.1.smithi082.stdout:1/643: dread d1/da/d11/d3f/f69 [0,4194304] 0 2024-02-15T22:41:19.168 INFO:tasks.workunit.client.1.smithi082.stdout:5/690: dread d5/da/d14/d53/f71 [0,4194304] 0 2024-02-15T22:41:19.168 INFO:tasks.workunit.client.1.smithi082.stdout:5/691: dread - d5/da/d67/da0/fc6 zero size 2024-02-15T22:41:19.169 INFO:tasks.workunit.client.1.smithi082.stdout:8/635: dwrite d1/d7/de/f80 [4194304,4194304] 0 2024-02-15T22:41:19.169 INFO:tasks.workunit.client.1.smithi082.stdout:8/636: chown d1/d7/d9/d42/f46 5 1 2024-02-15T22:41:19.169 INFO:tasks.workunit.client.1.smithi082.stdout:3/690: truncate d0/d16/d3e/d56/fd9 243922 0 2024-02-15T22:41:19.170 INFO:tasks.workunit.client.1.smithi082.stdout:3/691: stat d0/d16/d62/d14/d21/d69/d91/c99 0 2024-02-15T22:41:19.170 INFO:tasks.workunit.client.1.smithi082.stdout:3/692: stat d0/d16/d62/d14/d71/da2/f7f 0 2024-02-15T22:41:19.170 INFO:tasks.workunit.client.1.smithi082.stdout:9/672: dwrite d8/d12/dc5/f57 [0,4194304] 0 2024-02-15T22:41:19.173 INFO:tasks.workunit.client.1.smithi082.stdout:7/725: dwrite d12/d17/d42/d67/d81/d91/da0/fb5 [0,4194304] 0 2024-02-15T22:41:19.173 INFO:tasks.workunit.client.1.smithi082.stdout:0/616: dwrite d3/d19/d5f/da0/dbc/f98 [0,4194304] 0 2024-02-15T22:41:19.177 INFO:tasks.workunit.client.1.smithi082.stdout:1/644: rename d1/da/d14/d18/d6d/d89/fbc to d1/da/fd6 0 2024-02-15T22:41:19.179 INFO:tasks.workunit.client.1.smithi082.stdout:5/692: truncate d5/da/dc/dad/dcf/d59/fb5 2427795 0 2024-02-15T22:41:19.187 INFO:tasks.workunit.client.1.smithi082.stdout:9/673: write d8/d12/d33/d64/d7c/f8f [4981276,97379] 0 2024-02-15T22:41:19.188 INFO:tasks.workunit.client.1.smithi082.stdout:3/693: symlink d0/d16/d3e/d56/db0/de1/lec 0 2024-02-15T22:41:19.192 INFO:tasks.workunit.client.1.smithi082.stdout:0/617: mkdir d3/d19/d20/d7c/dcf 0 2024-02-15T22:41:19.192 INFO:tasks.workunit.client.1.smithi082.stdout:0/618: dread - d3/d19/d5f/da5/d99/db1/fbd zero size 2024-02-15T22:41:19.192 INFO:tasks.workunit.client.1.smithi082.stdout:0/619: fdatasync d3/d19/f21 0 2024-02-15T22:41:19.192 INFO:tasks.workunit.client.1.smithi082.stdout:0/620: chown d3/d19/d20/d26/f6a 1570 1 2024-02-15T22:41:19.193 INFO:tasks.workunit.client.1.smithi082.stdout:1/645: dread d1/da/d14/d18/d51/f8e [0,4194304] 0 2024-02-15T22:41:19.194 INFO:tasks.workunit.client.1.smithi082.stdout:7/726: symlink d12/d17/d42/d67/d81/d91/dbc/lef 0 2024-02-15T22:41:19.195 INFO:tasks.workunit.client.1.smithi082.stdout:5/693: truncate d5/f2e 149957 0 2024-02-15T22:41:19.196 INFO:tasks.workunit.client.1.smithi082.stdout:9/674: creat d8/d12/fcd x:0 0 0 2024-02-15T22:41:19.197 INFO:tasks.workunit.client.1.smithi082.stdout:3/694: rmdir d0/d16/d62/d2e/dcc 39 2024-02-15T22:41:19.197 INFO:tasks.workunit.client.1.smithi082.stdout:3/695: chown d0/fa9 0 1 2024-02-15T22:41:19.199 INFO:tasks.workunit.client.1.smithi082.stdout:0/621: rename d3/d19/d20/d26/l46 to d3/d19/d20/d7c/ld0 0 2024-02-15T22:41:19.201 INFO:tasks.workunit.client.1.smithi082.stdout:6/704: dwrite d2/f52 [0,4194304] 0 2024-02-15T22:41:19.201 INFO:tasks.workunit.client.1.smithi082.stdout:6/705: fsync d2/d18/d23/d67/fac 0 2024-02-15T22:41:19.201 INFO:tasks.workunit.client.1.smithi082.stdout:2/670: dwrite d6/dc/d58/f19 [0,4194304] 0 2024-02-15T22:41:19.201 INFO:tasks.workunit.client.1.smithi082.stdout:8/637: dwrite d1/d40/dbb/fc6 [0,4194304] 0 2024-02-15T22:41:19.202 INFO:tasks.workunit.client.1.smithi082.stdout:1/646: creat d1/da/d11/d93/db6/dc5/fd7 x:0 0 0 2024-02-15T22:41:19.204 INFO:tasks.workunit.client.1.smithi082.stdout:5/694: creat d5/da/de3/de9/fee x:0 0 0 2024-02-15T22:41:19.205 INFO:tasks.workunit.client.1.smithi082.stdout:9/675: creat d8/d12/dc5/fce x:0 0 0 2024-02-15T22:41:19.206 INFO:tasks.workunit.client.1.smithi082.stdout:1/647: dread d1/da/d14/d18/fbe [0,4194304] 0 2024-02-15T22:41:19.206 INFO:tasks.workunit.client.1.smithi082.stdout:0/622: creat d3/d19/d20/d7c/dcf/fd1 x:0 0 0 2024-02-15T22:41:19.211 INFO:tasks.workunit.client.1.smithi082.stdout:8/638: write d1/d7/d9/d50/d56/dab/fc1 [6600769,4406] 0 2024-02-15T22:41:19.219 INFO:tasks.workunit.client.1.smithi082.stdout:1/648: write d1/f47 [2863812,43057] 0 2024-02-15T22:41:19.219 INFO:tasks.workunit.client.1.smithi082.stdout:1/649: write d1/da/d11/f9e [999358,67821] 0 2024-02-15T22:41:19.221 INFO:tasks.workunit.client.1.smithi082.stdout:3/696: dwrite d0/d16/d62/d14/d21/d69/f82 [4194304,4194304] 0 2024-02-15T22:41:19.230 INFO:tasks.workunit.client.1.smithi082.stdout:5/695: dwrite d5/da/d67/f68 [0,4194304] 0 2024-02-15T22:41:19.238 INFO:tasks.workunit.client.1.smithi082.stdout:1/650: fdatasync d1/f47 0 2024-02-15T22:41:19.238 INFO:tasks.workunit.client.1.smithi082.stdout:8/639: dwrite d1/d7/d9/f47 [0,4194304] 0 2024-02-15T22:41:19.239 INFO:tasks.workunit.client.1.smithi082.stdout:3/697: dwrite d0/dc/f26 [0,4194304] 0 2024-02-15T22:41:19.254 INFO:tasks.workunit.client.1.smithi082.stdout:3/698: dwrite d0/d16/d62/d14/d21/d69/d87/fdf [0,4194304] 0 2024-02-15T22:41:19.255 INFO:tasks.workunit.client.1.smithi082.stdout:3/699: truncate d0/d16/d62/d14/d21/d41/f67 5451980 0 2024-02-15T22:41:19.263 INFO:tasks.workunit.client.1.smithi082.stdout:3/700: dread d0/d16/f12 [0,4194304] 0 2024-02-15T22:41:19.269 INFO:tasks.workunit.client.1.smithi082.stdout:3/701: dread d0/dc/d3f/f76 [0,4194304] 0 2024-02-15T22:41:19.269 INFO:tasks.workunit.client.1.smithi082.stdout:3/702: fsync d0/dc/f9c 0 2024-02-15T22:41:19.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:18 smithi033 ceph-mon[29033]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 162 MiB/s rd, 205 MiB/s wr, 753 op/s 2024-02-15T22:41:19.315 INFO:tasks.workunit.client.1.smithi082.stdout:9/676: link d8/f44 d8/db5/fcf 0 2024-02-15T22:41:19.315 INFO:tasks.workunit.client.1.smithi082.stdout:9/677: chown d8/d12/d33/d64/d8b/d96 3501319 1 2024-02-15T22:41:19.315 INFO:tasks.workunit.client.1.smithi082.stdout:9/678: write f5 [8821487,103673] 0 2024-02-15T22:41:19.315 INFO:tasks.workunit.client.1.smithi082.stdout:9/679: creat d8/db5/fd0 x:0 0 0 2024-02-15T22:41:19.318 INFO:tasks.workunit.client.1.smithi082.stdout:0/623: rename d3/d64 to d3/d19/d5f/da5/d99/db1/dd2 0 2024-02-15T22:41:19.323 INFO:tasks.workunit.client.1.smithi082.stdout:5/696: symlink d5/da/d14/lef 0 2024-02-15T22:41:19.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:18 smithi082 ceph-mon[37153]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 162 MiB/s rd, 205 MiB/s wr, 753 op/s 2024-02-15T22:41:19.462 INFO:tasks.workunit.client.1.smithi082.stdout:1/651: chown d1/l40 30 1 2024-02-15T22:41:19.462 INFO:tasks.workunit.client.1.smithi082.stdout:1/652: fsync d1/da/d14/d18/f2b 0 2024-02-15T22:41:19.463 INFO:tasks.workunit.client.1.smithi082.stdout:8/640: stat d1/d7/de/l2b 0 2024-02-15T22:41:19.471 INFO:tasks.workunit.client.1.smithi082.stdout:3/703: getdents d0/d16/d62/d2e/dcc 0 2024-02-15T22:41:19.481 INFO:tasks.workunit.client.1.smithi082.stdout:7/727: rmdir d12/d27/d33/da7 0 2024-02-15T22:41:19.497 INFO:tasks.workunit.client.1.smithi082.stdout:7/728: dwrite d12/d17/d3d/f55 [4194304,4194304] 0 2024-02-15T22:41:19.497 INFO:tasks.workunit.client.1.smithi082.stdout:7/729: creat d12/d27/d74/ff0 x:0 0 0 2024-02-15T22:41:19.624 INFO:tasks.workunit.client.1.smithi082.stdout:9/680: creat d8/d12/d67/fd1 x:0 0 0 2024-02-15T22:41:19.624 INFO:tasks.workunit.client.1.smithi082.stdout:9/681: write d8/d12/d33/d64/d7c/fc9 [1077,109656] 0 2024-02-15T22:41:19.626 INFO:tasks.workunit.client.1.smithi082.stdout:0/624: mkdir d3/d19/d25/d80/dd3 0 2024-02-15T22:41:19.629 INFO:tasks.workunit.client.1.smithi082.stdout:5/697: mknod d5/da/dc/dad/dcf/d59/d84/cf0 0 2024-02-15T22:41:19.629 INFO:tasks.workunit.client.1.smithi082.stdout:5/698: readlink d5/da/d14/d53/l55 0 2024-02-15T22:41:19.634 INFO:tasks.workunit.client.1.smithi082.stdout:1/653: rename d1/da/d11/d3f/f46 to d1/da/d14/d18/d6d/fd8 0 2024-02-15T22:41:19.639 INFO:tasks.workunit.client.1.smithi082.stdout:9/682: unlink d8/d24/d2e/cbf 0 2024-02-15T22:41:19.639 INFO:tasks.workunit.client.1.smithi082.stdout:9/683: fsync d8/db5/fc8 0 2024-02-15T22:41:19.639 INFO:tasks.workunit.client.1.smithi082.stdout:9/684: write d8/d24/d87/f9c [948262,32146] 0 2024-02-15T22:41:19.640 INFO:tasks.workunit.client.1.smithi082.stdout:0/625: getdents d3/d19/d5f/da0 0 2024-02-15T22:41:19.643 INFO:tasks.workunit.client.1.smithi082.stdout:1/654: mkdir d1/da/d14/d7f/dd9 0 2024-02-15T22:41:19.646 INFO:tasks.workunit.client.1.smithi082.stdout:7/730: dread d12/d17/f1a [0,4194304] 0 2024-02-15T22:41:19.647 INFO:tasks.workunit.client.1.smithi082.stdout:5/699: rmdir d5/da/d67/da0 39 2024-02-15T22:41:19.647 INFO:tasks.workunit.client.1.smithi082.stdout:5/700: readlink d5/da/dc/dad/dcf/d59/da3/lb9 0 2024-02-15T22:41:19.650 INFO:tasks.workunit.client.1.smithi082.stdout:8/641: rename d1/la0 to d1/d7/d9/ldc 0 2024-02-15T22:41:19.650 INFO:tasks.workunit.client.1.smithi082.stdout:8/642: chown d1/d7/d9/d24/l59 1586 1 2024-02-15T22:41:19.652 INFO:tasks.workunit.client.1.smithi082.stdout:1/655: creat d1/da/d14/d7f/dd9/fda x:0 0 0 2024-02-15T22:41:19.654 INFO:tasks.workunit.client.1.smithi082.stdout:0/626: dread d3/d19/d5f/da0/dbc/f7a [0,4194304] 0 2024-02-15T22:41:19.654 INFO:tasks.workunit.client.1.smithi082.stdout:0/627: truncate d3/d19/d5f/da0/dbc/fcd 212571 0 2024-02-15T22:41:19.655 INFO:tasks.workunit.client.1.smithi082.stdout:7/731: mknod d12/d17/d42/d67/d81/d91/cf1 0 2024-02-15T22:41:19.658 INFO:tasks.workunit.client.1.smithi082.stdout:3/704: rename d0/d16/d62/fb to d0/fed 0 2024-02-15T22:41:19.658 INFO:tasks.workunit.client.1.smithi082.stdout:3/705: write d0/d16/d62/d14/d21/d7d/f83 [3972673,116307] 0 2024-02-15T22:41:19.660 INFO:tasks.workunit.client.1.smithi082.stdout:1/656: mkdir d1/da/d14/d18/d1f/d7a/ddb 0 2024-02-15T22:41:19.661 INFO:tasks.workunit.client.1.smithi082.stdout:7/732: mknod d12/d27/d74/d8b/cf2 0 2024-02-15T22:41:19.663 INFO:tasks.workunit.client.1.smithi082.stdout:5/701: dwrite d5/fca [0,4194304] 0 2024-02-15T22:41:19.663 INFO:tasks.workunit.client.1.smithi082.stdout:5/702: write d5/da/d14/f94 [4946212,40214] 0 2024-02-15T22:41:19.663 INFO:tasks.workunit.client.1.smithi082.stdout:5/703: dread - d5/fe7 zero size 2024-02-15T22:41:19.666 INFO:tasks.workunit.client.1.smithi082.stdout:8/643: rename d1/d7/d9/d50/dc8 to d1/d7/d9/d42/d6a/da5/ddd 0 2024-02-15T22:41:19.671 INFO:tasks.workunit.client.1.smithi082.stdout:5/704: symlink d5/da/dc/dad/dcf/lf1 0 2024-02-15T22:41:19.671 INFO:tasks.workunit.client.1.smithi082.stdout:7/733: dread d12/d3b/f3f [0,4194304] 0 2024-02-15T22:41:19.675 INFO:tasks.workunit.client.1.smithi082.stdout:0/628: rename d3/faf to d3/d19/d5f/da5/d99/db1/fd4 0 2024-02-15T22:41:19.676 INFO:tasks.workunit.client.1.smithi082.stdout:3/706: mkdir d0/d16/d62/d14/d21/dee 0 2024-02-15T22:41:19.676 INFO:tasks.workunit.client.1.smithi082.stdout:3/707: truncate d0/dc/d3f/f78 975527 0 2024-02-15T22:41:19.678 INFO:tasks.workunit.client.1.smithi082.stdout:8/644: rename d1/d7/de/d1e/c9a to d1/d7/d9/d42/d6a/da5/dd4/dd8/cde 0 2024-02-15T22:41:19.679 INFO:tasks.workunit.client.1.smithi082.stdout:3/708: creat d0/d16/d62/d14/d21/fef x:0 0 0 2024-02-15T22:41:19.680 INFO:tasks.workunit.client.1.smithi082.stdout:3/709: fdatasync d0/d16/d62/d14/d21/d69/d91/f96 0 2024-02-15T22:41:19.680 INFO:tasks.workunit.client.1.smithi082.stdout:3/710: write d0/d16/d62/d14/d21/fef [111509,106277] 0 2024-02-15T22:41:19.680 INFO:tasks.workunit.client.1.smithi082.stdout:7/734: write d12/d17/d42/d67/f71 [1753068,50189] 0 2024-02-15T22:41:19.680 INFO:tasks.workunit.client.1.smithi082.stdout:9/685: rmdir d8/db5 39 2024-02-15T22:41:19.681 INFO:tasks.workunit.client.1.smithi082.stdout:8/645: mknod d1/d7/d9/d42/cdf 0 2024-02-15T22:41:19.682 INFO:tasks.workunit.client.1.smithi082.stdout:3/711: mkdir d0/d16/df0 0 2024-02-15T22:41:19.682 INFO:tasks.workunit.client.1.smithi082.stdout:3/712: chown d0/d16/d62/d14/d71/da2/cc0 1854468 1 2024-02-15T22:41:19.682 INFO:tasks.workunit.client.1.smithi082.stdout:3/713: truncate d0/d16/d62/d14/d21/d69/d6c/fd5 494094 0 2024-02-15T22:41:19.682 INFO:tasks.workunit.client.1.smithi082.stdout:3/714: fdatasync d0/d16/d3e/d56/fb5 0 2024-02-15T22:41:19.684 INFO:tasks.workunit.client.1.smithi082.stdout:8/646: creat d1/d7/de/d57/fe0 x:0 0 0 2024-02-15T22:41:19.685 INFO:tasks.workunit.client.1.smithi082.stdout:3/715: mknod d0/dc/d3f/deb/cf1 0 2024-02-15T22:41:19.687 INFO:tasks.workunit.client.1.smithi082.stdout:9/686: write d8/d12/d33/d64/d7c/f94 [509304,127887] 0 2024-02-15T22:41:19.687 INFO:tasks.workunit.client.1.smithi082.stdout:8/647: creat d1/d7/d9/d24/fe1 x:0 0 0 2024-02-15T22:41:19.689 INFO:tasks.workunit.client.1.smithi082.stdout:9/687: getdents d8/db5 0 2024-02-15T22:41:19.689 INFO:tasks.workunit.client.1.smithi082.stdout:7/735: read d12/d17/d42/d67/f71 [4749536,54058] 0 2024-02-15T22:41:19.690 INFO:tasks.workunit.client.1.smithi082.stdout:8/648: mknod d1/d7/d9/d24/d43/d85/ce2 0 2024-02-15T22:41:19.692 INFO:tasks.workunit.client.1.smithi082.stdout:9/688: creat d8/d24/d2e/d53/fd2 x:0 0 0 2024-02-15T22:41:19.692 INFO:tasks.workunit.client.1.smithi082.stdout:4/822: sync 2024-02-15T22:41:19.692 INFO:tasks.workunit.client.1.smithi082.stdout:6/706: sync 2024-02-15T22:41:19.692 INFO:tasks.workunit.client.1.smithi082.stdout:2/671: sync 2024-02-15T22:41:19.694 INFO:tasks.workunit.client.1.smithi082.stdout:2/672: creat d6/dc/dd/fc9 x:0 0 0 2024-02-15T22:41:19.695 INFO:tasks.workunit.client.1.smithi082.stdout:8/649: dread d1/f21 [0,4194304] 0 2024-02-15T22:41:19.695 INFO:tasks.workunit.client.1.smithi082.stdout:8/650: fdatasync d1/d7/f2a 0 2024-02-15T22:41:19.696 INFO:tasks.workunit.client.1.smithi082.stdout:8/651: dread - d1/d7/d9/d42/d6a/da5/fbe zero size 2024-02-15T22:41:19.696 INFO:tasks.workunit.client.1.smithi082.stdout:8/652: dread - d1/d7/d48/d6f/faf zero size 2024-02-15T22:41:19.697 INFO:tasks.workunit.client.1.smithi082.stdout:6/707: creat d2/d18/d8a/d84/fdb x:0 0 0 2024-02-15T22:41:19.698 INFO:tasks.workunit.client.1.smithi082.stdout:4/823: mkdir d0/dc0/dcd/de3/d12d 0 2024-02-15T22:41:19.699 INFO:tasks.workunit.client.1.smithi082.stdout:0/629: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:41:19.701 INFO:tasks.workunit.client.1.smithi082.stdout:8/653: unlink d1/d7/d9/d42/d6a/f6c 0 2024-02-15T22:41:19.703 INFO:tasks.workunit.client.1.smithi082.stdout:6/708: mknod d2/d18/d23/d67/cdc 0 2024-02-15T22:41:19.703 INFO:tasks.workunit.client.1.smithi082.stdout:6/709: chown d2/d18/d8a/d47/d72/d80 158757243 1 2024-02-15T22:41:19.703 INFO:tasks.workunit.client.1.smithi082.stdout:6/710: truncate d2/d18/d8a/d47/f91 666860 0 2024-02-15T22:41:19.703 INFO:tasks.workunit.client.1.smithi082.stdout:6/711: truncate d2/d45/fc9 292543 0 2024-02-15T22:41:19.705 INFO:tasks.workunit.client.1.smithi082.stdout:4/824: creat d0/d8/d1b/dd/d37/dfa/f12e x:0 0 0 2024-02-15T22:41:19.706 INFO:tasks.workunit.client.1.smithi082.stdout:9/689: dread d8/f18 [8388608,4194304] 0 2024-02-15T22:41:19.707 INFO:tasks.workunit.client.1.smithi082.stdout:0/630: rename d3/d19/d5f/da5/d99/db1/dd2/d71 to d3/d19/d20/d7c/dd5 0 2024-02-15T22:41:19.707 INFO:tasks.workunit.client.1.smithi082.stdout:0/631: stat d3/d19 0 2024-02-15T22:41:19.708 INFO:tasks.workunit.client.1.smithi082.stdout:4/825: mkdir d0/dc0/dcd/d12f 0 2024-02-15T22:41:19.708 INFO:tasks.workunit.client.1.smithi082.stdout:4/826: chown d0/d8/d32/d39/l84 1887269 1 2024-02-15T22:41:19.709 INFO:tasks.workunit.client.1.smithi082.stdout:9/690: symlink d8/d24/d2e/d53/ld3 0 2024-02-15T22:41:19.712 INFO:tasks.workunit.client.1.smithi082.stdout:8/654: rename d1/d7/d9/d50/f67 to d1/d7/d9/d42/fe3 0 2024-02-15T22:41:19.712 INFO:tasks.workunit.client.1.smithi082.stdout:9/691: dread d8/f18 [8388608,4194304] 0 2024-02-15T22:41:19.713 INFO:tasks.workunit.client.1.smithi082.stdout:0/632: creat d3/d19/d20/d26/fd6 x:0 0 0 2024-02-15T22:41:19.715 INFO:tasks.workunit.client.1.smithi082.stdout:4/827: unlink d0/d8/d1b/dd/fc9 0 2024-02-15T22:41:19.716 INFO:tasks.workunit.client.1.smithi082.stdout:6/712: rename d2/d18/d8a/d84/f87 to d2/d18/d8a/da7/fdd 0 2024-02-15T22:41:19.717 INFO:tasks.workunit.client.1.smithi082.stdout:9/692: symlink d8/d24/d87/dcb/ld4 0 2024-02-15T22:41:19.720 INFO:tasks.workunit.client.1.smithi082.stdout:0/633: creat d3/d19/d20/fd7 x:0 0 0 2024-02-15T22:41:19.720 INFO:tasks.workunit.client.1.smithi082.stdout:7/736: dwrite d12/d37/f98 [0,4194304] 0 2024-02-15T22:41:19.722 INFO:tasks.workunit.client.1.smithi082.stdout:4/828: rename d0/f23 to d0/d8/d1b/dd/daa/f130 0 2024-02-15T22:41:19.722 INFO:tasks.workunit.client.1.smithi082.stdout:2/673: dwrite d6/dc/dd/d24/fc0 [0,4194304] 0 2024-02-15T22:41:19.722 INFO:tasks.workunit.client.1.smithi082.stdout:8/655: dread d1/d7/d9/d50/fa8 [0,4194304] 0 2024-02-15T22:41:19.723 INFO:tasks.workunit.client.1.smithi082.stdout:8/656: creat d1/d7/d9/d24/d30/fe4 x:0 0 0 2024-02-15T22:41:19.725 INFO:tasks.workunit.client.1.smithi082.stdout:6/713: mknod d2/d18/d8a/d84/cde 0 2024-02-15T22:41:19.726 INFO:tasks.workunit.client.1.smithi082.stdout:7/737: mknod d12/de4/cf3 0 2024-02-15T22:41:19.726 INFO:tasks.workunit.client.1.smithi082.stdout:7/738: fdatasync d12/d3b/fea 0 2024-02-15T22:41:19.726 INFO:tasks.workunit.client.1.smithi082.stdout:7/739: truncate d12/d27/d6e/d6a/d9e/dbe/dcb/fd9 4521038 0 2024-02-15T22:41:19.727 INFO:tasks.workunit.client.1.smithi082.stdout:0/634: rename d3/d19/d1c/d6d/f72 to d3/d19/d25/d80/dd3/fd8 0 2024-02-15T22:41:19.729 INFO:tasks.workunit.client.1.smithi082.stdout:4/829: link d0/c6c d0/dc0/dcd/dcf/c131 0 2024-02-15T22:41:19.729 INFO:tasks.workunit.client.1.smithi082.stdout:4/830: getdents d0/dc0/dcd/de3/d12d 0 2024-02-15T22:41:19.732 INFO:tasks.workunit.client.1.smithi082.stdout:2/674: mknod d6/dc/cca 0 2024-02-15T22:41:19.732 INFO:tasks.workunit.client.1.smithi082.stdout:2/675: chown d6/dc/dd/d1d/f57 5 1 2024-02-15T22:41:19.734 INFO:tasks.workunit.client.1.smithi082.stdout:8/657: symlink d1/d40/le5 0 2024-02-15T22:41:19.737 INFO:tasks.workunit.client.1.smithi082.stdout:6/714: mkdir d2/d18/d23/ddf 0 2024-02-15T22:41:19.740 INFO:tasks.workunit.client.1.smithi082.stdout:0/635: creat d3/d19/d5f/d92/fd9 x:0 0 0 2024-02-15T22:41:19.740 INFO:tasks.workunit.client.1.smithi082.stdout:0/636: chown d3/d19/d5f/da5/l59 1280727 1 2024-02-15T22:41:19.740 INFO:tasks.workunit.client.1.smithi082.stdout:0/637: truncate d3/d19/d5f/f96 738661 0 2024-02-15T22:41:19.741 INFO:tasks.workunit.client.1.smithi082.stdout:4/831: symlink d0/dc0/dcd/de3/d12d/l132 0 2024-02-15T22:41:19.741 INFO:tasks.workunit.client.1.smithi082.stdout:4/832: readlink d0/d8/d32/d39/l6d 0 2024-02-15T22:41:19.742 INFO:tasks.workunit.client.1.smithi082.stdout:2/676: mkdir d6/dc/dd/d24/d71/dcb 0 2024-02-15T22:41:19.743 INFO:tasks.workunit.client.1.smithi082.stdout:9/693: dwrite d8/d12/d30/d3c/d65/f6b [0,4194304] 0 2024-02-15T22:41:19.744 INFO:tasks.workunit.client.1.smithi082.stdout:6/715: rename d2/cbf to d2/d18/d8a/d47/d72/ce0 0 2024-02-15T22:41:19.750 INFO:tasks.workunit.client.1.smithi082.stdout:8/658: dwrite d1/d7/d9/d24/d43/d85/fb2 [0,4194304] 0 2024-02-15T22:41:19.757 INFO:tasks.workunit.client.1.smithi082.stdout:7/740: symlink d12/d3b/d5a/dce/lf4 0 2024-02-15T22:41:19.757 INFO:tasks.workunit.client.1.smithi082.stdout:7/741: chown d12/d27/d6e/d6a/d9e/dbe/dcb/le1 55 1 2024-02-15T22:41:19.759 INFO:tasks.workunit.client.1.smithi082.stdout:4/833: mkdir d0/d8/d1b/dd/d37/d133 0 2024-02-15T22:41:19.760 INFO:tasks.workunit.client.1.smithi082.stdout:4/834: chown d0/d8/d1b/dd/daa/l10d 684787758 1 2024-02-15T22:41:19.760 INFO:tasks.workunit.client.1.smithi082.stdout:4/835: creat d0/dc0/dcd/de3/f134 x:0 0 0 2024-02-15T22:41:19.760 INFO:tasks.workunit.client.1.smithi082.stdout:2/677: creat d6/dc/d58/d49/d5e/d67/fcc x:0 0 0 2024-02-15T22:41:19.761 INFO:tasks.workunit.client.1.smithi082.stdout:9/694: symlink d8/d12/d33/d64/d7c/da1/ld5 0 2024-02-15T22:41:19.761 INFO:tasks.workunit.client.1.smithi082.stdout:9/695: fsync d8/d12/fbe 0 2024-02-15T22:41:19.762 INFO:tasks.workunit.client.1.smithi082.stdout:7/742: dread d12/d37/d85/f90 [0,4194304] 0 2024-02-15T22:41:19.763 INFO:tasks.workunit.client.1.smithi082.stdout:6/716: mkdir d2/d30/da6/de1 0 2024-02-15T22:41:19.763 INFO:tasks.workunit.client.1.smithi082.stdout:6/717: creat d2/d18/d8a/d47/d69/db1/fe2 x:0 0 0 2024-02-15T22:41:19.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/659: rename d1/d40/lb0 to d1/d7/d9/d24/d43/da6/db6/le6 0 2024-02-15T22:41:19.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/660: write d1/d7/d9/d24/d43/da6/db6/fd7 [4335450,18635] 0 2024-02-15T22:41:19.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/661: creat d1/d40/dbb/fe7 x:0 0 0 2024-02-15T22:41:19.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/662: fdatasync d1/d7/d9/d24/d30/f4b 0 2024-02-15T22:41:19.765 INFO:tasks.workunit.client.1.smithi082.stdout:8/663: readlink d1/d7/d48/lbc 0 2024-02-15T22:41:19.766 INFO:tasks.workunit.client.1.smithi082.stdout:4/836: creat d0/d8/d1b/dd/d37/d133/f135 x:0 0 0 2024-02-15T22:41:19.767 INFO:tasks.workunit.client.1.smithi082.stdout:2/678: symlink d6/d3c/d8c/lcd 0 2024-02-15T22:41:19.767 INFO:tasks.workunit.client.1.smithi082.stdout:2/679: fdatasync d6/dc/dd/d1d/f1f 0 2024-02-15T22:41:19.767 INFO:tasks.workunit.client.1.smithi082.stdout:2/680: fdatasync d6/dc/dd/d1d/f57 0 2024-02-15T22:41:19.769 INFO:tasks.workunit.client.1.smithi082.stdout:9/696: creat d8/db5/fd6 x:0 0 0 2024-02-15T22:41:19.769 INFO:tasks.workunit.client.1.smithi082.stdout:9/697: chown d8/d12/d33/d64/d7c/da1 1 1 2024-02-15T22:41:19.769 INFO:tasks.workunit.client.1.smithi082.stdout:4/837: dread d0/d8/d32/d39/fb2 [0,4194304] 0 2024-02-15T22:41:19.769 INFO:tasks.workunit.client.1.smithi082.stdout:4/838: creat d0/d47/d4d/f136 x:0 0 0 2024-02-15T22:41:19.769 INFO:tasks.workunit.client.1.smithi082.stdout:4/839: fsync d0/d47/da6/da7/fd6 0 2024-02-15T22:41:19.769 INFO:tasks.workunit.client.1.smithi082.stdout:4/840: write d0/d16/f30 [2543587,77491] 0 2024-02-15T22:41:19.769 INFO:tasks.workunit.client.1.smithi082.stdout:4/841: fdatasync d0/d8/d1b/ff8 0 2024-02-15T22:41:19.770 INFO:tasks.workunit.client.1.smithi082.stdout:7/743: mkdir d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/df5 0 2024-02-15T22:41:19.770 INFO:tasks.workunit.client.1.smithi082.stdout:7/744: stat d12/d27/d74/f82 0 2024-02-15T22:41:19.773 INFO:tasks.workunit.client.1.smithi082.stdout:6/718: creat d2/d18/d8a/d47/d72/fe3 x:0 0 0 2024-02-15T22:41:19.778 INFO:tasks.workunit.client.1.smithi082.stdout:8/664: link d1/f4f d1/d7/d9/d42/d6a/da5/dd4/dd8/fe8 0 2024-02-15T22:41:19.781 INFO:tasks.workunit.client.1.smithi082.stdout:2/681: mknod d6/dc/dd/d1d/cce 0 2024-02-15T22:41:19.782 INFO:tasks.workunit.client.1.smithi082.stdout:9/698: rename d8/f22 to d8/d12/d33/d64/fd7 0 2024-02-15T22:41:19.785 INFO:tasks.workunit.client.1.smithi082.stdout:6/719: mkdir d2/d18/d8a/d47/d69/d75/de4 0 2024-02-15T22:41:19.786 INFO:tasks.workunit.client.1.smithi082.stdout:6/720: mknod d2/d18/d8a/d47/d69/dd0/ce5 0 2024-02-15T22:41:19.787 INFO:tasks.workunit.client.1.smithi082.stdout:6/721: read d2/d18/d8a/d65/fcf [3519164,120682] 0 2024-02-15T22:41:19.788 INFO:tasks.workunit.client.1.smithi082.stdout:6/722: unlink d2/d30/d3b/c3e 0 2024-02-15T22:41:19.790 INFO:tasks.workunit.client.1.smithi082.stdout:6/723: mknod d2/d18/d8a/d47/d69/d75/ce6 0 2024-02-15T22:41:19.790 INFO:tasks.workunit.client.1.smithi082.stdout:6/724: chown d2/d18/d8a/d47/d69/db1/fcc 35 1 2024-02-15T22:41:19.790 INFO:tasks.workunit.client.1.smithi082.stdout:6/725: stat d2/d18/d8a/d47 0 2024-02-15T22:41:19.792 INFO:tasks.workunit.client.1.smithi082.stdout:4/842: dwrite d0/d16/f2b [4194304,4194304] 0 2024-02-15T22:41:19.792 INFO:tasks.workunit.client.1.smithi082.stdout:4/843: chown d0/d8/d1b/dd/d37/dfa/f12e 498360929 1 2024-02-15T22:41:19.792 INFO:tasks.workunit.client.1.smithi082.stdout:6/726: symlink d2/d18/d8a/d47/d69/dd0/le7 0 2024-02-15T22:41:19.793 INFO:tasks.workunit.client.1.smithi082.stdout:7/745: dwrite d12/d27/d74/fd1 [0,4194304] 0 2024-02-15T22:41:19.795 INFO:tasks.workunit.client.1.smithi082.stdout:4/844: creat d0/d16/d87/d10c/f137 x:0 0 0 2024-02-15T22:41:19.796 INFO:tasks.workunit.client.1.smithi082.stdout:6/727: link d2/d30/d3b/f49 d2/d18/d8a/d47/d69/d75/de4/fe8 0 2024-02-15T22:41:19.802 INFO:tasks.workunit.client.1.smithi082.stdout:8/665: dwrite d1/d7/d48/f6e [0,4194304] 0 2024-02-15T22:41:19.804 INFO:tasks.workunit.client.1.smithi082.stdout:4/845: mkdir d0/dc0/dcd/d138 0 2024-02-15T22:41:19.804 INFO:tasks.workunit.client.1.smithi082.stdout:4/846: write d0/d8/d32/f4e [2727951,56044] 0 2024-02-15T22:41:19.804 INFO:tasks.workunit.client.1.smithi082.stdout:4/847: write d0/d8/d1b/dd/fbc [1234686,60566] 0 2024-02-15T22:41:19.804 INFO:tasks.workunit.client.1.smithi082.stdout:2/682: dwrite d6/dc/dd/d21/f5a [0,4194304] 0 2024-02-15T22:41:19.806 INFO:tasks.workunit.client.1.smithi082.stdout:6/728: rmdir d2/d18/d8a/d47/d69/dc1 39 2024-02-15T22:41:19.808 INFO:tasks.workunit.client.1.smithi082.stdout:8/666: truncate d1/d7/de/f32 3578611 0 2024-02-15T22:41:19.808 INFO:tasks.workunit.client.1.smithi082.stdout:8/667: readlink d1/l3 0 2024-02-15T22:41:19.808 INFO:tasks.workunit.client.1.smithi082.stdout:8/668: fsync d1/f14 0 2024-02-15T22:41:19.810 INFO:tasks.workunit.client.1.smithi082.stdout:4/848: mkdir d0/d47/da6/da7/d108/d139 0 2024-02-15T22:41:19.810 INFO:tasks.workunit.client.1.smithi082.stdout:4/849: truncate d0/d46/fc7 4924473 0 2024-02-15T22:41:19.811 INFO:tasks.workunit.client.1.smithi082.stdout:7/746: write d12/d17/d4d/d7d/f9c [2711408,76321] 0 2024-02-15T22:41:19.812 INFO:tasks.workunit.client.1.smithi082.stdout:6/729: unlink d2/d30/cba 0 2024-02-15T22:41:19.812 INFO:tasks.workunit.client.1.smithi082.stdout:6/730: chown d2/d18/d8a/d65/cca 112323050 1 2024-02-15T22:41:19.813 INFO:tasks.workunit.client.1.smithi082.stdout:8/669: truncate d1/d7/d9/d42/d6a/f76 1578399 0 2024-02-15T22:41:19.813 INFO:tasks.workunit.client.1.smithi082.stdout:8/670: write d1/d7/d9/fa4 [120088,122610] 0 2024-02-15T22:41:19.815 INFO:tasks.workunit.client.1.smithi082.stdout:2/683: dread d6/dc/dd/d21/f5a [0,4194304] 0 2024-02-15T22:41:19.816 INFO:tasks.workunit.client.1.smithi082.stdout:4/850: unlink d0/d8/d1b/c5d 0 2024-02-15T22:41:19.817 INFO:tasks.workunit.client.1.smithi082.stdout:9/699: dwrite d8/d12/d33/fbb [0,4194304] 0 2024-02-15T22:41:19.819 INFO:tasks.workunit.client.1.smithi082.stdout:7/747: symlink d12/d17/d4d/d7d/lf6 0 2024-02-15T22:41:19.820 INFO:tasks.workunit.client.1.smithi082.stdout:6/731: creat d2/d18/d8a/d47/dae/fe9 x:0 0 0 2024-02-15T22:41:19.820 INFO:tasks.workunit.client.1.smithi082.stdout:6/732: chown d2/d18/d8a/f6f 166 1 2024-02-15T22:41:19.822 INFO:tasks.workunit.client.1.smithi082.stdout:8/671: rename d1/d7/de/d1e/c82 to d1/d40/dbb/dcf/ce9 0 2024-02-15T22:41:19.824 INFO:tasks.workunit.client.1.smithi082.stdout:4/851: mkdir d0/d16/d87/d10c/d13a 0 2024-02-15T22:41:19.827 INFO:tasks.workunit.client.1.smithi082.stdout:6/733: symlink d2/d18/d8a/d47/d69/db1/lea 0 2024-02-15T22:41:19.833 INFO:tasks.workunit.client.1.smithi082.stdout:2/684: dwrite d6/dc/d58/d49/d5e/f73 [0,4194304] 0 2024-02-15T22:41:19.834 INFO:tasks.workunit.client.1.smithi082.stdout:9/700: rename d8/d12/d33/d64/d8b/d96/f9d to d8/d12/d33/d64/d77/dab/fd8 0 2024-02-15T22:41:19.834 INFO:tasks.workunit.client.1.smithi082.stdout:9/701: read - d8/d24/d2e/d53/fd2 zero size 2024-02-15T22:41:19.837 INFO:tasks.workunit.client.1.smithi082.stdout:4/852: creat d0/d47/da6/d114/f13b x:0 0 0 2024-02-15T22:41:19.837 INFO:tasks.workunit.client.1.smithi082.stdout:4/853: fdatasync d0/d8/d1b/dd/ff 0 2024-02-15T22:41:19.837 INFO:tasks.workunit.client.1.smithi082.stdout:4/854: creat d0/d16/d4a/d6a/dd9/f13c x:0 0 0 2024-02-15T22:41:19.838 INFO:tasks.workunit.client.1.smithi082.stdout:6/734: creat d2/d18/d8a/d47/d69/feb x:0 0 0 2024-02-15T22:41:19.838 INFO:tasks.workunit.client.1.smithi082.stdout:8/672: rmdir d1/d40/dbb/dce 39 2024-02-15T22:41:19.843 INFO:tasks.workunit.client.1.smithi082.stdout:2/685: mknod d6/dc/d12/ccf 0 2024-02-15T22:41:19.847 INFO:tasks.workunit.client.1.smithi082.stdout:9/702: truncate d8/f19 2589708 0 2024-02-15T22:41:19.847 INFO:tasks.workunit.client.1.smithi082.stdout:9/703: chown d8/d12/d33/d64/d7c/f8f 111770 1 2024-02-15T22:41:19.847 INFO:tasks.workunit.client.1.smithi082.stdout:9/704: write d8/d12/d33/d64/d77/dab/fb1 [913093,76525] 0 2024-02-15T22:41:19.848 INFO:tasks.workunit.client.1.smithi082.stdout:8/673: symlink d1/d7/d9/d42/d6a/lea 0 2024-02-15T22:41:19.849 INFO:tasks.workunit.client.1.smithi082.stdout:7/748: dwrite d12/d17/d42/d67/d81/d91/da0/fb5 [0,4194304] 0 2024-02-15T22:41:19.851 INFO:tasks.workunit.client.1.smithi082.stdout:8/674: stat d1/d7/d9/d42/dc5/c94 0 2024-02-15T22:41:19.851 INFO:tasks.workunit.client.1.smithi082.stdout:8/675: dread - d1/d7/d9/d24/fe1 zero size 2024-02-15T22:41:19.857 INFO:tasks.workunit.client.1.smithi082.stdout:6/735: dread d2/d18/d23/d67/fa3 [0,4194304] 0 2024-02-15T22:41:19.857 INFO:tasks.workunit.client.1.smithi082.stdout:9/705: dread d8/d12/d30/f51 [0,4194304] 0 2024-02-15T22:41:19.857 INFO:tasks.workunit.client.1.smithi082.stdout:9/706: creat d8/d12/d67/fd9 x:0 0 0 2024-02-15T22:41:19.861 INFO:tasks.workunit.client.1.smithi082.stdout:4/855: dwrite d0/fc2 [0,4194304] 0 2024-02-15T22:41:19.862 INFO:tasks.workunit.client.1.smithi082.stdout:4/856: creat d0/d8/d1b/dd/daa/f13d x:0 0 0 2024-02-15T22:41:19.862 INFO:tasks.workunit.client.1.smithi082.stdout:4/857: chown d0/d47/da6/c9e 30929684 1 2024-02-15T22:41:19.863 INFO:tasks.workunit.client.1.smithi082.stdout:6/736: write d2/d18/d8a/d47/d69/d75/f9a [603333,65618] 0 2024-02-15T22:41:19.869 INFO:tasks.workunit.client.1.smithi082.stdout:4/858: getdents d0/d16/d4a 0 2024-02-15T22:41:19.869 INFO:tasks.workunit.client.1.smithi082.stdout:4/859: write d0/dc0/dcd/ffc [580614,110213] 0 2024-02-15T22:41:19.870 INFO:tasks.workunit.client.1.smithi082.stdout:6/737: creat d2/d30/da6/fec x:0 0 0 2024-02-15T22:41:19.870 INFO:tasks.workunit.client.1.smithi082.stdout:6/738: chown d2/d18/d8a/d47/d69/d75/ce6 12 1 2024-02-15T22:41:19.871 INFO:tasks.workunit.client.1.smithi082.stdout:6/739: chown d2/d18/d8a/d47/d72/fe3 1648 1 2024-02-15T22:41:19.871 INFO:tasks.workunit.client.1.smithi082.stdout:4/860: mkdir d0/d47/dd8/d13e 0 2024-02-15T22:41:19.871 INFO:tasks.workunit.client.1.smithi082.stdout:4/861: readlink d0/d46/df9/l105 0 2024-02-15T22:41:19.871 INFO:tasks.workunit.client.1.smithi082.stdout:4/862: creat d0/d47/da6/d114/f13f x:0 0 0 2024-02-15T22:41:19.872 INFO:tasks.workunit.client.1.smithi082.stdout:6/740: mkdir d2/d18/d8a/d47/d69/dc1/ded 0 2024-02-15T22:41:19.875 INFO:tasks.workunit.client.1.smithi082.stdout:6/741: unlink d2/cbc 0 2024-02-15T22:41:19.876 INFO:tasks.workunit.client.1.smithi082.stdout:6/742: mknod d2/d18/d23/d67/cee 0 2024-02-15T22:41:19.878 INFO:tasks.workunit.client.1.smithi082.stdout:6/743: symlink d2/d18/d8a/d47/d69/d75/de4/lef 0 2024-02-15T22:41:19.880 INFO:tasks.workunit.client.1.smithi082.stdout:6/744: mknod d2/d18/d8a/d47/d69/db1/cf0 0 2024-02-15T22:41:19.881 INFO:tasks.workunit.client.1.smithi082.stdout:6/745: truncate d2/d18/d8a/d65/fcf 3611987 0 2024-02-15T22:41:19.882 INFO:tasks.workunit.client.1.smithi082.stdout:0/638: fsync d3/d19/d20/fd7 0 2024-02-15T22:41:19.882 INFO:tasks.workunit.client.1.smithi082.stdout:0/639: write d3/d19/d5f/da5/d99/fa7 [489248,9098] 0 2024-02-15T22:41:19.882 INFO:tasks.workunit.client.1.smithi082.stdout:0/640: truncate d3/d19/d5f/da5/d99/db1/fbd 1206271 0 2024-02-15T22:41:19.884 INFO:tasks.workunit.client.1.smithi082.stdout:0/641: rename d3/d19/d20/d7c/dd5/f79 to d3/d6b/dac/fda 0 2024-02-15T22:41:19.887 INFO:tasks.workunit.client.1.smithi082.stdout:0/642: mkdir d3/d19/d1c/ddb 0 2024-02-15T22:41:19.889 INFO:tasks.workunit.client.1.smithi082.stdout:0/643: unlink d3/d19/d20/d26/fc3 0 2024-02-15T22:41:19.891 INFO:tasks.workunit.client.1.smithi082.stdout:0/644: mkdir d3/d19/d5f/da5/d99/ddc 0 2024-02-15T22:41:19.892 INFO:tasks.workunit.client.1.smithi082.stdout:0/645: readlink d3/lf 0 2024-02-15T22:41:19.892 INFO:tasks.workunit.client.1.smithi082.stdout:0/646: fdatasync d3/d19/d20/fd7 0 2024-02-15T22:41:19.894 INFO:tasks.workunit.client.1.smithi082.stdout:7/749: dwrite f6 [0,4194304] 0 2024-02-15T22:41:19.894 INFO:tasks.workunit.client.1.smithi082.stdout:8/676: dwrite d1/d7/d9/d50/fc3 [0,4194304] 0 2024-02-15T22:41:19.897 INFO:tasks.workunit.client.1.smithi082.stdout:9/707: dwrite d8/d12/fcd [0,4194304] 0 2024-02-15T22:41:19.897 INFO:tasks.workunit.client.1.smithi082.stdout:9/708: truncate d8/d12/d33/d3e/fc7 896008 0 2024-02-15T22:41:19.898 INFO:tasks.workunit.client.1.smithi082.stdout:4/863: dwrite d0/fa0 [0,4194304] 0 2024-02-15T22:41:19.898 INFO:tasks.workunit.client.1.smithi082.stdout:4/864: dread - d0/d47/d4d/fad zero size 2024-02-15T22:41:19.899 INFO:tasks.workunit.client.1.smithi082.stdout:7/750: link d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/ce6 d12/d27/dc2/dda/cf7 0 2024-02-15T22:41:19.899 INFO:tasks.workunit.client.1.smithi082.stdout:4/865: write d0/dc0/dcd/f12c [612347,4972] 0 2024-02-15T22:41:19.901 INFO:tasks.workunit.client.1.smithi082.stdout:8/677: mknod d1/ceb 0 2024-02-15T22:41:19.902 INFO:tasks.workunit.client.1.smithi082.stdout:0/647: dread d3/f15 [0,4194304] 0 2024-02-15T22:41:19.907 INFO:tasks.workunit.client.1.smithi082.stdout:9/709: rename d8/d24/d2e/f6a to d8/d12/d33/d3e/fda 0 2024-02-15T22:41:19.907 INFO:tasks.workunit.client.1.smithi082.stdout:9/710: creat d8/d12/d33/d64/d8b/d96/fdb x:0 0 0 2024-02-15T22:41:19.909 INFO:tasks.workunit.client.1.smithi082.stdout:7/751: mknod d12/d17/d42/d67/cf8 0 2024-02-15T22:41:19.910 INFO:tasks.workunit.client.1.smithi082.stdout:7/752: write d12/d3b/f44 [18901,119138] 0 2024-02-15T22:41:19.910 INFO:tasks.workunit.client.1.smithi082.stdout:7/753: fsync d12/d27/f2c 0 2024-02-15T22:41:19.910 INFO:tasks.workunit.client.1.smithi082.stdout:9/711: write d8/d12/d33/d64/d77/dab/fae [760679,115271] 0 2024-02-15T22:41:19.912 INFO:tasks.workunit.client.1.smithi082.stdout:8/678: mknod d1/d7/d48/cec 0 2024-02-15T22:41:19.913 INFO:tasks.workunit.client.1.smithi082.stdout:0/648: write d3/f57 [4976236,73775] 0 2024-02-15T22:41:19.913 INFO:tasks.workunit.client.1.smithi082.stdout:0/649: creat d3/d19/d93/dbe/fdd x:0 0 0 2024-02-15T22:41:19.913 INFO:tasks.workunit.client.1.smithi082.stdout:0/650: chown d3/d19/d5f/da5/d99/db1/fbd 200437716 1 2024-02-15T22:41:19.914 INFO:tasks.workunit.client.1.smithi082.stdout:9/712: creat d8/d24/d2e/fdc x:0 0 0 2024-02-15T22:41:19.917 INFO:tasks.workunit.client.1.smithi082.stdout:9/713: symlink d8/d12/d33/d64/d8b/ldd 0 2024-02-15T22:41:19.919 INFO:tasks.workunit.client.1.smithi082.stdout:9/714: rmdir d8/d12/d33/d64/d7c/d99 0 2024-02-15T22:41:19.924 INFO:tasks.workunit.client.1.smithi082.stdout:4/866: dwrite d0/f54 [0,4194304] 0 2024-02-15T22:41:19.924 INFO:tasks.workunit.client.1.smithi082.stdout:4/867: write d0/fa8 [1096359,95584] 0 2024-02-15T22:41:19.925 INFO:tasks.workunit.client.1.smithi082.stdout:4/868: stat d0/dc0 0 2024-02-15T22:41:19.931 INFO:tasks.workunit.client.1.smithi082.stdout:8/679: write d1/d7/d9/d50/fa8 [3469913,73951] 0 2024-02-15T22:41:19.931 INFO:tasks.workunit.client.1.smithi082.stdout:8/680: stat d1/d7/d9/d50/d56 0 2024-02-15T22:41:19.931 INFO:tasks.workunit.client.1.smithi082.stdout:4/869: rmdir d0/d47 39 2024-02-15T22:41:19.933 INFO:tasks.workunit.client.1.smithi082.stdout:0/651: dwrite d3/d19/d5f/da5/d99/db1/fbd [0,4194304] 0 2024-02-15T22:41:19.959 INFO:tasks.workunit.client.1.smithi082.stdout:9/715: dwrite d8/d12/d33/fbb [0,4194304] 0 2024-02-15T22:41:19.959 INFO:tasks.workunit.client.1.smithi082.stdout:9/716: chown d8/d24/f4b 97676 1 2024-02-15T22:41:19.961 INFO:tasks.workunit.client.1.smithi082.stdout:8/681: dwrite d1/d7/d9/d50/d56/dab/fc1 [8388608,4194304] 0 2024-02-15T22:41:20.009 INFO:tasks.workunit.client.1.smithi082.stdout:9/717: truncate d8/f44 800527 0 2024-02-15T22:41:20.009 INFO:tasks.workunit.client.1.smithi082.stdout:9/718: chown d8/d12/d30/d3c/d65/lbd 3179 1 2024-02-15T22:41:20.012 INFO:tasks.workunit.client.1.smithi082.stdout:8/682: rename d1/d7/d9/d50/d56/dab/fc1 to d1/d7/de/d57/fed 0 2024-02-15T22:41:20.013 INFO:tasks.workunit.client.1.smithi082.stdout:8/683: creat d1/d7/d9/d24/fee x:0 0 0 2024-02-15T22:41:20.021 INFO:tasks.workunit.client.1.smithi082.stdout:9/719: write d8/d12/dc5/f57 [1518217,69095] 0 2024-02-15T22:41:20.021 INFO:tasks.workunit.client.1.smithi082.stdout:9/720: stat d8/d24/d2e/l5a 0 2024-02-15T22:41:20.021 INFO:tasks.workunit.client.1.smithi082.stdout:9/721: chown d8/d12/dc5/cca 13936283 1 2024-02-15T22:41:20.027 INFO:tasks.workunit.client.1.smithi082.stdout:8/684: dwrite d1/d40/dbb/fc6 [0,4194304] 0 2024-02-15T22:41:20.029 INFO:tasks.workunit.client.1.smithi082.stdout:8/685: write d1/d7/d48/f6e [4282859,79867] 0 2024-02-15T22:41:20.029 INFO:tasks.workunit.client.1.smithi082.stdout:8/686: chown d1/d7/de/l15 85 1 2024-02-15T22:41:20.037 INFO:tasks.workunit.client.1.smithi082.stdout:8/687: dread d1/d7/de/d1e/fc4 [0,4194304] 0 2024-02-15T22:41:20.038 INFO:tasks.workunit.client.1.smithi082.stdout:4/870: rmdir d0/d8/d1b 39 2024-02-15T22:41:20.046 INFO:tasks.workunit.client.1.smithi082.stdout:6/746: write d2/d18/d8a/d65/fcf [4247031,23649] 0 2024-02-15T22:41:20.046 INFO:tasks.workunit.client.1.smithi082.stdout:6/747: fsync d2/d18/d8a/d47/d72/f78 0 2024-02-15T22:41:20.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:19 smithi033 ceph-mon[29033]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:41:20.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:19 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:41:20.930 INFO:tasks.workunit.client.1.smithi082.stdout:8/688: mkdir d1/d7/d9/d24/d43/da6/db8/def 0 2024-02-15T22:41:20.930 INFO:tasks.workunit.client.1.smithi082.stdout:8/689: write d1/d7/de/f80 [9429727,47232] 0 2024-02-15T22:41:20.935 INFO:tasks.workunit.client.1.smithi082.stdout:6/748: truncate d2/f6e 1262501 0 2024-02-15T22:41:20.936 INFO:tasks.workunit.client.1.smithi082.stdout:9/722: rmdir d8/d12/dc5 39 2024-02-15T22:41:20.936 INFO:tasks.workunit.client.1.smithi082.stdout:9/723: fdatasync d8/d12/d33/d64/d7c/f94 0 2024-02-15T22:41:20.944 INFO:tasks.workunit.client.1.smithi082.stdout:6/749: rename d2/d18/d8a/d47/d69/db1/lea to d2/d18/d39/lf1 0 2024-02-15T22:41:20.952 INFO:tasks.workunit.client.1.smithi082.stdout:8/690: dwrite d1/d7/d9/d42/dc5/f79 [0,4194304] 0 2024-02-15T22:41:20.953 INFO:tasks.workunit.client.1.smithi082.stdout:4/871: creat d0/d16/d4a/d6a/dd9/de2/f140 x:0 0 0 2024-02-15T22:41:20.958 INFO:tasks.workunit.client.1.smithi082.stdout:9/724: symlink d8/d12/d33/da4/dac/lde 0 2024-02-15T22:41:20.958 INFO:tasks.workunit.client.1.smithi082.stdout:9/725: stat d8/d12/d67/d70 0 2024-02-15T22:41:20.958 INFO:tasks.workunit.client.1.smithi082.stdout:9/726: write d8/d24/d2e/d53/fd2 [91592,64090] 0 2024-02-15T22:41:20.959 INFO:tasks.workunit.client.1.smithi082.stdout:8/691: truncate d1/d7/de/f2e 1138941 0 2024-02-15T22:41:20.959 INFO:tasks.workunit.client.1.smithi082.stdout:8/692: read - d1/d7/d9/d24/d43/d85/f97 zero size 2024-02-15T22:41:20.959 INFO:tasks.workunit.client.1.smithi082.stdout:8/693: write d1/d7/de/d57/f74 [1662930,69404] 0 2024-02-15T22:41:20.961 INFO:tasks.workunit.client.1.smithi082.stdout:4/872: link d0/d8/d1b/dd/daa/ff5 d0/d8/d1b/dd/d37/f141 0 2024-02-15T22:41:20.964 INFO:tasks.workunit.client.1.smithi082.stdout:8/694: creat d1/d40/dbb/dcf/ff0 x:0 0 0 2024-02-15T22:41:20.967 INFO:tasks.workunit.client.1.smithi082.stdout:4/873: mkdir d0/d16/d4a/d6a/d142 0 2024-02-15T22:41:20.967 INFO:tasks.workunit.client.1.smithi082.stdout:4/874: creat d0/d16/d4a/d6a/dd9/de2/f143 x:0 0 0 2024-02-15T22:41:20.972 INFO:tasks.workunit.client.1.smithi082.stdout:9/727: write d8/d12/dc5/f72 [216452,2372] 0 2024-02-15T22:41:20.972 INFO:tasks.workunit.client.1.smithi082.stdout:6/750: dwrite d2/d18/d8a/d47/f91 [0,4194304] 0 2024-02-15T22:41:20.972 INFO:tasks.workunit.client.1.smithi082.stdout:9/728: read d8/d24/d2e/f41 [641964,71171] 0 2024-02-15T22:41:20.977 INFO:tasks.workunit.client.1.smithi082.stdout:6/751: creat d2/d18/d23/ddf/ff2 x:0 0 0 2024-02-15T22:41:20.977 INFO:tasks.workunit.client.1.smithi082.stdout:4/875: rmdir d0/d47/da6/da7 39 2024-02-15T22:41:20.981 INFO:tasks.workunit.client.1.smithi082.stdout:9/729: unlink d8/d12/d33/l62 0 2024-02-15T22:41:20.983 INFO:tasks.workunit.client.1.smithi082.stdout:6/752: unlink d2/d30/l36 0 2024-02-15T22:41:20.986 INFO:tasks.workunit.client.1.smithi082.stdout:9/730: rename d8/d12/dc5/f8a to d8/d12/d30/fdf 0 2024-02-15T22:41:20.987 INFO:tasks.workunit.client.1.smithi082.stdout:6/753: mknod d2/d18/cf3 0 2024-02-15T22:41:20.988 INFO:tasks.workunit.client.1.smithi082.stdout:8/695: dwrite d1/d7/d48/f64 [0,4194304] 0 2024-02-15T22:41:20.991 INFO:tasks.workunit.client.1.smithi082.stdout:9/731: getdents d8/d12/d67 0 2024-02-15T22:41:20.991 INFO:tasks.workunit.client.1.smithi082.stdout:6/754: creat d2/d30/ff4 x:0 0 0 2024-02-15T22:41:20.998 INFO:tasks.workunit.client.1.smithi082.stdout:4/876: dwrite d0/d8/d32/fbf [0,4194304] 0 2024-02-15T22:41:20.999 INFO:tasks.workunit.client.1.smithi082.stdout:9/732: dread d8/f44 [0,4194304] 0 2024-02-15T22:41:21.007 INFO:tasks.workunit.client.1.smithi082.stdout:5/705: sync 2024-02-15T22:41:21.007 INFO:tasks.workunit.client.1.smithi082.stdout:2/686: sync 2024-02-15T22:41:21.007 INFO:tasks.workunit.client.1.smithi082.stdout:7/754: sync 2024-02-15T22:41:21.008 INFO:tasks.workunit.client.1.smithi082.stdout:2/687: fdatasync d6/dc/d58/d49/f56 0 2024-02-15T22:41:21.008 INFO:tasks.workunit.client.1.smithi082.stdout:0/652: sync 2024-02-15T22:41:21.008 INFO:tasks.workunit.client.1.smithi082.stdout:5/706: truncate d5/da/d14/d45/fc1 1313558 0 2024-02-15T22:41:21.008 INFO:tasks.workunit.client.1.smithi082.stdout:3/716: sync 2024-02-15T22:41:21.008 INFO:tasks.workunit.client.1.smithi082.stdout:1/657: sync 2024-02-15T22:41:21.008 INFO:tasks.workunit.client.1.smithi082.stdout:1/658: write d1/da/d14/d18/fbe [1423811,78834] 0 2024-02-15T22:41:21.009 INFO:tasks.workunit.client.1.smithi082.stdout:4/877: rmdir d0/d16 39 2024-02-15T22:41:21.012 INFO:tasks.workunit.client.1.smithi082.stdout:6/755: dwrite d2/d30/d3b/f49 [0,4194304] 0 2024-02-15T22:41:21.012 INFO:tasks.workunit.client.1.smithi082.stdout:7/755: mkdir d12/d3b/df9 0 2024-02-15T22:41:21.013 INFO:tasks.workunit.client.1.smithi082.stdout:6/756: dread d2/d18/d8a/d47/f54 [0,4194304] 0 2024-02-15T22:41:21.013 INFO:tasks.workunit.client.1.smithi082.stdout:6/757: chown d2/d45/c5d 1 1 2024-02-15T22:41:21.014 INFO:tasks.workunit.client.1.smithi082.stdout:2/688: creat d6/dc/d12/d46/d4b/fd0 x:0 0 0 2024-02-15T22:41:21.019 INFO:tasks.workunit.client.1.smithi082.stdout:5/707: dread d5/da/f26 [0,4194304] 0 2024-02-15T22:41:21.019 INFO:tasks.workunit.client.1.smithi082.stdout:5/708: write d5/da/d14/f97 [770565,77633] 0 2024-02-15T22:41:21.019 INFO:tasks.workunit.client.1.smithi082.stdout:3/717: symlink d0/d16/d3e/d56/lf2 0 2024-02-15T22:41:21.021 INFO:tasks.workunit.client.1.smithi082.stdout:1/659: creat d1/da/d11/d3f/d75/fdc x:0 0 0 2024-02-15T22:41:21.022 INFO:tasks.workunit.client.1.smithi082.stdout:2/689: dread d6/dc/dd/d24/f43 [0,4194304] 0 2024-02-15T22:41:21.023 INFO:tasks.workunit.client.1.smithi082.stdout:4/878: creat d0/dc0/dcd/d138/f144 x:0 0 0 2024-02-15T22:41:21.024 INFO:tasks.workunit.client.1.smithi082.stdout:9/733: rename d8/d12/d33/d64 to d8/d24/d87/de0 0 2024-02-15T22:41:21.026 INFO:tasks.workunit.client.1.smithi082.stdout:7/756: creat d12/d3b/df9/ffa x:0 0 0 2024-02-15T22:41:21.026 INFO:tasks.workunit.client.1.smithi082.stdout:7/757: chown d12/d27/d33/l83 122822 1 2024-02-15T22:41:21.026 INFO:tasks.workunit.client.1.smithi082.stdout:7/758: readlink d12/d3b/d41/l7f 0 2024-02-15T22:41:21.027 INFO:tasks.workunit.client.1.smithi082.stdout:5/709: dread d5/da/d56/d6e/fbc [0,4194304] 0 2024-02-15T22:41:21.027 INFO:tasks.workunit.client.1.smithi082.stdout:0/653: symlink d3/d19/d25/d45/lde 0 2024-02-15T22:41:21.030 INFO:tasks.workunit.client.1.smithi082.stdout:3/718: creat d0/d16/d62/d14/d21/d69/d6c/ff3 x:0 0 0 2024-02-15T22:41:21.030 INFO:tasks.workunit.client.1.smithi082.stdout:3/719: chown d0/dc/fbd 15915 1 2024-02-15T22:41:21.031 INFO:tasks.workunit.client.1.smithi082.stdout:2/690: creat d6/fd1 x:0 0 0 2024-02-15T22:41:21.033 INFO:tasks.workunit.client.1.smithi082.stdout:4/879: rename d0/c6c to d0/d8/d1b/c145 0 2024-02-15T22:41:21.033 INFO:tasks.workunit.client.1.smithi082.stdout:4/880: dread - d0/d8/d1b/dd/d37/d133/f135 zero size 2024-02-15T22:41:21.033 INFO:tasks.workunit.client.1.smithi082.stdout:1/660: dread d1/da/d14/d18/d1f/f84 [0,4194304] 0 2024-02-15T22:41:21.036 INFO:tasks.workunit.client.1.smithi082.stdout:6/758: rmdir d2/d18/d8a/d47/dae 39 2024-02-15T22:41:21.037 INFO:tasks.workunit.client.1.smithi082.stdout:6/759: stat d2/f98 0 2024-02-15T22:41:21.037 INFO:tasks.workunit.client.1.smithi082.stdout:6/760: fdatasync d2/d30/da6/fec 0 2024-02-15T22:41:21.037 INFO:tasks.workunit.client.1.smithi082.stdout:6/761: fsync d2/d18/d8a/d65/f7f 0 2024-02-15T22:41:21.037 INFO:tasks.workunit.client.1.smithi082.stdout:5/710: dread d5/da/d14/d45/f60 [0,4194304] 0 2024-02-15T22:41:21.039 INFO:tasks.workunit.client.1.smithi082.stdout:5/711: dread d5/da/f25 [0,4194304] 0 2024-02-15T22:41:21.040 INFO:tasks.workunit.client.1.smithi082.stdout:5/712: write d5/f2e [646623,64998] 0 2024-02-15T22:41:21.042 INFO:tasks.workunit.client.1.smithi082.stdout:7/759: rename d12/d27/l2a to d12/d3b/d5a/lfb 0 2024-02-15T22:41:21.043 INFO:tasks.workunit.client.1.smithi082.stdout:4/881: symlink d0/dc0/dcd/de3/d12d/l146 0 2024-02-15T22:41:21.047 INFO:tasks.workunit.client.1.smithi082.stdout:9/734: rmdir d8/d12/d67 39 2024-02-15T22:41:21.052 INFO:tasks.workunit.client.1.smithi082.stdout:5/713: creat d5/da/d67/dbf/ff2 x:0 0 0 2024-02-15T22:41:21.052 INFO:tasks.workunit.client.1.smithi082.stdout:5/714: fsync d5/da/d14/d45/f6b 0 2024-02-15T22:41:21.054 INFO:tasks.workunit.client.1.smithi082.stdout:7/760: creat d12/d27/dc4/ffc x:0 0 0 2024-02-15T22:41:21.054 INFO:tasks.workunit.client.1.smithi082.stdout:7/761: fsync d12/d3b/d41/f60 0 2024-02-15T22:41:21.054 INFO:tasks.workunit.client.1.smithi082.stdout:7/762: readlink d12/d27/d33/l76 0 2024-02-15T22:41:21.055 INFO:tasks.workunit.client.1.smithi082.stdout:2/691: dwrite d6/dc/dd/d24/d72/fc4 [0,4194304] 0 2024-02-15T22:41:21.056 INFO:tasks.workunit.client.1.smithi082.stdout:6/762: creat d2/d18/d8a/d47/d69/dc1/ded/ff5 x:0 0 0 2024-02-15T22:41:21.058 INFO:tasks.workunit.client.1.smithi082.stdout:3/720: dwrite d0/d16/d62/d14/d21/d69/dbe/fdd [0,4194304] 0 2024-02-15T22:41:21.059 INFO:tasks.workunit.client.1.smithi082.stdout:4/882: link d0/cbd d0/d16/d87/c147 0 2024-02-15T22:41:21.064 INFO:tasks.workunit.client.1.smithi082.stdout:1/661: rmdir d1/da/d11/d3f 39 2024-02-15T22:41:21.066 INFO:tasks.workunit.client.1.smithi082.stdout:5/715: symlink d5/da/d67/dbf/lf3 0 2024-02-15T22:41:21.072 INFO:tasks.workunit.client.1.smithi082.stdout:6/763: creat d2/d18/d23/ddf/ff6 x:0 0 0 2024-02-15T22:41:21.074 INFO:tasks.workunit.client.1.smithi082.stdout:0/654: rmdir d3/d19/d1c/ddb 0 2024-02-15T22:41:21.076 INFO:tasks.workunit.client.1.smithi082.stdout:9/735: rmdir d8/d12/d30/d3c/d65 39 2024-02-15T22:41:21.077 INFO:tasks.workunit.client.1.smithi082.stdout:1/662: dread d1/da/d11/d3f/f53 [0,4194304] 0 2024-02-15T22:41:21.081 INFO:tasks.workunit.client.1.smithi082.stdout:4/883: mknod d0/d8/d32/c148 0 2024-02-15T22:41:21.081 INFO:tasks.workunit.client.1.smithi082.stdout:4/884: write d0/d47/da6/fee [417665,84967] 0 2024-02-15T22:41:21.081 INFO:tasks.workunit.client.1.smithi082.stdout:4/885: readlink d0/d47/d4d/l129 0 2024-02-15T22:41:21.081 INFO:tasks.workunit.client.1.smithi082.stdout:4/886: chown d0/d16/f111 585439 1 2024-02-15T22:41:21.082 INFO:tasks.workunit.client.1.smithi082.stdout:4/887: chown d0/f31 351917069 1 2024-02-15T22:41:21.082 INFO:tasks.workunit.client.1.smithi082.stdout:5/716: creat d5/da/dc/d43/ff4 x:0 0 0 2024-02-15T22:41:21.084 INFO:tasks.workunit.client.1.smithi082.stdout:7/763: dwrite d12/d37/dbd/fe2 [0,4194304] 0 2024-02-15T22:41:21.084 INFO:tasks.workunit.client.1.smithi082.stdout:7/764: stat d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/df5 0 2024-02-15T22:41:21.084 INFO:tasks.workunit.client.1.smithi082.stdout:0/655: getdents d3/d19/d25 0 2024-02-15T22:41:21.084 INFO:tasks.workunit.client.1.smithi082.stdout:0/656: readlink d3/d19/d25/d45/l1b 0 2024-02-15T22:41:21.084 INFO:tasks.workunit.client.1.smithi082.stdout:0/657: chown d3/d19/d25/d45/lde 0 1 2024-02-15T22:41:21.085 INFO:tasks.workunit.client.1.smithi082.stdout:3/721: dwrite d0/d16/d62/d14/d21/d69/d87/f8f [0,4194304] 0 2024-02-15T22:41:21.085 INFO:tasks.workunit.client.1.smithi082.stdout:2/692: dwrite d6/dc/d58/d49/db6/fb3 [4194304,4194304] 0 2024-02-15T22:41:21.088 INFO:tasks.workunit.client.1.smithi082.stdout:7/765: dread d12/d37/f5b [0,4194304] 0 2024-02-15T22:41:21.088 INFO:tasks.workunit.client.1.smithi082.stdout:7/766: creat d12/d3b/df9/ffd x:0 0 0 2024-02-15T22:41:21.088 INFO:tasks.workunit.client.1.smithi082.stdout:7/767: stat d12/d17/d42/d67/d81/d91/dbc 0 2024-02-15T22:41:21.088 INFO:tasks.workunit.client.1.smithi082.stdout:7/768: chown d12/f16 40892622 1 2024-02-15T22:41:21.090 INFO:tasks.workunit.client.1.smithi082.stdout:9/736: link d8/d24/d87/de0/fd7 d8/d12/d30/d3c/d65/fe1 0 2024-02-15T22:41:21.094 INFO:tasks.workunit.client.1.smithi082.stdout:4/888: rename d0/d8/d1b/fb3 to d0/d47/dd8/f149 0 2024-02-15T22:41:21.094 INFO:tasks.workunit.client.1.smithi082.stdout:4/889: chown d0/d16/d4a/d6a/dd9/de2/f143 412109 1 2024-02-15T22:41:21.094 INFO:tasks.workunit.client.1.smithi082.stdout:4/890: truncate d0/d16/f9c 4844825 0 2024-02-15T22:41:21.094 INFO:tasks.workunit.client.1.smithi082.stdout:4/891: fdatasync d0/d8/d32/fb4 0 2024-02-15T22:41:21.098 INFO:tasks.workunit.client.1.smithi082.stdout:5/717: link d5/da/de3/lec d5/da/dc/dad/dcf/d59/d84/lf5 0 2024-02-15T22:41:21.102 INFO:tasks.workunit.client.1.smithi082.stdout:4/892: write d0/d8/fdc [2828681,128300] 0 2024-02-15T22:41:21.102 INFO:tasks.workunit.client.1.smithi082.stdout:4/893: chown d0/d8/d1b/f73 999697 1 2024-02-15T22:41:21.112 INFO:tasks.workunit.client.1.smithi082.stdout:0/658: getdents d3/d19/d1c 0 2024-02-15T22:41:21.122 INFO:tasks.workunit.client.1.smithi082.stdout:2/693: symlink d6/dc/dd/d24/d71/ld2 0 2024-02-15T22:41:21.130 INFO:tasks.workunit.client.1.smithi082.stdout:7/769: mkdir d12/d3b/d41/dfe 0 2024-02-15T22:41:21.132 INFO:tasks.workunit.client.1.smithi082.stdout:9/737: truncate d8/d24/d2e/f34 1814657 0 2024-02-15T22:41:21.132 INFO:tasks.workunit.client.1.smithi082.stdout:9/738: readlink d8/d12/d33/l4f 0 2024-02-15T22:41:21.133 INFO:tasks.workunit.client.1.smithi082.stdout:5/718: mknod d5/da/dc/dad/dcf/d59/da3/cf6 0 2024-02-15T22:41:21.134 INFO:tasks.workunit.client.1.smithi082.stdout:9/739: dread d8/d24/d87/de0/d77/dab/fb1 [0,4194304] 0 2024-02-15T22:41:21.136 INFO:tasks.workunit.client.1.smithi082.stdout:4/894: unlink d0/d47/cfd 0 2024-02-15T22:41:21.137 INFO:tasks.workunit.client.1.smithi082.stdout:0/659: symlink d3/d19/d20/d7c/ldf 0 2024-02-15T22:41:21.139 INFO:tasks.workunit.client.1.smithi082.stdout:2/694: creat d6/d3c/d8c/fd3 x:0 0 0 2024-02-15T22:41:21.143 INFO:tasks.workunit.client.1.smithi082.stdout:9/740: mknod d8/d24/d87/de0/d77/dc6/ce2 0 2024-02-15T22:41:21.143 INFO:tasks.workunit.client.1.smithi082.stdout:5/719: dread d5/da/dc/f3d [0,4194304] 0 2024-02-15T22:41:21.145 INFO:tasks.workunit.client.1.smithi082.stdout:4/895: symlink d0/dc0/dcd/dcf/l14a 0 2024-02-15T22:41:21.146 INFO:tasks.workunit.client.1.smithi082.stdout:7/770: rename d12/d3b/feb to d12/d3b/d5a/dce/fff 0 2024-02-15T22:41:21.149 INFO:tasks.workunit.client.1.smithi082.stdout:5/720: rmdir d5/da/d67/da0/dde 39 2024-02-15T22:41:21.149 INFO:tasks.workunit.client.1.smithi082.stdout:5/721: chown d5/da/de3 256905093 1 2024-02-15T22:41:21.149 INFO:tasks.workunit.client.1.smithi082.stdout:5/722: fdatasync d5/f4b 0 2024-02-15T22:41:21.149 INFO:tasks.workunit.client.1.smithi082.stdout:5/723: dread - d5/da/d67/da0/d92/fc3 zero size 2024-02-15T22:41:21.152 INFO:tasks.workunit.client.1.smithi082.stdout:7/771: mkdir d12/d27/d100 0 2024-02-15T22:41:21.153 INFO:tasks.workunit.client.1.smithi082.stdout:5/724: rmdir d5/da/d14/d53 39 2024-02-15T22:41:21.156 INFO:tasks.workunit.client.1.smithi082.stdout:2/695: dwrite d6/dc/d12/f74 [0,4194304] 0 2024-02-15T22:41:21.158 INFO:tasks.workunit.client.1.smithi082.stdout:7/772: link d12/d37/f70 d12/d17/d42/d67/d81/d91/f101 0 2024-02-15T22:41:21.159 INFO:tasks.workunit.client.1.smithi082.stdout:0/660: rename d3/d19/d20/d7c/ldf to d3/d19/d5f/da5/d99/ddc/le0 0 2024-02-15T22:41:21.160 INFO:tasks.workunit.client.1.smithi082.stdout:5/725: rmdir d5/da/d67/da0/dde 39 2024-02-15T22:41:21.160 INFO:tasks.workunit.client.1.smithi082.stdout:5/726: stat d5/da/dc/dad/dcf/d59 0 2024-02-15T22:41:21.163 INFO:tasks.workunit.client.1.smithi082.stdout:2/696: truncate d6/dc/d58/d49/fa2 1082715 0 2024-02-15T22:41:21.166 INFO:tasks.workunit.client.1.smithi082.stdout:9/741: rename d8/d12/d30/fdf to d8/d12/d67/d70/fe3 0 2024-02-15T22:41:21.168 INFO:tasks.workunit.client.1.smithi082.stdout:7/773: dread d12/d17/d3d/f40 [0,4194304] 0 2024-02-15T22:41:21.171 INFO:tasks.workunit.client.1.smithi082.stdout:0/661: write d3/d19/d1c/f52 [2968789,71851] 0 2024-02-15T22:41:21.171 INFO:tasks.workunit.client.1.smithi082.stdout:9/742: rename d8/d24/d87/de0/d77/dc6/ce2 to d8/ce4 0 2024-02-15T22:41:21.171 INFO:tasks.workunit.client.1.smithi082.stdout:9/743: fdatasync d8/d12/d30/d3c/d65/f9b 0 2024-02-15T22:41:21.174 INFO:tasks.workunit.client.1.smithi082.stdout:9/744: mkdir d8/d24/d87/dcb/de5 0 2024-02-15T22:41:21.176 INFO:tasks.workunit.client.1.smithi082.stdout:2/697: rmdir d6/dc/d12/d23/d6e 39 2024-02-15T22:41:21.180 INFO:tasks.workunit.client.1.smithi082.stdout:9/745: rmdir d8/d12 39 2024-02-15T22:41:21.181 INFO:tasks.workunit.client.1.smithi082.stdout:9/746: truncate d8/d12/d30/d3c/d65/f9b 686302 0 2024-02-15T22:41:21.181 INFO:tasks.workunit.client.1.smithi082.stdout:5/727: dwrite d5/da/f96 [0,4194304] 0 2024-02-15T22:41:21.181 INFO:tasks.workunit.client.1.smithi082.stdout:0/662: dread d3/fb [4194304,4194304] 0 2024-02-15T22:41:21.181 INFO:tasks.workunit.client.1.smithi082.stdout:5/728: chown d5/da/dc/dad/dcf/d59/d84/fd2 166 1 2024-02-15T22:41:21.181 INFO:tasks.workunit.client.1.smithi082.stdout:0/663: truncate d3/d19/d5f/da5/d99/db1/dd2/f68 2483870 0 2024-02-15T22:41:21.181 INFO:tasks.workunit.client.1.smithi082.stdout:0/664: chown d3/d19/d1c/c5a 1 1 2024-02-15T22:41:21.181 INFO:tasks.workunit.client.1.smithi082.stdout:2/698: getdents d6/dc/d12/d23/d6e 0 2024-02-15T22:41:21.192 INFO:tasks.workunit.client.1.smithi082.stdout:5/729: dread d5/da/dc/dad/fd9 [0,4194304] 0 2024-02-15T22:41:21.193 INFO:tasks.workunit.client.1.smithi082.stdout:9/747: dread f5 [4194304,4194304] 0 2024-02-15T22:41:21.193 INFO:tasks.workunit.client.1.smithi082.stdout:9/748: chown d8/d24/l3a 146942 1 2024-02-15T22:41:21.194 INFO:tasks.workunit.client.1.smithi082.stdout:5/730: rename d5/da/d56/d6e/f82 to d5/da/dc/dad/dcf/ff7 0 2024-02-15T22:41:21.196 INFO:tasks.workunit.client.1.smithi082.stdout:0/665: dread d3/d19/d20/d26/f6a [0,4194304] 0 2024-02-15T22:41:21.196 INFO:tasks.workunit.client.1.smithi082.stdout:0/666: chown d3/d19/d25/d45/l74 751273066 1 2024-02-15T22:41:21.199 INFO:tasks.workunit.client.1.smithi082.stdout:5/731: rename d5/da/d67/da0/fc4 to d5/da/dc/d43/ff8 0 2024-02-15T22:41:21.199 INFO:tasks.workunit.client.1.smithi082.stdout:0/667: rmdir d3/d19/d25/d80 39 2024-02-15T22:41:21.199 INFO:tasks.workunit.client.1.smithi082.stdout:0/668: write d3/d19/d5f/da5/d99/fa7 [1476054,107963] 0 2024-02-15T22:41:21.200 INFO:tasks.workunit.client.1.smithi082.stdout:9/749: write d8/d24/d2e/f46 [666231,112455] 0 2024-02-15T22:41:21.200 INFO:tasks.workunit.client.1.smithi082.stdout:9/750: chown d8/d12/fcd 401087 1 2024-02-15T22:41:21.207 INFO:tasks.workunit.client.1.smithi082.stdout:0/669: rename d3/d19/d25/fab to d3/d19/d5f/da0/dbc/fe1 0 2024-02-15T22:41:21.207 INFO:tasks.workunit.client.1.smithi082.stdout:0/670: write d3/d19/d5f/fad [777663,115231] 0 2024-02-15T22:41:21.208 INFO:tasks.workunit.client.1.smithi082.stdout:9/751: truncate d8/f44 1308845 0 2024-02-15T22:41:21.210 INFO:tasks.workunit.client.1.smithi082.stdout:0/671: dread - d3/d19/d5f/da0/dbc/fb8 zero size 2024-02-15T22:41:21.212 INFO:tasks.workunit.client.1.smithi082.stdout:5/732: dwrite d5/da/fc7 [0,4194304] 0 2024-02-15T22:41:21.212 INFO:tasks.workunit.client.1.smithi082.stdout:5/733: dread - d5/da/dc/dad/dcf/d59/fc8 zero size 2024-02-15T22:41:21.214 INFO:tasks.workunit.client.1.smithi082.stdout:0/672: creat d3/d19/d5f/da0/fe2 x:0 0 0 2024-02-15T22:41:21.221 INFO:tasks.workunit.client.1.smithi082.stdout:5/734: symlink d5/da/d14/lf9 0 2024-02-15T22:41:21.221 INFO:tasks.workunit.client.1.smithi082.stdout:5/735: write d5/da/d67/da0/fc5 [116138,106947] 0 2024-02-15T22:41:21.228 INFO:tasks.workunit.client.1.smithi082.stdout:0/673: creat d3/d19/d93/dbe/fe3 x:0 0 0 2024-02-15T22:41:21.229 INFO:tasks.workunit.client.1.smithi082.stdout:0/674: read d3/d19/d20/d26/f31 [156660,11945] 0 2024-02-15T22:41:21.229 INFO:tasks.workunit.client.1.smithi082.stdout:5/736: mkdir d5/da/de3/de9/dfa 0 2024-02-15T22:41:21.231 INFO:tasks.workunit.client.1.smithi082.stdout:0/675: creat d3/d19/d5f/da5/d99/db1/dd2/fe4 x:0 0 0 2024-02-15T22:41:21.233 INFO:tasks.workunit.client.1.smithi082.stdout:5/737: link d5/da/dc/dad/dcf/f35 d5/da/ffb 0 2024-02-15T22:41:21.233 INFO:tasks.workunit.client.1.smithi082.stdout:5/738: stat d5/da/dc/l7a 0 2024-02-15T22:41:21.233 INFO:tasks.workunit.client.1.smithi082.stdout:5/739: chown d5/c2b 233 1 2024-02-15T22:41:21.233 INFO:tasks.workunit.client.1.smithi082.stdout:5/740: readlink d5/da/l29 0 2024-02-15T22:41:21.233 INFO:tasks.workunit.client.1.smithi082.stdout:5/741: chown d5/da/dc/ccc 739580 1 2024-02-15T22:41:21.234 INFO:tasks.workunit.client.1.smithi082.stdout:0/676: truncate d3/d19/d1c/f50 1884436 0 2024-02-15T22:41:21.234 INFO:tasks.workunit.client.1.smithi082.stdout:0/677: fsync d3/d19/d20/d26/fd6 0 2024-02-15T22:41:21.237 INFO:tasks.workunit.client.1.smithi082.stdout:5/742: rename d5/da/d56/d98/ca5 to d5/da/d14/d45/cfc 0 2024-02-15T22:41:21.237 INFO:tasks.workunit.client.1.smithi082.stdout:5/743: stat d5/da/d14/f94 0 2024-02-15T22:41:21.238 INFO:tasks.workunit.client.1.smithi082.stdout:0/678: mknod d3/d19/d1c/d76/d88/ce5 0 2024-02-15T22:41:21.241 INFO:tasks.workunit.client.1.smithi082.stdout:0/679: creat d3/d19/d1c/d6d/fe6 x:0 0 0 2024-02-15T22:41:21.244 INFO:tasks.workunit.client.1.smithi082.stdout:0/680: getdents d3/d19/d5f/da5/d99/ddc 0 2024-02-15T22:41:21.251 INFO:tasks.workunit.client.1.smithi082.stdout:5/744: dwrite d5/da/dc/dad/dcf/d59/da3/fd3 [0,4194304] 0 2024-02-15T22:41:21.251 INFO:tasks.workunit.client.1.smithi082.stdout:5/745: dread - d5/da/d56/f5b zero size 2024-02-15T22:41:21.259 INFO:tasks.workunit.client.1.smithi082.stdout:0/681: dwrite d3/d19/d5f/da5/d9c/fb0 [0,4194304] 0 2024-02-15T22:41:21.259 INFO:tasks.workunit.client.1.smithi082.stdout:0/682: chown d3/c43 14682186 1 2024-02-15T22:41:21.259 INFO:tasks.workunit.client.1.smithi082.stdout:0/683: stat d3/d19/d20/l22 0 2024-02-15T22:41:21.259 INFO:tasks.workunit.client.1.smithi082.stdout:0/684: chown d3/d19/d5f/da5/d99/db3/cc7 243452 1 2024-02-15T22:41:21.264 INFO:tasks.workunit.client.1.smithi082.stdout:0/685: mkdir d3/d19/d25/de7 0 2024-02-15T22:41:21.264 INFO:tasks.workunit.client.1.smithi082.stdout:0/686: fsync d3/d19/d20/d26/f31 0 2024-02-15T22:41:21.265 INFO:tasks.workunit.client.1.smithi082.stdout:0/687: symlink d3/d19/d1c/d76/d88/le8 0 2024-02-15T22:41:21.265 INFO:tasks.workunit.client.1.smithi082.stdout:0/688: write d3/d19/d20/f51 [154306,92547] 0 2024-02-15T22:41:21.266 INFO:tasks.workunit.client.1.smithi082.stdout:0/689: mkdir d3/d19/d5f/da5/d99/db3/de9 0 2024-02-15T22:41:21.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:20 smithi033 ceph-mon[29033]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 132 MiB/s rd, 168 MiB/s wr, 353 op/s 2024-02-15T22:41:21.272 INFO:tasks.workunit.client.1.smithi082.stdout:5/746: dwrite d5/da/dc/dad/dcf/ff7 [0,4194304] 0 2024-02-15T22:41:21.278 INFO:tasks.workunit.client.1.smithi082.stdout:0/690: dread d3/d19/d5f/da5/d99/db1/fbd [0,4194304] 0 2024-02-15T22:41:21.278 INFO:tasks.workunit.client.1.smithi082.stdout:0/691: dread - d3/d19/d93/dbe/fce zero size 2024-02-15T22:41:21.281 INFO:tasks.workunit.client.1.smithi082.stdout:0/692: link d3/d19/d5f/da0/dbc/f9d d3/d19/d5f/d92/fea 0 2024-02-15T22:41:21.288 INFO:tasks.workunit.client.1.smithi082.stdout:5/747: dwrite d5/da/dc/dad/dcf/d59/fb5 [0,4194304] 0 2024-02-15T22:41:21.288 INFO:tasks.workunit.client.1.smithi082.stdout:5/748: fdatasync d5/da/d14/f94 0 2024-02-15T22:41:21.302 INFO:tasks.workunit.client.1.smithi082.stdout:0/693: dwrite d3/d19/f29 [0,4194304] 0 2024-02-15T22:41:21.302 INFO:tasks.workunit.client.1.smithi082.stdout:0/694: write d3/d19/f21 [2089687,74047] 0 2024-02-15T22:41:21.314 INFO:tasks.workunit.client.1.smithi082.stdout:5/749: creat d5/dd8/ffd x:0 0 0 2024-02-15T22:41:21.314 INFO:tasks.workunit.client.1.smithi082.stdout:5/750: write d5/da/d67/f76 [669753,8546] 0 2024-02-15T22:41:21.323 INFO:tasks.workunit.client.1.smithi082.stdout:5/751: mknod d5/da/cfe 0 2024-02-15T22:41:21.323 INFO:tasks.workunit.client.1.smithi082.stdout:5/752: readlink d5/da/dc/dad/dcf/d59/ldd 0 2024-02-15T22:41:21.333 INFO:tasks.workunit.client.1.smithi082.stdout:5/753: unlink d5/da/d56/f8d 0 2024-02-15T22:41:21.339 INFO:tasks.workunit.client.1.smithi082.stdout:0/695: rename d3/d19/d5f to d3/d19/d20/d7c/dd5/deb 0 2024-02-15T22:41:21.339 INFO:tasks.workunit.client.1.smithi082.stdout:0/696: write d3/d19/d20/d7c/dd5/deb/d92/fd9 [499191,62083] 0 2024-02-15T22:41:21.342 INFO:tasks.workunit.client.1.smithi082.stdout:0/697: symlink d3/d19/d20/d7c/dd5/lec 0 2024-02-15T22:41:21.343 INFO:tasks.workunit.client.1.smithi082.stdout:5/754: dread d5/da/d14/d53/f85 [0,4194304] 0 2024-02-15T22:41:21.346 INFO:tasks.workunit.client.1.smithi082.stdout:0/698: rename d3/d19/f29 to d3/d19/d20/d7c/dd5/deb/da5/d99/db3/de9/fed 0 2024-02-15T22:41:21.346 INFO:tasks.workunit.client.1.smithi082.stdout:0/699: write d3/f11 [1186473,121634] 0 2024-02-15T22:41:21.349 INFO:tasks.workunit.client.1.smithi082.stdout:0/700: creat d3/d19/d20/d7c/dcf/fee x:0 0 0 2024-02-15T22:41:21.373 INFO:tasks.workunit.client.1.smithi082.stdout:5/755: dwrite d5/da/d56/d6e/fbc [0,4194304] 0 2024-02-15T22:41:21.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:20 smithi082 ceph-mon[37153]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 132 MiB/s rd, 168 MiB/s wr, 353 op/s 2024-02-15T22:41:21.375 INFO:tasks.workunit.client.1.smithi082.stdout:0/701: dwrite d3/d19/d20/d7c/dd5/deb/f96 [0,4194304] 0 2024-02-15T22:41:21.379 INFO:tasks.workunit.client.1.smithi082.stdout:0/702: link d3/d19/d25/d45/f39 d3/d19/d20/d7c/dd5/deb/da5/d9c/fef 0 2024-02-15T22:41:21.380 INFO:tasks.workunit.client.1.smithi082.stdout:5/756: dread d5/da/d67/f76 [0,4194304] 0 2024-02-15T22:41:21.380 INFO:tasks.workunit.client.1.smithi082.stdout:0/703: creat d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/ff0 x:0 0 0 2024-02-15T22:41:21.380 INFO:tasks.workunit.client.1.smithi082.stdout:0/704: fsync d3/d19/d20/d7c/dd5/deb/fad 0 2024-02-15T22:41:21.381 INFO:tasks.workunit.client.1.smithi082.stdout:5/757: symlink d5/da/d56/d98/ddb/lff 0 2024-02-15T22:41:21.384 INFO:tasks.workunit.client.1.smithi082.stdout:0/705: rename d3/d19/d20/d7c/dd5/deb/da0/dbc/fb8 to d3/d19/d20/d7c/dd5/deb/ff1 0 2024-02-15T22:41:21.384 INFO:tasks.workunit.client.1.smithi082.stdout:0/706: fsync d3/d19/d20/d7c/dd5/deb/da0/dbc/f98 0 2024-02-15T22:41:21.384 INFO:tasks.workunit.client.1.smithi082.stdout:5/758: mknod d5/da/dc/dad/dcf/c100 0 2024-02-15T22:41:21.384 INFO:tasks.workunit.client.1.smithi082.stdout:5/759: chown d5/lc0 29 1 2024-02-15T22:41:21.390 INFO:tasks.workunit.client.1.smithi082.stdout:5/760: rename d5/da/d56/d6e/cd4 to d5/da/d56/d98/c101 0 2024-02-15T22:41:21.392 INFO:tasks.workunit.client.1.smithi082.stdout:0/707: mkdir d3/d19/d20/d7c/dd5/deb/da0/dbc/df2 0 2024-02-15T22:41:21.419 INFO:tasks.workunit.client.1.smithi082.stdout:5/761: dwrite d5/da/d56/f5b [0,4194304] 0 2024-02-15T22:41:21.419 INFO:tasks.workunit.client.1.smithi082.stdout:5/762: fsync d5/da/f3c 0 2024-02-15T22:41:21.421 INFO:tasks.workunit.client.1.smithi082.stdout:0/708: dwrite d3/d19/d20/d7c/dd5/deb/da5/d99/db3/de9/fed [0,4194304] 0 2024-02-15T22:41:21.422 INFO:tasks.workunit.client.1.smithi082.stdout:0/709: symlink d3/lf3 0 2024-02-15T22:41:21.434 INFO:tasks.workunit.client.1.smithi082.stdout:5/763: dwrite d5/da/d67/da0/fc5 [0,4194304] 0 2024-02-15T22:41:21.436 INFO:tasks.workunit.client.1.smithi082.stdout:0/710: mkdir d3/d19/d93/dbe/df4 0 2024-02-15T22:41:21.437 INFO:tasks.workunit.client.1.smithi082.stdout:5/764: mkdir d5/d102 0 2024-02-15T22:41:21.439 INFO:tasks.workunit.client.1.smithi082.stdout:0/711: symlink d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/lf5 0 2024-02-15T22:41:21.439 INFO:tasks.workunit.client.1.smithi082.stdout:0/712: creat d3/d19/d93/dbe/ff6 x:0 0 0 2024-02-15T22:41:21.439 INFO:tasks.workunit.client.1.smithi082.stdout:0/713: write d3/d19/d25/d80/dd3/fd8 [632102,57631] 0 2024-02-15T22:41:21.442 INFO:tasks.workunit.client.1.smithi082.stdout:5/765: unlink d5/da/dc/dad/dcf/c28 0 2024-02-15T22:41:21.445 INFO:tasks.workunit.client.1.smithi082.stdout:0/714: rename d3/d19/d20/d7c/dd5/deb/d92/fd9 to d3/d19/d25/de7/ff7 0 2024-02-15T22:41:21.449 INFO:tasks.workunit.client.1.smithi082.stdout:5/766: rename d5/da/d67/da0/dde to d5/d103 0 2024-02-15T22:41:21.449 INFO:tasks.workunit.client.1.smithi082.stdout:5/767: fsync d5/fe7 0 2024-02-15T22:41:21.449 INFO:tasks.workunit.client.1.smithi082.stdout:5/768: truncate d5/da/d67/f90 692674 0 2024-02-15T22:41:21.449 INFO:tasks.workunit.client.1.smithi082.stdout:5/769: fsync d5/da/d14/f94 0 2024-02-15T22:41:21.450 INFO:tasks.workunit.client.1.smithi082.stdout:5/770: stat d5/da/de3/de9/fee 0 2024-02-15T22:41:21.450 INFO:tasks.workunit.client.1.smithi082.stdout:5/771: fsync d5/da/d14/d53/f70 0 2024-02-15T22:41:21.450 INFO:tasks.workunit.client.1.smithi082.stdout:0/715: creat d3/d19/d25/d80/ff8 x:0 0 0 2024-02-15T22:41:21.451 INFO:tasks.workunit.client.1.smithi082.stdout:0/716: unlink d3/d6b/cae 0 2024-02-15T22:41:21.454 INFO:tasks.workunit.client.1.smithi082.stdout:0/717: mknod d3/d19/d93/dbe/cf9 0 2024-02-15T22:41:21.456 INFO:tasks.workunit.client.1.smithi082.stdout:0/718: mkdir d3/d19/d20/d7c/dd5/deb/da5/d99/db3/dfa 0 2024-02-15T22:41:21.458 INFO:tasks.workunit.client.1.smithi082.stdout:0/719: creat d3/d19/d20/d26/ffb x:0 0 0 2024-02-15T22:41:21.462 INFO:tasks.workunit.client.1.smithi082.stdout:5/772: dwrite d5/da/dc/dad/dcf/f2d [0,4194304] 0 2024-02-15T22:41:21.489 INFO:tasks.workunit.client.1.smithi082.stdout:5/773: dwrite d5/da/dc/dad/fb8 [4194304,4194304] 0 2024-02-15T22:41:21.489 INFO:tasks.workunit.client.1.smithi082.stdout:5/774: truncate d5/da/d67/fc9 909761 0 2024-02-15T22:41:21.490 INFO:tasks.workunit.client.1.smithi082.stdout:0/720: dwrite d3/d19/d20/f5b [0,4194304] 0 2024-02-15T22:41:21.493 INFO:tasks.workunit.client.1.smithi082.stdout:0/721: truncate d3/d19/d1c/f65 114744 0 2024-02-15T22:41:21.500 INFO:tasks.workunit.client.1.smithi082.stdout:0/722: unlink d3/f57 0 2024-02-15T22:41:21.502 INFO:tasks.workunit.client.1.smithi082.stdout:0/723: creat d3/d19/d25/d45/ffc x:0 0 0 2024-02-15T22:41:21.503 INFO:tasks.workunit.client.1.smithi082.stdout:5/775: dwrite d5/da/d67/da0/d92/fda [0,4194304] 0 2024-02-15T22:41:21.503 INFO:tasks.workunit.client.1.smithi082.stdout:5/776: write d5/da/dc/d43/fce [388178,18774] 0 2024-02-15T22:41:21.503 INFO:tasks.workunit.client.1.smithi082.stdout:5/777: readlink d5/da/d56/d6e/l91 0 2024-02-15T22:41:21.503 INFO:tasks.workunit.client.1.smithi082.stdout:5/778: write d5/da/dc/d43/ff4 [658201,25559] 0 2024-02-15T22:41:21.503 INFO:tasks.workunit.client.1.smithi082.stdout:0/724: symlink d3/d19/d25/d80/dd3/lfd 0 2024-02-15T22:41:21.510 INFO:tasks.workunit.client.1.smithi082.stdout:5/779: dread d5/da/ffb [0,4194304] 0 2024-02-15T22:41:21.513 INFO:tasks.workunit.client.1.smithi082.stdout:5/780: creat d5/da/d67/f104 x:0 0 0 2024-02-15T22:41:21.513 INFO:tasks.workunit.client.1.smithi082.stdout:0/725: dread d3/d6b/dac/fda [0,4194304] 0 2024-02-15T22:41:21.519 INFO:tasks.workunit.client.1.smithi082.stdout:5/781: link d5/da/f1c d5/da/d56/d98/f105 0 2024-02-15T22:41:21.538 INFO:tasks.workunit.client.1.smithi082.stdout:0/726: dwrite d3/d19/d1c/f50 [0,4194304] 0 2024-02-15T22:41:21.539 INFO:tasks.workunit.client.1.smithi082.stdout:5/782: dwrite d5/da/d14/f61 [4194304,4194304] 0 2024-02-15T22:41:21.547 INFO:tasks.workunit.client.1.smithi082.stdout:0/727: mkdir d3/d19/d20/d7c/dd5/deb/d92/dfe 0 2024-02-15T22:41:21.556 INFO:tasks.workunit.client.1.smithi082.stdout:8/696: sync 2024-02-15T22:41:21.556 INFO:tasks.workunit.client.1.smithi082.stdout:3/722: sync 2024-02-15T22:41:21.556 INFO:tasks.workunit.client.1.smithi082.stdout:6/764: sync 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:7/774: sync 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:1/663: sync 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:3/723: fsync d0/d16/d62/d79/fd7 0 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:4/896: sync 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:5/783: symlink d5/dd8/l106 0 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:5/784: write d5/da/f24 [510746,102207] 0 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:2/699: sync 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:9/752: sync 2024-02-15T22:41:21.557 INFO:tasks.workunit.client.1.smithi082.stdout:2/700: chown d6/dc/d12/d46/d4b/d63/f94 3451419 1 2024-02-15T22:41:21.558 INFO:tasks.workunit.client.1.smithi082.stdout:0/728: truncate d3/d19/d20/d7c/dd5/deb/f63 2715211 0 2024-02-15T22:41:21.563 INFO:tasks.workunit.client.1.smithi082.stdout:6/765: link d2/d18/d39/f88 d2/d18/d8a/d47/d69/dc1/ff7 0 2024-02-15T22:41:21.564 INFO:tasks.workunit.client.1.smithi082.stdout:8/697: write d1/d7/d78/fd0 [2529869,34043] 0 2024-02-15T22:41:21.566 INFO:tasks.workunit.client.1.smithi082.stdout:1/664: write d1/da/ff [8256057,71181] 0 2024-02-15T22:41:21.566 INFO:tasks.workunit.client.1.smithi082.stdout:7/775: creat d12/d3b/d5a/f102 x:0 0 0 2024-02-15T22:41:21.568 INFO:tasks.workunit.client.1.smithi082.stdout:5/785: creat d5/da/dc/dd5/f107 x:0 0 0 2024-02-15T22:41:21.568 INFO:tasks.workunit.client.1.smithi082.stdout:9/753: getdents d8/d12/d33/da4/dac 0 2024-02-15T22:41:21.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/766: mknod d2/d18/d8a/d84/cf8 0 2024-02-15T22:41:21.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/767: readlink d2/d18/d8a/d47/d72/l74 0 2024-02-15T22:41:21.575 INFO:tasks.workunit.client.1.smithi082.stdout:6/768: chown d2/d18/d23/ddf 109 1 2024-02-15T22:41:21.576 INFO:tasks.workunit.client.1.smithi082.stdout:8/698: mkdir d1/d7/d9/d24/d43/df1 0 2024-02-15T22:41:21.577 INFO:tasks.workunit.client.1.smithi082.stdout:7/776: truncate d12/d17/d42/d67/f7a 1196534 0 2024-02-15T22:41:21.579 INFO:tasks.workunit.client.1.smithi082.stdout:4/897: dwrite d0/d47/d4d/f88 [0,4194304] 0 2024-02-15T22:41:21.580 INFO:tasks.workunit.client.1.smithi082.stdout:1/665: link d1/da/d11/d3f/fd0 d1/da/d11/d93/db6/dc5/fdd 0 2024-02-15T22:41:21.580 INFO:tasks.workunit.client.1.smithi082.stdout:1/666: chown d1/da/d11/cba 372 1 2024-02-15T22:41:21.581 INFO:tasks.workunit.client.1.smithi082.stdout:3/724: rename d0/d16/d62/d14/d21/d41 to d0/d16/d62/d14/d71/df4 0 2024-02-15T22:41:21.585 INFO:tasks.workunit.client.1.smithi082.stdout:3/725: read d0/dc/d3f/f78 [115543,81585] 0 2024-02-15T22:41:21.585 INFO:tasks.workunit.client.1.smithi082.stdout:3/726: readlink d0/d16/d3e/d56/l61 0 2024-02-15T22:41:21.585 INFO:tasks.workunit.client.1.smithi082.stdout:3/727: fdatasync d0/d16/d62/d14/d71/df4/f67 0 2024-02-15T22:41:21.585 INFO:tasks.workunit.client.1.smithi082.stdout:6/769: creat d2/d18/d8a/d47/d69/d75/ff9 x:0 0 0 2024-02-15T22:41:21.586 INFO:tasks.workunit.client.1.smithi082.stdout:6/770: chown d2/f1e 2323744 1 2024-02-15T22:41:21.586 INFO:tasks.workunit.client.1.smithi082.stdout:8/699: creat d1/d7/ff2 x:0 0 0 2024-02-15T22:41:21.586 INFO:tasks.workunit.client.1.smithi082.stdout:8/700: chown d1/d7/d9/f17 0 1 2024-02-15T22:41:21.588 INFO:tasks.workunit.client.1.smithi082.stdout:2/701: dwrite d6/dc/f10 [0,4194304] 0 2024-02-15T22:41:21.588 INFO:tasks.workunit.client.1.smithi082.stdout:2/702: fsync d6/dc/dd/d21/d9f/fbc 0 2024-02-15T22:41:21.588 INFO:tasks.workunit.client.1.smithi082.stdout:5/786: dwrite d5/da/f3c [0,4194304] 0 2024-02-15T22:41:21.588 INFO:tasks.workunit.client.1.smithi082.stdout:5/787: stat d5/da/dc/dad/dcf/d59/d84/d89/le2 0 2024-02-15T22:41:21.588 INFO:tasks.workunit.client.1.smithi082.stdout:5/788: dread - d5/da/dc/f4f zero size 2024-02-15T22:41:21.589 INFO:tasks.workunit.client.1.smithi082.stdout:7/777: unlink d12/d27/d74/c7b 0 2024-02-15T22:41:21.592 INFO:tasks.workunit.client.1.smithi082.stdout:4/898: mkdir d0/d8/d1b/d14b 0 2024-02-15T22:41:21.594 INFO:tasks.workunit.client.1.smithi082.stdout:0/729: rename d3/d19/d25/d80/dd3/lfd to d3/d19/d20/d7c/dd5/deb/da5/d99/db3/lff 0 2024-02-15T22:41:21.599 INFO:tasks.workunit.client.1.smithi082.stdout:6/771: link d2/d18/d8a/d47/d69/dc1/cd3 d2/d30/da6/cfa 0 2024-02-15T22:41:21.599 INFO:tasks.workunit.client.1.smithi082.stdout:1/667: dwrite d1/da/d14/d18/fbe [0,4194304] 0 2024-02-15T22:41:21.601 INFO:tasks.workunit.client.1.smithi082.stdout:8/701: dread d1/d7/d9/f81 [0,4194304] 0 2024-02-15T22:41:21.603 INFO:tasks.workunit.client.1.smithi082.stdout:2/703: write d6/dc/f38 [466080,10532] 0 2024-02-15T22:41:21.604 INFO:tasks.workunit.client.1.smithi082.stdout:5/789: truncate d5/da/d67/da0/fc5 318477 0 2024-02-15T22:41:21.608 INFO:tasks.workunit.client.1.smithi082.stdout:7/778: creat d12/d3b/d41/f103 x:0 0 0 2024-02-15T22:41:21.608 INFO:tasks.workunit.client.1.smithi082.stdout:3/728: dread d0/d16/d62/d14/d21/f3d [0,4194304] 0 2024-02-15T22:41:21.609 INFO:tasks.workunit.client.1.smithi082.stdout:9/754: rmdir d8/d12/d33 39 2024-02-15T22:41:21.612 INFO:tasks.workunit.client.1.smithi082.stdout:4/899: mkdir d0/d8/d1b/dd/d37/dfa/d14c 0 2024-02-15T22:41:21.616 INFO:tasks.workunit.client.1.smithi082.stdout:0/730: creat d3/d19/d20/d7c/dd5/deb/da5/d9c/f100 x:0 0 0 2024-02-15T22:41:21.618 INFO:tasks.workunit.client.1.smithi082.stdout:6/772: symlink d2/d18/d8a/d47/d69/d75/lfb 0 2024-02-15T22:41:21.618 INFO:tasks.workunit.client.1.smithi082.stdout:6/773: write d2/d18/d8a/f6f [515660,85763] 0 2024-02-15T22:41:21.622 INFO:tasks.workunit.client.1.smithi082.stdout:1/668: creat d1/da/d14/d18/d1f/d76/da7/fde x:0 0 0 2024-02-15T22:41:21.622 INFO:tasks.workunit.client.1.smithi082.stdout:1/669: stat d1/da/l45 0 2024-02-15T22:41:21.624 INFO:tasks.workunit.client.1.smithi082.stdout:2/704: dwrite d6/dc/d12/d46/fa0 [0,4194304] 0 2024-02-15T22:41:21.624 INFO:tasks.workunit.client.1.smithi082.stdout:2/705: chown d6/dc/d12/ccf 32 1 2024-02-15T22:41:21.625 INFO:tasks.workunit.client.1.smithi082.stdout:7/779: symlink d12/d17/d3d/l104 0 2024-02-15T22:41:21.626 INFO:tasks.workunit.client.1.smithi082.stdout:3/729: symlink d0/d16/d62/d14/d21/d69/de6/lf5 0 2024-02-15T22:41:21.626 INFO:tasks.workunit.client.1.smithi082.stdout:5/790: dwrite d5/da/dc/dad/dcf/d59/f5c [0,4194304] 0 2024-02-15T22:41:21.639 INFO:tasks.workunit.client.1.smithi082.stdout:4/900: symlink d0/d16/d4a/l14d 0 2024-02-15T22:41:21.641 INFO:tasks.workunit.client.1.smithi082.stdout:5/791: dread d5/da/d14/f61 [0,4194304] 0 2024-02-15T22:41:21.642 INFO:tasks.workunit.client.1.smithi082.stdout:0/731: rename d3/d19/d20/d7c/dd5/deb/d92/lc4 to d3/d19/d93/l101 0 2024-02-15T22:41:21.645 INFO:tasks.workunit.client.1.smithi082.stdout:6/774: unlink d2/d18/d23/d67/fa3 0 2024-02-15T22:41:21.648 INFO:tasks.workunit.client.1.smithi082.stdout:2/706: dwrite d6/dc/d12/fb4 [0,4194304] 0 2024-02-15T22:41:21.649 INFO:tasks.workunit.client.1.smithi082.stdout:1/670: link d1/da/d14/d18/d1f/d2f/fb7 d1/da/d14/fdf 0 2024-02-15T22:41:21.649 INFO:tasks.workunit.client.1.smithi082.stdout:1/671: stat d1/da/d14/d7f 0 2024-02-15T22:41:21.649 INFO:tasks.workunit.client.1.smithi082.stdout:1/672: fsync d1/da/d14/f2d 0 2024-02-15T22:41:21.655 INFO:tasks.workunit.client.1.smithi082.stdout:2/707: dread d6/dc/d58/d49/fa2 [0,4194304] 0 2024-02-15T22:41:21.655 INFO:tasks.workunit.client.1.smithi082.stdout:2/708: chown d6/dc/dd/d21/d9f 0 1 2024-02-15T22:41:21.655 INFO:tasks.workunit.client.1.smithi082.stdout:2/709: write d6/dc/dd/d24/f54 [1391422,18558] 0 2024-02-15T22:41:21.658 INFO:tasks.workunit.client.1.smithi082.stdout:3/730: rename d0/d16/d62/f7e to d0/d16/d62/d14/d21/d69/d91/ff6 0 2024-02-15T22:41:21.658 INFO:tasks.workunit.client.1.smithi082.stdout:0/732: dwrite d3/d19/d1c/f65 [0,4194304] 0 2024-02-15T22:41:21.658 INFO:tasks.workunit.client.1.smithi082.stdout:0/733: truncate d3/d6b/d7f/f8d 750962 0 2024-02-15T22:41:21.658 INFO:tasks.workunit.client.1.smithi082.stdout:2/710: dread d6/dc/d12/d46/d4b/f8b [0,4194304] 0 2024-02-15T22:41:21.658 INFO:tasks.workunit.client.1.smithi082.stdout:0/734: readlink d3/d19/d25/l54 0 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:1/673: dread d1/f3d [0,4194304] 0 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:1/674: write d1/da/d14/d18/f2b [4769883,44436] 0 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:1/675: readlink d1/da/l45 0 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:1/676: dread - d1/da/d14/d18/d1f/d2f/fa5 zero size 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:1/677: stat d1/da/d14/d18/d1f/f4f 0 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:1/678: dread - d1/da/d14/fdf zero size 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:1/679: fdatasync d1/da/d14/d18/d1f/d7a/f8a 0 2024-02-15T22:41:21.661 INFO:tasks.workunit.client.1.smithi082.stdout:6/775: mknod d2/d18/d8a/d47/d72/d80/cfc 0 2024-02-15T22:41:21.667 INFO:tasks.workunit.client.1.smithi082.stdout:4/901: rename d0/c15 to d0/d16/d4a/d6a/dd9/de2/c14e 0 2024-02-15T22:41:21.671 INFO:tasks.workunit.client.1.smithi082.stdout:3/731: creat d0/d16/d3e/d56/ff7 x:0 0 0 2024-02-15T22:41:21.674 INFO:tasks.workunit.client.1.smithi082.stdout:0/735: link d3/d19/d20/d7c/dd5/deb/da0/dbc/f98 d3/d19/d20/d7c/dd5/f102 0 2024-02-15T22:41:21.676 INFO:tasks.workunit.client.1.smithi082.stdout:2/711: symlink d6/dc/d58/d49/db6/ld4 0 2024-02-15T22:41:21.677 INFO:tasks.workunit.client.1.smithi082.stdout:1/680: symlink d1/da/d14/db4/le0 0 2024-02-15T22:41:21.678 INFO:tasks.workunit.client.1.smithi082.stdout:9/755: dwrite d8/f44 [0,4194304] 0 2024-02-15T22:41:21.678 INFO:tasks.workunit.client.1.smithi082.stdout:9/756: truncate d8/d24/d2e/fdc 965889 0 2024-02-15T22:41:21.678 INFO:tasks.workunit.client.1.smithi082.stdout:6/776: dwrite d2/d18/fd2 [0,4194304] 0 2024-02-15T22:41:21.680 INFO:tasks.workunit.client.1.smithi082.stdout:0/736: unlink d3/d6b/d7f/f8d 0 2024-02-15T22:41:21.682 INFO:tasks.workunit.client.1.smithi082.stdout:1/681: dread d1/f47 [0,4194304] 0 2024-02-15T22:41:21.682 INFO:tasks.workunit.client.1.smithi082.stdout:2/712: truncate d6/dc/dd/f1a 402770 0 2024-02-15T22:41:21.686 INFO:tasks.workunit.client.1.smithi082.stdout:9/757: mkdir d8/d24/d87/de0/d77/dc6/de6 0 2024-02-15T22:41:21.688 INFO:tasks.workunit.client.1.smithi082.stdout:4/902: dwrite d0/d47/da6/d120/f124 [0,4194304] 0 2024-02-15T22:41:21.688 INFO:tasks.workunit.client.1.smithi082.stdout:4/903: write d0/d8/d32/d39/da4/fae [1161552,30005] 0 2024-02-15T22:41:21.689 INFO:tasks.workunit.client.1.smithi082.stdout:6/777: creat d2/d18/d8a/d47/d72/ffd x:0 0 0 2024-02-15T22:41:21.694 INFO:tasks.workunit.client.1.smithi082.stdout:1/682: creat d1/da/d14/d18/d1f/d76/fe1 x:0 0 0 2024-02-15T22:41:21.694 INFO:tasks.workunit.client.1.smithi082.stdout:3/732: dwrite d0/f6f [0,4194304] 0 2024-02-15T22:41:21.698 INFO:tasks.workunit.client.1.smithi082.stdout:2/713: creat d6/dc/fd5 x:0 0 0 2024-02-15T22:41:21.699 INFO:tasks.workunit.client.1.smithi082.stdout:2/714: chown d6/dc/fc7 441000 1 2024-02-15T22:41:21.702 INFO:tasks.workunit.client.1.smithi082.stdout:9/758: symlink d8/d24/d87/de0/d7c/da1/le7 0 2024-02-15T22:41:21.702 INFO:tasks.workunit.client.1.smithi082.stdout:9/759: getdents d8/d24/d87/de0/d77/dc6/de6 0 2024-02-15T22:41:21.703 INFO:tasks.workunit.client.1.smithi082.stdout:2/715: dread d6/dc/f89 [0,4194304] 0 2024-02-15T22:41:21.703 INFO:tasks.workunit.client.1.smithi082.stdout:2/716: chown d6/dc/d12/d46/d4b/d63/c64 51193052 1 2024-02-15T22:41:21.716 INFO:tasks.workunit.client.1.smithi082.stdout:4/904: rmdir d0/d8/d1b/dd/d37/dfa/d14c 0 2024-02-15T22:41:21.716 INFO:tasks.workunit.client.1.smithi082.stdout:4/905: dread - d0/dc0/dcd/de3/f134 zero size 2024-02-15T22:41:21.717 INFO:tasks.workunit.client.1.smithi082.stdout:9/760: write d8/d12/d33/fbb [150415,63179] 0 2024-02-15T22:41:21.718 INFO:tasks.workunit.client.1.smithi082.stdout:1/683: dwrite d1/da/d14/d18/d1f/d7a/fa2 [0,4194304] 0 2024-02-15T22:41:21.718 INFO:tasks.workunit.client.1.smithi082.stdout:2/717: dwrite d6/d18/f75 [0,4194304] 0 2024-02-15T22:41:21.718 INFO:tasks.workunit.client.1.smithi082.stdout:6/778: symlink d2/d18/d8a/d47/d72/lfe 0 2024-02-15T22:41:21.718 INFO:tasks.workunit.client.1.smithi082.stdout:2/718: readlink d6/dc/dd/d21/l45 0 2024-02-15T22:41:21.718 INFO:tasks.workunit.client.1.smithi082.stdout:2/719: fsync d6/dc/d12/d46/d4b/d63/f94 0 2024-02-15T22:41:21.719 INFO:tasks.workunit.client.1.smithi082.stdout:1/684: write d1/da/fd6 [210664,26927] 0 2024-02-15T22:41:21.721 INFO:tasks.workunit.client.1.smithi082.stdout:1/685: dread d1/da/d14/d18/f3a [4194304,4194304] 0 2024-02-15T22:41:21.721 INFO:tasks.workunit.client.1.smithi082.stdout:1/686: write d1/da/d11/f9e [483248,94511] 0 2024-02-15T22:41:21.725 INFO:tasks.workunit.client.1.smithi082.stdout:3/733: mkdir d0/d16/df0/df8 0 2024-02-15T22:41:21.729 INFO:tasks.workunit.client.1.smithi082.stdout:1/687: dread d1/da/d14/f28 [0,4194304] 0 2024-02-15T22:41:21.729 INFO:tasks.workunit.client.1.smithi082.stdout:1/688: fsync d1/da/d14/d18/d6d/f6f 0 2024-02-15T22:41:21.734 INFO:tasks.workunit.client.1.smithi082.stdout:4/906: rename d0/d47/dd8/c113 to d0/d16/d4a/d6a/dd9/de2/c14f 0 2024-02-15T22:41:21.734 INFO:tasks.workunit.client.1.smithi082.stdout:4/907: readlink d0/d47/d4d/l129 0 2024-02-15T22:41:21.743 INFO:tasks.workunit.client.1.smithi082.stdout:3/734: dwrite d0/d16/d62/d14/d21/d69/d91/f96 [0,4194304] 0 2024-02-15T22:41:21.758 INFO:tasks.workunit.client.1.smithi082.stdout:1/689: mkdir d1/d57/de2 0 2024-02-15T22:41:21.761 INFO:tasks.workunit.client.1.smithi082.stdout:9/761: rename d8/d12/d67/fd1 to d8/d24/fe8 0 2024-02-15T22:41:21.765 INFO:tasks.workunit.client.1.smithi082.stdout:3/735: mknod d0/d16/d62/d14/d21/d69/de6/cf9 0 2024-02-15T22:41:21.766 INFO:tasks.workunit.client.1.smithi082.stdout:3/736: dread d0/d16/d62/d14/f2a [0,4194304] 0 2024-02-15T22:41:21.770 INFO:tasks.workunit.client.1.smithi082.stdout:1/690: creat d1/da/d14/d18/d1f/d7a/dd1/fe3 x:0 0 0 2024-02-15T22:41:21.770 INFO:tasks.workunit.client.1.smithi082.stdout:4/908: dread d0/d46/f8a [0,4194304] 0 2024-02-15T22:41:21.771 INFO:tasks.workunit.client.1.smithi082.stdout:9/762: read d8/db5/fcf [804478,79300] 0 2024-02-15T22:41:21.771 INFO:tasks.workunit.client.1.smithi082.stdout:6/779: rename d2/d18/d23/ddf/ff6 to d2/d18/d8a/da7/fff 0 2024-02-15T22:41:21.776 INFO:tasks.workunit.client.1.smithi082.stdout:8/702: sync 2024-02-15T22:41:21.777 INFO:tasks.workunit.client.1.smithi082.stdout:7/780: sync 2024-02-15T22:41:21.777 INFO:tasks.workunit.client.1.smithi082.stdout:5/792: sync 2024-02-15T22:41:21.777 INFO:tasks.workunit.client.1.smithi082.stdout:0/737: sync 2024-02-15T22:41:21.777 INFO:tasks.workunit.client.1.smithi082.stdout:5/793: write d5/da/dc/ff [4989283,129210] 0 2024-02-15T22:41:21.779 INFO:tasks.workunit.client.1.smithi082.stdout:9/763: unlink d8/d12/lc2 0 2024-02-15T22:41:21.779 INFO:tasks.workunit.client.1.smithi082.stdout:4/909: write d0/fa0 [5316956,40287] 0 2024-02-15T22:41:21.782 INFO:tasks.workunit.client.1.smithi082.stdout:2/720: rename d6/dc/dd/d24/d71/f9c to d6/dc/dd/d1d/fd6 0 2024-02-15T22:41:21.782 INFO:tasks.workunit.client.1.smithi082.stdout:1/691: rmdir d1/da/d14/d18/d1f/d2f 39 2024-02-15T22:41:21.783 INFO:tasks.workunit.client.1.smithi082.stdout:1/692: creat d1/da/d14/d18/d1f/d76/da7/fe4 x:0 0 0 2024-02-15T22:41:21.783 INFO:tasks.workunit.client.1.smithi082.stdout:3/737: dread d0/dc/d3f/fbb [0,4194304] 0 2024-02-15T22:41:21.785 INFO:tasks.workunit.client.1.smithi082.stdout:7/781: write d12/d17/d42/d67/d81/d91/dbc/fd3 [3343748,39303] 0 2024-02-15T22:41:21.786 INFO:tasks.workunit.client.1.smithi082.stdout:2/721: dread d6/dc/d12/d46/d4b/d63/f9e [0,4194304] 0 2024-02-15T22:41:21.789 INFO:tasks.workunit.client.1.smithi082.stdout:9/764: mknod d8/d12/dc5/ce9 0 2024-02-15T22:41:21.791 INFO:tasks.workunit.client.1.smithi082.stdout:6/780: rmdir d2/d18/d8a/d47/d69/dc1/ded 39 2024-02-15T22:41:21.792 INFO:tasks.workunit.client.1.smithi082.stdout:8/703: rmdir d1/d7/d9/d42 39 2024-02-15T22:41:21.792 INFO:tasks.workunit.client.1.smithi082.stdout:8/704: fdatasync d1/d7/d78/fd0 0 2024-02-15T22:41:21.796 INFO:tasks.workunit.client.1.smithi082.stdout:4/910: unlink d0/d47/la5 0 2024-02-15T22:41:21.796 INFO:tasks.workunit.client.1.smithi082.stdout:4/911: readlink d0/d8/d1b/dd/d37/lf1 0 2024-02-15T22:41:21.798 INFO:tasks.workunit.client.1.smithi082.stdout:1/693: getdents d1/da/d14/d18/d1f/d2f 0 2024-02-15T22:41:21.798 INFO:tasks.workunit.client.1.smithi082.stdout:4/912: dread d0/d47/dd8/fe6 [0,4194304] 0 2024-02-15T22:41:21.798 INFO:tasks.workunit.client.1.smithi082.stdout:4/913: truncate d0/d47/d4d/fd1 1000797 0 2024-02-15T22:41:21.799 INFO:tasks.workunit.client.1.smithi082.stdout:6/781: read d2/d18/d39/f7d [1069863,2162] 0 2024-02-15T22:41:21.802 INFO:tasks.workunit.client.1.smithi082.stdout:7/782: truncate d12/d3b/d5a/fb7 752481 0 2024-02-15T22:41:21.804 INFO:tasks.workunit.client.1.smithi082.stdout:9/765: symlink d8/d24/d87/de0/d7c/lea 0 2024-02-15T22:41:21.808 INFO:tasks.workunit.client.1.smithi082.stdout:8/705: creat d1/d7/d9/d42/ff3 x:0 0 0 2024-02-15T22:41:21.808 INFO:tasks.workunit.client.1.smithi082.stdout:1/694: dread d1/da/d14/d18/d6d/f86 [0,4194304] 0 2024-02-15T22:41:21.808 INFO:tasks.workunit.client.1.smithi082.stdout:1/695: truncate d1/da/d11/d3f/f53 4521406 0 2024-02-15T22:41:21.810 INFO:tasks.workunit.client.1.smithi082.stdout:0/738: rename d3/d19/d1c/d76/cb2 to d3/d19/d20/d7c/dd5/deb/da0/dbc/c103 0 2024-02-15T22:41:21.812 INFO:tasks.workunit.client.1.smithi082.stdout:6/782: mknod d2/d45/dc5/c100 0 2024-02-15T22:41:21.814 INFO:tasks.workunit.client.1.smithi082.stdout:0/739: dread d3/d19/d20/d26/f31 [0,4194304] 0 2024-02-15T22:41:21.814 INFO:tasks.workunit.client.1.smithi082.stdout:0/740: dread - d3/f49 zero size 2024-02-15T22:41:21.815 INFO:tasks.workunit.client.1.smithi082.stdout:7/783: creat d12/d37/d85/f105 x:0 0 0 2024-02-15T22:41:21.815 INFO:tasks.workunit.client.1.smithi082.stdout:7/784: fdatasync d12/d17/d42/d67/d81/d91/dbc/fd3 0 2024-02-15T22:41:21.816 INFO:tasks.workunit.client.1.smithi082.stdout:7/785: stat d12/d17/d4d/d7d/lf6 0 2024-02-15T22:41:21.816 INFO:tasks.workunit.client.1.smithi082.stdout:7/786: read d12/d27/d74/f82 [65505,96712] 0 2024-02-15T22:41:21.816 INFO:tasks.workunit.client.1.smithi082.stdout:4/914: dwrite d0/d16/d4a/d6a/dd9/f107 [0,4194304] 0 2024-02-15T22:41:21.816 INFO:tasks.workunit.client.1.smithi082.stdout:4/915: write d0/d47/dd8/fe6 [1770361,20611] 0 2024-02-15T22:41:21.817 INFO:tasks.workunit.client.1.smithi082.stdout:5/794: rename d5/da/dc/d43/fce to d5/da/f108 0 2024-02-15T22:41:21.820 INFO:tasks.workunit.client.1.smithi082.stdout:6/783: mknod d2/d30/c101 0 2024-02-15T22:41:21.823 INFO:tasks.workunit.client.1.smithi082.stdout:7/787: creat d12/d37/d85/f106 x:0 0 0 2024-02-15T22:41:21.825 INFO:tasks.workunit.client.1.smithi082.stdout:9/766: dwrite d8/d12/d30/f36 [0,4194304] 0 2024-02-15T22:41:21.831 INFO:tasks.workunit.client.1.smithi082.stdout:3/738: rename d0/f43 to d0/d16/df0/ffa 0 2024-02-15T22:41:21.832 INFO:tasks.workunit.client.1.smithi082.stdout:2/722: rename d6/dc/d12 to d6/dc/d12/db1/dd7 22 2024-02-15T22:41:21.835 INFO:tasks.workunit.client.1.smithi082.stdout:1/696: dwrite d1/da/d14/d18/f3a [4194304,4194304] 0 2024-02-15T22:41:21.835 INFO:tasks.workunit.client.1.smithi082.stdout:5/795: creat d5/da/de3/de9/f109 x:0 0 0 2024-02-15T22:41:21.837 INFO:tasks.workunit.client.1.smithi082.stdout:6/784: getdents d2/d18/d8a/d84 0 2024-02-15T22:41:21.838 INFO:tasks.workunit.client.1.smithi082.stdout:7/788: creat d12/d17/d42/d67/f107 x:0 0 0 2024-02-15T22:41:21.843 INFO:tasks.workunit.client.1.smithi082.stdout:0/741: dwrite d3/d19/d20/d7c/dcf/fd1 [0,4194304] 0 2024-02-15T22:41:21.845 INFO:tasks.workunit.client.1.smithi082.stdout:1/697: dread d1/da/f24 [0,4194304] 0 2024-02-15T22:41:21.845 INFO:tasks.workunit.client.1.smithi082.stdout:1/698: write d1/da/d14/d18/d1f/d2f/fa5 [406827,74761] 0 2024-02-15T22:41:21.846 INFO:tasks.workunit.client.1.smithi082.stdout:1/699: chown d1/da/d14/d18/d1f/d2f/c4c 4687 1 2024-02-15T22:41:21.847 INFO:tasks.workunit.client.1.smithi082.stdout:3/739: mknod d0/d16/d3e/d56/cfb 0 2024-02-15T22:41:21.850 INFO:tasks.workunit.client.1.smithi082.stdout:2/723: dread d6/dc/dd/f1a [0,4194304] 0 2024-02-15T22:41:21.850 INFO:tasks.workunit.client.1.smithi082.stdout:2/724: chown d6/d3c 3 1 2024-02-15T22:41:21.851 INFO:tasks.workunit.client.1.smithi082.stdout:4/916: rename d0/d16/d4a/d6a/dd9/de2/f143 to d0/d46/df9/f150 0 2024-02-15T22:41:21.852 INFO:tasks.workunit.client.1.smithi082.stdout:5/796: mknod d5/da/d56/d98/c10a 0 2024-02-15T22:41:21.855 INFO:tasks.workunit.client.1.smithi082.stdout:7/789: symlink d12/d27/d6e/d6a/d9e/dbe/dcb/l108 0 2024-02-15T22:41:21.862 INFO:tasks.workunit.client.1.smithi082.stdout:0/742: dwrite d3/d19/d20/d7c/dd5/deb/da5/d99/db3/de9/fed [0,4194304] 0 2024-02-15T22:41:21.863 INFO:tasks.workunit.client.1.smithi082.stdout:3/740: mkdir d0/d16/d62/d14/d21/d69/dfc 0 2024-02-15T22:41:21.864 INFO:tasks.workunit.client.1.smithi082.stdout:1/700: unlink d1/da/d11/c7d 0 2024-02-15T22:41:21.870 INFO:tasks.workunit.client.1.smithi082.stdout:6/785: rename d2/d45/lbe to d2/d18/d23/ddf/l102 0 2024-02-15T22:41:21.875 INFO:tasks.workunit.client.1.smithi082.stdout:4/917: mknod d0/d8/d1b/dd/d37/dfa/c151 0 2024-02-15T22:41:21.879 INFO:tasks.workunit.client.1.smithi082.stdout:5/797: creat d5/dd8/f10b x:0 0 0 2024-02-15T22:41:21.879 INFO:tasks.workunit.client.1.smithi082.stdout:5/798: fsync d5/da/dc/f6d 0 2024-02-15T22:41:21.880 INFO:tasks.workunit.client.1.smithi082.stdout:7/790: mkdir d12/d27/d74/d8b/d109 0 2024-02-15T22:41:21.880 INFO:tasks.workunit.client.1.smithi082.stdout:7/791: write d12/d3b/d41/f60 [693459,63519] 0 2024-02-15T22:41:21.883 INFO:tasks.workunit.client.1.smithi082.stdout:3/741: symlink d0/d16/d62/d14/d21/d69/de6/lfd 0 2024-02-15T22:41:21.884 INFO:tasks.workunit.client.1.smithi082.stdout:3/742: dread d0/d16/d62/d14/f2a [0,4194304] 0 2024-02-15T22:41:21.885 INFO:tasks.workunit.client.1.smithi082.stdout:6/786: dread d2/d18/d8a/da7/fdd [0,4194304] 0 2024-02-15T22:41:21.885 INFO:tasks.workunit.client.1.smithi082.stdout:6/787: truncate d2/d30/d3b/f42 8429236 0 2024-02-15T22:41:21.885 INFO:tasks.workunit.client.1.smithi082.stdout:6/788: truncate d2/d18/d8a/d47/f54 1548817 0 2024-02-15T22:41:21.890 INFO:tasks.workunit.client.1.smithi082.stdout:2/725: rmdir d6/d3c/d8c 39 2024-02-15T22:41:21.892 INFO:tasks.workunit.client.1.smithi082.stdout:5/799: rename d5/da/dc/d43/f9d to d5/da/dc/dd5/de5/f10c 0 2024-02-15T22:41:21.892 INFO:tasks.workunit.client.1.smithi082.stdout:5/800: stat d5/da/dc/dad/dcf/d59/d84/fd2 0 2024-02-15T22:41:21.892 INFO:tasks.workunit.client.1.smithi082.stdout:7/792: chown d12/d17/l31 28460 1 2024-02-15T22:41:21.894 INFO:tasks.workunit.client.1.smithi082.stdout:6/789: symlink d2/d18/d8a/d65/l103 0 2024-02-15T22:41:21.894 INFO:tasks.workunit.client.1.smithi082.stdout:6/790: dread - d2/d18/d8a/d47/d72/fc7 zero size 2024-02-15T22:41:21.896 INFO:tasks.workunit.client.1.smithi082.stdout:1/701: dwrite d1/da/ff [4194304,4194304] 0 2024-02-15T22:41:21.896 INFO:tasks.workunit.client.1.smithi082.stdout:1/702: chown d1/da/d14/f28 23 1 2024-02-15T22:41:21.897 INFO:tasks.workunit.client.1.smithi082.stdout:4/918: dwrite d0/d8/d32/d39/da4/fae [0,4194304] 0 2024-02-15T22:41:21.897 INFO:tasks.workunit.client.1.smithi082.stdout:0/743: dwrite d3/d19/fc1 [0,4194304] 0 2024-02-15T22:41:21.898 INFO:tasks.workunit.client.1.smithi082.stdout:3/743: rename d0/dc/l2d to d0/d16/d62/d14/d21/d69/d6c/lfe 0 2024-02-15T22:41:21.899 INFO:tasks.workunit.client.1.smithi082.stdout:0/744: dread d3/d19/d25/d80/dd3/fd8 [0,4194304] 0 2024-02-15T22:41:21.901 INFO:tasks.workunit.client.1.smithi082.stdout:5/801: unlink d5/da/dc/d43/l62 0 2024-02-15T22:41:21.901 INFO:tasks.workunit.client.1.smithi082.stdout:5/802: chown d5/da/d67/dbf/cd1 814126416 1 2024-02-15T22:41:21.901 INFO:tasks.workunit.client.1.smithi082.stdout:5/803: fsync d5/da/dc/f10 0 2024-02-15T22:41:21.901 INFO:tasks.workunit.client.1.smithi082.stdout:5/804: fsync d5/da/d67/da0/fc6 0 2024-02-15T22:41:21.901 INFO:tasks.workunit.client.1.smithi082.stdout:5/805: truncate d5/da/dc/d43/ff4 1426160 0 2024-02-15T22:41:21.902 INFO:tasks.workunit.client.1.smithi082.stdout:2/726: rmdir d6/dc/d12/d23/da7 39 2024-02-15T22:41:21.902 INFO:tasks.workunit.client.1.smithi082.stdout:2/727: truncate d6/dc/d58/f17 1446219 0 2024-02-15T22:41:21.904 INFO:tasks.workunit.client.1.smithi082.stdout:6/791: creat d2/d18/d23/d67/f104 x:0 0 0 2024-02-15T22:41:21.907 INFO:tasks.workunit.client.1.smithi082.stdout:0/745: write d3/f40 [1756867,11875] 0 2024-02-15T22:41:21.907 INFO:tasks.workunit.client.1.smithi082.stdout:0/746: chown d3/d19/d93/la3 60 1 2024-02-15T22:41:21.912 INFO:tasks.workunit.client.1.smithi082.stdout:0/747: dread d3/d19/d20/d26/f6a [4194304,4194304] 0 2024-02-15T22:41:21.913 INFO:tasks.workunit.client.1.smithi082.stdout:0/748: readlink d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/lf5 0 2024-02-15T22:41:21.914 INFO:tasks.workunit.client.1.smithi082.stdout:2/728: creat d6/dc/d58/d49/db6/fd8 x:0 0 0 2024-02-15T22:41:21.916 INFO:tasks.workunit.client.1.smithi082.stdout:7/793: rename d12/d17/c24 to d12/d3b/c10a 0 2024-02-15T22:41:21.919 INFO:tasks.workunit.client.1.smithi082.stdout:3/744: dread d0/d16/d3e/f5f [0,4194304] 0 2024-02-15T22:41:21.919 INFO:tasks.workunit.client.1.smithi082.stdout:0/749: mknod d3/d19/d1c/d6d/c104 0 2024-02-15T22:41:21.921 INFO:tasks.workunit.client.1.smithi082.stdout:4/919: rmdir d0/d16/d4a/d6a/dd9 39 2024-02-15T22:41:21.921 INFO:tasks.workunit.client.1.smithi082.stdout:4/920: chown d0/d16/d87/da2 87065 1 2024-02-15T22:41:21.923 INFO:tasks.workunit.client.1.smithi082.stdout:2/729: dread d6/dc/d58/f17 [0,4194304] 0 2024-02-15T22:41:21.923 INFO:tasks.workunit.client.1.smithi082.stdout:2/730: truncate d6/dc/f38 4769316 0 2024-02-15T22:41:21.926 INFO:tasks.workunit.client.1.smithi082.stdout:6/792: dread d2/d18/d8a/d47/d72/f9f [0,4194304] 0 2024-02-15T22:41:21.926 INFO:tasks.workunit.client.1.smithi082.stdout:1/703: dwrite d1/da/d14/f8b [0,4194304] 0 2024-02-15T22:41:21.927 INFO:tasks.workunit.client.1.smithi082.stdout:4/921: creat d0/f152 x:0 0 0 2024-02-15T22:41:21.927 INFO:tasks.workunit.client.1.smithi082.stdout:4/922: fdatasync d0/d8/d32/f4e 0 2024-02-15T22:41:21.933 INFO:tasks.workunit.client.1.smithi082.stdout:2/731: dread d6/dc/dd/d24/d71/f7a [0,4194304] 0 2024-02-15T22:41:21.933 INFO:tasks.workunit.client.1.smithi082.stdout:2/732: write d6/dc/d12/d23/d6e/f95 [1046812,62391] 0 2024-02-15T22:41:21.937 INFO:tasks.workunit.client.1.smithi082.stdout:1/704: mkdir d1/da/d14/d18/d1f/d7a/de5 0 2024-02-15T22:41:21.937 INFO:tasks.workunit.client.1.smithi082.stdout:3/745: rmdir d0/d16/d62/d14/d21/d69/d6c 39 2024-02-15T22:41:21.939 INFO:tasks.workunit.client.1.smithi082.stdout:2/733: creat d6/d18/fd9 x:0 0 0 2024-02-15T22:41:21.940 INFO:tasks.workunit.client.1.smithi082.stdout:3/746: write d0/d16/f4a [449240,103495] 0 2024-02-15T22:41:21.940 INFO:tasks.workunit.client.1.smithi082.stdout:1/705: mknod d1/da/d11/d8c/db3/ce6 0 2024-02-15T22:41:21.944 INFO:tasks.workunit.client.1.smithi082.stdout:1/706: dread d1/da/fd6 [0,4194304] 0 2024-02-15T22:41:21.944 INFO:tasks.workunit.client.1.smithi082.stdout:4/923: dread d0/d47/da6/d120/f124 [0,4194304] 0 2024-02-15T22:41:21.946 INFO:tasks.workunit.client.1.smithi082.stdout:1/707: mknod d1/da/d14/ce7 0 2024-02-15T22:41:21.947 INFO:tasks.workunit.client.1.smithi082.stdout:4/924: mkdir d0/d8/d32/d153 0 2024-02-15T22:41:21.949 INFO:tasks.workunit.client.1.smithi082.stdout:1/708: rename d1/da/d14/d18/d1f/f64 to d1/da/d14/d18/d1f/d7a/de5/fe8 0 2024-02-15T22:41:21.951 INFO:tasks.workunit.client.1.smithi082.stdout:4/925: creat d0/d8/d1b/d14b/f154 x:0 0 0 2024-02-15T22:41:21.953 INFO:tasks.workunit.client.1.smithi082.stdout:4/926: creat d0/d47/ddf/f155 x:0 0 0 2024-02-15T22:41:21.954 INFO:tasks.workunit.client.1.smithi082.stdout:4/927: creat d0/d16/d4a/d6a/f156 x:0 0 0 2024-02-15T22:41:21.957 INFO:tasks.workunit.client.1.smithi082.stdout:3/747: dread d0/d16/d62/d14/d21/f35 [0,4194304] 0 2024-02-15T22:41:21.957 INFO:tasks.workunit.client.1.smithi082.stdout:3/748: chown d0/d16/d3e/d56/fb5 7528202 1 2024-02-15T22:41:21.957 INFO:tasks.workunit.client.1.smithi082.stdout:1/709: dread d1/da/d14/d18/d51/f97 [0,4194304] 0 2024-02-15T22:41:21.958 INFO:tasks.workunit.client.1.smithi082.stdout:3/749: creat d0/d16/d62/d14/d71/fff x:0 0 0 2024-02-15T22:41:21.958 INFO:tasks.workunit.client.1.smithi082.stdout:3/750: stat d0/d16/d3e/d56/lc8 0 2024-02-15T22:41:21.958 INFO:tasks.workunit.client.1.smithi082.stdout:3/751: truncate d0/d16/d62/f6d 1454652 0 2024-02-15T22:41:21.958 INFO:tasks.workunit.client.1.smithi082.stdout:3/752: readlink d0/d16/d3e/d56/lc8 0 2024-02-15T22:41:21.960 INFO:tasks.workunit.client.1.smithi082.stdout:7/794: dwrite d12/d27/d74/fd1 [0,4194304] 0 2024-02-15T22:41:21.960 INFO:tasks.workunit.client.1.smithi082.stdout:5/806: dwrite d5/da/d67/da0/d92/fc3 [0,4194304] 0 2024-02-15T22:41:21.960 INFO:tasks.workunit.client.1.smithi082.stdout:6/793: dwrite d2/d18/d8a/d47/d69/d75/f9a [0,4194304] 0 2024-02-15T22:41:21.960 INFO:tasks.workunit.client.1.smithi082.stdout:1/710: unlink d1/f47 0 2024-02-15T22:41:21.964 INFO:tasks.workunit.client.1.smithi082.stdout:0/750: dwrite d3/d19/d20/d7c/dd5/f102 [0,4194304] 0 2024-02-15T22:41:21.964 INFO:tasks.workunit.client.1.smithi082.stdout:2/734: dwrite d6/dc/d58/d49/fa6 [0,4194304] 0 2024-02-15T22:41:21.964 INFO:tasks.workunit.client.1.smithi082.stdout:3/753: symlink d0/dc/d3f/dc4/dc9/l100 0 2024-02-15T22:41:21.972 INFO:tasks.workunit.client.1.smithi082.stdout:7/795: dread d12/d17/d3d/f55 [0,4194304] 0 2024-02-15T22:41:21.972 INFO:tasks.workunit.client.1.smithi082.stdout:6/794: write d2/f1e [3735520,87847] 0 2024-02-15T22:41:21.973 INFO:tasks.workunit.client.1.smithi082.stdout:6/795: fsync d2/d30/ff4 0 2024-02-15T22:41:21.973 INFO:tasks.workunit.client.1.smithi082.stdout:3/754: write d0/d16/d62/d14/d21/d69/d87/fdf [371744,8659] 0 2024-02-15T22:41:21.973 INFO:tasks.workunit.client.1.smithi082.stdout:3/755: chown d0/d16/laa 173 1 2024-02-15T22:41:21.975 INFO:tasks.workunit.client.1.smithi082.stdout:5/807: link d5/da/dc/dad/dcf/f2d d5/da/dc/dad/dcf/d59/d84/f10d 0 2024-02-15T22:41:21.985 INFO:tasks.workunit.client.1.smithi082.stdout:0/751: truncate d3/d19/d20/d7c/dcf/fd1 2646545 0 2024-02-15T22:41:21.991 INFO:tasks.workunit.client.1.smithi082.stdout:2/735: symlink d6/dc/d12/d46/lda 0 2024-02-15T22:41:21.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/736: readlink d6/dc/d58/d49/db6/ld4 0 2024-02-15T22:41:21.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/737: readlink d6/lf 0 2024-02-15T22:41:21.992 INFO:tasks.workunit.client.1.smithi082.stdout:2/738: readlink d6/d3c/d8c/lcd 0 2024-02-15T22:41:21.994 INFO:tasks.workunit.client.1.smithi082.stdout:7/796: creat d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/df5/f10b x:0 0 0 2024-02-15T22:41:21.995 INFO:tasks.workunit.client.1.smithi082.stdout:6/796: creat d2/d18/d8a/d47/f105 x:0 0 0 2024-02-15T22:41:21.998 INFO:tasks.workunit.client.1.smithi082.stdout:1/711: dwrite d1/da/d14/d18/d51/f59 [0,4194304] 0 2024-02-15T22:41:21.998 INFO:tasks.workunit.client.1.smithi082.stdout:1/712: write d1/da/d11/d93/db6/dc5/fd7 [811926,91011] 0 2024-02-15T22:41:21.999 INFO:tasks.workunit.client.1.smithi082.stdout:3/756: mkdir d0/d16/d62/d14/d71/d101 0 2024-02-15T22:41:22.001 INFO:tasks.workunit.client.1.smithi082.stdout:5/808: mknod d5/da/dc/dd5/c10e 0 2024-02-15T22:41:22.002 INFO:tasks.workunit.client.1.smithi082.stdout:0/752: symlink d3/d19/d20/d7c/dd5/deb/d92/l105 0 2024-02-15T22:41:22.004 INFO:tasks.workunit.client.1.smithi082.stdout:9/767: sync 2024-02-15T22:41:22.004 INFO:tasks.workunit.client.1.smithi082.stdout:8/706: sync 2024-02-15T22:41:22.004 INFO:tasks.workunit.client.1.smithi082.stdout:8/707: fsync d1/d7/d9/d24/d43/fae 0 2024-02-15T22:41:22.004 INFO:tasks.workunit.client.1.smithi082.stdout:8/708: write d1/d7/d9/d24/d43/da6/db8/fd6 [1021867,19913] 0 2024-02-15T22:41:22.005 INFO:tasks.workunit.client.1.smithi082.stdout:2/739: truncate d6/dc/dd/d21/f5a 1412092 0 2024-02-15T22:41:22.008 INFO:tasks.workunit.client.1.smithi082.stdout:7/797: symlink d12/d27/d74/d8b/l10c 0 2024-02-15T22:41:22.008 INFO:tasks.workunit.client.1.smithi082.stdout:7/798: truncate d12/d3b/d41/f60 1723542 0 2024-02-15T22:41:22.009 INFO:tasks.workunit.client.1.smithi082.stdout:3/757: dread d0/d16/d62/f45 [4194304,4194304] 0 2024-02-15T22:41:22.012 INFO:tasks.workunit.client.1.smithi082.stdout:6/797: unlink d2/d18/cd4 0 2024-02-15T22:41:22.015 INFO:tasks.workunit.client.1.smithi082.stdout:6/798: dread d2/f98 [0,4194304] 0 2024-02-15T22:41:22.016 INFO:tasks.workunit.client.1.smithi082.stdout:8/709: dwrite d1/d7/de/f3d [0,4194304] 0 2024-02-15T22:41:22.017 INFO:tasks.workunit.client.1.smithi082.stdout:1/713: write d1/da/d14/d18/d51/f73 [654924,13576] 0 2024-02-15T22:41:22.021 INFO:tasks.workunit.client.1.smithi082.stdout:5/809: unlink d5/da/d56/d98/f105 0 2024-02-15T22:41:22.024 INFO:tasks.workunit.client.1.smithi082.stdout:0/753: unlink d3/d19/d20/l22 0 2024-02-15T22:41:22.027 INFO:tasks.workunit.client.1.smithi082.stdout:9/768: creat d8/d12/d30/d3c/d71/feb x:0 0 0 2024-02-15T22:41:22.029 INFO:tasks.workunit.client.1.smithi082.stdout:2/740: mknod d6/dc/dd/d21/cdb 0 2024-02-15T22:41:22.029 INFO:tasks.workunit.client.1.smithi082.stdout:2/741: chown d6/dc/d58/d49/d5e 31 1 2024-02-15T22:41:22.029 INFO:tasks.workunit.client.1.smithi082.stdout:2/742: write d6/dc/d58/d49/fa6 [4804073,44817] 0 2024-02-15T22:41:22.032 INFO:tasks.workunit.client.1.smithi082.stdout:3/758: mkdir d0/d16/d62/d14/d21/d69/de6/d102 0 2024-02-15T22:41:22.035 INFO:tasks.workunit.client.1.smithi082.stdout:6/799: creat d2/d45/dc5/f106 x:0 0 0 2024-02-15T22:41:22.041 INFO:tasks.workunit.client.1.smithi082.stdout:8/710: mkdir d1/d7/d9/d50/d56/df4 0 2024-02-15T22:41:22.041 INFO:tasks.workunit.client.1.smithi082.stdout:8/711: read - d1/d7/de/fb7 zero size 2024-02-15T22:41:22.044 INFO:tasks.workunit.client.1.smithi082.stdout:2/743: dwrite d6/dc/dd/d1d/f50 [0,4194304] 0 2024-02-15T22:41:22.048 INFO:tasks.workunit.client.1.smithi082.stdout:6/800: dread d2/d18/d23/d67/f6d [0,4194304] 0 2024-02-15T22:41:22.053 INFO:tasks.workunit.client.1.smithi082.stdout:5/810: link d5/da/d67/dbf/ff2 d5/da/d67/f10f 0 2024-02-15T22:41:22.056 INFO:tasks.workunit.client.1.smithi082.stdout:5/811: dread d5/da/d67/da0/fc5 [0,4194304] 0 2024-02-15T22:41:22.058 INFO:tasks.workunit.client.1.smithi082.stdout:9/769: truncate d8/f11 3919061 0 2024-02-15T22:41:22.063 INFO:tasks.workunit.client.1.smithi082.stdout:7/799: mknod d12/d17/c10d 0 2024-02-15T22:41:22.066 INFO:tasks.workunit.client.1.smithi082.stdout:6/801: dwrite d2/d18/d8a/d47/d72/f8c [0,4194304] 0 2024-02-15T22:41:22.066 INFO:tasks.workunit.client.1.smithi082.stdout:6/802: readlink d2/d18/d8a/d47/d72/lb5 0 2024-02-15T22:41:22.066 INFO:tasks.workunit.client.1.smithi082.stdout:9/770: dread d8/d12/d30/d3c/d65/fe1 [0,4194304] 0 2024-02-15T22:41:22.068 INFO:tasks.workunit.client.1.smithi082.stdout:8/712: rmdir d1/dcc 39 2024-02-15T22:41:22.068 INFO:tasks.workunit.client.1.smithi082.stdout:8/713: write d1/d7/d9/fa4 [570735,51612] 0 2024-02-15T22:41:22.070 INFO:tasks.workunit.client.1.smithi082.stdout:2/744: link d6/dc/dd/d1d/c42 d6/dc/dd/d21/cdc 0 2024-02-15T22:41:22.078 INFO:tasks.workunit.client.1.smithi082.stdout:9/771: dwrite d8/d24/d87/de0/d8b/d96/fdb [0,4194304] 0 2024-02-15T22:41:22.078 INFO:tasks.workunit.client.1.smithi082.stdout:9/772: readlink d8/d24/d2e/l5a 0 2024-02-15T22:41:22.079 INFO:tasks.workunit.client.1.smithi082.stdout:5/812: mknod d5/da/dc/dad/dcf/d59/d84/d89/c110 0 2024-02-15T22:41:22.083 INFO:tasks.workunit.client.1.smithi082.stdout:3/759: rename d0/d16/d62/d14/d71/df4/f67 to d0/d16/d62/d14/d21/f103 0 2024-02-15T22:41:22.085 INFO:tasks.workunit.client.1.smithi082.stdout:6/803: link d2/f1e d2/d30/d3b/f107 0 2024-02-15T22:41:22.090 INFO:tasks.workunit.client.1.smithi082.stdout:8/714: mkdir d1/d7/d9/d42/d6a/da5/dd4/dd8/df5 0 2024-02-15T22:41:22.090 INFO:tasks.workunit.client.1.smithi082.stdout:8/715: chown d1/d7/d9/d42/dc5/f79 10 1 2024-02-15T22:41:22.091 INFO:tasks.workunit.client.1.smithi082.stdout:2/745: mknod d6/d18/cdd 0 2024-02-15T22:41:22.098 INFO:tasks.workunit.client.1.smithi082.stdout:9/773: creat d8/d12/d33/d3e/fec x:0 0 0 2024-02-15T22:41:22.099 INFO:tasks.workunit.client.1.smithi082.stdout:5/813: creat d5/da/d67/da0/d92/f111 x:0 0 0 2024-02-15T22:41:22.102 INFO:tasks.workunit.client.1.smithi082.stdout:5/814: dread d5/da/f40 [0,4194304] 0 2024-02-15T22:41:22.104 INFO:tasks.workunit.client.1.smithi082.stdout:7/800: creat d12/d37/d85/dcc/f10e x:0 0 0 2024-02-15T22:41:22.104 INFO:tasks.workunit.client.1.smithi082.stdout:7/801: fsync d12/d17/d42/d67/d81/d91/f101 0 2024-02-15T22:41:22.112 INFO:tasks.workunit.client.1.smithi082.stdout:3/760: rename d0/d16/d62/d14/fa8 to d0/d16/d62/d14/d21/d69/dbe/f104 0 2024-02-15T22:41:22.112 INFO:tasks.workunit.client.1.smithi082.stdout:4/928: sync 2024-02-15T22:41:22.113 INFO:tasks.workunit.client.1.smithi082.stdout:4/929: write d0/d47/da6/da7/d108/f116 [1252785,121625] 0 2024-02-15T22:41:22.117 INFO:tasks.workunit.client.1.smithi082.stdout:8/716: unlink d1/d7/d9/d50/c55 0 2024-02-15T22:41:22.122 INFO:tasks.workunit.client.1.smithi082.stdout:4/930: write d0/d8/fba [1085802,65952] 0 2024-02-15T22:41:22.122 INFO:tasks.workunit.client.1.smithi082.stdout:2/746: symlink d6/dc/dd/d21/d9f/lde 0 2024-02-15T22:41:22.122 INFO:tasks.workunit.client.1.smithi082.stdout:6/804: rmdir d2/d18/d23 39 2024-02-15T22:41:22.126 INFO:tasks.workunit.client.1.smithi082.stdout:9/774: creat d8/d12/d30/d3c/d65/fed x:0 0 0 2024-02-15T22:41:22.130 INFO:tasks.workunit.client.1.smithi082.stdout:7/802: rmdir d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/df5 39 2024-02-15T22:41:22.141 INFO:tasks.workunit.client.1.smithi082.stdout:8/717: rename d1/d7/d9/ldc to d1/d40/lf6 0 2024-02-15T22:41:22.141 INFO:tasks.workunit.client.1.smithi082.stdout:8/718: stat d1/f21 0 2024-02-15T22:41:22.141 INFO:tasks.workunit.client.1.smithi082.stdout:8/719: write d1/d7/de/fb7 [288120,90162] 0 2024-02-15T22:41:22.143 INFO:tasks.workunit.client.1.smithi082.stdout:1/714: sync 2024-02-15T22:41:22.145 INFO:tasks.workunit.client.1.smithi082.stdout:4/931: symlink d0/d47/da6/d114/l157 0 2024-02-15T22:41:22.151 INFO:tasks.workunit.client.1.smithi082.stdout:2/747: unlink d6/dc/dd/d21/cdb 0 2024-02-15T22:41:22.154 INFO:tasks.workunit.client.1.smithi082.stdout:0/754: sync 2024-02-15T22:41:22.155 INFO:tasks.workunit.client.1.smithi082.stdout:0/755: write d3/d19/d20/d7c/dd5/deb/da5/f8a [159062,90977] 0 2024-02-15T22:41:22.155 INFO:tasks.workunit.client.1.smithi082.stdout:0/756: chown d3/d19/d20/d7c/dd5/deb/da5/d9c 255666313 1 2024-02-15T22:41:22.155 INFO:tasks.workunit.client.1.smithi082.stdout:9/775: symlink d8/d24/d87/de0/daf/lee 0 2024-02-15T22:41:22.155 INFO:tasks.workunit.client.1.smithi082.stdout:9/776: write d8/d12/f2f [1263966,33142] 0 2024-02-15T22:41:22.158 INFO:tasks.workunit.client.1.smithi082.stdout:8/720: dwrite d1/d7/d9/d24/d43/d85/fb2 [0,4194304] 0 2024-02-15T22:41:22.163 INFO:tasks.workunit.client.1.smithi082.stdout:1/715: link d1/da/d14/d18/d1f/d2f/f95 d1/da/d14/d18/d6d/fe9 0 2024-02-15T22:41:22.163 INFO:tasks.workunit.client.1.smithi082.stdout:1/716: stat d1/da/d14/f8b 0 2024-02-15T22:41:22.163 INFO:tasks.workunit.client.1.smithi082.stdout:1/717: write d1/da/d11/d3f/f5e [731458,52769] 0 2024-02-15T22:41:22.164 INFO:tasks.workunit.client.1.smithi082.stdout:4/932: symlink d0/d8/d32/l158 0 2024-02-15T22:41:22.170 INFO:tasks.workunit.client.1.smithi082.stdout:3/761: write d0/dc/fd [2588195,118703] 0 2024-02-15T22:41:22.171 INFO:tasks.workunit.client.1.smithi082.stdout:2/748: symlink d6/dc/dd/ldf 0 2024-02-15T22:41:22.171 INFO:tasks.workunit.client.1.smithi082.stdout:2/749: fsync d6/dc/d12/d23/fc8 0 2024-02-15T22:41:22.172 INFO:tasks.workunit.client.1.smithi082.stdout:2/750: creat d6/dc/d58/d49/db6/fe0 x:0 0 0 2024-02-15T22:41:22.172 INFO:tasks.workunit.client.1.smithi082.stdout:2/751: write d6/dc/dd/d24/d71/fa5 [1276606,118839] 0 2024-02-15T22:41:22.173 INFO:tasks.workunit.client.1.smithi082.stdout:6/805: getdents d2/d18/d8a/d47 0 2024-02-15T22:41:22.178 INFO:tasks.workunit.client.1.smithi082.stdout:0/757: link d3/d19/d93/dbe/ff6 d3/d19/d20/d7c/dd5/deb/da5/d99/db1/f106 0 2024-02-15T22:41:22.178 INFO:tasks.workunit.client.1.smithi082.stdout:0/758: fdatasync d3/d19/d1c/d6d/fe6 0 2024-02-15T22:41:22.183 INFO:tasks.workunit.client.1.smithi082.stdout:9/777: creat d8/d24/d87/de0/fef x:0 0 0 2024-02-15T22:41:22.183 INFO:tasks.workunit.client.1.smithi082.stdout:9/778: fdatasync d8/d24/d87/de0/d77/dab/fb1 0 2024-02-15T22:41:22.185 INFO:tasks.workunit.client.1.smithi082.stdout:7/803: dwrite d12/d17/f5f [0,4194304] 0 2024-02-15T22:41:22.187 INFO:tasks.workunit.client.1.smithi082.stdout:8/721: dwrite d1/d7/d78/fcb [0,4194304] 0 2024-02-15T22:41:22.187 INFO:tasks.workunit.client.1.smithi082.stdout:8/722: fsync d1/d7/f54 0 2024-02-15T22:41:22.188 INFO:tasks.workunit.client.1.smithi082.stdout:1/718: dwrite d1/da/d11/d3f/d75/f78 [0,4194304] 0 2024-02-15T22:41:22.200 INFO:tasks.workunit.client.1.smithi082.stdout:4/933: symlink d0/dc0/l159 0 2024-02-15T22:41:22.203 INFO:tasks.workunit.client.1.smithi082.stdout:3/762: symlink d0/d16/d3e/l105 0 2024-02-15T22:41:22.207 INFO:tasks.workunit.client.1.smithi082.stdout:2/752: unlink d6/dc/d58/d49/d5e/d67/fab 0 2024-02-15T22:41:22.208 INFO:tasks.workunit.client.1.smithi082.stdout:6/806: creat d2/d18/f108 x:0 0 0 2024-02-15T22:41:22.208 INFO:tasks.workunit.client.1.smithi082.stdout:6/807: chown d2/d30/da6/fec 11668 1 2024-02-15T22:41:22.208 INFO:tasks.workunit.client.1.smithi082.stdout:6/808: read d2/d45/fc9 [24372,25816] 0 2024-02-15T22:41:22.209 INFO:tasks.workunit.client.1.smithi082.stdout:0/759: mkdir d3/d19/d93/d107 0 2024-02-15T22:41:22.211 INFO:tasks.workunit.client.1.smithi082.stdout:9/779: rename d8/d12/d30/d3c/d71/feb to d8/d12/d67/d70/d97/ff0 0 2024-02-15T22:41:22.211 INFO:tasks.workunit.client.1.smithi082.stdout:9/780: read d8/d12/dc5/f57 [1824809,65074] 0 2024-02-15T22:41:22.215 INFO:tasks.workunit.client.1.smithi082.stdout:7/804: dwrite d12/d17/d3d/f55 [4194304,4194304] 0 2024-02-15T22:41:22.216 INFO:tasks.workunit.client.1.smithi082.stdout:8/723: dwrite d1/d7/d9/f17 [0,4194304] 0 2024-02-15T22:41:22.216 INFO:tasks.workunit.client.1.smithi082.stdout:8/724: readlink d1/d40/le5 0 2024-02-15T22:41:22.219 INFO:tasks.workunit.client.1.smithi082.stdout:1/719: dwrite d1/da/d14/d18/d1f/d2f/f95 [0,4194304] 0 2024-02-15T22:41:22.225 INFO:tasks.workunit.client.1.smithi082.stdout:9/781: write d8/d12/d30/d3c/d65/f6b [964534,19102] 0 2024-02-15T22:41:22.229 INFO:tasks.workunit.client.1.smithi082.stdout:8/725: dwrite d1/d7/de/ff [4194304,4194304] 0 2024-02-15T22:41:22.237 INFO:tasks.workunit.client.1.smithi082.stdout:4/934: getdents d0/d47/dd8 0 2024-02-15T22:41:22.237 INFO:tasks.workunit.client.1.smithi082.stdout:4/935: truncate d0/d47/da6/d114/f13b 996728 0 2024-02-15T22:41:22.238 INFO:tasks.workunit.client.1.smithi082.stdout:2/753: creat d6/dc/dd/d21/d9f/fe1 x:0 0 0 2024-02-15T22:41:22.244 INFO:tasks.workunit.client.1.smithi082.stdout:0/760: link d3/d19/d20/d7c/dd5/deb/da0/dbc/f98 d3/d19/d1c/f108 0 2024-02-15T22:41:22.248 INFO:tasks.workunit.client.1.smithi082.stdout:3/763: rename d0/d16/df0/df8 to d0/d16/d3e/d56/db0/de1/d106 0 2024-02-15T22:41:22.249 INFO:tasks.workunit.client.1.smithi082.stdout:3/764: dread - d0/d16/d3e/d56/ff7 zero size 2024-02-15T22:41:22.249 INFO:tasks.workunit.client.1.smithi082.stdout:3/765: stat d0/d16/d62/d14/d21/d69/d6c/fd5 0 2024-02-15T22:41:22.253 INFO:tasks.workunit.client.1.smithi082.stdout:7/805: truncate d12/f22 109820 0 2024-02-15T22:41:22.253 INFO:tasks.workunit.client.1.smithi082.stdout:4/936: dwrite d0/d16/f9c [0,4194304] 0 2024-02-15T22:41:22.253 INFO:tasks.workunit.client.1.smithi082.stdout:4/937: chown d0/d46/f79 7542 1 2024-02-15T22:41:22.253 INFO:tasks.workunit.client.1.smithi082.stdout:4/938: readlink d0/d8/d1b/dd/d37/lf1 0 2024-02-15T22:41:22.253 INFO:tasks.workunit.client.1.smithi082.stdout:0/761: dread d3/d19/d25/d45/f39 [0,4194304] 0 2024-02-15T22:41:22.255 INFO:tasks.workunit.client.1.smithi082.stdout:1/720: getdents d1/da/d11/d8c/db3 0 2024-02-15T22:41:22.255 INFO:tasks.workunit.client.1.smithi082.stdout:1/721: dread - d1/da/d11/d93/db6/dc5/fdd zero size 2024-02-15T22:41:22.256 INFO:tasks.workunit.client.1.smithi082.stdout:9/782: creat d8/d24/d87/dcb/ff1 x:0 0 0 2024-02-15T22:41:22.256 INFO:tasks.workunit.client.1.smithi082.stdout:9/783: readlink d8/d12/d33/l75 0 2024-02-15T22:41:22.260 INFO:tasks.workunit.client.1.smithi082.stdout:6/809: rename d2/d18/d23/c85 to d2/d18/d8a/d47/d69/d75/de4/c109 0 2024-02-15T22:41:22.260 INFO:tasks.workunit.client.1.smithi082.stdout:6/810: truncate d2/d30/ff4 669513 0 2024-02-15T22:41:22.262 INFO:tasks.workunit.client.1.smithi082.stdout:3/766: mknod d0/d16/d62/d2e/d84/c107 0 2024-02-15T22:41:22.268 INFO:tasks.workunit.client.1.smithi082.stdout:7/806: creat d12/d3b/d41/dfe/f10f x:0 0 0 2024-02-15T22:41:22.274 INFO:tasks.workunit.client.1.smithi082.stdout:4/939: mknod d0/d8/d32/d153/c15a 0 2024-02-15T22:41:22.275 INFO:tasks.workunit.client.1.smithi082.stdout:4/940: fdatasync d0/d8/d32/fb4 0 2024-02-15T22:41:22.275 INFO:tasks.workunit.client.1.smithi082.stdout:4/941: creat d0/d16/d4a/d6a/f15b x:0 0 0 2024-02-15T22:41:22.276 INFO:tasks.workunit.client.1.smithi082.stdout:0/762: creat d3/d19/d25/d80/dd3/f109 x:0 0 0 2024-02-15T22:41:22.282 INFO:tasks.workunit.client.1.smithi082.stdout:1/722: mknod d1/da/d14/d18/d6d/cea 0 2024-02-15T22:41:22.287 INFO:tasks.workunit.client.1.smithi082.stdout:3/767: dwrite d0/d16/d62/f31 [0,4194304] 0 2024-02-15T22:41:22.287 INFO:tasks.workunit.client.1.smithi082.stdout:4/942: dwrite d0/d8/d1b/f73 [0,4194304] 0 2024-02-15T22:41:22.296 INFO:tasks.workunit.client.1.smithi082.stdout:8/726: rename d1/d7/de/d57/fe0 to d1/d7/d9/d42/d6a/da5/dd4/ff7 0 2024-02-15T22:41:22.296 INFO:tasks.workunit.client.1.smithi082.stdout:8/727: chown d1/d7/d48/lbc 2039766 1 2024-02-15T22:41:22.296 INFO:tasks.workunit.client.1.smithi082.stdout:8/728: truncate d1/d7/d9/d24/d30/fe4 587206 0 2024-02-15T22:41:22.297 INFO:tasks.workunit.client.1.smithi082.stdout:6/811: link d2/d18/d8a/d65/cce d2/d18/d8a/d47/d69/dd0/c10a 0 2024-02-15T22:41:22.299 INFO:tasks.workunit.client.1.smithi082.stdout:6/812: dread d2/d18/d8a/d47/d69/db1/fd7 [0,4194304] 0 2024-02-15T22:41:22.299 INFO:tasks.workunit.client.1.smithi082.stdout:6/813: write d2/d18/d8a/d65/fcf [2896113,27551] 0 2024-02-15T22:41:22.299 INFO:tasks.workunit.client.1.smithi082.stdout:6/814: fsync d2/d18/d23/f35 0 2024-02-15T22:41:22.301 INFO:tasks.workunit.client.1.smithi082.stdout:7/807: dread - d12/d17/fa5 zero size 2024-02-15T22:41:22.309 INFO:tasks.workunit.client.1.smithi082.stdout:1/723: mknod d1/d57/de2/ceb 0 2024-02-15T22:41:22.317 INFO:tasks.workunit.client.1.smithi082.stdout:5/815: sync 2024-02-15T22:41:22.321 INFO:tasks.workunit.client.1.smithi082.stdout:8/729: dwrite d1/d7/d9/f47 [0,4194304] 0 2024-02-15T22:41:22.323 INFO:tasks.workunit.client.1.smithi082.stdout:3/768: mkdir d0/d16/d108 0 2024-02-15T22:41:22.328 INFO:tasks.workunit.client.1.smithi082.stdout:0/763: dwrite d3/d19/d1c/d6d/f94 [0,4194304] 0 2024-02-15T22:41:22.334 INFO:tasks.workunit.client.1.smithi082.stdout:4/943: creat d0/d47/dd8/f15c x:0 0 0 2024-02-15T22:41:22.334 INFO:tasks.workunit.client.1.smithi082.stdout:4/944: write d0/d16/f56 [1333915,57577] 0 2024-02-15T22:41:22.336 INFO:tasks.workunit.client.1.smithi082.stdout:9/784: getdents d8/d12/d33/d3e 0 2024-02-15T22:41:22.340 INFO:tasks.workunit.client.1.smithi082.stdout:2/754: rename d6/dc/dd/c7d to d6/dc/dd/d24/d71/ce2 0 2024-02-15T22:41:22.340 INFO:tasks.workunit.client.1.smithi082.stdout:2/755: readlink d6/l80 0 2024-02-15T22:41:22.340 INFO:tasks.workunit.client.1.smithi082.stdout:4/945: dread d0/d8/d1b/f119 [0,4194304] 0 2024-02-15T22:41:22.345 INFO:tasks.workunit.client.1.smithi082.stdout:7/808: getdents d12/d17/d42/d67/d81/d91 0 2024-02-15T22:41:22.345 INFO:tasks.workunit.client.1.smithi082.stdout:7/809: fdatasync d12/d17/d42/f53 0 2024-02-15T22:41:22.345 INFO:tasks.workunit.client.1.smithi082.stdout:7/810: readlink d12/d27/d74/da2/ldb 0 2024-02-15T22:41:22.345 INFO:tasks.workunit.client.1.smithi082.stdout:7/811: chown d12/d27/d6e/d6a/lcf 1245902 1 2024-02-15T22:41:22.351 INFO:tasks.workunit.client.1.smithi082.stdout:3/769: link d0/d16/d62/d14/d21/d69/d6c/c72 d0/d16/d62/d2e/d84/c109 0 2024-02-15T22:41:22.364 INFO:tasks.workunit.client.1.smithi082.stdout:3/770: dwrite d0/dc/fd [4194304,4194304] 0 2024-02-15T22:41:22.364 INFO:tasks.workunit.client.1.smithi082.stdout:3/771: read d0/fed [2370345,6905] 0 2024-02-15T22:41:22.379 INFO:tasks.workunit.client.1.smithi082.stdout:9/785: symlink d8/d24/d87/de0/d77/dc6/lf2 0 2024-02-15T22:41:22.382 INFO:tasks.workunit.client.1.smithi082.stdout:6/815: rename d2/d18/d23/d67/f71 to d2/d18/f10b 0 2024-02-15T22:41:22.386 INFO:tasks.workunit.client.1.smithi082.stdout:1/724: link d1/da/d14/d18/d51/f81 d1/da/d14/d18/d1f/d7a/ddb/fec 0 2024-02-15T22:41:22.387 INFO:tasks.workunit.client.1.smithi082.stdout:8/730: truncate d1/f14 4386542 0 2024-02-15T22:41:22.390 INFO:tasks.workunit.client.1.smithi082.stdout:9/786: getdents d8/d12/d33/da4 0 2024-02-15T22:41:22.391 INFO:tasks.workunit.client.1.smithi082.stdout:9/787: read - d8/d12/d30/f3d zero size 2024-02-15T22:41:22.393 INFO:tasks.workunit.client.1.smithi082.stdout:2/756: getdents d6 0 2024-02-15T22:41:22.400 INFO:tasks.workunit.client.1.smithi082.stdout:2/757: write d6/dc/dd/d21/d9f/fbc [3784893,122608] 0 2024-02-15T22:41:22.400 INFO:tasks.workunit.client.1.smithi082.stdout:2/758: chown d6/dc/d12/d46/d4b 12 1 2024-02-15T22:41:22.400 INFO:tasks.workunit.client.1.smithi082.stdout:2/759: chown d6/dc/d58/d49/d5e/d67 0 1 2024-02-15T22:41:22.401 INFO:tasks.workunit.client.1.smithi082.stdout:9/788: creat d8/d12/d33/da4/dac/ff3 x:0 0 0 2024-02-15T22:41:22.401 INFO:tasks.workunit.client.1.smithi082.stdout:9/789: read - d8/d24/d87/de0/d77/dab/fd8 zero size 2024-02-15T22:41:22.404 INFO:tasks.workunit.client.1.smithi082.stdout:0/764: rename d3/d19/d25/d80/dd3/fd8 to d3/d19/d20/d7c/dd5/deb/da0/dbc/f10a 0 2024-02-15T22:41:22.408 INFO:tasks.workunit.client.1.smithi082.stdout:9/790: creat d8/d24/d2e/ff4 x:0 0 0 2024-02-15T22:41:22.409 INFO:tasks.workunit.client.1.smithi082.stdout:4/946: rename d0/d8/d32/c148 to d0/dc0/dcd/d12f/c15d 0 2024-02-15T22:41:22.414 INFO:tasks.workunit.client.1.smithi082.stdout:7/812: rename d12/d27/d74/d8b/cf2 to d12/d27/d6e/d6a/d9e/dbe/c110 0 2024-02-15T22:41:22.418 INFO:tasks.workunit.client.1.smithi082.stdout:4/947: dread d0/d8/d32/fbf [0,4194304] 0 2024-02-15T22:41:22.418 INFO:tasks.workunit.client.1.smithi082.stdout:6/816: rename d2/d18/d23/cbb to d2/d18/d8a/d47/d69/dd0/c10c 0 2024-02-15T22:41:22.418 INFO:tasks.workunit.client.1.smithi082.stdout:6/817: fdatasync d2/d18/d8a/d65/fcd 0 2024-02-15T22:41:22.419 INFO:tasks.workunit.client.1.smithi082.stdout:7/813: symlink d12/d17/d42/d67/l111 0 2024-02-15T22:41:22.421 INFO:tasks.workunit.client.1.smithi082.stdout:7/814: creat d12/d37/d85/f112 x:0 0 0 2024-02-15T22:41:22.424 INFO:tasks.workunit.client.1.smithi082.stdout:1/725: rename d1/da/d14/d18/d51/c72 to d1/da/d11/d3f/ced 0 2024-02-15T22:41:22.427 INFO:tasks.workunit.client.1.smithi082.stdout:8/731: rename d1/d7/d9/d24/d43/da6/db8/fd6 to d1/d7/d9/d42/d6a/da5/ddd/ff8 0 2024-02-15T22:41:22.427 INFO:tasks.workunit.client.1.smithi082.stdout:2/760: rename d6/dc to d6/dc/d58/d49/d5e/d67/de3 22 2024-02-15T22:41:22.428 INFO:tasks.workunit.client.1.smithi082.stdout:9/791: dwrite d8/d12/d30/d3c/d71/fba [0,4194304] 0 2024-02-15T22:41:22.434 INFO:tasks.workunit.client.1.smithi082.stdout:0/765: rename d3/d19/d20/d7c/dd5/deb/da0/dbc/f9d to d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/f10b 0 2024-02-15T22:41:22.436 INFO:tasks.workunit.client.1.smithi082.stdout:2/761: link d6/dc/fc7 d6/dc/d58/d49/d5e/fe4 0 2024-02-15T22:41:22.439 INFO:tasks.workunit.client.1.smithi082.stdout:8/732: creat d1/d7/d9/d24/d43/da6/db8/ff9 x:0 0 0 2024-02-15T22:41:22.440 INFO:tasks.workunit.client.1.smithi082.stdout:2/762: dread d6/dc/d58/d49/fa6 [4194304,4194304] 0 2024-02-15T22:41:22.447 INFO:tasks.workunit.client.1.smithi082.stdout:8/733: creat d1/d7/d9/d24/ffa x:0 0 0 2024-02-15T22:41:22.448 INFO:tasks.workunit.client.1.smithi082.stdout:2/763: symlink d6/le5 0 2024-02-15T22:41:22.448 INFO:tasks.workunit.client.1.smithi082.stdout:2/764: creat d6/dc/d58/d49/db6/fe6 x:0 0 0 2024-02-15T22:41:22.452 INFO:tasks.workunit.client.1.smithi082.stdout:2/765: rmdir d6/dc/d58/d9b 0 2024-02-15T22:41:22.452 INFO:tasks.workunit.client.1.smithi082.stdout:8/734: read d1/d7/de/d1e/f27 [228284,119489] 0 2024-02-15T22:41:22.453 INFO:tasks.workunit.client.1.smithi082.stdout:9/792: link d8/f19 d8/d12/d30/d3c/d65/ff5 0 2024-02-15T22:41:22.455 INFO:tasks.workunit.client.1.smithi082.stdout:2/766: symlink d6/le7 0 2024-02-15T22:41:22.456 INFO:tasks.workunit.client.1.smithi082.stdout:7/815: dwrite d12/d27/d33/f36 [4194304,4194304] 0 2024-02-15T22:41:22.456 INFO:tasks.workunit.client.1.smithi082.stdout:8/735: truncate d1/d7/de/f2f 2407414 0 2024-02-15T22:41:22.458 INFO:tasks.workunit.client.1.smithi082.stdout:4/948: dwrite d0/d8/d32/fbf [0,4194304] 0 2024-02-15T22:41:22.458 INFO:tasks.workunit.client.1.smithi082.stdout:4/949: dread - d0/d16/d4a/d6a/dd9/de2/f140 zero size 2024-02-15T22:41:22.458 INFO:tasks.workunit.client.1.smithi082.stdout:1/726: dwrite d1/da/d14/d18/d1f/d7a/ddb/fec [0,4194304] 0 2024-02-15T22:41:22.458 INFO:tasks.workunit.client.1.smithi082.stdout:0/766: dwrite d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/f68 [0,4194304] 0 2024-02-15T22:41:22.459 INFO:tasks.workunit.client.1.smithi082.stdout:7/816: creat d12/d27/d6e/f113 x:0 0 0 2024-02-15T22:41:22.460 INFO:tasks.workunit.client.1.smithi082.stdout:1/727: dread d1/da/d11/d93/db6/dc5/fd7 [0,4194304] 0 2024-02-15T22:41:22.460 INFO:tasks.workunit.client.1.smithi082.stdout:1/728: write d1/da/d11/f82 [662956,16397] 0 2024-02-15T22:41:22.462 INFO:tasks.workunit.client.1.smithi082.stdout:8/736: creat d1/d7/de/ffb x:0 0 0 2024-02-15T22:41:22.462 INFO:tasks.workunit.client.1.smithi082.stdout:8/737: fsync d1/d7/d9/d50/d56/f6b 0 2024-02-15T22:41:22.463 INFO:tasks.workunit.client.1.smithi082.stdout:2/767: dread d6/d18/f75 [0,4194304] 0 2024-02-15T22:41:22.465 INFO:tasks.workunit.client.1.smithi082.stdout:4/950: rename d0/d47/c55 to d0/dc0/dcd/dcf/c15e 0 2024-02-15T22:41:22.465 INFO:tasks.workunit.client.1.smithi082.stdout:4/951: write d0/d8/d1b/ff8 [390935,103111] 0 2024-02-15T22:41:22.465 INFO:tasks.workunit.client.1.smithi082.stdout:4/952: chown d0/d47/da6/da7/f126 2913199 1 2024-02-15T22:41:22.469 INFO:tasks.workunit.client.1.smithi082.stdout:0/767: link d3/d19/d20/d7c/dcf/fd1 d3/d19/d1c/d76/d88/f10c 0 2024-02-15T22:41:22.470 INFO:tasks.workunit.client.1.smithi082.stdout:2/768: mkdir d6/dc/d12/d46/d76/dae/de8 0 2024-02-15T22:41:22.474 INFO:tasks.workunit.client.1.smithi082.stdout:4/953: creat d0/dc0/f15f x:0 0 0 2024-02-15T22:41:22.475 INFO:tasks.workunit.client.1.smithi082.stdout:2/769: mknod d6/dc/dd/d24/d71/ce9 0 2024-02-15T22:41:22.476 INFO:tasks.workunit.client.1.smithi082.stdout:9/793: dwrite d8/d12/d30/d3c/d65/fe1 [0,4194304] 0 2024-02-15T22:41:22.476 INFO:tasks.workunit.client.1.smithi082.stdout:1/729: dwrite d1/da/d14/d18/d1f/d2f/f52 [4194304,4194304] 0 2024-02-15T22:41:22.476 INFO:tasks.workunit.client.1.smithi082.stdout:1/730: fsync d1/fc6 0 2024-02-15T22:41:22.482 INFO:tasks.workunit.client.1.smithi082.stdout:1/731: dread d1/da/d14/d18/d51/f71 [0,4194304] 0 2024-02-15T22:41:22.485 INFO:tasks.workunit.client.1.smithi082.stdout:7/817: rename d12/d3b/d41 to d12/d27/d6e/d6a/d9e/dbe/dcb/d114 0 2024-02-15T22:41:22.485 INFO:tasks.workunit.client.1.smithi082.stdout:7/818: chown d12/d17/d42/d67/c69 1010983024 1 2024-02-15T22:41:22.485 INFO:tasks.workunit.client.1.smithi082.stdout:7/819: dread - d12/d27/d6e/d6a/d9e/dbe/dcb/d114/f103 zero size 2024-02-15T22:41:22.486 INFO:tasks.workunit.client.1.smithi082.stdout:1/732: getdents d1/da/d14/d18/d1f 0 2024-02-15T22:41:22.488 INFO:tasks.workunit.client.1.smithi082.stdout:7/820: dread d12/d3b/f89 [0,4194304] 0 2024-02-15T22:41:22.489 INFO:tasks.workunit.client.1.smithi082.stdout:0/768: rename d3/f15 to d3/d19/d20/d7c/dd5/deb/f10d 0 2024-02-15T22:41:22.489 INFO:tasks.workunit.client.1.smithi082.stdout:0/769: fdatasync d3/d19/d20/d7c/dd5/deb/f6e 0 2024-02-15T22:41:22.491 INFO:tasks.workunit.client.1.smithi082.stdout:2/770: dread d6/dc/dd/d1d/f57 [0,4194304] 0 2024-02-15T22:41:22.491 INFO:tasks.workunit.client.1.smithi082.stdout:2/771: chown d6/dc/dd/d24/f43 268928463 1 2024-02-15T22:41:22.491 INFO:tasks.workunit.client.1.smithi082.stdout:7/821: mkdir d12/d27/d74/d115 0 2024-02-15T22:41:22.492 INFO:tasks.workunit.client.1.smithi082.stdout:9/794: dwrite d8/d24/d87/de0/d8b/d96/fdb [0,4194304] 0 2024-02-15T22:41:22.494 INFO:tasks.workunit.client.1.smithi082.stdout:2/772: creat d6/dc/d58/d49/d5e/d67/fea x:0 0 0 2024-02-15T22:41:22.495 INFO:tasks.workunit.client.1.smithi082.stdout:2/773: stat d6/dc/d12/d46/f7c 0 2024-02-15T22:41:22.495 INFO:tasks.workunit.client.1.smithi082.stdout:2/774: truncate d6/dc/d12/d46/d4b/d63/fb0 969292 0 2024-02-15T22:41:22.495 INFO:tasks.workunit.client.1.smithi082.stdout:2/775: fsync d6/d18/faf 0 2024-02-15T22:41:22.495 INFO:tasks.workunit.client.1.smithi082.stdout:7/822: chown d12/d37/d85/ca4 91750174 1 2024-02-15T22:41:22.497 INFO:tasks.workunit.client.1.smithi082.stdout:0/770: symlink d3/d19/d20/d7c/dd5/deb/da0/dbc/l10e 0 2024-02-15T22:41:22.500 INFO:tasks.workunit.client.1.smithi082.stdout:9/795: mkdir d8/d24/d87/de0/d77/df6 0 2024-02-15T22:41:22.502 INFO:tasks.workunit.client.1.smithi082.stdout:2/776: creat d6/feb x:0 0 0 2024-02-15T22:41:22.502 INFO:tasks.workunit.client.1.smithi082.stdout:2/777: fdatasync d6/dc/d58/f61 0 2024-02-15T22:41:22.503 INFO:tasks.workunit.client.1.smithi082.stdout:4/954: dwrite d0/d47/da6/da7/f126 [0,4194304] 0 2024-02-15T22:41:22.504 INFO:tasks.workunit.client.1.smithi082.stdout:0/771: link d3/d19/d25/d45/ffc d3/d19/d20/d7c/dd5/deb/da5/d9c/f10f 0 2024-02-15T22:41:22.505 INFO:tasks.workunit.client.1.smithi082.stdout:9/796: creat d8/d12/d33/ff7 x:0 0 0 2024-02-15T22:41:22.507 INFO:tasks.workunit.client.1.smithi082.stdout:2/778: mkdir d6/dc/d58/d49/dec 0 2024-02-15T22:41:22.508 INFO:tasks.workunit.client.1.smithi082.stdout:7/823: mknod d12/d17/c116 0 2024-02-15T22:41:22.508 INFO:tasks.workunit.client.1.smithi082.stdout:1/733: dwrite d1/da/d11/d3f/f5c [0,4194304] 0 2024-02-15T22:41:22.510 INFO:tasks.workunit.client.1.smithi082.stdout:4/955: getdents d0/dc0/dcd/de3/d12d 0 2024-02-15T22:41:22.519 INFO:tasks.workunit.client.1.smithi082.stdout:4/956: write d0/d16/d4a/d6a/dd9/f107 [3657801,5087] 0 2024-02-15T22:41:22.520 INFO:tasks.workunit.client.1.smithi082.stdout:4/957: dread - d0/d16/d4a/d6a/f15b zero size 2024-02-15T22:41:22.522 INFO:tasks.workunit.client.1.smithi082.stdout:7/824: mknod d12/d3b/c117 0 2024-02-15T22:41:22.528 INFO:tasks.workunit.client.1.smithi082.stdout:1/734: rename d1/da/d11/d3f/l65 to d1/da/d11/d3f/d75/lee 0 2024-02-15T22:41:22.528 INFO:tasks.workunit.client.1.smithi082.stdout:1/735: chown d1/da/d11/d93/db6/dc5/fce 1830566 1 2024-02-15T22:41:22.528 INFO:tasks.workunit.client.1.smithi082.stdout:1/736: write d1/f1d [1673889,66633] 0 2024-02-15T22:41:22.533 INFO:tasks.workunit.client.1.smithi082.stdout:1/737: creat d1/da/d14/d18/d6d/dc9/fef x:0 0 0 2024-02-15T22:41:22.533 INFO:tasks.workunit.client.1.smithi082.stdout:1/738: chown d1/f4 0 1 2024-02-15T22:41:22.533 INFO:tasks.workunit.client.1.smithi082.stdout:1/739: chown d1/da/d14/d18/d1f/d7a 1674 1 2024-02-15T22:41:22.534 INFO:tasks.workunit.client.1.smithi082.stdout:3/772: write d0/dc/d3f/fbb [3803212,8115] 0 2024-02-15T22:41:22.534 INFO:tasks.workunit.client.1.smithi082.stdout:7/825: unlink d12/d37/d85/c94 0 2024-02-15T22:41:22.537 INFO:tasks.workunit.client.1.smithi082.stdout:3/773: creat d0/d16/d62/d14/d21/d69/dfc/f10a x:0 0 0 2024-02-15T22:41:22.539 INFO:tasks.workunit.client.1.smithi082.stdout:3/774: truncate d0/dc/d3f/f78 656537 0 2024-02-15T22:41:22.539 INFO:tasks.workunit.client.1.smithi082.stdout:3/775: readlink d0/d16/d62/d14/lb8 0 2024-02-15T22:41:22.539 INFO:tasks.workunit.client.1.smithi082.stdout:3/776: fsync d0/dc/d3f/fda 0 2024-02-15T22:41:22.539 INFO:tasks.workunit.client.1.smithi082.stdout:3/777: chown d0/fa9 1487043 1 2024-02-15T22:41:22.540 INFO:tasks.workunit.client.1.smithi082.stdout:3/778: mkdir d0/d16/d3e/d10b 0 2024-02-15T22:41:22.542 INFO:tasks.workunit.client.1.smithi082.stdout:9/797: dwrite d8/f58 [0,4194304] 0 2024-02-15T22:41:22.542 INFO:tasks.workunit.client.1.smithi082.stdout:3/779: mkdir d0/d16/d62/d14/d21/d69/de6/d10c 0 2024-02-15T22:41:22.543 INFO:tasks.workunit.client.1.smithi082.stdout:2/779: dwrite d6/dc/d12/d23/fc8 [0,4194304] 0 2024-02-15T22:41:22.543 INFO:tasks.workunit.client.1.smithi082.stdout:4/958: rename d0/d16/fd5 to d0/d47/da6/da7/f160 0 2024-02-15T22:41:22.543 INFO:tasks.workunit.client.1.smithi082.stdout:1/740: write d1/da/d14/d18/d1f/d7a/ddb/fec [910280,20074] 0 2024-02-15T22:41:22.557 INFO:tasks.workunit.client.1.smithi082.stdout:3/780: write d0/d16/d62/d14/d21/d69/dbe/f104 [8253187,74169] 0 2024-02-15T22:41:22.557 INFO:tasks.workunit.client.1.smithi082.stdout:9/798: symlink d8/d24/d2e/lf8 0 2024-02-15T22:41:22.563 INFO:tasks.workunit.client.1.smithi082.stdout:1/741: creat d1/da/d14/d18/d1f/d7a/dd1/ff0 x:0 0 0 2024-02-15T22:41:22.565 INFO:tasks.workunit.client.1.smithi082.stdout:3/781: truncate d0/dc/f26 2849151 0 2024-02-15T22:41:22.567 INFO:tasks.workunit.client.1.smithi082.stdout:9/799: symlink d8/d24/d2e/lf9 0 2024-02-15T22:41:22.567 INFO:tasks.workunit.client.1.smithi082.stdout:9/800: stat d8/d24/d87/de0/d7c/da1/dc1 0 2024-02-15T22:41:22.567 INFO:tasks.workunit.client.1.smithi082.stdout:9/801: truncate d8/d12/d67/d70/fa0 1048220 0 2024-02-15T22:41:22.567 INFO:tasks.workunit.client.1.smithi082.stdout:9/802: dread - d8/d12/d33/da4/fad zero size 2024-02-15T22:41:22.569 INFO:tasks.workunit.client.1.smithi082.stdout:2/780: dwrite d6/dc/d12/db1/fb8 [0,4194304] 0 2024-02-15T22:41:22.570 INFO:tasks.workunit.client.1.smithi082.stdout:1/742: rename d1/da/d14/d18/d51/fc4 to d1/da/d14/d18/d6d/dc9/ff1 0 2024-02-15T22:41:22.572 INFO:tasks.workunit.client.1.smithi082.stdout:3/782: truncate d0/d16/d62/d14/d21/fa5 1466092 0 2024-02-15T22:41:22.572 INFO:tasks.workunit.client.1.smithi082.stdout:3/783: chown d0/d16/d62/d14/d21/d69/d6c/fd0 136453 1 2024-02-15T22:41:22.575 INFO:tasks.workunit.client.1.smithi082.stdout:9/803: link d8/d24/d87/de0/d77/dc6/fc4 d8/ffa 0 2024-02-15T22:41:22.577 INFO:tasks.workunit.client.1.smithi082.stdout:4/959: dwrite d0/f152 [0,4194304] 0 2024-02-15T22:41:22.585 INFO:tasks.workunit.client.1.smithi082.stdout:3/784: read d0/d16/d62/d79/fd4 [1330248,95949] 0 2024-02-15T22:41:22.594 INFO:tasks.workunit.client.1.smithi082.stdout:2/781: mkdir d6/dc/dd/d24/d71/ded 0 2024-02-15T22:41:22.598 INFO:tasks.workunit.client.1.smithi082.stdout:1/743: link d1/da/d14/d7f/laa d1/da/d11/d3f/d75/lf2 0 2024-02-15T22:41:22.598 INFO:tasks.workunit.client.1.smithi082.stdout:1/744: stat d1/da/d14/c90 0 2024-02-15T22:41:22.598 INFO:tasks.workunit.client.1.smithi082.stdout:1/745: fdatasync d1/da/d11/d8c/f99 0 2024-02-15T22:41:22.599 INFO:tasks.workunit.client.1.smithi082.stdout:9/804: symlink d8/d24/d87/lfb 0 2024-02-15T22:41:22.607 INFO:tasks.workunit.client.1.smithi082.stdout:4/960: symlink d0/dc0/dcd/l161 0 2024-02-15T22:41:22.610 INFO:tasks.workunit.client.1.smithi082.stdout:3/785: symlink d0/d16/d3e/dc5/l10d 0 2024-02-15T22:41:22.611 INFO:tasks.workunit.client.1.smithi082.stdout:9/805: dread d8/f1a [0,4194304] 0 2024-02-15T22:41:22.615 INFO:tasks.workunit.client.1.smithi082.stdout:5/816: sync 2024-02-15T22:41:22.619 INFO:tasks.workunit.client.1.smithi082.stdout:2/782: rename d6/l62 to d6/dc/dd/d21/lee 0 2024-02-15T22:41:22.621 INFO:tasks.workunit.client.1.smithi082.stdout:1/746: readlink d1/da/d14/d18/d51/la6 0 2024-02-15T22:41:22.621 INFO:tasks.workunit.client.1.smithi082.stdout:1/747: chown d1/da/d14/d18/d1f/d7a 38777342 1 2024-02-15T22:41:22.626 INFO:tasks.workunit.client.1.smithi082.stdout:3/786: mkdir d0/d16/d62/d14/d21/d69/d6c/d10e 0 2024-02-15T22:41:22.629 INFO:tasks.workunit.client.1.smithi082.stdout:9/806: link d8/f58 d8/ffc 0 2024-02-15T22:41:22.630 INFO:tasks.workunit.client.1.smithi082.stdout:3/787: dread d0/d16/d62/d14/d71/da2/f9d [0,4194304] 0 2024-02-15T22:41:22.630 INFO:tasks.workunit.client.1.smithi082.stdout:3/788: dread - d0/d16/d62/d14/fe4 zero size 2024-02-15T22:41:22.630 INFO:tasks.workunit.client.1.smithi082.stdout:3/789: read d0/d16/d62/d14/d21/d69/dbe/f104 [2730582,15147] 0 2024-02-15T22:41:22.631 INFO:tasks.workunit.client.1.smithi082.stdout:3/790: creat d0/d16/d3e/d56/f10f x:0 0 0 2024-02-15T22:41:22.631 INFO:tasks.workunit.client.1.smithi082.stdout:3/791: chown d0/d16/d62/d14/d21/d69/d87/f8f 29 1 2024-02-15T22:41:22.631 INFO:tasks.workunit.client.1.smithi082.stdout:3/792: chown d0/d16/d62/l73 29 1 2024-02-15T22:41:22.636 INFO:tasks.workunit.client.1.smithi082.stdout:5/817: mknod d5/da/d14/d45/c112 0 2024-02-15T22:41:22.636 INFO:tasks.workunit.client.1.smithi082.stdout:5/818: getdents d5/da/d14/d53 0 2024-02-15T22:41:22.636 INFO:tasks.workunit.client.1.smithi082.stdout:5/819: write d5/da/d67/f10f [180939,120234] 0 2024-02-15T22:41:22.636 INFO:tasks.workunit.client.1.smithi082.stdout:5/820: dread - d5/da/dc/fdc zero size 2024-02-15T22:41:22.644 INFO:tasks.workunit.client.1.smithi082.stdout:1/748: mknod d1/da/d11/cf3 0 2024-02-15T22:41:22.646 INFO:tasks.workunit.client.1.smithi082.stdout:9/807: rename d8/d24/d87/de0/daf/lee to d8/d24/d87/de0/d7c/lfd 0 2024-02-15T22:41:22.654 INFO:tasks.workunit.client.1.smithi082.stdout:5/821: mkdir d5/da/dc/d113 0 2024-02-15T22:41:22.654 INFO:tasks.workunit.client.1.smithi082.stdout:5/822: creat d5/da/d67/f114 x:0 0 0 2024-02-15T22:41:22.654 INFO:tasks.workunit.client.1.smithi082.stdout:5/823: write d5/da/d67/f10f [782218,81432] 0 2024-02-15T22:41:22.662 INFO:tasks.workunit.client.1.smithi082.stdout:1/749: rename d1/da/d11/d3f/cd5 to d1/da/d14/d18/d1f/d7a/ddb/cf4 0 2024-02-15T22:41:22.662 INFO:tasks.workunit.client.1.smithi082.stdout:3/793: rmdir d0/d16/d62/d14/d21/d69/dbe 39 2024-02-15T22:41:22.662 INFO:tasks.workunit.client.1.smithi082.stdout:3/794: write d0/d16/d62/d14/d21/d69/d6c/fd0 [957725,68590] 0 2024-02-15T22:41:22.670 INFO:tasks.workunit.client.1.smithi082.stdout:5/824: mknod d5/da/d56/d98/c115 0 2024-02-15T22:41:22.670 INFO:tasks.workunit.client.1.smithi082.stdout:5/825: chown d5/da/dc/dad/dcf/d59/c8c 3464 1 2024-02-15T22:41:22.673 INFO:tasks.workunit.client.1.smithi082.stdout:1/750: creat d1/da/d11/d93/db6/ff5 x:0 0 0 2024-02-15T22:41:22.674 INFO:tasks.workunit.client.1.smithi082.stdout:1/751: chown d1/da/d14/d7f 49 1 2024-02-15T22:41:22.681 INFO:tasks.workunit.client.1.smithi082.stdout:1/752: rmdir d1/da/d11/d93 39 2024-02-15T22:41:22.685 INFO:tasks.workunit.client.1.smithi082.stdout:1/753: creat d1/da/d14/d18/d1f/d7a/dd1/ff6 x:0 0 0 2024-02-15T22:41:22.685 INFO:tasks.workunit.client.1.smithi082.stdout:1/754: write d1/d57/f94 [514833,87219] 0 2024-02-15T22:41:22.689 INFO:tasks.workunit.client.1.smithi082.stdout:5/826: dwrite d5/da/d56/f86 [0,4194304] 0 2024-02-15T22:41:22.694 INFO:tasks.workunit.client.1.smithi082.stdout:5/827: rename d5/da/dc/le6 to d5/da/dc/dd5/l116 0 2024-02-15T22:41:22.694 INFO:tasks.workunit.client.1.smithi082.stdout:5/828: fsync d5/da/fc7 0 2024-02-15T22:41:22.695 INFO:tasks.workunit.client.1.smithi082.stdout:5/829: fdatasync d5/f2e 0 2024-02-15T22:41:22.696 INFO:tasks.workunit.client.1.smithi082.stdout:1/755: link d1/d57/f5f d1/da/d14/d18/ff7 0 2024-02-15T22:41:22.696 INFO:tasks.workunit.client.1.smithi082.stdout:1/756: truncate d1/da/d14/d18/d1f/d2f/fb7 120065 0 2024-02-15T22:41:22.696 INFO:tasks.workunit.client.1.smithi082.stdout:1/757: chown d1/d57/c96 100095 1 2024-02-15T22:41:22.700 INFO:tasks.workunit.client.1.smithi082.stdout:5/830: rmdir d5/da/d67/da0 39 2024-02-15T22:41:22.705 INFO:tasks.workunit.client.1.smithi082.stdout:1/758: truncate d1/da/d11/f33 687055 0 2024-02-15T22:41:22.710 INFO:tasks.workunit.client.1.smithi082.stdout:5/831: write d5/da/d67/da0/d92/fc3 [3825002,36597] 0 2024-02-15T22:41:22.710 INFO:tasks.workunit.client.1.smithi082.stdout:1/759: mknod d1/da/d14/d18/d1f/d76/da7/cf8 0 2024-02-15T22:41:22.710 INFO:tasks.workunit.client.1.smithi082.stdout:1/760: write d1/da/d14/d18/d1f/d2f/fa5 [1516744,34549] 0 2024-02-15T22:41:22.717 INFO:tasks.workunit.client.1.smithi082.stdout:5/832: creat d5/da/de3/f117 x:0 0 0 2024-02-15T22:41:22.720 INFO:tasks.workunit.client.1.smithi082.stdout:1/761: link d1/da/d14/d18/d1f/f50 d1/da/d11/d8c/db3/ff9 0 2024-02-15T22:41:22.730 INFO:tasks.workunit.client.1.smithi082.stdout:1/762: rename d1/da/d14/fdf to d1/da/d11/d3f/ffa 0 2024-02-15T22:41:22.732 INFO:tasks.workunit.client.1.smithi082.stdout:1/763: readlink d1/da/d14/d18/d51/l9c 0 2024-02-15T22:41:22.745 INFO:tasks.workunit.client.1.smithi082.stdout:1/764: dwrite d1/da/d11/d3f/d75/fdc [0,4194304] 0 2024-02-15T22:41:22.747 INFO:tasks.workunit.client.1.smithi082.stdout:3/795: read d0/d16/d62/f9f [502673,105960] 0 2024-02-15T22:41:22.753 INFO:tasks.workunit.client.1.smithi082.stdout:1/765: mknod d1/da/d14/d18/d6d/dc2/cfb 0 2024-02-15T22:41:22.765 INFO:tasks.workunit.client.1.smithi082.stdout:3/796: dwrite d0/d16/d62/d79/fd4 [0,4194304] 0 2024-02-15T22:41:22.768 INFO:tasks.workunit.client.1.smithi082.stdout:3/797: rename d0/d16/l10 to d0/d16/d3e/d56/l110 0 2024-02-15T22:41:22.769 INFO:tasks.workunit.client.1.smithi082.stdout:3/798: chown d0/d16/d3e/d56/fb5 132 1 2024-02-15T22:41:22.774 INFO:tasks.workunit.client.1.smithi082.stdout:3/799: link d0/d16/d62/d2e/d84/l9b d0/dc/l111 0 2024-02-15T22:41:22.783 INFO:tasks.workunit.client.1.smithi082.stdout:3/800: dread d0/fed [0,4194304] 0 2024-02-15T22:41:22.783 INFO:tasks.workunit.client.1.smithi082.stdout:3/801: fdatasync d0/d16/d62/f36 0 2024-02-15T22:41:22.790 INFO:tasks.workunit.client.1.smithi082.stdout:6/818: sync 2024-02-15T22:41:22.790 INFO:tasks.workunit.client.1.smithi082.stdout:8/738: sync 2024-02-15T22:41:22.793 INFO:tasks.workunit.client.1.smithi082.stdout:7/826: sync 2024-02-15T22:41:22.793 INFO:tasks.workunit.client.1.smithi082.stdout:0/772: sync 2024-02-15T22:41:22.798 INFO:tasks.workunit.client.1.smithi082.stdout:6/819: link d2/d18/f44 d2/d18/d8a/d47/d72/f10d 0 2024-02-15T22:41:22.799 INFO:tasks.workunit.client.1.smithi082.stdout:6/820: dread d2/d30/da6/fc3 [0,4194304] 0 2024-02-15T22:41:22.802 INFO:tasks.workunit.client.1.smithi082.stdout:8/739: truncate d1/d7/d9/d42/dc5/f79 4042518 0 2024-02-15T22:41:22.806 INFO:tasks.workunit.client.1.smithi082.stdout:9/808: getdents d8/d24/d87/de0/daf 0 2024-02-15T22:41:22.810 INFO:tasks.workunit.client.1.smithi082.stdout:8/740: mkdir d1/d40/dbb/dce/dfc 0 2024-02-15T22:41:22.810 INFO:tasks.workunit.client.1.smithi082.stdout:8/741: truncate d1/d7/d9/d50/d56/dab/fc7 553044 0 2024-02-15T22:41:22.812 INFO:tasks.workunit.client.1.smithi082.stdout:0/773: getdents d3/d19/d25/d80 0 2024-02-15T22:41:22.812 INFO:tasks.workunit.client.1.smithi082.stdout:0/774: dread - d3/d19/d93/dbe/fce zero size 2024-02-15T22:41:22.814 INFO:tasks.workunit.client.1.smithi082.stdout:9/809: truncate d8/f11 253675 0 2024-02-15T22:41:22.814 INFO:tasks.workunit.client.1.smithi082.stdout:9/810: readlink d8/d12/d30/l9a 0 2024-02-15T22:41:22.814 INFO:tasks.workunit.client.1.smithi082.stdout:9/811: fsync d8/db5/fcf 0 2024-02-15T22:41:22.815 INFO:tasks.workunit.client.1.smithi082.stdout:9/812: stat d8/d12/d30/d3c/f93 0 2024-02-15T22:41:22.815 INFO:tasks.workunit.client.1.smithi082.stdout:7/827: dwrite d12/d3b/df9/ffd [0,4194304] 0 2024-02-15T22:41:22.815 INFO:tasks.workunit.client.1.smithi082.stdout:6/821: dwrite d2/d18/d8a/d47/d69/dd0/fd8 [0,4194304] 0 2024-02-15T22:41:22.816 INFO:tasks.workunit.client.1.smithi082.stdout:0/775: creat d3/d19/d20/d7c/dd5/deb/da0/dbc/f110 x:0 0 0 2024-02-15T22:41:22.817 INFO:tasks.workunit.client.1.smithi082.stdout:9/813: getdents d8/d24/d87/de0/d7c 0 2024-02-15T22:41:22.819 INFO:tasks.workunit.client.1.smithi082.stdout:6/822: dread d2/d18/f10b [0,4194304] 0 2024-02-15T22:41:22.828 INFO:tasks.workunit.client.1.smithi082.stdout:0/776: creat d3/d19/d25/d80/f111 x:0 0 0 2024-02-15T22:41:22.829 INFO:tasks.workunit.client.1.smithi082.stdout:7/828: rmdir d12/d3b 39 2024-02-15T22:41:22.830 INFO:tasks.workunit.client.1.smithi082.stdout:7/829: read - d12/d3b/d5a/f92 zero size 2024-02-15T22:41:22.832 INFO:tasks.workunit.client.1.smithi082.stdout:0/777: mknod d3/d19/d20/d7c/dd5/deb/da5/d99/c112 0 2024-02-15T22:41:22.833 INFO:tasks.workunit.client.1.smithi082.stdout:7/830: creat d12/d27/d6e/d6a/db2/f118 x:0 0 0 2024-02-15T22:41:22.833 INFO:tasks.workunit.client.1.smithi082.stdout:7/831: truncate d12/d17/d42/d67/d81/dc0/fe9 125362 0 2024-02-15T22:41:22.835 INFO:tasks.workunit.client.1.smithi082.stdout:0/778: mkdir d3/d19/d20/d7c/dd5/deb/da5/d99/db1/d113 0 2024-02-15T22:41:22.837 INFO:tasks.workunit.client.1.smithi082.stdout:5/833: getdents d5/da/dc/dd5 0 2024-02-15T22:41:22.837 INFO:tasks.workunit.client.1.smithi082.stdout:5/834: read d5/da/f24 [64223,118211] 0 2024-02-15T22:41:22.837 INFO:tasks.workunit.client.1.smithi082.stdout:7/832: dread d12/d3b/d5a/dce/fca [0,4194304] 0 2024-02-15T22:41:22.838 INFO:tasks.workunit.client.1.smithi082.stdout:5/835: rename d5/da/dc/dad/dcf/cb4 to d5/da/dc/dd5/c118 0 2024-02-15T22:41:22.840 INFO:tasks.workunit.client.1.smithi082.stdout:7/833: getdents d12/d27/dc4 0 2024-02-15T22:41:22.844 INFO:tasks.workunit.client.1.smithi082.stdout:4/961: sync 2024-02-15T22:41:22.844 INFO:tasks.workunit.client.1.smithi082.stdout:6/823: dwrite d2/d18/d8a/d65/fd9 [0,4194304] 0 2024-02-15T22:41:22.847 INFO:tasks.workunit.client.1.smithi082.stdout:5/836: rename d5/da/dc/dad/dcf/d59/d84/d89/f9c to d5/da/dc/dd5/f119 0 2024-02-15T22:41:22.847 INFO:tasks.workunit.client.1.smithi082.stdout:5/837: dread - d5/da/d67/f104 zero size 2024-02-15T22:41:22.848 INFO:tasks.workunit.client.1.smithi082.stdout:9/814: dwrite d8/f58 [0,4194304] 0 2024-02-15T22:41:22.848 INFO:tasks.workunit.client.1.smithi082.stdout:9/815: stat d8/f2b 0 2024-02-15T22:41:22.848 INFO:tasks.workunit.client.1.smithi082.stdout:9/816: stat d8/d12/d67/d70/f76 0 2024-02-15T22:41:22.850 INFO:tasks.workunit.client.1.smithi082.stdout:4/962: mkdir d0/d162 0 2024-02-15T22:41:22.850 INFO:tasks.workunit.client.1.smithi082.stdout:4/963: chown d0/d16/f30 368 1 2024-02-15T22:41:22.853 INFO:tasks.workunit.client.1.smithi082.stdout:1/766: getdents d1/da/d14/d18/d1f/d76/da7 0 2024-02-15T22:41:22.853 INFO:tasks.workunit.client.1.smithi082.stdout:0/779: dwrite d3/d19/d1c/f50 [0,4194304] 0 2024-02-15T22:41:22.855 INFO:tasks.workunit.client.1.smithi082.stdout:7/834: unlink d12/d17/d4d/d7d/f9c 0 2024-02-15T22:41:22.856 INFO:tasks.workunit.client.1.smithi082.stdout:2/783: sync 2024-02-15T22:41:22.856 INFO:tasks.workunit.client.1.smithi082.stdout:2/784: chown d6/dc/d12/d23/d6e 461434 1 2024-02-15T22:41:22.863 INFO:tasks.workunit.client.1.smithi082.stdout:4/964: dread d0/d16/f2b [4194304,4194304] 0 2024-02-15T22:41:22.863 INFO:tasks.workunit.client.1.smithi082.stdout:4/965: stat d0/d47/da6/da7/d108/d139 0 2024-02-15T22:41:22.864 INFO:tasks.workunit.client.1.smithi082.stdout:5/838: read d5/da/d67/fc9 [179143,21743] 0 2024-02-15T22:41:22.865 INFO:tasks.workunit.client.1.smithi082.stdout:9/817: creat d8/d12/d67/d70/ffe x:0 0 0 2024-02-15T22:41:22.865 INFO:tasks.workunit.client.1.smithi082.stdout:9/818: stat d8/d12/d30/d3c/d65/f9b 0 2024-02-15T22:41:22.868 INFO:tasks.workunit.client.1.smithi082.stdout:1/767: readlink d1/l26 0 2024-02-15T22:41:22.870 INFO:tasks.workunit.client.1.smithi082.stdout:0/780: truncate d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/f10b 1962019 0 2024-02-15T22:41:22.870 INFO:tasks.workunit.client.1.smithi082.stdout:0/781: readlink d3/d19/d20/d7c/dd5/deb/d92/l105 0 2024-02-15T22:41:22.872 INFO:tasks.workunit.client.1.smithi082.stdout:2/785: unlink d6/dc/dd/d1d/c42 0 2024-02-15T22:41:22.875 INFO:tasks.workunit.client.1.smithi082.stdout:4/966: unlink d0/d8/d1b/ff6 0 2024-02-15T22:41:22.876 INFO:tasks.workunit.client.1.smithi082.stdout:5/839: mkdir d5/da/d67/d11a 0 2024-02-15T22:41:22.877 INFO:tasks.workunit.client.1.smithi082.stdout:9/819: symlink d8/d24/d87/de0/d77/dc6/lff 0 2024-02-15T22:41:22.879 INFO:tasks.workunit.client.1.smithi082.stdout:4/967: dread d0/d16/d4a/d6a/dd9/f107 [0,4194304] 0 2024-02-15T22:41:22.879 INFO:tasks.workunit.client.1.smithi082.stdout:4/968: chown d0/d47/da6/d120/f124 317 1 2024-02-15T22:41:22.879 INFO:tasks.workunit.client.1.smithi082.stdout:4/969: dread - d0/d8/d1b/d70/ffe zero size 2024-02-15T22:41:22.879 INFO:tasks.workunit.client.1.smithi082.stdout:4/970: dread - d0/d47/d4d/f136 zero size 2024-02-15T22:41:22.879 INFO:tasks.workunit.client.1.smithi082.stdout:1/768: mknod d1/da/d11/d93/cfc 0 2024-02-15T22:41:22.879 INFO:tasks.workunit.client.1.smithi082.stdout:6/824: dwrite d2/d18/d39/f88 [0,4194304] 0 2024-02-15T22:41:22.879 INFO:tasks.workunit.client.1.smithi082.stdout:7/835: dwrite d12/d17/f5f [0,4194304] 0 2024-02-15T22:41:22.880 INFO:tasks.workunit.client.1.smithi082.stdout:0/782: creat d3/d19/d20/d7c/dd5/deb/d92/f114 x:0 0 0 2024-02-15T22:41:22.881 INFO:tasks.workunit.client.1.smithi082.stdout:2/786: dread d6/dc/d58/d49/d5e/f60 [0,4194304] 0 2024-02-15T22:41:22.881 INFO:tasks.workunit.client.1.smithi082.stdout:2/787: readlink d6/l80 0 2024-02-15T22:41:22.882 INFO:tasks.workunit.client.1.smithi082.stdout:0/783: dread d3/d19/d20/d7c/dd5/deb/da0/dbc/f10a [0,4194304] 0 2024-02-15T22:41:22.882 INFO:tasks.workunit.client.1.smithi082.stdout:5/840: rename d5/da/d67/dbf/ff2 to d5/d103/f11b 0 2024-02-15T22:41:22.884 INFO:tasks.workunit.client.1.smithi082.stdout:9/820: symlink d8/d24/d87/de0/d8b/d96/l100 0 2024-02-15T22:41:22.884 INFO:tasks.workunit.client.1.smithi082.stdout:9/821: readlink d8/d24/d87/de0/d7c/da1/ld5 0 2024-02-15T22:41:22.884 INFO:tasks.workunit.client.1.smithi082.stdout:9/822: readlink d8/d24/d87/de0/d8b/ldd 0 2024-02-15T22:41:22.887 INFO:tasks.workunit.client.1.smithi082.stdout:1/769: creat d1/da/d14/d18/d1f/ffd x:0 0 0 2024-02-15T22:41:22.891 INFO:tasks.workunit.client.1.smithi082.stdout:5/841: dread d5/da/f26 [0,4194304] 0 2024-02-15T22:41:22.892 INFO:tasks.workunit.client.1.smithi082.stdout:6/825: mkdir d2/d30/d3b/d10e 0 2024-02-15T22:41:22.895 INFO:tasks.workunit.client.1.smithi082.stdout:2/788: mkdir d6/dc/dd/d21/def 0 2024-02-15T22:41:22.897 INFO:tasks.workunit.client.1.smithi082.stdout:0/784: creat d3/d19/d20/d7c/dd5/deb/da5/d99/ddc/f115 x:0 0 0 2024-02-15T22:41:22.897 INFO:tasks.workunit.client.1.smithi082.stdout:0/785: readlink d3/d19/d25/d45/l35 0 2024-02-15T22:41:22.901 INFO:tasks.workunit.client.1.smithi082.stdout:4/971: rename d0/d16/c40 to d0/d8/d1b/d14b/c163 0 2024-02-15T22:41:22.903 INFO:tasks.workunit.client.1.smithi082.stdout:9/823: symlink d8/d12/d67/l101 0 2024-02-15T22:41:22.903 INFO:tasks.workunit.client.1.smithi082.stdout:9/824: chown f5 117560 1 2024-02-15T22:41:22.904 INFO:tasks.workunit.client.1.smithi082.stdout:1/770: mknod d1/da/d11/d93/cfe 0 2024-02-15T22:41:22.912 INFO:tasks.workunit.client.1.smithi082.stdout:5/842: rename d5/da/d67/da0/d92/le8 to d5/da/dc/dad/dcf/d59/da3/l11c 0 2024-02-15T22:41:22.914 INFO:tasks.workunit.client.1.smithi082.stdout:6/826: dwrite d2/d18/d8a/d47/d72/fc7 [0,4194304] 0 2024-02-15T22:41:22.914 INFO:tasks.workunit.client.1.smithi082.stdout:0/786: dwrite d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/ff0 [0,4194304] 0 2024-02-15T22:41:22.915 INFO:tasks.workunit.client.1.smithi082.stdout:9/825: symlink d8/d24/d87/de0/d7c/da1/l102 0 2024-02-15T22:41:22.915 INFO:tasks.workunit.client.1.smithi082.stdout:9/826: write d8/d12/d33/d3e/fb7 [52625,118072] 0 2024-02-15T22:41:22.917 INFO:tasks.workunit.client.1.smithi082.stdout:1/771: dread d1/da/d14/d18/d51/f8e [0,4194304] 0 2024-02-15T22:41:22.917 INFO:tasks.workunit.client.1.smithi082.stdout:1/772: chown d1/da/d14/d7f/c8d 3678116 1 2024-02-15T22:41:22.917 INFO:tasks.workunit.client.1.smithi082.stdout:4/972: creat d0/d16/d87/d10c/d13a/f164 x:0 0 0 2024-02-15T22:41:22.920 INFO:tasks.workunit.client.1.smithi082.stdout:6/827: mkdir d2/d18/d10f 0 2024-02-15T22:41:22.923 INFO:tasks.workunit.client.1.smithi082.stdout:5/843: dread d5/da/d14/d53/f71 [0,4194304] 0 2024-02-15T22:41:22.923 INFO:tasks.workunit.client.1.smithi082.stdout:5/844: chown d5/da/de3/lec 213946 1 2024-02-15T22:41:22.929 INFO:tasks.workunit.client.1.smithi082.stdout:0/787: symlink d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/l116 0 2024-02-15T22:41:22.929 INFO:tasks.workunit.client.1.smithi082.stdout:0/788: fsync d3/d19/d20/d26/f6a 0 2024-02-15T22:41:22.929 INFO:tasks.workunit.client.1.smithi082.stdout:0/789: fsync d3/d19/f2e 0 2024-02-15T22:41:22.929 INFO:tasks.workunit.client.1.smithi082.stdout:0/790: readlink d3/d19/d20/d7c/dd5/la2 0 2024-02-15T22:41:22.934 INFO:tasks.workunit.client.1.smithi082.stdout:5/845: dread d5/da/f3c [0,4194304] 0 2024-02-15T22:41:22.934 INFO:tasks.workunit.client.1.smithi082.stdout:5/846: write d5/da/dc/dad/dcf/d59/d84/d89/fea [1004596,66629] 0 2024-02-15T22:41:22.934 INFO:tasks.workunit.client.1.smithi082.stdout:5/847: write d5/da/dc/dd5/f119 [1007025,81262] 0 2024-02-15T22:41:22.935 INFO:tasks.workunit.client.1.smithi082.stdout:8/742: unlink d1/d7/d9/d42/dc5/f79 0 2024-02-15T22:41:22.939 INFO:tasks.workunit.client.1.smithi082.stdout:5/848: dread d5/da/d67/da0/d92/f9a [0,4194304] 0 2024-02-15T22:41:22.940 INFO:tasks.workunit.client.1.smithi082.stdout:1/773: mknod d1/da/d14/d7f/cff 0 2024-02-15T22:41:22.944 INFO:tasks.workunit.client.1.smithi082.stdout:0/791: rename d3/d19/d20/d7c/dd5/deb/da5/d9c/f100 to d3/d19/d20/d7c/dd5/deb/da5/f117 0 2024-02-15T22:41:22.944 INFO:tasks.workunit.client.1.smithi082.stdout:0/792: chown d3/d19/d20/d7c/dd5/deb/da5/d99/db3/lff 11650 1 2024-02-15T22:41:22.944 INFO:tasks.workunit.client.1.smithi082.stdout:6/828: dwrite d2/d18/d8a/d47/d69/d75/de4/fe8 [0,4194304] 0 2024-02-15T22:41:22.945 INFO:tasks.workunit.client.1.smithi082.stdout:4/973: dwrite d0/fa0 [4194304,4194304] 0 2024-02-15T22:41:22.953 INFO:tasks.workunit.client.1.smithi082.stdout:1/774: unlink d1/da/d14/d18/d1f/d2f/f52 0 2024-02-15T22:41:22.960 INFO:tasks.workunit.client.1.smithi082.stdout:6/829: symlink d2/d45/l110 0 2024-02-15T22:41:22.960 INFO:tasks.workunit.client.1.smithi082.stdout:6/830: fsync d2/d18/d8a/d47/d69/dc1/ff7 0 2024-02-15T22:41:22.960 INFO:tasks.workunit.client.1.smithi082.stdout:6/831: readlink d2/d30/l79 0 2024-02-15T22:41:22.960 INFO:tasks.workunit.client.1.smithi082.stdout:6/832: write d2/d30/ff4 [279100,68147] 0 2024-02-15T22:41:22.960 INFO:tasks.workunit.client.1.smithi082.stdout:6/833: getdents d2/d18/d8a/d84 0 2024-02-15T22:41:22.960 INFO:tasks.workunit.client.1.smithi082.stdout:6/834: creat d2/d18/d23/d67/f111 x:0 0 0 2024-02-15T22:41:22.961 INFO:tasks.workunit.client.1.smithi082.stdout:5/849: rmdir d5/da/dc/dad/dcf/d59/d84 39 2024-02-15T22:41:22.961 INFO:tasks.workunit.client.1.smithi082.stdout:5/850: write d5/da/f40 [560376,32025] 0 2024-02-15T22:41:22.961 INFO:tasks.workunit.client.1.smithi082.stdout:5/851: truncate d5/fe7 635431 0 2024-02-15T22:41:22.962 INFO:tasks.workunit.client.1.smithi082.stdout:8/743: dwrite d1/d7/d9/d50/d56/f9e [0,4194304] 0 2024-02-15T22:41:22.963 INFO:tasks.workunit.client.1.smithi082.stdout:4/974: dwrite d0/d46/df9/f150 [0,4194304] 0 2024-02-15T22:41:22.969 INFO:tasks.workunit.client.1.smithi082.stdout:0/793: write d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/f10b [1794242,126660] 0 2024-02-15T22:41:22.969 INFO:tasks.workunit.client.1.smithi082.stdout:0/794: chown d3/d6b/c78 51 1 2024-02-15T22:41:22.970 INFO:tasks.workunit.client.1.smithi082.stdout:5/852: dread d5/da/d14/d53/f85 [0,4194304] 0 2024-02-15T22:41:22.970 INFO:tasks.workunit.client.1.smithi082.stdout:5/853: truncate d5/da/d67/f114 761400 0 2024-02-15T22:41:22.979 INFO:tasks.workunit.client.1.smithi082.stdout:1/775: mknod d1/da/d11/d93/c100 0 2024-02-15T22:41:22.979 INFO:tasks.workunit.client.1.smithi082.stdout:1/776: chown d1/da/d14/d18/d1f/d7a/dd1/ff6 1 1 2024-02-15T22:41:22.980 INFO:tasks.workunit.client.1.smithi082.stdout:5/854: write d5/da/dc/d43/ff8 [934038,114855] 0 2024-02-15T22:41:22.980 INFO:tasks.workunit.client.1.smithi082.stdout:5/855: readlink d5/da/dc/dad/dcf/d59/da3/lb9 0 2024-02-15T22:41:22.983 INFO:tasks.workunit.client.1.smithi082.stdout:6/835: rename d2/l3a to d2/d45/dc5/l112 0 2024-02-15T22:41:22.993 INFO:tasks.workunit.client.1.smithi082.stdout:8/744: mkdir d1/dfd 0 2024-02-15T22:41:22.996 INFO:tasks.workunit.client.1.smithi082.stdout:1/777: dwrite d1/da/d14/d18/d1f/d76/f92 [0,4194304] 0 2024-02-15T22:41:22.997 INFO:tasks.workunit.client.1.smithi082.stdout:1/778: fdatasync d1/da/d14/d18/d1f/d2f/f95 0 2024-02-15T22:41:23.003 INFO:tasks.workunit.client.1.smithi082.stdout:1/779: dread d1/f4 [0,4194304] 0 2024-02-15T22:41:23.003 INFO:tasks.workunit.client.1.smithi082.stdout:1/780: write d1/da/fd6 [1179394,98216] 0 2024-02-15T22:41:23.009 INFO:tasks.workunit.client.1.smithi082.stdout:8/745: dwrite d1/d7/d9/d24/d43/da6/db6/fd7 [0,4194304] 0 2024-02-15T22:41:23.009 INFO:tasks.workunit.client.1.smithi082.stdout:8/746: write d1/d7/d9/f86 [170840,32730] 0 2024-02-15T22:41:23.009 INFO:tasks.workunit.client.1.smithi082.stdout:8/747: chown d1/d7/de/f80 19 1 2024-02-15T22:41:23.014 INFO:tasks.workunit.client.1.smithi082.stdout:9/827: write d8/d24/d2e/f34 [2405457,12062] 0 2024-02-15T22:41:23.014 INFO:tasks.workunit.client.1.smithi082.stdout:9/828: write d8/d24/d87/de0/d7c/fc9 [603836,10926] 0 2024-02-15T22:41:23.017 INFO:tasks.workunit.client.1.smithi082.stdout:4/975: mknod d0/d16/d4a/dc5/c165 0 2024-02-15T22:41:23.018 INFO:tasks.workunit.client.1.smithi082.stdout:4/976: chown d0/d8/d1b/d70/caf 5 1 2024-02-15T22:41:23.018 INFO:tasks.workunit.client.1.smithi082.stdout:4/977: fdatasync d0/f152 0 2024-02-15T22:41:23.026 INFO:tasks.workunit.client.1.smithi082.stdout:1/781: dwrite d1/da/d14/f8b [0,4194304] 0 2024-02-15T22:41:23.032 INFO:tasks.workunit.client.1.smithi082.stdout:5/856: mkdir d5/d102/d11d 0 2024-02-15T22:41:23.032 INFO:tasks.workunit.client.1.smithi082.stdout:5/857: chown d5/da/de3/de9/f109 3 1 2024-02-15T22:41:23.036 INFO:tasks.workunit.client.1.smithi082.stdout:0/795: rename d3/d19/d20/d7c/dd5/deb/da5/ca4 to d3/d19/d20/d7c/dd5/deb/c118 0 2024-02-15T22:41:23.038 INFO:tasks.workunit.client.1.smithi082.stdout:0/796: dread d3/d19/d20/d7c/dd5/deb/da0/dbc/f10a [0,4194304] 0 2024-02-15T22:41:23.040 INFO:tasks.workunit.client.1.smithi082.stdout:3/802: sync 2024-02-15T22:41:23.042 INFO:tasks.workunit.client.1.smithi082.stdout:8/748: creat d1/d7/d48/ffe x:0 0 0 2024-02-15T22:41:23.042 INFO:tasks.workunit.client.1.smithi082.stdout:8/749: chown d1/d7/d78 1851890 1 2024-02-15T22:41:23.042 INFO:tasks.workunit.client.1.smithi082.stdout:8/750: dread - d1/d7/d48/d6f/faf zero size 2024-02-15T22:41:23.044 INFO:tasks.workunit.client.1.smithi082.stdout:4/978: link d0/d47/da6/da7/lfb d0/dc0/dcd/d138/l166 0 2024-02-15T22:41:23.046 INFO:tasks.workunit.client.1.smithi082.stdout:4/979: write d0/d16/d4a/d6a/fbb [4484372,14431] 0 2024-02-15T22:41:23.049 INFO:tasks.workunit.client.1.smithi082.stdout:4/980: dread d0/d16/d4a/d6a/dd9/f107 [0,4194304] 0 2024-02-15T22:41:23.049 INFO:tasks.workunit.client.1.smithi082.stdout:8/751: dread d1/d7/d9/d42/d6a/da5/dd4/dd8/fe8 [0,4194304] 0 2024-02-15T22:41:23.052 INFO:tasks.workunit.client.1.smithi082.stdout:1/782: symlink d1/da/d11/d93/db6/l101 0 2024-02-15T22:41:23.054 INFO:tasks.workunit.client.1.smithi082.stdout:5/858: truncate d5/da/dc/f3d 79273 0 2024-02-15T22:41:23.057 INFO:tasks.workunit.client.1.smithi082.stdout:3/803: dwrite d0/d16/d62/d14/d21/fef [0,4194304] 0 2024-02-15T22:41:23.057 INFO:tasks.workunit.client.1.smithi082.stdout:3/804: chown d0/d16/d62/d14/d21/d69/d91/fa1 10842687 1 2024-02-15T22:41:23.058 INFO:tasks.workunit.client.1.smithi082.stdout:6/836: rename d2/d45/c93 to d2/d30/c113 0 2024-02-15T22:41:23.058 INFO:tasks.workunit.client.1.smithi082.stdout:6/837: write d2/d18/f44 [1405697,11249] 0 2024-02-15T22:41:23.062 INFO:tasks.workunit.client.1.smithi082.stdout:0/797: symlink d3/d19/d20/d7c/dd5/l119 0 2024-02-15T22:41:23.065 INFO:tasks.workunit.client.1.smithi082.stdout:7/836: sync 2024-02-15T22:41:23.067 INFO:tasks.workunit.client.1.smithi082.stdout:3/805: write d0/d16/d62/d14/d21/fef [2353304,23794] 0 2024-02-15T22:41:23.067 INFO:tasks.workunit.client.1.smithi082.stdout:5/859: read d5/da/ffb [2164752,756] 0 2024-02-15T22:41:23.067 INFO:tasks.workunit.client.1.smithi082.stdout:1/783: dwrite d1/da/d14/d18/d1f/d2f/fb7 [0,4194304] 0 2024-02-15T22:41:23.073 INFO:tasks.workunit.client.1.smithi082.stdout:9/829: rename d8/d12/dc5/fa5 to d8/d12/d33/da4/f103 0 2024-02-15T22:41:23.074 INFO:tasks.workunit.client.1.smithi082.stdout:1/784: write d1/da/d14/d18/d51/f8e [1341164,29281] 0 2024-02-15T22:41:23.076 INFO:tasks.workunit.client.1.smithi082.stdout:1/785: read d1/da/d11/d93/db6/dc5/fd7 [99306,95573] 0 2024-02-15T22:41:23.081 INFO:tasks.workunit.client.1.smithi082.stdout:2/789: sync 2024-02-15T22:41:23.082 INFO:tasks.workunit.client.1.smithi082.stdout:6/838: mknod d2/d18/d23/c114 0 2024-02-15T22:41:23.086 INFO:tasks.workunit.client.1.smithi082.stdout:0/798: creat d3/d6b/dac/f11a x:0 0 0 2024-02-15T22:41:23.089 INFO:tasks.workunit.client.1.smithi082.stdout:7/837: truncate d12/d27/d74/fd1 372001 0 2024-02-15T22:41:23.091 INFO:tasks.workunit.client.1.smithi082.stdout:3/806: symlink d0/d16/d62/d14/d21/d69/d6c/l112 0 2024-02-15T22:41:23.095 INFO:tasks.workunit.client.1.smithi082.stdout:5/860: creat d5/da/de3/de9/dfa/f11e x:0 0 0 2024-02-15T22:41:23.095 INFO:tasks.workunit.client.1.smithi082.stdout:5/861: fdatasync d5/da/d14/fe1 0 2024-02-15T22:41:23.096 INFO:tasks.workunit.client.1.smithi082.stdout:3/807: write d0/dc/f26 [1456727,8161] 0 2024-02-15T22:41:23.096 INFO:tasks.workunit.client.1.smithi082.stdout:3/808: stat d0/d16/d62/d14/d21/d69/d6c/fd0 0 2024-02-15T22:41:23.098 INFO:tasks.workunit.client.1.smithi082.stdout:5/862: dread d5/da/dc/dad/dcf/f3f [0,4194304] 0 2024-02-15T22:41:23.108 INFO:tasks.workunit.client.1.smithi082.stdout:4/981: rename d0/d47/dd8/fe6 to d0/dc0/dcd/de3/d12d/f167 0 2024-02-15T22:41:23.108 INFO:tasks.workunit.client.1.smithi082.stdout:4/982: fsync d0/d8/d1b/dd/d37/d133/f135 0 2024-02-15T22:41:23.110 INFO:tasks.workunit.client.1.smithi082.stdout:7/838: dwrite d12/d17/d3d/f59 [4194304,4194304] 0 2024-02-15T22:41:23.110 INFO:tasks.workunit.client.1.smithi082.stdout:7/839: creat d12/d3b/d5a/f119 x:0 0 0 2024-02-15T22:41:23.110 INFO:tasks.workunit.client.1.smithi082.stdout:7/840: chown d12/d17/d3d/f55 8 1 2024-02-15T22:41:23.113 INFO:tasks.workunit.client.1.smithi082.stdout:1/786: mkdir d1/da/d11/d93/d102 0 2024-02-15T22:41:23.113 INFO:tasks.workunit.client.1.smithi082.stdout:1/787: fdatasync d1/da/d14/d18/d6d/dc9/fd3 0 2024-02-15T22:41:23.123 INFO:tasks.workunit.client.1.smithi082.stdout:2/790: mknod d6/dc/dd/d1d/cf0 0 2024-02-15T22:41:23.123 INFO:tasks.workunit.client.1.smithi082.stdout:2/791: fsync d6/dc/d12/f74 0 2024-02-15T22:41:23.123 INFO:tasks.workunit.client.1.smithi082.stdout:2/792: fsync d6/dc/d58/d49/db6/fd8 0 2024-02-15T22:41:23.123 INFO:tasks.workunit.client.1.smithi082.stdout:4/983: dwrite d0/f31 [0,4194304] 0 2024-02-15T22:41:23.129 INFO:tasks.workunit.client.1.smithi082.stdout:6/839: mkdir d2/d18/d10f/d115 0 2024-02-15T22:41:23.130 INFO:tasks.workunit.client.1.smithi082.stdout:6/840: write d2/d30/ff4 [1522609,9611] 0 2024-02-15T22:41:23.130 INFO:tasks.workunit.client.1.smithi082.stdout:6/841: chown d2/d18/d8a/d47/d72/d80/fb4 14186 1 2024-02-15T22:41:23.131 INFO:tasks.workunit.client.1.smithi082.stdout:0/799: symlink d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/l11b 0 2024-02-15T22:41:23.139 INFO:tasks.workunit.client.1.smithi082.stdout:3/809: getdents d0/d16 0 2024-02-15T22:41:23.141 INFO:tasks.workunit.client.1.smithi082.stdout:5/863: symlink d5/da/d67/l11f 0 2024-02-15T22:41:23.151 INFO:tasks.workunit.client.1.smithi082.stdout:3/810: read d0/d16/d3e/f5f [3918797,84832] 0 2024-02-15T22:41:23.154 INFO:tasks.workunit.client.1.smithi082.stdout:0/800: dwrite d3/d19/d20/d7c/dd5/deb/da5/d99/ddc/f115 [0,4194304] 0 2024-02-15T22:41:23.154 INFO:tasks.workunit.client.1.smithi082.stdout:0/801: readlink d3/d19/d20/d7c/dd5/lec 0 2024-02-15T22:41:23.155 INFO:tasks.workunit.client.1.smithi082.stdout:1/788: getdents d1/da/d14/d18/d1f/d7a 0 2024-02-15T22:41:23.155 INFO:tasks.workunit.client.1.smithi082.stdout:1/789: truncate d1/da/d14/d18/d1f/f66 556583 0 2024-02-15T22:41:23.155 INFO:tasks.workunit.client.1.smithi082.stdout:1/790: creat d1/da/d14/d18/d6d/dc9/f103 x:0 0 0 2024-02-15T22:41:23.158 INFO:tasks.workunit.client.1.smithi082.stdout:4/984: link d0/d47/d4d/f136 d0/d47/da6/da7/f168 0 2024-02-15T22:41:23.158 INFO:tasks.workunit.client.1.smithi082.stdout:4/985: write d0/d8/d1b/dd/daa/f10f [854,4751] 0 2024-02-15T22:41:23.162 INFO:tasks.workunit.client.1.smithi082.stdout:5/864: dwrite d5/da/dc/f15 [0,4194304] 0 2024-02-15T22:41:23.162 INFO:tasks.workunit.client.1.smithi082.stdout:5/865: write d5/da/dc/fdc [167187,84965] 0 2024-02-15T22:41:23.163 INFO:tasks.workunit.client.1.smithi082.stdout:6/842: mkdir d2/d18/d8a/d47/d116 0 2024-02-15T22:41:23.168 INFO:tasks.workunit.client.1.smithi082.stdout:1/791: dread d1/da/d14/d18/d6d/fd8 [0,4194304] 0 2024-02-15T22:41:23.184 INFO:tasks.workunit.client.1.smithi082.stdout:8/752: rename d1/d7/d9/d24/d43 to d1/d40/dbb/dff 0 2024-02-15T22:41:23.184 INFO:tasks.workunit.client.1.smithi082.stdout:8/753: dread - d1/d40/f6d zero size 2024-02-15T22:41:23.187 INFO:tasks.workunit.client.1.smithi082.stdout:4/986: unlink d0/d8/d32/c60 0 2024-02-15T22:41:23.190 INFO:tasks.workunit.client.1.smithi082.stdout:5/866: link d5/dd8/ffd d5/d103/f120 0 2024-02-15T22:41:23.190 INFO:tasks.workunit.client.1.smithi082.stdout:5/867: fdatasync d5/dd8/f10b 0 2024-02-15T22:41:23.190 INFO:tasks.workunit.client.1.smithi082.stdout:5/868: write d5/da/de3/de9/dfa/f11e [614332,118931] 0 2024-02-15T22:41:23.193 INFO:tasks.workunit.client.1.smithi082.stdout:6/843: link d2/d30/da6/fc3 d2/d18/d8a/d47/d69/d75/f117 0 2024-02-15T22:41:23.195 INFO:tasks.workunit.client.1.smithi082.stdout:1/792: creat d1/da/d11/d8c/db3/f104 x:0 0 0 2024-02-15T22:41:23.202 INFO:tasks.workunit.client.1.smithi082.stdout:3/811: mkdir d0/dc/d113 0 2024-02-15T22:41:23.206 INFO:tasks.workunit.client.1.smithi082.stdout:7/841: rename d12/d3b/d5a/lfb to d12/d27/dc4/l11a 0 2024-02-15T22:41:23.207 INFO:tasks.workunit.client.1.smithi082.stdout:8/754: mknod d1/d7/d9/d42/d6a/c100 0 2024-02-15T22:41:23.208 INFO:tasks.workunit.client.1.smithi082.stdout:8/755: creat d1/d7/d48/f101 x:0 0 0 2024-02-15T22:41:23.208 INFO:tasks.workunit.client.1.smithi082.stdout:8/756: read - d1/d7/d9/d42/ff3 zero size 2024-02-15T22:41:23.208 INFO:tasks.workunit.client.1.smithi082.stdout:8/757: chown d1/d40/dbb/dff/fb5 15 1 2024-02-15T22:41:23.210 INFO:tasks.workunit.client.1.smithi082.stdout:3/812: truncate d0/d16/d62/f90 3811671 0 2024-02-15T22:41:23.213 INFO:tasks.workunit.client.1.smithi082.stdout:5/869: rename d5/da/de3/de9/fee to d5/da/f121 0 2024-02-15T22:41:23.214 INFO:tasks.workunit.client.1.smithi082.stdout:7/842: creat d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/f11b x:0 0 0 2024-02-15T22:41:23.214 INFO:tasks.workunit.client.1.smithi082.stdout:7/843: dread - d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/df5/f10b zero size 2024-02-15T22:41:23.218 INFO:tasks.workunit.client.1.smithi082.stdout:8/758: mknod d1/d7/d9/d42/d6a/da5/ddd/c102 0 2024-02-15T22:41:23.218 INFO:tasks.workunit.client.1.smithi082.stdout:8/759: readlink d1/d7/d9/d24/l59 0 2024-02-15T22:41:23.218 INFO:tasks.workunit.client.1.smithi082.stdout:8/760: chown d1/d7/d9/d42/f46 5332 1 2024-02-15T22:41:23.218 INFO:tasks.workunit.client.1.smithi082.stdout:8/761: chown d1/f18 20 1 2024-02-15T22:41:23.218 INFO:tasks.workunit.client.1.smithi082.stdout:7/844: dread d12/d27/d74/f82 [0,4194304] 0 2024-02-15T22:41:23.219 INFO:tasks.workunit.client.1.smithi082.stdout:7/845: truncate d12/d3b/d5a/dce/fca 1288993 0 2024-02-15T22:41:23.219 INFO:tasks.workunit.client.1.smithi082.stdout:7/846: stat d12/d27/d6e/l73 0 2024-02-15T22:41:23.220 INFO:tasks.workunit.client.1.smithi082.stdout:3/813: unlink d0/d16/d62/d14/fb7 0 2024-02-15T22:41:23.220 INFO:tasks.workunit.client.1.smithi082.stdout:3/814: chown d0/d16/d62/d14/c1b 0 1 2024-02-15T22:41:23.222 INFO:tasks.workunit.client.1.smithi082.stdout:5/870: mknod d5/da/d14/c122 0 2024-02-15T22:41:23.223 INFO:tasks.workunit.client.1.smithi082.stdout:8/762: link d1/d7/d9/l77 d1/d7/d48/l103 0 2024-02-15T22:41:23.224 INFO:tasks.workunit.client.1.smithi082.stdout:6/844: dwrite d2/d45/fb3 [0,4194304] 0 2024-02-15T22:41:23.224 INFO:tasks.workunit.client.1.smithi082.stdout:6/845: read - d2/d18/d8a/d47/d72/fe3 zero size 2024-02-15T22:41:23.224 INFO:tasks.workunit.client.1.smithi082.stdout:6/846: chown d2/d18/d8a/d47/d69 51880 1 2024-02-15T22:41:23.224 INFO:tasks.workunit.client.1.smithi082.stdout:4/987: dwrite d0/fa8 [0,4194304] 0 2024-02-15T22:41:23.224 INFO:tasks.workunit.client.1.smithi082.stdout:1/793: dwrite d1/da/f24 [0,4194304] 0 2024-02-15T22:41:23.225 INFO:tasks.workunit.client.1.smithi082.stdout:1/794: truncate d1/da/d14/d18/d1f/d7a/dd1/ff6 71802 0 2024-02-15T22:41:23.225 INFO:tasks.workunit.client.1.smithi082.stdout:1/795: fdatasync d1/da/d11/f48 0 2024-02-15T22:41:23.225 INFO:tasks.workunit.client.1.smithi082.stdout:1/796: dread - d1/da/d14/d18/d1f/f9b zero size 2024-02-15T22:41:23.225 INFO:tasks.workunit.client.1.smithi082.stdout:7/847: mkdir d12/d17/d42/d67/d11c 0 2024-02-15T22:41:23.225 INFO:tasks.workunit.client.1.smithi082.stdout:7/848: creat d12/d3b/d5a/f11d x:0 0 0 2024-02-15T22:41:23.230 INFO:tasks.workunit.client.1.smithi082.stdout:3/815: dread d0/dc/d3f/fbb [0,4194304] 0 2024-02-15T22:41:23.230 INFO:tasks.workunit.client.1.smithi082.stdout:5/871: truncate d5/da/dc/dad/dcf/f2d 1042120 0 2024-02-15T22:41:23.230 INFO:tasks.workunit.client.1.smithi082.stdout:5/872: creat d5/da/dc/d43/f123 x:0 0 0 2024-02-15T22:41:23.240 INFO:tasks.workunit.client.1.smithi082.stdout:7/849: dread d12/d3b/f44 [0,4194304] 0 2024-02-15T22:41:23.243 INFO:tasks.workunit.client.1.smithi082.stdout:8/763: dwrite d1/d40/dbb/dce/fd9 [0,4194304] 0 2024-02-15T22:41:23.244 INFO:tasks.workunit.client.1.smithi082.stdout:5/873: dwrite d5/da/dc/dad/dcf/d59/d84/fd2 [0,4194304] 0 2024-02-15T22:41:23.244 INFO:tasks.workunit.client.1.smithi082.stdout:5/874: readlink d5/da/d14/lef 0 2024-02-15T22:41:23.245 INFO:tasks.workunit.client.1.smithi082.stdout:5/875: write d5/da/dc/d43/ff4 [257639,15222] 0 2024-02-15T22:41:23.248 INFO:tasks.workunit.client.1.smithi082.stdout:4/988: symlink d0/d8/d1b/dd/d37/dfa/l169 0 2024-02-15T22:41:23.251 INFO:tasks.workunit.client.1.smithi082.stdout:9/830: sync 2024-02-15T22:41:23.251 INFO:tasks.workunit.client.1.smithi082.stdout:9/831: creat d8/d24/d87/de0/f104 x:0 0 0 2024-02-15T22:41:23.260 INFO:tasks.workunit.client.1.smithi082.stdout:6/847: rename d2/d18/d8a/d84 to d2/d18/d8a/d47/d72/d80/d118 0 2024-02-15T22:41:23.271 INFO:tasks.workunit.client.1.smithi082.stdout:3/816: symlink d0/d16/d62/d14/d71/l114 0 2024-02-15T22:41:23.292 INFO:tasks.workunit.client.1.smithi082.stdout:8/764: unlink d1/d7/de/d1e/fd1 0 2024-02-15T22:41:23.292 INFO:tasks.workunit.client.1.smithi082.stdout:8/765: chown d1/d7/l3b 35 1 2024-02-15T22:41:23.293 INFO:tasks.workunit.client.1.smithi082.stdout:3/817: dwrite d0/d16/d62/d14/d21/d7d/f9a [0,4194304] 0 2024-02-15T22:41:23.296 INFO:tasks.workunit.client.1.smithi082.stdout:2/793: sync 2024-02-15T22:41:23.301 INFO:tasks.workunit.client.1.smithi082.stdout:5/876: symlink d5/da/dc/dad/dcf/l124 0 2024-02-15T22:41:23.306 INFO:tasks.workunit.client.1.smithi082.stdout:4/989: creat d0/d8/d1b/dd/d37/d133/f16a x:0 0 0 2024-02-15T22:41:23.307 INFO:tasks.workunit.client.1.smithi082.stdout:7/850: write d12/d3b/d5a/fb7 [1089158,130254] 0 2024-02-15T22:41:23.307 INFO:tasks.workunit.client.1.smithi082.stdout:7/851: write d12/d27/d6e/d6a/d9e/dbe/dcb/d114/f60 [2523492,121863] 0 2024-02-15T22:41:23.311 INFO:tasks.workunit.client.1.smithi082.stdout:9/832: symlink d8/d24/d87/de0/d77/dc6/l105 0 2024-02-15T22:41:23.311 INFO:tasks.workunit.client.1.smithi082.stdout:0/802: sync 2024-02-15T22:41:23.315 INFO:tasks.workunit.client.1.smithi082.stdout:1/797: dwrite d1/da/d11/f33 [0,4194304] 0 2024-02-15T22:41:23.316 INFO:tasks.workunit.client.1.smithi082.stdout:6/848: truncate d2/d18/d8a/d47/d72/f78 481960 0 2024-02-15T22:41:23.318 INFO:tasks.workunit.client.1.smithi082.stdout:8/766: mkdir d1/d40/dbb/dff/da6/db6/d104 0 2024-02-15T22:41:23.333 INFO:tasks.workunit.client.1.smithi082.stdout:2/794: creat d6/dc/d12/d23/d6e/ff1 x:0 0 0 2024-02-15T22:41:23.336 INFO:tasks.workunit.client.1.smithi082.stdout:4/990: dwrite d0/d8/d1b/dd/f57 [0,4194304] 0 2024-02-15T22:41:23.336 INFO:tasks.workunit.client.1.smithi082.stdout:5/877: rename d5/da/f65 to d5/da/dc/dad/dcf/d59/d84/d89/f125 0 2024-02-15T22:41:23.336 INFO:tasks.workunit.client.1.smithi082.stdout:5/878: creat d5/da/dc/d43/f126 x:0 0 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:5/879: write d5/da/f121 [1009828,125839] 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:5/880: truncate d5/d103/fb3 553994 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:4/991: read d0/d47/d4d/fd1 [789544,87893] 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:4/992: truncate d0/d16/d4a/d6a/f156 510295 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:4/993: write d0/f2 [8777469,51176] 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:4/994: dread - d0/dc0/dcd/de3/f122 zero size 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:7/852: getdents d12/d37/dbd 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:8/767: dwrite d1/d40/dbb/dff/da6/db8/ff9 [0,4194304] 0 2024-02-15T22:41:23.337 INFO:tasks.workunit.client.1.smithi082.stdout:8/768: creat d1/d7/d9/d42/f105 x:0 0 0 2024-02-15T22:41:23.347 INFO:tasks.workunit.client.1.smithi082.stdout:7/853: dread d12/d17/f1a [0,4194304] 0 2024-02-15T22:41:23.347 INFO:tasks.workunit.client.1.smithi082.stdout:7/854: write d12/d37/f70 [6257286,126081] 0 2024-02-15T22:41:23.348 INFO:tasks.workunit.client.1.smithi082.stdout:6/849: getdents d2/d18/d8a/d47/d69 0 2024-02-15T22:41:23.348 INFO:tasks.workunit.client.1.smithi082.stdout:6/850: read d2/d18/d8a/d47/f54 [823819,95757] 0 2024-02-15T22:41:23.348 INFO:tasks.workunit.client.1.smithi082.stdout:6/851: fsync d2/d18/d8a/d47/d69/d75/f9a 0 2024-02-15T22:41:23.349 INFO:tasks.workunit.client.1.smithi082.stdout:6/852: fdatasync d2/d18/d8a/d47/f7b 0 2024-02-15T22:41:23.355 INFO:tasks.workunit.client.1.smithi082.stdout:3/818: mkdir d0/dc/d3f/d115 0 2024-02-15T22:41:23.359 INFO:tasks.workunit.client.1.smithi082.stdout:2/795: symlink d6/dc/dd/d24/d71/dcb/lf2 0 2024-02-15T22:41:23.362 INFO:tasks.workunit.client.1.smithi082.stdout:9/833: rename d8/d12/d30/f3d to d8/db5/f106 0 2024-02-15T22:41:23.363 INFO:tasks.workunit.client.1.smithi082.stdout:9/834: getdents d8/d24/d87/de0/d77/dc6/de6 0 2024-02-15T22:41:23.365 INFO:tasks.workunit.client.1.smithi082.stdout:6/853: dwrite d2/d18/d8a/d65/f7f [0,4194304] 0 2024-02-15T22:41:23.365 INFO:tasks.workunit.client.1.smithi082.stdout:2/796: dread d6/d18/f4c [0,4194304] 0 2024-02-15T22:41:23.365 INFO:tasks.workunit.client.1.smithi082.stdout:6/854: write d2/d18/d8a/d65/fcf [2267755,90937] 0 2024-02-15T22:41:23.366 INFO:tasks.workunit.client.1.smithi082.stdout:2/797: write d6/dc/d58/f17 [603265,83802] 0 2024-02-15T22:41:23.366 INFO:tasks.workunit.client.1.smithi082.stdout:2/798: write d6/f7 [4321694,33595] 0 2024-02-15T22:41:23.367 INFO:tasks.workunit.client.1.smithi082.stdout:5/881: mknod d5/da/d67/dbf/c127 0 2024-02-15T22:41:23.370 INFO:tasks.workunit.client.1.smithi082.stdout:4/995: mkdir d0/d47/d4d/d16b 0 2024-02-15T22:41:23.375 INFO:tasks.workunit.client.1.smithi082.stdout:6/855: dread d2/d18/d8a/da7/fdd [0,4194304] 0 2024-02-15T22:41:23.380 INFO:tasks.workunit.client.1.smithi082.stdout:8/769: creat d1/d7/d9/d42/d6a/da5/ddd/f106 x:0 0 0 2024-02-15T22:41:23.380 INFO:tasks.workunit.client.1.smithi082.stdout:8/770: chown d1/d40/dbb/dff/fb5 751384 1 2024-02-15T22:41:23.380 INFO:tasks.workunit.client.1.smithi082.stdout:8/771: chown d1/d7/d9/d42/d6a/cc9 17484639 1 2024-02-15T22:41:23.383 INFO:tasks.workunit.client.1.smithi082.stdout:5/882: dread d5/da/dc/dad/dcf/d59/f95 [0,4194304] 0 2024-02-15T22:41:23.383 INFO:tasks.workunit.client.1.smithi082.stdout:5/883: chown d5/lc0 13481871 1 2024-02-15T22:41:23.383 INFO:tasks.workunit.client.1.smithi082.stdout:5/884: chown d5/fca 34509933 1 2024-02-15T22:41:23.387 INFO:tasks.workunit.client.1.smithi082.stdout:7/855: creat d12/d27/d6e/d6a/d9e/dbe/dcb/d114/dfe/f11e x:0 0 0 2024-02-15T22:41:23.392 INFO:tasks.workunit.client.1.smithi082.stdout:1/798: rename d1/da/d11/d3f/c4b to d1/da/d14/d18/d1f/d76/da7/c105 0 2024-02-15T22:41:23.393 INFO:tasks.workunit.client.1.smithi082.stdout:2/799: dwrite d6/dc/dd/f8a [0,4194304] 0 2024-02-15T22:41:23.393 INFO:tasks.workunit.client.1.smithi082.stdout:2/800: truncate d6/dc/d58/d49/d5e/d67/fea 407460 0 2024-02-15T22:41:23.400 INFO:tasks.workunit.client.1.smithi082.stdout:9/835: mknod d8/d24/d87/de0/daf/c107 0 2024-02-15T22:41:23.402 INFO:tasks.workunit.client.1.smithi082.stdout:4/996: mkdir d0/d47/ddf/d16c 0 2024-02-15T22:41:23.403 INFO:tasks.workunit.client.1.smithi082.stdout:7/856: dread d12/d17/d42/d67/d79/fd2 [0,4194304] 0 2024-02-15T22:41:23.403 INFO:tasks.workunit.client.1.smithi082.stdout:6/856: creat d2/d18/d8a/d47/d69/dc1/ded/f119 x:0 0 0 2024-02-15T22:41:23.403 INFO:tasks.workunit.client.1.smithi082.stdout:8/772: mkdir d1/d7/d9/d24/d30/d75/d107 0 2024-02-15T22:41:23.403 INFO:tasks.workunit.client.1.smithi082.stdout:8/773: write d1/d40/dbb/dff/da6/db6/dca/f90 [910653,126527] 0 2024-02-15T22:41:23.404 INFO:tasks.workunit.client.1.smithi082.stdout:5/885: rmdir d5/d102 39 2024-02-15T22:41:23.404 INFO:tasks.workunit.client.1.smithi082.stdout:3/819: rename d0/d16/l2f to d0/d16/d3e/l116 0 2024-02-15T22:41:23.404 INFO:tasks.workunit.client.1.smithi082.stdout:3/820: fdatasync d0/d16/d62/d14/d21/d7d/f9a 0 2024-02-15T22:41:23.404 INFO:tasks.workunit.client.1.smithi082.stdout:5/886: dread d5/da/d14/f97 [0,4194304] 0 2024-02-15T22:41:23.405 INFO:tasks.workunit.client.1.smithi082.stdout:5/887: fsync d5/da/d67/da0/fc6 0 2024-02-15T22:41:23.406 INFO:tasks.workunit.client.1.smithi082.stdout:1/799: symlink d1/da/d14/d18/d6d/dc2/l106 0 2024-02-15T22:41:23.421 INFO:tasks.workunit.client.1.smithi082.stdout:2/801: getdents d6/dc/d12/d46 0 2024-02-15T22:41:23.421 INFO:tasks.workunit.client.1.smithi082.stdout:9/836: getdents d8/d12/d30/d3c 0 2024-02-15T22:41:23.421 INFO:tasks.workunit.client.1.smithi082.stdout:9/837: getdents d8/d24/d87/de0/d7c/da1/dc1 0 2024-02-15T22:41:23.425 INFO:tasks.workunit.client.1.smithi082.stdout:4/997: creat d0/dc0/dcd/dcf/f16d x:0 0 0 2024-02-15T22:41:23.433 INFO:tasks.workunit.client.1.smithi082.stdout:6/857: symlink d2/d30/da6/l11a 0 2024-02-15T22:41:23.433 INFO:tasks.workunit.client.1.smithi082.stdout:7/857: dwrite d12/d37/d85/f105 [0,4194304] 0 2024-02-15T22:41:23.436 INFO:tasks.workunit.client.1.smithi082.stdout:6/858: dread d2/d18/d8a/d47/f7b [0,4194304] 0 2024-02-15T22:41:23.448 INFO:tasks.workunit.client.1.smithi082.stdout:1/800: rmdir d1/da/d14/d18/d1f/d7a/dd1 39 2024-02-15T22:41:23.448 INFO:tasks.workunit.client.1.smithi082.stdout:1/801: fsync d1/da/d14/d18/d6d/f6f 0 2024-02-15T22:41:23.449 INFO:tasks.workunit.client.1.smithi082.stdout:8/774: dwrite d1/d7/d9/d42/ff3 [0,4194304] 0 2024-02-15T22:41:23.449 INFO:tasks.workunit.client.1.smithi082.stdout:8/775: write d1/d40/f6d [152082,85533] 0 2024-02-15T22:41:23.450 INFO:tasks.workunit.client.1.smithi082.stdout:9/838: getdents d8/d24/d87/de0/d77/dab 0 2024-02-15T22:41:23.450 INFO:tasks.workunit.client.1.smithi082.stdout:9/839: chown d8/f2c 1755142676 1 2024-02-15T22:41:23.451 INFO:tasks.workunit.client.1.smithi082.stdout:2/802: dwrite d6/dc/d58/d49/d5e/d67/fea [0,4194304] 0 2024-02-15T22:41:23.452 INFO:tasks.workunit.client.1.smithi082.stdout:2/803: creat d6/dc/d58/d49/d5e/d67/ff3 x:0 0 0 2024-02-15T22:41:23.452 INFO:tasks.workunit.client.1.smithi082.stdout:2/804: chown d6/dc/dd/f9a 32 1 2024-02-15T22:41:23.452 INFO:tasks.workunit.client.1.smithi082.stdout:7/858: write d12/d27/f6d [1314204,14471] 0 2024-02-15T22:41:23.452 INFO:tasks.workunit.client.1.smithi082.stdout:5/888: dwrite d5/da/dc/dad/dcf/d59/d84/d89/f125 [0,4194304] 0 2024-02-15T22:41:23.452 INFO:tasks.workunit.client.1.smithi082.stdout:5/889: fsync d5/da/de3/de9/dfa/f11e 0 2024-02-15T22:41:23.452 INFO:tasks.workunit.client.1.smithi082.stdout:7/859: write d12/d37/d85/f112 [474555,95983] 0 2024-02-15T22:41:23.452 INFO:tasks.workunit.client.1.smithi082.stdout:4/998: unlink d0/d8/d32/d39/fab 0 2024-02-15T22:41:23.454 INFO:tasks.workunit.client.1.smithi082.stdout:2/805: dread d6/dc/dd/d1d/fbd [0,4194304] 0 2024-02-15T22:41:23.455 INFO:tasks.workunit.client.1.smithi082.stdout:6/859: link d2/d30/c9c d2/d30/d3b/d10e/c11b 0 2024-02-15T22:41:23.455 INFO:tasks.workunit.client.1.smithi082.stdout:6/860: read - d2/d18/d8a/d47/f105 zero size 2024-02-15T22:41:23.456 INFO:tasks.workunit.client.1.smithi082.stdout:6/861: stat d2/d30/d3b/f49 0 2024-02-15T22:41:23.458 INFO:tasks.workunit.client.1.smithi082.stdout:0/803: sync 2024-02-15T22:41:23.458 INFO:tasks.workunit.client.1.smithi082.stdout:0/804: write d3/d19/f44 [3919217,109375] 0 2024-02-15T22:41:23.461 INFO:tasks.workunit.client.1.smithi082.stdout:8/776: link d1/d7/d9/d24/d30/ld2 d1/d40/dbb/dce/dfc/l108 0 2024-02-15T22:41:23.461 INFO:tasks.workunit.client.1.smithi082.stdout:8/777: dread - d1/d7/d9/d42/f8b zero size 2024-02-15T22:41:23.462 INFO:tasks.workunit.client.1.smithi082.stdout:4/999: dwrite d0/d47/da6/da7/d108/f116 [0,4194304] 0 2024-02-15T22:41:23.472 INFO:tasks.workunit.client.1.smithi082.stdout:9/840: mknod d8/d12/d30/c108 0 2024-02-15T22:41:23.482 INFO:tasks.workunit.client.1.smithi082.stdout:5/890: rename d5/da/dc/dad/dcf/d59/d84/c9f to d5/da/de3/de9/c128 0 2024-02-15T22:41:23.482 INFO:tasks.workunit.client.1.smithi082.stdout:5/891: read - d5/da/dc/d43/f123 zero size 2024-02-15T22:41:23.485 INFO:tasks.workunit.client.1.smithi082.stdout:6/862: mkdir d2/d30/da6/de1/d11c 0 2024-02-15T22:41:23.486 INFO:tasks.workunit.client.1.smithi082.stdout:0/805: creat d3/d19/f11c x:0 0 0 2024-02-15T22:41:23.486 INFO:tasks.workunit.client.1.smithi082.stdout:0/806: write d3/d19/d25/d45/f55 [4698517,26561] 0 2024-02-15T22:41:23.486 INFO:tasks.workunit.client.1.smithi082.stdout:0/807: write d3/d19/d25/d80/dd3/f109 [507305,127949] 0 2024-02-15T22:41:23.486 INFO:tasks.workunit.client.1.smithi082.stdout:0/808: truncate d3/d19/d25/de7/ff7 645539 0 2024-02-15T22:41:23.487 INFO:tasks.workunit.client.1.smithi082.stdout:6/863: write d2/f98 [319302,38424] 0 2024-02-15T22:41:23.490 INFO:tasks.workunit.client.1.smithi082.stdout:7/860: rename d12/d27/d6e/d6a/d9e/ld0 to d12/d27/d6e/d6a/db2/dbb/l11f 0 2024-02-15T22:41:23.491 INFO:tasks.workunit.client.1.smithi082.stdout:5/892: mknod d5/da/d67/da0/d92/c129 0 2024-02-15T22:41:23.491 INFO:tasks.workunit.client.1.smithi082.stdout:5/893: write d5/da/f121 [1346810,60683] 0 2024-02-15T22:41:23.491 INFO:tasks.workunit.client.1.smithi082.stdout:5/894: stat d5/da/d14/c66 0 2024-02-15T22:41:23.492 INFO:tasks.workunit.client.1.smithi082.stdout:2/806: mknod d6/dc/dd/d21/d9f/cf4 0 2024-02-15T22:41:23.492 INFO:tasks.workunit.client.1.smithi082.stdout:6/864: dread d2/d45/fb3 [0,4194304] 0 2024-02-15T22:41:23.492 INFO:tasks.workunit.client.1.smithi082.stdout:2/807: read d6/dc/dd/f9a [54709,5811] 0 2024-02-15T22:41:23.498 INFO:tasks.workunit.client.1.smithi082.stdout:0/809: mkdir d3/d19/d11d 0 2024-02-15T22:41:23.500 INFO:tasks.workunit.client.1.smithi082.stdout:8/778: rename d1/d7/de/l15 to d1/d40/dbb/dff/df1/l109 0 2024-02-15T22:41:23.500 INFO:tasks.workunit.client.1.smithi082.stdout:7/861: mknod d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/c120 0 2024-02-15T22:41:23.500 INFO:tasks.workunit.client.1.smithi082.stdout:7/862: write d12/d37/d85/f112 [937952,23782] 0 2024-02-15T22:41:23.501 INFO:tasks.workunit.client.1.smithi082.stdout:7/863: write d12/d17/d42/d67/d81/d91/f101 [3945267,85046] 0 2024-02-15T22:41:23.502 INFO:tasks.workunit.client.1.smithi082.stdout:5/895: creat d5/da/f12a x:0 0 0 2024-02-15T22:41:23.502 INFO:tasks.workunit.client.1.smithi082.stdout:5/896: truncate d5/dd8/ffd 458087 0 2024-02-15T22:41:23.503 INFO:tasks.workunit.client.1.smithi082.stdout:8/779: dread d1/d7/d9/d24/d30/f7f [0,4194304] 0 2024-02-15T22:41:23.503 INFO:tasks.workunit.client.1.smithi082.stdout:8/780: chown d1/d7/d9/d42/cb4 365615 1 2024-02-15T22:41:23.503 INFO:tasks.workunit.client.1.smithi082.stdout:8/781: chown d1/d7/d9/d24/fe1 0 1 2024-02-15T22:41:23.504 INFO:tasks.workunit.client.1.smithi082.stdout:0/810: creat d3/d19/d20/d7c/dd5/deb/da0/f11e x:0 0 0 2024-02-15T22:41:23.521 INFO:tasks.workunit.client.1.smithi082.stdout:9/841: rename d8/d24/d87/de0/d77/dc6/fc4 to d8/d12/d30/f109 0 2024-02-15T22:41:23.523 INFO:tasks.workunit.client.1.smithi082.stdout:6/865: dwrite d2/d18/d23/d67/f104 [0,4194304] 0 2024-02-15T22:41:23.523 INFO:tasks.workunit.client.1.smithi082.stdout:5/897: dwrite d5/da/dc/dad/dcf/d59/d84/d89/fea [0,4194304] 0 2024-02-15T22:41:23.528 INFO:tasks.workunit.client.1.smithi082.stdout:8/782: getdents d1/d40/dbb/dce/dfc 0 2024-02-15T22:41:23.530 INFO:tasks.workunit.client.1.smithi082.stdout:0/811: creat d3/d19/d1c/d76/d88/f11f x:0 0 0 2024-02-15T22:41:23.537 INFO:tasks.workunit.client.1.smithi082.stdout:0/812: write d3/d19/d1c/f108 [1827683,13970] 0 2024-02-15T22:41:23.538 INFO:tasks.workunit.client.1.smithi082.stdout:0/813: truncate d3/d19/f2e 395471 0 2024-02-15T22:41:23.538 INFO:tasks.workunit.client.1.smithi082.stdout:7/864: rename d12/d17/d42/d67/l111 to d12/d27/d6e/d6a/db2/ded/l121 0 2024-02-15T22:41:23.542 INFO:tasks.workunit.client.1.smithi082.stdout:9/842: dwrite d8/d12/d30/d3c/d65/f6b [0,4194304] 0 2024-02-15T22:41:23.552 INFO:tasks.workunit.client.1.smithi082.stdout:9/843: write d8/f58 [1224998,27598] 0 2024-02-15T22:41:23.553 INFO:tasks.workunit.client.1.smithi082.stdout:8/783: truncate d1/d40/f6d 126001 0 2024-02-15T22:41:23.558 INFO:tasks.workunit.client.1.smithi082.stdout:5/898: rename d5/da/d14/c3e to d5/da/dc/dad/dcf/c12b 0 2024-02-15T22:41:23.574 INFO:tasks.workunit.client.1.smithi082.stdout:6/866: symlink d2/d18/d8a/d47/d69/dc1/ded/l11d 0 2024-02-15T22:41:23.578 INFO:tasks.workunit.client.1.smithi082.stdout:9/844: mknod d8/d12/d33/d3e/c10a 0 2024-02-15T22:41:23.578 INFO:tasks.workunit.client.1.smithi082.stdout:9/845: truncate d8/ffa 3522340 0 2024-02-15T22:41:23.580 INFO:tasks.workunit.client.1.smithi082.stdout:3/821: sync 2024-02-15T22:41:23.580 INFO:tasks.workunit.client.1.smithi082.stdout:1/802: sync 2024-02-15T22:41:23.581 INFO:tasks.workunit.client.1.smithi082.stdout:2/808: sync 2024-02-15T22:41:23.582 INFO:tasks.workunit.client.1.smithi082.stdout:8/784: symlink d1/d40/dbb/dff/da6/db8/def/l10a 0 2024-02-15T22:41:23.582 INFO:tasks.workunit.client.1.smithi082.stdout:8/785: truncate d1/d7/d9/d42/d6a/f76 2211906 0 2024-02-15T22:41:23.583 INFO:tasks.workunit.client.1.smithi082.stdout:1/803: dread d1/da/d11/d3f/f5e [0,4194304] 0 2024-02-15T22:41:23.584 INFO:tasks.workunit.client.1.smithi082.stdout:2/809: dread d6/dc/f89 [0,4194304] 0 2024-02-15T22:41:23.587 INFO:tasks.workunit.client.1.smithi082.stdout:0/814: rename d3/d19/d20/d26/f4e to d3/d19/d20/f120 0 2024-02-15T22:41:23.590 INFO:tasks.workunit.client.1.smithi082.stdout:5/899: symlink d5/da/d14/l12c 0 2024-02-15T22:41:23.590 INFO:tasks.workunit.client.1.smithi082.stdout:5/900: fsync d5/da/dc/dd5/f119 0 2024-02-15T22:41:23.596 INFO:tasks.workunit.client.1.smithi082.stdout:9/846: mkdir d8/d12/d30/d3c/d65/d10b 0 2024-02-15T22:41:23.597 INFO:tasks.workunit.client.1.smithi082.stdout:3/822: creat d0/dc/d3f/d115/f117 x:0 0 0 2024-02-15T22:41:23.597 INFO:tasks.workunit.client.1.smithi082.stdout:3/823: truncate d0/d16/d62/f7 4473230 0 2024-02-15T22:41:23.608 INFO:tasks.workunit.client.1.smithi082.stdout:9/847: creat d8/d24/d2e/d53/f10c x:0 0 0 2024-02-15T22:41:23.608 INFO:tasks.workunit.client.1.smithi082.stdout:1/804: rmdir d1/da/d14/d18/d1f/d7a 39 2024-02-15T22:41:23.608 INFO:tasks.workunit.client.1.smithi082.stdout:1/805: read d1/da/d14/d18/d51/f97 [1721561,47694] 0 2024-02-15T22:41:23.608 INFO:tasks.workunit.client.1.smithi082.stdout:1/806: stat d1/da/d14/d18/d1f/d7a/c8f 0 2024-02-15T22:41:23.612 INFO:tasks.workunit.client.1.smithi082.stdout:0/815: getdents d3/d19/d20/d7c/dd5/deb/da5/d9c 0 2024-02-15T22:41:23.613 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:23 smithi033 ceph-mon[29033]: pgmap v24: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 198 MiB/s rd, 240 MiB/s wr, 505 op/s 2024-02-15T22:41:23.614 INFO:tasks.workunit.client.1.smithi082.stdout:1/807: rmdir d1/da/d14/d18/d1f/d7a/ddb 39 2024-02-15T22:41:23.615 INFO:tasks.workunit.client.1.smithi082.stdout:0/816: mknod d3/d19/d93/c121 0 2024-02-15T22:41:23.618 INFO:tasks.workunit.client.1.smithi082.stdout:1/808: creat d1/da/d14/d18/d98/f107 x:0 0 0 2024-02-15T22:41:23.621 INFO:tasks.workunit.client.1.smithi082.stdout:6/867: dwrite d2/d18/d8a/d47/d72/f10d [8388608,4194304] 0 2024-02-15T22:41:23.621 INFO:tasks.workunit.client.1.smithi082.stdout:7/865: rename d12/d17/d42/d67/d79 to d12/de4/d122 0 2024-02-15T22:41:23.623 INFO:tasks.workunit.client.1.smithi082.stdout:6/868: rename d2/d18/d8a/d47/d69/dc1/ff7 to d2/d18/d8a/d65/f11e 0 2024-02-15T22:41:23.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:23 smithi082 ceph-mon[37153]: pgmap v24: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 198 MiB/s rd, 240 MiB/s wr, 505 op/s 2024-02-15T22:41:23.625 INFO:tasks.workunit.client.1.smithi082.stdout:0/817: dread d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/f10b [0,4194304] 0 2024-02-15T22:41:23.625 INFO:tasks.workunit.client.1.smithi082.stdout:6/869: link d2/le d2/l11f 0 2024-02-15T22:41:23.625 INFO:tasks.workunit.client.1.smithi082.stdout:6/870: write d2/d18/d8a/d47/d69/d75/f117 [899322,57467] 0 2024-02-15T22:41:23.627 INFO:tasks.workunit.client.1.smithi082.stdout:3/824: dwrite d0/d16/d62/f50 [0,4194304] 0 2024-02-15T22:41:23.627 INFO:tasks.workunit.client.1.smithi082.stdout:0/818: dread d3/d19/d20/d7c/dd5/deb/da0/fa1 [0,4194304] 0 2024-02-15T22:41:23.628 INFO:tasks.workunit.client.1.smithi082.stdout:6/871: rename d2/d18/d10f/d115 to d2/d30/d3b/d120 0 2024-02-15T22:41:23.630 INFO:tasks.workunit.client.1.smithi082.stdout:2/810: dwrite d6/dc/d58/f61 [0,4194304] 0 2024-02-15T22:41:23.632 INFO:tasks.workunit.client.1.smithi082.stdout:6/872: unlink d2/d18/d39/cd1 0 2024-02-15T22:41:23.647 INFO:tasks.workunit.client.1.smithi082.stdout:2/811: link d6/d18/c7b d6/dc/dd/d24/d71/cf5 0 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:8/786: dwrite d1/d40/dbb/dff/d85/f97 [0,4194304] 0 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:2/812: mkdir d6/dc/d58/d49/d5e/d67/df6 0 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:3/825: dread d0/d16/d62/d14/d21/d69/d87/fdf [0,4194304] 0 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:3/826: symlink d0/d16/d62/d14/d21/d69/d87/dc7/l118 0 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:3/827: chown d0/dc/d3f/dc4/dc9 86217 1 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:3/828: truncate d0/d16/d62/d14/d21/d69/dfc/f10a 399571 0 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:3/829: chown d0/d16/d3e/d56 899802 1 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:6/873: dread d2/d45/f56 [0,4194304] 0 2024-02-15T22:41:23.648 INFO:tasks.workunit.client.1.smithi082.stdout:6/874: mkdir d2/d18/d8a/d47/d69/dc1/d121 0 2024-02-15T22:41:23.649 INFO:tasks.workunit.client.1.smithi082.stdout:5/901: dwrite d5/da/d14/d45/f60 [4194304,4194304] 0 2024-02-15T22:41:23.651 INFO:tasks.workunit.client.1.smithi082.stdout:5/902: mkdir d5/d102/d11d/d12d 0 2024-02-15T22:41:23.651 INFO:tasks.workunit.client.1.smithi082.stdout:5/903: write d5/da/d14/f18 [801356,57451] 0 2024-02-15T22:41:23.658 INFO:tasks.workunit.client.1.smithi082.stdout:8/787: dread d1/f14 [0,4194304] 0 2024-02-15T22:41:23.658 INFO:tasks.workunit.client.1.smithi082.stdout:9/848: dwrite d8/d12/d67/d70/d97/fb0 [0,4194304] 0 2024-02-15T22:41:23.658 INFO:tasks.workunit.client.1.smithi082.stdout:5/904: dread d5/da/f3c [0,4194304] 0 2024-02-15T22:41:23.659 INFO:tasks.workunit.client.1.smithi082.stdout:8/788: getdents d1/d7 0 2024-02-15T22:41:23.661 INFO:tasks.workunit.client.1.smithi082.stdout:8/789: symlink d1/l10b 0 2024-02-15T22:41:23.661 INFO:tasks.workunit.client.1.smithi082.stdout:3/830: dread d0/dc/f5c [0,4194304] 0 2024-02-15T22:41:23.661 INFO:tasks.workunit.client.1.smithi082.stdout:3/831: creat d0/d16/d3e/d56/f119 x:0 0 0 2024-02-15T22:41:23.661 INFO:tasks.workunit.client.1.smithi082.stdout:5/905: dread d5/da/d14/d53/f71 [0,4194304] 0 2024-02-15T22:41:23.661 INFO:tasks.workunit.client.1.smithi082.stdout:5/906: stat d5/da/d14/f75 0 2024-02-15T22:41:23.662 INFO:tasks.workunit.client.1.smithi082.stdout:5/907: chown d5/da/dc/d113 909832328 1 2024-02-15T22:41:23.662 INFO:tasks.workunit.client.1.smithi082.stdout:1/809: dwrite d1/da/d14/d18/d1f/d76/da7/fde [0,4194304] 0 2024-02-15T22:41:23.662 INFO:tasks.workunit.client.1.smithi082.stdout:8/790: unlink d1/d7/d9/d42/d6a/cc9 0 2024-02-15T22:41:23.662 INFO:tasks.workunit.client.1.smithi082.stdout:8/791: write d1/d7/d78/fcb [5131383,69840] 0 2024-02-15T22:41:23.662 INFO:tasks.workunit.client.1.smithi082.stdout:8/792: truncate d1/d7/d78/fb1 1657189 0 2024-02-15T22:41:23.662 INFO:tasks.workunit.client.1.smithi082.stdout:8/793: chown d1/ceb 1494 1 2024-02-15T22:41:23.663 INFO:tasks.workunit.client.1.smithi082.stdout:7/866: dwrite d12/d37/f5b [0,4194304] 0 2024-02-15T22:41:23.663 INFO:tasks.workunit.client.1.smithi082.stdout:5/908: rename d5/da/c42 to d5/da/dc/d43/c12e 0 2024-02-15T22:41:23.663 INFO:tasks.workunit.client.1.smithi082.stdout:2/813: dwrite d6/d3c/d8c/fd3 [0,4194304] 0 2024-02-15T22:41:23.663 INFO:tasks.workunit.client.1.smithi082.stdout:8/794: dread d1/d7/d9/f17 [0,4194304] 0 2024-02-15T22:41:23.664 INFO:tasks.workunit.client.1.smithi082.stdout:0/819: dwrite d3/d19/d20/d7c/dd5/deb/f6e [0,4194304] 0 2024-02-15T22:41:23.664 INFO:tasks.workunit.client.1.smithi082.stdout:1/810: mknod d1/da/d14/d18/d1f/d2f/c108 0 2024-02-15T22:41:23.669 INFO:tasks.workunit.client.1.smithi082.stdout:7/867: creat d12/d37/f123 x:0 0 0 2024-02-15T22:41:23.669 INFO:tasks.workunit.client.1.smithi082.stdout:7/868: dread - d12/d27/d6e/d6a/d9e/dbe/fec zero size 2024-02-15T22:41:23.673 INFO:tasks.workunit.client.1.smithi082.stdout:5/909: rename d5/da/dc/dad/dcf/fa4 to d5/da/d14/d53/f12f 0 2024-02-15T22:41:23.675 INFO:tasks.workunit.client.1.smithi082.stdout:5/910: dread d5/da/f121 [0,4194304] 0 2024-02-15T22:41:23.675 INFO:tasks.workunit.client.1.smithi082.stdout:5/911: creat d5/da/d67/da0/d92/f130 x:0 0 0 2024-02-15T22:41:23.675 INFO:tasks.workunit.client.1.smithi082.stdout:5/912: dread - d5/da/f12a zero size 2024-02-15T22:41:23.675 INFO:tasks.workunit.client.1.smithi082.stdout:2/814: creat d6/dc/d12/d46/d76/ff7 x:0 0 0 2024-02-15T22:41:23.680 INFO:tasks.workunit.client.1.smithi082.stdout:8/795: mkdir d1/d7/de/d10c 0 2024-02-15T22:41:23.686 INFO:tasks.workunit.client.1.smithi082.stdout:2/815: write d6/dc/dd/d24/fc0 [2891092,58474] 0 2024-02-15T22:41:23.688 INFO:tasks.workunit.client.1.smithi082.stdout:5/913: dwrite d5/da/dc/dad/dcf/f2d [0,4194304] 0 2024-02-15T22:41:23.697 INFO:tasks.workunit.client.1.smithi082.stdout:8/796: dwrite d1/d7/f62 [0,4194304] 0 2024-02-15T22:41:23.697 INFO:tasks.workunit.client.1.smithi082.stdout:8/797: chown d1/d7/d9/d42/d6a/lea 7 1 2024-02-15T22:41:23.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/820: creat d3/d19/d1c/d76/d88/f122 x:0 0 0 2024-02-15T22:41:23.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/821: fdatasync d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/f68 0 2024-02-15T22:41:23.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/822: fsync d3/d19/d20/d26/f62 0 2024-02-15T22:41:23.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/823: fdatasync d3/d19/d20/d7c/dd5/deb/da0/dbc/fcd 0 2024-02-15T22:41:23.704 INFO:tasks.workunit.client.1.smithi082.stdout:7/869: creat d12/d17/d42/d67/d81/d91/f124 x:0 0 0 2024-02-15T22:41:23.707 INFO:tasks.workunit.client.1.smithi082.stdout:1/811: rename d1/da/d14/d18/d1f/d2f/fa5 to d1/da/d14/d18/d6d/dc2/f109 0 2024-02-15T22:41:23.707 INFO:tasks.workunit.client.1.smithi082.stdout:1/812: chown d1/d57/f5f 95705990 1 2024-02-15T22:41:23.713 INFO:tasks.workunit.client.1.smithi082.stdout:2/816: creat d6/dc/d58/d49/d5e/d67/df6/ff8 x:0 0 0 2024-02-15T22:41:23.715 INFO:tasks.workunit.client.1.smithi082.stdout:5/914: mknod d5/da/dc/d113/c131 0 2024-02-15T22:41:23.719 INFO:tasks.workunit.client.1.smithi082.stdout:8/798: link d1/d7/d9/d24/l59 d1/d7/de/d1e/ddb/l10d 0 2024-02-15T22:41:23.726 INFO:tasks.workunit.client.1.smithi082.stdout:0/824: mkdir d3/d19/d20/d7c/dd5/deb/da0/d123 0 2024-02-15T22:41:23.726 INFO:tasks.workunit.client.1.smithi082.stdout:0/825: stat d3/d19/d20/d7c/dd5/deb/da5/d9c/fb0 0 2024-02-15T22:41:23.726 INFO:tasks.workunit.client.1.smithi082.stdout:0/826: write d3/d19/d1c/d6d/fe6 [602992,92238] 0 2024-02-15T22:41:23.729 INFO:tasks.workunit.client.1.smithi082.stdout:7/870: rename d12/d17/d42/d67/d81/dc0/lc5 to d12/d27/d6e/d6a/d9e/l125 0 2024-02-15T22:41:23.733 INFO:tasks.workunit.client.1.smithi082.stdout:1/813: mknod d1/da/c10a 0 2024-02-15T22:41:23.734 INFO:tasks.workunit.client.1.smithi082.stdout:0/827: write d3/d19/d20/d7c/dd5/deb/f63 [357935,83012] 0 2024-02-15T22:41:23.734 INFO:tasks.workunit.client.1.smithi082.stdout:0/828: dread - d3/d19/d20/d7c/dd5/deb/da5/d99/db1/f106 zero size 2024-02-15T22:41:23.742 INFO:tasks.workunit.client.1.smithi082.stdout:5/915: symlink d5/d102/d11d/l132 0 2024-02-15T22:41:23.747 INFO:tasks.workunit.client.1.smithi082.stdout:7/871: unlink la 0 2024-02-15T22:41:23.747 INFO:tasks.workunit.client.1.smithi082.stdout:1/814: mknod d1/da/d11/d8c/c10b 0 2024-02-15T22:41:23.748 INFO:tasks.workunit.client.1.smithi082.stdout:1/815: chown d1/da/d14/d18/d6d/dc2/l106 113205 1 2024-02-15T22:41:23.751 INFO:tasks.workunit.client.1.smithi082.stdout:7/872: dread d12/d27/d74/f82 [0,4194304] 0 2024-02-15T22:41:23.752 INFO:tasks.workunit.client.1.smithi082.stdout:0/829: mkdir d3/d19/d11d/d124 0 2024-02-15T22:41:23.754 INFO:tasks.workunit.client.1.smithi082.stdout:5/916: mkdir d5/d102/d11d/d133 0 2024-02-15T22:41:23.755 INFO:tasks.workunit.client.1.smithi082.stdout:7/873: mkdir d12/d17/d42/d67/d81/d91/da0/d126 0 2024-02-15T22:41:23.755 INFO:tasks.workunit.client.1.smithi082.stdout:7/874: fsync d12/d3b/d5a/fb7 0 2024-02-15T22:41:23.758 INFO:tasks.workunit.client.1.smithi082.stdout:5/917: mknod d5/d102/d11d/d133/c134 0 2024-02-15T22:41:23.758 INFO:tasks.workunit.client.1.smithi082.stdout:1/816: dread d1/da/d14/d18/d1f/f84 [0,4194304] 0 2024-02-15T22:41:23.758 INFO:tasks.workunit.client.1.smithi082.stdout:1/817: readlink d1/da/d14/d18/l79 0 2024-02-15T22:41:23.760 INFO:tasks.workunit.client.1.smithi082.stdout:0/830: dread d3/d19/d20/f5b [0,4194304] 0 2024-02-15T22:41:23.762 INFO:tasks.workunit.client.1.smithi082.stdout:0/831: mknod d3/d19/d20/d7c/dd5/deb/d92/c125 0 2024-02-15T22:41:23.762 INFO:tasks.workunit.client.1.smithi082.stdout:0/832: chown d3/d19/d20/d7c/dd5/deb/da5/d99/l9a 46 1 2024-02-15T22:41:23.765 INFO:tasks.workunit.client.1.smithi082.stdout:7/875: write d12/d17/d42/f53 [2778971,26561] 0 2024-02-15T22:41:23.770 INFO:tasks.workunit.client.1.smithi082.stdout:7/876: symlink d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/l127 0 2024-02-15T22:41:23.770 INFO:tasks.workunit.client.1.smithi082.stdout:7/877: write d12/f2d [531304,41402] 0 2024-02-15T22:41:23.770 INFO:tasks.workunit.client.1.smithi082.stdout:5/918: dread d5/da/d56/f86 [0,4194304] 0 2024-02-15T22:41:23.776 INFO:tasks.workunit.client.1.smithi082.stdout:6/875: sync 2024-02-15T22:41:23.776 INFO:tasks.workunit.client.1.smithi082.stdout:9/849: sync 2024-02-15T22:41:23.776 INFO:tasks.workunit.client.1.smithi082.stdout:3/832: sync 2024-02-15T22:41:23.776 INFO:tasks.workunit.client.1.smithi082.stdout:3/833: readlink d0/d16/d3e/d56/l110 0 2024-02-15T22:41:23.779 INFO:tasks.workunit.client.1.smithi082.stdout:1/818: write d1/f1d [1390616,56163] 0 2024-02-15T22:41:23.782 INFO:tasks.workunit.client.1.smithi082.stdout:6/876: getdents d2/d18/d8a/d47/d69/db1 0 2024-02-15T22:41:23.783 INFO:tasks.workunit.client.1.smithi082.stdout:9/850: symlink d8/l10d 0 2024-02-15T22:41:23.783 INFO:tasks.workunit.client.1.smithi082.stdout:9/851: readlink d8/d24/d2e/l54 0 2024-02-15T22:41:23.786 INFO:tasks.workunit.client.1.smithi082.stdout:3/834: write d0/d16/d62/d14/d21/d69/dbe/fdd [2772175,24812] 0 2024-02-15T22:41:23.786 INFO:tasks.workunit.client.1.smithi082.stdout:1/819: creat d1/da/d14/d18/d1f/d7a/f10c x:0 0 0 2024-02-15T22:41:23.786 INFO:tasks.workunit.client.1.smithi082.stdout:1/820: readlink d1/da/d14/d18/d6d/dc2/l106 0 2024-02-15T22:41:23.787 INFO:tasks.workunit.client.1.smithi082.stdout:0/833: dwrite d3/d19/d20/d7c/dd5/deb/da5/d99/db1/f106 [0,4194304] 0 2024-02-15T22:41:23.789 INFO:tasks.workunit.client.1.smithi082.stdout:0/834: dread d3/d19/d20/d7c/dd5/deb/da0/fa1 [0,4194304] 0 2024-02-15T22:41:23.792 INFO:tasks.workunit.client.1.smithi082.stdout:6/877: symlink d2/d30/l122 0 2024-02-15T22:41:23.792 INFO:tasks.workunit.client.1.smithi082.stdout:6/878: truncate d2/d18/d8a/d47/d69/dd0/fd8 4906624 0 2024-02-15T22:41:23.795 INFO:tasks.workunit.client.1.smithi082.stdout:3/835: rename d0/d16/d62/d14/d71/d101 to d0/d16/d62/d14/d21/dee/d11a 0 2024-02-15T22:41:23.796 INFO:tasks.workunit.client.1.smithi082.stdout:5/919: dwrite d5/da/d14/f75 [4194304,4194304] 0 2024-02-15T22:41:23.796 INFO:tasks.workunit.client.1.smithi082.stdout:5/920: chown d5/da/f24 20404 1 2024-02-15T22:41:23.796 INFO:tasks.workunit.client.1.smithi082.stdout:5/921: fdatasync d5/da/d14/d53/f7b 0 2024-02-15T22:41:23.800 INFO:tasks.workunit.client.1.smithi082.stdout:1/821: creat d1/da/d11/d93/db6/dc5/f10d x:0 0 0 2024-02-15T22:41:23.801 INFO:tasks.workunit.client.1.smithi082.stdout:9/852: dwrite d8/d12/f69 [0,4194304] 0 2024-02-15T22:41:23.803 INFO:tasks.workunit.client.1.smithi082.stdout:9/853: dread d8/d12/f2f [0,4194304] 0 2024-02-15T22:41:23.808 INFO:tasks.workunit.client.1.smithi082.stdout:0/835: mknod d3/d19/d93/dbe/c126 0 2024-02-15T22:41:23.808 INFO:tasks.workunit.client.1.smithi082.stdout:0/836: creat d3/d19/d25/d80/dd3/f127 x:0 0 0 2024-02-15T22:41:23.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/879: truncate d2/d45/fb3 2111861 0 2024-02-15T22:41:23.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/880: write d2/d18/d39/f7d [4254078,101168] 0 2024-02-15T22:41:23.809 INFO:tasks.workunit.client.1.smithi082.stdout:6/881: fdatasync d2/d18/d8a/da7/fff 0 2024-02-15T22:41:23.810 INFO:tasks.workunit.client.1.smithi082.stdout:6/882: truncate d2/d18/d23/d67/fac 4840973 0 2024-02-15T22:41:23.820 INFO:tasks.workunit.client.1.smithi082.stdout:9/854: dwrite d8/d24/d87/de0/d77/dab/fb1 [0,4194304] 0 2024-02-15T22:41:23.820 INFO:tasks.workunit.client.1.smithi082.stdout:9/855: write d8/d12/dc5/f60 [264834,54824] 0 2024-02-15T22:41:23.821 INFO:tasks.workunit.client.1.smithi082.stdout:5/922: mkdir d5/da/de3/d135 0 2024-02-15T22:41:23.821 INFO:tasks.workunit.client.1.smithi082.stdout:5/923: chown d5/da/de3/d135 36913 1 2024-02-15T22:41:23.821 INFO:tasks.workunit.client.1.smithi082.stdout:5/924: fdatasync d5/da/dc/dad/dcf/f3f 0 2024-02-15T22:41:23.821 INFO:tasks.workunit.client.1.smithi082.stdout:5/925: write d5/da/d67/f114 [920045,119228] 0 2024-02-15T22:41:23.821 INFO:tasks.workunit.client.1.smithi082.stdout:6/883: dread d2/d18/d8a/d47/d72/f10d [4194304,4194304] 0 2024-02-15T22:41:23.821 INFO:tasks.workunit.client.1.smithi082.stdout:3/836: rmdir d0/d16/d62/d14/d21/d69/d91 39 2024-02-15T22:41:23.827 INFO:tasks.workunit.client.1.smithi082.stdout:9/856: dread d8/d12/d33/f3b [0,4194304] 0 2024-02-15T22:41:23.828 INFO:tasks.workunit.client.1.smithi082.stdout:9/857: chown d8/d24/d2e/d53/ld3 0 1 2024-02-15T22:41:23.836 INFO:tasks.workunit.client.1.smithi082.stdout:3/837: dwrite d0/d16/d3e/fca [0,4194304] 0 2024-02-15T22:41:23.836 INFO:tasks.workunit.client.1.smithi082.stdout:0/837: mknod d3/d19/d20/d7c/dd5/deb/da5/d99/ddc/c128 0 2024-02-15T22:41:23.838 INFO:tasks.workunit.client.1.smithi082.stdout:0/838: dread d3/d19/d20/d7c/dd5/deb/da5/f6f [0,4194304] 0 2024-02-15T22:41:23.838 INFO:tasks.workunit.client.1.smithi082.stdout:0/839: write d3/d19/d20/d7c/dd5/deb/da5/d9c/fef [2685182,14097] 0 2024-02-15T22:41:23.838 INFO:tasks.workunit.client.1.smithi082.stdout:0/840: dread - d3/d19/d20/d7c/dd5/deb/da0/fe2 zero size 2024-02-15T22:41:23.839 INFO:tasks.workunit.client.1.smithi082.stdout:3/838: write d0/d16/d62/d14/d21/d69/d91/fa1 [48321,38959] 0 2024-02-15T22:41:23.842 INFO:tasks.workunit.client.1.smithi082.stdout:9/858: dread d8/d24/d2e/f81 [0,4194304] 0 2024-02-15T22:41:23.842 INFO:tasks.workunit.client.1.smithi082.stdout:9/859: creat d8/d24/d2e/d53/f10e x:0 0 0 2024-02-15T22:41:23.843 INFO:tasks.workunit.client.1.smithi082.stdout:9/860: dread d8/d12/d33/d3e/fb7 [0,4194304] 0 2024-02-15T22:41:23.854 INFO:tasks.workunit.client.1.smithi082.stdout:6/884: mkdir d2/d45/d123 0 2024-02-15T22:41:23.859 INFO:tasks.workunit.client.1.smithi082.stdout:9/861: dwrite d8/f11 [0,4194304] 0 2024-02-15T22:41:23.866 INFO:tasks.workunit.client.1.smithi082.stdout:9/862: dread d8/f2b [0,4194304] 0 2024-02-15T22:41:23.867 INFO:tasks.workunit.client.1.smithi082.stdout:0/841: creat d3/d19/d25/f129 x:0 0 0 2024-02-15T22:41:23.868 INFO:tasks.workunit.client.1.smithi082.stdout:6/885: dwrite d2/d18/d23/d67/fac [4194304,4194304] 0 2024-02-15T22:41:23.874 INFO:tasks.workunit.client.1.smithi082.stdout:3/839: symlink d0/d16/d62/d14/d21/dee/d11a/l11b 0 2024-02-15T22:41:23.875 INFO:tasks.workunit.client.1.smithi082.stdout:3/840: stat d0/dc/d3f/fbb 0 2024-02-15T22:41:23.875 INFO:tasks.workunit.client.1.smithi082.stdout:3/841: fsync d0/d16/d3e/d56/fb5 0 2024-02-15T22:41:23.879 INFO:tasks.workunit.client.1.smithi082.stdout:1/822: rmdir d1/da/d11 39 2024-02-15T22:41:23.881 INFO:tasks.workunit.client.1.smithi082.stdout:8/799: sync 2024-02-15T22:41:23.882 INFO:tasks.workunit.client.1.smithi082.stdout:7/878: sync 2024-02-15T22:41:23.882 INFO:tasks.workunit.client.1.smithi082.stdout:2/817: sync 2024-02-15T22:41:23.882 INFO:tasks.workunit.client.1.smithi082.stdout:7/879: chown d12/d27/d100 1 1 2024-02-15T22:41:23.882 INFO:tasks.workunit.client.1.smithi082.stdout:7/880: fsync d12/d3b/d5a/f11d 0 2024-02-15T22:41:23.882 INFO:tasks.workunit.client.1.smithi082.stdout:8/800: creat d1/d40/dbb/dcf/f10e x:0 0 0 2024-02-15T22:41:23.882 INFO:tasks.workunit.client.1.smithi082.stdout:8/801: truncate d1/d7/d9/d24/d30/f4b 1189063 0 2024-02-15T22:41:23.883 INFO:tasks.workunit.client.1.smithi082.stdout:9/863: symlink d8/d24/d87/de0/d77/dc6/de6/l10f 0 2024-02-15T22:41:23.885 INFO:tasks.workunit.client.1.smithi082.stdout:1/823: dread d1/da/d14/d18/ff7 [0,4194304] 0 2024-02-15T22:41:23.885 INFO:tasks.workunit.client.1.smithi082.stdout:0/842: symlink d3/d19/d93/d107/l12a 0 2024-02-15T22:41:23.890 INFO:tasks.workunit.client.1.smithi082.stdout:2/818: creat d6/dc/d12/d46/da9/ff9 x:0 0 0 2024-02-15T22:41:23.890 INFO:tasks.workunit.client.1.smithi082.stdout:2/819: write d6/dc/fc7 [152641,50699] 0 2024-02-15T22:41:23.890 INFO:tasks.workunit.client.1.smithi082.stdout:2/820: stat d6/lf 0 2024-02-15T22:41:23.890 INFO:tasks.workunit.client.1.smithi082.stdout:2/821: write d6/dc/d58/d49/db6/fe0 [7026,112215] 0 2024-02-15T22:41:23.895 INFO:tasks.workunit.client.1.smithi082.stdout:6/886: dwrite d2/d30/da6/faa [0,4194304] 0 2024-02-15T22:41:23.896 INFO:tasks.workunit.client.1.smithi082.stdout:5/926: dwrite d5/da/d67/fc9 [0,4194304] 0 2024-02-15T22:41:23.897 INFO:tasks.workunit.client.1.smithi082.stdout:7/881: creat d12/d27/d74/f128 x:0 0 0 2024-02-15T22:41:23.897 INFO:tasks.workunit.client.1.smithi082.stdout:7/882: write d12/d3b/d5a/f11d [173031,89979] 0 2024-02-15T22:41:23.897 INFO:tasks.workunit.client.1.smithi082.stdout:0/843: dread d3/d19/d20/d7c/dd5/deb/f10d [0,4194304] 0 2024-02-15T22:41:23.898 INFO:tasks.workunit.client.1.smithi082.stdout:8/802: mknod d1/d7/d9/d24/d30/c10f 0 2024-02-15T22:41:23.902 INFO:tasks.workunit.client.1.smithi082.stdout:1/824: creat d1/da/d11/d8c/db3/f10e x:0 0 0 2024-02-15T22:41:23.902 INFO:tasks.workunit.client.1.smithi082.stdout:1/825: dread - d1/da/d14/d18/d1f/ffd zero size 2024-02-15T22:41:23.902 INFO:tasks.workunit.client.1.smithi082.stdout:1/826: fdatasync d1/da/d14/d18/d1f/f66 0 2024-02-15T22:41:23.904 INFO:tasks.workunit.client.1.smithi082.stdout:3/842: mkdir d0/d16/d62/d14/d21/d11c 0 2024-02-15T22:41:23.915 INFO:tasks.workunit.client.1.smithi082.stdout:5/927: unlink d5/da/f121 0 2024-02-15T22:41:23.916 INFO:tasks.workunit.client.1.smithi082.stdout:6/887: dwrite d2/d18/f10b [0,4194304] 0 2024-02-15T22:41:23.917 INFO:tasks.workunit.client.1.smithi082.stdout:9/864: write d8/d12/d67/d70/fa0 [1108650,105119] 0 2024-02-15T22:41:23.917 INFO:tasks.workunit.client.1.smithi082.stdout:3/843: dwrite d0/d16/d62/d14/fe4 [0,4194304] 0 2024-02-15T22:41:23.920 INFO:tasks.workunit.client.1.smithi082.stdout:9/865: read d8/f2b [513414,25366] 0 2024-02-15T22:41:23.920 INFO:tasks.workunit.client.1.smithi082.stdout:9/866: write d8/d12/d67/d70/d97/fb0 [4865556,67750] 0 2024-02-15T22:41:23.922 INFO:tasks.workunit.client.1.smithi082.stdout:7/883: unlink d12/d27/d6e/f93 0 2024-02-15T22:41:23.922 INFO:tasks.workunit.client.1.smithi082.stdout:7/884: fdatasync d12/d17/f1a 0 2024-02-15T22:41:23.927 INFO:tasks.workunit.client.1.smithi082.stdout:6/888: dread d2/d18/d23/f35 [0,4194304] 0 2024-02-15T22:41:23.927 INFO:tasks.workunit.client.1.smithi082.stdout:0/844: mkdir d3/d19/d20/d7c/dcf/d12b 0 2024-02-15T22:41:23.927 INFO:tasks.workunit.client.1.smithi082.stdout:0/845: chown d3/d19/d25/d80/f111 536 1 2024-02-15T22:41:23.934 INFO:tasks.workunit.client.1.smithi082.stdout:8/803: symlink d1/d40/dbb/dff/da6/db6/d104/l110 0 2024-02-15T22:41:23.937 INFO:tasks.workunit.client.1.smithi082.stdout:1/827: mknod d1/da/c10f 0 2024-02-15T22:41:23.937 INFO:tasks.workunit.client.1.smithi082.stdout:1/828: write d1/da/d11/d8c/db3/f104 [529921,97252] 0 2024-02-15T22:41:23.937 INFO:tasks.workunit.client.1.smithi082.stdout:1/829: chown d1/da/d14/d18/d1f/d2f 820 1 2024-02-15T22:41:23.937 INFO:tasks.workunit.client.1.smithi082.stdout:5/928: mknod d5/da/d67/c136 0 2024-02-15T22:41:23.944 INFO:tasks.workunit.client.1.smithi082.stdout:6/889: dwrite d2/d18/d8a/d47/d69/f73 [0,4194304] 0 2024-02-15T22:41:23.944 INFO:tasks.workunit.client.1.smithi082.stdout:6/890: creat d2/d45/dc5/f124 x:0 0 0 2024-02-15T22:41:23.945 INFO:tasks.workunit.client.1.smithi082.stdout:3/844: symlink d0/d16/d62/d2e/d84/l11d 0 2024-02-15T22:41:23.945 INFO:tasks.workunit.client.1.smithi082.stdout:5/929: dread d5/da/d14/d53/f71 [0,4194304] 0 2024-02-15T22:41:23.945 INFO:tasks.workunit.client.1.smithi082.stdout:5/930: write d5/da/d67/da0/d92/fc3 [279865,23325] 0 2024-02-15T22:41:23.946 INFO:tasks.workunit.client.1.smithi082.stdout:9/867: symlink d8/d24/d87/de0/d77/dc6/de6/l110 0 2024-02-15T22:41:23.949 INFO:tasks.workunit.client.1.smithi082.stdout:0/846: symlink d3/d19/d20/d26/l12c 0 2024-02-15T22:41:23.950 INFO:tasks.workunit.client.1.smithi082.stdout:8/804: symlink d1/d40/l111 0 2024-02-15T22:41:23.952 INFO:tasks.workunit.client.1.smithi082.stdout:1/830: mkdir d1/da/d14/d18/d1f/d76/da7/d110 0 2024-02-15T22:41:23.952 INFO:tasks.workunit.client.1.smithi082.stdout:1/831: write d1/da/d11/fae [230592,81373] 0 2024-02-15T22:41:23.956 INFO:tasks.workunit.client.1.smithi082.stdout:3/845: write d0/d16/d62/f45 [7902089,46044] 0 2024-02-15T22:41:23.956 INFO:tasks.workunit.client.1.smithi082.stdout:3/846: fdatasync d0/d16/df0/ffa 0 2024-02-15T22:41:23.957 INFO:tasks.workunit.client.1.smithi082.stdout:6/891: creat d2/d30/d3b/d10e/f125 x:0 0 0 2024-02-15T22:41:23.958 INFO:tasks.workunit.client.1.smithi082.stdout:5/931: creat d5/d102/d11d/f137 x:0 0 0 2024-02-15T22:41:23.961 INFO:tasks.workunit.client.1.smithi082.stdout:9/868: creat d8/d12/d30/d3c/d65/d10b/f111 x:0 0 0 2024-02-15T22:41:23.961 INFO:tasks.workunit.client.1.smithi082.stdout:9/869: write d8/d24/fe8 [301185,80846] 0 2024-02-15T22:41:23.961 INFO:tasks.workunit.client.1.smithi082.stdout:9/870: chown d8/d24/d2e/f34 44010331 1 2024-02-15T22:41:23.962 INFO:tasks.workunit.client.1.smithi082.stdout:0/847: rename d3/d19/d93/d107/l12a to d3/d19/d20/d7c/l12d 0 2024-02-15T22:41:23.962 INFO:tasks.workunit.client.1.smithi082.stdout:0/848: truncate d3/d19/d20/d26/f62 788629 0 2024-02-15T22:41:23.962 INFO:tasks.workunit.client.1.smithi082.stdout:0/849: dread - d3/d19/d93/fb7 zero size 2024-02-15T22:41:23.966 INFO:tasks.workunit.client.1.smithi082.stdout:8/805: symlink d1/dfd/l112 0 2024-02-15T22:41:23.969 INFO:tasks.workunit.client.1.smithi082.stdout:1/832: rmdir d1/da/d14/d18/d6d/dc2 39 2024-02-15T22:41:23.970 INFO:tasks.workunit.client.1.smithi082.stdout:7/885: write d12/d17/d42/d67/f7a [2169452,35293] 0 2024-02-15T22:41:23.981 INFO:tasks.workunit.client.1.smithi082.stdout:3/847: creat d0/dc/d3f/deb/f11e x:0 0 0 2024-02-15T22:41:23.983 INFO:tasks.workunit.client.1.smithi082.stdout:6/892: mknod d2/d18/d10f/c126 0 2024-02-15T22:41:23.983 INFO:tasks.workunit.client.1.smithi082.stdout:6/893: chown d2/f52 14 1 2024-02-15T22:41:23.984 INFO:tasks.workunit.client.1.smithi082.stdout:5/932: unlink d5/da/d67/dbf/cd1 0 2024-02-15T22:41:23.986 INFO:tasks.workunit.client.1.smithi082.stdout:9/871: creat d8/d24/d87/de0/d7c/da1/f112 x:0 0 0 2024-02-15T22:41:23.986 INFO:tasks.workunit.client.1.smithi082.stdout:9/872: getdents d8/d24/d87/dcb/de5 0 2024-02-15T22:41:23.986 INFO:tasks.workunit.client.1.smithi082.stdout:9/873: readlink d8/d24/d87/dcb/ld4 0 2024-02-15T22:41:23.986 INFO:tasks.workunit.client.1.smithi082.stdout:9/874: dread - d8/d24/d2e/d53/f10e zero size 2024-02-15T22:41:23.989 INFO:tasks.workunit.client.1.smithi082.stdout:0/850: creat d3/d6b/d7f/f12e x:0 0 0 2024-02-15T22:41:23.989 INFO:tasks.workunit.client.1.smithi082.stdout:0/851: write d3/d6b/dac/fda [5059465,130583] 0 2024-02-15T22:41:23.989 INFO:tasks.workunit.client.1.smithi082.stdout:0/852: fsync d3/d19/d20/d7c/dd5/deb/ff1 0 2024-02-15T22:41:23.990 INFO:tasks.workunit.client.1.smithi082.stdout:0/853: write d3/d19/f7e [113082,101333] 0 2024-02-15T22:41:23.990 INFO:tasks.workunit.client.1.smithi082.stdout:0/854: dread - d3/d19/d93/dbe/fce zero size 2024-02-15T22:41:23.991 INFO:tasks.workunit.client.1.smithi082.stdout:1/833: dwrite d1/da/d14/d18/d6d/fd8 [0,4194304] 0 2024-02-15T22:41:23.991 INFO:tasks.workunit.client.1.smithi082.stdout:8/806: creat d1/d40/dbb/dff/da6/db6/dca/f113 x:0 0 0 2024-02-15T22:41:23.992 INFO:tasks.workunit.client.1.smithi082.stdout:6/894: dread d2/f5c [0,4194304] 0 2024-02-15T22:41:23.992 INFO:tasks.workunit.client.1.smithi082.stdout:6/895: write d2/d30/da6/fec [771015,27393] 0 2024-02-15T22:41:23.994 INFO:tasks.workunit.client.1.smithi082.stdout:5/933: write d5/da/dc/dad/dcf/f2d [1073388,104850] 0 2024-02-15T22:41:23.994 INFO:tasks.workunit.client.1.smithi082.stdout:5/934: write d5/da/d67/da0/fc5 [527745,27079] 0 2024-02-15T22:41:23.994 INFO:tasks.workunit.client.1.smithi082.stdout:5/935: write d5/dd8/f10b [549285,106597] 0 2024-02-15T22:41:23.999 INFO:tasks.workunit.client.1.smithi082.stdout:3/848: chown d0/dc/c18 4453 1 2024-02-15T22:41:24.004 INFO:tasks.workunit.client.1.smithi082.stdout:9/875: dwrite d8/d24/d87/de0/daf/fb3 [0,4194304] 0 2024-02-15T22:41:24.004 INFO:tasks.workunit.client.1.smithi082.stdout:9/876: stat d8/d12/dc5/ce9 0 2024-02-15T22:41:24.004 INFO:tasks.workunit.client.1.smithi082.stdout:9/877: read d8/d24/d87/de0/d7c/f94 [2943682,3324] 0 2024-02-15T22:41:24.006 INFO:tasks.workunit.client.1.smithi082.stdout:2/822: sync 2024-02-15T22:41:24.007 INFO:tasks.workunit.client.1.smithi082.stdout:0/855: creat d3/d19/d1c/d76/f12f x:0 0 0 2024-02-15T22:41:24.011 INFO:tasks.workunit.client.1.smithi082.stdout:1/834: creat d1/da/d11/d93/f111 x:0 0 0 2024-02-15T22:41:24.012 INFO:tasks.workunit.client.1.smithi082.stdout:1/835: readlink d1/da/d11/d3f/d75/lf2 0 2024-02-15T22:41:24.012 INFO:tasks.workunit.client.1.smithi082.stdout:1/836: read - d1/da/d14/d18/d1f/d76/fe1 zero size 2024-02-15T22:41:24.013 INFO:tasks.workunit.client.1.smithi082.stdout:8/807: mknod d1/d40/dbb/dff/d85/c114 0 2024-02-15T22:41:24.016 INFO:tasks.workunit.client.1.smithi082.stdout:6/896: mknod d2/d18/d8a/d47/d116/c127 0 2024-02-15T22:41:24.016 INFO:tasks.workunit.client.1.smithi082.stdout:6/897: readlink d2/d18/d8a/l55 0 2024-02-15T22:41:24.023 INFO:tasks.workunit.client.1.smithi082.stdout:3/849: rename d0/l1d to d0/d16/d62/d14/d21/d69/dbe/l11f 0 2024-02-15T22:41:24.023 INFO:tasks.workunit.client.1.smithi082.stdout:3/850: chown d0/d16/d62/f31 200076598 1 2024-02-15T22:41:24.027 INFO:tasks.workunit.client.1.smithi082.stdout:1/837: write d1/da/f24 [4155729,38108] 0 2024-02-15T22:41:24.027 INFO:tasks.workunit.client.1.smithi082.stdout:2/823: dwrite d6/dc/f38 [0,4194304] 0 2024-02-15T22:41:24.027 INFO:tasks.workunit.client.1.smithi082.stdout:2/824: write d6/d18/fd9 [1028999,128660] 0 2024-02-15T22:41:24.027 INFO:tasks.workunit.client.1.smithi082.stdout:8/808: read d1/d40/dbb/dff/da6/db8/ff9 [1210011,50618] 0 2024-02-15T22:41:24.028 INFO:tasks.workunit.client.1.smithi082.stdout:1/838: dread d1/da/d14/d18/d1f/d2f/f3e [0,4194304] 0 2024-02-15T22:41:24.030 INFO:tasks.workunit.client.1.smithi082.stdout:6/898: dread d2/d18/d23/f9d [0,4194304] 0 2024-02-15T22:41:24.033 INFO:tasks.workunit.client.1.smithi082.stdout:9/878: mkdir d8/d24/d87/de0/d77/dc6/d113 0 2024-02-15T22:41:24.033 INFO:tasks.workunit.client.1.smithi082.stdout:8/809: write d1/f5 [2258033,48321] 0 2024-02-15T22:41:24.036 INFO:tasks.workunit.client.1.smithi082.stdout:0/856: creat d3/d19/d20/d7c/dd5/deb/da5/d99/db3/de9/f130 x:0 0 0 2024-02-15T22:41:24.038 INFO:tasks.workunit.client.1.smithi082.stdout:3/851: mkdir d0/d16/d62/d14/d71/df4/d120 0 2024-02-15T22:41:24.038 INFO:tasks.workunit.client.1.smithi082.stdout:3/852: chown d0/d16/d3e/d56/f10f 550 1 2024-02-15T22:41:24.040 INFO:tasks.workunit.client.1.smithi082.stdout:9/879: dread d8/d24/d2e/f38 [0,4194304] 0 2024-02-15T22:41:24.042 INFO:tasks.workunit.client.1.smithi082.stdout:2/825: mknod d6/dc/dd/d24/d71/ded/cfa 0 2024-02-15T22:41:24.044 INFO:tasks.workunit.client.1.smithi082.stdout:1/839: mkdir d1/da/d14/d18/d6d/dc9/d112 0 2024-02-15T22:41:24.047 INFO:tasks.workunit.client.1.smithi082.stdout:6/899: link d2/d30/da6/faa d2/d18/f128 0 2024-02-15T22:41:24.049 INFO:tasks.workunit.client.1.smithi082.stdout:8/810: creat d1/d7/d9/d42/d6a/dc2/f115 x:0 0 0 2024-02-15T22:41:24.051 INFO:tasks.workunit.client.1.smithi082.stdout:0/857: mkdir d3/d19/d20/d7c/dd5/deb/d92/d131 0 2024-02-15T22:41:24.052 INFO:tasks.workunit.client.1.smithi082.stdout:3/853: symlink d0/d16/d62/d14/d21/d69/l121 0 2024-02-15T22:41:24.052 INFO:tasks.workunit.client.1.smithi082.stdout:3/854: fsync d0/d16/d62/d14/d21/d69/d6c/fd5 0 2024-02-15T22:41:24.052 INFO:tasks.workunit.client.1.smithi082.stdout:3/855: read d0/d16/d62/d14/d21/d69/d91/fa1 [542910,31839] 0 2024-02-15T22:41:24.056 INFO:tasks.workunit.client.1.smithi082.stdout:2/826: creat d6/dc/dd/d24/ffb x:0 0 0 2024-02-15T22:41:24.057 INFO:tasks.workunit.client.1.smithi082.stdout:0/858: write d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/ff0 [809330,6013] 0 2024-02-15T22:41:24.058 INFO:tasks.workunit.client.1.smithi082.stdout:0/859: chown d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/l116 860414 1 2024-02-15T22:41:24.071 INFO:tasks.workunit.client.1.smithi082.stdout:6/900: mkdir d2/d45/dc5/d129 0 2024-02-15T22:41:24.072 INFO:tasks.workunit.client.1.smithi082.stdout:2/827: dwrite d6/dc/f89 [0,4194304] 0 2024-02-15T22:41:24.072 INFO:tasks.workunit.client.1.smithi082.stdout:8/811: truncate d1/d7/de/d57/f74 3114953 0 2024-02-15T22:41:24.073 INFO:tasks.workunit.client.1.smithi082.stdout:8/812: dread - d1/d7/d9/d24/fe1 zero size 2024-02-15T22:41:24.075 INFO:tasks.workunit.client.1.smithi082.stdout:3/856: link d0/d16/d62/d79/fd4 d0/d16/d62/d14/d71/da2/f122 0 2024-02-15T22:41:24.075 INFO:tasks.workunit.client.1.smithi082.stdout:3/857: fsync d0/d16/d62/d14/d71/fac 0 2024-02-15T22:41:24.076 INFO:tasks.workunit.client.1.smithi082.stdout:3/858: read d0/d16/d62/d14/d21/d69/d6c/fd0 [109381,88500] 0 2024-02-15T22:41:24.081 INFO:tasks.workunit.client.1.smithi082.stdout:6/901: write d2/d18/f10b [1670584,10598] 0 2024-02-15T22:41:24.081 INFO:tasks.workunit.client.1.smithi082.stdout:6/902: creat d2/d18/f12a x:0 0 0 2024-02-15T22:41:24.081 INFO:tasks.workunit.client.1.smithi082.stdout:0/860: truncate d3/fe 3277984 0 2024-02-15T22:41:24.089 INFO:tasks.workunit.client.1.smithi082.stdout:9/880: rename d8/d24/d87/de0/d7c to d8/db5/d114 0 2024-02-15T22:41:24.092 INFO:tasks.workunit.client.1.smithi082.stdout:2/828: mkdir d6/dc/dd/d24/d71/dcb/dfc 0 2024-02-15T22:41:24.093 INFO:tasks.workunit.client.1.smithi082.stdout:3/859: symlink d0/d16/d3e/d10b/l123 0 2024-02-15T22:41:24.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/886: sync 2024-02-15T22:41:24.098 INFO:tasks.workunit.client.1.smithi082.stdout:7/887: chown d12/de4/d122/lb9 4 1 2024-02-15T22:41:24.099 INFO:tasks.workunit.client.1.smithi082.stdout:0/861: dwrite d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/fe4 [0,4194304] 0 2024-02-15T22:41:24.099 INFO:tasks.workunit.client.1.smithi082.stdout:0/862: fsync d3/d19/d20/f51 0 2024-02-15T22:41:24.100 INFO:tasks.workunit.client.1.smithi082.stdout:6/903: link d2/fa5 d2/d18/d8a/d47/d72/d80/d118/f12b 0 2024-02-15T22:41:24.103 INFO:tasks.workunit.client.1.smithi082.stdout:8/813: rename d1/d7/d9/d42/d6a/da5/ca7 to d1/d7/d9/d50/d56/dab/c116 0 2024-02-15T22:41:24.105 INFO:tasks.workunit.client.1.smithi082.stdout:9/881: creat d8/d24/d87/de0/d8b/f115 x:0 0 0 2024-02-15T22:41:24.105 INFO:tasks.workunit.client.1.smithi082.stdout:9/882: chown d8/d12/d67/d70/lc0 49 1 2024-02-15T22:41:24.106 INFO:tasks.workunit.client.1.smithi082.stdout:2/829: unlink d6/d18/f4c 0 2024-02-15T22:41:24.106 INFO:tasks.workunit.client.1.smithi082.stdout:2/830: chown d6/dc/dd/d24/f54 3 1 2024-02-15T22:41:24.106 INFO:tasks.workunit.client.1.smithi082.stdout:2/831: fsync d6/dc/d58/d49/f56 0 2024-02-15T22:41:24.107 INFO:tasks.workunit.client.1.smithi082.stdout:3/860: link d0/dc/d3f/deb/cf1 d0/d16/d3e/dc5/c124 0 2024-02-15T22:41:24.108 INFO:tasks.workunit.client.1.smithi082.stdout:3/861: stat d0/d16/d62/d2e/dcc 0 2024-02-15T22:41:24.112 INFO:tasks.workunit.client.1.smithi082.stdout:0/863: dwrite d3/d19/d20/d26/ffb [0,4194304] 0 2024-02-15T22:41:24.120 INFO:tasks.workunit.client.1.smithi082.stdout:6/904: mknod d2/d18/d8a/d65/c12c 0 2024-02-15T22:41:24.125 INFO:tasks.workunit.client.1.smithi082.stdout:7/888: rename d12/d27/d74/da2/ldb to d12/d27/d6e/d6a/db2/l129 0 2024-02-15T22:41:24.125 INFO:tasks.workunit.client.1.smithi082.stdout:7/889: fdatasync d12/d3b/d5a/dce/fab 0 2024-02-15T22:41:24.125 INFO:tasks.workunit.client.1.smithi082.stdout:7/890: dread - d12/d27/d74/ff0 zero size 2024-02-15T22:41:24.127 INFO:tasks.workunit.client.1.smithi082.stdout:8/814: creat d1/f117 x:0 0 0 2024-02-15T22:41:24.128 INFO:tasks.workunit.client.1.smithi082.stdout:3/862: dwrite d0/d16/d62/f50 [0,4194304] 0 2024-02-15T22:41:24.134 INFO:tasks.workunit.client.1.smithi082.stdout:2/832: creat d6/dc/d12/d23/da7/ffd x:0 0 0 2024-02-15T22:41:24.135 INFO:tasks.workunit.client.1.smithi082.stdout:2/833: readlink d6/dc/dd/d24/d72/la3 0 2024-02-15T22:41:24.135 INFO:tasks.workunit.client.1.smithi082.stdout:2/834: getdents d6/dc/dd/d24/d72/dbb 0 2024-02-15T22:41:24.135 INFO:tasks.workunit.client.1.smithi082.stdout:6/905: dwrite d2/d18/d8a/d47/d72/d80/fb4 [0,4194304] 0 2024-02-15T22:41:24.135 INFO:tasks.workunit.client.1.smithi082.stdout:5/936: sync 2024-02-15T22:41:24.149 INFO:tasks.workunit.client.1.smithi082.stdout:0/864: creat d3/d19/d20/d7c/dd5/f132 x:0 0 0 2024-02-15T22:41:24.150 INFO:tasks.workunit.client.1.smithi082.stdout:0/865: creat d3/d19/d20/d7c/dd5/deb/da5/d99/ddc/f133 x:0 0 0 2024-02-15T22:41:24.152 INFO:tasks.workunit.client.1.smithi082.stdout:9/883: unlink d8/d24/d87/de0/d77/dab/fae 0 2024-02-15T22:41:24.157 INFO:tasks.workunit.client.1.smithi082.stdout:8/815: truncate d1/d7/d9/d24/f8a 4024668 0 2024-02-15T22:41:24.161 INFO:tasks.workunit.client.1.smithi082.stdout:3/863: rename d0/d16/d62/d14/d21/d69/d6c/fd0 to d0/d16/d62/d79/f125 0 2024-02-15T22:41:24.163 INFO:tasks.workunit.client.1.smithi082.stdout:2/835: dwrite d6/dc/d12/d23/fc8 [0,4194304] 0 2024-02-15T22:41:24.166 INFO:tasks.workunit.client.1.smithi082.stdout:2/836: dread d6/d3c/d8c/fb5 [0,4194304] 0 2024-02-15T22:41:24.168 INFO:tasks.workunit.client.1.smithi082.stdout:5/937: dwrite d5/da/d67/da0/fc6 [0,4194304] 0 2024-02-15T22:41:24.170 INFO:tasks.workunit.client.1.smithi082.stdout:0/866: mkdir d3/d19/d25/d80/d134 0 2024-02-15T22:41:24.170 INFO:tasks.workunit.client.1.smithi082.stdout:7/891: truncate d12/f22 139317 0 2024-02-15T22:41:24.174 INFO:tasks.workunit.client.1.smithi082.stdout:8/816: symlink d1/d7/d9/d50/l118 0 2024-02-15T22:41:24.182 INFO:tasks.workunit.client.1.smithi082.stdout:5/938: read d5/da/f96 [1195100,104835] 0 2024-02-15T22:41:24.182 INFO:tasks.workunit.client.1.smithi082.stdout:5/939: chown d5/d102/d11d/d12d 28294 1 2024-02-15T22:41:24.182 INFO:tasks.workunit.client.1.smithi082.stdout:9/884: dwrite d8/d24/d87/de0/d8b/f115 [0,4194304] 0 2024-02-15T22:41:24.185 INFO:tasks.workunit.client.1.smithi082.stdout:3/864: dwrite d0/d16/d62/d14/fe4 [0,4194304] 0 2024-02-15T22:41:24.192 INFO:tasks.workunit.client.1.smithi082.stdout:1/840: sync 2024-02-15T22:41:24.192 INFO:tasks.workunit.client.1.smithi082.stdout:1/841: stat d1/da/d14/d7f 0 2024-02-15T22:41:24.194 INFO:tasks.workunit.client.1.smithi082.stdout:8/817: rename d1/d40/dbb/dff/d85/ce2 to d1/d40/dbb/dff/d85/c119 0 2024-02-15T22:41:24.196 INFO:tasks.workunit.client.1.smithi082.stdout:7/892: rmdir d12/d27 39 2024-02-15T22:41:24.199 INFO:tasks.workunit.client.1.smithi082.stdout:5/940: symlink d5/d102/d11d/d133/l138 0 2024-02-15T22:41:24.199 INFO:tasks.workunit.client.1.smithi082.stdout:5/941: fsync d5/da/dc/f3d 0 2024-02-15T22:41:24.200 INFO:tasks.workunit.client.1.smithi082.stdout:5/942: creat d5/da/de3/f139 x:0 0 0 2024-02-15T22:41:24.202 INFO:tasks.workunit.client.1.smithi082.stdout:8/818: truncate d1/d40/dbb/dff/d85/f97 3212595 0 2024-02-15T22:41:24.202 INFO:tasks.workunit.client.1.smithi082.stdout:8/819: readlink d1/d40/l111 0 2024-02-15T22:41:24.203 INFO:tasks.workunit.client.1.smithi082.stdout:8/820: write d1/d7/d9/d50/d56/dab/fc7 [900877,52998] 0 2024-02-15T22:41:24.203 INFO:tasks.workunit.client.1.smithi082.stdout:8/821: readlink d1/d7/d48/l35 0 2024-02-15T22:41:24.203 INFO:tasks.workunit.client.1.smithi082.stdout:2/837: dwrite d6/dc/fd5 [0,4194304] 0 2024-02-15T22:41:24.209 INFO:tasks.workunit.client.1.smithi082.stdout:7/893: rmdir d12/d37/dbd/de7 0 2024-02-15T22:41:24.209 INFO:tasks.workunit.client.1.smithi082.stdout:3/865: dwrite d0/dc/d3f/f76 [0,4194304] 0 2024-02-15T22:41:24.209 INFO:tasks.workunit.client.1.smithi082.stdout:0/867: dwrite d3/d19/d20/d7c/dd5/deb/fad [0,4194304] 0 2024-02-15T22:41:24.209 INFO:tasks.workunit.client.1.smithi082.stdout:1/842: write d1/da/d14/fca [394850,119375] 0 2024-02-15T22:41:24.209 INFO:tasks.workunit.client.1.smithi082.stdout:0/868: chown d3/d19/d20/d7c/dd5/deb/da5/d99/db3/lff 7209278 1 2024-02-15T22:41:24.213 INFO:tasks.workunit.client.1.smithi082.stdout:5/943: unlink d5/da/de3/de9/c128 0 2024-02-15T22:41:24.213 INFO:tasks.workunit.client.1.smithi082.stdout:5/944: chown d5/da/d67/f10f 9523 1 2024-02-15T22:41:24.213 INFO:tasks.workunit.client.1.smithi082.stdout:5/945: chown d5/d102 3178595 1 2024-02-15T22:41:24.224 INFO:tasks.workunit.client.1.smithi082.stdout:7/894: unlink d12/d17/d42/d67/d81/d91/da0/lb4 0 2024-02-15T22:41:24.235 INFO:tasks.workunit.client.1.smithi082.stdout:8/822: dwrite d1/d7/f62 [4194304,4194304] 0 2024-02-15T22:41:24.235 INFO:tasks.workunit.client.1.smithi082.stdout:6/906: dwrite d2/d30/d3b/f42 [4194304,4194304] 0 2024-02-15T22:41:24.235 INFO:tasks.workunit.client.1.smithi082.stdout:2/838: dwrite d6/dc/d58/d49/d5e/d67/ff3 [0,4194304] 0 2024-02-15T22:41:24.235 INFO:tasks.workunit.client.1.smithi082.stdout:3/866: dwrite d0/d16/d62/d14/d71/df4/fe9 [0,4194304] 0 2024-02-15T22:41:24.243 INFO:tasks.workunit.client.1.smithi082.stdout:5/946: creat d5/da/dc/dad/dcf/f13a x:0 0 0 2024-02-15T22:41:24.243 INFO:tasks.workunit.client.1.smithi082.stdout:5/947: creat d5/da/dc/d43/f13b x:0 0 0 2024-02-15T22:41:24.245 INFO:tasks.workunit.client.1.smithi082.stdout:7/895: truncate d12/d17/d42/f87 2652758 0 2024-02-15T22:41:24.250 INFO:tasks.workunit.client.1.smithi082.stdout:8/823: link d1/d7/d9/d24/l59 d1/d40/dbb/dff/da6/db8/l11a 0 2024-02-15T22:41:24.253 INFO:tasks.workunit.client.1.smithi082.stdout:6/907: dwrite d2/d18/d8a/d65/f7f [4194304,4194304] 0 2024-02-15T22:41:24.253 INFO:tasks.workunit.client.1.smithi082.stdout:6/908: fdatasync d2/d45/dc5/fd6 0 2024-02-15T22:41:24.258 INFO:tasks.workunit.client.1.smithi082.stdout:2/839: truncate d6/dc/d58/d49/fa2 238488 0 2024-02-15T22:41:24.258 INFO:tasks.workunit.client.1.smithi082.stdout:2/840: chown d6/dc/dd/f8a 235 1 2024-02-15T22:41:24.265 INFO:tasks.workunit.client.1.smithi082.stdout:3/867: symlink d0/d16/d62/d14/d21/d69/d87/l126 0 2024-02-15T22:41:24.267 INFO:tasks.workunit.client.1.smithi082.stdout:1/843: mkdir d1/d113 0 2024-02-15T22:41:24.269 INFO:tasks.workunit.client.1.smithi082.stdout:8/824: dwrite d1/d40/dbb/dff/d85/fb2 [0,4194304] 0 2024-02-15T22:41:24.274 INFO:tasks.workunit.client.1.smithi082.stdout:2/841: write d6/dc/dd/d1d/fd6 [1695439,50380] 0 2024-02-15T22:41:24.274 INFO:tasks.workunit.client.1.smithi082.stdout:2/842: chown d6/dc/d58/d49/db6/fe0 609 1 2024-02-15T22:41:24.274 INFO:tasks.workunit.client.1.smithi082.stdout:0/869: getdents d3/d19/d20/d7c/dd5/deb/da0 0 2024-02-15T22:41:24.281 INFO:tasks.workunit.client.1.smithi082.stdout:5/948: creat d5/da/dc/dad/dcf/d59/d84/f13c x:0 0 0 2024-02-15T22:41:24.285 INFO:tasks.workunit.client.1.smithi082.stdout:7/896: mkdir d12/d27/d12a 0 2024-02-15T22:41:24.292 INFO:tasks.workunit.client.1.smithi082.stdout:8/825: dwrite d1/d7/d9/d24/d30/f4b [0,4194304] 0 2024-02-15T22:41:24.292 INFO:tasks.workunit.client.1.smithi082.stdout:1/844: dwrite d1/da/d14/d18/d1f/d2f/f95 [0,4194304] 0 2024-02-15T22:41:24.308 INFO:tasks.workunit.client.1.smithi082.stdout:2/843: rename d6/dc/dd/d21/d9f/cf4 to d6/dc/d58/d49/dec/cfe 0 2024-02-15T22:41:24.308 INFO:tasks.workunit.client.1.smithi082.stdout:2/844: creat d6/dc/d12/d23/d6e/fff x:0 0 0 2024-02-15T22:41:24.308 INFO:tasks.workunit.client.1.smithi082.stdout:2/845: chown d6/dc/dd/d24/f39 0 1 2024-02-15T22:41:24.309 INFO:tasks.workunit.client.1.smithi082.stdout:3/868: dread d0/dc/d3f/f49 [0,4194304] 0 2024-02-15T22:41:24.309 INFO:tasks.workunit.client.1.smithi082.stdout:3/869: write d0/d16/d62/d14/f40 [106389,71519] 0 2024-02-15T22:41:24.309 INFO:tasks.workunit.client.1.smithi082.stdout:8/826: dread d1/d7/d9/d42/fd5 [0,4194304] 0 2024-02-15T22:41:24.310 INFO:tasks.workunit.client.1.smithi082.stdout:3/870: read d0/d16/d62/d14/d71/da2/f9d [2457,69161] 0 2024-02-15T22:41:24.310 INFO:tasks.workunit.client.1.smithi082.stdout:0/870: mkdir d3/d19/d135 0 2024-02-15T22:41:24.314 INFO:tasks.workunit.client.1.smithi082.stdout:5/949: truncate d5/da/d14/d45/f58 122186 0 2024-02-15T22:41:24.316 INFO:tasks.workunit.client.1.smithi082.stdout:7/897: mkdir d12/d17/d42/d67/d81/dc0/d12b 0 2024-02-15T22:41:24.319 INFO:tasks.workunit.client.1.smithi082.stdout:6/909: getdents d2/d18/d8a/d47/d72 0 2024-02-15T22:41:24.322 INFO:tasks.workunit.client.1.smithi082.stdout:2/846: dwrite d6/dc/dd/d21/d9f/fe1 [0,4194304] 0 2024-02-15T22:41:24.323 INFO:tasks.workunit.client.1.smithi082.stdout:2/847: fdatasync d6/dc/dd/d24/d71/f7a 0 2024-02-15T22:41:24.323 INFO:tasks.workunit.client.1.smithi082.stdout:9/885: sync 2024-02-15T22:41:24.323 INFO:tasks.workunit.client.1.smithi082.stdout:9/886: stat d8/d24/c61 0 2024-02-15T22:41:24.325 INFO:tasks.workunit.client.1.smithi082.stdout:2/848: read d6/dc/d12/d46/d4b/d63/fb0 [740515,36278] 0 2024-02-15T22:41:24.328 INFO:tasks.workunit.client.1.smithi082.stdout:1/845: mknod d1/da/d14/d18/d1f/d7a/c114 0 2024-02-15T22:41:24.330 INFO:tasks.workunit.client.1.smithi082.stdout:8/827: getdents d1/d40/dbb/dff/da6/db8 0 2024-02-15T22:41:24.330 INFO:tasks.workunit.client.1.smithi082.stdout:8/828: fsync d1/f117 0 2024-02-15T22:41:24.330 INFO:tasks.workunit.client.1.smithi082.stdout:8/829: fdatasync d1/f4f 0 2024-02-15T22:41:24.331 INFO:tasks.workunit.client.1.smithi082.stdout:3/871: symlink d0/d16/d62/d14/d21/d69/de6/l127 0 2024-02-15T22:41:24.332 INFO:tasks.workunit.client.1.smithi082.stdout:3/872: truncate d0/d16/f1f 5104686 0 2024-02-15T22:41:24.332 INFO:tasks.workunit.client.1.smithi082.stdout:0/871: link d3/d19/d25/d45/l1b d3/d19/d1c/l136 0 2024-02-15T22:41:24.335 INFO:tasks.workunit.client.1.smithi082.stdout:7/898: creat d12/d17/d42/d67/d81/dc0/d12b/f12c x:0 0 0 2024-02-15T22:41:24.336 INFO:tasks.workunit.client.1.smithi082.stdout:6/910: rmdir d2/d45/d123 0 2024-02-15T22:41:24.342 INFO:tasks.workunit.client.1.smithi082.stdout:3/873: dread d0/d16/d62/d14/d21/d69/f82 [4194304,4194304] 0 2024-02-15T22:41:24.342 INFO:tasks.workunit.client.1.smithi082.stdout:3/874: write d0/dc/d3f/f78 [1503359,99581] 0 2024-02-15T22:41:24.345 INFO:tasks.workunit.client.1.smithi082.stdout:9/887: getdents d8/d24/d87/de0/d77/dc6/de6 0 2024-02-15T22:41:24.345 INFO:tasks.workunit.client.1.smithi082.stdout:9/888: creat d8/d12/d30/d3c/d65/d10b/f116 x:0 0 0 2024-02-15T22:41:24.345 INFO:tasks.workunit.client.1.smithi082.stdout:9/889: readlink d8/d12/d33/l75 0 2024-02-15T22:41:24.346 INFO:tasks.workunit.client.1.smithi082.stdout:0/872: dread d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/fe4 [0,4194304] 0 2024-02-15T22:41:24.348 INFO:tasks.workunit.client.1.smithi082.stdout:2/849: rename d6/dc/d12/d23/da7/ffd to d6/d3c/f100 0 2024-02-15T22:41:24.350 INFO:tasks.workunit.client.1.smithi082.stdout:1/846: truncate d1/da/d14/d18/f3a 3784239 0 2024-02-15T22:41:24.352 INFO:tasks.workunit.client.1.smithi082.stdout:8/830: mkdir d1/d7/d11b 0 2024-02-15T22:41:24.352 INFO:tasks.workunit.client.1.smithi082.stdout:8/831: write d1/d7/d9/d42/dc5/f98 [488568,13445] 0 2024-02-15T22:41:24.353 INFO:tasks.workunit.client.1.smithi082.stdout:7/899: mknod d12/d27/dc2/c12d 0 2024-02-15T22:41:24.353 INFO:tasks.workunit.client.1.smithi082.stdout:0/873: dread d3/d19/d20/d26/f6a [4194304,4194304] 0 2024-02-15T22:41:24.357 INFO:tasks.workunit.client.1.smithi082.stdout:6/911: rename d2/f3 to d2/d18/d8a/d47/d69/d75/f12d 0 2024-02-15T22:41:24.361 INFO:tasks.workunit.client.1.smithi082.stdout:1/847: link d1/da/d14/d7f/cff d1/da/d14/d18/d1f/d2f/c115 0 2024-02-15T22:41:24.361 INFO:tasks.workunit.client.1.smithi082.stdout:1/848: stat d1/da/d14/d18/d51/f81 0 2024-02-15T22:41:24.364 INFO:tasks.workunit.client.1.smithi082.stdout:8/832: rmdir d1/d7/d11b 0 2024-02-15T22:41:24.366 INFO:tasks.workunit.client.1.smithi082.stdout:0/874: symlink d3/d19/d93/d107/l137 0 2024-02-15T22:41:24.367 INFO:tasks.workunit.client.1.smithi082.stdout:9/890: dread d8/d12/dc5/f72 [0,4194304] 0 2024-02-15T22:41:24.367 INFO:tasks.workunit.client.1.smithi082.stdout:9/891: write d8/d24/d87/de0/d77/dab/fd8 [194742,29931] 0 2024-02-15T22:41:24.367 INFO:tasks.workunit.client.1.smithi082.stdout:9/892: creat d8/d12/d30/d3c/d65/f117 x:0 0 0 2024-02-15T22:41:24.368 INFO:tasks.workunit.client.1.smithi082.stdout:3/875: dwrite d0/d16/d62/f36 [0,4194304] 0 2024-02-15T22:41:24.368 INFO:tasks.workunit.client.1.smithi082.stdout:3/876: fsync d0/d16/d62/d79/f125 0 2024-02-15T22:41:24.370 INFO:tasks.workunit.client.1.smithi082.stdout:2/850: rename d6/dc/dd/d24/l78 to d6/dc/dd/d24/d72/dbb/l101 0 2024-02-15T22:41:24.371 INFO:tasks.workunit.client.1.smithi082.stdout:2/851: fdatasync d6/dc/dd/d1d/fbd 0 2024-02-15T22:41:24.372 INFO:tasks.workunit.client.1.smithi082.stdout:6/912: symlink d2/d18/d8a/d47/d69/dd0/l12e 0 2024-02-15T22:41:24.372 INFO:tasks.workunit.client.1.smithi082.stdout:3/877: dread d0/d16/d62/d14/d21/f35 [0,4194304] 0 2024-02-15T22:41:24.372 INFO:tasks.workunit.client.1.smithi082.stdout:3/878: chown d0/d16/d62/d14/d21 79138 1 2024-02-15T22:41:24.372 INFO:tasks.workunit.client.1.smithi082.stdout:7/900: dwrite d12/d17/f1a [0,4194304] 0 2024-02-15T22:41:24.374 INFO:tasks.workunit.client.1.smithi082.stdout:1/849: creat d1/da/d14/d18/d1f/d76/da7/d110/f116 x:0 0 0 2024-02-15T22:41:24.376 INFO:tasks.workunit.client.1.smithi082.stdout:8/833: getdents d1/d40/dbb/dff/da6/db6 0 2024-02-15T22:41:24.380 INFO:tasks.workunit.client.1.smithi082.stdout:9/893: mkdir d8/d12/d30/d3c/d118 0 2024-02-15T22:41:24.384 INFO:tasks.workunit.client.1.smithi082.stdout:2/852: creat d6/dc/d58/d49/d5e/f102 x:0 0 0 2024-02-15T22:41:24.384 INFO:tasks.workunit.client.1.smithi082.stdout:2/853: readlink d6/dc/d12/l32 0 2024-02-15T22:41:24.384 INFO:tasks.workunit.client.1.smithi082.stdout:2/854: fdatasync d6/dc/dd/d24/d71/f7a 0 2024-02-15T22:41:24.384 INFO:tasks.workunit.client.1.smithi082.stdout:2/855: creat d6/dc/d12/d23/d6e/f103 x:0 0 0 2024-02-15T22:41:24.386 INFO:tasks.workunit.client.1.smithi082.stdout:6/913: symlink d2/d18/d8a/d47/d69/d75/l12f 0 2024-02-15T22:41:24.386 INFO:tasks.workunit.client.1.smithi082.stdout:6/914: dread - d2/d18/d8a/d47/d72/d80/d118/fdb zero size 2024-02-15T22:41:24.386 INFO:tasks.workunit.client.1.smithi082.stdout:3/879: dread d0/d16/f1f [0,4194304] 0 2024-02-15T22:41:24.387 INFO:tasks.workunit.client.1.smithi082.stdout:0/875: dwrite d3/fe [0,4194304] 0 2024-02-15T22:41:24.387 INFO:tasks.workunit.client.1.smithi082.stdout:0/876: chown d3/d19/d1c 0 1 2024-02-15T22:41:24.387 INFO:tasks.workunit.client.1.smithi082.stdout:0/877: write d3/d19/d20/d7c/dd5/deb/da5/d99/ddc/f133 [51742,30685] 0 2024-02-15T22:41:24.389 INFO:tasks.workunit.client.1.smithi082.stdout:7/901: rename d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/df5 to d12/d27/d6e/d6a/db2/dbb/d12e 0 2024-02-15T22:41:24.389 INFO:tasks.workunit.client.1.smithi082.stdout:7/902: chown d12/d17/d42/c6c 47692355 1 2024-02-15T22:41:24.392 INFO:tasks.workunit.client.1.smithi082.stdout:1/850: creat d1/da/d11/d93/d102/f117 x:0 0 0 2024-02-15T22:41:24.392 INFO:tasks.workunit.client.1.smithi082.stdout:1/851: read - d1/da/d14/d18/d6d/dc9/fef zero size 2024-02-15T22:41:24.392 INFO:tasks.workunit.client.1.smithi082.stdout:1/852: stat d1/da/d11/d93/db6/dc5 0 2024-02-15T22:41:24.392 INFO:tasks.workunit.client.1.smithi082.stdout:1/853: write d1/da/d14/d18/d1f/d7a/ddb/fec [4405569,117456] 0 2024-02-15T22:41:24.393 INFO:tasks.workunit.client.1.smithi082.stdout:8/834: creat d1/dcc/f11c x:0 0 0 2024-02-15T22:41:24.397 INFO:tasks.workunit.client.1.smithi082.stdout:2/856: mkdir d6/dc/d12/d46/d76/dae/de8/d104 0 2024-02-15T22:41:24.397 INFO:tasks.workunit.client.1.smithi082.stdout:2/857: write d6/d18/f75 [4977994,6612] 0 2024-02-15T22:41:24.398 INFO:tasks.workunit.client.1.smithi082.stdout:0/878: symlink d3/d19/d1c/l138 0 2024-02-15T22:41:24.398 INFO:tasks.workunit.client.1.smithi082.stdout:9/894: dwrite d8/d12/d30/d3c/d65/d10b/f111 [0,4194304] 0 2024-02-15T22:41:24.399 INFO:tasks.workunit.client.1.smithi082.stdout:7/903: rename d12/d17/d42/d67/d81/dc0/d12b/f12c to d12/d17/d3d/f12f 0 2024-02-15T22:41:24.400 INFO:tasks.workunit.client.1.smithi082.stdout:1/854: creat d1/f118 x:0 0 0 2024-02-15T22:41:24.400 INFO:tasks.workunit.client.1.smithi082.stdout:6/915: write d2/d30/f86 [3823011,100425] 0 2024-02-15T22:41:24.402 INFO:tasks.workunit.client.1.smithi082.stdout:2/858: unlink d6/dc/dd/d24/d72/fc4 0 2024-02-15T22:41:24.404 INFO:tasks.workunit.client.1.smithi082.stdout:0/879: creat d3/d19/d20/d7c/dcf/d12b/f139 x:0 0 0 2024-02-15T22:41:24.412 INFO:tasks.workunit.client.1.smithi082.stdout:8/835: rename d1/d40/dbb/dff/da6/db8/cd3 to d1/c11d 0 2024-02-15T22:41:24.412 INFO:tasks.workunit.client.1.smithi082.stdout:7/904: creat d12/d17/d4d/d7d/f130 x:0 0 0 2024-02-15T22:41:24.412 INFO:tasks.workunit.client.1.smithi082.stdout:7/905: fsync d12/d3b/fea 0 2024-02-15T22:41:24.412 INFO:tasks.workunit.client.1.smithi082.stdout:7/906: write d12/d27/d6e/d6a/db2/f118 [152219,17119] 0 2024-02-15T22:41:24.414 INFO:tasks.workunit.client.1.smithi082.stdout:1/855: symlink d1/d57/l119 0 2024-02-15T22:41:24.414 INFO:tasks.workunit.client.1.smithi082.stdout:1/856: write d1/da/d14/d18/d51/f97 [330351,129674] 0 2024-02-15T22:41:24.414 INFO:tasks.workunit.client.1.smithi082.stdout:1/857: stat d1/da/d11/d3f 0 2024-02-15T22:41:24.416 INFO:tasks.workunit.client.1.smithi082.stdout:6/916: truncate d2/d18/d39/f7d 1517087 0 2024-02-15T22:41:24.418 INFO:tasks.workunit.client.1.smithi082.stdout:2/859: link d6/dc/d12/d23/cb9 d6/dc/d58/d49/d5e/d67/df6/c105 0 2024-02-15T22:41:24.419 INFO:tasks.workunit.client.1.smithi082.stdout:3/880: dwrite d0/d16/d62/d14/d71/fff [0,4194304] 0 2024-02-15T22:41:24.419 INFO:tasks.workunit.client.1.smithi082.stdout:9/895: dwrite d8/d24/d87/de0/fef [0,4194304] 0 2024-02-15T22:41:24.420 INFO:tasks.workunit.client.1.smithi082.stdout:8/836: truncate d1/d40/dbb/fc6 3145302 0 2024-02-15T22:41:24.422 INFO:tasks.workunit.client.1.smithi082.stdout:7/907: creat d12/d27/d6e/d6a/db2/dbb/dc6/f131 x:0 0 0 2024-02-15T22:41:24.423 INFO:tasks.workunit.client.1.smithi082.stdout:6/917: getdents d2/d18/d8a/d47/d116 0 2024-02-15T22:41:24.439 INFO:tasks.workunit.client.1.smithi082.stdout:6/918: dwrite d2/d18/d8a/d65/fcd [0,4194304] 0 2024-02-15T22:41:24.439 INFO:tasks.workunit.client.1.smithi082.stdout:6/919: read - d2/d18/d8a/d47/f105 zero size 2024-02-15T22:41:24.441 INFO:tasks.workunit.client.1.smithi082.stdout:6/920: dread d2/d30/da6/fc3 [0,4194304] 0 2024-02-15T22:41:24.445 INFO:tasks.workunit.client.1.smithi082.stdout:9/896: mkdir d8/d24/d87/de0/d8b/d119 0 2024-02-15T22:41:24.447 INFO:tasks.workunit.client.1.smithi082.stdout:8/837: symlink d1/d7/de/d10c/l11e 0 2024-02-15T22:41:24.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/908: link d12/d27/d74/f128 d12/d27/dc4/f132 0 2024-02-15T22:41:24.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/909: stat d12/d37/d85/dcc/f10e 0 2024-02-15T22:41:24.450 INFO:tasks.workunit.client.1.smithi082.stdout:2/860: getdents d6/dc/d12/d23/da7 0 2024-02-15T22:41:24.465 INFO:tasks.workunit.client.1.smithi082.stdout:9/897: unlink d8/f11 0 2024-02-15T22:41:24.465 INFO:tasks.workunit.client.1.smithi082.stdout:9/898: chown d8/db5/fd6 454 1 2024-02-15T22:41:24.466 INFO:tasks.workunit.client.1.smithi082.stdout:8/838: mknod d1/dcc/c11f 0 2024-02-15T22:41:24.466 INFO:tasks.workunit.client.1.smithi082.stdout:8/839: write d1/d7/d9/d42/dc5/f98 [1072965,58671] 0 2024-02-15T22:41:24.466 INFO:tasks.workunit.client.1.smithi082.stdout:9/899: write d8/d12/d33/da4/dac/ff3 [433921,22031] 0 2024-02-15T22:41:24.466 INFO:tasks.workunit.client.1.smithi082.stdout:9/900: readlink d8/d24/d87/de0/l74 0 2024-02-15T22:41:24.466 INFO:tasks.workunit.client.1.smithi082.stdout:8/840: write d1/d40/dbb/dff/fae [4965694,106142] 0 2024-02-15T22:41:24.467 INFO:tasks.workunit.client.1.smithi082.stdout:9/901: symlink d8/d24/d2e/l11a 0 2024-02-15T22:41:24.469 INFO:tasks.workunit.client.1.smithi082.stdout:0/880: rename d3/d19/d20/d7c/dd5/deb/da5/d99/fa7 to d3/d19/d25/d45/f13a 0 2024-02-15T22:41:24.472 INFO:tasks.workunit.client.1.smithi082.stdout:8/841: mknod d1/d7/d9/d42/d6a/da5/ddd/c120 0 2024-02-15T22:41:24.473 INFO:tasks.workunit.client.1.smithi082.stdout:8/842: readlink d1/d7/d9/d24/d30/ld2 0 2024-02-15T22:41:24.475 INFO:tasks.workunit.client.1.smithi082.stdout:7/910: dwrite d12/d27/d6e/d6a/db2/dbb/dc6/f131 [0,4194304] 0 2024-02-15T22:41:24.475 INFO:tasks.workunit.client.1.smithi082.stdout:7/911: creat d12/d27/d6e/f133 x:0 0 0 2024-02-15T22:41:24.475 INFO:tasks.workunit.client.1.smithi082.stdout:7/912: stat d12/d17/d42/d67/d81/dc0/d12b 0 2024-02-15T22:41:24.475 INFO:tasks.workunit.client.1.smithi082.stdout:7/913: read d12/d27/d74/d8b/fc8 [460972,78864] 0 2024-02-15T22:41:24.475 INFO:tasks.workunit.client.1.smithi082.stdout:7/914: write d12/d27/d6e/f133 [28787,70531] 0 2024-02-15T22:41:24.476 INFO:tasks.workunit.client.1.smithi082.stdout:2/861: dwrite d6/dc/d12/db1/fb8 [0,4194304] 0 2024-02-15T22:41:24.477 INFO:tasks.workunit.client.1.smithi082.stdout:1/858: rename d1/da/d14/d18/d6d/dc2/cfb to d1/da/d11/c11a 0 2024-02-15T22:41:24.478 INFO:tasks.workunit.client.1.smithi082.stdout:0/881: creat d3/d19/d20/d7c/dd5/deb/da0/dbc/f13b x:0 0 0 2024-02-15T22:41:24.479 INFO:tasks.workunit.client.1.smithi082.stdout:8/843: truncate d1/d7/d9/f81 1745530 0 2024-02-15T22:41:24.481 INFO:tasks.workunit.client.1.smithi082.stdout:9/902: getdents d8/d24/d87/de0 0 2024-02-15T22:41:24.486 INFO:tasks.workunit.client.1.smithi082.stdout:0/882: write d3/d19/d25/d45/f18 [3256735,76768] 0 2024-02-15T22:41:24.487 INFO:tasks.workunit.client.1.smithi082.stdout:7/915: creat d12/d17/d42/d67/d81/d91/dbc/f134 x:0 0 0 2024-02-15T22:41:24.488 INFO:tasks.workunit.client.1.smithi082.stdout:2/862: mkdir d6/dc/dd/d24/d71/ded/d106 0 2024-02-15T22:41:24.490 INFO:tasks.workunit.client.1.smithi082.stdout:0/883: dread d3/d19/d20/d7c/dd5/deb/da5/d99/ddc/f133 [0,4194304] 0 2024-02-15T22:41:24.490 INFO:tasks.workunit.client.1.smithi082.stdout:3/881: rename d0/d16/d62/d14/d21/d69/de6/l127 to d0/d16/d62/d2e/dcc/l128 0 2024-02-15T22:41:24.493 INFO:tasks.workunit.client.1.smithi082.stdout:1/859: creat d1/da/d14/d18/d1f/d7a/de5/f11b x:0 0 0 2024-02-15T22:41:24.495 INFO:tasks.workunit.client.1.smithi082.stdout:8/844: creat d1/d7/de/d1e/ddb/f121 x:0 0 0 2024-02-15T22:41:24.496 INFO:tasks.workunit.client.1.smithi082.stdout:8/845: truncate d1/d7/d48/ffe 927999 0 2024-02-15T22:41:24.496 INFO:tasks.workunit.client.1.smithi082.stdout:8/846: write d1/f5 [2498770,20526] 0 2024-02-15T22:41:24.496 INFO:tasks.workunit.client.1.smithi082.stdout:8/847: stat d1/d7/d9/d42/d6a/f76 0 2024-02-15T22:41:24.496 INFO:tasks.workunit.client.1.smithi082.stdout:7/916: dread d12/d17/d42/f58 [0,4194304] 0 2024-02-15T22:41:24.496 INFO:tasks.workunit.client.1.smithi082.stdout:9/903: mkdir d8/d12/d11b 0 2024-02-15T22:41:24.497 INFO:tasks.workunit.client.1.smithi082.stdout:3/882: dread d0/d16/d3e/fca [0,4194304] 0 2024-02-15T22:41:24.497 INFO:tasks.workunit.client.1.smithi082.stdout:3/883: fsync d0/d16/d3e/d56/ff7 0 2024-02-15T22:41:24.498 INFO:tasks.workunit.client.1.smithi082.stdout:2/863: unlink d6/dc/dd/d24/c4a 0 2024-02-15T22:41:24.500 INFO:tasks.workunit.client.1.smithi082.stdout:0/884: mkdir d3/d19/d20/d7c/dd5/deb/d13c 0 2024-02-15T22:41:24.501 INFO:tasks.workunit.client.1.smithi082.stdout:1/860: mkdir d1/da/d14/d18/d6d/d89/d11c 0 2024-02-15T22:41:24.501 INFO:tasks.workunit.client.1.smithi082.stdout:1/861: fsync d1/da/d14/d18/ff7 0 2024-02-15T22:41:24.501 INFO:tasks.workunit.client.1.smithi082.stdout:1/862: dread - d1/da/d14/d18/d6d/dc9/fef zero size 2024-02-15T22:41:24.503 INFO:tasks.workunit.client.1.smithi082.stdout:8/848: mknod d1/d7/d9/d50/d56/dab/c122 0 2024-02-15T22:41:24.507 INFO:tasks.workunit.client.1.smithi082.stdout:9/904: creat d8/d12/d67/f11c x:0 0 0 2024-02-15T22:41:24.507 INFO:tasks.workunit.client.1.smithi082.stdout:9/905: fdatasync d8/d12/d33/da4/f103 0 2024-02-15T22:41:24.512 INFO:tasks.workunit.client.1.smithi082.stdout:3/884: unlink d0/d16/d62/d2e/f89 0 2024-02-15T22:41:24.512 INFO:tasks.workunit.client.1.smithi082.stdout:3/885: write d0/fa9 [1744466,808] 0 2024-02-15T22:41:24.512 INFO:tasks.workunit.client.1.smithi082.stdout:1/863: read d1/da/d11/d3f/ffa [928502,33906] 0 2024-02-15T22:41:24.512 INFO:tasks.workunit.client.1.smithi082.stdout:0/885: mknod d3/d19/d20/c13d 0 2024-02-15T22:41:24.512 INFO:tasks.workunit.client.1.smithi082.stdout:0/886: chown d3/d19/d20/d7c/dd5/deb/da5/d99/db1/d113 76837753 1 2024-02-15T22:41:24.512 INFO:tasks.workunit.client.1.smithi082.stdout:7/917: mknod d12/d17/da3/c135 0 2024-02-15T22:41:24.515 INFO:tasks.workunit.client.1.smithi082.stdout:2/864: dwrite d6/dc/d58/d49/d5e/d67/df6/ff8 [0,4194304] 0 2024-02-15T22:41:24.515 INFO:tasks.workunit.client.1.smithi082.stdout:9/906: creat d8/f11d x:0 0 0 2024-02-15T22:41:24.515 INFO:tasks.workunit.client.1.smithi082.stdout:2/865: chown d6/dc/dd/d24/f43 1 1 2024-02-15T22:41:24.515 INFO:tasks.workunit.client.1.smithi082.stdout:2/866: read d6/dc/dd/d24/f54 [39693,84453] 0 2024-02-15T22:41:24.516 INFO:tasks.workunit.client.1.smithi082.stdout:8/849: rmdir d1/d40/dbb/dff/da6/db8 39 2024-02-15T22:41:24.518 INFO:tasks.workunit.client.1.smithi082.stdout:1/864: truncate d1/da/d14/fca 1169723 0 2024-02-15T22:41:24.521 INFO:tasks.workunit.client.1.smithi082.stdout:0/887: link d3/d19/d20/d7c/dd5/f102 d3/d19/d20/d7c/dd5/deb/da0/f13e 0 2024-02-15T22:41:24.521 INFO:tasks.workunit.client.1.smithi082.stdout:0/888: dread - d3/d19/d20/d7c/dd5/f132 zero size 2024-02-15T22:41:24.522 INFO:tasks.workunit.client.1.smithi082.stdout:7/918: symlink d12/d27/d6e/l136 0 2024-02-15T22:41:24.529 INFO:tasks.workunit.client.1.smithi082.stdout:6/921: dread d2/d18/d39/f7d [0,4194304] 0 2024-02-15T22:41:24.531 INFO:tasks.workunit.client.1.smithi082.stdout:2/867: creat d6/dc/d58/f107 x:0 0 0 2024-02-15T22:41:24.531 INFO:tasks.workunit.client.1.smithi082.stdout:2/868: truncate d6/dc/fc7 1111173 0 2024-02-15T22:41:24.532 INFO:tasks.workunit.client.1.smithi082.stdout:3/886: mkdir d0/dc/d129 0 2024-02-15T22:41:24.534 INFO:tasks.workunit.client.1.smithi082.stdout:9/907: dwrite d8/d12/d30/d3c/d65/fe1 [0,4194304] 0 2024-02-15T22:41:24.535 INFO:tasks.workunit.client.1.smithi082.stdout:8/850: unlink d1/d7/d9/d42/f49 0 2024-02-15T22:41:24.535 INFO:tasks.workunit.client.1.smithi082.stdout:8/851: write d1/d7/d9/d50/fa8 [1892048,13371] 0 2024-02-15T22:41:24.537 INFO:tasks.workunit.client.1.smithi082.stdout:1/865: symlink d1/da/d11/d8c/l11d 0 2024-02-15T22:41:24.537 INFO:tasks.workunit.client.1.smithi082.stdout:1/866: stat d1/da/d14/d18/d1f/d2f/c4c 0 2024-02-15T22:41:24.537 INFO:tasks.workunit.client.1.smithi082.stdout:1/867: chown d1/da/d11/d8c/db3/f10e 170 1 2024-02-15T22:41:24.538 INFO:tasks.workunit.client.1.smithi082.stdout:0/889: mkdir d3/d19/d93/dbe/df4/d13f 0 2024-02-15T22:41:24.540 INFO:tasks.workunit.client.1.smithi082.stdout:6/922: creat d2/f130 x:0 0 0 2024-02-15T22:41:24.541 INFO:tasks.workunit.client.1.smithi082.stdout:2/869: symlink d6/dc/d12/d23/l108 0 2024-02-15T22:41:24.542 INFO:tasks.workunit.client.1.smithi082.stdout:3/887: link d0/d16/d62/d2e/d84/f64 d0/d16/d62/d14/d71/f12a 0 2024-02-15T22:41:24.565 INFO:tasks.workunit.client.1.smithi082.stdout:3/888: dwrite d0/d16/d62/f45 [4194304,4194304] 0 2024-02-15T22:41:24.573 INFO:tasks.workunit.client.1.smithi082.stdout:6/923: truncate d2/d18/d8a/f8f 630026 0 2024-02-15T22:41:24.575 INFO:tasks.workunit.client.1.smithi082.stdout:3/889: dread d0/d16/d62/f45 [4194304,4194304] 0 2024-02-15T22:41:24.577 INFO:tasks.workunit.client.1.smithi082.stdout:8/852: rmdir d1/d7/d9/d42/d6a/da5 39 2024-02-15T22:41:24.577 INFO:tasks.workunit.client.1.smithi082.stdout:8/853: stat d1/d40/dbb/dff 0 2024-02-15T22:41:24.577 INFO:tasks.workunit.client.1.smithi082.stdout:8/854: stat d1/d40/dbb/dff/da6/db6/fd7 0 2024-02-15T22:41:24.578 INFO:tasks.workunit.client.1.smithi082.stdout:5/950: sync 2024-02-15T22:41:24.579 INFO:tasks.workunit.client.1.smithi082.stdout:8/855: dread d1/d7/d9/d50/d56/f6b [0,4194304] 0 2024-02-15T22:41:24.582 INFO:tasks.workunit.client.1.smithi082.stdout:6/924: symlink d2/d18/d23/ddf/l131 0 2024-02-15T22:41:24.582 INFO:tasks.workunit.client.1.smithi082.stdout:6/925: write d2/d18/d8a/d47/d72/f10d [766532,37853] 0 2024-02-15T22:41:24.582 INFO:tasks.workunit.client.1.smithi082.stdout:6/926: chown d2/d18/d39/c43 21180 1 2024-02-15T22:41:24.586 INFO:tasks.workunit.client.1.smithi082.stdout:3/890: stat d0/dc/l15 0 2024-02-15T22:41:24.586 INFO:tasks.workunit.client.1.smithi082.stdout:2/870: read d6/dc/dd/d21/f36 [707488,57988] 0 2024-02-15T22:41:24.590 INFO:tasks.workunit.client.1.smithi082.stdout:5/951: chown d5/da/dc/dd5/c10e 35 1 2024-02-15T22:41:24.591 INFO:tasks.workunit.client.1.smithi082.stdout:6/927: creat d2/d18/d8a/da7/f132 x:0 0 0 2024-02-15T22:41:24.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/891: creat d0/f12b x:0 0 0 2024-02-15T22:41:24.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/892: readlink d0/d16/d62/d14/d21/d69/d6c/lfe 0 2024-02-15T22:41:24.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/893: chown d0/d16/d62/d14/d21/d69/d6c/ce3 89747 1 2024-02-15T22:41:24.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/894: chown d0/d16/d3e/d56/cfb 52 1 2024-02-15T22:41:24.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/895: dread - d0/d16/d62/d14/d21/d69/d6c/ff3 zero size 2024-02-15T22:41:24.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/896: chown d0/d16/d62/d14/d71/d86 77093 1 2024-02-15T22:41:24.595 INFO:tasks.workunit.client.1.smithi082.stdout:3/897: read d0/d16/d62/d14/d71/da2/f9d [373093,117600] 0 2024-02-15T22:41:24.597 INFO:tasks.workunit.client.1.smithi082.stdout:5/952: mkdir d5/da/dc/d13d 0 2024-02-15T22:41:24.599 INFO:tasks.workunit.client.1.smithi082.stdout:3/898: creat d0/d16/d62/d14/d21/dee/d11a/f12c x:0 0 0 2024-02-15T22:41:24.600 INFO:tasks.workunit.client.1.smithi082.stdout:3/899: chown d0/d16/d62/d14/d21/d69/d6c/l112 56611824 1 2024-02-15T22:41:24.602 INFO:tasks.workunit.client.1.smithi082.stdout:5/953: mknod d5/da/de3/d135/c13e 0 2024-02-15T22:41:24.604 INFO:tasks.workunit.client.1.smithi082.stdout:2/871: dread d6/dc/d12/fb4 [0,4194304] 0 2024-02-15T22:41:24.605 INFO:tasks.workunit.client.1.smithi082.stdout:5/954: rename d5/da/dc/fdc to d5/da/d67/dbf/f13f 0 2024-02-15T22:41:24.606 INFO:tasks.workunit.client.1.smithi082.stdout:5/955: rmdir d5/da/dc/d113 39 2024-02-15T22:41:24.608 INFO:tasks.workunit.client.1.smithi082.stdout:5/956: creat d5/da/d14/d53/f140 x:0 0 0 2024-02-15T22:41:24.608 INFO:tasks.workunit.client.1.smithi082.stdout:5/957: fsync d5/da/dc/f15 0 2024-02-15T22:41:24.624 INFO:tasks.workunit.client.1.smithi082.stdout:8/856: dwrite d1/dcc/f11c [0,4194304] 0 2024-02-15T22:41:24.624 INFO:tasks.workunit.client.1.smithi082.stdout:6/928: dwrite d2/d18/d8a/d47/f105 [0,4194304] 0 2024-02-15T22:41:24.624 INFO:tasks.workunit.client.1.smithi082.stdout:6/929: creat d2/d30/d3b/d10e/f133 x:0 0 0 2024-02-15T22:41:24.661 INFO:tasks.workunit.client.1.smithi082.stdout:8/857: symlink d1/d7/d9/d42/d6a/da5/ddd/l123 0 2024-02-15T22:41:24.666 INFO:tasks.workunit.client.1.smithi082.stdout:6/930: symlink d2/d30/d3b/d120/l134 0 2024-02-15T22:41:24.666 INFO:tasks.workunit.client.1.smithi082.stdout:6/931: write d2/d18/d23/f35 [2295163,23234] 0 2024-02-15T22:41:24.666 INFO:tasks.workunit.client.1.smithi082.stdout:6/932: truncate d2/d18/d8a/d47/d72/d80/d118/fdb 384845 0 2024-02-15T22:41:24.678 INFO:tasks.workunit.client.1.smithi082.stdout:8/858: creat d1/d7/d9/d50/f124 x:0 0 0 2024-02-15T22:41:24.684 INFO:tasks.workunit.client.1.smithi082.stdout:1/868: write d1/da/d14/fca [1661784,115642] 0 2024-02-15T22:41:24.691 INFO:tasks.workunit.client.1.smithi082.stdout:8/859: dread d1/d7/d9/d42/fd5 [0,4194304] 0 2024-02-15T22:41:24.693 INFO:tasks.workunit.client.1.smithi082.stdout:8/860: symlink d1/d7/d9/d24/d30/d75/l125 0 2024-02-15T22:41:24.695 INFO:tasks.workunit.client.1.smithi082.stdout:8/861: creat d1/d40/dbb/dff/d85/f126 x:0 0 0 2024-02-15T22:41:24.695 INFO:tasks.workunit.client.1.smithi082.stdout:8/862: getdents d1/d7/d9/d42/d6a/da5/dd4/dd8/df5 0 2024-02-15T22:41:24.696 INFO:tasks.workunit.client.1.smithi082.stdout:8/863: mknod d1/d40/dbb/dff/da6/db6/dca/c127 0 2024-02-15T22:41:24.698 INFO:tasks.workunit.client.1.smithi082.stdout:2/872: rmdir d6 39 2024-02-15T22:41:24.714 INFO:tasks.workunit.client.1.smithi082.stdout:8/864: dread d1/d40/dbb/dce/fd9 [0,4194304] 0 2024-02-15T22:41:24.716 INFO:tasks.workunit.client.1.smithi082.stdout:8/865: getdents d1/d7/d78 0 2024-02-15T22:41:24.726 INFO:tasks.workunit.client.1.smithi082.stdout:7/919: sync 2024-02-15T22:41:24.727 INFO:tasks.workunit.client.1.smithi082.stdout:1/869: dwrite d1/da/d14/d18/d1f/d76/da7/d110/f116 [0,4194304] 0 2024-02-15T22:41:24.728 INFO:tasks.workunit.client.1.smithi082.stdout:2/873: dwrite d6/dc/d12/d46/d76/ff7 [0,4194304] 0 2024-02-15T22:41:24.731 INFO:tasks.workunit.client.1.smithi082.stdout:8/866: dread d1/f3a [0,4194304] 0 2024-02-15T22:41:24.734 INFO:tasks.workunit.client.1.smithi082.stdout:1/870: creat d1/da/d14/d18/d6d/f11e x:0 0 0 2024-02-15T22:41:24.738 INFO:tasks.workunit.client.1.smithi082.stdout:2/874: mknod d6/dc/d58/d49/d5e/c109 0 2024-02-15T22:41:24.738 INFO:tasks.workunit.client.1.smithi082.stdout:2/875: truncate d6/dc/fd5 4516963 0 2024-02-15T22:41:24.745 INFO:tasks.workunit.client.1.smithi082.stdout:8/867: mknod d1/d40/dbb/dff/da6/db6/c128 0 2024-02-15T22:41:24.746 INFO:tasks.workunit.client.1.smithi082.stdout:7/920: write d12/f22 [802633,118561] 0 2024-02-15T22:41:24.747 INFO:tasks.workunit.client.1.smithi082.stdout:2/876: link d6/dc/f10 d6/dc/d12/f10a 0 2024-02-15T22:41:24.749 INFO:tasks.workunit.client.1.smithi082.stdout:8/868: link d1/d7/d9/d42/c8c d1/d40/dbb/dff/df1/c129 0 2024-02-15T22:41:24.753 INFO:tasks.workunit.client.1.smithi082.stdout:7/921: unlink d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/l127 0 2024-02-15T22:41:24.753 INFO:tasks.workunit.client.1.smithi082.stdout:7/922: creat d12/d17/d42/d67/d81/dc0/d12b/f137 x:0 0 0 2024-02-15T22:41:24.754 INFO:tasks.workunit.client.1.smithi082.stdout:7/923: write d12/d37/d85/f106 [400189,111949] 0 2024-02-15T22:41:24.754 INFO:tasks.workunit.client.1.smithi082.stdout:7/924: chown d12/d3b/f86 206 1 2024-02-15T22:41:24.754 INFO:tasks.workunit.client.1.smithi082.stdout:7/925: chown d12/d27/d74/ccd 608 1 2024-02-15T22:41:24.755 INFO:tasks.workunit.client.1.smithi082.stdout:1/871: dwrite d1/dc8/fcb [0,4194304] 0 2024-02-15T22:41:24.759 INFO:tasks.workunit.client.1.smithi082.stdout:7/926: mkdir d12/d27/d6e/d6a/d9e/dbe/dcb/d114/d138 0 2024-02-15T22:41:24.759 INFO:tasks.workunit.client.1.smithi082.stdout:7/927: fsync d12/d37/d85/f90 0 2024-02-15T22:41:24.759 INFO:tasks.workunit.client.1.smithi082.stdout:7/928: chown d12/d3b/d5a/f92 59394 1 2024-02-15T22:41:24.761 INFO:tasks.workunit.client.1.smithi082.stdout:2/877: dread d6/d18/f22 [0,4194304] 0 2024-02-15T22:41:24.762 INFO:tasks.workunit.client.1.smithi082.stdout:7/929: write d12/d17/f1a [4384197,56349] 0 2024-02-15T22:41:24.778 INFO:tasks.workunit.client.1.smithi082.stdout:1/872: dwrite d1/da/d14/d18/d6d/fd8 [4194304,4194304] 0 2024-02-15T22:41:24.778 INFO:tasks.workunit.client.1.smithi082.stdout:1/873: write d1/da/d14/fca [2728137,122476] 0 2024-02-15T22:41:24.778 INFO:tasks.workunit.client.1.smithi082.stdout:1/874: chown d1/da/d14/c91 277 1 2024-02-15T22:41:24.784 INFO:tasks.workunit.client.1.smithi082.stdout:8/869: rmdir d1/d7/de 39 2024-02-15T22:41:24.788 INFO:tasks.workunit.client.1.smithi082.stdout:2/878: creat d6/dc/dd/d24/d71/ded/d106/f10b x:0 0 0 2024-02-15T22:41:24.790 INFO:tasks.workunit.client.1.smithi082.stdout:0/890: sync 2024-02-15T22:41:24.790 INFO:tasks.workunit.client.1.smithi082.stdout:9/908: sync 2024-02-15T22:41:24.790 INFO:tasks.workunit.client.1.smithi082.stdout:0/891: stat d3/d6b/l7b 0 2024-02-15T22:41:24.790 INFO:tasks.workunit.client.1.smithi082.stdout:0/892: chown d3/d6b/dac/f11a 239257691 1 2024-02-15T22:41:24.790 INFO:tasks.workunit.client.1.smithi082.stdout:9/909: creat d8/d24/d2e/f11e x:0 0 0 2024-02-15T22:41:24.790 INFO:tasks.workunit.client.1.smithi082.stdout:0/893: fdatasync d3/d19/d25/d80/f111 0 2024-02-15T22:41:24.796 INFO:tasks.workunit.client.1.smithi082.stdout:7/930: getdents d12/d17/d3d/da8 0 2024-02-15T22:41:24.796 INFO:tasks.workunit.client.1.smithi082.stdout:7/931: creat d12/d17/d42/d67/d81/d91/dbc/f139 x:0 0 0 2024-02-15T22:41:24.800 INFO:tasks.workunit.client.1.smithi082.stdout:9/910: dread d8/d12/d67/d70/f76 [0,4194304] 0 2024-02-15T22:41:24.803 INFO:tasks.workunit.client.1.smithi082.stdout:6/933: sync 2024-02-15T22:41:24.803 INFO:tasks.workunit.client.1.smithi082.stdout:3/900: sync 2024-02-15T22:41:24.803 INFO:tasks.workunit.client.1.smithi082.stdout:5/958: sync 2024-02-15T22:41:24.803 INFO:tasks.workunit.client.1.smithi082.stdout:5/959: write d5/da/d14/f18 [1617983,56625] 0 2024-02-15T22:41:24.803 INFO:tasks.workunit.client.1.smithi082.stdout:5/960: fdatasync d5/da/dc/dad/dcf/d59/f5c 0 2024-02-15T22:41:24.803 INFO:tasks.workunit.client.1.smithi082.stdout:5/961: readlink d5/dd8/l106 0 2024-02-15T22:41:24.804 INFO:tasks.workunit.client.1.smithi082.stdout:8/870: dwrite d1/d40/dbb/dcf/ff0 [0,4194304] 0 2024-02-15T22:41:24.804 INFO:tasks.workunit.client.1.smithi082.stdout:8/871: stat d1/d7/d9/d42/d6a/da5/ddd/l123 0 2024-02-15T22:41:24.804 INFO:tasks.workunit.client.1.smithi082.stdout:1/875: mkdir d1/da/d14/db4/d11f 0 2024-02-15T22:41:24.806 INFO:tasks.workunit.client.1.smithi082.stdout:2/879: creat d6/dc/dd/d1d/f10c x:0 0 0 2024-02-15T22:41:24.806 INFO:tasks.workunit.client.1.smithi082.stdout:2/880: write d6/dc/d12/d46/d4b/fd0 [856695,76824] 0 2024-02-15T22:41:24.809 INFO:tasks.workunit.client.1.smithi082.stdout:0/894: mkdir d3/d19/d20/d26/d140 0 2024-02-15T22:41:24.812 INFO:tasks.workunit.client.1.smithi082.stdout:7/932: creat d12/d27/d6e/d6a/d9e/f13a x:0 0 0 2024-02-15T22:41:24.815 INFO:tasks.workunit.client.1.smithi082.stdout:9/911: rmdir d8/d24/d87/de0/d77/dc6/d113 0 2024-02-15T22:41:24.816 INFO:tasks.workunit.client.1.smithi082.stdout:0/895: dread d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/fe4 [0,4194304] 0 2024-02-15T22:41:24.819 INFO:tasks.workunit.client.1.smithi082.stdout:6/934: creat d2/d18/d39/f135 x:0 0 0 2024-02-15T22:41:24.820 INFO:tasks.workunit.client.1.smithi082.stdout:6/935: truncate d2/d18/f99 843055 0 2024-02-15T22:41:24.820 INFO:tasks.workunit.client.1.smithi082.stdout:3/901: truncate d0/d16/d62/d14/d21/d69/d87/f8f 334497 0 2024-02-15T22:41:24.821 INFO:tasks.workunit.client.1.smithi082.stdout:5/962: mkdir d5/da/de3/d135/d141 0 2024-02-15T22:41:24.821 INFO:tasks.workunit.client.1.smithi082.stdout:5/963: write d5/da/d67/fc9 [4519557,10574] 0 2024-02-15T22:41:24.827 INFO:tasks.workunit.client.1.smithi082.stdout:8/872: creat d1/d40/dbb/dff/da6/db8/def/f12a x:0 0 0 2024-02-15T22:41:24.829 INFO:tasks.workunit.client.1.smithi082.stdout:1/876: truncate d1/da/ff 4489081 0 2024-02-15T22:41:24.829 INFO:tasks.workunit.client.1.smithi082.stdout:1/877: dread - d1/da/d11/d93/db6/dc5/fdd zero size 2024-02-15T22:41:24.833 INFO:tasks.workunit.client.1.smithi082.stdout:2/881: link d6/dc/dd/f1a d6/dc/d12/d46/d76/dae/de8/d104/f10d 0 2024-02-15T22:41:24.835 INFO:tasks.workunit.client.1.smithi082.stdout:9/912: link d8/d12/d67/d70/fa0 d8/f11f 0 2024-02-15T22:41:24.837 INFO:tasks.workunit.client.1.smithi082.stdout:0/896: mknod d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/c141 0 2024-02-15T22:41:24.837 INFO:tasks.workunit.client.1.smithi082.stdout:0/897: chown d3/d19/d20/d7c/dd5/deb/da5/d99/ddc/f115 141681680 1 2024-02-15T22:41:24.840 INFO:tasks.workunit.client.1.smithi082.stdout:6/936: symlink d2/d18/d8a/d47/d72/d80/d118/l136 0 2024-02-15T22:41:24.846 INFO:tasks.workunit.client.1.smithi082.stdout:9/913: dread d8/d24/d2e/f34 [0,4194304] 0 2024-02-15T22:41:24.846 INFO:tasks.workunit.client.1.smithi082.stdout:7/933: dwrite d12/de4/d122/f96 [0,4194304] 0 2024-02-15T22:41:24.849 INFO:tasks.workunit.client.1.smithi082.stdout:5/964: rmdir d5/da/de3/d135/d141 0 2024-02-15T22:41:24.852 INFO:tasks.workunit.client.1.smithi082.stdout:3/902: dwrite d0/dc/f5c [4194304,4194304] 0 2024-02-15T22:41:24.852 INFO:tasks.workunit.client.1.smithi082.stdout:3/903: stat d0/d16/d62/d14/d21/d69/d87/fdf 0 2024-02-15T22:41:24.853 INFO:tasks.workunit.client.1.smithi082.stdout:8/873: stat d1/d40/dbb/dff/d85/c119 0 2024-02-15T22:41:24.854 INFO:tasks.workunit.client.1.smithi082.stdout:1/878: mkdir d1/da/d14/db4/d120 0 2024-02-15T22:41:24.859 INFO:tasks.workunit.client.1.smithi082.stdout:2/882: symlink d6/dc/d58/l10e 0 2024-02-15T22:41:24.859 INFO:tasks.workunit.client.1.smithi082.stdout:2/883: dread - d6/dc/d58/f107 zero size 2024-02-15T22:41:24.859 INFO:tasks.workunit.client.1.smithi082.stdout:1/879: dread d1/da/d14/d18/d1f/d2f/f3e [0,4194304] 0 2024-02-15T22:41:24.859 INFO:tasks.workunit.client.1.smithi082.stdout:1/880: truncate d1/fc6 1356154 0 2024-02-15T22:41:24.859 INFO:tasks.workunit.client.1.smithi082.stdout:6/937: dwrite d2/d18/d8a/d47/f54 [0,4194304] 0 2024-02-15T22:41:24.860 INFO:tasks.workunit.client.1.smithi082.stdout:0/898: creat d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/f142 x:0 0 0 2024-02-15T22:41:24.863 INFO:tasks.workunit.client.1.smithi082.stdout:9/914: mkdir d8/db5/d114/d120 0 2024-02-15T22:41:24.863 INFO:tasks.workunit.client.1.smithi082.stdout:9/915: creat d8/d12/d67/d70/f121 x:0 0 0 2024-02-15T22:41:24.863 INFO:tasks.workunit.client.1.smithi082.stdout:9/916: chown d8/db5/d114/da1/f112 95 1 2024-02-15T22:41:24.863 INFO:tasks.workunit.client.1.smithi082.stdout:9/917: write d8/d12/d30/d3c/f93 [991145,94450] 0 2024-02-15T22:41:24.863 INFO:tasks.workunit.client.1.smithi082.stdout:9/918: fsync d8/db5/f106 0 2024-02-15T22:41:24.868 INFO:tasks.workunit.client.1.smithi082.stdout:5/965: rename d5/da/d14/l93 to d5/da/d56/l142 0 2024-02-15T22:41:24.872 INFO:tasks.workunit.client.1.smithi082.stdout:3/904: link d0/d16/d62/d14/d21/d69/de6/lfd d0/d16/d62/d2e/l12d 0 2024-02-15T22:41:24.873 INFO:tasks.workunit.client.1.smithi082.stdout:9/919: dread d8/d24/f4b [0,4194304] 0 2024-02-15T22:41:24.873 INFO:tasks.workunit.client.1.smithi082.stdout:9/920: stat d8/d12/d33/d3e/fda 0 2024-02-15T22:41:24.876 INFO:tasks.workunit.client.1.smithi082.stdout:8/874: mknod d1/d7/d48/d6f/c12b 0 2024-02-15T22:41:24.877 INFO:tasks.workunit.client.1.smithi082.stdout:7/934: rmdir d12/d37/dbd 39 2024-02-15T22:41:24.879 INFO:tasks.workunit.client.1.smithi082.stdout:3/905: dread d0/dc/f26 [0,4194304] 0 2024-02-15T22:41:24.881 INFO:tasks.workunit.client.1.smithi082.stdout:1/881: unlink d1/da/d11/d3f/f69 0 2024-02-15T22:41:24.881 INFO:tasks.workunit.client.1.smithi082.stdout:1/882: fdatasync d1/da/d14/d18/d6d/dc2/f109 0 2024-02-15T22:41:24.886 INFO:tasks.workunit.client.1.smithi082.stdout:7/935: write d12/d37/dbd/fe2 [1180667,65797] 0 2024-02-15T22:41:24.887 INFO:tasks.workunit.client.1.smithi082.stdout:0/899: symlink d3/d19/d1c/d76/l143 0 2024-02-15T22:41:24.887 INFO:tasks.workunit.client.1.smithi082.stdout:0/900: creat d3/d19/d20/d7c/dcf/f144 x:0 0 0 2024-02-15T22:41:24.891 INFO:tasks.workunit.client.1.smithi082.stdout:3/906: dread d0/d16/d62/d14/d21/d7d/f83 [0,4194304] 0 2024-02-15T22:41:24.891 INFO:tasks.workunit.client.1.smithi082.stdout:3/907: getdents d0/d16/d62/d14/d21/d11c 0 2024-02-15T22:41:24.891 INFO:tasks.workunit.client.1.smithi082.stdout:3/908: read - d0/d16/d3e/d56/fb5 zero size 2024-02-15T22:41:24.891 INFO:tasks.workunit.client.1.smithi082.stdout:3/909: truncate d0/d16/d3e/d56/f10f 954811 0 2024-02-15T22:41:24.894 INFO:tasks.workunit.client.1.smithi082.stdout:5/966: mkdir d5/d103/d143 0 2024-02-15T22:41:24.902 INFO:tasks.workunit.client.1.smithi082.stdout:9/921: mknod d8/c122 0 2024-02-15T22:41:24.902 INFO:tasks.workunit.client.1.smithi082.stdout:9/922: write d8/d12/d67/f11c [74263,38969] 0 2024-02-15T22:41:24.905 INFO:tasks.workunit.client.1.smithi082.stdout:8/875: creat d1/d7/d9/d42/d6a/da5/f12c x:0 0 0 2024-02-15T22:41:24.905 INFO:tasks.workunit.client.1.smithi082.stdout:8/876: fsync d1/d7/f54 0 2024-02-15T22:41:24.906 INFO:tasks.workunit.client.1.smithi082.stdout:1/883: symlink d1/da/d11/d8c/db3/l121 0 2024-02-15T22:41:24.906 INFO:tasks.workunit.client.1.smithi082.stdout:1/884: readlink d1/da/d11/d93/la9 0 2024-02-15T22:41:24.906 INFO:tasks.workunit.client.1.smithi082.stdout:1/885: write d1/da/d14/f28 [4362460,121295] 0 2024-02-15T22:41:24.922 INFO:tasks.workunit.client.1.smithi082.stdout:8/877: dwrite d1/d7/d9/d24/d30/f3c [0,4194304] 0 2024-02-15T22:41:24.922 INFO:tasks.workunit.client.1.smithi082.stdout:8/878: fsync d1/d40/dbb/dcf/ff0 0 2024-02-15T22:41:24.923 INFO:tasks.workunit.client.1.smithi082.stdout:8/879: dread - d1/d40/dbb/dcf/f10e zero size 2024-02-15T22:41:24.923 INFO:tasks.workunit.client.1.smithi082.stdout:8/880: fsync d1/d7/d9/d24/d30/f4b 0 2024-02-15T22:41:24.925 INFO:tasks.workunit.client.1.smithi082.stdout:7/936: symlink d12/d27/d6e/d6a/d9e/l13b 0 2024-02-15T22:41:24.931 INFO:tasks.workunit.client.1.smithi082.stdout:0/901: creat d3/d19/d20/d7c/dd5/deb/da5/d99/db1/f145 x:0 0 0 2024-02-15T22:41:24.931 INFO:tasks.workunit.client.1.smithi082.stdout:0/902: truncate d3/d19/d20/d7c/dcf/d12b/f139 1015179 0 2024-02-15T22:41:24.932 INFO:tasks.workunit.client.1.smithi082.stdout:8/881: write d1/d7/de/f3d [2291462,13490] 0 2024-02-15T22:41:24.932 INFO:tasks.workunit.client.1.smithi082.stdout:8/882: dread - d1/d7/d9/d42/d6a/da5/f12c zero size 2024-02-15T22:41:24.932 INFO:tasks.workunit.client.1.smithi082.stdout:8/883: stat d1/d7/d9/f47 0 2024-02-15T22:41:24.934 INFO:tasks.workunit.client.1.smithi082.stdout:7/937: write d12/de4/d122/f96 [3477559,19770] 0 2024-02-15T22:41:24.935 INFO:tasks.workunit.client.1.smithi082.stdout:3/910: symlink d0/dc/d3f/dc4/l12e 0 2024-02-15T22:41:24.938 INFO:tasks.workunit.client.1.smithi082.stdout:5/967: truncate d5/da/d67/fc9 2447963 0 2024-02-15T22:41:24.941 INFO:tasks.workunit.client.1.smithi082.stdout:9/923: creat d8/d24/d87/de0/d77/dab/f123 x:0 0 0 2024-02-15T22:41:24.945 INFO:tasks.workunit.client.1.smithi082.stdout:1/886: mkdir d1/da/d11/d8c/d122 0 2024-02-15T22:41:24.947 INFO:tasks.workunit.client.1.smithi082.stdout:0/903: creat d3/d19/d20/d7c/dd5/deb/d13c/f146 x:0 0 0 2024-02-15T22:41:24.947 INFO:tasks.workunit.client.1.smithi082.stdout:0/904: stat d3/d19/d20/d7c/dd5/deb/da5/d99/fa9 0 2024-02-15T22:41:24.948 INFO:tasks.workunit.client.1.smithi082.stdout:0/905: fdatasync d3/d19/d93/dbe/fdd 0 2024-02-15T22:41:24.960 INFO:tasks.workunit.client.1.smithi082.stdout:8/884: symlink d1/d40/dbb/l12d 0 2024-02-15T22:41:24.961 INFO:tasks.workunit.client.1.smithi082.stdout:5/968: dwrite d5/da/f40 [0,4194304] 0 2024-02-15T22:41:24.962 INFO:tasks.workunit.client.1.smithi082.stdout:2/884: rename d6/dc/dd/d24/d71/ded/d106 to d6/dc/dd/d21/d9f/d10f 0 2024-02-15T22:41:24.962 INFO:tasks.workunit.client.1.smithi082.stdout:2/885: truncate d6/dc/d58/d49/db6/fe6 967627 0 2024-02-15T22:41:24.962 INFO:tasks.workunit.client.1.smithi082.stdout:2/886: stat d6/dc/d58/d49/db6/fe6 0 2024-02-15T22:41:24.963 INFO:tasks.workunit.client.1.smithi082.stdout:7/938: mknod d12/d17/d42/d67/d81/c13c 0 2024-02-15T22:41:24.965 INFO:tasks.workunit.client.1.smithi082.stdout:9/924: mknod d8/d12/d67/d70/d97/c124 0 2024-02-15T22:41:24.965 INFO:tasks.workunit.client.1.smithi082.stdout:9/925: dread - d8/d24/d87/dcb/ff1 zero size 2024-02-15T22:41:24.966 INFO:tasks.workunit.client.1.smithi082.stdout:1/887: dwrite d1/da/d14/d18/d6d/dc2/f109 [0,4194304] 0 2024-02-15T22:41:24.966 INFO:tasks.workunit.client.1.smithi082.stdout:1/888: write d1/da/d14/d18/d1f/d7a/ddb/fec [149759,3330] 0 2024-02-15T22:41:24.966 INFO:tasks.workunit.client.1.smithi082.stdout:1/889: write d1/da/d14/d18/d51/f97 [1835157,76623] 0 2024-02-15T22:41:24.966 INFO:tasks.workunit.client.1.smithi082.stdout:1/890: chown d1/da/d14/d18/d1f/d76/da7/cb0 2166733 1 2024-02-15T22:41:24.966 INFO:tasks.workunit.client.1.smithi082.stdout:0/906: mknod d3/d19/d20/d7c/dd5/deb/da5/d99/c147 0 2024-02-15T22:41:24.970 INFO:tasks.workunit.client.1.smithi082.stdout:5/969: symlink d5/da/de3/l144 0 2024-02-15T22:41:24.970 INFO:tasks.workunit.client.1.smithi082.stdout:5/970: readlink d5/da/dc/dad/dcf/d59/da3/lb9 0 2024-02-15T22:41:24.972 INFO:tasks.workunit.client.1.smithi082.stdout:7/939: mkdir d12/d27/d13d 0 2024-02-15T22:41:24.972 INFO:tasks.workunit.client.1.smithi082.stdout:7/940: creat d12/d17/d42/d67/f13e x:0 0 0 2024-02-15T22:41:24.972 INFO:tasks.workunit.client.1.smithi082.stdout:5/971: dread d5/da/d14/d53/f70 [0,4194304] 0 2024-02-15T22:41:24.972 INFO:tasks.workunit.client.1.smithi082.stdout:5/972: chown d5/da/de3/de9/dfa 1184484 1 2024-02-15T22:41:24.974 INFO:tasks.workunit.client.1.smithi082.stdout:8/885: dread d1/d7/d9/d24/d30/f3c [0,4194304] 0 2024-02-15T22:41:24.976 INFO:tasks.workunit.client.1.smithi082.stdout:6/938: sync 2024-02-15T22:41:24.976 INFO:tasks.workunit.client.1.smithi082.stdout:2/887: dread d6/dc/d12/d46/fa0 [0,4194304] 0 2024-02-15T22:41:24.977 INFO:tasks.workunit.client.1.smithi082.stdout:6/939: write d2/d30/ff4 [1206118,87525] 0 2024-02-15T22:41:24.979 INFO:tasks.workunit.client.1.smithi082.stdout:9/926: dwrite d8/d12/d30/d3c/f4e [0,4194304] 0 2024-02-15T22:41:24.979 INFO:tasks.workunit.client.1.smithi082.stdout:9/927: write d8/f11f [2254238,75780] 0 2024-02-15T22:41:24.979 INFO:tasks.workunit.client.1.smithi082.stdout:9/928: readlink d8/d24/l5c 0 2024-02-15T22:41:24.979 INFO:tasks.workunit.client.1.smithi082.stdout:9/929: fdatasync d8/d12/d33/fbb 0 2024-02-15T22:41:24.982 INFO:tasks.workunit.client.1.smithi082.stdout:1/891: creat d1/da/d11/d8c/d122/f123 x:0 0 0 2024-02-15T22:41:24.985 INFO:tasks.workunit.client.1.smithi082.stdout:0/907: creat d3/d19/d20/d7c/dd5/deb/d92/dfe/f148 x:0 0 0 2024-02-15T22:41:24.990 INFO:tasks.workunit.client.1.smithi082.stdout:7/941: creat d12/d27/dc2/f13f x:0 0 0 2024-02-15T22:41:24.990 INFO:tasks.workunit.client.1.smithi082.stdout:7/942: write d12/d3b/d5a/f102 [670077,50191] 0 2024-02-15T22:41:24.993 INFO:tasks.workunit.client.1.smithi082.stdout:8/886: creat d1/d7/d9/d42/d6a/f12e x:0 0 0 2024-02-15T22:41:24.993 INFO:tasks.workunit.client.1.smithi082.stdout:8/887: write d1/d7/d9/d42/f105 [701707,72705] 0 2024-02-15T22:41:24.993 INFO:tasks.workunit.client.1.smithi082.stdout:8/888: chown d1/d40/dbb/dff/da6/db6/dca 1115 1 2024-02-15T22:41:24.995 INFO:tasks.workunit.client.1.smithi082.stdout:2/888: link d6/f7 d6/dc/d12/d46/da9/f110 0 2024-02-15T22:41:24.997 INFO:tasks.workunit.client.1.smithi082.stdout:6/940: mkdir d2/d18/d8a/d47/d69/dc1/d137 0 2024-02-15T22:41:25.000 INFO:tasks.workunit.client.1.smithi082.stdout:7/943: dread d12/d37/f98 [0,4194304] 0 2024-02-15T22:41:25.001 INFO:tasks.workunit.client.1.smithi082.stdout:9/930: symlink d8/d24/d87/de0/l125 0 2024-02-15T22:41:25.005 INFO:tasks.workunit.client.1.smithi082.stdout:0/908: symlink d3/d19/d20/d7c/dd5/deb/da5/d9c/l149 0 2024-02-15T22:41:25.010 INFO:tasks.workunit.client.1.smithi082.stdout:2/889: dwrite d6/d3c/d8c/fd3 [0,4194304] 0 2024-02-15T22:41:25.011 INFO:tasks.workunit.client.1.smithi082.stdout:5/973: mkdir d5/da/dc/dd5/de5/d145 0 2024-02-15T22:41:25.011 INFO:tasks.workunit.client.1.smithi082.stdout:5/974: chown d5/da/de3/l144 0 1 2024-02-15T22:41:25.011 INFO:tasks.workunit.client.1.smithi082.stdout:5/975: creat d5/da/dc/dad/dcf/f146 x:0 0 0 2024-02-15T22:41:25.011 INFO:tasks.workunit.client.1.smithi082.stdout:5/976: stat d5/da/de3/d135 0 2024-02-15T22:41:25.013 INFO:tasks.workunit.client.1.smithi082.stdout:6/941: mknod d2/d30/d3b/d120/c138 0 2024-02-15T22:41:25.015 INFO:tasks.workunit.client.1.smithi082.stdout:7/944: mkdir d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/d140 0 2024-02-15T22:41:25.017 INFO:tasks.workunit.client.1.smithi082.stdout:9/931: truncate d8/d12/d30/d3c/d65/d10b/f111 3921847 0 2024-02-15T22:41:25.022 INFO:tasks.workunit.client.1.smithi082.stdout:6/942: dread d2/d18/d8a/d47/d69/d75/f12d [0,4194304] 0 2024-02-15T22:41:25.022 INFO:tasks.workunit.client.1.smithi082.stdout:6/943: chown d2/d18/d8a/d47/d69/dc1/ded 0 1 2024-02-15T22:41:25.022 INFO:tasks.workunit.client.1.smithi082.stdout:6/944: chown d2/d18/d23/d67/caf 2608 1 2024-02-15T22:41:25.023 INFO:tasks.workunit.client.1.smithi082.stdout:6/945: fsync d2/d18/d8a/d65/f11e 0 2024-02-15T22:41:25.037 INFO:tasks.workunit.client.1.smithi082.stdout:2/890: getdents d6/dc/dd/d21 0 2024-02-15T22:41:25.043 INFO:tasks.workunit.client.1.smithi082.stdout:5/977: symlink d5/da/de3/l147 0 2024-02-15T22:41:25.046 INFO:tasks.workunit.client.1.smithi082.stdout:5/978: dread d5/da/dc/dad/dcf/f35 [0,4194304] 0 2024-02-15T22:41:25.046 INFO:tasks.workunit.client.1.smithi082.stdout:5/979: readlink d5/da/dc/dad/dcf/d59/d84/lf5 0 2024-02-15T22:41:25.046 INFO:tasks.workunit.client.1.smithi082.stdout:1/892: rename d1/da to d1/dc8/d124 0 2024-02-15T22:41:25.047 INFO:tasks.workunit.client.1.smithi082.stdout:1/893: read d1/dc8/d124/d14/d18/d51/f81 [2041600,32537] 0 2024-02-15T22:41:25.052 INFO:tasks.workunit.client.1.smithi082.stdout:7/945: rmdir d12/de4/d122 39 2024-02-15T22:41:25.052 INFO:tasks.workunit.client.1.smithi082.stdout:7/946: fsync d12/d3b/f44 0 2024-02-15T22:41:25.054 INFO:tasks.workunit.client.1.smithi082.stdout:7/947: dread d12/d3b/f89 [0,4194304] 0 2024-02-15T22:41:25.058 INFO:tasks.workunit.client.1.smithi082.stdout:9/932: mkdir d8/db5/d114/da1/d126 0 2024-02-15T22:41:25.062 INFO:tasks.workunit.client.1.smithi082.stdout:0/909: mkdir d3/d19/d20/d7c/dd5/deb/da0/dbc/d14a 0 2024-02-15T22:41:25.063 INFO:tasks.workunit.client.1.smithi082.stdout:6/946: creat d2/d45/f139 x:0 0 0 2024-02-15T22:41:25.063 INFO:tasks.workunit.client.1.smithi082.stdout:6/947: dread - d2/d18/f108 zero size 2024-02-15T22:41:25.066 INFO:tasks.workunit.client.1.smithi082.stdout:2/891: symlink d6/dc/dd/d24/d71/ded/l111 0 2024-02-15T22:41:25.070 INFO:tasks.workunit.client.1.smithi082.stdout:5/980: creat d5/d102/d11d/d12d/f148 x:0 0 0 2024-02-15T22:41:25.075 INFO:tasks.workunit.client.1.smithi082.stdout:8/889: rename d1/d7/d9/d24/d30/f3c to d1/d7/d9/d24/f12f 0 2024-02-15T22:41:25.075 INFO:tasks.workunit.client.1.smithi082.stdout:8/890: readlink d1/d40/dbb/dff/l65 0 2024-02-15T22:41:25.076 INFO:tasks.workunit.client.1.smithi082.stdout:8/891: dread d1/d7/d9/fa4 [0,4194304] 0 2024-02-15T22:41:25.076 INFO:tasks.workunit.client.1.smithi082.stdout:8/892: readlink d1/d40/lf6 0 2024-02-15T22:41:25.076 INFO:tasks.workunit.client.1.smithi082.stdout:8/893: dread - d1/d7/d48/f101 zero size 2024-02-15T22:41:25.078 INFO:tasks.workunit.client.1.smithi082.stdout:1/894: mknod d1/dc8/d124/d14/d18/d1f/d7a/dd1/c125 0 2024-02-15T22:41:25.079 INFO:tasks.workunit.client.1.smithi082.stdout:3/911: sync 2024-02-15T22:41:25.080 INFO:tasks.workunit.client.1.smithi082.stdout:3/912: chown d0/d16/d62/d2e/d84/c109 67 1 2024-02-15T22:41:25.080 INFO:tasks.workunit.client.1.smithi082.stdout:3/913: fdatasync d0/d16/d3e/d56/fb5 0 2024-02-15T22:41:25.080 INFO:tasks.workunit.client.1.smithi082.stdout:9/933: mkdir d8/d24/d87/de0/d77/dc6/de6/d127 0 2024-02-15T22:41:25.081 INFO:tasks.workunit.client.1.smithi082.stdout:0/910: mknod d3/d19/d20/d26/c14b 0 2024-02-15T22:41:25.082 INFO:tasks.workunit.client.1.smithi082.stdout:6/948: mkdir d2/d45/dc5/d129/d13a 0 2024-02-15T22:41:25.084 INFO:tasks.workunit.client.1.smithi082.stdout:2/892: symlink d6/dc/dd/l112 0 2024-02-15T22:41:25.084 INFO:tasks.workunit.client.1.smithi082.stdout:2/893: fsync d6/dc/d58/f17 0 2024-02-15T22:41:25.085 INFO:tasks.workunit.client.1.smithi082.stdout:0/911: dread d3/d19/d20/d7c/dd5/deb/da5/d9c/dcc/f10b [0,4194304] 0 2024-02-15T22:41:25.085 INFO:tasks.workunit.client.1.smithi082.stdout:0/912: symlink d3/d19/d20/d7c/dd5/deb/da5/d99/db1/l14c 2 2024-02-15T22:41:25.085 INFO:tasks.workunit.client.1.smithi082.stdout:0/913: readlink d3/d6b/l7b 0 2024-02-15T22:41:25.086 INFO:tasks.workunit.client.1.smithi082.stdout:7/948: rename d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/d140 to d12/d27/dc2/dda/d141 0 2024-02-15T22:41:25.088 INFO:tasks.workunit.client.1.smithi082.stdout:8/894: symlink d1/d40/dbb/dce/dfc/l130 0 2024-02-15T22:41:25.089 INFO:tasks.workunit.client.1.smithi082.stdout:3/914: creat d0/d16/d62/d79/f12f x:0 0 0 2024-02-15T22:41:25.090 INFO:tasks.workunit.client.1.smithi082.stdout:3/915: fdatasync d0/d16/d62/d79/f12f 0 2024-02-15T22:41:25.090 INFO:tasks.workunit.client.1.smithi082.stdout:2/894: mkdir d6/dc/dd/d24/d72/dbb/d113 0 2024-02-15T22:41:25.094 INFO:tasks.workunit.client.1.smithi082.stdout:7/949: mkdir d12/d27/d6e/d6a/d9e/dbe/dcb/d114/d138/d142 0 2024-02-15T22:41:25.099 INFO:tasks.workunit.client.1.smithi082.stdout:1/895: rename d1/dc8/d124/d11/d8c/d122 to d1/dc8/d124/d14/d18/d1f/d7a/dd1/d126 0 2024-02-15T22:41:25.099 INFO:tasks.workunit.client.1.smithi082.stdout:1/896: chown d1/dc8/d124/d11/d8c 1407733 1 2024-02-15T22:41:25.099 INFO:tasks.workunit.client.1.smithi082.stdout:1/897: fsync d1/dc8/d124/d14/d18/d98/f107 0 2024-02-15T22:41:25.099 INFO:tasks.workunit.client.1.smithi082.stdout:1/898: fsync d1/dc8/d124/d14/d18/d51/f59 0 2024-02-15T22:41:25.099 INFO:tasks.workunit.client.1.smithi082.stdout:8/895: write d1/d40/dbb/fc6 [34053,91665] 0 2024-02-15T22:41:25.099 INFO:tasks.workunit.client.1.smithi082.stdout:8/896: truncate d1/f117 729813 0 2024-02-15T22:41:25.099 INFO:tasks.workunit.client.1.smithi082.stdout:8/897: fdatasync d1/f21 0 2024-02-15T22:41:25.100 INFO:tasks.workunit.client.1.smithi082.stdout:5/981: dwrite d5/da/dc/d43/f4d [0,4194304] 0 2024-02-15T22:41:25.100 INFO:tasks.workunit.client.1.smithi082.stdout:5/982: write d5/da/dc/d43/f123 [231232,50768] 0 2024-02-15T22:41:25.101 INFO:tasks.workunit.client.1.smithi082.stdout:2/895: rmdir d6/dc/d12/d46/d76/dae/de8 39 2024-02-15T22:41:25.103 INFO:tasks.workunit.client.1.smithi082.stdout:7/950: unlink d12/d17/d42/d67/f71 0 2024-02-15T22:41:25.105 INFO:tasks.workunit.client.1.smithi082.stdout:1/899: creat d1/dc8/d124/d11/d3f/d75/f127 x:0 0 0 2024-02-15T22:41:25.109 INFO:tasks.workunit.client.1.smithi082.stdout:8/898: truncate d1/f14 917344 0 2024-02-15T22:41:25.110 INFO:tasks.workunit.client.1.smithi082.stdout:5/983: mkdir d5/d102/d11d/d133/d149 0 2024-02-15T22:41:25.110 INFO:tasks.workunit.client.1.smithi082.stdout:5/984: write d5/da/d56/f5b [4215514,98734] 0 2024-02-15T22:41:25.110 INFO:tasks.workunit.client.1.smithi082.stdout:5/985: fsync d5/d103/f120 0 2024-02-15T22:41:25.110 INFO:tasks.workunit.client.1.smithi082.stdout:5/986: stat d5/da/dc/dad/dcf/f83 0 2024-02-15T22:41:25.112 INFO:tasks.workunit.client.1.smithi082.stdout:2/896: creat d6/dc/d58/d49/db6/f114 x:0 0 0 2024-02-15T22:41:25.115 INFO:tasks.workunit.client.1.smithi082.stdout:7/951: symlink d12/d27/d12a/l143 0 2024-02-15T22:41:25.115 INFO:tasks.workunit.client.1.smithi082.stdout:7/952: stat d12/d27/d6e/d6a/db2/ded 0 2024-02-15T22:41:25.115 INFO:tasks.workunit.client.1.smithi082.stdout:8/899: symlink d1/d40/dbb/dff/da6/db8/l131 0 2024-02-15T22:41:25.116 INFO:tasks.workunit.client.1.smithi082.stdout:8/900: read - d1/d7/d9/d24/fee zero size 2024-02-15T22:41:25.117 INFO:tasks.workunit.client.1.smithi082.stdout:9/934: dwrite d8/d24/d2e/ff4 [0,4194304] 0 2024-02-15T22:41:25.117 INFO:tasks.workunit.client.1.smithi082.stdout:6/949: dwrite d2/f1e [0,4194304] 0 2024-02-15T22:41:25.118 INFO:tasks.workunit.client.1.smithi082.stdout:2/897: dread d6/dc/dd/d24/d71/f7a [0,4194304] 0 2024-02-15T22:41:25.119 INFO:tasks.workunit.client.1.smithi082.stdout:0/914: dwrite d3/d19/d1c/f52 [0,4194304] 0 2024-02-15T22:41:25.119 INFO:tasks.workunit.client.1.smithi082.stdout:3/916: dwrite d0/d16/d62/d14/f2a [0,4194304] 0 2024-02-15T22:41:25.120 INFO:tasks.workunit.client.1.smithi082.stdout:8/901: symlink d1/d7/d9/d42/l132 0 2024-02-15T22:41:25.120 INFO:tasks.workunit.client.1.smithi082.stdout:3/917: stat d0/d16/d62/d14/d21/d69/d6c/lb4 0 2024-02-15T22:41:25.121 INFO:tasks.workunit.client.1.smithi082.stdout:1/900: write d1/dc8/d124/d14/d18/d1f/d2f/f95 [1298541,20687] 0 2024-02-15T22:41:25.124 INFO:tasks.workunit.client.1.smithi082.stdout:1/901: dread d1/dc8/d124/d11/d3f/f5e [0,4194304] 0 2024-02-15T22:41:25.124 INFO:tasks.workunit.client.1.smithi082.stdout:1/902: chown d1/dc8/d124/d14/d18/d6d/f70 246 1 2024-02-15T22:41:25.129 INFO:tasks.workunit.client.1.smithi082.stdout:9/935: mkdir d8/d12/d33/d128 0 2024-02-15T22:41:25.129 INFO:tasks.workunit.client.1.smithi082.stdout:8/902: write d1/d7/d9/d42/dc5/f88 [3020576,42112] 0 2024-02-15T22:41:25.131 INFO:tasks.workunit.client.1.smithi082.stdout:5/987: dwrite d5/da/dc/f4f [0,4194304] 0 2024-02-15T22:41:25.132 INFO:tasks.workunit.client.1.smithi082.stdout:5/988: creat d5/da/de3/f14a x:0 0 0 2024-02-15T22:41:25.132 INFO:tasks.workunit.client.1.smithi082.stdout:6/950: mknod d2/d18/d8a/d47/d69/dc1/d121/c13b 0 2024-02-15T22:41:25.132 INFO:tasks.workunit.client.1.smithi082.stdout:6/951: readlink d2/d18/d8a/d47/d72/d80/d118/l136 0 2024-02-15T22:41:25.136 INFO:tasks.workunit.client.1.smithi082.stdout:0/915: mknod d3/d19/d20/d7c/dd5/deb/c14d 0 2024-02-15T22:41:25.147 INFO:tasks.workunit.client.1.smithi082.stdout:0/916: write d3/d19/d20/d7c/dd5/deb/da5/d9c/fb0 [3691678,43009] 0 2024-02-15T22:41:25.147 INFO:tasks.workunit.client.1.smithi082.stdout:1/903: rename d1/dc8/d124/d14/d18/d1f/d76/f92 to d1/dc8/d124/d14/d18/d1f/d7a/f128 0 2024-02-15T22:41:25.149 INFO:tasks.workunit.client.1.smithi082.stdout:8/903: creat d1/d40/dbb/dff/df1/f133 x:0 0 0 2024-02-15T22:41:25.149 INFO:tasks.workunit.client.1.smithi082.stdout:8/904: creat d1/d7/d48/f134 x:0 0 0 2024-02-15T22:41:25.159 INFO:tasks.workunit.client.1.smithi082.stdout:2/898: dwrite d6/dc/d12/d46/da9/f110 [0,4194304] 0 2024-02-15T22:41:25.159 INFO:tasks.workunit.client.1.smithi082.stdout:2/899: write d6/dc/dd/d24/f54 [909176,34816] 0 2024-02-15T22:41:25.159 INFO:tasks.workunit.client.1.smithi082.stdout:2/900: chown d6/dc/dd/d21 69982730 1 2024-02-15T22:41:25.159 INFO:tasks.workunit.client.1.smithi082.stdout:7/953: dwrite d12/d3b/d5a/f102 [0,4194304] 0 2024-02-15T22:41:25.159 INFO:tasks.workunit.client.1.smithi082.stdout:7/954: fdatasync d12/d27/d6e/d6a/d9e/dbe/dcb/fd9 0 2024-02-15T22:41:25.160 INFO:tasks.workunit.client.1.smithi082.stdout:5/989: dwrite d5/da/dc/d43/f4d [4194304,4194304] 0 2024-02-15T22:41:25.160 INFO:tasks.workunit.client.1.smithi082.stdout:5/990: creat d5/da/d67/dbf/f14b x:0 0 0 2024-02-15T22:41:25.161 INFO:tasks.workunit.client.1.smithi082.stdout:6/952: symlink d2/d18/l13c 0 2024-02-15T22:41:25.161 INFO:tasks.workunit.client.1.smithi082.stdout:8/905: dread d1/d7/de/f32 [0,4194304] 0 2024-02-15T22:41:25.166 INFO:tasks.workunit.client.1.smithi082.stdout:0/917: dwrite d3/f34 [4194304,4194304] 0 2024-02-15T22:41:25.166 INFO:tasks.workunit.client.1.smithi082.stdout:0/918: chown d3/d19/d20/d7c/dd5/deb/da5/d9c/fef 6341 1 2024-02-15T22:41:25.166 INFO:tasks.workunit.client.1.smithi082.stdout:0/919: write d3/d19/d20/d7c/dd5/f132 [174137,51592] 0 2024-02-15T22:41:25.166 INFO:tasks.workunit.client.1.smithi082.stdout:0/920: creat d3/d6b/d7f/f14e x:0 0 0 2024-02-15T22:41:25.172 INFO:tasks.workunit.client.1.smithi082.stdout:2/901: mkdir d6/dc/dd/d24/d72/d115 0 2024-02-15T22:41:25.177 INFO:tasks.workunit.client.1.smithi082.stdout:6/953: dwrite d2/d18/d23/f9d [0,4194304] 0 2024-02-15T22:41:25.177 INFO:tasks.workunit.client.1.smithi082.stdout:6/954: write d2/d18/d8a/d47/d69/db1/fcc [574551,44458] 0 2024-02-15T22:41:25.178 INFO:tasks.workunit.client.1.smithi082.stdout:3/918: write d0/d16/d62/d14/f2a [5034143,108541] 0 2024-02-15T22:41:25.180 INFO:tasks.workunit.client.1.smithi082.stdout:7/955: rename d12/d27/dc2/f13f to d12/d27/d6e/d6a/d9e/dbe/f144 0 2024-02-15T22:41:25.180 INFO:tasks.workunit.client.1.smithi082.stdout:7/956: chown d12/d27/d74/d8b/cd8 98253 1 2024-02-15T22:41:25.194 INFO:tasks.workunit.client.1.smithi082.stdout:5/991: creat d5/da/dc/f14c x:0 0 0 2024-02-15T22:41:25.195 INFO:tasks.workunit.client.1.smithi082.stdout:8/906: mkdir d1/d7/d9/d24/d30/d75/d107/d135 0 2024-02-15T22:41:25.195 INFO:tasks.workunit.client.1.smithi082.stdout:8/907: chown d1/d7/c1a 1662867 1 2024-02-15T22:41:25.196 INFO:tasks.workunit.client.1.smithi082.stdout:1/904: mknod d1/dc8/d124/d14/d18/d51/c129 0 2024-02-15T22:41:25.196 INFO:tasks.workunit.client.1.smithi082.stdout:1/905: stat d1/dc8/d124/d14/d18/d6d/fd8 0 2024-02-15T22:41:25.198 INFO:tasks.workunit.client.1.smithi082.stdout:0/921: rmdir d3/d19/d20/d7c/dd5/deb/da5/d99/db3 39 2024-02-15T22:41:25.200 INFO:tasks.workunit.client.1.smithi082.stdout:6/955: stat d2/d18/d8a/d47/d69/dc1/cd3 0 2024-02-15T22:41:25.201 INFO:tasks.workunit.client.1.smithi082.stdout:5/992: write d5/da/d56/f5b [637266,95676] 0 2024-02-15T22:41:25.201 INFO:tasks.workunit.client.1.smithi082.stdout:5/993: chown d5/da/dc/dad/dcf/d59/d84/d89 6209938 1 2024-02-15T22:41:25.203 INFO:tasks.workunit.client.1.smithi082.stdout:3/919: truncate d0/d16/d62/d14/d71/df4/fe9 1515765 0 2024-02-15T22:41:25.205 INFO:tasks.workunit.client.1.smithi082.stdout:7/957: unlink d12/d17/d3d/l4c 0 2024-02-15T22:41:25.212 INFO:tasks.workunit.client.1.smithi082.stdout:8/908: creat d1/d7/d48/d6f/f136 x:0 0 0 2024-02-15T22:41:25.216 INFO:tasks.workunit.client.1.smithi082.stdout:1/906: symlink d1/d113/l12a 0 2024-02-15T22:41:25.218 INFO:tasks.workunit.client.1.smithi082.stdout:0/922: unlink d3/d19/d1c/f50 0 2024-02-15T22:41:25.220 INFO:tasks.workunit.client.1.smithi082.stdout:6/956: symlink d2/d18/d8a/d47/d69/db1/l13d 0 2024-02-15T22:41:25.221 INFO:tasks.workunit.client.1.smithi082.stdout:6/957: write d2/d30/da6/fec [100464,128962] 0 2024-02-15T22:41:25.223 INFO:tasks.workunit.client.1.smithi082.stdout:5/994: mkdir d5/d103/d143/d14d 0 2024-02-15T22:41:25.223 INFO:tasks.workunit.client.1.smithi082.stdout:5/995: truncate d5/da/f26 4693490 0 2024-02-15T22:41:25.227 INFO:tasks.workunit.client.1.smithi082.stdout:8/909: creat d1/d40/dbb/dce/dfc/f137 x:0 0 0 2024-02-15T22:41:25.227 INFO:tasks.workunit.client.1.smithi082.stdout:8/910: write d1/d7/d9/d42/d6a/da5/f12c [516340,6866] 0 2024-02-15T22:41:25.227 INFO:tasks.workunit.client.1.smithi082.stdout:8/911: stat d1/d7/d9/d42/dc5/f88 0 2024-02-15T22:41:25.231 INFO:tasks.workunit.client.1.smithi082.stdout:1/907: creat d1/dc8/d124/d11/d3f/f12b x:0 0 0 2024-02-15T22:41:25.233 INFO:tasks.workunit.client.1.smithi082.stdout:3/920: getdents d0/d16/d62/d79 0 2024-02-15T22:41:25.236 INFO:tasks.workunit.client.1.smithi082.stdout:7/958: dwrite d12/d37/dbd/fe2 [0,4194304] 0 2024-02-15T22:41:25.236 INFO:tasks.workunit.client.1.smithi082.stdout:7/959: truncate d12/d17/f1a 5067488 0 2024-02-15T22:41:25.237 INFO:tasks.workunit.client.1.smithi082.stdout:3/921: link d0/d16/d62/d14/d21/d7d/l98 d0/d16/d3e/d10b/l130 0 2024-02-15T22:41:25.237 INFO:tasks.workunit.client.1.smithi082.stdout:8/912: read d1/d40/dbb/dff/da6/db6/fd7 [3930883,46815] 0 2024-02-15T22:41:25.243 INFO:tasks.workunit.client.1.smithi082.stdout:8/913: dread d1/d7/de/f3d [0,4194304] 0 2024-02-15T22:41:25.243 INFO:tasks.workunit.client.1.smithi082.stdout:8/914: fsync d1/d7/d9/d50/fa8 0 2024-02-15T22:41:25.243 INFO:tasks.workunit.client.1.smithi082.stdout:6/958: rename d2/d18/d8a/d65 to d2/d18/d8a/d47/d69/d75/de4/d13e 0 2024-02-15T22:41:25.245 INFO:tasks.workunit.client.1.smithi082.stdout:1/908: read d1/dc8/d124/d14/db4/fbb [3590403,96433] 0 2024-02-15T22:41:25.245 INFO:tasks.workunit.client.1.smithi082.stdout:1/909: write d1/fc6 [762183,23251] 0 2024-02-15T22:41:25.246 INFO:tasks.workunit.client.1.smithi082.stdout:8/915: mkdir d1/d7/d9/d138 0 2024-02-15T22:41:25.246 INFO:tasks.workunit.client.1.smithi082.stdout:1/910: mknod d1/dc8/d124/d14/d18/d1f/d7a/de5/c12c 0 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:0/923: dwrite d3/d19/f24 [0,4194304] 0 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:8/916: truncate d1/d7/d9/d42/f105 512842 0 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:5/996: dwrite d5/da/d67/dbf/f14b [0,4194304] 0 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:3/922: dread d0/dc/d3f/fda [0,4194304] 0 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:3/923: truncate d0/f46 276310 0 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:3/924: fsync d0/d16/d62/d14/f40 0 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:3/925: chown d0/d16/d3e/l7a 29329 1 2024-02-15T22:41:25.248 INFO:tasks.workunit.client.1.smithi082.stdout:1/911: mkdir d1/dc8/d124/d14/d18/d98/d12d 0 2024-02-15T22:41:25.249 INFO:tasks.workunit.client.1.smithi082.stdout:1/912: stat d1/dc8/d124/d14/d18/d1f/d76/fe1 0 2024-02-15T22:41:25.249 INFO:tasks.workunit.client.1.smithi082.stdout:1/913: chown d1/dc8/d124/d14/db4/lb5 426511 1 2024-02-15T22:41:25.250 INFO:tasks.workunit.client.1.smithi082.stdout:0/924: mknod d3/d19/d20/d7c/dd5/deb/d92/dfe/c14f 0 2024-02-15T22:41:25.255 INFO:tasks.workunit.client.1.smithi082.stdout:6/959: read d2/d18/d8a/d47/d72/fc7 [3390543,57253] 0 2024-02-15T22:41:25.257 INFO:tasks.workunit.client.1.smithi082.stdout:8/917: dread d1/d7/de/ff [4194304,4194304] 0 2024-02-15T22:41:25.261 INFO:tasks.workunit.client.1.smithi082.stdout:5/997: link d5/da/dc/dad/fb8 d5/d103/d143/d14d/f14e 0 2024-02-15T22:41:25.262 INFO:tasks.workunit.client.1.smithi082.stdout:3/926: rename d0/d16/d62/d2e/d84/c109 to d0/d16/d62/d14/d21/d69/de6/d102/c131 0 2024-02-15T22:41:25.265 INFO:tasks.workunit.client.1.smithi082.stdout:1/914: truncate d1/dc8/d124/d11/f33 1281562 0 2024-02-15T22:41:25.265 INFO:tasks.workunit.client.1.smithi082.stdout:0/925: mkdir d3/d19/d1c/d150 0 2024-02-15T22:41:25.272 INFO:tasks.workunit.client.1.smithi082.stdout:6/960: truncate d2/d18/d39/f88 178732 0 2024-02-15T22:41:25.277 INFO:tasks.workunit.client.1.smithi082.stdout:8/918: link d1/d7/de/f2f d1/d7/f139 0 2024-02-15T22:41:25.277 INFO:tasks.workunit.client.1.smithi082.stdout:8/919: fsync d1/d40/dbb/dff/da6/db6/dca/f90 0 2024-02-15T22:41:25.277 INFO:tasks.workunit.client.1.smithi082.stdout:8/920: write d1/d7/d48/f64 [124077,111810] 0 2024-02-15T22:41:25.280 INFO:tasks.workunit.client.1.smithi082.stdout:5/998: mkdir d5/da/dc/dad/dcf/d14f 0 2024-02-15T22:41:25.282 INFO:tasks.workunit.client.1.smithi082.stdout:3/927: mknod d0/d16/d62/d2e/dcc/c132 0 2024-02-15T22:41:25.282 INFO:tasks.workunit.client.1.smithi082.stdout:3/928: chown d0/d16/d62/d79/dcb/lde 31035546 1 2024-02-15T22:41:25.283 INFO:tasks.workunit.client.1.smithi082.stdout:3/929: read d0/d16/d3e/d56/fd9 [106517,98017] 0 2024-02-15T22:41:25.285 INFO:tasks.workunit.client.1.smithi082.stdout:0/926: dwrite d3/d19/d20/d7c/dd5/f132 [0,4194304] 0 2024-02-15T22:41:25.285 INFO:tasks.workunit.client.1.smithi082.stdout:1/915: fsync d1/f6c 0 2024-02-15T22:41:25.285 INFO:tasks.workunit.client.1.smithi082.stdout:9/936: sync 2024-02-15T22:41:25.288 INFO:tasks.workunit.client.1.smithi082.stdout:8/921: creat d1/d7/de/d57/f13a x:0 0 0 2024-02-15T22:41:25.297 INFO:tasks.workunit.client.1.smithi082.stdout:6/961: link d2/d18/d8a/d47/d69/d75/de4/d13e/fcf d2/d30/d3b/f13f 0 2024-02-15T22:41:25.297 INFO:tasks.workunit.client.1.smithi082.stdout:2/902: sync 2024-02-15T22:41:25.301 INFO:tasks.workunit.client.1.smithi082.stdout:2/903: write d6/dc/d12/d46/fa0 [3616822,37883] 0 2024-02-15T22:41:25.307 INFO:tasks.workunit.client.1.smithi082.stdout:1/916: dwrite d1/dc8/d124/d11/d8c/f99 [0,4194304] 0 2024-02-15T22:41:25.307 INFO:tasks.workunit.client.1.smithi082.stdout:5/999: write d5/da/f1c [18337,5736] 0 2024-02-15T22:41:25.314 INFO:tasks.workunit.client.1.smithi082.stdout:0/927: mkdir d3/d19/d20/d7c/dd5/deb/da5/d151 0 2024-02-15T22:41:25.319 INFO:tasks.workunit.client.1.smithi082.stdout:9/937: rename d8/d24/d2e/l54 to d8/d24/d2e/d53/l129 0 2024-02-15T22:41:25.319 INFO:tasks.workunit.client.1.smithi082.stdout:9/938: dread - d8/d24/d2e/d53/f10e zero size 2024-02-15T22:41:25.320 INFO:tasks.workunit.client.1.smithi082.stdout:8/922: symlink d1/d7/d9/d42/d6a/da5/ddd/l13b 0 2024-02-15T22:41:25.320 INFO:tasks.workunit.client.1.smithi082.stdout:8/923: dread - d1/d7/de/ffb zero size 2024-02-15T22:41:25.323 INFO:tasks.workunit.client.1.smithi082.stdout:3/930: getdents d0/dc/d3f/deb 0 2024-02-15T22:41:25.332 INFO:tasks.workunit.client.1.smithi082.stdout:6/962: dwrite d2/d18/d39/f88 [0,4194304] 0 2024-02-15T22:41:25.333 INFO:tasks.workunit.client.1.smithi082.stdout:2/904: dwrite d6/d18/fd9 [0,4194304] 0 2024-02-15T22:41:25.334 INFO:tasks.workunit.client.1.smithi082.stdout:0/928: symlink d3/l152 0 2024-02-15T22:41:25.336 INFO:tasks.workunit.client.1.smithi082.stdout:1/917: rename d1/dc8/d124/d14/d18/d6d/dc9/d112 to d1/dc8/d124/d14/d18/d6d/d12e 0 2024-02-15T22:41:25.337 INFO:tasks.workunit.client.1.smithi082.stdout:9/939: mknod d8/d24/d87/de0/d77/dc6/c12a 0 2024-02-15T22:41:25.337 INFO:tasks.workunit.client.1.smithi082.stdout:2/905: dread d6/d18/f47 [0,4194304] 0 2024-02-15T22:41:25.337 INFO:tasks.workunit.client.1.smithi082.stdout:3/931: dread d0/d16/f1f [0,4194304] 0 2024-02-15T22:41:25.339 INFO:tasks.workunit.client.1.smithi082.stdout:8/924: mknod d1/d7/d48/d6f/c13c 0 2024-02-15T22:41:25.349 INFO:tasks.workunit.client.1.smithi082.stdout:6/963: dwrite d2/d45/dc5/f124 [0,4194304] 0 2024-02-15T22:41:25.358 INFO:tasks.workunit.client.1.smithi082.stdout:0/929: rename d3/d19/d20/d7c/dd5/deb/f10d to d3/d19/d11d/f153 0 2024-02-15T22:41:25.358 INFO:tasks.workunit.client.1.smithi082.stdout:0/930: write d3/d19/d1c/d76/d88/f11f [356025,38093] 0 2024-02-15T22:41:25.358 INFO:tasks.workunit.client.1.smithi082.stdout:0/931: fdatasync d3/d19/d20/d7c/dd5/deb/da5/d99/db1/fd4 0 2024-02-15T22:41:25.358 INFO:tasks.workunit.client.1.smithi082.stdout:0/932: dread - d3/d19/d20/d7c/dd5/deb/da0/dbc/f13b zero size 2024-02-15T22:41:25.359 INFO:tasks.workunit.client.1.smithi082.stdout:1/918: creat d1/dc8/d124/d14/f12f x:0 0 0 2024-02-15T22:41:25.359 INFO:tasks.workunit.client.1.smithi082.stdout:1/919: chown d1/dc8/d124/d14/d18/d51/f97 180625551 1 2024-02-15T22:41:25.361 INFO:tasks.workunit.client.1.smithi082.stdout:9/940: creat d8/d24/f12b x:0 0 0 2024-02-15T22:41:25.362 INFO:tasks.workunit.client.1.smithi082.stdout:3/932: creat d0/d16/d62/d14/d71/df4/f133 x:0 0 0 2024-02-15T22:41:25.363 INFO:tasks.workunit.client.1.smithi082.stdout:8/925: mkdir d1/d40/dbb/dcf/d13d 0 2024-02-15T22:41:25.365 INFO:tasks.workunit.client.1.smithi082.stdout:0/933: read d3/d19/f24 [3743365,33554] 0 2024-02-15T22:41:25.367 INFO:tasks.workunit.client.1.smithi082.stdout:6/964: mkdir d2/d18/d8a/d47/d69/d75/d140 0 2024-02-15T22:41:25.372 INFO:tasks.workunit.client.1.smithi082.stdout:2/906: rename d6/dc/dd/d24/d71/cf5 to d6/dc/d12/d23/d6e/c116 0 2024-02-15T22:41:25.373 INFO:tasks.workunit.client.1.smithi082.stdout:1/920: symlink d1/dc8/d124/d14/d18/d6d/d89/l130 0 2024-02-15T22:41:25.373 INFO:tasks.workunit.client.1.smithi082.stdout:1/921: chown d1/dc8/d124/d11/d93/db6/l101 250 1 2024-02-15T22:41:25.374 INFO:tasks.workunit.client.1.smithi082.stdout:9/941: creat d8/d12/d11b/f12c x:0 0 0 2024-02-15T22:41:25.377 INFO:tasks.workunit.client.1.smithi082.stdout:0/934: rename d3/c14 to d3/d19/d20/d7c/dd5/c154 0 2024-02-15T22:41:25.378 INFO:tasks.workunit.client.1.smithi082.stdout:0/935: dread d3/d19/d20/d7c/dd5/deb/da0/dbc/fcd [0,4194304] 0 2024-02-15T22:41:25.380 INFO:tasks.workunit.client.1.smithi082.stdout:1/922: creat d1/dc8/d124/d14/d18/d1f/d76/da7/d110/f131 x:0 0 0 2024-02-15T22:41:25.381 INFO:tasks.workunit.client.1.smithi082.stdout:1/923: write d1/dc8/d124/d14/d18/d51/f71 [140525,108883] 0 2024-02-15T22:41:25.381 INFO:tasks.workunit.client.1.smithi082.stdout:3/933: mkdir d0/dc/d3f/d134 0 2024-02-15T22:41:25.383 INFO:tasks.workunit.client.1.smithi082.stdout:6/965: rename d2/d18/d23/f35 to d2/d30/d3b/f141 0 2024-02-15T22:41:25.384 INFO:tasks.workunit.client.1.smithi082.stdout:9/942: write d8/d12/fcd [3553757,42623] 0 2024-02-15T22:41:25.384 INFO:tasks.workunit.client.1.smithi082.stdout:9/943: write d8/d24/d2e/f41 [1648662,68453] 0 2024-02-15T22:41:25.384 INFO:tasks.workunit.client.1.smithi082.stdout:0/936: mkdir d3/d6b/dac/d155 0 2024-02-15T22:41:25.386 INFO:tasks.workunit.client.1.smithi082.stdout:1/924: link d1/dc8/d124/d11/c11a d1/dc8/d124/d14/db4/c132 0 2024-02-15T22:41:25.386 INFO:tasks.workunit.client.1.smithi082.stdout:8/926: dwrite d1/d7/d48/f64 [4194304,4194304] 0 2024-02-15T22:41:25.386 INFO:tasks.workunit.client.1.smithi082.stdout:8/927: stat d1/d7/c1a 0 2024-02-15T22:41:25.387 INFO:tasks.workunit.client.1.smithi082.stdout:3/934: unlink d0/d16/d62/d14/l1e 0 2024-02-15T22:41:25.388 INFO:tasks.workunit.client.1.smithi082.stdout:6/966: mkdir d2/d18/d8a/d47/d69/dc1/d142 0 2024-02-15T22:41:25.389 INFO:tasks.workunit.client.1.smithi082.stdout:6/967: chown d2/d18/d8a/d47/d72/f78 23683 1 2024-02-15T22:41:25.390 INFO:tasks.workunit.client.1.smithi082.stdout:9/944: mkdir d8/d12d 0 2024-02-15T22:41:25.391 INFO:tasks.workunit.client.1.smithi082.stdout:1/925: symlink d1/dc8/d124/d11/l133 0 2024-02-15T22:41:25.393 INFO:tasks.workunit.client.1.smithi082.stdout:3/935: creat d0/d16/d3e/d56/db0/de1/f135 x:0 0 0 2024-02-15T22:41:25.394 INFO:tasks.workunit.client.1.smithi082.stdout:6/968: rename d2/d18/d23/c40 to d2/d30/c143 0 2024-02-15T22:41:25.396 INFO:tasks.workunit.client.1.smithi082.stdout:7/960: sync 2024-02-15T22:41:25.396 INFO:tasks.workunit.client.1.smithi082.stdout:7/961: creat d12/d27/d6e/d6a/d9e/dbe/dcb/d114/dfe/f145 x:0 0 0 2024-02-15T22:41:25.396 INFO:tasks.workunit.client.1.smithi082.stdout:7/962: chown d12/d27/d74/da2/laf 150813485 1 2024-02-15T22:41:25.397 INFO:tasks.workunit.client.1.smithi082.stdout:0/937: dread d3/d19/d20/d7c/dd5/f102 [0,4194304] 0 2024-02-15T22:41:25.400 INFO:tasks.workunit.client.1.smithi082.stdout:2/907: dwrite d6/dc/dd/d24/f43 [0,4194304] 0 2024-02-15T22:41:25.406 INFO:tasks.workunit.client.1.smithi082.stdout:1/926: rename d1/dc8/d124/d14/d18/ca1 to d1/dc8/d124/d14/d18/d6d/d89/c134 0 2024-02-15T22:41:25.406 INFO:tasks.workunit.client.1.smithi082.stdout:7/963: getdents d12/d27/d6e/d6a/d9e/dbe/dcb/d114/d138 0 2024-02-15T22:41:25.406 INFO:tasks.workunit.client.1.smithi082.stdout:7/964: dread - d12/d17/d3d/f12f zero size 2024-02-15T22:41:25.406 INFO:tasks.workunit.client.1.smithi082.stdout:3/936: rmdir d0/d16/d62/d14/d21/d69/d6c 39 2024-02-15T22:41:25.407 INFO:tasks.workunit.client.1.smithi082.stdout:6/969: dread d2/d18/d8a/d47/d69/d75/de4/d13e/fd9 [0,4194304] 0 2024-02-15T22:41:25.409 INFO:tasks.workunit.client.1.smithi082.stdout:1/927: truncate d1/dc8/d124/d14/d18/d1f/d7a/f128 4042090 0 2024-02-15T22:41:25.409 INFO:tasks.workunit.client.1.smithi082.stdout:1/928: stat d1/dc8/d124/d14/d18/d51/f73 0 2024-02-15T22:41:25.409 INFO:tasks.workunit.client.1.smithi082.stdout:1/929: chown d1/dc8/d124/d14/d18/d6d/f86 14570528 1 2024-02-15T22:41:25.411 INFO:tasks.workunit.client.1.smithi082.stdout:0/938: dread d3/d19/fc1 [0,4194304] 0 2024-02-15T22:41:25.415 INFO:tasks.workunit.client.1.smithi082.stdout:9/945: dwrite f5 [0,4194304] 0 2024-02-15T22:41:25.415 INFO:tasks.workunit.client.1.smithi082.stdout:8/928: dwrite d1/f4f [0,4194304] 0 2024-02-15T22:41:25.416 INFO:tasks.workunit.client.1.smithi082.stdout:7/965: truncate d12/d37/f70 2502286 0 2024-02-15T22:41:25.416 INFO:tasks.workunit.client.1.smithi082.stdout:7/966: fsync d12/f2d 0 2024-02-15T22:41:25.416 INFO:tasks.workunit.client.1.smithi082.stdout:7/967: truncate d12/d27/d6e/d6a/d9e/dbe/dcb/fe8 219909 0 2024-02-15T22:41:25.419 INFO:tasks.workunit.client.1.smithi082.stdout:3/937: mkdir d0/d16/d62/d14/d21/dee/d11a/d136 0 2024-02-15T22:41:25.419 INFO:tasks.workunit.client.1.smithi082.stdout:3/938: write d0/d16/d3e/d56/f10f [1193075,92985] 0 2024-02-15T22:41:25.426 INFO:tasks.workunit.client.1.smithi082.stdout:6/970: mknod d2/d30/c144 0 2024-02-15T22:41:25.440 INFO:tasks.workunit.client.1.smithi082.stdout:7/968: rmdir d12/d27/d6e/d6a/d9e/dbe/dcb/d114/d138/d142 0 2024-02-15T22:41:25.446 INFO:tasks.workunit.client.1.smithi082.stdout:6/971: rename d2/d30/d3b/d10e/f133 to d2/d18/d8a/d47/d72/d80/d118/f145 0 2024-02-15T22:41:25.446 INFO:tasks.workunit.client.1.smithi082.stdout:6/972: truncate d2/d30/da6/fc3 1943675 0 2024-02-15T22:41:25.447 INFO:tasks.workunit.client.1.smithi082.stdout:7/969: unlink d12/f20 0 2024-02-15T22:41:25.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/970: chown d12/d3b/d5a/dce/lf4 2011017 1 2024-02-15T22:41:25.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/971: dread - d12/d17/d42/d67/d81/fa1 zero size 2024-02-15T22:41:25.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/972: truncate d12/d27/d6e/d6a/d9e/dbe/dcb/d114/f66 1223855 0 2024-02-15T22:41:25.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/973: write d12/d17/d42/d67/d81/d91/dbc/fd3 [2269653,52307] 0 2024-02-15T22:41:25.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/974: readlink d12/d27/d6e/d6a/db2/l129 0 2024-02-15T22:41:25.448 INFO:tasks.workunit.client.1.smithi082.stdout:7/975: dread d12/d17/d42/d67/d81/dc0/fe9 [0,4194304] 0 2024-02-15T22:41:25.449 INFO:tasks.workunit.client.1.smithi082.stdout:6/973: mknod d2/d18/d8a/d47/d69/d75/d140/c146 0 2024-02-15T22:41:25.453 INFO:tasks.workunit.client.1.smithi082.stdout:1/930: dwrite d1/dc8/d124/d14/d18/d6d/f86 [0,4194304] 0 2024-02-15T22:41:25.453 INFO:tasks.workunit.client.1.smithi082.stdout:0/939: dwrite d3/d19/d20/fd7 [0,4194304] 0 2024-02-15T22:41:25.453 INFO:tasks.workunit.client.1.smithi082.stdout:9/946: dwrite d8/d12/d67/d70/ffe [0,4194304] 0 2024-02-15T22:41:25.454 INFO:tasks.workunit.client.1.smithi082.stdout:9/947: write d8/d24/d87/de0/daf/fb2 [730980,103473] 0 2024-02-15T22:41:25.454 INFO:tasks.workunit.client.1.smithi082.stdout:8/929: dwrite d1/f5 [0,4194304] 0 2024-02-15T22:41:25.455 INFO:tasks.workunit.client.1.smithi082.stdout:3/939: dwrite d0/d16/d62/d14/d21/f103 [0,4194304] 0 2024-02-15T22:41:25.455 INFO:tasks.workunit.client.1.smithi082.stdout:3/940: fsync d0/d16/d62/d14/fe4 0 2024-02-15T22:41:25.457 INFO:tasks.workunit.client.1.smithi082.stdout:7/976: creat d12/d27/dc4/f146 x:0 0 0 2024-02-15T22:41:25.462 INFO:tasks.workunit.client.1.smithi082.stdout:6/974: creat d2/d18/d23/f147 x:0 0 0 2024-02-15T22:41:25.462 INFO:tasks.workunit.client.1.smithi082.stdout:6/975: stat d2/d18/d8a/f3d 0 2024-02-15T22:41:25.464 INFO:tasks.workunit.client.1.smithi082.stdout:1/931: write d1/dc8/d124/d14/d18/d6d/f6f [253053,89053] 0 2024-02-15T22:41:25.471 INFO:tasks.workunit.client.1.smithi082.stdout:0/940: symlink d3/d19/d20/d7c/dd5/deb/da0/l156 0 2024-02-15T22:41:25.485 INFO:tasks.workunit.client.1.smithi082.stdout:9/948: rename d8/d24/d87/de0/d8b/ldd to d8/d12d/l12e 0 2024-02-15T22:41:25.489 INFO:tasks.workunit.client.1.smithi082.stdout:8/930: unlink d1/d7/d9/d42/cb4 0 2024-02-15T22:41:25.496 INFO:tasks.workunit.client.1.smithi082.stdout:3/941: creat d0/d16/d62/d79/f137 x:0 0 0 2024-02-15T22:41:25.496 INFO:tasks.workunit.client.1.smithi082.stdout:3/942: write d0/d16/d62/d14/d71/da2/f7f [1457537,58606] 0 2024-02-15T22:41:25.496 INFO:tasks.workunit.client.1.smithi082.stdout:3/943: readlink d0/d16/d62/d2e/dcc/ld2 0 2024-02-15T22:41:25.496 INFO:tasks.workunit.client.1.smithi082.stdout:7/977: symlink d12/d17/d4d/l147 0 2024-02-15T22:41:25.500 INFO:tasks.workunit.client.1.smithi082.stdout:6/976: mkdir d2/d45/dc5/d129/d148 0 2024-02-15T22:41:25.500 INFO:tasks.workunit.client.1.smithi082.stdout:6/977: chown d2/d18/d8a/da7/fff 28 1 2024-02-15T22:41:25.500 INFO:tasks.workunit.client.1.smithi082.stdout:6/978: write d2/d18/d8a/d47/d69/db1/fcc [848140,11903] 0 2024-02-15T22:41:25.500 INFO:tasks.workunit.client.1.smithi082.stdout:6/979: dread - d2/d18/d8a/da7/fc6 zero size 2024-02-15T22:41:25.500 INFO:tasks.workunit.client.1.smithi082.stdout:6/980: read - d2/d18/d8a/da7/fff zero size 2024-02-15T22:41:25.500 INFO:tasks.workunit.client.1.smithi082.stdout:6/981: chown d2/f98 36530114 1 2024-02-15T22:41:25.511 INFO:tasks.workunit.client.1.smithi082.stdout:0/941: unlink d3/d19/f44 0 2024-02-15T22:41:25.511 INFO:tasks.workunit.client.1.smithi082.stdout:0/942: chown d3/d19/d1c/d6d/c104 774297 1 2024-02-15T22:41:25.512 INFO:tasks.workunit.client.1.smithi082.stdout:0/943: fsync d3/d19/d20/d7c/dd5/deb/d92/f114 0 2024-02-15T22:41:25.512 INFO:tasks.workunit.client.1.smithi082.stdout:0/944: chown d3/d19/d20/d7c/dd5/deb/da5/d9c/fb0 1182552 1 2024-02-15T22:41:25.518 INFO:tasks.workunit.client.1.smithi082.stdout:3/944: dwrite d0/d16/d62/d2e/f81 [0,4194304] 0 2024-02-15T22:41:25.531 INFO:tasks.workunit.client.1.smithi082.stdout:0/945: dwrite d3/d6b/d7f/f14e [0,4194304] 0 2024-02-15T22:41:25.531 INFO:tasks.workunit.client.1.smithi082.stdout:9/949: rename d8/d12/d33/f3b to d8/d24/d87/dcb/de5/f12f 0 2024-02-15T22:41:25.531 INFO:tasks.workunit.client.1.smithi082.stdout:9/950: chown d8/f2c 24552672 1 2024-02-15T22:41:25.534 INFO:tasks.workunit.client.1.smithi082.stdout:9/951: dread d8/d24/d87/f9c [0,4194304] 0 2024-02-15T22:41:25.535 INFO:tasks.workunit.client.1.smithi082.stdout:7/978: mkdir d12/d37/d148 0 2024-02-15T22:41:25.536 INFO:tasks.workunit.client.1.smithi082.stdout:6/982: symlink d2/d30/da6/de1/l149 0 2024-02-15T22:41:25.536 INFO:tasks.workunit.client.1.smithi082.stdout:6/983: read d2/d18/f10b [2858719,78171] 0 2024-02-15T22:41:25.540 INFO:tasks.workunit.client.1.smithi082.stdout:3/945: link d0/dc/fd d0/d16/d62/d14/d71/d86/f138 0 2024-02-15T22:41:25.547 INFO:tasks.workunit.client.1.smithi082.stdout:3/946: write d0/d16/d62/d14/fe4 [3356486,82250] 0 2024-02-15T22:41:25.548 INFO:tasks.workunit.client.1.smithi082.stdout:3/947: chown d0/dc/d113 14574 1 2024-02-15T22:41:25.553 INFO:tasks.workunit.client.1.smithi082.stdout:6/984: dwrite d2/d18/d8a/d47/f54 [0,4194304] 0 2024-02-15T22:41:25.554 INFO:tasks.workunit.client.1.smithi082.stdout:6/985: truncate d2/d30/d3b/d10e/f125 662059 0 2024-02-15T22:41:25.556 INFO:tasks.workunit.client.1.smithi082.stdout:8/931: rename d1/d7/d48/f9f to d1/d7/de/d10c/f13e 0 2024-02-15T22:41:25.556 INFO:tasks.workunit.client.1.smithi082.stdout:8/932: creat d1/d7/d9/d42/f13f x:0 0 0 2024-02-15T22:41:25.558 INFO:tasks.workunit.client.1.smithi082.stdout:9/952: link d8/c95 d8/d24/d87/de0/d77/dc6/c130 0 2024-02-15T22:41:25.562 INFO:tasks.workunit.client.1.smithi082.stdout:7/979: unlink d12/d17/c116 0 2024-02-15T22:41:25.562 INFO:tasks.workunit.client.1.smithi082.stdout:7/980: truncate d12/d27/d6e/d6a/db2/f118 517695 0 2024-02-15T22:41:25.565 INFO:tasks.workunit.client.1.smithi082.stdout:3/948: mkdir d0/d16/d3e/d56/db0/de1/d139 0 2024-02-15T22:41:25.567 INFO:tasks.workunit.client.1.smithi082.stdout:6/986: dwrite d2/d45/dc5/f106 [0,4194304] 0 2024-02-15T22:41:25.567 INFO:tasks.workunit.client.1.smithi082.stdout:0/946: getdents d3/d19/d25 0 2024-02-15T22:41:25.569 INFO:tasks.workunit.client.1.smithi082.stdout:3/949: dread d0/d16/d62/d79/f125 [0,4194304] 0 2024-02-15T22:41:25.575 INFO:tasks.workunit.client.1.smithi082.stdout:0/947: write d3/d19/fc1 [2002958,2684] 0 2024-02-15T22:41:25.583 INFO:tasks.workunit.client.1.smithi082.stdout:8/933: mkdir d1/d40/dbb/dff/da6/db6/d104/d140 0 2024-02-15T22:41:25.583 INFO:tasks.workunit.client.1.smithi082.stdout:8/934: dread - d1/d40/dbb/dff/da6/db6/dca/f9b zero size 2024-02-15T22:41:25.583 INFO:tasks.workunit.client.1.smithi082.stdout:8/935: fsync d1/d40/dbb/dcf/f10e 0 2024-02-15T22:41:25.584 INFO:tasks.workunit.client.1.smithi082.stdout:9/953: mkdir d8/d12d/d131 0 2024-02-15T22:41:25.587 INFO:tasks.workunit.client.1.smithi082.stdout:7/981: mkdir d12/d3b/df9/d149 0 2024-02-15T22:41:25.594 INFO:tasks.workunit.client.1.smithi082.stdout:6/987: creat d2/d30/d3b/d120/f14a x:0 0 0 2024-02-15T22:41:25.594 INFO:tasks.workunit.client.1.smithi082.stdout:9/954: dread d8/d12/d30/d3c/d65/d10b/f111 [0,4194304] 0 2024-02-15T22:41:25.594 INFO:tasks.workunit.client.1.smithi082.stdout:9/955: readlink d8/db5/d114/lfd 0 2024-02-15T22:41:25.596 INFO:tasks.workunit.client.1.smithi082.stdout:3/950: dwrite d0/dc/fbd [4194304,4194304] 0 2024-02-15T22:41:25.597 INFO:tasks.workunit.client.1.smithi082.stdout:7/982: dread d12/d27/d33/f36 [0,4194304] 0 2024-02-15T22:41:25.597 INFO:tasks.workunit.client.1.smithi082.stdout:7/983: fdatasync d12/d17/d3d/f55 0 2024-02-15T22:41:25.597 INFO:tasks.workunit.client.1.smithi082.stdout:7/984: fsync d12/f2d 0 2024-02-15T22:41:25.600 INFO:tasks.workunit.client.1.smithi082.stdout:0/948: rename d3/d19/d20/d7c/dd5/deb/da5/d99/db1/f145 to d3/d19/d20/d7c/dd5/deb/da5/d151/f157 0 2024-02-15T22:41:25.600 INFO:tasks.workunit.client.1.smithi082.stdout:0/949: fsync d3/f49 0 2024-02-15T22:41:25.603 INFO:tasks.workunit.client.1.smithi082.stdout:8/936: unlink d1/d40/dbb/dce/dfc/l130 0 2024-02-15T22:41:25.604 INFO:tasks.workunit.client.1.smithi082.stdout:6/988: link d2/d18/d23/d67/fac d2/d18/d8a/d47/d69/d75/de4/d13e/f14b 0 2024-02-15T22:41:25.606 INFO:tasks.workunit.client.1.smithi082.stdout:6/989: dread d2/d18/d8a/d47/f8b [0,4194304] 0 2024-02-15T22:41:25.606 INFO:tasks.workunit.client.1.smithi082.stdout:6/990: fdatasync d2/d18/f128 0 2024-02-15T22:41:25.608 INFO:tasks.workunit.client.1.smithi082.stdout:3/951: link d0/d16/d62/d14/f40 d0/d16/d62/d79/f13a 0 2024-02-15T22:41:25.612 INFO:tasks.workunit.client.1.smithi082.stdout:7/985: symlink d12/d27/d6e/d6a/d9e/dbe/l14a 0 2024-02-15T22:41:25.617 INFO:tasks.workunit.client.1.smithi082.stdout:9/956: rename d8/d12/d67/d70/d97/c124 to d8/d24/d87/de0/d77/dc6/de6/d127/c132 0 2024-02-15T22:41:25.617 INFO:tasks.workunit.client.1.smithi082.stdout:9/957: fsync d8/d12/d30/d3c/d65/d10b/f116 0 2024-02-15T22:41:25.617 INFO:tasks.workunit.client.1.smithi082.stdout:9/958: fdatasync d8/f1c 0 2024-02-15T22:41:25.617 INFO:tasks.workunit.client.1.smithi082.stdout:9/959: dread - d8/d12/d67/d70/d97/ff0 zero size 2024-02-15T22:41:25.620 INFO:tasks.workunit.client.1.smithi082.stdout:8/937: unlink d1/d7/f54 0 2024-02-15T22:41:25.622 INFO:tasks.workunit.client.1.smithi082.stdout:3/952: creat d0/d16/d62/d2e/d84/f13b x:0 0 0 2024-02-15T22:41:25.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:25 smithi082 ceph-mon[37153]: pgmap v25: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 354 op/s 2024-02-15T22:41:25.625 INFO:tasks.workunit.client.1.smithi082.stdout:7/986: symlink d12/d27/d6e/d6a/d9e/dbe/dcb/dd5/l14b 0 2024-02-15T22:41:25.627 INFO:tasks.workunit.client.1.smithi082.stdout:7/987: write d12/d3b/d5a/dce/fca [17933,26414] 0 2024-02-15T22:41:25.631 INFO:tasks.workunit.client.1.smithi082.stdout:0/950: rename d3/lf3 to d3/d19/d20/d7c/dd5/deb/da5/d99/db3/dfa/l158 0 2024-02-15T22:41:25.636 INFO:tasks.workunit.client.1.smithi082.stdout:9/960: mknod d8/d12/d33/da4/dac/c133 0 2024-02-15T22:41:25.636 INFO:tasks.workunit.client.1.smithi082.stdout:9/961: fsync d8/d24/d2e/f38 0 2024-02-15T22:41:25.639 INFO:tasks.workunit.client.1.smithi082.stdout:8/938: mkdir d1/d7/d9/d42/d6a/da5/d141 0 2024-02-15T22:41:25.639 INFO:tasks.workunit.client.1.smithi082.stdout:2/908: sync 2024-02-15T22:41:25.640 INFO:tasks.workunit.client.1.smithi082.stdout:0/951: dread d3/d19/d25/d45/f39 [0,4194304] 0 2024-02-15T22:41:25.641 INFO:tasks.workunit.client.1.smithi082.stdout:3/953: link d0/d16/d62/d14/d21/fef d0/d16/d62/d14/d71/df4/f13c 0 2024-02-15T22:41:25.646 INFO:tasks.workunit.client.1.smithi082.stdout:9/962: read d8/d24/d87/de0/fd7 [2028483,100083] 0 2024-02-15T22:41:25.647 INFO:tasks.workunit.client.1.smithi082.stdout:6/991: rename d2/d18/d8a/d47/d69/db1/lb9 to d2/d30/d3b/d120/l14c 0 2024-02-15T22:41:25.653 INFO:tasks.workunit.client.1.smithi082.stdout:8/939: symlink d1/d7/de/d10c/l142 0 2024-02-15T22:41:25.655 INFO:tasks.workunit.client.1.smithi082.stdout:0/952: dwrite d3/d19/d20/d7c/dd5/deb/da5/d151/f157 [0,4194304] 0 2024-02-15T22:41:25.655 INFO:tasks.workunit.client.1.smithi082.stdout:0/953: write d3/d19/d20/d7c/dd5/deb/da5/f6f [814135,17705] 0 2024-02-15T22:41:25.655 INFO:tasks.workunit.client.1.smithi082.stdout:0/954: write d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/ff0 [3739436,115549] 0 2024-02-15T22:41:25.656 INFO:tasks.workunit.client.1.smithi082.stdout:2/909: link d6/d18/f22 d6/dc/d58/f117 0 2024-02-15T22:41:25.656 INFO:tasks.workunit.client.1.smithi082.stdout:1/932: sync 2024-02-15T22:41:25.656 INFO:tasks.workunit.client.1.smithi082.stdout:6/992: mknod d2/d18/d8a/d47/d69/dd0/c14d 0 2024-02-15T22:41:25.658 INFO:tasks.workunit.client.1.smithi082.stdout:8/940: mknod d1/d7/de/c143 0 2024-02-15T22:41:25.663 INFO:tasks.workunit.client.1.smithi082.stdout:0/955: mkdir d3/d19/d20/d7c/dd5/deb/da5/d99/db3/d159 0 2024-02-15T22:41:25.664 INFO:tasks.workunit.client.1.smithi082.stdout:2/910: write d6/dc/d58/d49/f56 [3104931,21331] 0 2024-02-15T22:41:25.664 INFO:tasks.workunit.client.1.smithi082.stdout:1/933: creat d1/dc8/d124/d11/d93/f135 x:0 0 0 2024-02-15T22:41:25.666 INFO:tasks.workunit.client.1.smithi082.stdout:6/993: creat d2/d18/d8a/d47/d69/d75/d140/f14e x:0 0 0 2024-02-15T22:41:25.666 INFO:tasks.workunit.client.1.smithi082.stdout:6/994: read - d2/d18/d8a/d47/d69/dc1/ded/ff5 zero size 2024-02-15T22:41:25.668 INFO:tasks.workunit.client.1.smithi082.stdout:9/963: dwrite d8/db5/d114/da1/f112 [0,4194304] 0 2024-02-15T22:41:25.669 INFO:tasks.workunit.client.1.smithi082.stdout:0/956: mknod d3/d19/d20/d7c/dd5/deb/d13c/c15a 0 2024-02-15T22:41:25.669 INFO:tasks.workunit.client.1.smithi082.stdout:0/957: dread - d3/d19/f11c zero size 2024-02-15T22:41:25.669 INFO:tasks.workunit.client.1.smithi082.stdout:0/958: chown d3/d19/d20/d7c/dcf/d12b 57556 1 2024-02-15T22:41:25.671 INFO:tasks.workunit.client.1.smithi082.stdout:2/911: symlink d6/dc/d12/d46/d4b/l118 0 2024-02-15T22:41:25.671 INFO:tasks.workunit.client.1.smithi082.stdout:2/912: truncate d6/dc/d58/fc1 38789 0 2024-02-15T22:41:25.672 INFO:tasks.workunit.client.1.smithi082.stdout:1/934: mknod d1/dc8/d124/d14/d18/d6d/c136 0 2024-02-15T22:41:25.673 INFO:tasks.workunit.client.1.smithi082.stdout:6/995: truncate d2/d18/f44 1400481 0 2024-02-15T22:41:25.679 INFO:tasks.workunit.client.1.smithi082.stdout:8/941: dwrite d1/d7/de/d10c/f13e [4194304,4194304] 0 2024-02-15T22:41:25.680 INFO:tasks.workunit.client.1.smithi082.stdout:0/959: rename d3/d19/d20/d7c/dd5/deb/da5/d99/db1/cc6 to d3/d6b/d7f/c15b 0 2024-02-15T22:41:25.682 INFO:tasks.workunit.client.1.smithi082.stdout:2/913: creat d6/dc/d12/d46/d76/f119 x:0 0 0 2024-02-15T22:41:25.682 INFO:tasks.workunit.client.1.smithi082.stdout:2/914: readlink d6/dc/dd/d24/d72/la3 0 2024-02-15T22:41:25.682 INFO:tasks.workunit.client.1.smithi082.stdout:2/915: readlink d6/dc/dd/l112 0 2024-02-15T22:41:25.683 INFO:tasks.workunit.client.1.smithi082.stdout:9/964: rmdir d8/d12/d30/d3c/d71 39 2024-02-15T22:41:25.685 INFO:tasks.workunit.client.1.smithi082.stdout:1/935: rename d1/dc8/d124/d11/d8c/f99 to d1/dc8/d124/d14/d18/d6d/dc9/f137 0 2024-02-15T22:41:25.686 INFO:tasks.workunit.client.1.smithi082.stdout:0/960: mkdir d3/d19/d93/dbe/df4/d13f/d15c 0 2024-02-15T22:41:25.686 INFO:tasks.workunit.client.1.smithi082.stdout:0/961: write d3/d19/d25/d45/f39 [3316382,61033] 0 2024-02-15T22:41:25.686 INFO:tasks.workunit.client.1.smithi082.stdout:0/962: chown d3/d19/d20/d7c/dd5/deb/f63 47370541 1 2024-02-15T22:41:25.687 INFO:tasks.workunit.client.1.smithi082.stdout:9/965: mknod d8/d12/d67/c134 0 2024-02-15T22:41:25.689 INFO:tasks.workunit.client.1.smithi082.stdout:1/936: mkdir d1/dc8/d124/d11/d3f/d75/d138 0 2024-02-15T22:41:25.690 INFO:tasks.workunit.client.1.smithi082.stdout:0/963: unlink d3/d19/d1c/d76/f9b 0 2024-02-15T22:41:25.691 INFO:tasks.workunit.client.1.smithi082.stdout:6/996: dwrite d2/f1e [0,4194304] 0 2024-02-15T22:41:25.691 INFO:tasks.workunit.client.1.smithi082.stdout:9/966: symlink d8/db5/l135 0 2024-02-15T22:41:25.693 INFO:tasks.workunit.client.1.smithi082.stdout:1/937: mknod d1/dc8/d124/d11/d93/d102/c139 0 2024-02-15T22:41:25.693 INFO:tasks.workunit.client.1.smithi082.stdout:8/942: write d1/d40/dbb/dff/fae [3828502,29595] 0 2024-02-15T22:41:25.694 INFO:tasks.workunit.client.1.smithi082.stdout:6/997: creat d2/d18/d8a/d47/d69/dc1/d137/f14f x:0 0 0 2024-02-15T22:41:25.696 INFO:tasks.workunit.client.1.smithi082.stdout:2/916: dread d6/dc/d12/d46/d76/ff7 [0,4194304] 0 2024-02-15T22:41:25.696 INFO:tasks.workunit.client.1.smithi082.stdout:9/967: truncate d8/d24/d87/de0/d77/dab/fb1 575767 0 2024-02-15T22:41:25.696 INFO:tasks.workunit.client.1.smithi082.stdout:9/968: chown d8/d24/c61 28091 1 2024-02-15T22:41:25.696 INFO:tasks.workunit.client.1.smithi082.stdout:2/917: fdatasync d6/dc/d12/d46/d4b/d63/f66 0 2024-02-15T22:41:25.696 INFO:tasks.workunit.client.1.smithi082.stdout:2/918: chown d6/dc/dd/d21/l45 2179015 1 2024-02-15T22:41:25.699 INFO:tasks.workunit.client.1.smithi082.stdout:1/938: unlink d1/dc8/d124/d11/d93/db6/l101 0 2024-02-15T22:41:25.700 INFO:tasks.workunit.client.1.smithi082.stdout:8/943: truncate d1/d7/d9/d42/dc5/f88 2578687 0 2024-02-15T22:41:25.700 INFO:tasks.workunit.client.1.smithi082.stdout:8/944: creat d1/d40/dbb/dcf/f144 x:0 0 0 2024-02-15T22:41:25.701 INFO:tasks.workunit.client.1.smithi082.stdout:1/939: dread d1/fc6 [0,4194304] 0 2024-02-15T22:41:25.701 INFO:tasks.workunit.client.1.smithi082.stdout:1/940: write d1/dc8/d124/d14/d18/d6d/f11e [956271,46472] 0 2024-02-15T22:41:25.701 INFO:tasks.workunit.client.1.smithi082.stdout:1/941: fsync d1/dc8/d124/d11/fae 0 2024-02-15T22:41:25.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/964: write d3/d19/d1c/d6d/f94 [10541,108414] 0 2024-02-15T22:41:25.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/965: write d3/d19/d20/d7c/dd5/f132 [4226251,55811] 0 2024-02-15T22:41:25.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/966: readlink d3/d19/d1c/d6d/lc2 0 2024-02-15T22:41:25.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/967: write d3/d19/d25/d80/ff8 [13916,95270] 0 2024-02-15T22:41:25.703 INFO:tasks.workunit.client.1.smithi082.stdout:0/968: write d3/d19/d25/d45/f13a [2493771,51076] 0 2024-02-15T22:41:25.709 INFO:tasks.workunit.client.1.smithi082.stdout:1/942: mkdir d1/dc8/d124/d14/d18/d1f/d7a/dd1/d13a 0 2024-02-15T22:41:25.711 INFO:tasks.workunit.client.1.smithi082.stdout:9/969: dread d8/d12/d30/d3c/d65/f6e [0,4194304] 0 2024-02-15T22:41:25.715 INFO:tasks.workunit.client.1.smithi082.stdout:1/943: dread d1/dc8/d124/d11/d8c/db3/f104 [0,4194304] 0 2024-02-15T22:41:25.716 INFO:tasks.workunit.client.1.smithi082.stdout:8/945: write d1/d7/d9/d42/f46 [3618878,86135] 0 2024-02-15T22:41:25.716 INFO:tasks.workunit.client.1.smithi082.stdout:8/946: write d1/d40/dbb/dff/fb5 [723090,32046] 0 2024-02-15T22:41:25.716 INFO:tasks.workunit.client.1.smithi082.stdout:8/947: chown d1/d40/dbb/dff/d85/fb2 1014682 1 2024-02-15T22:41:25.722 INFO:tasks.workunit.client.1.smithi082.stdout:0/969: unlink d3/d19/d20/d7c/dd5/l119 0 2024-02-15T22:41:25.722 INFO:tasks.workunit.client.1.smithi082.stdout:0/970: truncate d3/d19/d20/d7c/dd5/deb/da0/dbc/f13b 558873 0 2024-02-15T22:41:25.722 INFO:tasks.workunit.client.1.smithi082.stdout:0/971: truncate d3/d6b/d7f/f12e 178196 0 2024-02-15T22:41:25.723 INFO:tasks.workunit.client.1.smithi082.stdout:9/970: symlink d8/d12/l136 0 2024-02-15T22:41:25.727 INFO:tasks.workunit.client.1.smithi082.stdout:1/944: rename d1/dc8/d124/d14/d18/d51/f59 to d1/dc8/d124/d14/d18/d6d/d12e/f13b 0 2024-02-15T22:41:25.728 INFO:tasks.workunit.client.1.smithi082.stdout:1/945: chown d1/dc8/d124/d14/d18/d1f/d7a/de5/f11b 6171558 1 2024-02-15T22:41:25.731 INFO:tasks.workunit.client.1.smithi082.stdout:2/919: dwrite d6/dc/d58/d49/db6/fb3 [0,4194304] 0 2024-02-15T22:41:25.732 INFO:tasks.workunit.client.1.smithi082.stdout:8/948: dwrite d1/d40/f6d [0,4194304] 0 2024-02-15T22:41:25.733 INFO:tasks.workunit.client.1.smithi082.stdout:0/972: creat d3/d19/d20/d7c/dd5/deb/da5/d99/db1/d113/f15d x:0 0 0 2024-02-15T22:41:25.736 INFO:tasks.workunit.client.1.smithi082.stdout:9/971: mknod d8/d12/dc5/c137 0 2024-02-15T22:41:25.737 INFO:tasks.workunit.client.1.smithi082.stdout:1/946: link d1/dc8/d124/d14/d18/d51/f81 d1/dc8/d124/d14/d18/d1f/d76/da7/f13c 0 2024-02-15T22:41:25.739 INFO:tasks.workunit.client.1.smithi082.stdout:2/920: symlink d6/dc/d12/d46/d76/dae/l11a 0 2024-02-15T22:41:25.740 INFO:tasks.workunit.client.1.smithi082.stdout:2/921: dread - d6/dc/d12/d46/d4b/d63/fc3 zero size 2024-02-15T22:41:25.742 INFO:tasks.workunit.client.1.smithi082.stdout:8/949: dread d1/d7/de/d57/f74 [0,4194304] 0 2024-02-15T22:41:25.744 INFO:tasks.workunit.client.1.smithi082.stdout:0/973: dread d3/d19/d1c/f52 [0,4194304] 0 2024-02-15T22:41:25.756 INFO:tasks.workunit.client.1.smithi082.stdout:2/922: dread d6/dc/d12/f10a [0,4194304] 0 2024-02-15T22:41:25.762 INFO:tasks.workunit.client.1.smithi082.stdout:2/923: dread d6/dc/dd/d24/f54 [0,4194304] 0 2024-02-15T22:41:25.763 INFO:tasks.workunit.client.1.smithi082.stdout:8/950: dwrite d1/d7/d48/ffe [0,4194304] 0 2024-02-15T22:41:25.764 INFO:tasks.workunit.client.1.smithi082.stdout:8/951: creat d1/d40/dbb/dff/da6/db6/dca/f145 x:0 0 0 2024-02-15T22:41:25.764 INFO:tasks.workunit.client.1.smithi082.stdout:8/952: fsync d1/d7/d9/f86 0 2024-02-15T22:41:25.766 INFO:tasks.workunit.client.1.smithi082.stdout:1/947: dwrite d1/dc8/d124/d14/d18/d1f/f9b [0,4194304] 0 2024-02-15T22:41:25.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:25 smithi033 ceph-mon[29033]: pgmap v25: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 354 op/s 2024-02-15T22:41:25.775 INFO:tasks.workunit.client.1.smithi082.stdout:9/972: mkdir d8/d12/d67/d70/d97/d138 0 2024-02-15T22:41:25.779 INFO:tasks.workunit.client.1.smithi082.stdout:0/974: symlink d3/d19/d93/dbe/df4/l15e 0 2024-02-15T22:41:25.785 INFO:tasks.workunit.client.1.smithi082.stdout:1/948: dwrite d1/dc8/d124/d11/d93/d102/f117 [0,4194304] 0 2024-02-15T22:41:25.786 INFO:tasks.workunit.client.1.smithi082.stdout:2/924: dwrite d6/dc/d12/d23/d6e/ff1 [0,4194304] 0 2024-02-15T22:41:25.787 INFO:tasks.workunit.client.1.smithi082.stdout:2/925: write d6/dc/dd/d21/d9f/d10f/f10b [866157,26533] 0 2024-02-15T22:41:25.787 INFO:tasks.workunit.client.1.smithi082.stdout:2/926: readlink d6/d18/l79 0 2024-02-15T22:41:25.791 INFO:tasks.workunit.client.1.smithi082.stdout:8/953: creat d1/d40/dbb/dff/da6/f146 x:0 0 0 2024-02-15T22:41:25.791 INFO:tasks.workunit.client.1.smithi082.stdout:8/954: chown d1/d7/de/d10c/f13e 54 1 2024-02-15T22:41:25.791 INFO:tasks.workunit.client.1.smithi082.stdout:8/955: write d1/d7/de/d57/f91 [713693,44030] 0 2024-02-15T22:41:25.793 INFO:tasks.workunit.client.1.smithi082.stdout:1/949: dread d1/dc8/d124/f24 [0,4194304] 0 2024-02-15T22:41:25.793 INFO:tasks.workunit.client.1.smithi082.stdout:1/950: stat d1/dc8/d124/d14/d18/d1f/d7a/de5/c12c 0 2024-02-15T22:41:25.794 INFO:tasks.workunit.client.1.smithi082.stdout:2/927: write d6/dc/d58/d49/d5e/f73 [3002358,74635] 0 2024-02-15T22:41:25.799 INFO:tasks.workunit.client.1.smithi082.stdout:9/973: link d8/db5/d114/fc9 d8/d24/d87/de0/d77/dc6/de6/f139 0 2024-02-15T22:41:25.800 INFO:tasks.workunit.client.1.smithi082.stdout:0/975: dwrite d3/d19/d20/d7c/dd5/deb/da5/f90 [0,4194304] 0 2024-02-15T22:41:25.805 INFO:tasks.workunit.client.1.smithi082.stdout:1/951: write d1/dc8/d124/d11/d3f/d75/fdc [388434,64179] 0 2024-02-15T22:41:25.805 INFO:tasks.workunit.client.1.smithi082.stdout:1/952: read - d1/dc8/d124/d14/d18/d1f/d76/da7/d110/f131 zero size 2024-02-15T22:41:25.814 INFO:tasks.workunit.client.1.smithi082.stdout:2/928: mknod d6/dc/d12/d46/d76/dae/de8/d104/c11b 0 2024-02-15T22:41:25.817 INFO:tasks.workunit.client.1.smithi082.stdout:9/974: getdents d8/d24/d87/de0/d77/dc6/de6/d127 0 2024-02-15T22:41:25.833 INFO:tasks.workunit.client.1.smithi082.stdout:7/988: sync 2024-02-15T22:41:25.834 INFO:tasks.workunit.client.1.smithi082.stdout:9/975: dwrite d8/d12/d33/d3e/fb7 [0,4194304] 0 2024-02-15T22:41:25.840 INFO:tasks.workunit.client.1.smithi082.stdout:1/953: link d1/dc8/d124/d11/d93/d102/c139 d1/dc8/d124/d11/c13d 0 2024-02-15T22:41:25.840 INFO:tasks.workunit.client.1.smithi082.stdout:2/929: getdents d6/dc/d12 0 2024-02-15T22:41:25.841 INFO:tasks.workunit.client.1.smithi082.stdout:3/954: sync 2024-02-15T22:41:25.841 INFO:tasks.workunit.client.1.smithi082.stdout:3/955: chown d0/d16/d62/d2e/d84/f64 32608146 1 2024-02-15T22:41:25.845 INFO:tasks.workunit.client.1.smithi082.stdout:8/956: rmdir d1/d7/d9/d50 39 2024-02-15T22:41:25.852 INFO:tasks.workunit.client.1.smithi082.stdout:3/956: dread d0/d16/d62/f50 [0,4194304] 0 2024-02-15T22:41:25.858 INFO:tasks.workunit.client.1.smithi082.stdout:3/957: dread d0/d16/d62/f7 [0,4194304] 0 2024-02-15T22:41:25.859 INFO:tasks.workunit.client.1.smithi082.stdout:3/958: read d0/d16/d62/d14/d71/fac [3234624,1699] 0 2024-02-15T22:41:25.859 INFO:tasks.workunit.client.1.smithi082.stdout:9/976: symlink d8/d12/d33/d128/l13a 0 2024-02-15T22:41:25.859 INFO:tasks.workunit.client.1.smithi082.stdout:6/998: sync 2024-02-15T22:41:25.860 INFO:tasks.workunit.client.1.smithi082.stdout:0/976: getdents d3/d19/d25/d80/dd3 0 2024-02-15T22:41:25.860 INFO:tasks.workunit.client.1.smithi082.stdout:0/977: chown d3/d19/d20/d7c/dd5/deb/da5/d99/db1/f106 435771790 1 2024-02-15T22:41:25.860 INFO:tasks.workunit.client.1.smithi082.stdout:0/978: getdents d3/d6b/dac/d155 0 2024-02-15T22:41:25.864 INFO:tasks.workunit.client.1.smithi082.stdout:1/954: symlink d1/dc8/d124/d14/d18/d6d/d89/d11c/l13e 0 2024-02-15T22:41:25.869 INFO:tasks.workunit.client.1.smithi082.stdout:2/930: creat d6/dc/dd/d24/d71/dcb/dfc/f11c x:0 0 0 2024-02-15T22:41:25.870 INFO:tasks.workunit.client.1.smithi082.stdout:9/977: dread d8/d24/d2e/f46 [0,4194304] 0 2024-02-15T22:41:25.871 INFO:tasks.workunit.client.1.smithi082.stdout:7/989: getdents d12/d3b/df9 0 2024-02-15T22:41:25.873 INFO:tasks.workunit.client.1.smithi082.stdout:8/957: dwrite d1/d7/d9/d42/fd5 [0,4194304] 0 2024-02-15T22:41:25.873 INFO:tasks.workunit.client.1.smithi082.stdout:8/958: creat d1/d7/d9/d42/f147 x:0 0 0 2024-02-15T22:41:25.873 INFO:tasks.workunit.client.1.smithi082.stdout:8/959: stat d1/d7/d9/d42/d6a/da5/dd4/ff7 0 2024-02-15T22:41:25.874 INFO:tasks.workunit.client.1.smithi082.stdout:3/959: creat d0/d16/d3e/f13d x:0 0 0 2024-02-15T22:41:25.875 INFO:tasks.workunit.client.1.smithi082.stdout:0/979: dwrite d3/d19/d20/d7c/dd5/deb/d92/f114 [0,4194304] 0 2024-02-15T22:41:25.877 INFO:tasks.workunit.client.1.smithi082.stdout:6/999: mknod d2/d30/d3b/d10e/c150 0 2024-02-15T22:41:25.880 INFO:tasks.workunit.client.1.smithi082.stdout:2/931: unlink d6/d18/l33 0 2024-02-15T22:41:25.880 INFO:tasks.workunit.client.1.smithi082.stdout:2/932: write d6/dc/d12/d23/d6e/f95 [1135085,101798] 0 2024-02-15T22:41:25.880 INFO:tasks.workunit.client.1.smithi082.stdout:2/933: truncate d6/dc/dd/f8a 5139056 0 2024-02-15T22:41:25.884 INFO:tasks.workunit.client.1.smithi082.stdout:8/960: symlink d1/d40/dbb/dff/d85/l148 0 2024-02-15T22:41:25.884 INFO:tasks.workunit.client.1.smithi082.stdout:8/961: truncate d1/d40/dbb/dff/da6/db6/dca/f145 327896 0 2024-02-15T22:41:25.892 INFO:tasks.workunit.client.1.smithi082.stdout:8/962: mknod d1/d7/d9/d42/d6a/da5/dd4/dd8/df5/c149 0 2024-02-15T22:41:25.892 INFO:tasks.workunit.client.1.smithi082.stdout:8/963: truncate d1/d7/de/fb7 423252 0 2024-02-15T22:41:25.892 INFO:tasks.workunit.client.1.smithi082.stdout:3/960: getdents d0/dc/d3f/d115 0 2024-02-15T22:41:25.896 INFO:tasks.workunit.client.1.smithi082.stdout:3/961: creat d0/d16/d3e/d10b/f13e x:0 0 0 2024-02-15T22:41:25.899 INFO:tasks.workunit.client.1.smithi082.stdout:3/962: symlink d0/d16/d62/d14/d21/dee/l13f 0 2024-02-15T22:41:25.901 INFO:tasks.workunit.client.1.smithi082.stdout:3/963: read d0/f46 [75517,15043] 0 2024-02-15T22:41:25.904 INFO:tasks.workunit.client.1.smithi082.stdout:3/964: rmdir d0/d16/d62/d14/d21/d7d 39 2024-02-15T22:41:25.905 INFO:tasks.workunit.client.1.smithi082.stdout:0/980: dwrite d3/d19/d25/d80/fc5 [0,4194304] 0 2024-02-15T22:41:25.905 INFO:tasks.workunit.client.1.smithi082.stdout:9/978: dwrite d8/d12/d33/f39 [4194304,4194304] 0 2024-02-15T22:41:25.905 INFO:tasks.workunit.client.1.smithi082.stdout:2/934: dwrite d6/dc/d58/d49/d5e/f60 [0,4194304] 0 2024-02-15T22:41:25.905 INFO:tasks.workunit.client.1.smithi082.stdout:2/935: write d6/dc/dd/d24/fc0 [2560897,41400] 0 2024-02-15T22:41:25.911 INFO:tasks.workunit.client.1.smithi082.stdout:3/965: write d0/d16/d62/f50 [1615421,99271] 0 2024-02-15T22:41:25.913 INFO:tasks.workunit.client.1.smithi082.stdout:9/979: symlink d8/db5/d114/da1/dc1/l13b 0 2024-02-15T22:41:25.922 INFO:tasks.workunit.client.1.smithi082.stdout:2/936: symlink d6/dc/dd/d24/d72/d115/l11d 0 2024-02-15T22:41:25.922 INFO:tasks.workunit.client.1.smithi082.stdout:2/937: chown d6/dc/d58/d49/f56 9066 1 2024-02-15T22:41:25.934 INFO:tasks.workunit.client.1.smithi082.stdout:3/966: getdents d0/d16/d62/d14 0 2024-02-15T22:41:25.936 INFO:tasks.workunit.client.1.smithi082.stdout:2/938: dwrite d6/dc/dd/d1d/f77 [0,4194304] 0 2024-02-15T22:41:25.937 INFO:tasks.workunit.client.1.smithi082.stdout:8/964: rename d1/d40/dbb/dff/d85 to d1/d7/d48/d6f/d14a 0 2024-02-15T22:41:25.944 INFO:tasks.workunit.client.1.smithi082.stdout:0/981: rename d3/d19/d25/d80/dd3/f127 to d3/d19/d1c/f15f 0 2024-02-15T22:41:25.949 INFO:tasks.workunit.client.1.smithi082.stdout:9/980: rename d8/d12/d33/f63 to d8/d12d/f13c 0 2024-02-15T22:41:25.954 INFO:tasks.workunit.client.1.smithi082.stdout:0/982: dread d3/d19/d20/d7c/dd5/deb/da5/d151/f157 [0,4194304] 0 2024-02-15T22:41:25.956 INFO:tasks.workunit.client.1.smithi082.stdout:9/981: creat d8/db5/d114/da1/dc1/f13d x:0 0 0 2024-02-15T22:41:25.956 INFO:tasks.workunit.client.1.smithi082.stdout:9/982: chown d8/d24/d87/de0/d8b/d96 1 1 2024-02-15T22:41:25.956 INFO:tasks.workunit.client.1.smithi082.stdout:9/983: fsync d8/f2b 0 2024-02-15T22:41:25.956 INFO:tasks.workunit.client.1.smithi082.stdout:9/984: write d8/d24/d87/dcb/de5/f12f [8464797,129628] 0 2024-02-15T22:41:25.959 INFO:tasks.workunit.client.1.smithi082.stdout:9/985: link d8/d24/d2e/f11e d8/d24/f13e 0 2024-02-15T22:41:25.959 INFO:tasks.workunit.client.1.smithi082.stdout:9/986: creat d8/d24/d87/dcb/f13f x:0 0 0 2024-02-15T22:41:25.966 INFO:tasks.workunit.client.1.smithi082.stdout:8/965: dwrite d1/d40/dbb/dff/fb5 [0,4194304] 0 2024-02-15T22:41:25.966 INFO:tasks.workunit.client.1.smithi082.stdout:8/966: chown d1/d40/dbb/dff/caa 195 1 2024-02-15T22:41:25.966 INFO:tasks.workunit.client.1.smithi082.stdout:8/967: truncate d1/d7/d48/d6f/d14a/f126 341706 0 2024-02-15T22:41:25.968 INFO:tasks.workunit.client.1.smithi082.stdout:2/939: dwrite d6/dc/d12/d23/fc8 [0,4194304] 0 2024-02-15T22:41:25.968 INFO:tasks.workunit.client.1.smithi082.stdout:2/940: readlink d6/d18/l79 0 2024-02-15T22:41:25.969 INFO:tasks.workunit.client.1.smithi082.stdout:3/967: dwrite d0/d16/d62/fe [4194304,4194304] 0 2024-02-15T22:41:25.969 INFO:tasks.workunit.client.1.smithi082.stdout:3/968: stat d0/d16/d62 0 2024-02-15T22:41:25.972 INFO:tasks.workunit.client.1.smithi082.stdout:2/941: symlink d6/dc/d58/l11e 0 2024-02-15T22:41:25.972 INFO:tasks.workunit.client.1.smithi082.stdout:2/942: stat d6/dc/d58/d49/f56 0 2024-02-15T22:41:25.974 INFO:tasks.workunit.client.1.smithi082.stdout:0/983: dwrite d3/d19/d20/d7c/dd5/deb/fad [0,4194304] 0 2024-02-15T22:41:25.975 INFO:tasks.workunit.client.1.smithi082.stdout:0/984: stat d3/d19/d1c/d76/lcb 0 2024-02-15T22:41:25.975 INFO:tasks.workunit.client.1.smithi082.stdout:0/985: chown d3/d19/d1c/f52 16559 1 2024-02-15T22:41:25.993 INFO:tasks.workunit.client.1.smithi082.stdout:9/987: dwrite d8/d24/d2e/f46 [4194304,4194304] 0 2024-02-15T22:41:25.995 INFO:tasks.workunit.client.1.smithi082.stdout:3/969: dwrite d0/d16/d62/d14/d21/d7d/fd6 [0,4194304] 0 2024-02-15T22:41:25.997 INFO:tasks.workunit.client.1.smithi082.stdout:8/968: dwrite d1/d7/de/fb7 [0,4194304] 0 2024-02-15T22:41:25.997 INFO:tasks.workunit.client.1.smithi082.stdout:8/969: truncate d1/d7/d9/d24/fe1 654129 0 2024-02-15T22:41:26.003 INFO:tasks.workunit.client.1.smithi082.stdout:2/943: mknod d6/dc/d12/d46/d76/dae/de8/d104/c11f 0 2024-02-15T22:41:26.003 INFO:tasks.workunit.client.1.smithi082.stdout:2/944: dread - d6/fd1 zero size 2024-02-15T22:41:26.003 INFO:tasks.workunit.client.1.smithi082.stdout:2/945: chown d6/dc/d58/d49 7404685 1 2024-02-15T22:41:26.007 INFO:tasks.workunit.client.1.smithi082.stdout:0/986: link d3/d19/d93/dbe/fdd d3/d19/d20/d7c/dd5/deb/f160 0 2024-02-15T22:41:26.012 INFO:tasks.workunit.client.1.smithi082.stdout:9/988: mkdir d8/d140 0 2024-02-15T22:41:26.018 INFO:tasks.workunit.client.1.smithi082.stdout:3/970: creat d0/d16/d3e/d56/db0/de1/d106/f140 x:0 0 0 2024-02-15T22:41:26.018 INFO:tasks.workunit.client.1.smithi082.stdout:3/971: write d0/d16/d62/d14/d21/d69/d91/fa1 [959314,110043] 0 2024-02-15T22:41:26.022 INFO:tasks.workunit.client.1.smithi082.stdout:7/990: sync 2024-02-15T22:41:26.022 INFO:tasks.workunit.client.1.smithi082.stdout:1/955: sync 2024-02-15T22:41:26.022 INFO:tasks.workunit.client.1.smithi082.stdout:7/991: chown d12/d17/d42/d67/d81/d91/dbc 14069045 1 2024-02-15T22:41:26.022 INFO:tasks.workunit.client.1.smithi082.stdout:7/992: chown d12/d27/d6e/f133 597 1 2024-02-15T22:41:26.023 INFO:tasks.workunit.client.1.smithi082.stdout:7/993: creat d12/d17/d42/d67/d81/d91/f14c x:0 0 0 2024-02-15T22:41:26.023 INFO:tasks.workunit.client.1.smithi082.stdout:7/994: read - d12/d17/d42/d67/d81/d91/f14c zero size 2024-02-15T22:41:26.023 INFO:tasks.workunit.client.1.smithi082.stdout:7/995: dread - d12/d27/d6e/d6a/d9e/dbe/fec zero size 2024-02-15T22:41:26.023 INFO:tasks.workunit.client.1.smithi082.stdout:7/996: chown d12/d27/d6e/d6a/db2/dbb/dc6 11223547 1 2024-02-15T22:41:26.028 INFO:tasks.workunit.client.1.smithi082.stdout:2/946: symlink d6/dc/dd/d24/d72/l120 0 2024-02-15T22:41:26.028 INFO:tasks.workunit.client.1.smithi082.stdout:2/947: fsync d6/dc/d58/d49/d5e/f102 0 2024-02-15T22:41:26.029 INFO:tasks.workunit.client.1.smithi082.stdout:7/997: write d12/d27/f2c [2823604,73797] 0 2024-02-15T22:41:26.030 INFO:tasks.workunit.client.1.smithi082.stdout:0/987: mkdir d3/d19/d93/d107/d161 0 2024-02-15T22:41:26.031 INFO:tasks.workunit.client.1.smithi082.stdout:0/988: readlink d3/d6b/la8 0 2024-02-15T22:41:26.034 INFO:tasks.workunit.client.1.smithi082.stdout:9/989: creat d8/d12d/f141 x:0 0 0 2024-02-15T22:41:26.034 INFO:tasks.workunit.client.1.smithi082.stdout:9/990: write d8/db5/fd0 [651910,62730] 0 2024-02-15T22:41:26.036 INFO:tasks.workunit.client.1.smithi082.stdout:1/956: mknod d1/dc8/d124/d11/d93/db6/dc5/c13f 0 2024-02-15T22:41:26.039 INFO:tasks.workunit.client.1.smithi082.stdout:0/989: write d3/d19/d20/d7c/dd5/f132 [1587425,27895] 0 2024-02-15T22:41:26.043 INFO:tasks.workunit.client.1.smithi082.stdout:0/990: write d3/d19/d20/d7c/dd5/deb/da5/d151/f157 [3582648,46847] 0 2024-02-15T22:41:26.044 INFO:tasks.workunit.client.1.smithi082.stdout:0/991: fdatasync d3/d19/d93/dbe/fdd 0 2024-02-15T22:41:26.044 INFO:tasks.workunit.client.1.smithi082.stdout:9/991: dread d8/db5/fcf [0,4194304] 0 2024-02-15T22:41:26.044 INFO:tasks.workunit.client.1.smithi082.stdout:9/992: fsync d8/d12/d67/fd9 0 2024-02-15T22:41:26.046 INFO:tasks.workunit.client.1.smithi082.stdout:1/957: dread d1/dc8/d124/d14/d18/d1f/d2f/f95 [0,4194304] 0 2024-02-15T22:41:26.049 INFO:tasks.workunit.client.1.smithi082.stdout:8/970: getdents d1 0 2024-02-15T22:41:26.049 INFO:tasks.workunit.client.1.smithi082.stdout:8/971: creat d1/d7/d9/d42/f14b x:0 0 0 2024-02-15T22:41:26.049 INFO:tasks.workunit.client.1.smithi082.stdout:8/972: write d1/d40/dbb/dce/dfc/f137 [154367,64820] 0 2024-02-15T22:41:26.055 INFO:tasks.workunit.client.1.smithi082.stdout:0/992: dread d3/d19/d20/fd7 [0,4194304] 0 2024-02-15T22:41:26.055 INFO:tasks.workunit.client.1.smithi082.stdout:0/993: creat d3/d19/d20/d26/f162 x:0 0 0 2024-02-15T22:41:26.055 INFO:tasks.workunit.client.1.smithi082.stdout:0/994: chown d3/d19/d20/d7c/dd5/deb/da5/d99/db1/dd2/l85 26774 1 2024-02-15T22:41:26.055 INFO:tasks.workunit.client.1.smithi082.stdout:7/998: mkdir d12/d37/d85/dcc/d14d 0 2024-02-15T22:41:26.061 INFO:tasks.workunit.client.1.smithi082.stdout:9/993: mkdir d8/d12/dc5/d142 0 2024-02-15T22:41:26.063 INFO:tasks.workunit.client.1.smithi082.stdout:8/973: dwrite d1/d7/de/ffb [0,4194304] 0 2024-02-15T22:41:26.065 INFO:tasks.workunit.client.1.smithi082.stdout:1/958: rename d1/dc8/d124/d11/d93/db6/dc5/f10d to d1/d57/f140 0 2024-02-15T22:41:26.066 INFO:tasks.workunit.client.1.smithi082.stdout:1/959: dread d1/fc6 [0,4194304] 0 2024-02-15T22:41:26.066 INFO:tasks.workunit.client.1.smithi082.stdout:1/960: write d1/dc8/d124/d14/f2d [3080626,53339] 0 2024-02-15T22:41:26.066 INFO:tasks.workunit.client.1.smithi082.stdout:2/948: getdents d6/dc/dd/d24/d71/dcb/dfc 0 2024-02-15T22:41:26.069 INFO:tasks.workunit.client.1.smithi082.stdout:0/995: mkdir d3/d19/d25/de7/d163 0 2024-02-15T22:41:26.069 INFO:tasks.workunit.client.1.smithi082.stdout:0/996: readlink d3/d19/d20/d7c/dd5/deb/da0/l156 0 2024-02-15T22:41:26.071 INFO:tasks.workunit.client.1.smithi082.stdout:8/974: dread d1/d7/d9/d42/d6a/da5/dd4/dd8/fe8 [0,4194304] 0 2024-02-15T22:41:26.071 INFO:tasks.workunit.client.1.smithi082.stdout:8/975: fdatasync d1/d40/dbb/dcf/f10e 0 2024-02-15T22:41:26.071 INFO:tasks.workunit.client.1.smithi082.stdout:8/976: creat d1/d7/d9/d24/f14c x:0 0 0 2024-02-15T22:41:26.071 INFO:tasks.workunit.client.1.smithi082.stdout:8/977: getdents d1/d7/d9/d24/d30/d75/d107/d135 0 2024-02-15T22:41:26.072 INFO:tasks.workunit.client.1.smithi082.stdout:7/999: unlink d12/d27/d6e/d6a/d9e/l125 0 2024-02-15T22:41:26.075 INFO:tasks.workunit.client.1.smithi082.stdout:9/994: truncate d8/d24/d87/de0/d77/dab/fb1 74327 0 2024-02-15T22:41:26.081 INFO:tasks.workunit.client.1.smithi082.stdout:1/961: rename d1/d57/c62 to d1/dc8/d124/d11/c141 0 2024-02-15T22:41:26.083 INFO:tasks.workunit.client.1.smithi082.stdout:2/949: dwrite d6/d18/f22 [0,4194304] 0 2024-02-15T22:41:26.083 INFO:tasks.workunit.client.1.smithi082.stdout:8/978: dread d1/d40/dbb/dcf/ff0 [0,4194304] 0 2024-02-15T22:41:26.083 INFO:tasks.workunit.client.1.smithi082.stdout:8/979: creat d1/d7/d9/d24/f14d x:0 0 0 2024-02-15T22:41:26.088 INFO:tasks.workunit.client.1.smithi082.stdout:9/995: symlink d8/d12/d30/d3c/d65/l143 0 2024-02-15T22:41:26.092 INFO:tasks.workunit.client.1.smithi082.stdout:0/997: rename d3/d19/d25/l3a to d3/d19/d20/d7c/dd5/deb/d92/d131/l164 0 2024-02-15T22:41:26.093 INFO:tasks.workunit.client.1.smithi082.stdout:2/950: dread d6/d18/f22 [0,4194304] 0 2024-02-15T22:41:26.096 INFO:tasks.workunit.client.1.smithi082.stdout:1/962: unlink d1/dc8/d124/d14/f8b 0 2024-02-15T22:41:26.102 INFO:tasks.workunit.client.1.smithi082.stdout:0/998: mkdir d3/d19/d11d/d124/d165 0 2024-02-15T22:41:26.114 INFO:tasks.workunit.client.1.smithi082.stdout:2/951: rmdir d6/dc/dd/d24/d71 39 2024-02-15T22:41:26.114 INFO:tasks.workunit.client.1.smithi082.stdout:2/952: stat d6/dc/d58/d49/f56 0 2024-02-15T22:41:26.114 INFO:tasks.workunit.client.1.smithi082.stdout:2/953: chown d6/dc/d58/d49/d5e/d67/fea 63297574 1 2024-02-15T22:41:26.117 INFO:tasks.workunit.client.1.smithi082.stdout:8/980: unlink d1/d7/d9/fa4 0 2024-02-15T22:41:26.124 INFO:tasks.workunit.client.1.smithi082.stdout:1/963: creat d1/dc8/d124/d11/d8c/db3/f142 x:0 0 0 2024-02-15T22:41:26.124 INFO:tasks.workunit.client.1.smithi082.stdout:1/964: creat d1/dc8/d124/d14/d18/d1f/d76/da7/d110/f143 x:0 0 0 2024-02-15T22:41:26.124 INFO:tasks.workunit.client.1.smithi082.stdout:1/965: fsync d1/dc8/d124/d11/d93/f111 0 2024-02-15T22:41:26.125 INFO:tasks.workunit.client.1.smithi082.stdout:1/966: fsync d1/dc8/d124/d11/d3f/fd0 0 2024-02-15T22:41:26.127 INFO:tasks.workunit.client.1.smithi082.stdout:9/996: getdents d8/d12/d33/da4/dac 0 2024-02-15T22:41:26.127 INFO:tasks.workunit.client.1.smithi082.stdout:0/999: truncate d3/d19/d20/d7c/dd5/deb/da5/d99/db1/f106 104984 0 2024-02-15T22:41:26.130 INFO:tasks.workunit.client.1.smithi082.stdout:2/954: creat d6/dc/dd/f121 x:0 0 0 2024-02-15T22:41:26.130 INFO:tasks.workunit.client.1.smithi082.stdout:3/972: sync 2024-02-15T22:41:26.134 INFO:tasks.workunit.client.1.smithi082.stdout:8/981: truncate d1/d7/d78/fcb 686619 0 2024-02-15T22:41:26.138 INFO:tasks.workunit.client.1.smithi082.stdout:1/967: mknod d1/dc8/d124/d14/c144 0 2024-02-15T22:41:26.139 INFO:tasks.workunit.client.1.smithi082.stdout:9/997: mkdir d8/d12/d30/d3c/d65/d144 0 2024-02-15T22:41:26.139 INFO:tasks.workunit.client.1.smithi082.stdout:9/998: fsync d8/d12/d30/f51 0 2024-02-15T22:41:26.139 INFO:tasks.workunit.client.1.smithi082.stdout:9/999: readlink d8/l15 0 2024-02-15T22:41:26.143 INFO:tasks.workunit.client.1.smithi082.stdout:2/955: creat d6/d18/f122 x:0 0 0 2024-02-15T22:41:26.146 INFO:tasks.workunit.client.1.smithi082.stdout:1/968: creat d1/dc8/d124/d14/d18/d1f/d7a/dd1/d13a/f145 x:0 0 0 2024-02-15T22:41:26.148 INFO:tasks.workunit.client.1.smithi082.stdout:2/956: mkdir d6/dc/dd/d123 0 2024-02-15T22:41:26.149 INFO:tasks.workunit.client.1.smithi082.stdout:8/982: mknod d1/d7/d9/c14e 0 2024-02-15T22:41:26.151 INFO:tasks.workunit.client.1.smithi082.stdout:2/957: symlink d6/l124 0 2024-02-15T22:41:26.153 INFO:tasks.workunit.client.1.smithi082.stdout:8/983: truncate d1/d7/d9/d42/d6a/da5/ddd/ff8 497969 0 2024-02-15T22:41:26.153 INFO:tasks.workunit.client.1.smithi082.stdout:3/973: dwrite d0/dc/fbd [0,4194304] 0 2024-02-15T22:41:26.154 INFO:tasks.workunit.client.1.smithi082.stdout:1/969: mknod d1/c146 0 2024-02-15T22:41:26.156 INFO:tasks.workunit.client.1.smithi082.stdout:2/958: creat d6/dc/d12/f125 x:0 0 0 2024-02-15T22:41:26.158 INFO:tasks.workunit.client.1.smithi082.stdout:8/984: mkdir d1/d7/d9/d42/d6a/da5/dd4/dd8/d14f 0 2024-02-15T22:41:26.158 INFO:tasks.workunit.client.1.smithi082.stdout:8/985: chown d1/d40/cba 32132794 1 2024-02-15T22:41:26.165 INFO:tasks.workunit.client.1.smithi082.stdout:2/959: creat d6/dc/dd/d24/d71/ded/f126 x:0 0 0 2024-02-15T22:41:26.168 INFO:tasks.workunit.client.1.smithi082.stdout:8/986: rename d1/d40/dbb/l12d to d1/d7/d9/d42/d6a/da5/l150 0 2024-02-15T22:41:26.168 INFO:tasks.workunit.client.1.smithi082.stdout:3/974: rmdir d0/d16/d62/d14/d21/d69/d6c 39 2024-02-15T22:41:26.173 INFO:tasks.workunit.client.1.smithi082.stdout:2/960: unlink d6/d3c/d8c/fd3 0 2024-02-15T22:41:26.173 INFO:tasks.workunit.client.1.smithi082.stdout:2/961: chown d6/dc/d58/d49/l5f 196654 1 2024-02-15T22:41:26.173 INFO:tasks.workunit.client.1.smithi082.stdout:2/962: fdatasync d6/dc/d12/d46/f7c 0 2024-02-15T22:41:26.174 INFO:tasks.workunit.client.1.smithi082.stdout:1/970: rmdir d1/dc8/d124/d14/d18/d1f 39 2024-02-15T22:41:26.178 INFO:tasks.workunit.client.1.smithi082.stdout:8/987: creat d1/d40/dbb/dff/f151 x:0 0 0 2024-02-15T22:41:26.181 INFO:tasks.workunit.client.1.smithi082.stdout:2/963: symlink d6/dc/dd/l127 0 2024-02-15T22:41:26.181 INFO:tasks.workunit.client.1.smithi082.stdout:2/964: chown d6/dc/dd/l112 877905 1 2024-02-15T22:41:26.184 INFO:tasks.workunit.client.1.smithi082.stdout:1/971: rename d1/dc8/d124/d11/d93/f135 to d1/dc8/d124/d14/d18/d1f/d7a/de5/f147 0 2024-02-15T22:41:26.186 INFO:tasks.workunit.client.1.smithi082.stdout:8/988: symlink d1/d7/d9/d42/d6a/da5/l152 0 2024-02-15T22:41:26.189 INFO:tasks.workunit.client.1.smithi082.stdout:2/965: symlink d6/dc/d58/d49/d5e/d67/df6/l128 0 2024-02-15T22:41:26.191 INFO:tasks.workunit.client.1.smithi082.stdout:1/972: mknod d1/dc8/d124/d14/d18/d1f/d76/da7/d110/c148 0 2024-02-15T22:41:26.196 INFO:tasks.workunit.client.1.smithi082.stdout:2/966: write d6/dc/d58/f61 [542687,40956] 0 2024-02-15T22:41:26.199 INFO:tasks.workunit.client.1.smithi082.stdout:2/967: mkdir d6/dc/dd/d24/d71/dcb/dfc/d129 0 2024-02-15T22:41:26.200 INFO:tasks.workunit.client.1.smithi082.stdout:8/989: dwrite d1/d7/d78/fd0 [8388608,4194304] 0 2024-02-15T22:41:26.200 INFO:tasks.workunit.client.1.smithi082.stdout:1/973: read d1/dc8/d124/d11/d3f/d75/f78 [1768335,35278] 0 2024-02-15T22:41:26.203 INFO:tasks.workunit.client.1.smithi082.stdout:8/990: creat d1/d7/f153 x:0 0 0 2024-02-15T22:41:26.210 INFO:tasks.workunit.client.1.smithi082.stdout:1/974: read d1/dc8/d124/d11/fb1 [1772492,105589] 0 2024-02-15T22:41:26.212 INFO:tasks.workunit.client.1.smithi082.stdout:1/975: symlink d1/dc8/d124/d11/d8c/db3/l149 0 2024-02-15T22:41:26.214 INFO:tasks.workunit.client.1.smithi082.stdout:2/968: dwrite d6/dc/d12/d46/d4b/d63/f9e [0,4194304] 0 2024-02-15T22:41:26.218 INFO:tasks.workunit.client.1.smithi082.stdout:8/991: write d1/d7/d48/ffe [2985765,35243] 0 2024-02-15T22:41:26.220 INFO:tasks.workunit.client.1.smithi082.stdout:2/969: unlink d6/dc/l68 0 2024-02-15T22:41:26.220 INFO:tasks.workunit.client.1.smithi082.stdout:2/970: write d6/dc/d12/d23/d6e/f95 [2071277,129590] 0 2024-02-15T22:41:26.220 INFO:tasks.workunit.client.1.smithi082.stdout:2/971: readlink d6/d3c/lac 0 2024-02-15T22:41:26.231 INFO:tasks.workunit.client.1.smithi082.stdout:2/972: write d6/dc/d58/d49/db6/fb3 [267752,73625] 0 2024-02-15T22:41:26.231 INFO:tasks.workunit.client.1.smithi082.stdout:2/973: read d6/d3c/d8c/fb5 [115999,70798] 0 2024-02-15T22:41:26.231 INFO:tasks.workunit.client.1.smithi082.stdout:2/974: write d6/dc/dd/d21/f36 [2315312,110183] 0 2024-02-15T22:41:26.234 INFO:tasks.workunit.client.1.smithi082.stdout:1/976: dwrite d1/dc8/d124/d14/d18/d1f/d76/da7/f13c [0,4194304] 0 2024-02-15T22:41:26.234 INFO:tasks.workunit.client.1.smithi082.stdout:8/992: truncate d1/d7/d78/fd0 3389458 0 2024-02-15T22:41:26.238 INFO:tasks.workunit.client.1.smithi082.stdout:2/975: mknod d6/dc/dd/d1d/c12a 0 2024-02-15T22:41:26.242 INFO:tasks.workunit.client.1.smithi082.stdout:8/993: dread d1/d40/dbb/fc6 [0,4194304] 0 2024-02-15T22:41:26.242 INFO:tasks.workunit.client.1.smithi082.stdout:8/994: fsync d1/d7/d9/d42/f14b 0 2024-02-15T22:41:26.244 INFO:tasks.workunit.client.1.smithi082.stdout:1/977: mkdir d1/d57/d14a 0 2024-02-15T22:41:26.246 INFO:tasks.workunit.client.1.smithi082.stdout:3/975: sync 2024-02-15T22:41:26.247 INFO:tasks.workunit.client.1.smithi082.stdout:8/995: mkdir d1/d40/dbb/dce/d154 0 2024-02-15T22:41:26.249 INFO:tasks.workunit.client.1.smithi082.stdout:8/996: dread d1/d40/dbb/dce/dfc/f137 [0,4194304] 0 2024-02-15T22:41:26.250 INFO:tasks.workunit.client.1.smithi082.stdout:3/976: symlink d0/d16/d62/d14/d71/l141 0 2024-02-15T22:41:26.250 INFO:tasks.workunit.client.1.smithi082.stdout:3/977: chown d0/d16/d62/d14/d71/fff 392209 1 2024-02-15T22:41:26.251 INFO:tasks.workunit.client.1.smithi082.stdout:8/997: creat d1/d7/de/d1e/f155 x:0 0 0 2024-02-15T22:41:26.253 INFO:tasks.workunit.client.1.smithi082.stdout:3/978: unlink d0/fa9 0 2024-02-15T22:41:26.253 INFO:tasks.workunit.client.1.smithi082.stdout:3/979: stat d0/d16/d62/f90 0 2024-02-15T22:41:26.253 INFO:tasks.workunit.client.1.smithi082.stdout:3/980: truncate d0/d16/d62/d79/fab 1032360 0 2024-02-15T22:41:26.253 INFO:tasks.workunit.client.1.smithi082.stdout:3/981: creat d0/d16/d3e/f142 x:0 0 0 2024-02-15T22:41:26.253 INFO:tasks.workunit.client.1.smithi082.stdout:1/978: dread d1/f39 [0,4194304] 0 2024-02-15T22:41:26.255 INFO:tasks.workunit.client.1.smithi082.stdout:2/976: dwrite d6/dc/dd/d21/f5a [0,4194304] 0 2024-02-15T22:41:26.257 INFO:tasks.workunit.client.1.smithi082.stdout:8/998: rename d1/d7/d9/d42/d6a/da5/lbd to d1/d40/dbb/dff/da6/db8/l156 0 2024-02-15T22:41:26.257 INFO:tasks.workunit.client.1.smithi082.stdout:8/999: chown d1/d7/d9/d50/d56/f9e 1942150579 1 2024-02-15T22:41:26.262 INFO:tasks.workunit.client.1.smithi082.stdout:1/979: symlink d1/dc8/d124/d14/d18/d1f/d7a/de5/l14b 0 2024-02-15T22:41:26.262 INFO:tasks.workunit.client.1.smithi082.stdout:1/980: fsync d1/dc8/d124/d14/d18/d1f/f50 0 2024-02-15T22:41:26.262 INFO:tasks.workunit.client.1.smithi082.stdout:1/981: dread - d1/dc8/d124/d14/d18/d6d/dc9/ff1 zero size 2024-02-15T22:41:26.262 INFO:tasks.workunit.client.1.smithi082.stdout:1/982: chown d1/dc8/d124/d11/d3f/d75/lee 7105 1 2024-02-15T22:41:26.264 INFO:tasks.workunit.client.1.smithi082.stdout:2/977: symlink d6/dc/dd/d24/d72/l12b 0 2024-02-15T22:41:26.275 INFO:tasks.workunit.client.1.smithi082.stdout:1/983: getdents d1/dc8/d124/d11/d93/db6/dc5 0 2024-02-15T22:41:26.278 INFO:tasks.workunit.client.1.smithi082.stdout:1/984: mknod d1/dc8/d124/d14/d18/d6d/d12e/c14c 0 2024-02-15T22:41:26.284 INFO:tasks.workunit.client.1.smithi082.stdout:1/985: rmdir d1/dc8/d124/d11/d93/db6 39 2024-02-15T22:41:26.284 INFO:tasks.workunit.client.1.smithi082.stdout:1/986: stat d1/dc8/d124/d14/d18/d1f/d7a/f128 0 2024-02-15T22:41:26.284 INFO:tasks.workunit.client.1.smithi082.stdout:2/978: dwrite d6/dc/dd/d24/f54 [0,4194304] 0 2024-02-15T22:41:26.297 INFO:tasks.workunit.client.1.smithi082.stdout:1/987: dwrite d1/dc8/d124/d14/d18/d1f/d76/da7/fe4 [0,4194304] 0 2024-02-15T22:41:26.297 INFO:tasks.workunit.client.1.smithi082.stdout:1/988: write d1/d57/f5f [675340,56977] 0 2024-02-15T22:41:26.319 INFO:tasks.workunit.client.1.smithi082.stdout:1/989: getdents d1/dc8/d124/d14/d18/d1f/d2f 0 2024-02-15T22:41:26.337 INFO:tasks.workunit.client.1.smithi082.stdout:1/990: creat d1/dc8/d124/d11/d93/db6/f14d x:0 0 0 2024-02-15T22:41:26.338 INFO:tasks.workunit.client.1.smithi082.stdout:1/991: chown d1/dc8/d124/d14/d18/d6d/lc1 49132 1 2024-02-15T22:41:26.352 INFO:tasks.workunit.client.1.smithi082.stdout:1/992: dwrite d1/dc8/d124/d11/f48 [0,4194304] 0 2024-02-15T22:41:26.364 INFO:tasks.workunit.client.1.smithi082.stdout:1/993: dread d1/dc8/d124/d14/d18/d6d/dc9/f137 [0,4194304] 0 2024-02-15T22:41:26.368 INFO:tasks.workunit.client.1.smithi082.stdout:1/994: truncate d1/dc8/d124/d14/d18/d1f/d7a/fa2 896994 0 2024-02-15T22:41:26.368 INFO:tasks.workunit.client.1.smithi082.stdout:1/995: write d1/dc8/d124/d14/d18/d1f/d7a/f8a [842453,116023] 0 2024-02-15T22:41:26.368 INFO:tasks.workunit.client.1.smithi082.stdout:1/996: chown d1/dc8/d124/d14/d18/d1f/d76/da7/d110/c148 0 1 2024-02-15T22:41:26.368 INFO:tasks.workunit.client.1.smithi082.stdout:1/997: readlink d1/dc8/d124/l45 0 2024-02-15T22:41:26.369 INFO:tasks.workunit.client.1.smithi082.stdout:1/998: dread - d1/dc8/d124/d14/d18/d6d/dc9/fd3 zero size 2024-02-15T22:41:26.371 INFO:tasks.workunit.client.1.smithi082.stdout:1/999: symlink d1/d57/d14a/l14e 0 2024-02-15T22:41:26.452 INFO:tasks.workunit.client.1.smithi082.stdout:2/979: rmdir d6/d18 39 2024-02-15T22:41:26.452 INFO:tasks.workunit.client.1.smithi082.stdout:2/980: dread - d6/dc/d58/d49/db6/f114 zero size 2024-02-15T22:41:26.455 INFO:tasks.workunit.client.1.smithi082.stdout:2/981: creat d6/dc/dd/d21/f12c x:0 0 0 2024-02-15T22:41:26.463 INFO:tasks.workunit.client.1.smithi082.stdout:3/982: sync 2024-02-15T22:41:26.463 INFO:tasks.workunit.client.1.smithi082.stdout:3/983: chown d0/d16/d62/d14/d21/d69/d6c/l112 59679 1 2024-02-15T22:41:26.463 INFO:tasks.workunit.client.1.smithi082.stdout:3/984: truncate d0/d16/d62/f45 244879 0 2024-02-15T22:41:26.465 INFO:tasks.workunit.client.1.smithi082.stdout:3/985: getdents d0/d16/d3e/d56/db0 0 2024-02-15T22:41:26.471 INFO:tasks.workunit.client.1.smithi082.stdout:2/982: dwrite d6/dc/fc7 [0,4194304] 0 2024-02-15T22:41:26.475 INFO:tasks.workunit.client.1.smithi082.stdout:2/983: link d6/dc/d12/d46/d4b/d63/f66 d6/dc/dd/d1d/f12d 0 2024-02-15T22:41:26.476 INFO:tasks.workunit.client.1.smithi082.stdout:2/984: creat d6/dc/d58/d49/d5e/d67/df6/f12e x:0 0 0 2024-02-15T22:41:26.479 INFO:tasks.workunit.client.1.smithi082.stdout:3/986: dwrite d0/d16/d62/d14/d71/da2/f7f [4194304,4194304] 0 2024-02-15T22:41:26.481 INFO:tasks.workunit.client.1.smithi082.stdout:3/987: mknod d0/d16/d62/d14/d21/d7d/c143 0 2024-02-15T22:41:26.484 INFO:tasks.workunit.client.1.smithi082.stdout:3/988: rename d0/dc/f5c to d0/dc/d3f/dc4/f144 0 2024-02-15T22:41:26.484 INFO:tasks.workunit.client.1.smithi082.stdout:3/989: write d0/f12b [583036,91862] 0 2024-02-15T22:41:26.485 INFO:tasks.workunit.client.1.smithi082.stdout:3/990: creat d0/d16/d62/f145 x:0 0 0 2024-02-15T22:41:26.487 INFO:tasks.workunit.client.1.smithi082.stdout:3/991: getdents d0/d16/d62/d14/d21/dee/d11a 0 2024-02-15T22:41:26.487 INFO:tasks.workunit.client.1.smithi082.stdout:3/992: chown d0/d16/d62/d14/d71/df4/c94 5373 1 2024-02-15T22:41:26.489 INFO:tasks.workunit.client.1.smithi082.stdout:3/993: creat d0/d16/d62/d14/d21/d69/de6/d10c/f146 x:0 0 0 2024-02-15T22:41:26.490 INFO:tasks.workunit.client.1.smithi082.stdout:3/994: mkdir d0/d16/d62/d79/d147 0 2024-02-15T22:41:26.491 INFO:tasks.workunit.client.1.smithi082.stdout:2/985: dwrite d6/dc/dd/d1d/f50 [0,4194304] 0 2024-02-15T22:41:26.492 INFO:tasks.workunit.client.1.smithi082.stdout:3/995: link d0/d16/d62/d14/d21/d69/de6/lf5 d0/d16/d62/d79/d147/l148 0 2024-02-15T22:41:26.495 INFO:tasks.workunit.client.1.smithi082.stdout:2/986: symlink d6/dc/dd/l12f 0 2024-02-15T22:41:26.495 INFO:tasks.workunit.client.1.smithi082.stdout:2/987: creat d6/dc/dd/f130 x:0 0 0 2024-02-15T22:41:26.498 INFO:tasks.workunit.client.1.smithi082.stdout:3/996: mknod d0/d16/d62/d14/d21/d11c/c149 0 2024-02-15T22:41:26.498 INFO:tasks.workunit.client.1.smithi082.stdout:3/997: write d0/dc/d3f/d115/f117 [602469,122037] 0 2024-02-15T22:41:26.498 INFO:tasks.workunit.client.1.smithi082.stdout:3/998: read - d0/d16/d3e/d56/db0/de1/f135 zero size 2024-02-15T22:41:26.504 INFO:tasks.workunit.client.1.smithi082.stdout:3/999: link d0/d16/d3e/d56/fb5 d0/d16/d3e/d10b/f14a 0 2024-02-15T22:41:26.506 INFO:tasks.workunit.client.1.smithi082.stdout:2/988: unlink d6/dc/dd/d24/f39 0 2024-02-15T22:41:26.506 INFO:tasks.workunit.client.1.smithi082.stdout:2/989: dread - d6/dc/dd/d24/d71/ded/f126 zero size 2024-02-15T22:41:26.510 INFO:tasks.workunit.client.1.smithi082.stdout:2/990: creat d6/dc/dd/d21/d9f/d10f/f131 x:0 0 0 2024-02-15T22:41:26.613 INFO:tasks.workunit.client.1.smithi082.stdout:2/991: sync 2024-02-15T22:41:26.613 INFO:tasks.workunit.client.1.smithi082.stdout:2/992: read d6/dc/d58/d49/f56 [112582,50682] 0 2024-02-15T22:41:26.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:26 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:26.627 INFO:tasks.workunit.client.1.smithi082.stdout:2/993: dwrite d6/dc/d12/f125 [0,4194304] 0 2024-02-15T22:41:26.630 INFO:tasks.workunit.client.1.smithi082.stdout:2/994: rename d6/dc/d12/d46/fa0 to d6/d18/f132 0 2024-02-15T22:41:26.632 INFO:tasks.workunit.client.1.smithi082.stdout:2/995: rename d6/dc/dd/d21/c3e to d6/dc/d58/d49/db6/c133 0 2024-02-15T22:41:26.633 INFO:tasks.workunit.client.1.smithi082.stdout:2/996: creat d6/dc/dd/d24/d71/dcb/f134 x:0 0 0 2024-02-15T22:41:26.633 INFO:tasks.workunit.client.1.smithi082.stdout:2/997: stat d6/dc/dd/d1d/f10c 0 2024-02-15T22:41:26.634 INFO:tasks.workunit.client.1.smithi082.stdout:2/998: mknod d6/dc/dd/d24/d71/ded/c135 0 2024-02-15T22:41:26.635 INFO:tasks.workunit.client.1.smithi082.stdout:2/999: rmdir d6/dc/dd/d24/d71/dcb/dfc 39 2024-02-15T22:41:26.641 INFO:tasks.workunit.client.1.smithi082.stderr:+ rm -rf -- ./tmp.xeOm4ZHvvm 2024-02-15T22:41:26.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:26 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:27.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1698675063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 msgr2=0x7f5d940fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1698675063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d940fd320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d90004940 tx=0x7f5d90009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1698675063 shutdown_connections 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1698675063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d940fe0e0 0x7f5d940fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1698675063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d940fd320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1698675063 >> 172.21.15.33:0/1698675063 conn(0x7f5d940f8620 msgr2=0x7f5d940faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1698675063 shutdown_connections 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.333+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1698675063 wait complete. 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d9b8bc700 1 Processor -- start 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d9b8bc700 1 -- start start 2024-02-15T22:41:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d9b8bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d9410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d9b8bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d940fe0e0 0x7f5d9410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d9b8bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9410e430 con 0x7f5d940fcef0 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d99658700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d9410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d99658700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d9410d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56914/0 (socket says 172.21.15.33:56914) 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d99658700 1 -- 172.21.15.33:0/1512491761 learned_addr learned my addr 172.21.15.33:0/1512491761 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9410ecd0 con 0x7f5d940fe0e0 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.334+0000 7f5d98e57700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d940fe0e0 0x7f5d9410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.335+0000 7f5d99658700 1 -- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d940fe0e0 msgr2=0x7f5d9410de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.335+0000 7f5d99658700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d940fe0e0 0x7f5d9410de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.335+0000 7f5d99658700 1 -- 172.21.15.33:0/1512491761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d90005040 con 0x7f5d940fcef0 2024-02-15T22:41:27.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.335+0000 7f5d99658700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d9410d8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5d90000c00 tx=0x7f5d90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:27.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.336+0000 7f5d89ffb700 1 -- 172.21.15.33:0/1512491761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9000e070 con 0x7f5d940fcef0 2024-02-15T22:41:27.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.336+0000 7f5d89ffb700 1 -- 172.21.15.33:0/1512491761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d9001c400 con 0x7f5d940fcef0 2024-02-15T22:41:27.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.336+0000 7f5d89ffb700 1 -- 172.21.15.33:0/1512491761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9000b650 con 0x7f5d940fcef0 2024-02-15T22:41:27.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.336+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9410ef50 con 0x7f5d940fcef0 2024-02-15T22:41:27.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.337+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9410f430 con 0x7f5d940fcef0 2024-02-15T22:41:27.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.338+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9404bed0 con 0x7f5d940fcef0 2024-02-15T22:41:27.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.338+0000 7f5d89ffb700 1 -- 172.21.15.33:0/1512491761 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f5d9001ca20 con 0x7f5d940fcef0 2024-02-15T22:41:27.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.339+0000 7f5d89ffb700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5d8006b3b0 0x7f5d8006d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:27.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.339+0000 7f5d89ffb700 1 -- 172.21.15.33:0/1512491761 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f5d9008b370 con 0x7f5d940fcef0 2024-02-15T22:41:27.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.339+0000 7f5d98e57700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5d8006b3b0 0x7f5d8006d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:27.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.340+0000 7f5d98e57700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5d8006b3b0 0x7f5d8006d860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009fd0 tx=0x7f5d8400b040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:27.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.344+0000 7f5d89ffb700 1 -- 172.21.15.33:0/1512491761 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5d90058fa0 con 0x7f5d940fcef0 2024-02-15T22:41:27.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:27 smithi082 ceph-mon[37153]: pgmap v26: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 354 op/s 2024-02-15T22:41:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.651+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d9410f8a0 con 0x7f5d8006b3b0 2024-02-15T22:41:27.652 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:27 smithi033 ceph-mon[29033]: pgmap v26: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 354 op/s 2024-02-15T22:41:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.652+0000 7f5d89ffb700 1 -- 172.21.15.33:0/1512491761 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f5d9410f8a0 con 0x7f5d8006b3b0 2024-02-15T22:41:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5d8006b3b0 msgr2=0x7f5d8006d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5d8006b3b0 0x7f5d8006d860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009fd0 tx=0x7f5d8400b040 comp rx=0 tx=0).stop 2024-02-15T22:41:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 msgr2=0x7f5d9410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d9410d8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5d90000c00 tx=0x7f5d90009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 shutdown_connections 2024-02-15T22:41:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5d8006b3b0 0x7f5d8006d860 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d940fcef0 0x7f5d9410d8f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 --2- 172.21.15.33:0/1512491761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d940fe0e0 0x7f5d9410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 >> 172.21.15.33:0/1512491761 conn(0x7f5d940f8620 msgr2=0x7f5d941013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 shutdown_connections 2024-02-15T22:41:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.655+0000 7f5d9b8bc700 1 -- 172.21.15.33:0/1512491761 wait complete. 2024-02-15T22:41:27.665 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:41:27.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 -- 172.21.15.33:0/1975119513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 msgr2=0x7f1fd00fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 --2- 172.21.15.33:0/1975119513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd00fc250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc004940 tx=0x7f1fcc009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 -- 172.21.15.33:0/1975119513 shutdown_connections 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 --2- 172.21.15.33:0/1975119513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd00fcfb0 0x7f1fd00fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 --2- 172.21.15.33:0/1975119513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd00fc250 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 -- 172.21.15.33:0/1975119513 >> 172.21.15.33:0/1975119513 conn(0x7f1fd00f74e0 msgr2=0x7f1fd00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 -- 172.21.15.33:0/1975119513 shutdown_connections 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 -- 172.21.15.33:0/1975119513 wait complete. 2024-02-15T22:41:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 Processor -- start 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 -- start start 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd0110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd00fcfb0 0x7f1fd0112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.774+0000 7f1fd816b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00664c0 con 0x7f1fd00fbe40 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd816b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0066600 con 0x7f1fd00fcfb0 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5f07700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd0110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5f07700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd0110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56918/0 (socket says 172.21.15.33:56918) 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5f07700 1 -- 172.21.15.33:0/3797846568 learned_addr learned my addr 172.21.15.33:0/3797846568 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5706700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd00fcfb0 0x7f1fd0112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5f07700 1 -- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd00fcfb0 msgr2=0x7f1fd0112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5f07700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd00fcfb0 0x7f1fd0112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5f07700 1 -- 172.21.15.33:0/3797846568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc005040 con 0x7f1fd00fbe40 2024-02-15T22:41:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd5f07700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd0110590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007d40 tx=0x7f1fcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fc67fc700 1 -- 172.21.15.33:0/3797846568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fcc021070 con 0x7f1fd00fbe40 2024-02-15T22:41:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fc67fc700 1 -- 172.21.15.33:0/3797846568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fcc01c400 con 0x7f1fd00fbe40 2024-02-15T22:41:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fc67fc700 1 -- 172.21.15.33:0/3797846568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fcc00e070 con 0x7f1fd00fbe40 2024-02-15T22:41:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.775+0000 7f1fd816b700 1 -- 172.21.15.33:0/3797846568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd01130e0 con 0x7f1fd00fbe40 2024-02-15T22:41:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.776+0000 7f1fd816b700 1 -- 172.21.15.33:0/3797846568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd0113500 con 0x7f1fd00fbe40 2024-02-15T22:41:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.777+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd004bed0 con 0x7f1fd00fbe40 2024-02-15T22:41:27.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.777+0000 7f1fc67fc700 1 -- 172.21.15.33:0/3797846568 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f1fcc01c9e0 con 0x7f1fd00fbe40 2024-02-15T22:41:27.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.778+0000 7f1fc67fc700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f1fbc06b2e0 0x7f1fbc06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:27.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.778+0000 7f1fc67fc700 1 -- 172.21.15.33:0/3797846568 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f1fcc08aec0 con 0x7f1fd00fbe40 2024-02-15T22:41:27.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.778+0000 7f1fd5706700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f1fbc06b2e0 0x7f1fbc06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:27.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.778+0000 7f1fd5706700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f1fbc06b2e0 0x7f1fbc06d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009b80 tx=0x7f1fc000b040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:27.787+0000 7f1fc67fc700 1 -- 172.21.15.33:0/3797846568 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1fcc054fc0 con 0x7f1fd00fbe40 2024-02-15T22:41:28.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.043+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fd0104930 con 0x7f1fbc06b2e0 2024-02-15T22:41:28.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.044+0000 7f1fc67fc700 1 -- 172.21.15.33:0/3797846568 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f1fd0104930 con 0x7f1fbc06b2e0 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f1fbc06b2e0 msgr2=0x7f1fbc06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f1fbc06b2e0 0x7f1fbc06d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009b80 tx=0x7f1fc000b040 comp rx=0 tx=0).stop 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 msgr2=0x7f1fd0110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd0110590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007d40 tx=0x7f1fcc009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 shutdown_connections 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f1fbc06b2e0 0x7f1fbc06d790 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fd00fbe40 0x7f1fd0110590 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 --2- 172.21.15.33:0/3797846568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd00fcfb0 0x7f1fd0112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 >> 172.21.15.33:0/3797846568 conn(0x7f1fd00f74e0 msgr2=0x7f1fd0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 shutdown_connections 2024-02-15T22:41:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.048+0000 7f1fbbfff700 1 -- 172.21.15.33:0/3797846568 wait complete. 2024-02-15T22:41:28.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 -- 172.21.15.33:0/2095797849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 msgr2=0x7fe3e40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 --2- 172.21.15.33:0/2095797849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e40fd420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc004940 tx=0x7fe3cc009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:28.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 -- 172.21.15.33:0/2095797849 shutdown_connections 2024-02-15T22:41:28.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 --2- 172.21.15.33:0/2095797849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e40fd420 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 --2- 172.21.15.33:0/2095797849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbe40 0x7fe3e40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 -- 172.21.15.33:0/2095797849 >> 172.21.15.33:0/2095797849 conn(0x7fe3e40f74e0 msgr2=0x7fe3e40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:28.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 -- 172.21.15.33:0/2095797849 shutdown_connections 2024-02-15T22:41:28.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.165+0000 7fe3e939d700 1 -- 172.21.15.33:0/2095797849 wait complete. 2024-02-15T22:41:28.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3e939d700 1 Processor -- start 2024-02-15T22:41:28.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3e939d700 1 -- start start 2024-02-15T22:41:28.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3e939d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbe40 0x7fe3e410fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3e939d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e4110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3e939d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e4110600 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3e939d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e4110ea0 con 0x7fe3e40fbe40 2024-02-15T22:41:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e4110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e4110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56934/0 (socket says 172.21.15.33:56934) 2024-02-15T22:41:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3dbfff700 1 -- 172.21.15.33:0/796347254 learned_addr learned my addr 172.21.15.33:0/796347254 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:41:28.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.166+0000 7fe3e2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbe40 0x7fe3e410fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:28.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.167+0000 7fe3dbfff700 1 -- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbe40 msgr2=0x7fe3e410fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.167+0000 7fe3dbfff700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbe40 0x7fe3e410fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.167+0000 7fe3dbfff700 1 -- 172.21.15.33:0/796347254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc005040 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.167+0000 7fe3dbfff700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e4110000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:28.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.167+0000 7fe3db7fe700 1 -- 172.21.15.33:0/796347254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3cc021070 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.167+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e4111120 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.167+0000 7fe3db7fe700 1 -- 172.21.15.33:0/796347254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3cc01c400 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.168+0000 7fe3db7fe700 1 -- 172.21.15.33:0/796347254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3cc00e070 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.168+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e4111600 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.169+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e404bed0 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.169+0000 7fe3db7fe700 1 -- 172.21.15.33:0/796347254 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7fe3cc01ca50 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.170+0000 7fe3db7fe700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fe3d006b2e0 0x7fe3d006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:28.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.170+0000 7fe3e2ffd700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fe3d006b2e0 0x7fe3d006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:28.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.171+0000 7fe3e2ffd700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fe3d006b2e0 0x7fe3d006d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009b80 tx=0x7fe3d400b040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:28.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.171+0000 7fe3db7fe700 1 -- 172.21.15.33:0/796347254 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe3cc058be0 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.177+0000 7fe3db7fe700 1 -- 172.21.15.33:0/796347254 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe3cc0582b0 con 0x7fe3e40fcfb0 2024-02-15T22:41:28.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.439+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3e4111b30 con 0x7fe3d006b2e0 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.449+0000 7fe3db7fe700 1 -- 172.21.15.33:0/796347254 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe3e4111b30 con 0x7fe3d006b2e0 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 starting - - - - 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (8m) 25s ago 8m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (7m) 38s ago 7m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (7m) 25s ago 8m 83.8M - 9.4.7 954c08fa6188 4e1a6363851b 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (3m) 25s ago 3m 118M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (2m) 25s ago 2m 70.0M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:41:28.450 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (2m) 38s ago 2m 66.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (2m) 38s ago 2m 54.7M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:9283 running (10m) 25s ago 10m 331M - 17.2.7-509-g9aa52330 61c0ec9cd187 4de1acba28ab 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283 running (65s) 38s ago 7m 488M - 19.0.0-1450-gf78a58c0 f081f847070a 0cbd0d048cce 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (10m) 25s ago 10m 51.3M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (7m) 38s ago 7m 39.4M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 starting - - - - 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 38s ago 7m 16.8M - 1.5.0 0da6a335fe13 e8b1514d760c 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (6m) 25s ago 6m 159M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:41:28.451 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 25s ago 6m 154M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:41:28.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (5m) 25s ago 5m 147M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:41:28.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (5m) 38s ago 5m 200M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:41:28.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (4m) 38s ago 4m 145M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:41:28.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (4m) 38s ago 4m 178M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:41:28.452 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (6m) 25s ago 8m 58.9M - 2.43.0 a07b618ecd1d fcda9c48f34e 2024-02-15T22:41:28.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fe3d006b2e0 msgr2=0x7fe3d006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fe3d006b2e0 0x7fe3d006d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009b80 tx=0x7fe3d400b040 comp rx=0 tx=0).stop 2024-02-15T22:41:28.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 msgr2=0x7fe3e4110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e4110000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 shutdown_connections 2024-02-15T22:41:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fe3d006b2e0 0x7fe3d006d790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbe40 0x7fe3e410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 --2- 172.21.15.33:0/796347254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3e40fcfb0 0x7fe3e4110000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 >> 172.21.15.33:0/796347254 conn(0x7fe3e40f74e0 msgr2=0x7fe3e40656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 shutdown_connections 2024-02-15T22:41:28.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.451+0000 7fe3e939d700 1 -- 172.21.15.33:0/796347254 wait complete. 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.569+0000 7fc5c54e8700 1 -- 172.21.15.33:0/4076730301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fbe40 msgr2=0x7fc5c00fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.569+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/4076730301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fbe40 0x7fc5c00fc250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0004940 tx=0x7fc5b0009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.569+0000 7fc5c54e8700 1 -- 172.21.15.33:0/4076730301 shutdown_connections 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.569+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/4076730301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5c00fcfb0 0x7fc5c00fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.569+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/4076730301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fbe40 0x7fc5c00fc250 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.569+0000 7fc5c54e8700 1 -- 172.21.15.33:0/4076730301 >> 172.21.15.33:0/4076730301 conn(0x7fc5c00f7520 msgr2=0x7fc5c00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.570+0000 7fc5c54e8700 1 -- 172.21.15.33:0/4076730301 shutdown_connections 2024-02-15T22:41:28.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.570+0000 7fc5c54e8700 1 -- 172.21.15.33:0/4076730301 wait complete. 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.570+0000 7fc5c54e8700 1 Processor -- start 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.570+0000 7fc5c54e8700 1 -- start start 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5c54e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5c00fbe40 0x7fc5c01105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5c54e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fcfb0 0x7fc5c0112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5c54e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0066cf0 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5c54e8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0066e30 con 0x7fc5c00fbe40 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5be7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fcfb0 0x7fc5c0112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5be7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fcfb0 0x7fc5c0112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56956/0 (socket says 172.21.15.33:56956) 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5be7fc700 1 -- 172.21.15.33:0/1073043118 learned_addr learned my addr 172.21.15.33:0/1073043118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5beffd700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5c00fbe40 0x7fc5c01105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5be7fc700 1 -- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5c00fbe40 msgr2=0x7fc5c01105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5be7fc700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5c00fbe40 0x7fc5c01105c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5be7fc700 1 -- 172.21.15.33:0/1073043118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0005040 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5be7fc700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fcfb0 0x7fc5c0112b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400eb40 tx=0x7fc5b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.571+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1073043118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b4007cc0 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.572+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c0113110 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.572+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1073043118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5b400f040 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.572+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c0113650 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.572+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1073043118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b400ca10 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.573+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac0052e0 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.573+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1073043118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7fc5b400cb70 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.574+0000 7fc5a77fe700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fc5a806b2e0 0x7fc5a806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.574+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1073043118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc5b4089840 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.574+0000 7fc5beffd700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fc5a806b2e0 0x7fc5a806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.575+0000 7fc5beffd700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fc5a806b2e0 0x7fc5a806d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0000c00 tx=0x7fc5b0009e30 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.579+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1073043118 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc5b404f620 con 0x7fc5c00fcfb0 2024-02-15T22:41:28.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:28 smithi082 ceph-mon[37153]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:28.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:28 smithi033 ceph-mon[29033]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:28.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.998+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc5ac005860 con 0x7fc5c00fcfb0 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:28.999+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1073043118 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fc5b4089070 con 0x7fc5c00fcfb0 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 1, 2024-02-15T22:41:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 13, 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:41:29.001 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:41:29.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fc5a806b2e0 msgr2=0x7fc5a806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:29.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fc5a806b2e0 0x7fc5a806d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0000c00 tx=0x7fc5b0009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:29.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fcfb0 msgr2=0x7fc5c0112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:29.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fcfb0 0x7fc5c0112b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400eb40 tx=0x7fc5b400b040 comp rx=0 tx=0).stop 2024-02-15T22:41:29.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 shutdown_connections 2024-02-15T22:41:29.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fc5a806b2e0 0x7fc5a806d790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5c00fbe40 0x7fc5c01105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 --2- 172.21.15.33:0/1073043118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c00fcfb0 0x7fc5c0112b10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 >> 172.21.15.33:0/1073043118 conn(0x7fc5c00f7520 msgr2=0x7fc5c0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:29.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 shutdown_connections 2024-02-15T22:41:29.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.001+0000 7fc5c54e8700 1 -- 172.21.15.33:0/1073043118 wait complete. 2024-02-15T22:41:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 -- 172.21.15.33:0/3036324079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90700fda80 msgr2=0x7f90700ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 --2- 172.21.15.33:0/3036324079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90700fda80 0x7f90700ffe60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9058004940 tx=0x7f9058009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 -- 172.21.15.33:0/3036324079 shutdown_connections 2024-02-15T22:41:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 --2- 172.21.15.33:0/3036324079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90701003a0 0x7f9070102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 --2- 172.21.15.33:0/3036324079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90700fda80 0x7f90700ffe60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 -- 172.21.15.33:0/3036324079 >> 172.21.15.33:0/3036324079 conn(0x7f90700f74e0 msgr2=0x7f90700f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 -- 172.21.15.33:0/3036324079 shutdown_connections 2024-02-15T22:41:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 -- 172.21.15.33:0/3036324079 wait complete. 2024-02-15T22:41:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 Processor -- start 2024-02-15T22:41:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.137+0000 7f9075c20700 1 -- start start 2024-02-15T22:41:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9075c20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90700fda80 0x7f907010d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9075c20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90701003a0 0x7f907010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9075c20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907010e400 con 0x7f90701003a0 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9075c20700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907010eca0 con 0x7f90700fda80 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90701003a0 0x7f907010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90701003a0 0x7f907010de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56976/0 (socket says 172.21.15.33:56976) 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906effd700 1 -- 172.21.15.33:0/4249679524 learned_addr learned my addr 172.21.15.33:0/4249679524 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906f7fe700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90700fda80 0x7f907010d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906effd700 1 -- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90700fda80 msgr2=0x7f907010d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906effd700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90700fda80 0x7f907010d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906effd700 1 -- 172.21.15.33:0/4249679524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058005040 con 0x7f90701003a0 2024-02-15T22:41:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f906effd700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90701003a0 0x7f907010de00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f906000eb40 tx=0x7f906000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9067fff700 1 -- 172.21.15.33:0/4249679524 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9060007cc0 con 0x7f90701003a0 2024-02-15T22:41:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9067fff700 1 -- 172.21.15.33:0/4249679524 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f906000f040 con 0x7f90701003a0 2024-02-15T22:41:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907010ef20 con 0x7f90701003a0 2024-02-15T22:41:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.138+0000 7f9067fff700 1 -- 172.21.15.33:0/4249679524 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f906000ca10 con 0x7f90701003a0 2024-02-15T22:41:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.139+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907010f460 con 0x7f90701003a0 2024-02-15T22:41:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.139+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9070107a50 con 0x7f90701003a0 2024-02-15T22:41:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.140+0000 7f9067fff700 1 -- 172.21.15.33:0/4249679524 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f906000cc80 con 0x7f90701003a0 2024-02-15T22:41:29.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.140+0000 7f9067fff700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f905c06b2e0 0x7f905c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:29.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.141+0000 7f9067fff700 1 -- 172.21.15.33:0/4249679524 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f90600899b0 con 0x7f90701003a0 2024-02-15T22:41:29.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.141+0000 7f906f7fe700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f905c06b2e0 0x7f905c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:29.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.141+0000 7f906f7fe700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f905c06b2e0 0x7f905c06d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90580045a0 tx=0x7f9058009e30 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:29.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.145+0000 7f9067fff700 1 -- 172.21.15.33:0/4249679524 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f906004f620 con 0x7f90701003a0 2024-02-15T22:41:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.471+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f907002b310 con 0x7f905c06b2e0 2024-02-15T22:41:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.473+0000 7f9067fff700 1 -- 172.21.15.33:0/4249679524 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f907002b310 con 0x7f905c06b2e0 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "1/2 daemons upgraded", 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:41:29.474 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:41:29.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f905c06b2e0 msgr2=0x7f905c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:29.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f905c06b2e0 0x7f905c06d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90580045a0 tx=0x7f9058009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:29.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90701003a0 msgr2=0x7f907010de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90701003a0 0x7f907010de00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f906000eb40 tx=0x7f906000b040 comp rx=0 tx=0).stop 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 shutdown_connections 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f905c06b2e0 0x7f905c06d790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90700fda80 0x7f907010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 --2- 172.21.15.33:0/4249679524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90701003a0 0x7f907010de00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 >> 172.21.15.33:0/4249679524 conn(0x7f90700f74e0 msgr2=0x7f90700f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.475+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 shutdown_connections 2024-02-15T22:41:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:29.476+0000 7f9075c20700 1 -- 172.21.15.33:0/4249679524 wait complete. 2024-02-15T22:41:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:29 smithi082 ceph-mon[37153]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:29 smithi082 ceph-mon[37153]: pgmap v27: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 227 MiB/s rd, 266 MiB/s wr, 509 op/s 2024-02-15T22:41:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:29 smithi082 ceph-mon[37153]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:29 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1073043118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:41:29.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:29 smithi033 ceph-mon[29033]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:29.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:29 smithi033 ceph-mon[29033]: pgmap v27: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 227 MiB/s rd, 266 MiB/s wr, 509 op/s 2024-02-15T22:41:29.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:29 smithi033 ceph-mon[29033]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:29.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:29 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1073043118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:41:30.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:30 smithi082 ceph-mon[37153]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:30.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:30 smithi033 ceph-mon[29033]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:31.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:31 smithi082 ceph-mon[37153]: pgmap v28: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 139 MiB/s rd, 161 MiB/s wr, 307 op/s 2024-02-15T22:41:31.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:31 smithi033 ceph-mon[29033]: pgmap v28: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 139 MiB/s rd, 161 MiB/s wr, 307 op/s 2024-02-15T22:41:33.612 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:33 smithi033 ceph-mon[29033]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 140 MiB/s rd, 163 MiB/s wr, 397 op/s 2024-02-15T22:41:33.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:33 smithi082 ceph-mon[37153]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 140 MiB/s rd, 163 MiB/s wr, 397 op/s 2024-02-15T22:41:35.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:35 smithi082 ceph-mon[37153]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 90 MiB/s wr, 245 op/s 2024-02-15T22:41:35.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:35 smithi033 ceph-mon[29033]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 90 MiB/s wr, 245 op/s 2024-02-15T22:41:37.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:37 smithi033 ceph-mon[29033]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 90 MiB/s wr, 245 op/s 2024-02-15T22:41:37.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:37 smithi082 ceph-mon[37153]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 90 MiB/s wr, 245 op/s 2024-02-15T22:41:39.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:38 smithi033 ceph-mon[29033]: pgmap v32: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 75 MiB/s rd, 91 MiB/s wr, 361 op/s 2024-02-15T22:41:39.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:38 smithi082 ceph-mon[37153]: pgmap v32: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 75 MiB/s rd, 91 MiB/s wr, 361 op/s 2024-02-15T22:41:41.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:41 smithi082 ceph-mon[37153]: pgmap v33: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 205 op/s 2024-02-15T22:41:41.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:41 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:41.636 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:41 smithi033 ceph-mon[29033]: pgmap v33: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 205 op/s 2024-02-15T22:41:41.636 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:41 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:43.612 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:43 smithi033 ceph-mon[29033]: pgmap v34: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 251 op/s 2024-02-15T22:41:43.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:43 smithi082 ceph-mon[37153]: pgmap v34: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 251 op/s 2024-02-15T22:41:45.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:45 smithi082 ceph-mon[37153]: pgmap v35: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2024-02-15T22:41:45.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:45 smithi033 ceph-mon[29033]: pgmap v35: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2024-02-15T22:41:47.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:47 smithi082 ceph-mon[37153]: pgmap v36: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2024-02-15T22:41:47.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:47 smithi033 ceph-mon[29033]: pgmap v36: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2024-02-15T22:41:49.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:48 smithi033 ceph-mon[29033]: pgmap v37: 65 pgs: 65 active+clean; 966 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 323 op/s 2024-02-15T22:41:49.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:48 smithi082 ceph-mon[37153]: pgmap v37: 65 pgs: 65 active+clean; 966 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 323 op/s 2024-02-15T22:41:49.428 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T22:41:49.428 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-15T22:41:51.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:51 smithi082 ceph-mon[37153]: pgmap v38: 65 pgs: 65 active+clean; 966 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2024-02-15T22:41:51.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:51 smithi033 ceph-mon[29033]: pgmap v38: 65 pgs: 65 active+clean; 966 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2024-02-15T22:41:53.611 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:53 smithi033 ceph-mon[29033]: pgmap v39: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 383 op/s 2024-02-15T22:41:53.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:53 smithi082 ceph-mon[37153]: pgmap v39: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 383 op/s 2024-02-15T22:41:55.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:55 smithi033 ceph-mon[29033]: pgmap v40: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 337 op/s 2024-02-15T22:41:55.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:55 smithi082 ceph-mon[37153]: pgmap v40: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 337 op/s 2024-02-15T22:41:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:56 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:56 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:56 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:56 smithi082 ceph-mon[37153]: Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T22:41:56.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:56 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:41:56.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:56 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:56.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:56 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:41:56.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:56 smithi033 ceph-mon[29033]: Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T22:41:57.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:57 smithi082 ceph-mon[37153]: Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T22:41:57.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:57 smithi082 ceph-mon[37153]: pgmap v41: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 337 op/s 2024-02-15T22:41:58.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:57 smithi033 ceph-mon[29033]: Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T22:41:58.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:57 smithi033 ceph-mon[29033]: pgmap v41: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 337 op/s 2024-02-15T22:41:59.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:41:58 smithi033 ceph-mon[29033]: pgmap v42: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 631 op/s 2024-02-15T22:41:59.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:41:58 smithi082 ceph-mon[37153]: pgmap v42: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 631 op/s 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.595+0000 7f10a37a1700 1 -- 172.21.15.33:0/874167054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 msgr2=0x7f109c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.595+0000 7f10a37a1700 1 --2- 172.21.15.33:0/874167054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 0x7f109c0fd420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f108c004940 tx=0x7f108c009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 -- 172.21.15.33:0/874167054 shutdown_connections 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 --2- 172.21.15.33:0/874167054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 0x7f109c0fd420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 --2- 172.21.15.33:0/874167054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 0x7f109c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 -- 172.21.15.33:0/874167054 >> 172.21.15.33:0/874167054 conn(0x7f109c0f74e0 msgr2=0x7f109c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 -- 172.21.15.33:0/874167054 shutdown_connections 2024-02-15T22:41:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 -- 172.21.15.33:0/874167054 wait complete. 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 Processor -- start 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.596+0000 7f10a37a1700 1 -- start start 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a37a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 0x7f109c10c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a37a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 0x7f109c10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a37a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c10d310 con 0x7f109c0fcfb0 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a37a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c10dbb0 con 0x7f109c0fbe40 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a153d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 0x7f109c10c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a0d3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 0x7f109c10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a153d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 0x7f109c10c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:53354/0 (socket says 172.21.15.33:53354) 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a153d700 1 -- 172.21.15.33:0/147407959 learned_addr learned my addr 172.21.15.33:0/147407959 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:41:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a153d700 1 -- 172.21.15.33:0/147407959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 msgr2=0x7f109c10cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a153d700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 0x7f109c10cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a153d700 1 -- 172.21.15.33:0/147407959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c005040 con 0x7f109c0fbe40 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a0d3c700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 0x7f109c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.597+0000 7f10a153d700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 0x7f109c10c7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1098010e50 tx=0x7f109800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.598+0000 7f1091ffb700 1 -- 172.21.15.33:0/147407959 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1098015070 con 0x7f109c0fbe40 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.598+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c10de30 con 0x7f109c0fbe40 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.598+0000 7f1091ffb700 1 -- 172.21.15.33:0/147407959 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f109800be00 con 0x7f109c0fbe40 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.598+0000 7f1091ffb700 1 -- 172.21.15.33:0/147407959 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109801b470 con 0x7f109c0fbe40 2024-02-15T22:41:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.598+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c10e370 con 0x7f109c0fbe40 2024-02-15T22:41:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.599+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c04bed0 con 0x7f109c0fbe40 2024-02-15T22:41:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.599+0000 7f1091ffb700 1 -- 172.21.15.33:0/147407959 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f109800b930 con 0x7f109c0fbe40 2024-02-15T22:41:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.600+0000 7f1091ffb700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f108806b2e0 0x7f108806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.600+0000 7f1091ffb700 1 -- 172.21.15.33:0/147407959 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f109808e270 con 0x7f109c0fbe40 2024-02-15T22:41:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.600+0000 7f10a0d3c700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f108806b2e0 0x7f108806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.601+0000 7f10a0d3c700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f108806b2e0 0x7f108806d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f108c009b30 tx=0x7f108c009e30 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:59.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.605+0000 7f1091ffb700 1 -- 172.21.15.33:0/147407959 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f109805bd60 con 0x7f109c0fbe40 2024-02-15T22:41:59.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.871+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f109c10e7e0 con 0x7f108806b2e0 2024-02-15T22:41:59.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.873+0000 7f1091ffb700 1 -- 172.21.15.33:0/147407959 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f109c10e7e0 con 0x7f108806b2e0 2024-02-15T22:41:59.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.877+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f108806b2e0 msgr2=0x7f108806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:59.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.877+0000 7f10a37a1700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f108806b2e0 0x7f108806d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f108c009b30 tx=0x7f108c009e30 comp rx=0 tx=0).stop 2024-02-15T22:41:59.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.877+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 msgr2=0x7f109c10c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:59.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.877+0000 7f10a37a1700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 0x7f109c10c7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1098010e50 tx=0x7f109800b040 comp rx=0 tx=0).stop 2024-02-15T22:41:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.878+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 shutdown_connections 2024-02-15T22:41:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.878+0000 7f10a37a1700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f108806b2e0 0x7f108806d790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.878+0000 7f10a37a1700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f109c0fbe40 0x7f109c10c7d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.878+0000 7f10a37a1700 1 --2- 172.21.15.33:0/147407959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f109c0fcfb0 0x7f109c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.878+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 >> 172.21.15.33:0/147407959 conn(0x7f109c0f74e0 msgr2=0x7f109c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.879+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 shutdown_connections 2024-02-15T22:41:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:41:59.880+0000 7f10a37a1700 1 -- 172.21.15.33:0/147407959 wait complete. 2024-02-15T22:41:59.898 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:42:00.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.065+0000 7f943f507700 1 -- 172.21.15.33:0/1969277167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94381045c0 msgr2=0x7f9438104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.065+0000 7f943f507700 1 --2- 172.21.15.33:0/1969277167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94381045c0 0x7f9438104a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9428004880 tx=0x7f9428009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:00.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.065+0000 7f943f507700 1 -- 172.21.15.33:0/1969277167 shutdown_connections 2024-02-15T22:42:00.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.065+0000 7f943f507700 1 --2- 172.21.15.33:0/1969277167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94381045c0 0x7f9438104a10 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9428004880 tx=0x7f9428009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:00.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.065+0000 7f943f507700 1 --2- 172.21.15.33:0/1969277167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94381033b0 0x7f94381037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.065+0000 7f943f507700 1 -- 172.21.15.33:0/1969277167 >> 172.21.15.33:0/1969277167 conn(0x7f94380725b0 msgr2=0x7f94380749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:00.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.066+0000 7f943f507700 1 -- 172.21.15.33:0/1969277167 shutdown_connections 2024-02-15T22:42:00.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.066+0000 7f943f507700 1 -- 172.21.15.33:0/1969277167 wait complete. 2024-02-15T22:42:00.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.067+0000 7f943f507700 1 Processor -- start 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.067+0000 7f943f507700 1 -- start start 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.067+0000 7f943f507700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94381033b0 0x7f943807dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.067+0000 7f943f507700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f943807e4e0 0x7f943811db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.067+0000 7f943f507700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943807e9a0 con 0x7f943807e4e0 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.067+0000 7f943f507700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943807eae0 con 0x7f94381033b0 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.068+0000 7f943caa2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f943807e4e0 0x7f943811db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.068+0000 7f943caa2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f943807e4e0 0x7f943811db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34480/0 (socket says 172.21.15.33:34480) 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.068+0000 7f943caa2700 1 -- 172.21.15.33:0/2082939857 learned_addr learned my addr 172.21.15.33:0/2082939857 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.068+0000 7f943caa2700 1 -- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94381033b0 msgr2=0x7f943807dfa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.068+0000 7f943caa2700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94381033b0 0x7f943807dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.068+0000 7f943caa2700 1 -- 172.21.15.33:0/2082939857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9428005040 con 0x7f943807e4e0 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.069+0000 7f943caa2700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f943807e4e0 0x7f943811db30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f94280047d0 tx=0x7f9428009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.069+0000 7f942dffb700 1 -- 172.21.15.33:0/2082939857 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f942800e030 con 0x7f943807e4e0 2024-02-15T22:42:00.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.069+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943811e130 con 0x7f943807e4e0 2024-02-15T22:42:00.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.070+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943811e6c0 con 0x7f943807e4e0 2024-02-15T22:42:00.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.070+0000 7f942dffb700 1 -- 172.21.15.33:0/2082939857 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9428013e60 con 0x7f943807e4e0 2024-02-15T22:42:00.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.070+0000 7f942dffb700 1 -- 172.21.15.33:0/2082939857 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94280123c0 con 0x7f943807e4e0 2024-02-15T22:42:00.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.071+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9438077f40 con 0x7f943807e4e0 2024-02-15T22:42:00.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.073+0000 7f942dffb700 1 -- 172.21.15.33:0/2082939857 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f9428012520 con 0x7f943807e4e0 2024-02-15T22:42:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.074+0000 7f942dffb700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f942406b400 0x7f942406d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.074+0000 7f942dffb700 1 -- 172.21.15.33:0/2082939857 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f942808b740 con 0x7f943807e4e0 2024-02-15T22:42:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.074+0000 7f943d2a3700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f942406b400 0x7f942406d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.078+0000 7f943d2a3700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f942406b400 0x7f942406d8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9438104420 tx=0x7f943000b040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.084+0000 7f942dffb700 1 -- 172.21.15.33:0/2082939857 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f94280592b0 con 0x7f943807e4e0 2024-02-15T22:42:00.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.412+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f943810c060 con 0x7f942406b400 2024-02-15T22:42:00.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.414+0000 7f942dffb700 1 -- 172.21.15.33:0/2082939857 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f943000f040 con 0x7f942406b400 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f942406b400 msgr2=0x7f942406d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f942406b400 0x7f942406d8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9438104420 tx=0x7f943000b040 comp rx=0 tx=0).stop 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f943807e4e0 msgr2=0x7f943811db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f943807e4e0 0x7f943811db30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f94280047d0 tx=0x7f9428009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 shutdown_connections 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f942406b400 0x7f942406d8b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94381033b0 0x7f943807dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 --2- 172.21.15.33:0/2082939857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f943807e4e0 0x7f943811db30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 >> 172.21.15.33:0/2082939857 conn(0x7f94380725b0 msgr2=0x7f94380758c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 shutdown_connections 2024-02-15T22:42:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.417+0000 7f943f507700 1 -- 172.21.15.33:0/2082939857 wait complete. 2024-02-15T22:42:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 -- 172.21.15.33:0/3146681892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 msgr2=0x7f5a280fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3146681892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a280fc290 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5a18004940 tx=0x7f5a18009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 -- 172.21.15.33:0/3146681892 shutdown_connections 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3146681892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a280fd080 0x7f5a280fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3146681892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a280fc290 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 -- 172.21.15.33:0/3146681892 >> 172.21.15.33:0/3146681892 conn(0x7f5a280f7590 msgr2=0x7f5a280f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 -- 172.21.15.33:0/3146681892 shutdown_connections 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.534+0000 7f5a2e366700 1 -- 172.21.15.33:0/3146681892 wait complete. 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a2e366700 1 Processor -- start 2024-02-15T22:42:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a2e366700 1 -- start start 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a2e366700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a281105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a2e366700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a280fd080 0x7f5a28112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a2e366700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28066db0 con 0x7f5a280fbe80 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a2e366700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28066ef0 con 0x7f5a280fd080 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a281105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a281105d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34490/0 (socket says 172.21.15.33:34490) 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a27fff700 1 -- 172.21.15.33:0/3399726004 learned_addr learned my addr 172.21.15.33:0/3399726004 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a277fe700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a280fd080 0x7f5a28112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a27fff700 1 -- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a280fd080 msgr2=0x7f5a28112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a27fff700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a280fd080 0x7f5a28112b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.535+0000 7f5a27fff700 1 -- 172.21.15.33:0/3399726004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18005040 con 0x7f5a280fbe80 2024-02-15T22:42:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.536+0000 7f5a27fff700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a281105d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5a18005010 tx=0x7f5a18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.536+0000 7f5a24ff9700 1 -- 172.21.15.33:0/3399726004 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a18021070 con 0x7f5a280fbe80 2024-02-15T22:42:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.536+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a28113120 con 0x7f5a280fbe80 2024-02-15T22:42:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.536+0000 7f5a24ff9700 1 -- 172.21.15.33:0/3399726004 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a18009430 con 0x7f5a280fbe80 2024-02-15T22:42:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.536+0000 7f5a24ff9700 1 -- 172.21.15.33:0/3399726004 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a1800e070 con 0x7f5a280fbe80 2024-02-15T22:42:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.536+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a28113600 con 0x7f5a280fbe80 2024-02-15T22:42:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.537+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2804bed0 con 0x7f5a280fbe80 2024-02-15T22:42:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.537+0000 7f5a24ff9700 1 -- 172.21.15.33:0/3399726004 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f5a1801c790 con 0x7f5a280fbe80 2024-02-15T22:42:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.538+0000 7f5a24ff9700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5a1006b2e0 0x7f5a1006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.538+0000 7f5a24ff9700 1 -- 172.21.15.33:0/3399726004 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f5a1808aff0 con 0x7f5a280fbe80 2024-02-15T22:42:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.538+0000 7f5a277fe700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5a1006b2e0 0x7f5a1006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.538+0000 7f5a277fe700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5a1006b2e0 0x7f5a1006d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009b80 tx=0x7f5a1c00b040 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.542+0000 7f5a24ff9700 1 -- 172.21.15.33:0/3399726004 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5a18055050 con 0x7f5a280fbe80 2024-02-15T22:42:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.774+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a281019d0 con 0x7f5a1006b2e0 2024-02-15T22:42:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.792+0000 7f5a24ff9700 1 -- 172.21.15.33:0/3399726004 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5a281019d0 con 0x7f5a1006b2e0 2024-02-15T22:42:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:42:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 starting - - - - 2024-02-15T22:42:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (9m) 58s ago 9m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:42:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (8m) 70s ago 8m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:42:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 starting - - - - 2024-02-15T22:42:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (3m) 58s ago 3m 118M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (3m) 58s ago 3m 70.0M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (3m) 70s ago 3m 66.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (3m) 70s ago 3m 54.7M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:9283 running (10m) 58s ago 10m 331M - 17.2.7-509-g9aa52330 61c0ec9cd187 4de1acba28ab 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283 running (97s) 70s ago 8m 488M - 19.0.0-1450-gf78a58c0 f081f847070a 0cbd0d048cce 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (10m) 58s ago 10m 51.3M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (8m) 70s ago 8m 39.4M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 starting - - - - 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (8m) 70s ago 8m 16.8M - 1.5.0 0da6a335fe13 e8b1514d760c 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 58s ago 7m 159M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 58s ago 6m 154M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (6m) 58s ago 6m 147M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:42:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (5m) 70s ago 5m 200M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:42:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (5m) 70s ago 5m 145M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:42:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (5m) 70s ago 5m 178M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:42:00.796 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (7m) 58s ago 8m 58.9M - 2.43.0 a07b618ecd1d fcda9c48f34e 2024-02-15T22:42:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5a1006b2e0 msgr2=0x7f5a1006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5a1006b2e0 0x7f5a1006d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009b80 tx=0x7f5a1c00b040 comp rx=0 tx=0).stop 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 msgr2=0x7f5a281105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a281105d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5a18005010 tx=0x7f5a18009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 shutdown_connections 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f5a1006b2e0 0x7f5a1006d790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a280fbe80 0x7f5a281105d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 --2- 172.21.15.33:0/3399726004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a280fd080 0x7f5a28112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.793+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 >> 172.21.15.33:0/3399726004 conn(0x7f5a280f7590 msgr2=0x7f5a281002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.794+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 shutdown_connections 2024-02-15T22:42:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.794+0000 7f5a2e366700 1 -- 172.21.15.33:0/3399726004 wait complete. 2024-02-15T22:42:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 -- 172.21.15.33:0/3302675917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284100060 msgr2=0x7fb284102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 --2- 172.21.15.33:0/3302675917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284100060 0x7fb284102440 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb278004940 tx=0x7fb278009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 -- 172.21.15.33:0/3302675917 shutdown_connections 2024-02-15T22:42:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 --2- 172.21.15.33:0/3302675917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284100060 0x7fb284102440 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 --2- 172.21.15.33:0/3302675917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284066340 0x7fb2840ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 -- 172.21.15.33:0/3302675917 >> 172.21.15.33:0/3302675917 conn(0x7fb2840f7530 msgr2=0x7fb2840f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 -- 172.21.15.33:0/3302675917 shutdown_connections 2024-02-15T22:42:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.930+0000 7fb28b607700 1 -- 172.21.15.33:0/3302675917 wait complete. 2024-02-15T22:42:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.931+0000 7fb28b607700 1 Processor -- start 2024-02-15T22:42:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.931+0000 7fb28b607700 1 -- start start 2024-02-15T22:42:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.931+0000 7fb28b607700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284066340 0x7fb28410d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.931+0000 7fb28b607700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284100060 0x7fb28410dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.931+0000 7fb28b607700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28410e320 con 0x7fb284066340 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.931+0000 7fb28b607700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28410ebc0 con 0x7fb284100060 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.931+0000 7fb2893a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284066340 0x7fb28410d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb288ba2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284100060 0x7fb28410dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb288ba2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284100060 0x7fb28410dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:53398/0 (socket says 172.21.15.33:53398) 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb2893a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284066340 0x7fb28410d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34496/0 (socket says 172.21.15.33:34496) 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb288ba2700 1 -- 172.21.15.33:0/2322126814 learned_addr learned my addr 172.21.15.33:0/2322126814 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb2893a3700 1 -- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284100060 msgr2=0x7fb28410dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb2893a3700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284100060 0x7fb28410dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb2893a3700 1 -- 172.21.15.33:0/2322126814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278005040 con 0x7fb284066340 2024-02-15T22:42:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb288ba2700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284100060 0x7fb28410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:42:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb2893a3700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284066340 0x7fb28410d7e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb27400ebf0 tx=0x7fb27400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb281ffb700 1 -- 172.21.15.33:0/2322126814 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb274007c00 con 0x7fb284066340 2024-02-15T22:42:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb281ffb700 1 -- 172.21.15.33:0/2322126814 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb27400f040 con 0x7fb284066340 2024-02-15T22:42:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28410eea0 con 0x7fb284066340 2024-02-15T22:42:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.932+0000 7fb281ffb700 1 -- 172.21.15.33:0/2322126814 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27400cbf0 con 0x7fb284066340 2024-02-15T22:42:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.933+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28410f3e0 con 0x7fb284066340 2024-02-15T22:42:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.934+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2841079f0 con 0x7fb284066340 2024-02-15T22:42:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.934+0000 7fb281ffb700 1 -- 172.21.15.33:0/2322126814 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7fb27400cd50 con 0x7fb284066340 2024-02-15T22:42:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.935+0000 7fb281ffb700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fb26c06b3b0 0x7fb26c06d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.935+0000 7fb281ffb700 1 -- 172.21.15.33:0/2322126814 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fb274089dc0 con 0x7fb284066340 2024-02-15T22:42:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.935+0000 7fb288ba2700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fb26c06b3b0 0x7fb26c06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.935+0000 7fb288ba2700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fb26c06b3b0 0x7fb26c06d860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb27800b0d0 tx=0x7fb278009e30 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:00.939+0000 7fb281ffb700 1 -- 172.21.15.33:0/2322126814 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb2740578b0 con 0x7fb284066340 2024-02-15T22:42:01.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.337+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb28410f6b0 con 0x7fb284066340 2024-02-15T22:42:01.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.337+0000 7fb281ffb700 1 -- 172.21.15.33:0/2322126814 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fb274057440 con 0x7fb284066340 2024-02-15T22:42:01.339 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:42:01.339 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 1, 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 13, 2024-02-15T22:42:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:42:01.341 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:42:01.341 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:42:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fb26c06b3b0 msgr2=0x7fb26c06d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fb26c06b3b0 0x7fb26c06d860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb27800b0d0 tx=0x7fb278009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284066340 msgr2=0x7fb28410d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284066340 0x7fb28410d7e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb27400ebf0 tx=0x7fb27400b040 comp rx=0 tx=0).stop 2024-02-15T22:42:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 shutdown_connections 2024-02-15T22:42:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7fb26c06b3b0 0x7fb26c06d860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb284066340 0x7fb28410d7e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 --2- 172.21.15.33:0/2322126814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb284100060 0x7fb28410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 >> 172.21.15.33:0/2322126814 conn(0x7fb2840f7530 msgr2=0x7fb2840f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 shutdown_connections 2024-02-15T22:42:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.340+0000 7fb28b607700 1 -- 172.21.15.33:0/2322126814 wait complete. 2024-02-15T22:42:01.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.455+0000 7f753b8a5700 1 -- 172.21.15.33:0/4194236450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fcfb0 msgr2=0x7f75340fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.455+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4194236450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fcfb0 0x7f75340fd420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7524004940 tx=0x7f7524009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:01.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.455+0000 7f753b8a5700 1 -- 172.21.15.33:0/4194236450 shutdown_connections 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.455+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4194236450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fcfb0 0x7f75340fd420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.455+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4194236450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75340fbe40 0x7f75340fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.455+0000 7f753b8a5700 1 -- 172.21.15.33:0/4194236450 >> 172.21.15.33:0/4194236450 conn(0x7f75340f74e0 msgr2=0x7f75340f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 -- 172.21.15.33:0/4194236450 shutdown_connections 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 -- 172.21.15.33:0/4194236450 wait complete. 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 Processor -- start 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 -- start start 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fbe40 0x7f75341105f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75340fcfb0 0x7f7534112b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534066460 con 0x7f75340fbe40 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f753b8a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340665a0 con 0x7f75340fcfb0 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f7538e40700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75340fcfb0 0x7f7534112b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f7539641700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fbe40 0x7f75341105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f7538e40700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75340fcfb0 0x7f7534112b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:53416/0 (socket says 172.21.15.33:53416) 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.456+0000 7f7538e40700 1 -- 172.21.15.33:0/4075035786 learned_addr learned my addr 172.21.15.33:0/4075035786 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f7539641700 1 -- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75340fcfb0 msgr2=0x7f7534112b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f7539641700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75340fcfb0 0x7f7534112b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f7539641700 1 -- 172.21.15.33:0/4075035786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524005040 con 0x7f75340fbe40 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f7539641700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fbe40 0x7f75341105f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fd0 tx=0x7f753000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f7529ffb700 1 -- 172.21.15.33:0/4075035786 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7530004e90 con 0x7f75340fbe40 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534113140 con 0x7f75340fbe40 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f7529ffb700 1 -- 172.21.15.33:0/4075035786 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f753000f040 con 0x7f75340fbe40 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.457+0000 7f7529ffb700 1 -- 172.21.15.33:0/4075035786 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753000ca50 con 0x7f75340fbe40 2024-02-15T22:42:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.458+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7534113680 con 0x7f75340fbe40 2024-02-15T22:42:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.458+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753404bed0 con 0x7f75340fbe40 2024-02-15T22:42:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.459+0000 7f7529ffb700 1 -- 172.21.15.33:0/4075035786 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 89016+0+0 (secure 0 0 0) 0x7f7530007cc0 con 0x7f75340fbe40 2024-02-15T22:42:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.459+0000 7f7529ffb700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f752006b2e0 0x7f752006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.459+0000 7f7529ffb700 1 -- 172.21.15.33:0/4075035786 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f75300897f0 con 0x7f75340fbe40 2024-02-15T22:42:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.460+0000 7f7538e40700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f752006b2e0 0x7f752006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.460+0000 7f7538e40700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f752006b2e0 0x7f752006d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f752400b0d0 tx=0x7f7524009e30 comp rx=0 tx=0).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.464+0000 7f7529ffb700 1 -- 172.21.15.33:0/4075035786 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f753004f620 con 0x7f75340fbe40 2024-02-15T22:42:01.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:01 smithi082 ceph-mon[37153]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:01.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:01 smithi082 ceph-mon[37153]: pgmap v43: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 468 op/s 2024-02-15T22:42:01.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:01 smithi082 ceph-mon[37153]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:01.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:01 smithi082 ceph-mon[37153]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:01.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:01 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2322126814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:42:01.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:01 smithi033 ceph-mon[29033]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:01.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:01 smithi033 ceph-mon[29033]: pgmap v43: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 468 op/s 2024-02-15T22:42:01.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:01 smithi033 ceph-mon[29033]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:01.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:01 smithi033 ceph-mon[29033]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:01.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:01 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2322126814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:42:01.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.693+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 --> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7534101990 con 0x7f752006b2e0 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.694+0000 7f7529ffb700 1 -- 172.21.15.33:0/4075035786 <== mgr.24381 v2:172.21.15.82:6828/144917264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f7534101990 con 0x7f752006b2e0 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "1/2 daemons upgraded", 2024-02-15T22:42:01.696 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T22:42:01.697 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:42:01.697 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:42:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f752006b2e0 msgr2=0x7f752006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f752006b2e0 0x7f752006d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f752400b0d0 tx=0x7f7524009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fbe40 msgr2=0x7f75341105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fbe40 0x7f75341105f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fd0 tx=0x7f753000b040 comp rx=0 tx=0).stop 2024-02-15T22:42:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 shutdown_connections 2024-02-15T22:42:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:6828/144917264,v1:172.21.15.82:6829/144917264] conn(0x7f752006b2e0 0x7f752006d790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75340fbe40 0x7f75341105f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 --2- 172.21.15.33:0/4075035786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75340fcfb0 0x7f7534112b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 >> 172.21.15.33:0/4075035786 conn(0x7f75340f74e0 msgr2=0x7f7534100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 shutdown_connections 2024-02-15T22:42:01.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:01.696+0000 7f753b8a5700 1 -- 172.21.15.33:0/4075035786 wait complete. 2024-02-15T22:42:02.622 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:02 smithi082 ceph-mon[37153]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:02.622 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:02 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:02.623 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:02 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:02.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:02 smithi033 ceph-mon[29033]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:02.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:02 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:02.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:02 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:03.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:03 smithi082 ceph-mon[37153]: Reconfiguring node-exporter.smithi082 (dependencies changed)... 2024-02-15T22:42:03.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:03 smithi082 ceph-mon[37153]: Reconfiguring daemon node-exporter.smithi082 on smithi082 2024-02-15T22:42:03.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:03 smithi082 ceph-mon[37153]: pgmap v44: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 728 op/s 2024-02-15T22:42:03.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:03 smithi033 ceph-mon[29033]: Reconfiguring node-exporter.smithi082 (dependencies changed)... 2024-02-15T22:42:03.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:03 smithi033 ceph-mon[29033]: Reconfiguring daemon node-exporter.smithi082 on smithi082 2024-02-15T22:42:03.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:03 smithi033 ceph-mon[29033]: pgmap v44: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 728 op/s 2024-02-15T22:42:06.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: pgmap v45: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 553 op/s 2024-02-15T22:42:06.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:06.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:06.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: Upgrade: Need to upgrade myself (mgr.smithi082.mjhlse) 2024-02-15T22:42:06.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:05 smithi033 ceph-mon[29033]: Upgrade: Need to upgrade myself (mgr.smithi082.mjhlse) 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: pgmap v45: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 553 op/s 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: Upgrade: Need to upgrade myself (mgr.smithi082.mjhlse) 2024-02-15T22:42:06.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:05 smithi082 ceph-mon[37153]: Upgrade: Need to upgrade myself (mgr.smithi082.mjhlse) 2024-02-15T22:42:07.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: pgmap v46: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 553 op/s 2024-02-15T22:42:07.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: Upgrade: Updating mgr.smithi033.swohxi 2024-02-15T22:42:07.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:07.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:42:07.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:42:07.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:42:07.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:07.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:07 smithi033 ceph-mon[29033]: Deploying daemon mgr.smithi033.swohxi on smithi033 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: pgmap v46: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 553 op/s 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: Upgrade: Updating mgr.smithi033.swohxi 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:07.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:07 smithi082 ceph-mon[37153]: Deploying daemon mgr.smithi033.swohxi on smithi033 2024-02-15T22:42:08.965 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:08 smithi033 ceph-mon[29033]: pgmap v47: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 625 op/s 2024-02-15T22:42:09.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:08 smithi082 ceph-mon[37153]: pgmap v47: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 625 op/s 2024-02-15T22:42:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:11 smithi082 ceph-mon[37153]: pgmap v48: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 331 op/s 2024-02-15T22:42:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:11 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:11 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:11 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:11 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:11 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:11 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:11.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:11 smithi033 ceph-mon[29033]: pgmap v48: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 331 op/s 2024-02-15T22:42:11.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:11 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:11.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:11 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:11.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:11 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:11.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:11 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:11.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:11 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:11.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:11 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:13.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:13 smithi033 ceph-mon[29033]: pgmap v49: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 480 op/s 2024-02-15T22:42:13.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:13 smithi033 ceph-mon[29033]: mgrmap e25: smithi082.mjhlse(active, since 92s), standbys: smithi033.swohxi 2024-02-15T22:42:13.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:13 smithi082 ceph-mon[37153]: pgmap v49: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 480 op/s 2024-02-15T22:42:13.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:13 smithi082 ceph-mon[37153]: mgrmap e25: smithi082.mjhlse(active, since 92s), standbys: smithi033.swohxi 2024-02-15T22:42:15.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:14 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:15.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:14 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:15.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:14 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:15.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:14 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:15.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:15 smithi033 ceph-mon[29033]: pgmap v50: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 220 op/s 2024-02-15T22:42:16.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:15 smithi082 ceph-mon[37153]: pgmap v50: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 220 op/s 2024-02-15T22:42:18.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:17 smithi033 ceph-mon[29033]: pgmap v51: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 220 op/s 2024-02-15T22:42:18.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:17 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:18.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:17 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:18.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:17 smithi082 ceph-mon[37153]: pgmap v51: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 220 op/s 2024-02-15T22:42:18.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:17 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:18.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:17 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:19.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: pgmap v52: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 441 op/s 2024-02-15T22:42:19.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: Standby manager daemon smithi033.swohxi restarted 2024-02-15T22:42:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: Standby manager daemon smithi033.swohxi started 2024-02-15T22:42:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/crt"}]: dispatch 2024-02-15T22:42:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:42:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/key"}]: dispatch 2024-02-15T22:42:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:19 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: pgmap v52: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 441 op/s 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: Standby manager daemon smithi033.swohxi restarted 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: Standby manager daemon smithi033.swohxi started 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/crt"}]: dispatch 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:42:20.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.swohxi/key"}]: dispatch 2024-02-15T22:42:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:19 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:42:21.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:20 smithi033 ceph-mon[29033]: mgrmap e26: smithi082.mjhlse(active, since 99s), standbys: smithi033.swohxi 2024-02-15T22:42:21.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:20 smithi033 ceph-mon[29033]: pgmap v53: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 369 op/s 2024-02-15T22:42:21.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:20 smithi082 ceph-mon[37153]: mgrmap e26: smithi082.mjhlse(active, since 99s), standbys: smithi033.swohxi 2024-02-15T22:42:21.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:20 smithi082 ceph-mon[37153]: pgmap v53: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 369 op/s 2024-02-15T22:42:23.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:23 smithi033 ceph-mon[29033]: pgmap v54: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 598 op/s 2024-02-15T22:42:23.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:23 smithi082 ceph-mon[37153]: pgmap v54: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 598 op/s 2024-02-15T22:42:25.269 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-15T22:42:25.269 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-15T22:42:25.481 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:25 smithi082 ceph-mon[37153]: pgmap v55: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 450 op/s 2024-02-15T22:42:25.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:25 smithi033 ceph-mon[29033]: pgmap v55: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 450 op/s 2024-02-15T22:42:25.742 DEBUG:teuthology.parallel:result is None 2024-02-15T22:42:26.612 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:26 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:26.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:26 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:27.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:27 smithi082 ceph-mon[37153]: pgmap v56: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 450 op/s 2024-02-15T22:42:27.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:27 smithi033 ceph-mon[29033]: pgmap v56: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 450 op/s 2024-02-15T22:42:29.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:28 smithi033 ceph-mon[29033]: pgmap v57: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 598 op/s 2024-02-15T22:42:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:28 smithi082 ceph-mon[37153]: pgmap v57: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 598 op/s 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 -- 172.21.15.33:0/4092369393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fcef0 msgr2=0x7f87940fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 --2- 172.21.15.33:0/4092369393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fcef0 0x7f87940fd320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8784004940 tx=0x7f8784009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 -- 172.21.15.33:0/4092369393 shutdown_connections 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 --2- 172.21.15.33:0/4092369393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87940fe0e0 0x7f87940fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 --2- 172.21.15.33:0/4092369393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fcef0 0x7f87940fd320 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 -- 172.21.15.33:0/4092369393 >> 172.21.15.33:0/4092369393 conn(0x7f87940f8620 msgr2=0x7f87940faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 -- 172.21.15.33:0/4092369393 shutdown_connections 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.840+0000 7f879a1c6700 1 -- 172.21.15.33:0/4092369393 wait complete. 2024-02-15T22:42:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f879a1c6700 1 Processor -- start 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f879a1c6700 1 -- start start 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f879a1c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87940fcef0 0x7f879410d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f879a1c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fe0e0 0x7f879410de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f879a1c6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879410e420 con 0x7f87940fe0e0 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f879a1c6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879410ecc0 con 0x7f87940fcef0 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f878bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fe0e0 0x7f879410de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f878bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fe0e0 0x7f879410de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44422/0 (socket says 172.21.15.33:44422) 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f878bfff700 1 -- 172.21.15.33:0/1442236475 learned_addr learned my addr 172.21.15.33:0/1442236475 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.841+0000 7f87937fe700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87940fcef0 0x7f879410d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:31.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f878bfff700 1 -- 172.21.15.33:0/1442236475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87940fcef0 msgr2=0x7f879410d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f878bfff700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87940fcef0 0x7f879410d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f878bfff700 1 -- 172.21.15.33:0/1442236475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784005040 con 0x7f87940fe0e0 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f878bfff700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fe0e0 0x7f879410de20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f877c00eb40 tx=0x7f877c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f877c007cc0 con 0x7f87940fe0e0 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f877c00f040 con 0x7f87940fe0e0 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879410ef40 con 0x7f87940fe0e0 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.842+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f877c00ca10 con 0x7f87940fe0e0 2024-02-15T22:42:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.843+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879410f430 con 0x7f87940fe0e0 2024-02-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.843+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 27) v1 ==== 45455+0+0 (secure 0 0 0) 0x7f877c00cc80 con 0x7f87940fe0e0 2024-02-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.844+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f877c04b940 con 0x7f87940fe0e0 2024-02-15T22:42:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.844+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879404bed0 con 0x7f87940fe0e0 2024-02-15T22:42:31.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.853+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f877c04b020 con 0x7f87940fe0e0 2024-02-15T22:42:31.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: pgmap v58: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 377 op/s 2024-02-15T22:42:31.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:31.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:31.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:31.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:42:31.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr fail", "who": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr fail", "who": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd='[{"prefix": "mgr fail", "who": "smithi082.mjhlse"}]': finished 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: mgrmap e27: smithi033.swohxi(active, starting, since 0.00618336s) 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:42:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:42:31.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:42:31.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:42:31.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:42:31.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:42:31.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:42:31.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:42:31.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:42:31.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:42:31.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:31.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:31.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:42:31.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:42:31.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.903+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 28) v1 ==== 45876+0+0 (secure 0 0 0) 0x7f877c014ae0 con 0x7f87940fe0e0 2024-02-15T22:42:31.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.903+0000 7f8790ff9700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f878003db00 0x7f878003fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:31.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.912+0000 7f87937fe700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f878003db00 0x7f878003fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:31.914+0000 7f87937fe700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f878003db00 0x7f878003fee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8784000c00 tx=0x7f8784009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:32.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.165+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f879410f8d0 con 0x7f878003db00 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: pgmap v58: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 377 op/s 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 172.21.15.82:0/4190226813' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr fail", "who": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "mgr fail", "who": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:42:32.168 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.24381 ' entity='mgr.smithi082.mjhlse' cmd='[{"prefix": "mgr fail", "who": "smithi082.mjhlse"}]': finished 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: mgrmap e27: smithi033.swohxi(active, starting, since 0.00618336s) 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:42:32.169 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:42:32.170 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:42:32.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.167+0000 7f8790ff9700 1 -- 172.21.15.33:0/1442236475 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f879410f8d0 con 0x7f878003db00 2024-02-15T22:42:32.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.171+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f878003db00 msgr2=0x7f878003fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.171+0000 7f879a1c6700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f878003db00 0x7f878003fee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8784000c00 tx=0x7f8784009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:32.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.171+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fe0e0 msgr2=0x7f879410de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.171+0000 7f879a1c6700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fe0e0 0x7f879410de20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f877c00eb40 tx=0x7f877c00b040 comp rx=0 tx=0).stop 2024-02-15T22:42:32.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.172+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 shutdown_connections 2024-02-15T22:42:32.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.172+0000 7f879a1c6700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f878003db00 0x7f878003fee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.172+0000 7f879a1c6700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87940fcef0 0x7f879410d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.172+0000 7f879a1c6700 1 --2- 172.21.15.33:0/1442236475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87940fe0e0 0x7f879410de20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.172+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 >> 172.21.15.33:0/1442236475 conn(0x7f87940f8620 msgr2=0x7f87941013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.173+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 shutdown_connections 2024-02-15T22:42:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.173+0000 7f879a1c6700 1 -- 172.21.15.33:0/1442236475 wait complete. 2024-02-15T22:42:32.189 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:42:32.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 -- 172.21.15.33:0/3966228058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 msgr2=0x7f4194102530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 --2- 172.21.15.33:0/3966228058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 0x7f4194102530 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4188004940 tx=0x7f4188009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 -- 172.21.15.33:0/3966228058 shutdown_connections 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 --2- 172.21.15.33:0/3966228058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 0x7f4194102530 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 --2- 172.21.15.33:0/3966228058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 0x7f41940ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 -- 172.21.15.33:0/3966228058 >> 172.21.15.33:0/3966228058 conn(0x7f41940f7510 msgr2=0x7f41940f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 -- 172.21.15.33:0/3966228058 shutdown_connections 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 -- 172.21.15.33:0/3966228058 wait complete. 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.309+0000 7f419a7e8700 1 Processor -- start 2024-02-15T22:42:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f419a7e8700 1 -- start start 2024-02-15T22:42:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f419a7e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 0x7f41940fd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f419a7e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 0x7f41940fba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f419a7e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940fc000 con 0x7f41941000d0 2024-02-15T22:42:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f419a7e8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940fc170 con 0x7f4194066c70 2024-02-15T22:42:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f41937fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 0x7f41940fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f4193fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 0x7f41940fd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f4193fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 0x7f41940fd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:48878/0 (socket says 172.21.15.33:48878) 2024-02-15T22:42:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f4193fff700 1 -- 172.21.15.33:0/1281633423 learned_addr learned my addr 172.21.15.33:0/1281633423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f4193fff700 1 -- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 msgr2=0x7f41940fba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f4193fff700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 0x7f41940fba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f4193fff700 1 -- 172.21.15.33:0/1281633423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4188005040 con 0x7f4194066c70 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.310+0000 7f4193fff700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 0x7f41940fd580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f418400eb40 tx=0x7f418400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.311+0000 7f4190ff9700 1 -- 172.21.15.33:0/1281633423 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4184007cc0 con 0x7f4194066c70 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.311+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41940fc3f0 con 0x7f4194066c70 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.311+0000 7f4190ff9700 1 -- 172.21.15.33:0/1281633423 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f418400f040 con 0x7f4194066c70 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.311+0000 7f4190ff9700 1 -- 172.21.15.33:0/1281633423 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f418400ca10 con 0x7f4194066c70 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.311+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4194115950 con 0x7f4194066c70 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.312+0000 7f4190ff9700 1 -- 172.21.15.33:0/1281633423 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 28) v1 ==== 45876+0+0 (secure 0 0 0) 0x7f418400cc80 con 0x7f4194066c70 2024-02-15T22:42:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.312+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4194107a60 con 0x7f4194066c70 2024-02-15T22:42:32.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.312+0000 7f4190ff9700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f417c0389e0 0x7f417c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:32.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.312+0000 7f4190ff9700 1 -- 172.21.15.33:0/1281633423 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f418404c1f0 con 0x7f4194066c70 2024-02-15T22:42:32.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.312+0000 7f41937fe700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f417c0389e0 0x7f417c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:32.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.313+0000 7f41937fe700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f417c0389e0 0x7f417c03ae90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4188000c00 tx=0x7f4188009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.318+0000 7f4190ff9700 1 -- 172.21.15.33:0/1281633423 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4184012db0 con 0x7f4194066c70 2024-02-15T22:42:32.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.549+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f419402b410 con 0x7f417c0389e0 2024-02-15T22:42:32.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.550+0000 7f4190ff9700 1 -- 172.21.15.33:0/1281633423 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f419402b410 con 0x7f417c0389e0 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.552+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f417c0389e0 msgr2=0x7f417c03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.552+0000 7f419a7e8700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f417c0389e0 0x7f417c03ae90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4188000c00 tx=0x7f4188009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.552+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 msgr2=0x7f41940fd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.552+0000 7f419a7e8700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 0x7f41940fd580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f418400eb40 tx=0x7f418400b040 comp rx=0 tx=0).stop 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.553+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 shutdown_connections 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.553+0000 7f419a7e8700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f417c0389e0 0x7f417c03ae90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.553+0000 7f419a7e8700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4194066c70 0x7f41940fd580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.553+0000 7f419a7e8700 1 --2- 172.21.15.33:0/1281633423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41941000d0 0x7f41940fba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.553+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 >> 172.21.15.33:0/1281633423 conn(0x7f41940f7510 msgr2=0x7f41940f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:32.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.553+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 shutdown_connections 2024-02-15T22:42:32.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.553+0000 7f419a7e8700 1 -- 172.21.15.33:0/1281633423 wait complete. 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 -- 172.21.15.33:0/1152160363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fbe40 msgr2=0x7fa6e00fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/1152160363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fbe40 0x7fa6e00fc250 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4004940 tx=0x7fa6d4009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 -- 172.21.15.33:0/1152160363 shutdown_connections 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/1152160363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e00fcfb0 0x7fa6e00fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/1152160363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fbe40 0x7fa6e00fc250 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 -- 172.21.15.33:0/1152160363 >> 172.21.15.33:0/1152160363 conn(0x7fa6e00f74e0 msgr2=0x7fa6e00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 -- 172.21.15.33:0/1152160363 shutdown_connections 2024-02-15T22:42:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 -- 172.21.15.33:0/1152160363 wait complete. 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 Processor -- start 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.680+0000 7fa6e6d80700 1 -- start start 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6e6d80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e00fbe40 0x7fa6e01105f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6e6d80700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fcfb0 0x7fa6e0112b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6e6d80700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0066460 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6e6d80700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00665a0 con 0x7fa6e00fbe40 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fcfb0 0x7fa6e0112b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6e4b1c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e00fbe40 0x7fa6e01105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fcfb0 0x7fa6e0112b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44458/0 (socket says 172.21.15.33:44458) 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6dffff700 1 -- 172.21.15.33:0/2561026177 learned_addr learned my addr 172.21.15.33:0/2561026177 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6dffff700 1 -- 172.21.15.33:0/2561026177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e00fbe40 msgr2=0x7fa6e01105f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6dffff700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e00fbe40 0x7fa6e01105f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6dffff700 1 -- 172.21.15.33:0/2561026177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4005040 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.681+0000 7fa6e4b1c700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e00fbe40 0x7fa6e01105f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.682+0000 7fa6dffff700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fcfb0 0x7fa6e0112b40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00eb40 tx=0x7fa6cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.682+0000 7fa6dd7fa700 1 -- 172.21.15.33:0/2561026177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc007cc0 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.682+0000 7fa6dd7fa700 1 -- 172.21.15.33:0/2561026177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6cc00f040 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.682+0000 7fa6dd7fa700 1 -- 172.21.15.33:0/2561026177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc00ca10 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.682+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e0113140 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.682+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e0113630 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.683+0000 7fa6dd7fa700 1 -- 172.21.15.33:0/2561026177 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 28) v1 ==== 45876+0+0 (secure 0 0 0) 0x7fa6cc00cc80 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.683+0000 7fa6dd7fa700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa6d00389d0 0x7fa6d003ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:32.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.683+0000 7fa6dd7fa700 1 -- 172.21.15.33:0/2561026177 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa6cc04c160 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.683+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e004bed0 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.683+0000 7fa6e4b1c700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa6d00389d0 0x7fa6d003ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:32.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.684+0000 7fa6e4b1c700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa6d00389d0 0x7fa6d003ae80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4013740 tx=0x7fa6d4009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:32.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.691+0000 7fa6dd7fa700 1 -- 172.21.15.33:0/2561026177 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa6cc012bd0 con 0x7fa6e00fcfb0 2024-02-15T22:42:32.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.936+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6e0101990 con 0x7fa6d00389d0 2024-02-15T22:42:32.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.948+0000 7fa6dd7fa700 1 -- 172.21.15.33:0/2561026177 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa6e0101990 con 0x7fa6d00389d0 2024-02-15T22:42:32.949 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:42:32.949 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (79s) 15s ago 9m 19.1M - 0.25.0 c8568f914cd2 c14c4db45752 2024-02-15T22:42:32.949 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (10m) 15s ago 10m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:42:32.949 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (8m) 19s ago 8m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:42:32.949 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (37s) 15s ago 9m 75.6M - 9.4.7 954c08fa6188 7446707d8c9f 2024-02-15T22:42:32.949 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (4m) 15s ago 4m 141M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (4m) 15s ago 4m 78.7M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (4m) 19s ago 4m 167M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (3m) 19s ago 3m 102M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (23s) 15s ago 11m 92.7M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283 running (2m) 19s ago 8m 501M - 19.0.0-1450-gf78a58c0 f081f847070a 0cbd0d048cce 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (11m) 15s ago 11m 52.9M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (8m) 19s ago 8m 37.2M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (85s) 15s ago 9m 17.2M - 1.5.0 0da6a335fe13 d91c8cd4ae6c 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (28s) 19s ago 8m 7986k - 1.5.0 0da6a335fe13 d3ddc885f88c 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 15s ago 7m 203M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:42:32.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (7m) 15s ago 7m 216M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:42:32.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (6m) 15s ago 6m 180M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:42:32.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (6m) 19s ago 6m 248M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:42:32.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (6m) 19s ago 6m 216M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:42:32.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (5m) 19s ago 5m 215M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:42:32.951 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (31s) 15s ago 9m 38.9M - 2.43.0 a07b618ecd1d bb494431a217 2024-02-15T22:42:32.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.950+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa6d00389d0 msgr2=0x7fa6d003ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.950+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa6d00389d0 0x7fa6d003ae80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4013740 tx=0x7fa6d4009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.950+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fcfb0 msgr2=0x7fa6e0112b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.950+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fcfb0 0x7fa6e0112b40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00eb40 tx=0x7fa6cc00b040 comp rx=0 tx=0).stop 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.951+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 shutdown_connections 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.951+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa6d00389d0 0x7fa6d003ae80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.951+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e00fbe40 0x7fa6e01105f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.951+0000 7fa6e6d80700 1 --2- 172.21.15.33:0/2561026177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6e00fcfb0 0x7fa6e0112b40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.951+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 >> 172.21.15.33:0/2561026177 conn(0x7fa6e00f74e0 msgr2=0x7fa6e0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.951+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 shutdown_connections 2024-02-15T22:42:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:32.951+0000 7fa6e6d80700 1 -- 172.21.15.33:0/2561026177 wait complete. 2024-02-15T22:42:32.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:32 smithi082 ceph-mon[37153]: [15/Feb/2024:22:42:31] ENGINE Bus STARTING 2024-02-15T22:42:32.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:32 smithi082 ceph-mon[37153]: [15/Feb/2024:22:42:31] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:42:32.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:32 smithi082 ceph-mon[37153]: [15/Feb/2024:22:42:31] ENGINE Serving on http://172.21.15.33:8765 2024-02-15T22:42:32.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:32 smithi082 ceph-mon[37153]: [15/Feb/2024:22:42:31] ENGINE Bus STARTED 2024-02-15T22:42:32.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:32 smithi082 ceph-mon[37153]: mgrmap e28: smithi033.swohxi(active, since 1.01178s) 2024-02-15T22:42:32.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:32 smithi082 ceph-mon[37153]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:32.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:32 smithi082 ceph-mon[37153]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:33.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1545124090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 msgr2=0x7fcdf40fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:33.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1545124090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf40fc250 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcde8004940 tx=0x7fcde8009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:33.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1545124090 shutdown_connections 2024-02-15T22:42:33.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1545124090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf40fcfb0 0x7fcdf40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1545124090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf40fc250 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1545124090 >> 172.21.15.33:0/1545124090 conn(0x7fcdf40f74e0 msgr2=0x7fcdf40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:33.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1545124090 shutdown_connections 2024-02-15T22:42:33.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.074+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1545124090 wait complete. 2024-02-15T22:42:33.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdfb0a3700 1 Processor -- start 2024-02-15T22:42:33.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdfb0a3700 1 -- start start 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdfb0a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf41105f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdfb0a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf40fcfb0 0x7fcdf4112b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdfb0a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4066460 con 0x7fcdf40fbe40 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdfb0a3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40665a0 con 0x7fcdf40fcfb0 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdf8e3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf41105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdf8e3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf41105f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44500/0 (socket says 172.21.15.33:44500) 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.075+0000 7fcdf8e3f700 1 -- 172.21.15.33:0/1120294303 learned_addr learned my addr 172.21.15.33:0/1120294303 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdf8e3f700 1 -- 172.21.15.33:0/1120294303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf40fcfb0 msgr2=0x7fcdf4112b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdf8e3f700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf40fcfb0 0x7fcdf4112b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdf8e3f700 1 -- 172.21.15.33:0/1120294303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8005040 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdf8e3f700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf41105f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcde8000c00 tx=0x7fcde8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdf17fa700 1 -- 172.21.15.33:0/1120294303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcde8021070 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf41130e0 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdf17fa700 1 -- 172.21.15.33:0/1120294303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcde801c400 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf4113620 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.076+0000 7fcdf17fa700 1 -- 172.21.15.33:0/1120294303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcde800e070 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.077+0000 7fcdf17fa700 1 -- 172.21.15.33:0/1120294303 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 28) v1 ==== 45876+0+0 (secure 0 0 0) 0x7fcde800b780 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.077+0000 7fcdf17fa700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcde40389e0 0x7fcde403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.077+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf404bed0 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.077+0000 7fcdf17fa700 1 -- 172.21.15.33:0/1120294303 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fcde804d7a0 con 0x7fcdf40fbe40 2024-02-15T22:42:33.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.077+0000 7fcdf3fff700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcde40389e0 0x7fcde403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:33.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.078+0000 7fcdf3fff700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcde40389e0 0x7fcde403ae90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009fd0 tx=0x7fcde000b040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:33.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.083+0000 7fcdf17fa700 1 -- 172.21.15.33:0/1120294303 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcde8024310 con 0x7fcdf40fbe40 2024-02-15T22:42:33.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:32 smithi033 ceph-mon[29033]: [15/Feb/2024:22:42:31] ENGINE Bus STARTING 2024-02-15T22:42:33.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:32 smithi033 ceph-mon[29033]: [15/Feb/2024:22:42:31] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:42:33.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:32 smithi033 ceph-mon[29033]: [15/Feb/2024:22:42:31] ENGINE Serving on http://172.21.15.33:8765 2024-02-15T22:42:33.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:32 smithi033 ceph-mon[29033]: [15/Feb/2024:22:42:31] ENGINE Bus STARTED 2024-02-15T22:42:33.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:32 smithi033 ceph-mon[29033]: mgrmap e28: smithi033.swohxi(active, since 1.01178s) 2024-02-15T22:42:33.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:32 smithi033 ceph-mon[29033]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:33.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:32 smithi033 ceph-mon[29033]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.463+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcdf4113c10 con 0x7fcdf40fbe40 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.464+0000 7fcdf17fa700 1 -- 172.21.15.33:0/1120294303 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fcde8011c00 con 0x7fcdf40fbe40 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 12, 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:42:33.466 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcde40389e0 msgr2=0x7fcde403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcde40389e0 0x7fcde403ae90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009fd0 tx=0x7fcde000b040 comp rx=0 tx=0).stop 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 msgr2=0x7fcdf41105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf41105f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcde8000c00 tx=0x7fcde8009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 shutdown_connections 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcde40389e0 0x7fcde403ae90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf40fbe40 0x7fcdf41105f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 --2- 172.21.15.33:0/1120294303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf40fcfb0 0x7fcdf4112b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 >> 172.21.15.33:0/1120294303 conn(0x7fcdf40f74e0 msgr2=0x7fcdf4100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:33.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 shutdown_connections 2024-02-15T22:42:33.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.467+0000 7fcdfb0a3700 1 -- 172.21.15.33:0/1120294303 wait complete. 2024-02-15T22:42:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 -- 172.21.15.33:0/1652091029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 msgr2=0x7fbaac0fc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1652091029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac0fc610 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0004940 tx=0x7fbaa0009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 -- 172.21.15.33:0/1652091029 shutdown_connections 2024-02-15T22:42:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1652091029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac0fc610 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1652091029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd460 0x7fbaac0fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 -- 172.21.15.33:0/1652091029 >> 172.21.15.33:0/1652091029 conn(0x7fbaac0f6ca0 msgr2=0x7fbaac0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 -- 172.21.15.33:0/1652091029 shutdown_connections 2024-02-15T22:42:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.584+0000 7fbab18f5700 1 -- 172.21.15.33:0/1652091029 wait complete. 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbab18f5700 1 Processor -- start 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbab18f5700 1 -- start start 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbab18f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac110780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbab18f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd460 0x7fbaac112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbab18f5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0fbe50 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbab18f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0fbf90 con 0x7fbaac0fd460 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbaaaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac110780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbaaaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac110780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44508/0 (socket says 172.21.15.33:44508) 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbaaaffd700 1 -- 172.21.15.33:0/1470155435 learned_addr learned my addr 172.21.15.33:0/1470155435 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.585+0000 7fbaaa7fc700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd460 0x7fbaac112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fbaaaffd700 1 -- 172.21.15.33:0/1470155435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd460 msgr2=0x7fbaac112cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fbaaaffd700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd460 0x7fbaac112cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fbaaaffd700 1 -- 172.21.15.33:0/1470155435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0005040 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fbaaaffd700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac110780 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00eb40 tx=0x7fba9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fba937fe700 1 -- 172.21.15.33:0/1470155435 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9c007cc0 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac1132d0 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fba937fe700 1 -- 172.21.15.33:0/1470155435 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba9c00f040 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac113810 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.586+0000 7fba937fe700 1 -- 172.21.15.33:0/1470155435 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9c00caa0 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.587+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba980052e0 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.587+0000 7fba937fe700 1 -- 172.21.15.33:0/1470155435 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 28) v1 ==== 45876+0+0 (secure 0 0 0) 0x7fba9c00cc00 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.588+0000 7fba937fe700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fba940389e0 0x7fba9403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:33.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.588+0000 7fba937fe700 1 -- 172.21.15.33:0/1470155435 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fba9c04c030 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.588+0000 7fbaaa7fc700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fba940389e0 0x7fba9403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:33.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.588+0000 7fbaaa7fc700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fba940389e0 0x7fba9403ae90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000b0d0 tx=0x7fbaa0009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:33.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.593+0000 7fba937fe700 1 -- 172.21.15.33:0/1470155435 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fba9c012910 con 0x7fbaac0fc1c0 2024-02-15T22:42:33.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.839+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba98000bf0 con 0x7fba940389e0 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.840+0000 7fba937fe700 1 -- 172.21.15.33:0/1470155435 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fba98000bf0 con 0x7fba940389e0 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:42:33.841 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:42:33.842 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T22:42:33.842 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:42:33.842 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:42:33.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fba940389e0 msgr2=0x7fba9403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:33.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fba940389e0 0x7fba9403ae90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000b0d0 tx=0x7fbaa0009e30 comp rx=0 tx=0).stop 2024-02-15T22:42:33.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 msgr2=0x7fbaac110780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:33.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac110780 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00eb40 tx=0x7fba9c00b040 comp rx=0 tx=0).stop 2024-02-15T22:42:33.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 shutdown_connections 2024-02-15T22:42:33.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fba940389e0 0x7fba9403ae90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaac0fc1c0 0x7fbaac110780 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 --2- 172.21.15.33:0/1470155435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd460 0x7fbaac112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:33.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 >> 172.21.15.33:0/1470155435 conn(0x7fbaac0f6ca0 msgr2=0x7fbaac100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:33.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 shutdown_connections 2024-02-15T22:42:33.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:42:33.843+0000 7fbab18f5700 1 -- 172.21.15.33:0/1470155435 wait complete. 2024-02-15T22:42:34.192 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:33 smithi082 ceph-mon[37153]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:34.192 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:33 smithi082 ceph-mon[37153]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:34.192 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:33 smithi082 ceph-mon[37153]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:34.193 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:33 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1120294303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:42:34.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:33 smithi033 ceph-mon[29033]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:34.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:33 smithi033 ceph-mon[29033]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:34.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:33 smithi033 ceph-mon[29033]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:34.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:33 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1120294303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:42:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:34 smithi033 ceph-mon[29033]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:34 smithi033 ceph-mon[29033]: mgrmap e29: smithi033.swohxi(active, since 3s) 2024-02-15T22:42:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:34 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:35.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:34 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:35.285 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:34 smithi082 ceph-mon[37153]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:35.285 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:34 smithi082 ceph-mon[37153]: mgrmap e29: smithi033.swohxi(active, since 3s) 2024-02-15T22:42:35.285 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:34 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:35.285 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:34 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:35.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:35 smithi082 ceph-mon[37153]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:35.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:35 smithi033 ceph-mon[29033]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:37.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:37 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:37.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:37 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:37.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:37 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:37.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:37 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:38.354 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:38 smithi033 ceph-mon[29033]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:38.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:38 smithi082 ceph-mon[37153]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:42:39.494 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-15T22:42:39.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-15T22:42:39.762 DEBUG:teuthology.parallel:result is None 2024-02-15T22:42:39.763 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T22:42:39.798 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T22:42:39.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T22:42:39.839 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T22:42:39.839 DEBUG:teuthology.parallel:result is None 2024-02-15T22:42:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:40 smithi082 ceph-mon[37153]: pgmap v7: 65 pgs: 65 active+clean; 309 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 761 KiB/s rd, 904 KiB/s wr, 231 op/s 2024-02-15T22:42:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:40 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:42:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:40 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:42:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:40 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:42:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:40 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:42:40.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:40 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:42:40.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:40 smithi033 ceph-mon[29033]: pgmap v7: 65 pgs: 65 active+clean; 309 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 761 KiB/s rd, 904 KiB/s wr, 231 op/s 2024-02-15T22:42:40.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:40 smithi033 ceph-mon[29033]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:42:40.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:40 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:42:40.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:40 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:42:40.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:40 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:42:40.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:40 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/1788177459' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:42:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:41 smithi082 ceph-mon[37153]: mgrmap e30: smithi033.swohxi(active, since 9s), standbys: smithi082.mjhlse 2024-02-15T22:42:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:41 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:42:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:41 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:41.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:41 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:41 smithi033 ceph-mon[29033]: mgrmap e30: smithi033.swohxi(active, since 9s), standbys: smithi082.mjhlse 2024-02-15T22:42:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:41 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:42:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:41 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:41.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:41 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:42.280 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:42 smithi033 ceph-mon[29033]: pgmap v8: 65 pgs: 65 active+clean; 309 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 592 KiB/s rd, 703 KiB/s wr, 180 op/s 2024-02-15T22:42:42.281 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:42.281 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:42 smithi082 ceph-mon[37153]: pgmap v8: 65 pgs: 65 active+clean; 309 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 592 KiB/s rd, 703 KiB/s wr, 180 op/s 2024-02-15T22:42:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:44.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:44 smithi033 ceph-mon[29033]: pgmap v9: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 950 KiB/s rd, 934 KiB/s wr, 250 op/s 2024-02-15T22:42:44.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:44 smithi082 ceph-mon[37153]: pgmap v9: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 950 KiB/s rd, 934 KiB/s wr, 250 op/s 2024-02-15T22:42:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:46 smithi033 ceph-mon[29033]: pgmap v10: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 869 KiB/s rd, 855 KiB/s wr, 229 op/s 2024-02-15T22:42:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:46 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:46 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:46 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:46 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:42:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:46 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:46.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:46 smithi082 ceph-mon[37153]: pgmap v10: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 869 KiB/s rd, 855 KiB/s wr, 229 op/s 2024-02-15T22:42:46.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:46 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:46.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:46 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:46.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:46 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:46.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:46 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:42:46.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:46 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:42:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:47 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:42:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:42:47.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:47.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:47 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:48.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:48 smithi082 ceph-mon[37153]: Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T22:42:48.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:48 smithi082 ceph-mon[37153]: Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T22:42:48.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:48 smithi082 ceph-mon[37153]: pgmap v11: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 869 KiB/s rd, 855 KiB/s wr, 229 op/s 2024-02-15T22:42:48.662 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:48 smithi033 ceph-mon[29033]: Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T22:42:48.662 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:48 smithi033 ceph-mon[29033]: Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T22:42:48.662 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:48 smithi033 ceph-mon[29033]: pgmap v11: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 869 KiB/s rd, 855 KiB/s wr, 229 op/s 2024-02-15T22:42:50.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:50 smithi082 ceph-mon[37153]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 875 KiB/s rd, 860 KiB/s wr, 233 op/s 2024-02-15T22:42:50.718 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:50 smithi033 ceph-mon[29033]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 875 KiB/s rd, 860 KiB/s wr, 233 op/s 2024-02-15T22:42:52.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:52 smithi082 ceph-mon[37153]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 432 KiB/s rd, 334 KiB/s wr, 98 op/s 2024-02-15T22:42:52.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:52 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:52.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:52 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:52.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:52 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:52.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:52 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:52.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:52 smithi033 ceph-mon[29033]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 432 KiB/s rd, 334 KiB/s wr, 98 op/s 2024-02-15T22:42:52.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:52 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:52.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:52 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:52.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:52 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:52.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:52 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:53.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:53 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:53.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:53 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:42:54.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:54 smithi082 ceph-mon[37153]: pgmap v14: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 433 KiB/s rd, 334 KiB/s wr, 101 op/s 2024-02-15T22:42:54.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:54 smithi082 ceph-mon[37153]: Upgrade: Updating mgr.smithi082.mjhlse 2024-02-15T22:42:54.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:54 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:42:54.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:54 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:42:54.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:54 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:54.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:54 smithi082 ceph-mon[37153]: Deploying daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:42:54.762 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:54 smithi033 ceph-mon[29033]: pgmap v14: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 433 KiB/s rd, 334 KiB/s wr, 101 op/s 2024-02-15T22:42:54.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:54 smithi033 ceph-mon[29033]: Upgrade: Updating mgr.smithi082.mjhlse 2024-02-15T22:42:54.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:54 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:42:54.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:54 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:42:54.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:54 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:54.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:54 smithi033 ceph-mon[29033]: Deploying daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:42:55.577 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:55 smithi082 ceph-mon[37153]: pgmap v15: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-02-15T22:42:55.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:55 smithi033 ceph-mon[29033]: pgmap v15: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-02-15T22:42:58.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:58 smithi033 ceph-mon[29033]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-02-15T22:42:58.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:58 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:58.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:58 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:58.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:42:58 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:58.360 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:58 smithi082 ceph-mon[37153]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-02-15T22:42:58.360 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:58 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:58.360 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:58 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:42:58.360 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:42:58 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:00.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:00 smithi033 ceph-mon[29033]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-02-15T22:43:00.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:00 smithi082 ceph-mon[37153]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-02-15T22:43:01.429 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:01 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:01.429 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:01 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:01.429 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:01 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:01.607 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:01 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:01.607 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:01 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:01.607 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:01 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:02.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:02 smithi082 ceph-mon[37153]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:43:02.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:02 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:02.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:02 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:02.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:02 smithi033 ceph-mon[29033]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:43:02.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:02 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:02.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:02 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:03 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:03 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:03.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:03 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:03.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:03 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:03.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- 172.21.15.33:0/2004630657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fb2c0 msgr2=0x7f42cc0fb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:03.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 --2- 172.21.15.33:0/2004630657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fb2c0 0x7f42cc0fb6d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f42c8004940 tx=0x7f42c8009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- 172.21.15.33:0/2004630657 shutdown_connections 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 --2- 172.21.15.33:0/2004630657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42cc0fbca0 0x7f42cc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 --2- 172.21.15.33:0/2004630657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fb2c0 0x7f42cc0fb6d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- 172.21.15.33:0/2004630657 >> 172.21.15.33:0/2004630657 conn(0x7f42cc0f6ca0 msgr2=0x7f42cc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- 172.21.15.33:0/2004630657 shutdown_connections 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- 172.21.15.33:0/2004630657 wait complete. 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 Processor -- start 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- start start 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42cc0fb2c0 0x7f42cc0fddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fc2a0 0x7f42cc0fc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0fcc50 con 0x7f42cc0fc2a0 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.964+0000 7f42d41f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0fcd90 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1793700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fc2a0 0x7f42cc0fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:03.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1793700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fc2a0 0x7f42cc0fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32866/0 (socket says 172.21.15.33:32866) 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1793700 1 -- 172.21.15.33:0/4194713091 learned_addr learned my addr 172.21.15.33:0/4194713091 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1f94700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42cc0fb2c0 0x7f42cc0fddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1f94700 1 -- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fc2a0 msgr2=0x7f42cc0fc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1f94700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fc2a0 0x7f42cc0fc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1f94700 1 -- 172.21.15.33:0/4194713091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8005040 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1793700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fc2a0 0x7f42cc0fc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d1f94700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42cc0fb2c0 0x7f42cc0fddd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42c8000c00 tx=0x7f42c8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42c27fc700 1 -- 172.21.15.33:0/4194713091 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c800e040 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc0fd010 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42c27fc700 1 -- 172.21.15.33:0/4194713091 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42c800bbf0 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc115f60 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.965+0000 7f42c27fc700 1 -- 172.21.15.33:0/4194713091 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c801c3f0 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.966+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42cc04bed0 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.967+0000 7f42c27fc700 1 -- 172.21.15.33:0/4194713091 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 30) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f42c800bd60 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.967+0000 7f42c27fc700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f42b806d200 0x7f42b806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:03.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.967+0000 7f42c27fc700 1 -- 172.21.15.33:0/4194713091 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f42c808d310 con 0x7f42cc0fb2c0 2024-02-15T22:43:03.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.967+0000 7f42d1793700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f42b806d200 0x7f42b806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:03.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.968+0000 7f42d1793700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f42b806d200 0x7f42b806f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0041d0 tx=0x7f42bc00b040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:03.972+0000 7f42c27fc700 1 -- 172.21.15.33:0/4194713091 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f42c8057280 con 0x7f42cc0fb2c0 2024-02-15T22:43:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.193+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42cc0fbca0 con 0x7f42b806d200 2024-02-15T22:43:04.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.194+0000 7f42c27fc700 1 -- 172.21.15.33:0/4194713091 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f42cc0fbca0 con 0x7f42b806d200 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f42b806d200 msgr2=0x7f42b806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f42b806d200 0x7f42b806f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0041d0 tx=0x7f42bc00b040 comp rx=0 tx=0).stop 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42cc0fb2c0 msgr2=0x7f42cc0fddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42cc0fb2c0 0x7f42cc0fddd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42c8000c00 tx=0x7f42c8009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 shutdown_connections 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f42b806d200 0x7f42b806f6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42cc0fb2c0 0x7f42cc0fddd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 --2- 172.21.15.33:0/4194713091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42cc0fc2a0 0x7f42cc0fc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.196+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 >> 172.21.15.33:0/4194713091 conn(0x7f42cc0f6ca0 msgr2=0x7f42cc101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.197+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 shutdown_connections 2024-02-15T22:43:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.197+0000 7f42d41f8700 1 -- 172.21.15.33:0/4194713091 wait complete. 2024-02-15T22:43:04.208 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 -- 172.21.15.33:0/2937944408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fb5e0 msgr2=0x7fb1dc0fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2937944408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0fb9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4004e00 tx=0x7fb1d400adb0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 -- 172.21.15.33:0/2937944408 shutdown_connections 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2937944408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fc7f0 0x7fb1dc0fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2937944408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0fb9f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 -- 172.21.15.33:0/2937944408 >> 172.21.15.33:0/2937944408 conn(0x7fb1dc0f6ca0 msgr2=0x7fb1dc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 -- 172.21.15.33:0/2937944408 shutdown_connections 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 -- 172.21.15.33:0/2937944408 wait complete. 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 Processor -- start 2024-02-15T22:43:04.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.305+0000 7fb1e4694700 1 -- start start 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e4694700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e4694700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fc7f0 0x7fb1dc0fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e4694700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0fe130 con 0x7fb1dc0fb5e0 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e4694700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0fe2a0 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e2430700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e2430700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32884/0 (socket says 172.21.15.33:32884) 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e2430700 1 -- 172.21.15.33:0/2046752887 learned_addr learned my addr 172.21.15.33:0/2046752887 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e1c2f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fc7f0 0x7fb1dc0fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e1c2f700 1 -- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fb5e0 msgr2=0x7fb1dc0ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e1c2f700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e1c2f700 1 -- 172.21.15.33:0/2046752887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4004a10 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e2430700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:43:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.306+0000 7fb1e1c2f700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fc7f0 0x7fb1dc0fdb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00c800 tx=0x7fb1cc004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.308+0000 7fb1d2ffd700 1 -- 172.21.15.33:0/2046752887 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc0106f0 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.308+0000 7fb1d2ffd700 1 -- 172.21.15.33:0/2046752887 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1cc010d20 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.308+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc0fe580 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.309+0000 7fb1d2ffd700 1 -- 172.21.15.33:0/2046752887 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc0113a0 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.309+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc1159e0 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.309+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc107890 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.310+0000 7fb1d2ffd700 1 -- 172.21.15.33:0/2046752887 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7fb1cc010850 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.310+0000 7fb1d2ffd700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb1c806d2c0 0x7fb1c806f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.310+0000 7fb1d2ffd700 1 -- 172.21.15.33:0/2046752887 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb1cc08c560 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.310+0000 7fb1e2430700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb1c806d2c0 0x7fb1c806f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.311+0000 7fb1e2430700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb1c806d2c0 0x7fb1c806f770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c740 tx=0x7fb1d400adb0 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:04.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.315+0000 7fb1d2ffd700 1 -- 172.21.15.33:0/2046752887 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb1cc05a120 con 0x7fb1dc0fc7f0 2024-02-15T22:43:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.536+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1dc02b3b0 con 0x7fb1c806d2c0 2024-02-15T22:43:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.537+0000 7fb1d2ffd700 1 -- 172.21.15.33:0/2046752887 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fb1dc02b3b0 con 0x7fb1c806d2c0 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb1c806d2c0 msgr2=0x7fb1c806f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb1c806d2c0 0x7fb1c806f770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c740 tx=0x7fb1d400adb0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fc7f0 msgr2=0x7fb1dc0fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fc7f0 0x7fb1dc0fdb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00c800 tx=0x7fb1cc004430 comp rx=0 tx=0).stop 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 shutdown_connections 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb1c806d2c0 0x7fb1c806f770 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1dc0fb5e0 0x7fb1dc0ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 --2- 172.21.15.33:0/2046752887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1dc0fc7f0 0x7fb1dc0fdb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 >> 172.21.15.33:0/2046752887 conn(0x7fb1dc0f6ca0 msgr2=0x7fb1dc0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 shutdown_connections 2024-02-15T22:43:04.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.539+0000 7fb1e4694700 1 -- 172.21.15.33:0/2046752887 wait complete. 2024-02-15T22:43:04.548 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:04 smithi082 ceph-mon[37153]: pgmap v19: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-02-15T22:43:04.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:04 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse restarted 2024-02-15T22:43:04.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:04 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:43:04.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:04 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:43:04.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:04 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:43:04.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:04 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:43:04.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:04 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:43:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.640+0000 7f4104747700 1 -- 172.21.15.33:0/74320249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fcfb0 msgr2=0x7f40fc0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.640+0000 7f4104747700 1 --2- 172.21.15.33:0/74320249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fcfb0 0x7f40fc0fd420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f40ec004940 tx=0x7f40ec009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.640+0000 7f4104747700 1 -- 172.21.15.33:0/74320249 shutdown_connections 2024-02-15T22:43:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 --2- 172.21.15.33:0/74320249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fcfb0 0x7f40fc0fd420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 --2- 172.21.15.33:0/74320249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40fc0fbe40 0x7f40fc0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 -- 172.21.15.33:0/74320249 >> 172.21.15.33:0/74320249 conn(0x7f40fc0f7520 msgr2=0x7f40fc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 -- 172.21.15.33:0/74320249 shutdown_connections 2024-02-15T22:43:04.643 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:04 smithi033 ceph-mon[29033]: pgmap v19: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-02-15T22:43:04.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:04 smithi033 ceph-mon[29033]: Standby manager daemon smithi082.mjhlse restarted 2024-02-15T22:43:04.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:04 smithi033 ceph-mon[29033]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:43:04.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:04 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:43:04.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:04 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:43:04.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:04 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:43:04.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:04 smithi033 ceph-mon[29033]: from='mgr.? 172.21.15.82:0/2486717838' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:43:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 -- 172.21.15.33:0/74320249 wait complete. 2024-02-15T22:43:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 Processor -- start 2024-02-15T22:43:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 -- start start 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fbe40 0x7f40fc0fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40fc0fcfb0 0x7f40fc0fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0fea10 con 0x7f40fc0fbe40 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f4104747700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0feb80 con 0x7f40fc0fcfb0 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f41024e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fbe40 0x7f40fc0fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f41024e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fbe40 0x7f40fc0fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32914/0 (socket says 172.21.15.33:32914) 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.641+0000 7f41024e3700 1 -- 172.21.15.33:0/2037123166 learned_addr learned my addr 172.21.15.33:0/2037123166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f4101ce2700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40fc0fcfb0 0x7f40fc0fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f41024e3700 1 -- 172.21.15.33:0/2037123166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40fc0fcfb0 msgr2=0x7f40fc0fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f41024e3700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40fc0fcfb0 0x7f40fc0fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f41024e3700 1 -- 172.21.15.33:0/2037123166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec005040 con 0x7f40fc0fbe40 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f41024e3700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fbe40 0x7f40fc0fff00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b790 tx=0x7f40f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f40f2ffd700 1 -- 172.21.15.33:0/2037123166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f800f6f0 con 0x7f40fc0fbe40 2024-02-15T22:43:04.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f40f2ffd700 1 -- 172.21.15.33:0/2037123166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40f800fd20 con 0x7f40fc0fbe40 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc0fee60 con 0x7f40fc0fbe40 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f40f2ffd700 1 -- 172.21.15.33:0/2037123166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f80103a0 con 0x7f40fc0fbe40 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.642+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc0ff1e0 con 0x7f40fc0fbe40 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.643+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc04bed0 con 0x7f40fc0fbe40 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.644+0000 7f40f2ffd700 1 -- 172.21.15.33:0/2037123166 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f40f8011400 con 0x7f40fc0fbe40 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.644+0000 7f40f2ffd700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f40e806d200 0x7f40e806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.644+0000 7f4101ce2700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f40e806d200 0x7f40e806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.644+0000 7f40f2ffd700 1 -- 172.21.15.33:0/2037123166 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f40f808c360 con 0x7f40fc0fbe40 2024-02-15T22:43:04.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.645+0000 7f4101ce2700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f40e806d200 0x7f40e806f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40ec004f90 tx=0x7f40ec009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:04.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.649+0000 7f40f2ffd700 1 -- 172.21.15.33:0/2037123166 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f40f8059fa0 con 0x7f40fc0fbe40 2024-02-15T22:43:04.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.858+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40fc066660 con 0x7f40e806d200 2024-02-15T22:43:04.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.869+0000 7f40f2ffd700 1 -- 172.21.15.33:0/2037123166 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f40fc066660 con 0x7f40e806d200 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (111s) 2s ago 10m 26.9M - 0.25.0 c8568f914cd2 c14c4db45752 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (10m) 2s ago 10m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (9m) 4s ago 9m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (69s) 2s ago 9m 76.1M - 9.4.7 954c08fa6188 7446707d8c9f 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (4m) 2s ago 4m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (4m) 2s ago 4m 75.1M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (4m) 4s ago 4m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (4m) 4s ago 4m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (54s) 2s ago 11m 491M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:43:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (8s) 4s ago 9m 65.6M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (11m) 2s ago 11m 56.7M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (9m) 4s ago 9m 40.7M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (117s) 2s ago 10m 16.9M - 1.5.0 0da6a335fe13 d91c8cd4ae6c 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (60s) 4s ago 9m 10.0M - 1.5.0 0da6a335fe13 d3ddc885f88c 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (8m) 2s ago 8m 211M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (7m) 2s ago 7m 229M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 2s ago 7m 195M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (7m) 4s ago 7m 261M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (6m) 4s ago 6m 230M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (6m) 4s ago 6m 223M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:43:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (13s) 2s ago 9m 40.0M - 2.43.0 a07b618ecd1d 86c99e28bbec 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f40e806d200 msgr2=0x7f40e806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f40e806d200 0x7f40e806f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40ec004f90 tx=0x7f40ec009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fbe40 msgr2=0x7f40fc0fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fbe40 0x7f40fc0fff00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b790 tx=0x7f40f8009250 comp rx=0 tx=0).stop 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 shutdown_connections 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f40e806d200 0x7f40e806f6b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40fc0fbe40 0x7f40fc0fff00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 --2- 172.21.15.33:0/2037123166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40fc0fcfb0 0x7f40fc0fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 >> 172.21.15.33:0/2037123166 conn(0x7f40fc0f7520 msgr2=0x7f40fc065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 shutdown_connections 2024-02-15T22:43:04.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.871+0000 7f4104747700 1 -- 172.21.15.33:0/2037123166 wait complete. 2024-02-15T22:43:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 -- 172.21.15.33:0/3697651304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 msgr2=0x7f37240fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 --2- 172.21.15.33:0/3697651304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fe700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3718004940 tx=0x7f3718009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 -- 172.21.15.33:0/3697651304 shutdown_connections 2024-02-15T22:43:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 --2- 172.21.15.33:0/3697651304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fe700 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 --2- 172.21.15.33:0/3697651304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240fb220 0x7f37240fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 -- 172.21.15.33:0/3697651304 >> 172.21.15.33:0/3697651304 conn(0x7f37240f6ca0 msgr2=0x7f37240f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 -- 172.21.15.33:0/3697651304 shutdown_connections 2024-02-15T22:43:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.974+0000 7f372924f700 1 -- 172.21.15.33:0/3697651304 wait complete. 2024-02-15T22:43:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372924f700 1 Processor -- start 2024-02-15T22:43:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372924f700 1 -- start start 2024-02-15T22:43:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372924f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240fb220 0x7f37240fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372924f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372924f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240fc7c0 con 0x7f37240fe2b0 2024-02-15T22:43:04.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372924f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240fc930 con 0x7f37240fb220 2024-02-15T22:43:04.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32924/0 (socket says 172.21.15.33:32924) 2024-02-15T22:43:04.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f372259c700 1 -- 172.21.15.33:0/3986891209 learned_addr learned my addr 172.21.15.33:0/3986891209 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:04.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.975+0000 7f3722d9d700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240fb220 0x7f37240fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f372259c700 1 -- 172.21.15.33:0/3986891209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240fb220 msgr2=0x7f37240fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f372259c700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240fb220 0x7f37240fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f372259c700 1 -- 172.21.15.33:0/3986891209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718005040 con 0x7f37240fe2b0 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f3722d9d700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240fb220 0x7f37240fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f372259c700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fc1c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3718009360 tx=0x7f3718009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f370b7fe700 1 -- 172.21.15.33:0/3986891209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371800e040 con 0x7f37240fe2b0 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f370b7fe700 1 -- 172.21.15.33:0/3986891209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f371800bbf0 con 0x7f37240fe2b0 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.976+0000 7f370b7fe700 1 -- 172.21.15.33:0/3986891209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371801c630 con 0x7f37240fe2b0 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.977+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240fcbb0 con 0x7f37240fe2b0 2024-02-15T22:43:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.977+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3724115a40 con 0x7f37240fe2b0 2024-02-15T22:43:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.978+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372404bed0 con 0x7f37240fe2b0 2024-02-15T22:43:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.979+0000 7f370b7fe700 1 -- 172.21.15.33:0/3986891209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f3718013420 con 0x7f37240fe2b0 2024-02-15T22:43:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.979+0000 7f370b7fe700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f370c06d200 0x7f370c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.979+0000 7f370b7fe700 1 -- 172.21.15.33:0/3986891209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f371808da60 con 0x7f37240fe2b0 2024-02-15T22:43:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.979+0000 7f3722d9d700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f370c06d200 0x7f370c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:04.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.980+0000 7f3722d9d700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f370c06d200 0x7f370c06f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37240fdad0 tx=0x7f3714009040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:04.985+0000 7f370b7fe700 1 -- 172.21.15.33:0/3986891209 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f371805b590 con 0x7f37240fe2b0 2024-02-15T22:43:05.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.283+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3724105a40 con 0x7f37240fe2b0 2024-02-15T22:43:05.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.284+0000 7f370b7fe700 1 -- 172.21.15.33:0/3986891209 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f3718013e60 con 0x7f37240fe2b0 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:05.286 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:43:05.287 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:43:05.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:05.287 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:43:05.287 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 12, 2024-02-15T22:43:05.287 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:43:05.287 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:43:05.287 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f370c06d200 msgr2=0x7f370c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f370c06d200 0x7f370c06f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37240fdad0 tx=0x7f3714009040 comp rx=0 tx=0).stop 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 msgr2=0x7f37240fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fc1c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3718009360 tx=0x7f3718009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 shutdown_connections 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f370c06d200 0x7f370c06f6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240fb220 0x7f37240fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 --2- 172.21.15.33:0/3986891209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37240fe2b0 0x7f37240fc1c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 >> 172.21.15.33:0/3986891209 conn(0x7f37240f6ca0 msgr2=0x7f37241014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 shutdown_connections 2024-02-15T22:43:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.286+0000 7f372924f700 1 -- 172.21.15.33:0/3986891209 wait complete. 2024-02-15T22:43:05.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 -- 172.21.15.33:0/1983412800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 msgr2=0x7f26d00fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:05.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 --2- 172.21.15.33:0/1983412800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d00fc250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f26c0004940 tx=0x7f26c0009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:05.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 -- 172.21.15.33:0/1983412800 shutdown_connections 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 --2- 172.21.15.33:0/1983412800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d00fcfb0 0x7f26d00fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 --2- 172.21.15.33:0/1983412800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d00fc250 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 -- 172.21.15.33:0/1983412800 >> 172.21.15.33:0/1983412800 conn(0x7f26d00f74e0 msgr2=0x7f26d00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 -- 172.21.15.33:0/1983412800 shutdown_connections 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.396+0000 7f26d72e5700 1 -- 172.21.15.33:0/1983412800 wait complete. 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d72e5700 1 Processor -- start 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d72e5700 1 -- start start 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d72e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d010d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d72e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d00fcfb0 0x7f26d010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d72e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d010e4c0 con 0x7f26d00fbe40 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d72e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d010ed60 con 0x7f26d00fcfb0 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d5081700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d5081700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d010d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32950/0 (socket says 172.21.15.33:32950) 2024-02-15T22:43:05.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d5081700 1 -- 172.21.15.33:0/550015814 learned_addr learned my addr 172.21.15.33:0/550015814 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d4880700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d00fcfb0 0x7f26d010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d5081700 1 -- 172.21.15.33:0/550015814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d00fcfb0 msgr2=0x7f26d010dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d5081700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d00fcfb0 0x7f26d010dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d5081700 1 -- 172.21.15.33:0/550015814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0005040 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.397+0000 7f26d5081700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d010d980 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f26c00093b0 tx=0x7f26c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.398+0000 7f26c5ffb700 1 -- 172.21.15.33:0/550015814 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26c000e040 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.398+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d010efe0 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.398+0000 7f26c5ffb700 1 -- 172.21.15.33:0/550015814 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26c000bcc0 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.398+0000 7f26c5ffb700 1 -- 172.21.15.33:0/550015814 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26c001c630 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.398+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d010f520 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.399+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d004bed0 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.399+0000 7f26c5ffb700 1 -- 172.21.15.33:0/550015814 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f26c0013980 con 0x7f26d00fbe40 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.400+0000 7f26c5ffb700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f26bc06d200 0x7f26bc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.400+0000 7f26c5ffb700 1 -- 172.21.15.33:0/550015814 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f26c008db20 con 0x7f26d00fbe40 2024-02-15T22:43:05.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.400+0000 7f26d4880700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f26bc06d200 0x7f26bc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:05.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.400+0000 7f26d4880700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f26bc06d200 0x7f26bc06f6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26cc004f60 tx=0x7f26cc00b040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:05.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.405+0000 7f26c5ffb700 1 -- 172.21.15.33:0/550015814 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f26c005b5b0 con 0x7f26d00fbe40 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: mgrmap e31: smithi033.swohxi(active, since 33s), standbys: smithi082.mjhlse 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: pgmap v20: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all mgr 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.swohxi"}]: dispatch 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.swohxi"}]': finished 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.mjhlse"}]: dispatch 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.mjhlse"}]': finished 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all rgw 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-15T22:43:05.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all ceph-exporter 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all iscsi 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all nfs 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all nvmeof 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:05 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3986891209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.629+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26d010f170 con 0x7f26bc06d200 2024-02-15T22:43:05.631 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: mgrmap e31: smithi033.swohxi(active, since 33s), standbys: smithi082.mjhlse 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: pgmap v20: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all mgr 2024-02-15T22:43:05.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.swohxi"}]: dispatch 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.swohxi"}]': finished 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.mjhlse"}]: dispatch 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.mjhlse"}]': finished 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all rgw 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all ceph-exporter 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all iscsi 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all nfs 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all nvmeof 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:05.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:05 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3986891209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.630+0000 7f26c5ffb700 1 -- 172.21.15.33:0/550015814 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f26d010f170 con 0x7f26bc06d200 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T22:43:05.635 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:43:05.636 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:43:05.636 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-15T22:43:05.636 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:43:05.636 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:43:05.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f26bc06d200 msgr2=0x7f26bc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:05.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f26bc06d200 0x7f26bc06f6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26cc004f60 tx=0x7f26cc00b040 comp rx=0 tx=0).stop 2024-02-15T22:43:05.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 msgr2=0x7f26d010d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d010d980 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f26c00093b0 tx=0x7f26c0009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 shutdown_connections 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f26bc06d200 0x7f26bc06f6b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26d00fbe40 0x7f26d010d980 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 --2- 172.21.15.33:0/550015814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d00fcfb0 0x7f26d010dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 >> 172.21.15.33:0/550015814 conn(0x7f26d00f74e0 msgr2=0x7f26d00656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 shutdown_connections 2024-02-15T22:43:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:05.633+0000 7f26d72e5700 1 -- 172.21.15.33:0/550015814 wait complete. 2024-02-15T22:43:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:06 smithi082 ceph-mon[37153]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:06.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:06 smithi033 ceph-mon[29033]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:07.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:07 smithi082 ceph-mon[37153]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:07.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:07 smithi033 ceph-mon[29033]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:09.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:08 smithi033 ceph-mon[29033]: Upgrade: Updating node-exporter.smithi033 (1/2) 2024-02-15T22:43:09.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:08 smithi033 ceph-mon[29033]: Deploying daemon node-exporter.smithi033 on smithi033 2024-02-15T22:43:09.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:08 smithi082 ceph-mon[37153]: Upgrade: Updating node-exporter.smithi033 (1/2) 2024-02-15T22:43:09.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:08 smithi082 ceph-mon[37153]: Deploying daemon node-exporter.smithi033 on smithi033 2024-02-15T22:43:10.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:09 smithi033 ceph-mon[29033]: pgmap v22: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:10.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:09 smithi082 ceph-mon[37153]: pgmap v22: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:11.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:11 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:11.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:11 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:11.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:11 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:11.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:11 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:12.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:12 smithi033 ceph-mon[29033]: pgmap v23: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:12.536 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:12 smithi082 ceph-mon[37153]: pgmap v23: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:13.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:13 smithi082 ceph-mon[37153]: Upgrade: Updating node-exporter.smithi082 (2/2) 2024-02-15T22:43:13.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:13 smithi082 ceph-mon[37153]: Deploying daemon node-exporter.smithi082 on smithi082 2024-02-15T22:43:13.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:13 smithi033 ceph-mon[29033]: Upgrade: Updating node-exporter.smithi082 (2/2) 2024-02-15T22:43:13.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:13 smithi033 ceph-mon[29033]: Deploying daemon node-exporter.smithi082 on smithi082 2024-02-15T22:43:14.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:14 smithi033 ceph-mon[29033]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:14.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:14 smithi082 ceph-mon[37153]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:15.460 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:15 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:15.461 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:15 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:15.461 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:15 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:15.461 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:15 smithi082 ceph-mon[37153]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:15.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:15 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:15.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:15 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:15.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:15 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:15.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:15 smithi033 ceph-mon[29033]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:16.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:16.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:18.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:18 smithi033 ceph-mon[29033]: pgmap v26: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:18.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:18 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:18.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:18 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:18.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:18 smithi082 ceph-mon[37153]: pgmap v26: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:18.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:18 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:18.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:18 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:19.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:19 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:19.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:19 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:19.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:19 smithi082 ceph-mon[37153]: pgmap v27: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:19.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:19 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:19.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:19 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:19.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:19 smithi033 ceph-mon[29033]: pgmap v27: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:20.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:20 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:20.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:20 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:20.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:20 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:20.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:20 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:21.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:21 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:21.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:21 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:21.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:21 smithi082 ceph-mon[37153]: pgmap v28: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:21.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:21 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:21.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:21 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:21.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:21 smithi033 ceph-mon[29033]: pgmap v28: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:22 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:23.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:22 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:23.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:22 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:23.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:22 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:24.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:23 smithi033 ceph-mon[29033]: pgmap v29: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:24.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:23 smithi082 ceph-mon[37153]: pgmap v29: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:25.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:25 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:25.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:25.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:25 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:26.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:26 smithi033 ceph-mon[29033]: pgmap v30: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:26.542 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:26 smithi082 ceph-mon[37153]: pgmap v30: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:27.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:27 smithi033 ceph-mon[29033]: Upgrade: Updating prometheus.smithi033 2024-02-15T22:43:27.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:27 smithi033 ceph-mon[29033]: Deploying daemon prometheus.smithi033 on smithi033 2024-02-15T22:43:27.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:27 smithi082 ceph-mon[37153]: Upgrade: Updating prometheus.smithi033 2024-02-15T22:43:27.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:27 smithi082 ceph-mon[37153]: Deploying daemon prometheus.smithi033 on smithi033 2024-02-15T22:43:28.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:28 smithi033 ceph-mon[29033]: pgmap v31: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:28.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:28 smithi082 ceph-mon[37153]: pgmap v31: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:30.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:30 smithi033 ceph-mon[29033]: pgmap v32: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:30.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:30 smithi082 ceph-mon[37153]: pgmap v32: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:31.347 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:31.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:32.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:32 smithi033 ceph-mon[29033]: pgmap v33: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:32.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:32 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:32.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:32 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:32.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:32 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:32.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:32 smithi082 ceph-mon[37153]: pgmap v33: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:32.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:32 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:32.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:32 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:32.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:32 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:34.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:34 smithi033 ceph-mon[29033]: pgmap v34: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:34.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:34 smithi082 ceph-mon[37153]: pgmap v34: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.779+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/4272374078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 msgr2=0x7f5dbc0ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.779+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/4272374078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc0ffb20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5dac004940 tx=0x7f5dac009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/4272374078 shutdown_connections 2024-02-15T22:43:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/4272374078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dbc1000f0 0x7f5dbc102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/4272374078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc0ffb20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/4272374078 >> 172.21.15.33:0/4272374078 conn(0x7f5dbc0f7510 msgr2=0x7f5dbc0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/4272374078 shutdown_connections 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/4272374078 wait complete. 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 Processor -- start 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.780+0000 7f5dc0a2a700 1 -- start start 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dc0a2a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc10d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dc0a2a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dbc1000f0 0x7f5dbc10de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dc0a2a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc10e490 con 0x7f5dbc066c50 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dc0a2a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc10ed30 con 0x7f5dbc1000f0 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc10d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc10d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45586/0 (socket says 172.21.15.33:45586) 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dba59c700 1 -- 172.21.15.33:0/3126007696 learned_addr learned my addr 172.21.15.33:0/3126007696 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5db9d9b700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dbc1000f0 0x7f5dbc10de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dba59c700 1 -- 172.21.15.33:0/3126007696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dbc1000f0 msgr2=0x7f5dbc10de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dba59c700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dbc1000f0 0x7f5dbc10de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dba59c700 1 -- 172.21.15.33:0/3126007696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac005040 con 0x7f5dbc066c50 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dba59c700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc10d950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0093b0 tx=0x7f5dac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5db2ffd700 1 -- 172.21.15.33:0/3126007696 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dac00e040 con 0x7f5dbc066c50 2024-02-15T22:43:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dbc10efb0 con 0x7f5dbc066c50 2024-02-15T22:43:35.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5db2ffd700 1 -- 172.21.15.33:0/3126007696 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5dac00bcc0 con 0x7f5dbc066c50 2024-02-15T22:43:35.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.781+0000 7f5db2ffd700 1 -- 172.21.15.33:0/3126007696 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dac01c630 con 0x7f5dbc066c50 2024-02-15T22:43:35.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.782+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc10f4f0 con 0x7f5dbc066c50 2024-02-15T22:43:35.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.782+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc04bed0 con 0x7f5dbc066c50 2024-02-15T22:43:35.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.783+0000 7f5db2ffd700 1 -- 172.21.15.33:0/3126007696 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f5dac013980 con 0x7f5dbc066c50 2024-02-15T22:43:35.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.784+0000 7f5db2ffd700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f5da806d200 0x7f5da806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:35.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.784+0000 7f5db2ffd700 1 -- 172.21.15.33:0/3126007696 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f5dac08db00 con 0x7f5dbc066c50 2024-02-15T22:43:35.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.784+0000 7f5db9d9b700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f5da806d200 0x7f5da806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:35.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.784+0000 7f5db9d9b700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f5da806d200 0x7f5da806f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc066990 tx=0x7f5da400b040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:35.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:35.788+0000 7f5db2ffd700 1 -- 172.21.15.33:0/3126007696 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5dac05b590 con 0x7f5dbc066c50 2024-02-15T22:43:36.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.012+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dbc10fbd0 con 0x7f5da806d200 2024-02-15T22:43:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.013+0000 7f5db2ffd700 1 -- 172.21.15.33:0/3126007696 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f5dbc10fbd0 con 0x7f5da806d200 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f5da806d200 msgr2=0x7f5da806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f5da806d200 0x7f5da806f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc066990 tx=0x7f5da400b040 comp rx=0 tx=0).stop 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 msgr2=0x7f5dbc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc10d950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0093b0 tx=0x7f5dac009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 shutdown_connections 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f5da806d200 0x7f5da806f6b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dbc066c50 0x7f5dbc10d950 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 --2- 172.21.15.33:0/3126007696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dbc1000f0 0x7f5dbc10de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.015+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 >> 172.21.15.33:0/3126007696 conn(0x7f5dbc0f7510 msgr2=0x7f5dbc0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:36.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.016+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 shutdown_connections 2024-02-15T22:43:36.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.016+0000 7f5dc0a2a700 1 -- 172.21.15.33:0/3126007696 wait complete. 2024-02-15T22:43:36.027 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 -- 172.21.15.33:0/3142938220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 msgr2=0x7efd5c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 --2- 172.21.15.33:0/3142938220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c0fe550 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd4c004940 tx=0x7efd4c009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 -- 172.21.15.33:0/3142938220 shutdown_connections 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 --2- 172.21.15.33:0/3142938220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c0fe550 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 --2- 172.21.15.33:0/3142938220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd5c0fcef0 0x7efd5c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 -- 172.21.15.33:0/3142938220 >> 172.21.15.33:0/3142938220 conn(0x7efd5c0f8620 msgr2=0x7efd5c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 -- 172.21.15.33:0/3142938220 shutdown_connections 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 -- 172.21.15.33:0/3142938220 wait complete. 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 Processor -- start 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.120+0000 7efd63876700 1 -- start start 2024-02-15T22:43:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd63876700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd5c0fcef0 0x7efd5c10d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd63876700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c10dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd63876700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c10e4c0 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd63876700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c10ed60 con 0x7efd5c0fcef0 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd60e11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c10dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd60e11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c10dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45616/0 (socket says 172.21.15.33:45616) 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd60e11700 1 -- 172.21.15.33:0/2207837381 learned_addr learned my addr 172.21.15.33:0/2207837381 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd61612700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd5c0fcef0 0x7efd5c10d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd60e11700 1 -- 172.21.15.33:0/2207837381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd5c0fcef0 msgr2=0x7efd5c10d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd60e11700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd5c0fcef0 0x7efd5c10d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd60e11700 1 -- 172.21.15.33:0/2207837381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c005040 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd61612700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd5c0fcef0 0x7efd5c10d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd60e11700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c10dec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009fd0 tx=0x7efd4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd51ffb700 1 -- 172.21.15.33:0/2207837381 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c00e040 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd51ffb700 1 -- 172.21.15.33:0/2207837381 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd4c00bcc0 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c10efe0 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.121+0000 7efd51ffb700 1 -- 172.21.15.33:0/2207837381 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c01c630 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.122+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c10f520 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.122+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c04bed0 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.123+0000 7efd51ffb700 1 -- 172.21.15.33:0/2207837381 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7efd4c013980 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.123+0000 7efd51ffb700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7efd4806d200 0x7efd4806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.123+0000 7efd51ffb700 1 -- 172.21.15.33:0/2207837381 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7efd4c08dc30 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.123+0000 7efd61612700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7efd4806d200 0x7efd4806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.124+0000 7efd61612700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7efd4806d200 0x7efd4806f6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efd58009fd0 tx=0x7efd58009ee0 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:36.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.128+0000 7efd51ffb700 1 -- 172.21.15.33:0/2207837381 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efd4c05b6c0 con 0x7efd5c0fe0e0 2024-02-15T22:43:36.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.370+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd5c10f960 con 0x7efd4806d200 2024-02-15T22:43:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.371+0000 7efd51ffb700 1 -- 172.21.15.33:0/2207837381 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7efd5c10f960 con 0x7efd4806d200 2024-02-15T22:43:36.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7efd4806d200 msgr2=0x7efd4806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7efd4806d200 0x7efd4806f6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efd58009fd0 tx=0x7efd58009ee0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 msgr2=0x7efd5c10dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c10dec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009fd0 tx=0x7efd4c009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:36.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 shutdown_connections 2024-02-15T22:43:36.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7efd4806d200 0x7efd4806f6b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd5c0fcef0 0x7efd5c10d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 --2- 172.21.15.33:0/2207837381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0fe0e0 0x7efd5c10dec0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 >> 172.21.15.33:0/2207837381 conn(0x7efd5c0f8620 msgr2=0x7efd5c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:36.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 shutdown_connections 2024-02-15T22:43:36.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.373+0000 7efd63876700 1 -- 172.21.15.33:0/2207837381 wait complete. 2024-02-15T22:43:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 -- 172.21.15.33:0/3953899783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fcef0 msgr2=0x7f12880fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 --2- 172.21.15.33:0/3953899783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fcef0 0x7f12880fd320 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1280004940 tx=0x7f1280009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 -- 172.21.15.33:0/3953899783 shutdown_connections 2024-02-15T22:43:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 --2- 172.21.15.33:0/3953899783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12880fe0e0 0x7f12880fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 --2- 172.21.15.33:0/3953899783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fcef0 0x7f12880fd320 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 -- 172.21.15.33:0/3953899783 >> 172.21.15.33:0/3953899783 conn(0x7f12880f8620 msgr2=0x7f12880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 -- 172.21.15.33:0/3953899783 shutdown_connections 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 -- 172.21.15.33:0/3953899783 wait complete. 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 Processor -- start 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.476+0000 7f12903e4700 1 -- start start 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f12903e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12880fcef0 0x7f128810d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f12903e4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fe0e0 0x7f128810de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f12903e4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128810e420 con 0x7f12880fe0e0 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f12903e4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128810ecc0 con 0x7f12880fcef0 2024-02-15T22:43:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128d97f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fe0e0 0x7f128810de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128d97f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fe0e0 0x7f128810de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39880/0 (socket says 172.21.15.33:39880) 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128d97f700 1 -- 172.21.15.33:0/2563603694 learned_addr learned my addr 172.21.15.33:0/2563603694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128e180700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12880fcef0 0x7f128810d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128d97f700 1 -- 172.21.15.33:0/2563603694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12880fcef0 msgr2=0x7f128810d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128d97f700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12880fcef0 0x7f128810d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128d97f700 1 -- 172.21.15.33:0/2563603694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1280005040 con 0x7f12880fe0e0 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f128d97f700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fe0e0 0x7f128810de20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f127c002a80 tx=0x7f127c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f1286ffd700 1 -- 172.21.15.33:0/2563603694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127c007cc0 con 0x7f12880fe0e0 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f1286ffd700 1 -- 172.21.15.33:0/2563603694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f127c00f040 con 0x7f12880fe0e0 2024-02-15T22:43:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128810efa0 con 0x7f12880fe0e0 2024-02-15T22:43:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f1286ffd700 1 -- 172.21.15.33:0/2563603694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127c00dac0 con 0x7f12880fe0e0 2024-02-15T22:43:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.477+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128810f4e0 con 0x7f12880fe0e0 2024-02-15T22:43:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.478+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128804bed0 con 0x7f12880fe0e0 2024-02-15T22:43:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.479+0000 7f1286ffd700 1 -- 172.21.15.33:0/2563603694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f127c00dc20 con 0x7f12880fe0e0 2024-02-15T22:43:36.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.479+0000 7f1286ffd700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f127006d200 0x7f127006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.479+0000 7f1286ffd700 1 -- 172.21.15.33:0/2563603694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f127c08c3e0 con 0x7f12880fe0e0 2024-02-15T22:43:36.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.479+0000 7f128e180700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f127006d200 0x7f127006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.480+0000 7f128e180700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f127006d200 0x7f127006f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1280004890 tx=0x7f1280009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:36.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.484+0000 7f1286ffd700 1 -- 172.21.15.33:0/2563603694 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f127c059dd0 con 0x7f12880fe0e0 2024-02-15T22:43:36.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:36 smithi033 ceph-mon[29033]: pgmap v35: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:36.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:36 smithi082 ceph-mon[37153]: pgmap v35: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:36.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.701+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f128810fa10 con 0x7f127006d200 2024-02-15T22:43:36.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.711+0000 7f1286ffd700 1 -- 172.21.15.33:0/2563603694 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f128810fa10 con 0x7f127006d200 2024-02-15T22:43:36.712 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (2m) 17s ago 10m 26.9M - 0.25.0 c8568f914cd2 c14c4db45752 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (11m) 17s ago 11m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (9m) 19s ago 9m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (101s) 17s ago 10m 75.9M - 9.4.7 954c08fa6188 7446707d8c9f 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (5m) 17s ago 5m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (5m) 17s ago 5m 75.1M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (5m) 19s ago 5m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (5m) 19s ago 5m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (86s) 17s ago 12m 494M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (40s) 19s ago 9m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (12m) 17s ago 12m 57.4M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (9m) 19s ago 9m 41.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (27s) 17s ago 11m 7189k - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:43:36.713 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (22s) 19s ago 9m 3389k - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:43:36.714 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (8m) 17s ago 8m 211M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:43:36.714 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (8m) 17s ago 8m 229M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:43:36.714 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 17s ago 7m 196M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:43:36.714 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (7m) 19s ago 7m 260M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:43:36.714 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (7m) 19s ago 7m 230M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:43:36.714 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (6m) 19s ago 6m 224M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:43:36.714 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 starting - - - - 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f127006d200 msgr2=0x7f127006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f127006d200 0x7f127006f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1280004890 tx=0x7f1280009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fe0e0 msgr2=0x7f128810de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fe0e0 0x7f128810de20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f127c002a80 tx=0x7f127c0046b0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 shutdown_connections 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f127006d200 0x7f127006f6b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12880fcef0 0x7f128810d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 --2- 172.21.15.33:0/2563603694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12880fe0e0 0x7f128810de20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.713+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 >> 172.21.15.33:0/2563603694 conn(0x7f12880f8620 msgr2=0x7f12881013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.714+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 shutdown_connections 2024-02-15T22:43:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.714+0000 7f12903e4700 1 -- 172.21.15.33:0/2563603694 wait complete. 2024-02-15T22:43:36.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.815+0000 7f6b566cb700 1 -- 172.21.15.33:0/2123980307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50071e90 msgr2=0x7f6b50070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.815+0000 7f6b566cb700 1 --2- 172.21.15.33:0/2123980307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50071e90 0x7f6b50070300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6b40004940 tx=0x7f6b40009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:36.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 -- 172.21.15.33:0/2123980307 shutdown_connections 2024-02-15T22:43:36.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 --2- 172.21.15.33:0/2123980307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b50070840 0x7f6b50070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 --2- 172.21.15.33:0/2123980307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50071e90 0x7f6b50070300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 -- 172.21.15.33:0/2123980307 >> 172.21.15.33:0/2123980307 conn(0x7f6b500f8620 msgr2=0x7f6b500faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:36.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 -- 172.21.15.33:0/2123980307 shutdown_connections 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 -- 172.21.15.33:0/2123980307 wait complete. 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 Processor -- start 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 -- start start 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50070840 0x7f6b5010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b50071e90 0x7f6b50110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b50110680 con 0x7f6b50070840 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b566cb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b50110f20 con 0x7f6b50071e90 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.816+0000 7f6b4ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50070840 0x7f6b5010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50070840 0x7f6b5010fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39888/0 (socket says 172.21.15.33:39888) 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4ffff700 1 -- 172.21.15.33:0/1873809955 learned_addr learned my addr 172.21.15.33:0/1873809955 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4f7fe700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b50071e90 0x7f6b50110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4ffff700 1 -- 172.21.15.33:0/1873809955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b50071e90 msgr2=0x7f6b50110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4ffff700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b50071e90 0x7f6b50110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4ffff700 1 -- 172.21.15.33:0/1873809955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40005040 con 0x7f6b50070840 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4ffff700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50070840 0x7f6b5010fb40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6b400093b0 tx=0x7f6b40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4cff9700 1 -- 172.21.15.33:0/1873809955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b4000e040 con 0x7f6b50070840 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4cff9700 1 -- 172.21.15.33:0/1873809955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b4000bcc0 con 0x7f6b50070840 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b501111a0 con 0x7f6b50070840 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b4cff9700 1 -- 172.21.15.33:0/1873809955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b4001c630 con 0x7f6b50070840 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.817+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b501116e0 con 0x7f6b50070840 2024-02-15T22:43:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.818+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5004bed0 con 0x7f6b50070840 2024-02-15T22:43:36.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.819+0000 7f6b4cff9700 1 -- 172.21.15.33:0/1873809955 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f6b400139f0 con 0x7f6b50070840 2024-02-15T22:43:36.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.819+0000 7f6b4cff9700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f6b3c06d200 0x7f6b3c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:36.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.819+0000 7f6b4cff9700 1 -- 172.21.15.33:0/1873809955 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f6b4008db00 con 0x7f6b50070840 2024-02-15T22:43:36.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.819+0000 7f6b4f7fe700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f6b3c06d200 0x7f6b3c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:36.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.820+0000 7f6b4f7fe700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f6b3c06d200 0x7f6b3c06f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6b380041d0 tx=0x7f6b38009040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:36.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:36.824+0000 7f6b4cff9700 1 -- 172.21.15.33:0/1873809955 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6b4005b6e0 con 0x7f6b50070840 2024-02-15T22:43:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.133+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6b50111d90 con 0x7f6b50070840 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.133+0000 7f6b4cff9700 1 -- 172.21.15.33:0/1873809955 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f6b50111d90 con 0x7f6b50070840 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:43:37.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 12, 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:43:37.136 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:43:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f6b3c06d200 msgr2=0x7f6b3c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f6b3c06d200 0x7f6b3c06f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6b380041d0 tx=0x7f6b38009040 comp rx=0 tx=0).stop 2024-02-15T22:43:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50070840 msgr2=0x7f6b5010fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50070840 0x7f6b5010fb40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6b400093b0 tx=0x7f6b40009e30 comp rx=0 tx=0).stop 2024-02-15T22:43:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 shutdown_connections 2024-02-15T22:43:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f6b3c06d200 0x7f6b3c06f6b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50070840 0x7f6b5010fb40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 --2- 172.21.15.33:0/1873809955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b50071e90 0x7f6b50110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.135+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 >> 172.21.15.33:0/1873809955 conn(0x7f6b500f8620 msgr2=0x7f6b50102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.136+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 shutdown_connections 2024-02-15T22:43:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.136+0000 7f6b566cb700 1 -- 172.21.15.33:0/1873809955 wait complete. 2024-02-15T22:43:37.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 -- 172.21.15.33:0/2373688174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fbe40 msgr2=0x7fccc40fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2373688174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fbe40 0x7fccc40fc250 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009ce0 tx=0x7fccb4004d10 comp rx=0 tx=0).stop 2024-02-15T22:43:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 -- 172.21.15.33:0/2373688174 shutdown_connections 2024-02-15T22:43:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2373688174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc40fcfb0 0x7fccc40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2373688174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fbe40 0x7fccc40fc250 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 -- 172.21.15.33:0/2373688174 >> 172.21.15.33:0/2373688174 conn(0x7fccc40f74e0 msgr2=0x7fccc40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 -- 172.21.15.33:0/2373688174 shutdown_connections 2024-02-15T22:43:37.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.246+0000 7fcccb74d700 1 -- 172.21.15.33:0/2373688174 wait complete. 2024-02-15T22:43:37.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fcccb74d700 1 Processor -- start 2024-02-15T22:43:37.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fcccb74d700 1 -- start start 2024-02-15T22:43:37.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fcccb74d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc40fbe40 0x7fccc410daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:37.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fcccb74d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fcfb0 0x7fccc410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:37.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fcccb74d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc410e6c0 con 0x7fccc40fcfb0 2024-02-15T22:43:37.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fcccb74d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc410ef00 con 0x7fccc40fbe40 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fccc8ce8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fcfb0 0x7fccc410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fccc8ce8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fcfb0 0x7fccc410e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39908/0 (socket says 172.21.15.33:39908) 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fccc8ce8700 1 -- 172.21.15.33:0/2036690426 learned_addr learned my addr 172.21.15.33:0/2036690426 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.247+0000 7fccc94e9700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc40fbe40 0x7fccc410daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc8ce8700 1 -- 172.21.15.33:0/2036690426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc40fbe40 msgr2=0x7fccc410daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc8ce8700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc40fbe40 0x7fccc410daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc8ce8700 1 -- 172.21.15.33:0/2036690426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4009940 con 0x7fccc40fcfb0 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc94e9700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc40fbe40 0x7fccc410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc8ce8700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fcfb0 0x7fccc410e030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fccb800b790 tx=0x7fccb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc1ffb700 1 -- 172.21.15.33:0/2036690426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb800f770 con 0x7fccc40fcfb0 2024-02-15T22:43:37.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc1ffb700 1 -- 172.21.15.33:0/2036690426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccb800fda0 con 0x7fccc40fcfb0 2024-02-15T22:43:37.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc410f1e0 con 0x7fccc40fcfb0 2024-02-15T22:43:37.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fccc1ffb700 1 -- 172.21.15.33:0/2036690426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb800d310 con 0x7fccc40fcfb0 2024-02-15T22:43:37.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.248+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc410f720 con 0x7fccc40fcfb0 2024-02-15T22:43:37.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.249+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc404bed0 con 0x7fccc40fcfb0 2024-02-15T22:43:37.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.250+0000 7fccc1ffb700 1 -- 172.21.15.33:0/2036690426 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 31) v1 ==== 91309+0+0 (secure 0 0 0) 0x7fccb8010420 con 0x7fccc40fcfb0 2024-02-15T22:43:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.250+0000 7fccc1ffb700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fccac06d200 0x7fccac06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.250+0000 7fccc1ffb700 1 -- 172.21.15.33:0/2036690426 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fccb808c660 con 0x7fccc40fcfb0 2024-02-15T22:43:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.250+0000 7fccc94e9700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fccac06d200 0x7fccac06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.251+0000 7fccc94e9700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fccac06d200 0x7fccac06f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fccb4005010 tx=0x7fccb4004d10 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.255+0000 7fccc1ffb700 1 -- 172.21.15.33:0/2036690426 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fccb805a1e0 con 0x7fccc40fcfb0 2024-02-15T22:43:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.477+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccc410fc10 con 0x7fccac06d200 2024-02-15T22:43:37.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:37 smithi033 ceph-mon[29033]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:37.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:37 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1873809955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:37.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:37 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:37.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:37 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.479+0000 7fccc1ffb700 1 -- 172.21.15.33:0/2036690426 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fccc410fc10 con 0x7fccac06d200 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T22:43:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:43:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:43:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-15T22:43:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:43:37.481 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:43:37.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fccac06d200 msgr2=0x7fccac06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:37.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fccac06d200 0x7fccac06f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fccb4005010 tx=0x7fccb4004d10 comp rx=0 tx=0).stop 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fcfb0 msgr2=0x7fccc410e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fcfb0 0x7fccc410e030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fccb800b790 tx=0x7fccb8009250 comp rx=0 tx=0).stop 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 shutdown_connections 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fccac06d200 0x7fccac06f6b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc40fbe40 0x7fccc410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 --2- 172.21.15.33:0/2036690426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc40fcfb0 0x7fccc410e030 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 >> 172.21.15.33:0/2036690426 conn(0x7fccc40f74e0 msgr2=0x7fccc40656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 shutdown_connections 2024-02-15T22:43:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:43:37.482+0000 7fcccb74d700 1 -- 172.21.15.33:0/2036690426 wait complete. 2024-02-15T22:43:37.534 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:37 smithi082 ceph-mon[37153]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:37.534 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:37 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1873809955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:37.534 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:37 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:37.535 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:37 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:38.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:38 smithi033 ceph-mon[29033]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:38.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:38 smithi033 ceph-mon[29033]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:38.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:38 smithi033 ceph-mon[29033]: pgmap v36: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:38.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:38 smithi082 ceph-mon[37153]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:38.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:38 smithi082 ceph-mon[37153]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:38.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:38 smithi082 ceph-mon[37153]: pgmap v36: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:39.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:39 smithi033 ceph-mon[29033]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:39.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:39 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:39.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:39 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:39.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:39 smithi082 ceph-mon[37153]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:43:39.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:39 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:39.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:39 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:40.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:40 smithi033 ceph-mon[29033]: pgmap v37: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:40.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:40 smithi082 ceph-mon[37153]: pgmap v37: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: pgmap v38: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:42.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:42 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: pgmap v38: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:42.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:42.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:42.689 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:42 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:43:43.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:43 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:43:43.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:43 smithi082 ceph-mon[37153]: pgmap v39: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:43.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:43 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:43:43.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:43 smithi033 ceph-mon[29033]: pgmap v39: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:44.609 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:44 smithi033 ceph-mon[29033]: Upgrade: Updating alertmanager.smithi033 2024-02-15T22:43:44.609 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:44 smithi033 ceph-mon[29033]: Deploying daemon alertmanager.smithi033 on smithi033 2024-02-15T22:43:44.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:44 smithi082 ceph-mon[37153]: Upgrade: Updating alertmanager.smithi033 2024-02-15T22:43:44.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:44 smithi082 ceph-mon[37153]: Deploying daemon alertmanager.smithi033 on smithi033 2024-02-15T22:43:45.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:45 smithi033 ceph-mon[29033]: pgmap v40: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:45.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:45 smithi082 ceph-mon[37153]: pgmap v40: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:46.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:46 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:46.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:46 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:47.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:47 smithi033 ceph-mon[29033]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:47 smithi082 ceph-mon[37153]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:49 smithi033 ceph-mon[29033]: pgmap v42: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:49 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:49 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:50.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:49 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:49 smithi082 ceph-mon[37153]: pgmap v42: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:49 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:49 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:49 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:51.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:51 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:51.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:51 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:51 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:51.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:51 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:52.473 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:52 smithi033 ceph-mon[29033]: pgmap v43: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:52.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:52 smithi082 ceph-mon[37153]: pgmap v43: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:54.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:54 smithi033 ceph-mon[29033]: pgmap v44: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:54.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:54 smithi082 ceph-mon[37153]: pgmap v44: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:43:55.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:55 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:55.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:55 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:55.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:55 smithi082 ceph-mon[37153]: pgmap v45: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:55.956 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:55 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:55.956 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:55 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:55.956 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:55 smithi033 ceph-mon[29033]: pgmap v45: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:43:56.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:56 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:56.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:56 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:57.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:56 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:57.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:56 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:43:57.944 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:57 smithi033 ceph-mon[29033]: pgmap v46: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:43:58.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:57 smithi082 ceph-mon[37153]: pgmap v46: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:00.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: pgmap v47: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:43:59 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: pgmap v47: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:44:00.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:00.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:00.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:43:59 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:01.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:00 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:01.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:00 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:02.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:01 smithi033 ceph-mon[29033]: pgmap v48: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:44:02.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:01 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:02.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:01 smithi033 ceph-mon[29033]: Upgrade: Updating grafana.smithi033 2024-02-15T22:44:02.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:01 smithi033 ceph-mon[29033]: Deploying daemon grafana.smithi033 on smithi033 2024-02-15T22:44:02.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:01 smithi082 ceph-mon[37153]: pgmap v48: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:44:02.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:01 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:02.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:01 smithi082 ceph-mon[37153]: Upgrade: Updating grafana.smithi033 2024-02-15T22:44:02.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:01 smithi082 ceph-mon[37153]: Deploying daemon grafana.smithi033 on smithi033 2024-02-15T22:44:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:03 smithi033 ceph-mon[29033]: pgmap v49: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-02-15T22:44:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:03 smithi033 ceph-mon[29033]: mgrmap e32: smithi033.swohxi(active, since 92s), standbys: smithi082.mjhlse 2024-02-15T22:44:04.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:03 smithi082 ceph-mon[37153]: pgmap v49: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-02-15T22:44:04.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:03 smithi082 ceph-mon[37153]: mgrmap e32: smithi033.swohxi(active, since 92s), standbys: smithi082.mjhlse 2024-02-15T22:44:06.116 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:05 smithi033 ceph-mon[29033]: pgmap v50: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:44:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:05 smithi082 ceph-mon[37153]: pgmap v50: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:44:07.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:07 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:07.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:07 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:07.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:07 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:07.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:07 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:07.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:07 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:07.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:07 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:07.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.599+0000 7fc35f90f700 1 -- 172.21.15.33:0/1684107087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fcfb0 msgr2=0x7fc3580fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:07.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.599+0000 7fc35f90f700 1 --2- 172.21.15.33:0/1684107087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fcfb0 0x7fc3580fd420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc348004940 tx=0x7fc348009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:07.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 -- 172.21.15.33:0/1684107087 shutdown_connections 2024-02-15T22:44:07.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 --2- 172.21.15.33:0/1684107087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fcfb0 0x7fc3580fd420 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 --2- 172.21.15.33:0/1684107087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3580fbe40 0x7fc3580fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 -- 172.21.15.33:0/1684107087 >> 172.21.15.33:0/1684107087 conn(0x7fc3580f74e0 msgr2=0x7fc3580f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 -- 172.21.15.33:0/1684107087 shutdown_connections 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 -- 172.21.15.33:0/1684107087 wait complete. 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 Processor -- start 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 -- start start 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fbe40 0x7fc35810d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3580fcfb0 0x7fc35810dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35810e4a0 con 0x7fc3580fbe40 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35f90f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35810ed40 con 0x7fc3580fcfb0 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35d6ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fbe40 0x7fc35810d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.600+0000 7fc35d6ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fbe40 0x7fc35810d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59136/0 (socket says 172.21.15.33:59136) 2024-02-15T22:44:07.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35d6ab700 1 -- 172.21.15.33:0/3280325585 learned_addr learned my addr 172.21.15.33:0/3280325585 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35ceaa700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3580fcfb0 0x7fc35810dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35d6ab700 1 -- 172.21.15.33:0/3280325585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3580fcfb0 msgr2=0x7fc35810dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35d6ab700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3580fcfb0 0x7fc35810dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35d6ab700 1 -- 172.21.15.33:0/3280325585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348005040 con 0x7fc3580fbe40 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35ceaa700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3580fcfb0 0x7fc35810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35d6ab700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fbe40 0x7fc35810d960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c830 tx=0x7fc354004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc34dffb700 1 -- 172.21.15.33:0/3280325585 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc35400a760 con 0x7fc3580fbe40 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc34dffb700 1 -- 172.21.15.33:0/3280325585 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc35400ad90 con 0x7fc3580fbe40 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35810f020 con 0x7fc3580fbe40 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc34dffb700 1 -- 172.21.15.33:0/3280325585 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3540113a0 con 0x7fc3580fbe40 2024-02-15T22:44:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.601+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35810f560 con 0x7fc3580fbe40 2024-02-15T22:44:07.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.602+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35804bed0 con 0x7fc3580fbe40 2024-02-15T22:44:07.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.603+0000 7fc34dffb700 1 -- 172.21.15.33:0/3280325585 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fc354012400 con 0x7fc3580fbe40 2024-02-15T22:44:07.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.603+0000 7fc34dffb700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fc34406d0e0 0x7fc34406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:07.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.603+0000 7fc34dffb700 1 -- 172.21.15.33:0/3280325585 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fc35408c480 con 0x7fc3580fbe40 2024-02-15T22:44:07.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.603+0000 7fc35ceaa700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fc34406d0e0 0x7fc34406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.604+0000 7fc35ceaa700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fc34406d0e0 0x7fc34406f590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc348004560 tx=0x7fc348009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:07.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.608+0000 7fc34dffb700 1 -- 172.21.15.33:0/3280325585 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc35405a1d0 con 0x7fc3580fbe40 2024-02-15T22:44:07.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.835+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc35810fa30 con 0x7fc34406d0e0 2024-02-15T22:44:07.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.837+0000 7fc34dffb700 1 -- 172.21.15.33:0/3280325585 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fc35810fa30 con 0x7fc34406d0e0 2024-02-15T22:44:07.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fc34406d0e0 msgr2=0x7fc34406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:07.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fc34406d0e0 0x7fc34406f590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc348004560 tx=0x7fc348009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fbe40 msgr2=0x7fc35810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fbe40 0x7fc35810d960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c830 tx=0x7fc354004470 comp rx=0 tx=0).stop 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 shutdown_connections 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fc34406d0e0 0x7fc34406f590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3580fbe40 0x7fc35810d960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 --2- 172.21.15.33:0/3280325585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3580fcfb0 0x7fc35810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 >> 172.21.15.33:0/3280325585 conn(0x7fc3580f74e0 msgr2=0x7fc3580656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 shutdown_connections 2024-02-15T22:44:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.839+0000 7fc35f90f700 1 -- 172.21.15.33:0/3280325585 wait complete. 2024-02-15T22:44:07.851 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:44:07.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.942+0000 7f15dd9de700 1 -- 172.21.15.33:0/3039831732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fcf30 msgr2=0x7f15d80fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:07.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.942+0000 7f15dd9de700 1 --2- 172.21.15.33:0/3039831732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fcf30 0x7f15d80fd340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f15c0004940 tx=0x7f15c0009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:07.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 -- 172.21.15.33:0/3039831732 shutdown_connections 2024-02-15T22:44:07.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 --2- 172.21.15.33:0/3039831732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d80fe1e0 0x7f15d80fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 --2- 172.21.15.33:0/3039831732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fcf30 0x7f15d80fd340 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 -- 172.21.15.33:0/3039831732 >> 172.21.15.33:0/3039831732 conn(0x7f15d80f86b0 msgr2=0x7f15d80faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:07.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 -- 172.21.15.33:0/3039831732 shutdown_connections 2024-02-15T22:44:07.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 -- 172.21.15.33:0/3039831732 wait complete. 2024-02-15T22:44:07.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 Processor -- start 2024-02-15T22:44:07.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 -- start start 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d80fcf30 0x7f15d8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fe1e0 0x7f15d80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80708e0 con 0x7f15d80fe1e0 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.943+0000 7f15dd9de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d8070a50 con 0x7f15d80fcf30 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fe1e0 0x7f15d80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fe1e0 0x7f15d80702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59142/0 (socket says 172.21.15.33:59142) 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d67fc700 1 -- 172.21.15.33:0/2023930466 learned_addr learned my addr 172.21.15.33:0/2023930466 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d6ffd700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d80fcf30 0x7f15d8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d67fc700 1 -- 172.21.15.33:0/2023930466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d80fcf30 msgr2=0x7f15d8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:07.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d67fc700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d80fcf30 0x7f15d8071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d67fc700 1 -- 172.21.15.33:0/2023930466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0005040 con 0x7f15d80fe1e0 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d6ffd700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d80fcf30 0x7f15d8071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15d67fc700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fe1e0 0x7f15d80702e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f15c8002a50 tx=0x7f15c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15cf7fe700 1 -- 172.21.15.33:0/2023930466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c8007cc0 con 0x7f15d80fe1e0 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d8070d30 con 0x7f15d80fe1e0 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15cf7fe700 1 -- 172.21.15.33:0/2023930466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15c800f040 con 0x7f15d80fe1e0 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15cf7fe700 1 -- 172.21.15.33:0/2023930466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c8009640 con 0x7f15d80fe1e0 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.944+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d8115990 con 0x7f15d80fe1e0 2024-02-15T22:44:07.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.945+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d804bed0 con 0x7f15d80fe1e0 2024-02-15T22:44:07.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.946+0000 7f15cf7fe700 1 -- 172.21.15.33:0/2023930466 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f15c80097a0 con 0x7f15d80fe1e0 2024-02-15T22:44:07.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.946+0000 7f15cf7fe700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f15c406d0f0 0x7f15c406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:07.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.946+0000 7f15cf7fe700 1 -- 172.21.15.33:0/2023930466 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f15c808c2c0 con 0x7f15d80fe1e0 2024-02-15T22:44:07.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.946+0000 7f15d6ffd700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f15c406d0f0 0x7f15c406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:07.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.947+0000 7f15d6ffd700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f15c406d0f0 0x7f15c406f5a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15c000b3b0 tx=0x7f15c0009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:07.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:07.951+0000 7f15cf7fe700 1 -- 172.21.15.33:0/2023930466 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f15c8059ef0 con 0x7f15d80fe1e0 2024-02-15T22:44:08.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.176+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15d8102b30 con 0x7f15c406d0f0 2024-02-15T22:44:08.178 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:08 smithi033 ceph-mon[29033]: pgmap v51: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:44:08.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.177+0000 7f15cf7fe700 1 -- 172.21.15.33:0/2023930466 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f15d8102b30 con 0x7f15c406d0f0 2024-02-15T22:44:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f15c406d0f0 msgr2=0x7f15c406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f15c406d0f0 0x7f15c406f5a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15c000b3b0 tx=0x7f15c0009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fe1e0 msgr2=0x7f15d80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fe1e0 0x7f15d80702e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f15c8002a50 tx=0x7f15c80046b0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 shutdown_connections 2024-02-15T22:44:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f15c406d0f0 0x7f15c406f5a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d80fcf30 0x7f15d8071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 --2- 172.21.15.33:0/2023930466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15d80fe1e0 0x7f15d80702e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 >> 172.21.15.33:0/2023930466 conn(0x7f15d80f86b0 msgr2=0x7f15d8101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 shutdown_connections 2024-02-15T22:44:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.179+0000 7f15dd9de700 1 -- 172.21.15.33:0/2023930466 wait complete. 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.287+0000 7f0a333ac700 1 -- 172.21.15.33:0/1704666282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c1003a0 msgr2=0x7f0a2c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.287+0000 7f0a333ac700 1 --2- 172.21.15.33:0/1704666282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c1003a0 0x7f0a2c102780 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0a20004940 tx=0x7f0a20009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.287+0000 7f0a333ac700 1 -- 172.21.15.33:0/1704666282 shutdown_connections 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.287+0000 7f0a333ac700 1 --2- 172.21.15.33:0/1704666282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c1003a0 0x7f0a2c102780 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.287+0000 7f0a333ac700 1 --2- 172.21.15.33:0/1704666282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c0fda80 0x7f0a2c0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.287+0000 7f0a333ac700 1 -- 172.21.15.33:0/1704666282 >> 172.21.15.33:0/1704666282 conn(0x7f0a2c0f74e0 msgr2=0x7f0a2c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 -- 172.21.15.33:0/1704666282 shutdown_connections 2024-02-15T22:44:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 -- 172.21.15.33:0/1704666282 wait complete. 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 Processor -- start 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 -- start start 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c0fda80 0x7f0a2c0fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c1003a0 0x7f0a2c0fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0fbf90 con 0x7f0a2c0fda80 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.288+0000 7f0a333ac700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0fc100 con 0x7f0a2c1003a0 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a31148700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c0fda80 0x7f0a2c0fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a31148700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c0fda80 0x7f0a2c0fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59162/0 (socket says 172.21.15.33:59162) 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a31148700 1 -- 172.21.15.33:0/3580166331 learned_addr learned my addr 172.21.15.33:0/3580166331 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a30947700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c1003a0 0x7f0a2c0fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a31148700 1 -- 172.21.15.33:0/3580166331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c1003a0 msgr2=0x7f0a2c0fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a31148700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c1003a0 0x7f0a2c0fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a31148700 1 -- 172.21.15.33:0/3580166331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20005040 con 0x7f0a2c0fda80 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a30947700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c1003a0 0x7f0a2c0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.289+0000 7f0a31148700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c0fda80 0x7f0a2c0fd510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a28002a50 tx=0x7f0a280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.290+0000 7f0a1dffb700 1 -- 172.21.15.33:0/3580166331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a28007cc0 con 0x7f0a2c0fda80 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.290+0000 7f0a1dffb700 1 -- 172.21.15.33:0/3580166331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a2800f040 con 0x7f0a2c0fda80 2024-02-15T22:44:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.290+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c0fc3e0 con 0x7f0a2c0fda80 2024-02-15T22:44:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.291+0000 7f0a1dffb700 1 -- 172.21.15.33:0/3580166331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a2800da70 con 0x7f0a2c0fda80 2024-02-15T22:44:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.291+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c115980 con 0x7f0a2c0fda80 2024-02-15T22:44:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.291+0000 7f0a1dffb700 1 -- 172.21.15.33:0/3580166331 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f0a2800dcb0 con 0x7f0a2c0fda80 2024-02-15T22:44:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.292+0000 7f0a1dffb700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0a1806d0e0 0x7f0a1806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.292+0000 7f0a1dffb700 1 -- 172.21.15.33:0/3580166331 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f0a2808ba70 con 0x7f0a2c0fda80 2024-02-15T22:44:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.292+0000 7f0a30947700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0a1806d0e0 0x7f0a1806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.292+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c107a70 con 0x7f0a2c0fda80 2024-02-15T22:44:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.293+0000 7f0a30947700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0a1806d0e0 0x7f0a1806f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a20004f90 tx=0x7f0a20009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.297+0000 7f0a1dffb700 1 -- 172.21.15.33:0/3580166331 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0a28017080 con 0x7f0a2c0fda80 2024-02-15T22:44:08.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:08 smithi082 ceph-mon[37153]: pgmap v51: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:44:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.531+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a2c02b3b0 con 0x7f0a1806d0e0 2024-02-15T22:44:08.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.541+0000 7f0a1dffb700 1 -- 172.21.15.33:0/3580166331 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0a2c02b3b0 con 0x7f0a1806d0e0 2024-02-15T22:44:08.543 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (19s) 13s ago 11m 16.1M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (11m) 13s ago 11m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (10m) 51s ago 10m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 starting - - - - 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (5m) 13s ago 5m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (5m) 13s ago 5m 75.1M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (5m) 51s ago 5m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (5m) 51s ago 5m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (118s) 13s ago 12m 497M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (71s) 51s ago 10m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (12m) 13s ago 13m 57.1M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (10m) 51s ago 10m 41.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:44:08.544 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (58s) 13s ago 11m 7419k - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (54s) 51s ago 10m 3389k - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (9m) 13s ago 9m 212M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (8m) 13s ago 8m 231M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (8m) 13s ago 8m 196M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (8m) 51s ago 8m 260M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (7m) 51s ago 7m 230M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (7m) 51s ago 7m 224M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:44:08.545 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (37s) 13s ago 10m 46.4M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.543+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0a1806d0e0 msgr2=0x7f0a1806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.543+0000 7f0a333ac700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0a1806d0e0 0x7f0a1806f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a20004f90 tx=0x7f0a20009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.543+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c0fda80 msgr2=0x7f0a2c0fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.543+0000 7f0a333ac700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c0fda80 0x7f0a2c0fd510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a28002a50 tx=0x7f0a280046b0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.544+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 shutdown_connections 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.544+0000 7f0a333ac700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0a1806d0e0 0x7f0a1806f590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.544+0000 7f0a333ac700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a2c0fda80 0x7f0a2c0fd510 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.544+0000 7f0a333ac700 1 --2- 172.21.15.33:0/3580166331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c1003a0 0x7f0a2c0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.544+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 >> 172.21.15.33:0/3580166331 conn(0x7f0a2c0f74e0 msgr2=0x7f0a2c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.544+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 shutdown_connections 2024-02-15T22:44:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.544+0000 7f0a333ac700 1 -- 172.21.15.33:0/3580166331 wait complete. 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 -- 172.21.15.33:0/571804541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fe0e0 msgr2=0x7f86840fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 --2- 172.21.15.33:0/571804541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fe0e0 0x7f86840fe550 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8674004940 tx=0x7f8674009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 -- 172.21.15.33:0/571804541 shutdown_connections 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 --2- 172.21.15.33:0/571804541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fe0e0 0x7f86840fe550 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 --2- 172.21.15.33:0/571804541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86840fcef0 0x7f86840fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 -- 172.21.15.33:0/571804541 >> 172.21.15.33:0/571804541 conn(0x7f86840f8620 msgr2=0x7f86840faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 -- 172.21.15.33:0/571804541 shutdown_connections 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.649+0000 7f8689e71700 1 -- 172.21.15.33:0/571804541 wait complete. 2024-02-15T22:44:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f8689e71700 1 Processor -- start 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f8689e71700 1 -- start start 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f8689e71700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fcef0 0x7f868410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f8689e71700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86840fe0e0 0x7f868410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f8689e71700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868410e4b0 con 0x7f86840fcef0 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f8689e71700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868410ed50 con 0x7f86840fe0e0 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f86837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fcef0 0x7f868410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f86837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fcef0 0x7f868410d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59180/0 (socket says 172.21.15.33:59180) 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.650+0000 7f86837fe700 1 -- 172.21.15.33:0/4261610995 learned_addr learned my addr 172.21.15.33:0/4261610995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f8682ffd700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86840fe0e0 0x7f868410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f86837fe700 1 -- 172.21.15.33:0/4261610995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86840fe0e0 msgr2=0x7f868410deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f86837fe700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86840fe0e0 0x7f868410deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f86837fe700 1 -- 172.21.15.33:0/4261610995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674005040 con 0x7f86840fcef0 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f86837fe700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fcef0 0x7f868410d970 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f867800c8b0 tx=0x7f8678004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f866bfff700 1 -- 172.21.15.33:0/4261610995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867800a760 con 0x7f86840fcef0 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868410f030 con 0x7f86840fcef0 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f866bfff700 1 -- 172.21.15.33:0/4261610995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f867800ad90 con 0x7f86840fcef0 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f866bfff700 1 -- 172.21.15.33:0/4261610995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86780113a0 con 0x7f86840fcef0 2024-02-15T22:44:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.651+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868410f570 con 0x7f86840fcef0 2024-02-15T22:44:08.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.652+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868404bed0 con 0x7f86840fcef0 2024-02-15T22:44:08.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.653+0000 7f866bfff700 1 -- 172.21.15.33:0/4261610995 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f8678012400 con 0x7f86840fcef0 2024-02-15T22:44:08.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.653+0000 7f866bfff700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f866c06d0f0 0x7f866c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.653+0000 7f866bfff700 1 -- 172.21.15.33:0/4261610995 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f867808c510 con 0x7f86840fcef0 2024-02-15T22:44:08.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.653+0000 7f8682ffd700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f866c06d0f0 0x7f866c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.654+0000 7f8682ffd700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f866c06d0f0 0x7f866c06f5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f867400b020 tx=0x7f8674009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.658+0000 7f866bfff700 1 -- 172.21.15.33:0/4261610995 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f867805a1c0 con 0x7f86840fcef0 2024-02-15T22:44:08.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.959+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f868410f9d0 con 0x7f86840fcef0 2024-02-15T22:44:08.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.959+0000 7f866bfff700 1 -- 172.21.15.33:0/4261610995 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8678059d50 con 0x7f86840fcef0 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:44:08.962 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:44:08.963 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 12, 2024-02-15T22:44:08.963 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:44:08.963 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:44:08.963 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:44:08.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f866c06d0f0 msgr2=0x7f866c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f866c06d0f0 0x7f866c06f5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f867400b020 tx=0x7f8674009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fcef0 msgr2=0x7f868410d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fcef0 0x7f868410d970 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f867800c8b0 tx=0x7f8678004470 comp rx=0 tx=0).stop 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 shutdown_connections 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f866c06d0f0 0x7f866c06f5a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86840fcef0 0x7f868410d970 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 --2- 172.21.15.33:0/4261610995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86840fe0e0 0x7f868410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.961+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 >> 172.21.15.33:0/4261610995 conn(0x7f86840f8620 msgr2=0x7f86841013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.962+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 shutdown_connections 2024-02-15T22:44:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:08.962+0000 7f8689e71700 1 -- 172.21.15.33:0/4261610995 wait complete. 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.065+0000 7ff6178ec700 1 -- 172.21.15.33:0/2143732066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 msgr2=0x7ff6100fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.065+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2143732066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff6100fd420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff600004940 tx=0x7ff600009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 -- 172.21.15.33:0/2143732066 shutdown_connections 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2143732066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff6100fd420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2143732066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6100fbe40 0x7ff6100fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 -- 172.21.15.33:0/2143732066 >> 172.21.15.33:0/2143732066 conn(0x7ff6100f7520 msgr2=0x7ff6100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 -- 172.21.15.33:0/2143732066 shutdown_connections 2024-02-15T22:44:09.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 -- 172.21.15.33:0/2143732066 wait complete. 2024-02-15T22:44:09.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 Processor -- start 2024-02-15T22:44:09.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 -- start start 2024-02-15T22:44:09.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6100fbe40 0x7ff610112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:09.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff610114f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:09.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610066be0 con 0x7ff6100fcfb0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.066+0000 7ff6178ec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610066d20 con 0x7ff6100fbe40 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff614e87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff610114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff614e87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff610114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59198/0 (socket says 172.21.15.33:59198) 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff614e87700 1 -- 172.21.15.33:0/2352942871 learned_addr learned my addr 172.21.15.33:0/2352942871 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff615688700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6100fbe40 0x7ff610112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff614e87700 1 -- 172.21.15.33:0/2352942871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6100fbe40 msgr2=0x7ff610112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff614e87700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6100fbe40 0x7ff610112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff614e87700 1 -- 172.21.15.33:0/2352942871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600005040 con 0x7ff6100fcfb0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff614e87700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff610114f90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff60000b3b0 tx=0x7ff600009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff605ffb700 1 -- 172.21.15.33:0/2352942871 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff60000e040 con 0x7ff6100fcfb0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff605ffb700 1 -- 172.21.15.33:0/2352942871 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff60000bd90 con 0x7ff6100fcfb0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6101154d0 con 0x7ff6100fcfb0 2024-02-15T22:44:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff605ffb700 1 -- 172.21.15.33:0/2352942871 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff60001c630 con 0x7ff6100fcfb0 2024-02-15T22:44:09.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.067+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff610115930 con 0x7ff6100fcfb0 2024-02-15T22:44:09.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.069+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61004bed0 con 0x7ff6100fcfb0 2024-02-15T22:44:09.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.069+0000 7ff605ffb700 1 -- 172.21.15.33:0/2352942871 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7ff6000139f0 con 0x7ff6100fcfb0 2024-02-15T22:44:09.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.069+0000 7ff605ffb700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7ff5fc06d0f0 0x7ff5fc06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:09.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.069+0000 7ff605ffb700 1 -- 172.21.15.33:0/2352942871 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7ff60008d940 con 0x7ff6100fcfb0 2024-02-15T22:44:09.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.069+0000 7ff615688700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7ff5fc06d0f0 0x7ff5fc06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:09.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.070+0000 7ff615688700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7ff5fc06d0f0 0x7ff5fc06f5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff610066970 tx=0x7ff60c009620 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:09.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.074+0000 7ff605ffb700 1 -- 172.21.15.33:0/2352942871 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff600057b60 con 0x7ff6100fcfb0 2024-02-15T22:44:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.297+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff610101990 con 0x7ff5fc06d0f0 2024-02-15T22:44:09.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.299+0000 7ff605ffb700 1 -- 172.21.15.33:0/2352942871 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ff610101990 con 0x7ff5fc06d0f0 2024-02-15T22:44:09.301 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:44:09.301 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading grafana daemons", 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:44:09.302 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:44:09.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7ff5fc06d0f0 msgr2=0x7ff5fc06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:09.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7ff5fc06d0f0 0x7ff5fc06f5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff610066970 tx=0x7ff60c009620 comp rx=0 tx=0).stop 2024-02-15T22:44:09.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 msgr2=0x7ff610114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:09.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff610114f90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff60000b3b0 tx=0x7ff600009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:09.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 shutdown_connections 2024-02-15T22:44:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7ff5fc06d0f0 0x7ff5fc06f5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6100fbe40 0x7ff610112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 --2- 172.21.15.33:0/2352942871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6100fcfb0 0x7ff610114f90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 >> 172.21.15.33:0/2352942871 conn(0x7ff6100f7520 msgr2=0x7ff610100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 shutdown_connections 2024-02-15T22:44:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:09.302+0000 7ff6178ec700 1 -- 172.21.15.33:0/2352942871 wait complete. 2024-02-15T22:44:09.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:09 smithi082 ceph-mon[37153]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:09.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:09 smithi082 ceph-mon[37153]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:09.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:09 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/4261610995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:09.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:09 smithi033 ceph-mon[29033]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:09.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:09 smithi033 ceph-mon[29033]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:09.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:09 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/4261610995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:10.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:10 smithi082 ceph-mon[37153]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:10.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:10 smithi082 ceph-mon[37153]: pgmap v52: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:44:10.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:10 smithi082 ceph-mon[37153]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:10.477 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:10 smithi033 ceph-mon[29033]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:10.477 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:10 smithi033 ceph-mon[29033]: pgmap v52: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:44:10.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:10 smithi033 ceph-mon[29033]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:12.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:12 smithi082 ceph-mon[37153]: pgmap v53: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:44:12.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:12 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:12.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:12 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:12.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:12 smithi033 ceph-mon[29033]: pgmap v53: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:44:12.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:12 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:12.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:12 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:14.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:13 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:13 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:13 smithi082 ceph-mon[37153]: pgmap v54: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:44:14.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:13 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:14.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:13 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:14.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:13 smithi033 ceph-mon[29033]: pgmap v54: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:44:16.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:15 smithi033 ceph-mon[29033]: pgmap v55: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:16.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:15 smithi082 ceph-mon[37153]: pgmap v55: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T22:44:17.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T22:44:17.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:17.275 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:17.276 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:17.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:17.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T22:44:17.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:17.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:18.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:17 smithi033 ceph-mon[29033]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:18.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:17 smithi033 ceph-mon[29033]: Upgrade: Finalizing container_image settings 2024-02-15T22:44:18.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:17 smithi033 ceph-mon[29033]: Upgrade: Complete! 2024-02-15T22:44:18.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:17 smithi033 ceph-mon[29033]: pgmap v56: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:18.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:17 smithi082 ceph-mon[37153]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:18.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:17 smithi082 ceph-mon[37153]: Upgrade: Finalizing container_image settings 2024-02-15T22:44:18.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:17 smithi082 ceph-mon[37153]: Upgrade: Complete! 2024-02-15T22:44:18.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:17 smithi082 ceph-mon[37153]: pgmap v56: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:20.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:19 smithi033 ceph-mon[29033]: pgmap v57: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:20.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:19 smithi082 ceph-mon[37153]: pgmap v57: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:22.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:21 smithi033 ceph-mon[29033]: pgmap v58: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:22.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:21 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:22.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:21 smithi082 ceph-mon[37153]: pgmap v58: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:22.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:21 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:44:24.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:24 smithi033 ceph-mon[29033]: pgmap v59: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:24.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:24 smithi082 ceph-mon[37153]: pgmap v59: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:26.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:26 smithi033 ceph-mon[29033]: pgmap v60: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:26.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:26 smithi082 ceph-mon[37153]: pgmap v60: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:28.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:28 smithi033 ceph-mon[29033]: pgmap v61: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:28.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:28 smithi082 ceph-mon[37153]: pgmap v61: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:30.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:30 smithi033 ceph-mon[29033]: pgmap v62: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:30.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:30 smithi082 ceph-mon[37153]: pgmap v62: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:31.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:31 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:31 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:32.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:32 smithi033 ceph-mon[29033]: pgmap v63: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:32.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:32 smithi082 ceph-mon[37153]: pgmap v63: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:34.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:34 smithi033 ceph-mon[29033]: pgmap v64: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:34.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:34 smithi082 ceph-mon[37153]: pgmap v64: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:36.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:36 smithi033 ceph-mon[29033]: pgmap v65: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:36.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:36 smithi082 ceph-mon[37153]: pgmap v65: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:38.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:38 smithi082 ceph-mon[37153]: pgmap v66: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:38.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:38 smithi033 ceph-mon[29033]: pgmap v66: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:39.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 -- 172.21.15.33:0/2803890120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 msgr2=0x7f288c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:39.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 --2- 172.21.15.33:0/2803890120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0fe550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2880004940 tx=0x7f2880009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:39.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 -- 172.21.15.33:0/2803890120 shutdown_connections 2024-02-15T22:44:39.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 --2- 172.21.15.33:0/2803890120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0fe550 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:39.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 --2- 172.21.15.33:0/2803890120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f288c0fcef0 0x7f288c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:39.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 -- 172.21.15.33:0/2803890120 >> 172.21.15.33:0/2803890120 conn(0x7f288c0f8620 msgr2=0x7f288c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:39.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 -- 172.21.15.33:0/2803890120 shutdown_connections 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.424+0000 7f2890ada700 1 -- 172.21.15.33:0/2803890120 wait complete. 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2890ada700 1 Processor -- start 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2890ada700 1 -- start start 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2890ada700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f288c0fcef0 0x7f288c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2890ada700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2890ada700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0708e0 con 0x7f288c0fe0e0 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2890ada700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c070a50 con 0x7f288c0fcef0 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2889d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2889d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59346/0 (socket says 172.21.15.33:59346) 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2889d9b700 1 -- 172.21.15.33:0/928540212 learned_addr learned my addr 172.21.15.33:0/928540212 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f288a59c700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f288c0fcef0 0x7f288c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2889d9b700 1 -- 172.21.15.33:0/928540212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f288c0fcef0 msgr2=0x7f288c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:39.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2889d9b700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f288c0fcef0 0x7f288c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2889d9b700 1 -- 172.21.15.33:0/928540212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2880005040 con 0x7f288c0fe0e0 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f288a59c700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f288c0fcef0 0x7f288c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.425+0000 7f2889d9b700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0702e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f28800093b0 tx=0x7f2880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.426+0000 7f287affd700 1 -- 172.21.15.33:0/928540212 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f288000e040 con 0x7f288c0fe0e0 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.426+0000 7f287affd700 1 -- 172.21.15.33:0/928540212 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f288000bcc0 con 0x7f288c0fe0e0 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.426+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c070cd0 con 0x7f288c0fe0e0 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.426+0000 7f287affd700 1 -- 172.21.15.33:0/928540212 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f288001c630 con 0x7f288c0fe0e0 2024-02-15T22:44:39.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.426+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c115990 con 0x7f288c0fe0e0 2024-02-15T22:44:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.427+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c04bed0 con 0x7f288c0fe0e0 2024-02-15T22:44:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.427+0000 7f287affd700 1 -- 172.21.15.33:0/928540212 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f28800139f0 con 0x7f288c0fe0e0 2024-02-15T22:44:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.428+0000 7f287affd700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f287406d0e0 0x7f287406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.428+0000 7f287affd700 1 -- 172.21.15.33:0/928540212 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f288008d960 con 0x7f288c0fe0e0 2024-02-15T22:44:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.428+0000 7f288a59c700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f287406d0e0 0x7f287406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.428+0000 7f288a59c700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f287406d0e0 0x7f287406f590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f288c071bf0 tx=0x7f287c009040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:39.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.432+0000 7f287affd700 1 -- 172.21.15.33:0/928540212 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f288005b610 con 0x7f288c0fe0e0 2024-02-15T22:44:39.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.657+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f288c102ac0 con 0x7f287406d0e0 2024-02-15T22:44:39.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.658+0000 7f287affd700 1 -- 172.21.15.33:0/928540212 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f288c102ac0 con 0x7f287406d0e0 2024-02-15T22:44:39.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f287406d0e0 msgr2=0x7f287406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:39.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f287406d0e0 0x7f287406f590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f288c071bf0 tx=0x7f287c009040 comp rx=0 tx=0).stop 2024-02-15T22:44:39.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 msgr2=0x7f288c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:39.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0702e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f28800093b0 tx=0x7f2880009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:39.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 shutdown_connections 2024-02-15T22:44:39.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f287406d0e0 0x7f287406f590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:39.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f288c0fcef0 0x7f288c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:39.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 --2- 172.21.15.33:0/928540212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f288c0fe0e0 0x7f288c0702e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:39.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 >> 172.21.15.33:0/928540212 conn(0x7f288c0f8620 msgr2=0x7f288c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:39.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 shutdown_connections 2024-02-15T22:44:39.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:39.661+0000 7f2890ada700 1 -- 172.21.15.33:0/928540212 wait complete. 2024-02-15T22:44:40.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:40 smithi033 ceph-mon[29033]: pgmap v67: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:40.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-15T22:44:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:40 smithi082 ceph-mon[37153]: pgmap v67: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:40.661 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:44:41.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:41 smithi082 ceph-mon[37153]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:41.502 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:41 smithi033 ceph-mon[29033]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:42.322 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:42 smithi033 ceph-mon[29033]: pgmap v68: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:42.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 -- 172.21.15.33:0/876245127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 msgr2=0x7f04000fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:42.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 --2- 172.21.15.33:0/876245127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f04000fbea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f03f0004940 tx=0x7f03f0009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:42.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 -- 172.21.15.33:0/876245127 shutdown_connections 2024-02-15T22:44:42.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 --2- 172.21.15.33:0/876245127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f04000fbea0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:42.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 --2- 172.21.15.33:0/876245127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0400101e40 0x7f0400102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:42.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 -- 172.21.15.33:0/876245127 >> 172.21.15.33:0/876245127 conn(0x7f0400071d90 msgr2=0x7f0400072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:42.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 -- 172.21.15.33:0/876245127 shutdown_connections 2024-02-15T22:44:42.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.331+0000 7f04065f5700 1 -- 172.21.15.33:0/876245127 wait complete. 2024-02-15T22:44:42.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f04065f5700 1 Processor -- start 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f04065f5700 1 -- start start 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f04065f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0400101e40 0x7f0400112970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f04065f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f0400112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f04065f5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400113500 con 0x7f04001027e0 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f04065f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040010c830 con 0x7f0400101e40 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f03ff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f0400112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f03ff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f0400112eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59360/0 (socket says 172.21.15.33:59360) 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.332+0000 7f03ff7fe700 1 -- 172.21.15.33:0/210343125 learned_addr learned my addr 172.21.15.33:0/210343125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03fffff700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0400101e40 0x7f0400112970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03ff7fe700 1 -- 172.21.15.33:0/210343125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0400101e40 msgr2=0x7f0400112970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03ff7fe700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0400101e40 0x7f0400112970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03ff7fe700 1 -- 172.21.15.33:0/210343125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f0005040 con 0x7f04001027e0 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03fffff700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0400101e40 0x7f0400112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:44:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03ff7fe700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f0400112eb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009150 tx=0x7f03f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:42.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03fcff9700 1 -- 172.21.15.33:0/210343125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f000e040 con 0x7f04001027e0 2024-02-15T22:44:42.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040010cab0 con 0x7f04001027e0 2024-02-15T22:44:42.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03fcff9700 1 -- 172.21.15.33:0/210343125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03f000bbf0 con 0x7f04001027e0 2024-02-15T22:44:42.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f03fcff9700 1 -- 172.21.15.33:0/210343125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f001c630 con 0x7f04001027e0 2024-02-15T22:44:42.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.333+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040010cff0 con 0x7f04001027e0 2024-02-15T22:44:42.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.334+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04000738b0 con 0x7f04001027e0 2024-02-15T22:44:42.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.335+0000 7f03fcff9700 1 -- 172.21.15.33:0/210343125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f03f000bd60 con 0x7f04001027e0 2024-02-15T22:44:42.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.335+0000 7f03fcff9700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f03ec06d0e0 0x7f03ec06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:42.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.335+0000 7f03fcff9700 1 -- 172.21.15.33:0/210343125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f03f008d900 con 0x7f04001027e0 2024-02-15T22:44:42.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.335+0000 7f03fffff700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f03ec06d0e0 0x7f03ec06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:42.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.336+0000 7f03fffff700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f03ec06d0e0 0x7f03ec06f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03e8007fd0 tx=0x7f03e8009f60 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:42.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.340+0000 7f03fcff9700 1 -- 172.21.15.33:0/210343125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f03f005b5b0 con 0x7f04001027e0 2024-02-15T22:44:42.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:42 smithi082 ceph-mon[37153]: pgmap v68: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:42.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.629+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f040004bed0 con 0x7f04001027e0 2024-02-15T22:44:42.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.629+0000 7f03fcff9700 1 -- 172.21.15.33:0/210343125 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f03f005b140 con 0x7f04001027e0 2024-02-15T22:44:42.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.631+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f03ec06d0e0 msgr2=0x7f03ec06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:42.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.631+0000 7f04065f5700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f03ec06d0e0 0x7f03ec06f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03e8007fd0 tx=0x7f03e8009f60 comp rx=0 tx=0).stop 2024-02-15T22:44:42.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.631+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 msgr2=0x7f0400112eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:42.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.631+0000 7f04065f5700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f0400112eb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009150 tx=0x7f03f0009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:42.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.632+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 shutdown_connections 2024-02-15T22:44:42.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.632+0000 7f04065f5700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f03ec06d0e0 0x7f03ec06f590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:42.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.632+0000 7f04065f5700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0400101e40 0x7f0400112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:42.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.632+0000 7f04065f5700 1 --2- 172.21.15.33:0/210343125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04001027e0 0x7f0400112eb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:42.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.632+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 >> 172.21.15.33:0/210343125 conn(0x7f0400071d90 msgr2=0x7f04000fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:42.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.632+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 shutdown_connections 2024-02-15T22:44:42.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:42.632+0000 7f04065f5700 1 -- 172.21.15.33:0/210343125 wait complete. 2024-02-15T22:44:42.643 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:44:43.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:43 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/210343125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:43.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:43 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/210343125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:43.398 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-15T22:44:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:44:44.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:44 smithi033 ceph-mon[29033]: pgmap v69: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:44.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:44 smithi082 ceph-mon[37153]: pgmap v69: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 -- 172.21.15.33:0/3769692226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 msgr2=0x7fdbe80fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/3769692226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe80fb9c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0004940 tx=0x7fdbd0009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 -- 172.21.15.33:0/3769692226 shutdown_connections 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/3769692226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe80fb9c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/3769692226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8103140 0x7fdbe8103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 -- 172.21.15.33:0/3769692226 >> 172.21.15.33:0/3769692226 conn(0x7fdbe8071560 msgr2=0x7fdbe8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 -- 172.21.15.33:0/3769692226 shutdown_connections 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.403+0000 7fdbed8a1700 1 -- 172.21.15.33:0/3769692226 wait complete. 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbed8a1700 1 Processor -- start 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbed8a1700 1 -- start start 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbed8a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe8113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbed8a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8103140 0x7fdbe8114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbed8a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe81146c0 con 0x7fdbe80fb570 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbed8a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe810d9f0 con 0x7fdbe8103140 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbe6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe8113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbe6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe8113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59374/0 (socket says 172.21.15.33:59374) 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbe6ffd700 1 -- 172.21.15.33:0/4156622418 learned_addr learned my addr 172.21.15.33:0/4156622418 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbe67fc700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8103140 0x7fdbe8114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbe6ffd700 1 -- 172.21.15.33:0/4156622418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8103140 msgr2=0x7fdbe8114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbe6ffd700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8103140 0x7fdbe8114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.404+0000 7fdbe6ffd700 1 -- 172.21.15.33:0/4156622418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0005040 con 0x7fdbe80fb570 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.405+0000 7fdbe67fc700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8103140 0x7fdbe8114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.405+0000 7fdbe6ffd700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe8113b30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800cb10 tx=0x7fdbd8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.405+0000 7fdbdf7fe700 1 -- 172.21.15.33:0/4156622418 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8004200 con 0x7fdbe80fb570 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.405+0000 7fdbdf7fe700 1 -- 172.21.15.33:0/4156622418 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbd800acc0 con 0x7fdbe80fb570 2024-02-15T22:44:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.405+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe810dcd0 con 0x7fdbe80fb570 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.405+0000 7fdbdf7fe700 1 -- 172.21.15.33:0/4156622418 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8003d90 con 0x7fdbe80fb570 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.405+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe810e210 con 0x7fdbe80fb570 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.406+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe81054d0 con 0x7fdbe80fb570 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.406+0000 7fdbdf7fe700 1 -- 172.21.15.33:0/4156622418 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fdbd8003430 con 0x7fdbe80fb570 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.407+0000 7fdbdf7fe700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fdbd406d0e0 0x7fdbd406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.407+0000 7fdbdf7fe700 1 -- 172.21.15.33:0/4156622418 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fdbd808ca90 con 0x7fdbe80fb570 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.407+0000 7fdbe67fc700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fdbd406d0e0 0x7fdbd406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.407+0000 7fdbe67fc700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fdbd406d0e0 0x7fdbd406f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009fd0 tx=0x7fdbd0009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.411+0000 7fdbdf7fe700 1 -- 172.21.15.33:0/4156622418 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fdbd805a6c0 con 0x7fdbe80fb570 2024-02-15T22:44:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.697+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdbe804bed0 con 0x7fdbe80fb570 2024-02-15T22:44:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.698+0000 7fdbdf7fe700 1 -- 172.21.15.33:0/4156622418 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fdbd805a250 con 0x7fdbe80fb570 2024-02-15T22:44:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fdbd406d0e0 msgr2=0x7fdbd406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fdbd406d0e0 0x7fdbd406f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009fd0 tx=0x7fdbd0009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 msgr2=0x7fdbe8113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe8113b30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800cb10 tx=0x7fdbd8007f90 comp rx=0 tx=0).stop 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 shutdown_connections 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fdbd406d0e0 0x7fdbd406f590 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80fb570 0x7fdbe8113b30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 --2- 172.21.15.33:0/4156622418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8103140 0x7fdbe8114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 >> 172.21.15.33:0/4156622418 conn(0x7fdbe8071560 msgr2=0x7fdbe80f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 shutdown_connections 2024-02-15T22:44:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:45.700+0000 7fdbed8a1700 1 -- 172.21.15.33:0/4156622418 wait complete. 2024-02-15T22:44:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-15T22:44:46.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:46 smithi033 ceph-mon[29033]: pgmap v70: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:46.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:46 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/4156622418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:46.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:46 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:46.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:46 smithi082 ceph-mon[37153]: pgmap v70: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:46.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:46 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/4156622418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:46.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:46 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:46.445 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-15T22:44:46.706 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:44:48.181 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:48 smithi033 ceph-mon[29033]: pgmap v71: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:48.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:48 smithi082 ceph-mon[37153]: pgmap v71: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 -- 172.21.15.33:0/2432168008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 msgr2=0x7f06240fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 --2- 172.21.15.33:0/2432168008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f06240fcf60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0618004940 tx=0x7f0618009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 -- 172.21.15.33:0/2432168008 shutdown_connections 2024-02-15T22:44:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 --2- 172.21.15.33:0/2432168008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f06240fcf60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 --2- 172.21.15.33:0/2432168008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0624102f50 0x7f0624103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 -- 172.21.15.33:0/2432168008 >> 172.21.15.33:0/2432168008 conn(0x7f06240f8ae0 msgr2=0x7f06240faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 -- 172.21.15.33:0/2432168008 shutdown_connections 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.405+0000 7f062a0aa700 1 -- 172.21.15.33:0/2432168008 wait complete. 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f062a0aa700 1 Processor -- start 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f062a0aa700 1 -- start start 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f062a0aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0624102f50 0x7f0624113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f062a0aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f0624113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f062a0aa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624114620 con 0x7f06241038f0 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f062a0aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062410d950 con 0x7f0624102f50 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f0622ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f0624113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f0622ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f0624113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43290/0 (socket says 172.21.15.33:43290) 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f0622ffd700 1 -- 172.21.15.33:0/3830381154 learned_addr learned my addr 172.21.15.33:0/3830381154 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.406+0000 7f06237fe700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0624102f50 0x7f0624113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f0622ffd700 1 -- 172.21.15.33:0/3830381154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0624102f50 msgr2=0x7f0624113a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f0622ffd700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0624102f50 0x7f0624113a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f0622ffd700 1 -- 172.21.15.33:0/3830381154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618005040 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f0622ffd700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f0624113fd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0618009150 tx=0x7f0618009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f060bfff700 1 -- 172.21.15.33:0/3830381154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061800e040 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f060bfff700 1 -- 172.21.15.33:0/3830381154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f061800bbf0 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062410dbd0 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f060bfff700 1 -- 172.21.15.33:0/3830381154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061801c3f0 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.407+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062410e110 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.408+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0624105420 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.408+0000 7f060bfff700 1 -- 172.21.15.33:0/3830381154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f061800bd60 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.409+0000 7f060bfff700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f060c06d0e0 0x7f060c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.409+0000 7f060bfff700 1 -- 172.21.15.33:0/3830381154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f061808d7a0 con 0x7f06241038f0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.409+0000 7f06237fe700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f060c06d0e0 0x7f060c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.409+0000 7f06237fe700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f060c06d0e0 0x7f060c06f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0614007fd0 tx=0x7f0614009040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.413+0000 7f060bfff700 1 -- 172.21.15.33:0/3830381154 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f061805b4f0 con 0x7f06241038f0 2024-02-15T22:44:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.701+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f062410a030 con 0x7f06241038f0 2024-02-15T22:44:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.702+0000 7f060bfff700 1 -- 172.21.15.33:0/3830381154 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f061805b080 con 0x7f06241038f0 2024-02-15T22:44:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f060c06d0e0 msgr2=0x7f060c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f060c06d0e0 0x7f060c06f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0614007fd0 tx=0x7f0614009040 comp rx=0 tx=0).stop 2024-02-15T22:44:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 msgr2=0x7f0624113fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f0624113fd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0618009150 tx=0x7f0618009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 shutdown_connections 2024-02-15T22:44:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f060c06d0e0 0x7f060c06f590 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0624102f50 0x7f0624113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 --2- 172.21.15.33:0/3830381154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06241038f0 0x7f0624113fd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 >> 172.21.15.33:0/3830381154 conn(0x7f06240f8ae0 msgr2=0x7f06240fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 shutdown_connections 2024-02-15T22:44:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:48.704+0000 7f062a0aa700 1 -- 172.21.15.33:0/3830381154 wait complete. 2024-02-15T22:44:48.715 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:44:49.353 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:49 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/3830381154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:49.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:49 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/3830381154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:44:49.380 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-15T22:44:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:44:50.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:50 smithi082 ceph-mon[37153]: pgmap v72: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:50.477 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:50 smithi033 ceph-mon[29033]: pgmap v72: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 -- 172.21.15.33:0/4011082919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e00702b0 msgr2=0x7f47e0070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/4011082919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e00702b0 0x7f47e0070680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009ce0 tx=0x7f47d8004d10 comp rx=0 tx=0).stop 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 -- 172.21.15.33:0/4011082919 shutdown_connections 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/4011082919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e0070bc0 0x7f47e01092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/4011082919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e00702b0 0x7f47e0070680 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 -- 172.21.15.33:0/4011082919 >> 172.21.15.33:0/4011082919 conn(0x7f47e00f8ae0 msgr2=0x7f47e00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 -- 172.21.15.33:0/4011082919 shutdown_connections 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 -- 172.21.15.33:0/4011082919 wait complete. 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 Processor -- start 2024-02-15T22:44:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.328+0000 7f47e4b5c700 1 -- start start 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47e4b5c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00702b0 0x7f47e0115e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47e4b5c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e0070bc0 0x7f47e0116350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47e4b5c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0116a30 con 0x7f47e0070bc0 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47e4b5c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e010fcb0 con 0x7f47e00702b0 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47ddd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e0070bc0 0x7f47e0116350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47ddd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e0070bc0 0x7f47e0116350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43308/0 (socket says 172.21.15.33:43308) 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47ddd9b700 1 -- 172.21.15.33:0/584768842 learned_addr learned my addr 172.21.15.33:0/584768842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47de59c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00702b0 0x7f47e0115e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47ddd9b700 1 -- 172.21.15.33:0/584768842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00702b0 msgr2=0x7f47e0115e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47ddd9b700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00702b0 0x7f47e0115e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47ddd9b700 1 -- 172.21.15.33:0/584768842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009940 con 0x7f47e0070bc0 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47ddd9b700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e0070bc0 0x7f47e0116350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f47c800b790 tx=0x7f47c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:51.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47d6ffd700 1 -- 172.21.15.33:0/584768842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c800f6f0 con 0x7f47e0070bc0 2024-02-15T22:44:51.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e010ff30 con 0x7f47e0070bc0 2024-02-15T22:44:51.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47d6ffd700 1 -- 172.21.15.33:0/584768842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47c800fd20 con 0x7f47e0070bc0 2024-02-15T22:44:51.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47d6ffd700 1 -- 172.21.15.33:0/584768842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c80103a0 con 0x7f47e0070bc0 2024-02-15T22:44:51.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.329+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e0110470 con 0x7f47e0070bc0 2024-02-15T22:44:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.330+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e01069a0 con 0x7f47e0070bc0 2024-02-15T22:44:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.331+0000 7f47d6ffd700 1 -- 172.21.15.33:0/584768842 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f47c8011400 con 0x7f47e0070bc0 2024-02-15T22:44:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.331+0000 7f47d6ffd700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f47cc06d0e0 0x7f47cc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.332+0000 7f47d6ffd700 1 -- 172.21.15.33:0/584768842 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f47c808c300 con 0x7f47e0070bc0 2024-02-15T22:44:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.332+0000 7f47de59c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f47cc06d0e0 0x7f47cc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.332+0000 7f47de59c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f47cc06d0e0 0x7f47cc06f590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f47d8015040 tx=0x7f47d8004d10 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:51.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.336+0000 7f47d6ffd700 1 -- 172.21.15.33:0/584768842 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f47c8059fb0 con 0x7f47e0070bc0 2024-02-15T22:44:51.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:51.555+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e01113f0 con 0x7f47cc06d0e0 2024-02-15T22:44:52.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:52 smithi082 ceph-mon[37153]: pgmap v73: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:52.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:52 smithi033 ceph-mon[29033]: pgmap v73: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:53.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:53 smithi082 ceph-mon[37153]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:53.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:53 smithi033 ceph-mon[29033]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.726+0000 7f47d6ffd700 1 -- 172.21.15.33:0/584768842 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f47e01113f0 con 0x7f47cc06d0e0 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.728+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f47cc06d0e0 msgr2=0x7f47cc06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.728+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f47cc06d0e0 0x7f47cc06f590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f47d8015040 tx=0x7f47d8004d10 comp rx=0 tx=0).stop 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.728+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e0070bc0 msgr2=0x7f47e0116350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.728+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e0070bc0 0x7f47e0116350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f47c800b790 tx=0x7f47c8009250 comp rx=0 tx=0).stop 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.729+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 shutdown_connections 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.729+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f47cc06d0e0 0x7f47cc06f590 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.729+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00702b0 0x7f47e0115e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.729+0000 7f47e4b5c700 1 --2- 172.21.15.33:0/584768842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47e0070bc0 0x7f47e0116350 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.729+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 >> 172.21.15.33:0/584768842 conn(0x7f47e00f8ae0 msgr2=0x7f47e0103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.729+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 shutdown_connections 2024-02-15T22:44:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:53.729+0000 7f47e4b5c700 1 -- 172.21.15.33:0/584768842 wait complete. 2024-02-15T22:44:53.741 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:44:54.314 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:54 smithi033 ceph-mon[29033]: pgmap v74: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:54.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-15T22:44:54.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:54 smithi082 ceph-mon[37153]: pgmap v74: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:44:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:44:56.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:56 smithi033 ceph-mon[29033]: pgmap v75: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 -- 172.21.15.33:0/2765332259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fdf60 msgr2=0x7f30700fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 --2- 172.21.15.33:0/2765332259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fdf60 0x7f30700fe330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3068009ce0 tx=0x7f3068004d10 comp rx=0 tx=0).stop 2024-02-15T22:44:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 -- 172.21.15.33:0/2765332259 shutdown_connections 2024-02-15T22:44:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 --2- 172.21.15.33:0/2765332259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30700fe900 0x7f3070106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 --2- 172.21.15.33:0/2765332259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fdf60 0x7f30700fe330 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 -- 172.21.15.33:0/2765332259 >> 172.21.15.33:0/2765332259 conn(0x7f30700f7a10 msgr2=0x7f30700f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 -- 172.21.15.33:0/2765332259 shutdown_connections 2024-02-15T22:44:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 -- 172.21.15.33:0/2765332259 wait complete. 2024-02-15T22:44:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 Processor -- start 2024-02-15T22:44:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.253+0000 7f3075970700 1 -- start start 2024-02-15T22:44:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f3075970700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30700fdf60 0x7f30700fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f3075970700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fe900 0x7f30700fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f3075970700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700fc8d0 con 0x7f30700fe900 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f3075970700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700fca40 con 0x7f30700fdf60 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fe900 0x7f30700fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fe900 0x7f30700fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43324/0 (socket says 172.21.15.33:43324) 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306e7fc700 1 -- 172.21.15.33:0/1493450117 learned_addr learned my addr 172.21.15.33:0/1493450117 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306effd700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30700fdf60 0x7f30700fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306e7fc700 1 -- 172.21.15.33:0/1493450117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30700fdf60 msgr2=0x7f30700fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306e7fc700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30700fdf60 0x7f30700fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306e7fc700 1 -- 172.21.15.33:0/1493450117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009940 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f306e7fc700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fe900 0x7f30700fc2d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3058002a50 tx=0x7f30580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f30677fe700 1 -- 172.21.15.33:0/1493450117 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3058007cc0 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f30677fe700 1 -- 172.21.15.33:0/1493450117 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f305800f040 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f30677fe700 1 -- 172.21.15.33:0/1493450117 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f305800da30 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3070119ce0 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.254+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307011a170 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.255+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3070104550 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.256+0000 7f30677fe700 1 -- 172.21.15.33:0/1493450117 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f305800db90 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.256+0000 7f30677fe700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f305c06d0e0 0x7f305c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.256+0000 7f30677fe700 1 -- 172.21.15.33:0/1493450117 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f305808c270 con 0x7f30700fe900 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.256+0000 7f306effd700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f305c06d0e0 0x7f305c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:56.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.257+0000 7f306effd700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f305c06d0e0 0x7f305c06f590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f306800b740 tx=0x7f3068004d10 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:56.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.261+0000 7f30677fe700 1 -- 172.21.15.33:0/1493450117 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3058056370 con 0x7f30700fe900 2024-02-15T22:44:56.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:56 smithi082 ceph-mon[37153]: pgmap v75: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:44:56.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.472+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30700fb5e0 con 0x7f305c06d0e0 2024-02-15T22:44:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.482+0000 7f30677fe700 1 -- 172.21.15.33:0/1493450117 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f30700fb5e0 con 0x7f305c06d0e0 2024-02-15T22:44:56.483 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (67s) 44s ago 12m 16.2M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (12m) 44s ago 12m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (11m) 99s ago 11m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (50s) 44s ago 11m 55.2M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (6m) 44s ago 6m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (6m) 44s ago 6m 75.1M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (6m) 99s ago 6m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:44:56.484 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (6m) 99s ago 6m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (2m) 44s ago 13m 498M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (119s) 99s ago 11m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (13m) 44s ago 13m 57.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (10m) 99s ago 10m 41.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (106s) 44s ago 12m 7512k - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (102s) 99s ago 11m 3389k - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (10m) 44s ago 10m 212M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (9m) 44s ago 9m 230M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (9m) 44s ago 9m 197M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (8m) 99s ago 8m 260M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (8m) 99s ago 8m 230M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:44:56.485 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (8m) 99s ago 7m 224M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:44:56.486 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (85s) 44s ago 11m 46.7M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:44:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f305c06d0e0 msgr2=0x7f305c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f305c06d0e0 0x7f305c06f590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f306800b740 tx=0x7f3068004d10 comp rx=0 tx=0).stop 2024-02-15T22:44:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fe900 msgr2=0x7f30700fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fe900 0x7f30700fc2d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3058002a50 tx=0x7f30580046b0 comp rx=0 tx=0).stop 2024-02-15T22:44:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 shutdown_connections 2024-02-15T22:44:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f305c06d0e0 0x7f305c06f590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30700fdf60 0x7f30700fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 --2- 172.21.15.33:0/1493450117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30700fe900 0x7f30700fc2d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 >> 172.21.15.33:0/1493450117 conn(0x7f30700f7a10 msgr2=0x7f30701016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 shutdown_connections 2024-02-15T22:44:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:56.484+0000 7f3075970700 1 -- 172.21.15.33:0/1493450117 wait complete. 2024-02-15T22:44:57.039 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:44:57.040 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:44:57.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-15T22:44:57.311 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:44:58.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:58 smithi082 ceph-mon[37153]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:58.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:44:58 smithi082 ceph-mon[37153]: pgmap v76: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:58.421 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:58 smithi033 ceph-mon[29033]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:58.421 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:44:58 smithi033 ceph-mon[29033]: pgmap v76: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:44:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 -- 172.21.15.33:0/3107721735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c70102f50 msgr2=0x7f1c70103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 --2- 172.21.15.33:0/3107721735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c70102f50 0x7f1c70103320 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1c60004940 tx=0x7f1c60009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 -- 172.21.15.33:0/3107721735 shutdown_connections 2024-02-15T22:44:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 --2- 172.21.15.33:0/3107721735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c701038f0 0x7f1c700fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 --2- 172.21.15.33:0/3107721735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c70102f50 0x7f1c70103320 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 -- 172.21.15.33:0/3107721735 >> 172.21.15.33:0/3107721735 conn(0x7f1c700f8ae0 msgr2=0x7f1c700faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 -- 172.21.15.33:0/3107721735 shutdown_connections 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.971+0000 7f1c77bed700 1 -- 172.21.15.33:0/3107721735 wait complete. 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c77bed700 1 Processor -- start 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c77bed700 1 -- start start 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c77bed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c70102f50 0x7f1c70113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c77bed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c701038f0 0x7f1c70113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c77bed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c701145f0 con 0x7f1c701038f0 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c77bed700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7010d920 con 0x7f1c70102f50 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c75188700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c701038f0 0x7f1c70113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c75188700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c701038f0 0x7f1c70113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34404/0 (socket says 172.21.15.33:34404) 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c75188700 1 -- 172.21.15.33:0/1717812562 learned_addr learned my addr 172.21.15.33:0/1717812562 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:44:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c75989700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c70102f50 0x7f1c70113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c75188700 1 -- 172.21.15.33:0/1717812562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c70102f50 msgr2=0x7f1c70113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.972+0000 7f1c75188700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c70102f50 0x7f1c70113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.973+0000 7f1c75188700 1 -- 172.21.15.33:0/1717812562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60005040 con 0x7f1c701038f0 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.973+0000 7f1c75188700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c701038f0 0x7f1c70113fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c002a50 tx=0x7f1c6c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.973+0000 7f1c667fc700 1 -- 172.21.15.33:0/1717812562 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c007cc0 con 0x7f1c701038f0 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.973+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7010dc00 con 0x7f1c701038f0 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.973+0000 7f1c667fc700 1 -- 172.21.15.33:0/1717812562 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c6c00f040 con 0x7f1c701038f0 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.973+0000 7f1c667fc700 1 -- 172.21.15.33:0/1717812562 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c00d9c0 con 0x7f1c701038f0 2024-02-15T22:44:58.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.973+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7010e140 con 0x7f1c701038f0 2024-02-15T22:44:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.974+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c70100260 con 0x7f1c701038f0 2024-02-15T22:44:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.974+0000 7f1c667fc700 1 -- 172.21.15.33:0/1717812562 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f1c6c009730 con 0x7f1c701038f0 2024-02-15T22:44:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.975+0000 7f1c667fc700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f1c5c06d0e0 0x7f1c5c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.975+0000 7f1c667fc700 1 -- 172.21.15.33:0/1717812562 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f1c6c08c280 con 0x7f1c701038f0 2024-02-15T22:44:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.975+0000 7f1c75989700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f1c5c06d0e0 0x7f1c5c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.975+0000 7f1c75989700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f1c5c06d0e0 0x7f1c5c06f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c60004f90 tx=0x7f1c60009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:58.980+0000 7f1c667fc700 1 -- 172.21.15.33:0/1717812562 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1c6c059eb0 con 0x7f1c701038f0 2024-02-15T22:44:59.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.190+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f1c7004bed0 con 0x7f1c701038f0 2024-02-15T22:44:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.196+0000 7f1c667fc700 1 -- 172.21.15.33:0/1717812562 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1c6c059a40 con 0x7f1c701038f0 2024-02-15T22:44:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f1c5c06d0e0 msgr2=0x7f1c5c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f1c5c06d0e0 0x7f1c5c06f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c60004f90 tx=0x7f1c60009e30 comp rx=0 tx=0).stop 2024-02-15T22:44:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c701038f0 msgr2=0x7f1c70113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c701038f0 0x7f1c70113fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c002a50 tx=0x7f1c6c004600 comp rx=0 tx=0).stop 2024-02-15T22:44:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 shutdown_connections 2024-02-15T22:44:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f1c5c06d0e0 0x7f1c5c06f590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c70102f50 0x7f1c70113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 --2- 172.21.15.33:0/1717812562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c701038f0 0x7f1c70113fa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 >> 172.21.15.33:0/1717812562 conn(0x7f1c700f8ae0 msgr2=0x7f1c700fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 shutdown_connections 2024-02-15T22:44:59.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:44:59.199+0000 7f1c77bed700 1 -- 172.21.15.33:0/1717812562 wait complete. 2024-02-15T22:44:59.813 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:44:59.813 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:44:59.814 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-15T22:45:00.077 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:45:00.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:00 smithi033 ceph-mon[29033]: pgmap v77: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:45:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:00 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1717812562' entity='client.admin' 2024-02-15T22:45:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:00 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:00 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:00 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:00 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:00.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:00 smithi082 ceph-mon[37153]: pgmap v77: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:45:00.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:00 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1717812562' entity='client.admin' 2024-02-15T22:45:00.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:00 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:00.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:00 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:00.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:00 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:00.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:00 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:01.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:01 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:01.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:01 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 -- 172.21.15.33:0/2161938481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 msgr2=0x7f3c2c103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 --2- 172.21.15.33:0/2161938481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c103310 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009ce0 tx=0x7f3c24004d10 comp rx=0 tx=0).stop 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 -- 172.21.15.33:0/2161938481 shutdown_connections 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 --2- 172.21.15.33:0/2161938481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1038e0 0x7f3c2c0fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 --2- 172.21.15.33:0/2161938481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c103310 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 -- 172.21.15.33:0/2161938481 >> 172.21.15.33:0/2161938481 conn(0x7f3c2c0f8af0 msgr2=0x7f3c2c0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 -- 172.21.15.33:0/2161938481 shutdown_connections 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.721+0000 7f3c30817700 1 -- 172.21.15.33:0/2161938481 wait complete. 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c30817700 1 Processor -- start 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c30817700 1 -- start start 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c30817700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c30817700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1038e0 0x7f3c2c1140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c30817700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1147d0 con 0x7f3c2c102f40 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c30817700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c10da70 con 0x7f3c2c1038e0 2024-02-15T22:45:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c2a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c2a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34424/0 (socket says 172.21.15.33:34424) 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.722+0000 7f3c2a59c700 1 -- 172.21.15.33:0/2604056857 learned_addr learned my addr 172.21.15.33:0/2604056857 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c29d9b700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1038e0 0x7f3c2c1140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c2a59c700 1 -- 172.21.15.33:0/2604056857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1038e0 msgr2=0x7f3c2c1140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c2a59c700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1038e0 0x7f3c2c1140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c2a59c700 1 -- 172.21.15.33:0/2604056857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24009940 con 0x7f3c2c102f40 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c2a59c700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c113bb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400bf60 tx=0x7f3c24004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c22ffd700 1 -- 172.21.15.33:0/2604056857 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2400e040 con 0x7f3c2c102f40 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c10dcf0 con 0x7f3c2c102f40 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c22ffd700 1 -- 172.21.15.33:0/2604056857 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c240128e0 con 0x7f3c2c102f40 2024-02-15T22:45:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c22ffd700 1 -- 172.21.15.33:0/2604056857 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2401c870 con 0x7f3c2c102f40 2024-02-15T22:45:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.723+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c10e230 con 0x7f3c2c102f40 2024-02-15T22:45:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.724+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c0fc6f0 con 0x7f3c2c102f40 2024-02-15T22:45:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.725+0000 7f3c22ffd700 1 -- 172.21.15.33:0/2604056857 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f3c24012a50 con 0x7f3c2c102f40 2024-02-15T22:45:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.725+0000 7f3c22ffd700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3c1806d0e0 0x7f3c1806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.725+0000 7f3c22ffd700 1 -- 172.21.15.33:0/2604056857 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f3c2408e230 con 0x7f3c2c102f40 2024-02-15T22:45:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.725+0000 7f3c29d9b700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3c1806d0e0 0x7f3c1806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:01.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.726+0000 7f3c29d9b700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3c1806d0e0 0x7f3c1806f590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c14006fd0 tx=0x7f3c14008040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:01.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.730+0000 7f3c22ffd700 1 -- 172.21.15.33:0/2604056857 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3c2405be60 con 0x7f3c2c102f40 2024-02-15T22:45:01.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.940+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f3c2c10f190 con 0x7f3c2c102f40 2024-02-15T22:45:01.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.940+0000 7f3c22ffd700 1 -- 172.21.15.33:0/2604056857 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f3c2405b9f0 con 0x7f3c2c102f40 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3c1806d0e0 msgr2=0x7f3c1806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3c1806d0e0 0x7f3c1806f590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c14006fd0 tx=0x7f3c14008040 comp rx=0 tx=0).stop 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 msgr2=0x7f3c2c113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c113bb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400bf60 tx=0x7f3c24004d10 comp rx=0 tx=0).stop 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 shutdown_connections 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3c1806d0e0 0x7f3c1806f590 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c102f40 0x7f3c2c113bb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 --2- 172.21.15.33:0/2604056857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1038e0 0x7f3c2c1140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.942+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 >> 172.21.15.33:0/2604056857 conn(0x7f3c2c0f8af0 msgr2=0x7f3c2c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.943+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 shutdown_connections 2024-02-15T22:45:01.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:01.943+0000 7f3c30817700 1 -- 172.21.15.33:0/2604056857 wait complete. 2024-02-15T22:45:02.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:02 smithi033 ceph-mon[29033]: pgmap v78: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:02.512 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-15T22:45:02.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:02 smithi082 ceph-mon[37153]: pgmap v78: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:02.774 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:45:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 -- 172.21.15.33:0/2493957884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 msgr2=0x7f22a8103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2493957884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8103320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2298004940 tx=0x7f2298009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 -- 172.21.15.33:0/2493957884 shutdown_connections 2024-02-15T22:45:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2493957884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81038f0 0x7f22a80fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2493957884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8103320 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 -- 172.21.15.33:0/2493957884 >> 172.21.15.33:0/2493957884 conn(0x7f22a80f8ae0 msgr2=0x7f22a80faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 -- 172.21.15.33:0/2493957884 shutdown_connections 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 -- 172.21.15.33:0/2493957884 wait complete. 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 Processor -- start 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.427+0000 7f22ad84b700 1 -- start start 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22ad84b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22ad84b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81038f0 0x7f22a8114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22ad84b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8114700 con 0x7f22a8102f50 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22ad84b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a810d9a0 con 0x7f22a81038f0 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34448/0 (socket says 172.21.15.33:34448) 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a6ffd700 1 -- 172.21.15.33:0/2081883736 learned_addr learned my addr 172.21.15.33:0/2081883736 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a67fc700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81038f0 0x7f22a8114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a6ffd700 1 -- 172.21.15.33:0/2081883736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81038f0 msgr2=0x7f22a8114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a6ffd700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81038f0 0x7f22a8114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a6ffd700 1 -- 172.21.15.33:0/2081883736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298005040 con 0x7f22a8102f50 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a67fc700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81038f0 0x7f22a8114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22a6ffd700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8113ae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f229800b3b0 tx=0x7f2298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f228f7fe700 1 -- 172.21.15.33:0/2081883736 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229800e040 con 0x7f22a8102f50 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f228f7fe700 1 -- 172.21.15.33:0/2081883736 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f229800bbf0 con 0x7f22a8102f50 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.428+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a810dc20 con 0x7f22a8102f50 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.429+0000 7f228f7fe700 1 -- 172.21.15.33:0/2081883736 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229801c630 con 0x7f22a8102f50 2024-02-15T22:45:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.429+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a810e160 con 0x7f22a8102f50 2024-02-15T22:45:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.430+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a80fc6e0 con 0x7f22a8102f50 2024-02-15T22:45:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.430+0000 7f228f7fe700 1 -- 172.21.15.33:0/2081883736 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f229800bd60 con 0x7f22a8102f50 2024-02-15T22:45:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.430+0000 7f228f7fe700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f229006d0e0 0x7f229006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.430+0000 7f228f7fe700 1 -- 172.21.15.33:0/2081883736 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f229808d920 con 0x7f22a8102f50 2024-02-15T22:45:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.430+0000 7f22a67fc700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f229006d0e0 0x7f229006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.431+0000 7f22a67fc700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f229006d0e0 0x7f229006f590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f22a810f310 tx=0x7f229c008040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:04.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.435+0000 7f228f7fe700 1 -- 172.21.15.33:0/2081883736 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f229805b5d0 con 0x7f22a8102f50 2024-02-15T22:45:04.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:04 smithi033 ceph-mon[29033]: pgmap v79: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:04.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:04 smithi082 ceph-mon[37153]: pgmap v79: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:04.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.641+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f22a810f0c0 con 0x7f22a8102f50 2024-02-15T22:45:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.641+0000 7f228f7fe700 1 -- 172.21.15.33:0/2081883736 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f229805b160 con 0x7f22a8102f50 2024-02-15T22:45:04.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f229006d0e0 msgr2=0x7f229006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:04.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f229006d0e0 0x7f229006f590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f22a810f310 tx=0x7f229c008040 comp rx=0 tx=0).stop 2024-02-15T22:45:04.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 msgr2=0x7f22a8113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:04.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8113ae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f229800b3b0 tx=0x7f2298009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 shutdown_connections 2024-02-15T22:45:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f229006d0e0 0x7f229006f590 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102f50 0x7f22a8113ae0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 --2- 172.21.15.33:0/2081883736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81038f0 0x7f22a8114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.643+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 >> 172.21.15.33:0/2081883736 conn(0x7f22a80f8ae0 msgr2=0x7f22a80fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.644+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 shutdown_connections 2024-02-15T22:45:04.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:04.644+0000 7f22ad84b700 1 -- 172.21.15.33:0/2081883736 wait complete. 2024-02-15T22:45:05.249 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-15T22:45:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:45:06.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:06 smithi033 ceph-mon[29033]: pgmap v80: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:06.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:06 smithi082 ceph-mon[37153]: pgmap v80: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:07.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 -- 172.21.15.33:0/1475711249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a98102f40 msgr2=0x7f3a98103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/1475711249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a98102f40 0x7f3a98103310 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c004940 tx=0x7f3a8c009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 -- 172.21.15.33:0/1475711249 shutdown_connections 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/1475711249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a981038e0 0x7f3a980fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/1475711249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a98102f40 0x7f3a98103310 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 -- 172.21.15.33:0/1475711249 >> 172.21.15.33:0/1475711249 conn(0x7f3a980f8af0 msgr2=0x7f3a980faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 -- 172.21.15.33:0/1475711249 shutdown_connections 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.137+0000 7f3a9eea9700 1 -- 172.21.15.33:0/1475711249 wait complete. 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a9eea9700 1 Processor -- start 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a9eea9700 1 -- start start 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a9eea9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a98102f40 0x7f3a98113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a9eea9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a981038e0 0x7f3a98113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a9eea9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98114670 con 0x7f3a981038e0 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a9eea9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9810d910 con 0x7f3a98102f40 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a97fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a981038e0 0x7f3a98113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a97fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a981038e0 0x7f3a98113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37772/0 (socket says 172.21.15.33:37772) 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.138+0000 7f3a97fff700 1 -- 172.21.15.33:0/2697817709 learned_addr learned my addr 172.21.15.33:0/2697817709 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a9cc45700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a98102f40 0x7f3a98113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a97fff700 1 -- 172.21.15.33:0/2697817709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a98102f40 msgr2=0x7f3a98113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a97fff700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a98102f40 0x7f3a98113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a97fff700 1 -- 172.21.15.33:0/2697817709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c005040 con 0x7f3a981038e0 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a97fff700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a981038e0 0x7f3a98113f90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400b790 tx=0x7f3a84009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:07.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a957fa700 1 -- 172.21.15.33:0/2697817709 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a8400f6f0 con 0x7f3a981038e0 2024-02-15T22:45:07.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a957fa700 1 -- 172.21.15.33:0/2697817709 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a8400fd20 con 0x7f3a981038e0 2024-02-15T22:45:07.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9810dbf0 con 0x7f3a981038e0 2024-02-15T22:45:07.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a957fa700 1 -- 172.21.15.33:0/2697817709 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a840103a0 con 0x7f3a981038e0 2024-02-15T22:45:07.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.139+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9810e130 con 0x7f3a981038e0 2024-02-15T22:45:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.140+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a980fc6f0 con 0x7f3a981038e0 2024-02-15T22:45:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.141+0000 7f3a957fa700 1 -- 172.21.15.33:0/2697817709 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f3a84011400 con 0x7f3a981038e0 2024-02-15T22:45:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.141+0000 7f3a957fa700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3a8806d0f0 0x7f3a8806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.141+0000 7f3a957fa700 1 -- 172.21.15.33:0/2697817709 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f3a8408c1f0 con 0x7f3a981038e0 2024-02-15T22:45:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.141+0000 7f3a9cc45700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3a8806d0f0 0x7f3a8806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.141+0000 7f3a9cc45700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3a8806d0f0 0x7f3a8806f5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00b3b0 tx=0x7f3a8c009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:07.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.146+0000 7f3a957fa700 1 -- 172.21.15.33:0/2697817709 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3a84059f40 con 0x7f3a981038e0 2024-02-15T22:45:07.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.366+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f3a9804bed0 con 0x7f3a981038e0 2024-02-15T22:45:07.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.366+0000 7f3a957fa700 1 -- 172.21.15.33:0/2697817709 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3a84059ad0 con 0x7f3a981038e0 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.368+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3a8806d0f0 msgr2=0x7f3a8806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.368+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3a8806d0f0 0x7f3a8806f5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00b3b0 tx=0x7f3a8c009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.368+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a981038e0 msgr2=0x7f3a98113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.368+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a981038e0 0x7f3a98113f90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400b790 tx=0x7f3a84009220 comp rx=0 tx=0).stop 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.369+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 shutdown_connections 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.369+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f3a8806d0f0 0x7f3a8806f5a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.369+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a98102f40 0x7f3a98113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:07.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.369+0000 7f3a9eea9700 1 --2- 172.21.15.33:0/2697817709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a981038e0 0x7f3a98113f90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:07.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.369+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 >> 172.21.15.33:0/2697817709 conn(0x7f3a980f8af0 msgr2=0x7f3a980fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:07.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.369+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 shutdown_connections 2024-02-15T22:45:07.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:07.369+0000 7f3a9eea9700 1 -- 172.21.15.33:0/2697817709 wait complete. 2024-02-15T22:45:08.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-15T22:45:08.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:08 smithi033 ceph-mon[29033]: pgmap v81: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:45:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:45:08.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:08 smithi082 ceph-mon[37153]: pgmap v81: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:45:10.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 -- 172.21.15.33:0/3431929717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 msgr2=0x7fa304102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 --2- 172.21.15.33:0/3431929717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa304102230 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4004940 tx=0x7fa2f4009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 -- 172.21.15.33:0/3431929717 shutdown_connections 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 --2- 172.21.15.33:0/3431929717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa304102800 0x7fa3040fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 --2- 172.21.15.33:0/3431929717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa304102230 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 -- 172.21.15.33:0/3431929717 >> 172.21.15.33:0/3431929717 conn(0x7fa3040f7a10 msgr2=0x7fa3040f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 -- 172.21.15.33:0/3431929717 shutdown_connections 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.902+0000 7fa309ef9700 1 -- 172.21.15.33:0/3431929717 wait complete. 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.903+0000 7fa309ef9700 1 Processor -- start 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.903+0000 7fa309ef9700 1 -- start start 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.903+0000 7fa309ef9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa30410ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.903+0000 7fa309ef9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa304102800 0x7fa30410f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.903+0000 7fa309ef9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30410f6a0 con 0x7fa304101e60 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.903+0000 7fa309ef9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30410f810 con 0x7fa304102800 2024-02-15T22:45:10.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa3037fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa30410ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa3037fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa30410ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37796/0 (socket says 172.21.15.33:37796) 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa3037fe700 1 -- 172.21.15.33:0/2690444102 learned_addr learned my addr 172.21.15.33:0/2690444102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa3037fe700 1 -- 172.21.15.33:0/2690444102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa304102800 msgr2=0x7fa30410f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa302ffd700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa304102800 0x7fa30410f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa3037fe700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa304102800 0x7fa30410f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa3037fe700 1 -- 172.21.15.33:0/2690444102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4005040 con 0x7fa304101e60 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa3037fe700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa30410ebb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400b3b0 tx=0x7fa2f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa2ebfff700 1 -- 172.21.15.33:0/2690444102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f400e040 con 0x7fa304101e60 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa304117b20 con 0x7fa304101e60 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa2ebfff700 1 -- 172.21.15.33:0/2690444102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2f400bbf0 con 0x7fa304101e60 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa2ebfff700 1 -- 172.21.15.33:0/2690444102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f401c630 con 0x7fa304101e60 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.904+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa304118030 con 0x7fa304101e60 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.905+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3040ff170 con 0x7fa304101e60 2024-02-15T22:45:10.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.906+0000 7fa2ebfff700 1 -- 172.21.15.33:0/2690444102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fa2f400bd60 con 0x7fa304101e60 2024-02-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.906+0000 7fa2ebfff700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa2ec06d0e0 0x7fa2ec06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.906+0000 7fa2ebfff700 1 -- 172.21.15.33:0/2690444102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa2f408d8f0 con 0x7fa304101e60 2024-02-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.906+0000 7fa302ffd700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa2ec06d0e0 0x7fa2ec06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.907+0000 7fa302ffd700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa2ec06d0e0 0x7fa2ec06f590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa304066a10 tx=0x7fa2f8009040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:10.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:09.911+0000 7fa2ebfff700 1 -- 172.21.15.33:0/2690444102 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa2f4057a70 con 0x7fa304101e60 2024-02-15T22:45:10.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.140+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7fa304066750 con 0x7fa2ec06d0e0 2024-02-15T22:45:10.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.145+0000 7fa2ebfff700 1 -- 172.21.15.33:0/2690444102 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fa304066750 con 0x7fa2ec06d0e0 2024-02-15T22:45:10.148 INFO:teuthology.orchestra.run.smithi033.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa2ec06d0e0 msgr2=0x7fa2ec06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa2ec06d0e0 0x7fa2ec06f590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa304066a10 tx=0x7fa2f8009040 comp rx=0 tx=0).stop 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 msgr2=0x7fa30410ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa30410ebb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400b3b0 tx=0x7fa2f4009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 shutdown_connections 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fa2ec06d0e0 0x7fa2ec06f590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa304101e60 0x7fa30410ebb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 --2- 172.21.15.33:0/2690444102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa304102800 0x7fa30410f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.147+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 >> 172.21.15.33:0/2690444102 conn(0x7fa3040f7a10 msgr2=0x7fa3040f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.148+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 shutdown_connections 2024-02-15T22:45:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:10.148+0000 7fa309ef9700 1 -- 172.21.15.33:0/2690444102 wait complete. 2024-02-15T22:45:10.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:10 smithi033 ceph-mon[29033]: pgmap v82: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:45:10.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:10 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:10.462 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:10 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:10.462 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:10 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:10.462 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:10 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:10.462 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:10 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:10.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:10 smithi082 ceph-mon[37153]: pgmap v82: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:45:10.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:10 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:10.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:10 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:10 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:10 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:10 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:10.779 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:45:10.780 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:45:10.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-15T22:45:11.061 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:45:11.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:11 smithi033 ceph-mon[29033]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:11.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:11 smithi033 ceph-mon[29033]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:45:11.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:11 smithi033 ceph-mon[29033]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:45:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:11 smithi082 ceph-mon[37153]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:11 smithi082 ceph-mon[37153]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:45:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:11 smithi082 ceph-mon[37153]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:45:12.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:12 smithi033 ceph-mon[29033]: pgmap v83: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:12.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:12 smithi082 ceph-mon[37153]: pgmap v83: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- 172.21.15.33:0/1683112703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 msgr2=0x7fbb3c0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 --2- 172.21.15.33:0/1683112703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c0fbe70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c004940 tx=0x7fbb2c009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- 172.21.15.33:0/1683112703 shutdown_connections 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 --2- 172.21.15.33:0/1683112703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c0fbe70 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 --2- 172.21.15.33:0/1683112703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c101e60 0x7fbb3c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- 172.21.15.33:0/1683112703 >> 172.21.15.33:0/1683112703 conn(0x7fbb3c0f7a10 msgr2=0x7fbb3c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- 172.21.15.33:0/1683112703 shutdown_connections 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- 172.21.15.33:0/1683112703 wait complete. 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 Processor -- start 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- start start 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c101e60 0x7fbb3c102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c103200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c103890 con 0x7fbb3c102800 2024-02-15T22:45:13.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb43e71700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c103a00 con 0x7fbb3c101e60 2024-02-15T22:45:13.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.431+0000 7fbb4140c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c103200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:13.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb4140c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c103200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37808/0 (socket says 172.21.15.33:37808) 2024-02-15T22:45:13.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb4140c700 1 -- 172.21.15.33:0/2231515343 learned_addr learned my addr 172.21.15.33:0/2231515343 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb41c0d700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c101e60 0x7fbb3c102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb4140c700 1 -- 172.21.15.33:0/2231515343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c101e60 msgr2=0x7fbb3c102cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb4140c700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c101e60 0x7fbb3c102cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb4140c700 1 -- 172.21.15.33:0/2231515343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c005040 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb4140c700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c103200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009030 tx=0x7fbb2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb327fc700 1 -- 172.21.15.33:0/2231515343 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb2c00e040 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb327fc700 1 -- 172.21.15.33:0/2231515343 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb2c00bbf0 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c119d10 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb327fc700 1 -- 172.21.15.33:0/2231515343 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb2c01c630 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.432+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c11a200 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.433+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c0fb610 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.434+0000 7fbb327fc700 1 -- 172.21.15.33:0/2231515343 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fbb2c00bd60 con 0x7fbb3c102800 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.434+0000 7fbb327fc700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fbb2806d0f0 0x7fbb2806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.434+0000 7fbb41c0d700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fbb2806d0f0 0x7fbb2806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.434+0000 7fbb327fc700 1 -- 172.21.15.33:0/2231515343 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fbb2c08d860 con 0x7fbb3c102800 2024-02-15T22:45:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.435+0000 7fbb41c0d700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fbb2806d0f0 0x7fbb2806f5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb38006fd0 tx=0x7fbb38008040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:13.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.439+0000 7fbb327fc700 1 -- 172.21.15.33:0/2231515343 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fbb2c0579e0 con 0x7fbb3c102800 2024-02-15T22:45:13.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.663+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb3c1044a0 con 0x7fbb2806d0f0 2024-02-15T22:45:13.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.664+0000 7fbb327fc700 1 -- 172.21.15.33:0/2231515343 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fbb3c1044a0 con 0x7fbb2806d0f0 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fbb2806d0f0 msgr2=0x7fbb2806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fbb2806d0f0 0x7fbb2806f5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb38006fd0 tx=0x7fbb38008040 comp rx=0 tx=0).stop 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 msgr2=0x7fbb3c103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c103200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009030 tx=0x7fbb2c009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 shutdown_connections 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fbb2806d0f0 0x7fbb2806f5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c101e60 0x7fbb3c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 --2- 172.21.15.33:0/2231515343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb3c102800 0x7fbb3c103200 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 >> 172.21.15.33:0/2231515343 conn(0x7fbb3c0f7a10 msgr2=0x7fbb3c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 shutdown_connections 2024-02-15T22:45:13.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.666+0000 7fbb43e71700 1 -- 172.21.15.33:0/2231515343 wait complete. 2024-02-15T22:45:13.679 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:45:13.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1369367028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 msgr2=0x7f0c040fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1369367028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fe3b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009d10 tx=0x7f0bf4004d10 comp rx=0 tx=0).stop 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1369367028 shutdown_connections 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1369367028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c040fe8f0 0x7f0c04107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1369367028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fe3b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1369367028 >> 172.21.15.33:0/1369367028 conn(0x7f0c04071d90 msgr2=0x7f0c04072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1369367028 shutdown_connections 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1369367028 wait complete. 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.770+0000 7f0c0c15d700 1 Processor -- start 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c0c15d700 1 -- start start 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c0c15d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c0c15d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c040fe8f0 0x7f0c040fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c0c15d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040fc9e0 con 0x7f0c040fdfe0 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c0c15d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040fcb50 con 0x7f0c040fe8f0 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c09ef9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c09ef9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37822/0 (socket says 172.21.15.33:37822) 2024-02-15T22:45:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c09ef9700 1 -- 172.21.15.33:0/1802043443 learned_addr learned my addr 172.21.15.33:0/1802043443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c096f8700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c040fe8f0 0x7f0c040fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c09ef9700 1 -- 172.21.15.33:0/1802043443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c040fe8f0 msgr2=0x7f0c040fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c09ef9700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c040fe8f0 0x7f0c040fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c09ef9700 1 -- 172.21.15.33:0/1802043443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf4009940 con 0x7f0c040fdfe0 2024-02-15T22:45:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c09ef9700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fbea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4008dd0 tx=0x7f0bf4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.771+0000 7f0c027fc700 1 -- 172.21.15.33:0/1802043443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf400e040 con 0x7f0c040fdfe0 2024-02-15T22:45:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.772+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c04119e70 con 0x7f0c040fdfe0 2024-02-15T22:45:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.772+0000 7f0c027fc700 1 -- 172.21.15.33:0/1802043443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bf40128e0 con 0x7f0c040fdfe0 2024-02-15T22:45:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.772+0000 7f0c027fc700 1 -- 172.21.15.33:0/1802043443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf401c880 con 0x7f0c040fdfe0 2024-02-15T22:45:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.772+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0411a2d0 con 0x7f0c040fdfe0 2024-02-15T22:45:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.772+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c041046c0 con 0x7f0c040fdfe0 2024-02-15T22:45:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.773+0000 7f0c027fc700 1 -- 172.21.15.33:0/1802043443 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f0bf4012410 con 0x7f0c040fdfe0 2024-02-15T22:45:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.773+0000 7f0c027fc700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0bec06d0e0 0x7f0bec06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.774+0000 7f0c027fc700 1 -- 172.21.15.33:0/1802043443 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f0bf408e280 con 0x7f0c040fdfe0 2024-02-15T22:45:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.774+0000 7f0c096f8700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0bec06d0e0 0x7f0bec06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.774+0000 7f0c096f8700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0bec06d0e0 0x7f0bec06f590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c040fd8a0 tx=0x7f0bf800b040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:13.778+0000 7f0c027fc700 1 -- 172.21.15.33:0/1802043443 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0bf4058380 con 0x7f0c040fdfe0 2024-02-15T22:45:14.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.008+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c040fd5e0 con 0x7f0bec06d0e0 2024-02-15T22:45:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.009+0000 7f0c027fc700 1 -- 172.21.15.33:0/1802043443 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f0c040fd5e0 con 0x7f0bec06d0e0 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.011+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0bec06d0e0 msgr2=0x7f0bec06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.011+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0bec06d0e0 0x7f0bec06f590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c040fd8a0 tx=0x7f0bf800b040 comp rx=0 tx=0).stop 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.011+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 msgr2=0x7f0c040fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.011+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fbea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4008dd0 tx=0x7f0bf4004d10 comp rx=0 tx=0).stop 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.012+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 shutdown_connections 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.012+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f0bec06d0e0 0x7f0bec06f590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.012+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040fdfe0 0x7f0c040fbea0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.012+0000 7f0c0c15d700 1 --2- 172.21.15.33:0/1802043443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c040fe8f0 0x7f0c040fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.012+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 >> 172.21.15.33:0/1802043443 conn(0x7f0c04071d90 msgr2=0x7f0c04101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.012+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 shutdown_connections 2024-02-15T22:45:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.012+0000 7f0c0c15d700 1 -- 172.21.15.33:0/1802043443 wait complete. 2024-02-15T22:45:14.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.121+0000 7fcfb2946700 1 -- 172.21.15.33:0/2874721496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fe8f0 msgr2=0x7fcfac106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.121+0000 7fcfb2946700 1 --2- 172.21.15.33:0/2874721496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fe8f0 0x7fcfac106f30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0004940 tx=0x7fcfa0009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 -- 172.21.15.33:0/2874721496 shutdown_connections 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 --2- 172.21.15.33:0/2874721496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fe8f0 0x7fcfac106f30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 --2- 172.21.15.33:0/2874721496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfac0fdf50 0x7fcfac0fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 -- 172.21.15.33:0/2874721496 >> 172.21.15.33:0/2874721496 conn(0x7fcfac0f79e0 msgr2=0x7fcfac0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 -- 172.21.15.33:0/2874721496 shutdown_connections 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 -- 172.21.15.33:0/2874721496 wait complete. 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 Processor -- start 2024-02-15T22:45:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.122+0000 7fcfb2946700 1 -- start start 2024-02-15T22:45:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfb2946700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fdf50 0x7fcfac113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfb2946700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfac0fe8f0 0x7fcfac114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfb2946700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac114670 con 0x7fcfac0fdf50 2024-02-15T22:45:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfb2946700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac10d9a0 con 0x7fcfac0fe8f0 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfabfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fdf50 0x7fcfac113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfabfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fdf50 0x7fcfac113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37844/0 (socket says 172.21.15.33:37844) 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfabfff700 1 -- 172.21.15.33:0/1395895946 learned_addr learned my addr 172.21.15.33:0/1395895946 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfab7fe700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfac0fe8f0 0x7fcfac114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfabfff700 1 -- 172.21.15.33:0/1395895946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfac0fe8f0 msgr2=0x7fcfac114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfabfff700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfac0fe8f0 0x7fcfac114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfabfff700 1 -- 172.21.15.33:0/1395895946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0005040 con 0x7fcfac0fdf50 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfabfff700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fdf50 0x7fcfac113ae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c8c0 tx=0x7fcf9c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfa8ff9700 1 -- 172.21.15.33:0/1395895946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf9c00a760 con 0x7fcfac0fdf50 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfa8ff9700 1 -- 172.21.15.33:0/1395895946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf9c00ad90 con 0x7fcfac0fdf50 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.123+0000 7fcfa8ff9700 1 -- 172.21.15.33:0/1395895946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf9c0113a0 con 0x7fcfac0fdf50 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.124+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac10dc80 con 0x7fcfac0fdf50 2024-02-15T22:45:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.124+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac10e190 con 0x7fcfac0fdf50 2024-02-15T22:45:14.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.125+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac104540 con 0x7fcfac0fdf50 2024-02-15T22:45:14.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.126+0000 7fcfa8ff9700 1 -- 172.21.15.33:0/1395895946 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fcf9c012400 con 0x7fcfac0fdf50 2024-02-15T22:45:14.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.127+0000 7fcfa8ff9700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcf9406d0e0 0x7fcf9406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.127+0000 7fcfa8ff9700 1 -- 172.21.15.33:0/1395895946 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fcf9c08d020 con 0x7fcfac0fdf50 2024-02-15T22:45:14.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.127+0000 7fcfab7fe700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcf9406d0e0 0x7fcf9406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.127+0000 7fcfab7fe700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcf9406d0e0 0x7fcf9406f590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfac10ecd0 tx=0x7fcfa0009e30 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.130+0000 7fcfa8ff9700 1 -- 172.21.15.33:0/1395895946 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcf9c05ad70 con 0x7fcfac0fdf50 2024-02-15T22:45:14.293 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:14 smithi033 ceph-mon[29033]: pgmap v84: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:14.293 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:14 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:14.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:14 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:14.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:14 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:14.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:14 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:14.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:14 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:45:14.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.344+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfac04bed0 con 0x7fcf9406d0e0 2024-02-15T22:45:14.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.364+0000 7fcfa8ff9700 1 -- 172.21.15.33:0/1395895946 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcfac04bed0 con 0x7fcf9406d0e0 2024-02-15T22:45:14.367 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:45:14.367 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (85s) 62s ago 12m 16.2M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:45:14.367 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (12m) 62s ago 12m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:45:14.367 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (11m) 117s ago 11m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:45:14.367 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (68s) 62s ago 12m 55.2M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:45:14.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (6m) 62s ago 6m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (6m) 62s ago 6m 75.1M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (6m) 117s ago 6m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (6m) 117s ago 6m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (3m) 62s ago 13m 498M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (2m) 117s ago 11m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (13m) 62s ago 14m 57.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 4e26ff0fda2f 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (11m) 117s ago 11m 41.5M 2048M 17.2.7-509-g9aa52330 61c0ec9cd187 6540eb082c8b 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (2m) 62s ago 12m 7512k - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (2m) 117s ago 11m 3389k - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (10m) 62s ago 10m 212M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (10m) 62s ago 10m 230M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (9m) 62s ago 9m 197M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:45:14.368 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (9m) 117s ago 9m 260M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:45:14.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (8m) 117s ago 8m 230M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:45:14.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (8m) 117s ago 8m 224M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:45:14.369 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (102s) 62s ago 11m 46.7M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:45:14.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.366+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcf9406d0e0 msgr2=0x7fcf9406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.366+0000 7fcfb2946700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcf9406d0e0 0x7fcf9406f590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfac10ecd0 tx=0x7fcfa0009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.366+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fdf50 msgr2=0x7fcfac113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.366+0000 7fcfb2946700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fdf50 0x7fcfac113ae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c8c0 tx=0x7fcf9c0044c0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.367+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 shutdown_connections 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.367+0000 7fcfb2946700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcf9406d0e0 0x7fcf9406f590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.367+0000 7fcfb2946700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfac0fdf50 0x7fcfac113ae0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.367+0000 7fcfb2946700 1 --2- 172.21.15.33:0/1395895946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfac0fe8f0 0x7fcfac114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.367+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 >> 172.21.15.33:0/1395895946 conn(0x7fcfac0f79e0 msgr2=0x7fcfac1016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.367+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 shutdown_connections 2024-02-15T22:45:14.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.367+0000 7fcfb2946700 1 -- 172.21.15.33:0/1395895946 wait complete. 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.486+0000 7fb5c05f5700 1 -- 172.21.15.33:0/617948087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 msgr2=0x7fb5b80fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.486+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/617948087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b80fbe70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8004940 tx=0x7fb5a8009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 -- 172.21.15.33:0/617948087 shutdown_connections 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/617948087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b80fbe70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/617948087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8101e60 0x7fb5b8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 -- 172.21.15.33:0/617948087 >> 172.21.15.33:0/617948087 conn(0x7fb5b80f7a10 msgr2=0x7fb5b80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 -- 172.21.15.33:0/617948087 shutdown_connections 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 -- 172.21.15.33:0/617948087 wait complete. 2024-02-15T22:45:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 Processor -- start 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 -- start start 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8101e60 0x7fb5b8113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.487+0000 7fb5c05f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b8114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5c05f5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8114650 con 0x7fb5b8102800 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5c05f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b810d980 con 0x7fb5b8101e60 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5bdb90700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b8114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5bdb90700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b8114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37858/0 (socket says 172.21.15.33:37858) 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5bdb90700 1 -- 172.21.15.33:0/1860212141 learned_addr learned my addr 172.21.15.33:0/1860212141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5be391700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8101e60 0x7fb5b8113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5bdb90700 1 -- 172.21.15.33:0/1860212141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8101e60 msgr2=0x7fb5b8113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5bdb90700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8101e60 0x7fb5b8113ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5bdb90700 1 -- 172.21.15.33:0/1860212141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8005040 con 0x7fb5b8102800 2024-02-15T22:45:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5bdb90700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b8114000 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009150 tx=0x7fb5a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.488+0000 7fb5aeffd700 1 -- 172.21.15.33:0/1860212141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5a800e040 con 0x7fb5b8102800 2024-02-15T22:45:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.489+0000 7fb5aeffd700 1 -- 172.21.15.33:0/1860212141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5a800bbf0 con 0x7fb5b8102800 2024-02-15T22:45:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.489+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b810dc00 con 0x7fb5b8102800 2024-02-15T22:45:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.489+0000 7fb5aeffd700 1 -- 172.21.15.33:0/1860212141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5a801c3f0 con 0x7fb5b8102800 2024-02-15T22:45:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.489+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b810e0f0 con 0x7fb5b8102800 2024-02-15T22:45:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.490+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b80fb610 con 0x7fb5b8102800 2024-02-15T22:45:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.490+0000 7fb5aeffd700 1 -- 172.21.15.33:0/1860212141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fb5a800bd60 con 0x7fb5b8102800 2024-02-15T22:45:14.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.491+0000 7fb5aeffd700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb5a406d0e0 0x7fb5a406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.491+0000 7fb5aeffd700 1 -- 172.21.15.33:0/1860212141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb5a808d860 con 0x7fb5b8102800 2024-02-15T22:45:14.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.491+0000 7fb5be391700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb5a406d0e0 0x7fb5a406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.492+0000 7fb5be391700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb5a406d0e0 0x7fb5a406f590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4004fd0 tx=0x7fb5b4009040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.500+0000 7fb5aeffd700 1 -- 172.21.15.33:0/1860212141 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb5a805b510 con 0x7fb5b8102800 2024-02-15T22:45:14.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:14 smithi082 ceph-mon[37153]: pgmap v84: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:14.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:14 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:14.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:14 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:14.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:14 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:14.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:14 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:14.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:14 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:45:14.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.806+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5b804bed0 con 0x7fb5b8102800 2024-02-15T22:45:14.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.806+0000 7fb5aeffd700 1 -- 172.21.15.33:0/1860212141 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fb5a805b0a0 con 0x7fb5b8102800 2024-02-15T22:45:14.809 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:45:14.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:45:14.809 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2 2024-02-15T22:45:14.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:14.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 12, 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:45:14.810 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:45:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.808+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb5a406d0e0 msgr2=0x7fb5a406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.808+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb5a406d0e0 0x7fb5a406f590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4004fd0 tx=0x7fb5b4009040 comp rx=0 tx=0).stop 2024-02-15T22:45:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.808+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 msgr2=0x7fb5b8114000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.808+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b8114000 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009150 tx=0x7fb5a8009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.808+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 shutdown_connections 2024-02-15T22:45:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.808+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fb5a406d0e0 0x7fb5a406f590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.808+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8101e60 0x7fb5b8113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.809+0000 7fb5c05f5700 1 --2- 172.21.15.33:0/1860212141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5b8102800 0x7fb5b8114000 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.809+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 >> 172.21.15.33:0/1860212141 conn(0x7fb5b80f7a10 msgr2=0x7fb5b81001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.809+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 shutdown_connections 2024-02-15T22:45:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.809+0000 7fb5c05f5700 1 -- 172.21.15.33:0/1860212141 wait complete. 2024-02-15T22:45:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.913+0000 7fcebd464700 1 -- 172.21.15.33:0/801761683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 msgr2=0x7fceb8109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.913+0000 7fcebd464700 1 --2- 172.21.15.33:0/801761683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8109440 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fceac004940 tx=0x7fceac009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 -- 172.21.15.33:0/801761683 shutdown_connections 2024-02-15T22:45:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 --2- 172.21.15.33:0/801761683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8109440 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 --2- 172.21.15.33:0/801761683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb80fbdd0 0x7fceb80fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 -- 172.21.15.33:0/801761683 >> 172.21.15.33:0/801761683 conn(0x7fceb8071d90 msgr2=0x7fceb8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 -- 172.21.15.33:0/801761683 shutdown_connections 2024-02-15T22:45:14.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 -- 172.21.15.33:0/801761683 wait complete. 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 Processor -- start 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.914+0000 7fcebd464700 1 -- start start 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fcebd464700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb80fbdd0 0x7fceb8115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fcebd464700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fcebd464700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8116790 con 0x7fceb80fc6e0 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fcebd464700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb810fac0 con 0x7fceb80fbdd0 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8116140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37872/0 (socket says 172.21.15.33:37872) 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb67fc700 1 -- 172.21.15.33:0/2782358096 learned_addr learned my addr 172.21.15.33:0/2782358096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb6ffd700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb80fbdd0 0x7fceb8115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb67fc700 1 -- 172.21.15.33:0/2782358096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb80fbdd0 msgr2=0x7fceb8115c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb67fc700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb80fbdd0 0x7fceb8115c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb67fc700 1 -- 172.21.15.33:0/2782358096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac005040 con 0x7fceb80fc6e0 2024-02-15T22:45:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fceb67fc700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8116140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fceac000c00 tx=0x7fceac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fce9f7fe700 1 -- 172.21.15.33:0/2782358096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceac021070 con 0x7fceb80fc6e0 2024-02-15T22:45:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.915+0000 7fce9f7fe700 1 -- 172.21.15.33:0/2782358096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fceac013d00 con 0x7fceb80fc6e0 2024-02-15T22:45:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.916+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb810fd40 con 0x7fceb80fc6e0 2024-02-15T22:45:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.916+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb8110280 con 0x7fceb80fc6e0 2024-02-15T22:45:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.916+0000 7fce9f7fe700 1 -- 172.21.15.33:0/2782358096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceac00e070 con 0x7fceb80fc6e0 2024-02-15T22:45:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.917+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb8106b70 con 0x7fceb80fc6e0 2024-02-15T22:45:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.917+0000 7fce9f7fe700 1 -- 172.21.15.33:0/2782358096 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fceac0126d0 con 0x7fceb80fc6e0 2024-02-15T22:45:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.918+0000 7fce9f7fe700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcea006d0f0 0x7fcea006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.918+0000 7fce9f7fe700 1 -- 172.21.15.33:0/2782358096 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fceac08da80 con 0x7fceb80fc6e0 2024-02-15T22:45:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.918+0000 7fceb6ffd700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcea006d0f0 0x7fcea006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.918+0000 7fceb6ffd700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcea006d0f0 0x7fcea006f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009b80 tx=0x7fcea800b040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:14.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:14.922+0000 7fce9f7fe700 1 -- 172.21.15.33:0/2782358096 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fceac05c620 con 0x7fceb80fc6e0 2024-02-15T22:45:15.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.174+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fceb810c200 con 0x7fceb80fc6e0 2024-02-15T22:45:15.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.174+0000 7fce9f7fe700 1 -- 172.21.15.33:0/2782358096 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1861 (secure 0 0 0) 0x7fceac05c1b0 con 0x7fceb80fc6e0 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout:e20 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:45:15.177 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 20 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:41:18.912549+0000 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:15.178 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:15.180 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:45:15.180 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:45:15.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcea006d0f0 msgr2=0x7fcea006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcea006d0f0 0x7fcea006f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009b80 tx=0x7fcea800b040 comp rx=0 tx=0).stop 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 msgr2=0x7fceb8116140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8116140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fceac000c00 tx=0x7fceac009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 shutdown_connections 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fcea006d0f0 0x7fcea006f5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb80fbdd0 0x7fceb8115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 --2- 172.21.15.33:0/2782358096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fceb80fc6e0 0x7fceb8116140 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 >> 172.21.15.33:0/2782358096 conn(0x7fceb8071d90 msgr2=0x7fceb80fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 shutdown_connections 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.177+0000 7fcebd464700 1 -- 172.21.15.33:0/2782358096 wait complete. 2024-02-15T22:45:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 20 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.283+0000 7fe19c847700 1 -- 172.21.15.33:0/874292277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 msgr2=0x7fe198102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.283+0000 7fe19c847700 1 --2- 172.21.15.33:0/874292277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe198102220 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe188004940 tx=0x7fe188009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 -- 172.21.15.33:0/874292277 shutdown_connections 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 --2- 172.21.15.33:0/874292277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1981027f0 0x7fe1980fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 --2- 172.21.15.33:0/874292277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe198102220 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 -- 172.21.15.33:0/874292277 >> 172.21.15.33:0/874292277 conn(0x7fe1980f79e0 msgr2=0x7fe1980f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 -- 172.21.15.33:0/874292277 shutdown_connections 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 -- 172.21.15.33:0/874292277 wait complete. 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 Processor -- start 2024-02-15T22:45:15.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 -- start start 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe1981030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1981027f0 0x7fe198103600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198103c90 con 0x7fe198101e50 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19c847700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198103e00 con 0x7fe1981027f0 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe1981030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.284+0000 7fe19659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe1981030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37890/0 (socket says 172.21.15.33:37890) 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe19659c700 1 -- 172.21.15.33:0/2408579667 learned_addr learned my addr 172.21.15.33:0/2408579667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe19659c700 1 -- 172.21.15.33:0/2408579667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1981027f0 msgr2=0x7fe198103600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe19659c700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1981027f0 0x7fe198103600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe19659c700 1 -- 172.21.15.33:0/2408579667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188005040 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe19659c700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe1981030c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b3b0 tx=0x7fe188009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe186ffd700 1 -- 172.21.15.33:0/2408579667 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe18800e040 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe186ffd700 1 -- 172.21.15.33:0/2408579667 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe18800bbf0 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe198119d30 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.285+0000 7fe186ffd700 1 -- 172.21.15.33:0/2408579667 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe18801c630 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.286+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19811a220 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.287+0000 7fe186ffd700 1 -- 172.21.15.33:0/2408579667 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7fe18800bd60 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.287+0000 7fe186ffd700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fe18006d0e0 0x7fe18006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.287+0000 7fe186ffd700 1 -- 172.21.15.33:0/2408579667 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fe18808d080 con 0x7fe198101e50 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.287+0000 7fe195d9b700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fe18006d0e0 0x7fe18006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.287+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1980fb5e0 con 0x7fe198101e50 2024-02-15T22:45:15.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.288+0000 7fe195d9b700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fe18006d0e0 0x7fe18006f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe18c006fd0 tx=0x7fe18c006db0 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.292+0000 7fe186ffd700 1 -- 172.21.15.33:0/2408579667 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe188092060 con 0x7fe198101e50 2024-02-15T22:45:15.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.513+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 --> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1981048a0 con 0x7fe18006d0e0 2024-02-15T22:45:15.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:15 smithi033 ceph-mon[29033]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:15.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:15 smithi033 ceph-mon[29033]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-15T22:45:15.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:15 smithi033 ceph-mon[29033]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:45:15.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:15 smithi033 ceph-mon[29033]: Upgrade: Setting container_image for all mgr 2024-02-15T22:45:15.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:15 smithi033 ceph-mon[29033]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:15.517 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:15 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1860212141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:15.517 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:15 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/2782358096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:45:15.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.515+0000 7fe186ffd700 1 -- 172.21.15.33:0/2408579667 <== mgr.14684 v2:172.21.15.33:6800/1221640653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe1981048a0 con 0x7fe18006d0e0 2024-02-15T22:45:15.517 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:45:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "2/21 daemons upgraded", 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading mon daemons", 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:45:15.518 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fe18006d0e0 msgr2=0x7fe18006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fe18006d0e0 0x7fe18006f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe18c006fd0 tx=0x7fe18c006db0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 msgr2=0x7fe1981030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe1981030c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b3b0 tx=0x7fe188009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 shutdown_connections 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7fe18006d0e0 0x7fe18006f590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe198101e50 0x7fe1981030c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 --2- 172.21.15.33:0/2408579667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1981027f0 0x7fe198103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 >> 172.21.15.33:0/2408579667 conn(0x7fe1980f79e0 msgr2=0x7fe198105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 shutdown_connections 2024-02-15T22:45:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.517+0000 7fe19c847700 1 -- 172.21.15.33:0/2408579667 wait complete. 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 -- 172.21.15.33:0/2446508284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 msgr2=0x7f6810106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 --2- 172.21.15.33:0/2446508284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810106f40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6804004940 tx=0x7f6804009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 -- 172.21.15.33:0/2446508284 shutdown_connections 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 --2- 172.21.15.33:0/2446508284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810106f40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 --2- 172.21.15.33:0/2446508284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68100fdf60 0x7f68100fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 -- 172.21.15.33:0/2446508284 >> 172.21.15.33:0/2446508284 conn(0x7f68100f7a10 msgr2=0x7f68100f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 -- 172.21.15.33:0/2446508284 shutdown_connections 2024-02-15T22:45:15.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.620+0000 7f6818236700 1 -- 172.21.15.33:0/2446508284 wait complete. 2024-02-15T22:45:15.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f6818236700 1 Processor -- start 2024-02-15T22:45:15.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f6818236700 1 -- start start 2024-02-15T22:45:15.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f6818236700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68100fdf60 0x7f6810113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:15.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f6818236700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:15.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f6818236700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68101146c0 con 0x7f68100fe900 2024-02-15T22:45:15.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f6818236700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681010d9f0 con 0x7f68100fdf60 2024-02-15T22:45:15.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f68157d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f68157d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37906/0 (socket says 172.21.15.33:37906) 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.621+0000 7f68157d1700 1 -- 172.21.15.33:0/1301725878 learned_addr learned my addr 172.21.15.33:0/1301725878 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f6815fd2700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68100fdf60 0x7f6810113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f68157d1700 1 -- 172.21.15.33:0/1301725878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68100fdf60 msgr2=0x7f6810113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f68157d1700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68100fdf60 0x7f6810113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f68157d1700 1 -- 172.21.15.33:0/1301725878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6804005040 con 0x7f68100fe900 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f6815fd2700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68100fdf60 0x7f6810113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f68157d1700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810114070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6804000c00 tx=0x7f6804009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f680e7fc700 1 -- 172.21.15.33:0/1301725878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680400e040 con 0x7f68100fe900 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f680e7fc700 1 -- 172.21.15.33:0/1301725878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6804009af0 con 0x7f68100fe900 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681010dc70 con 0x7f68100fe900 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f680e7fc700 1 -- 172.21.15.33:0/1301725878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680401c630 con 0x7f68100fe900 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.622+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681010e1b0 con 0x7f68100fe900 2024-02-15T22:45:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.623+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6810104550 con 0x7f68100fe900 2024-02-15T22:45:15.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:15 smithi082 ceph-mon[37153]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:15.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:15 smithi082 ceph-mon[37153]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-15T22:45:15.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:15 smithi082 ceph-mon[37153]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:45:15.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:15 smithi082 ceph-mon[37153]: Upgrade: Setting container_image for all mgr 2024-02-15T22:45:15.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:15 smithi082 ceph-mon[37153]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:15.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:15 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1860212141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:15.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:15 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/2782358096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:45:15.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.623+0000 7f680e7fc700 1 -- 172.21.15.33:0/1301725878 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 32) v1 ==== 91207+0+0 (secure 0 0 0) 0x7f680400bbf0 con 0x7f68100fe900 2024-02-15T22:45:15.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.624+0000 7f680e7fc700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f67f806d0e0 0x7f67f806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:15.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.624+0000 7f6815fd2700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f67f806d0e0 0x7f67f806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:15.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.624+0000 7f680e7fc700 1 -- 172.21.15.33:0/1301725878 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f680408d890 con 0x7f68100fe900 2024-02-15T22:45:15.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.624+0000 7f6815fd2700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f67f806d0e0 0x7f67f806f590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6808004f00 tx=0x7f6808009040 comp rx=0 tx=0).ready entity=mgr.14684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.629+0000 7f680e7fc700 1 -- 172.21.15.33:0/1301725878 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f680405b540 con 0x7f68100fe900 2024-02-15T22:45:15.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.921+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f68100fb670 con 0x7f68100fe900 2024-02-15T22:45:15.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.922+0000 7f680e7fc700 1 -- 172.21.15.33:0/1301725878 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f680405b0d0 con 0x7f68100fe900 2024-02-15T22:45:15.924 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:45:15.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f67f806d0e0 msgr2=0x7f67f806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f67f806d0e0 0x7f67f806f590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6808004f00 tx=0x7f6808009040 comp rx=0 tx=0).stop 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 msgr2=0x7f6810114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810114070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6804000c00 tx=0x7f6804009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 shutdown_connections 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:6800/1221640653,v1:172.21.15.33:6801/1221640653] conn(0x7f67f806d0e0 0x7f67f806f590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68100fdf60 0x7f6810113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 --2- 172.21.15.33:0/1301725878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68100fe900 0x7f6810114070 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 >> 172.21.15.33:0/1301725878 conn(0x7f68100f7a10 msgr2=0x7f68101016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 shutdown_connections 2024-02-15T22:45:15.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:15.924+0000 7f6818236700 1 -- 172.21.15.33:0/1301725878 wait complete. 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: pgmap v85: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: from='client.? 172.21.15.33:0/1301725878' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:45:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:16 smithi033 ceph-mon[29033]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:16.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:16.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: pgmap v85: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:16.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:16.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:45:16.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:45:16.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:16.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: from='client.? 172.21.15.33:0/1301725878' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:45:16.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:16 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:17 smithi033 ceph-mon[29033]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:17.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:17 smithi033 ceph-mon[29033]: Upgrade: Updating mon.smithi033 2024-02-15T22:45:17.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:17 smithi033 ceph-mon[29033]: Deploying daemon mon.smithi033 on smithi033 2024-02-15T22:45:17.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:17 smithi082 ceph-mon[37153]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:17.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:17 smithi082 ceph-mon[37153]: Upgrade: Updating mon.smithi033 2024-02-15T22:45:17.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:17 smithi082 ceph-mon[37153]: Deploying daemon mon.smithi033 on smithi033 2024-02-15T22:45:17.820 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:17 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:45:17.820 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:17 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[29029]: 2024-02-15T22:45:17.798+0000 7f08f9f00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:45:17.820 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:17 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[29029]: 2024-02-15T22:45:17.798+0000 7f08f9f00700 -1 mon.smithi033@0(leader) e2 *** Got Signal Terminated *** 2024-02-15T22:45:18.210 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:17 smithi033 podman[113597]: 2024-02-15 22:45:17.973615268 +0000 UTC m=+0.268863263 container died 4e26ff0fda2f16d8bb34064628641095a2fe9f464a732173627e0d2aad555c2e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-9aa5233, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=) 2024-02-15T22:45:18.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:18 smithi033 podman[113597]: 2024-02-15 22:45:18.299911889 +0000 UTC m=+0.595159887 container cleanup 4e26ff0fda2f16d8bb34064628641095a2fe9f464a732173627e0d2aad555c2e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9aa5233, ceph=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-15T22:45:18.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:18 smithi033 bash[113597]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033 2024-02-15T22:45:18.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:18 smithi033 podman[113623]: 2024-02-15 22:45:18.492871608 +0000 UTC m=+0.512790755 container remove 4e26ff0fda2f16d8bb34064628641095a2fe9f464a732173627e0d2aad555c2e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, GIT_CLEAN=True, RELEASE=quincy-9aa5233, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:45:18.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:18 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service: Deactivated successfully. 2024-02-15T22:45:18.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:18 smithi033 systemd[1]: Stopped Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:45:18.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:18 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service: Consumed 13.395s CPU time. 2024-02-15T22:45:19.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:18 smithi033 systemd[1]: Starting Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:45:19.418 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 podman[113754]: 2024-02-15 22:45:19.067129605 +0000 UTC m=+0.018106770 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:45:19.418 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 podman[113754]: 2024-02-15 22:45:19.202993155 +0000 UTC m=+0.153970320 container create d82c29a70480c4a45083358c69c6eea6c559eb46f4d75600b80e1d0397c81139 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, ceph=True) 2024-02-15T22:45:19.418 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 podman[113754]: 2024-02-15 22:45:19.414003552 +0000 UTC m=+0.364980720 container init d82c29a70480c4a45083358c69c6eea6c559eb46f4d75600b80e1d0397c81139 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-15T22:45:19.418 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 podman[113754]: 2024-02-15 22:45:19.417038753 +0000 UTC m=+0.368015927 container start d82c29a70480c4a45083358c69c6eea6c559eb46f4d75600b80e1d0397c81139 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=) 2024-02-15T22:45:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: set uid:gid to 167:167 (ceph:ceph) 2024-02-15T22:45:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: pidfile_write: ignore empty --pid-file 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: load: jerasure load: lrc 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: RocksDB version: 7.9.2 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Git sha 0 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: DB SUMMARY 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: DB Session ID: E3LPZP86JKZUC7RAZDYB 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: CURRENT file: CURRENT 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: IDENTITY file: IDENTITY 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1171 Bytes 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 1, files: 000033.sst 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 000031.log size: 4560692 ; 2024-02-15T22:45:19.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.error_if_exists: 0 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.create_if_missing: 0 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.paranoid_checks: 1 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.env: 0x55a76d481ae0 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.fs: PosixFileSystem 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.info_log: 0x55a76fc71760 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_file_opening_threads: 16 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.statistics: (nil) 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.use_fsync: 0 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_log_file_size: 0 2024-02-15T22:45:19.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.keep_log_file_num: 1000 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.recycle_log_file_num: 0 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.allow_fallocate: 1 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.allow_mmap_reads: 0 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.allow_mmap_writes: 0 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.use_direct_reads: 0 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.create_missing_column_families: 0 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.db_log_dir: 2024-02-15T22:45:19.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.wal_dir: 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.advise_random_on_open: 1 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.db_write_buffer_size: 0 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.write_buffer_manager: 0x55a76fc45400 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T22:45:19.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.rate_limiter: (nil) 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.wal_recovery_mode: 2 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.enable_thread_tracking: 0 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.enable_pipelined_write: 0 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.unordered_write: 0 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.row_cache: None 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.wal_filter: None 2024-02-15T22:45:19.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.allow_ingest_behind: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.two_write_queues: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.manual_wal_flush: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.wal_compression: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.atomic_flush: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.log_readahead_size: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.best_efforts_recovery: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.allow_data_in_errors: 0 2024-02-15T22:45:19.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.db_host_id: __hostname__ 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_background_jobs: 2 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_background_compactions: -1 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_subcompactions: 1 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_total_wal_size: 0 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T22:45:19.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_open_files: -1 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bytes_per_sync: 0 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_readahead_size: 0 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_background_flushes: -1 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Compression algorithms supported: 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kZSTD supported: 0 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kXpressCompression supported: 0 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kLZ4HCCompression supported: 1 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kZlibCompression supported: 1 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kSnappyCompression supported: 1 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kLZ4Compression supported: 1 2024-02-15T22:45:19.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: kBZip2Compression supported: 0 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000015 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.merge_operator: 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_filter: None 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_filter_factory: None 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.sst_partitioner_factory: None 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a76fc71880) 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: cache_index_and_filter_blocks: 1 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T22:45:19.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: pin_top_level_index_and_filter: 1 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_type: 0 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_block_index_type: 0 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_shortening: 1 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: checksum: 4 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: no_block_cache: 0 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache: 0x55a76fc75090 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_name: BinnedLRUCache 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_options: 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: capacity : 536870912 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: num_shard_bits : 4 2024-02-15T22:45:19.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: strict_capacity_limit : 0 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: high_pri_pool_ratio: 0.000 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_compressed: (nil) 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: persistent_cache: (nil) 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_size: 4096 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_size_deviation: 10 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_restart_interval: 16 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_block_restart_interval: 1 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: metadata_block_size: 4096 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: partition_filters: 0 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: use_delta_encoding: 1 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: filter_policy: bloomfilter 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: whole_key_filtering: 1 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: verify_compression: 0 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: read_amp_bytes_per_bit: 0 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: format_version: 5 2024-02-15T22:45:19.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: enable_index_compression: 1 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_align: 0 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: max_auto_readahead_size: 262144 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: prepopulate_block_cache: 0 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: initial_auto_readahead_size: 8192 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: num_file_reads_for_auto_readahead: 2 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.write_buffer_size: 33554432 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_write_buffer_number: 2 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression: NoCompression 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression: Disabled 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.prefix_extractor: nullptr 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.num_levels: 7 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T22:45:19.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.level: 32767 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.strategy: 0 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T22:45:19.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.enabled: false 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.target_file_size_base: 67108864 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T22:45:19.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.arena_block_size: 1048576 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.disable_auto_compactions: 0 2024-02-15T22:45:19.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.table_properties_collectors: 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.inplace_update_support: 0 2024-02-15T22:45:19.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.bloom_locality: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.max_successive_merges: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.paranoid_file_checks: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.force_consistency_checks: 1 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.report_bg_io_stats: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.ttl: 2592000 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.enable_blob_files: false 2024-02-15T22:45:19.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.min_blob_size: 0 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.blob_file_size: 268435456 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.blob_file_starting_level: 0 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12022, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9917deb4-26b1-47a3-a35e-c0b7e69ecf40 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037119446217, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-02-15T22:45:19.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037119460945, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 4069201, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12023, "largest_seqno": 15352, "table_properties": {"data_size": 4056393, "index_size": 8011, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3781, "raw_key_size": 33344, "raw_average_key_size": 22, "raw_value_size": 4026877, "raw_average_value_size": 2673, "num_data_blocks": 362, "num_entries": 1506, "num_filter_entries": 1506, "num_deletions": 260, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708037119, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9917deb4-26b1-47a3-a35e-c0b7e69ecf40", "db_session_id": "E3LPZP86JKZUC7RAZDYB", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037119461052, "job": 1, "event": "recovery_finished"} 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi033/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a76fd64000 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: DB pointer 0x55a76fd50000 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** DB Stats ** 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:45:19.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L0 1/0 3.88 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L6 1/0 4.94 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Sum 2/0 8.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:45:19.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 509.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative compaction: 0.00 GB write, 225.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval compaction: 0.00 GB write, 225.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Block cache BinnedLRUCache@0x55a76fc75090#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-02-15T22:45:19.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: starting mon.smithi033 rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi033 fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???) e2 preinit fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???).mds e20 new map 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???).mds e20 print_map 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: e20 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: legacy client fscid: 1 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Filesystem 'cephfs' (1) 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: fs_name cephfs 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: epoch 20 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:45:19.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: modified 2024-02-15T22:41:18.912549+0000 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: tableserver 0 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: root 0 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: session_timeout 60 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: session_autoclose 300 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: max_file_size 1099511627776 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: max_xattr_size 65536 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: required_client_features {} 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: last_failure 0 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: last_failure_osd_epoch 0 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: max_mds 2 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: in 0,1 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: up {0=14470,1=24295} 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: failed 2024-02-15T22:45:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: damaged 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: stopped 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_pools [3] 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: metadata_pool 2 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: inline_data disabled 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: balancer 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: bal_rank_mask -1 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: standby_count_wanted 1 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2024-02-15T22:45:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-15T22:45:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:45:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:45:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:45:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 ceph-mon[113773]: mon.smithi033@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-15T22:45:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 bash[113754]: d82c29a70480c4a45083358c69c6eea6c559eb46f4d75600b80e1d0397c81139 2024-02-15T22:45:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:19 smithi033 systemd[1]: Started Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:45:21.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:45:21.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:45:21.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: pgmap v87: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:45:21.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: mon.smithi033 calling monitor election 2024-02-15T22:45:21.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: mon.smithi033 is new leader, mons smithi033,smithi082 in quorum (ranks 0,1) 2024-02-15T22:45:21.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:45:21.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:45:21.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:45:21.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: mgrmap e32: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:45:21.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: overall HEALTH_OK 2024-02-15T22:45:21.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: from='mgr.14684 ' entity='' 2024-02-15T22:45:21.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:20 smithi033 ceph-mon[113773]: mgrmap e33: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:45:21.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: from='mgr.14684 172.21.15.33:0/3210408600' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: pgmap v87: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: mon.smithi033 calling monitor election 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: mon.smithi033 is new leader, mons smithi033,smithi082 in quorum (ranks 0,1) 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: mgrmap e32: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: overall HEALTH_OK 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: from='mgr.14684 ' entity='' 2024-02-15T22:45:21.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:20 smithi082 ceph-mon[37153]: mgrmap e33: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:45:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:27 smithi033 ceph-mon[113773]: Standby manager daemon smithi082.mjhlse restarted 2024-02-15T22:45:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:27 smithi033 ceph-mon[113773]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:45:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:27 smithi033 ceph-mon[113773]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:45:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:27 smithi033 ceph-mon[113773]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:45:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:27 smithi033 ceph-mon[113773]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:45:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:27 smithi033 ceph-mon[113773]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:45:28.046 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:27 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse restarted 2024-02-15T22:45:28.046 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:27 smithi082 ceph-mon[37153]: Standby manager daemon smithi082.mjhlse started 2024-02-15T22:45:28.046 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:27 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/crt"}]: dispatch 2024-02-15T22:45:28.046 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:27 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:45:28.046 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:27 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.mjhlse/key"}]: dispatch 2024-02-15T22:45:28.046 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:27 smithi082 ceph-mon[37153]: from='mgr.? 172.21.15.82:0/1275717731' entity='mgr.smithi082.mjhlse' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:45:28.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082[37133]: 2024-02-15T22:45:28.045+0000 7fb1c6231700 -1 mon.smithi082@1(peon).osd e49 update_from_paxos full map CRC mismatch, resetting to canonical 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: mgrmap e34: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: Active manager daemon smithi033.swohxi restarted 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: Activating manager daemon smithi033.swohxi 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: mgrmap e35: smithi033.swohxi(active, starting, since 0.00606846s), standbys: smithi082.mjhlse 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:45:29.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:45:29.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:45:29.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:45:29.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:29.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:29.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:29.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:45:29.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:45:29.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:28 smithi033 ceph-mon[113773]: failed to encode map e49 with expected crc 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: mgrmap e34: smithi033.swohxi(active, since 2m), standbys: smithi082.mjhlse 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: Active manager daemon smithi033.swohxi restarted 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: Activating manager daemon smithi033.swohxi 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: mgrmap e35: smithi033.swohxi(active, starting, since 0.00606846s), standbys: smithi082.mjhlse 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:45:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi033.swohxi", "id": "smithi033.swohxi"}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr metadata", "who": "smithi082.mjhlse", "id": "smithi082.mjhlse"}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:45:29.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: Manager daemon smithi033.swohxi is now available 2024-02-15T22:45:29.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:29.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:29.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:29.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:45:29.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.swohxi/trash_purge_schedule"}]: dispatch 2024-02-15T22:45:29.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:28 smithi082 ceph-mon[37153]: failed to encode map e49 with expected crc 2024-02-15T22:45:30.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:29 smithi033 ceph-mon[113773]: failed to encode map e49 with expected crc 2024-02-15T22:45:30.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:29 smithi033 ceph-mon[113773]: [15/Feb/2024:22:45:28] ENGINE Bus STARTING 2024-02-15T22:45:30.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:29 smithi033 ceph-mon[113773]: [15/Feb/2024:22:45:28] ENGINE Serving on http://172.21.15.33:8765 2024-02-15T22:45:30.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:29 smithi033 ceph-mon[113773]: mgrmap e36: smithi033.swohxi(active, since 1.00924s), standbys: smithi082.mjhlse 2024-02-15T22:45:30.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:29 smithi082 ceph-mon[37153]: failed to encode map e49 with expected crc 2024-02-15T22:45:30.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:29 smithi082 ceph-mon[37153]: [15/Feb/2024:22:45:28] ENGINE Bus STARTING 2024-02-15T22:45:30.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:29 smithi082 ceph-mon[37153]: [15/Feb/2024:22:45:28] ENGINE Serving on http://172.21.15.33:8765 2024-02-15T22:45:30.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:29 smithi082 ceph-mon[37153]: mgrmap e36: smithi033.swohxi(active, since 1.00924s), standbys: smithi082.mjhlse 2024-02-15T22:45:30.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:30 smithi082 ceph-mon[37153]: [15/Feb/2024:22:45:29] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:45:30.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:30 smithi082 ceph-mon[37153]: [15/Feb/2024:22:45:29] ENGINE Bus STARTED 2024-02-15T22:45:30.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:30 smithi082 ceph-mon[37153]: pgmap v3: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:31.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:30 smithi033 ceph-mon[113773]: [15/Feb/2024:22:45:29] ENGINE Serving on https://172.21.15.33:7150 2024-02-15T22:45:31.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:30 smithi033 ceph-mon[113773]: [15/Feb/2024:22:45:29] ENGINE Bus STARTED 2024-02-15T22:45:31.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:30 smithi033 ceph-mon[113773]: pgmap v3: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:32.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:31 smithi082 ceph-mon[37153]: pgmap v4: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:32.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:31 smithi082 ceph-mon[37153]: mgrmap e37: smithi033.swohxi(active, since 3s), standbys: smithi082.mjhlse 2024-02-15T22:45:32.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:31 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:32.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:31 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:32.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:31 smithi033 ceph-mon[113773]: pgmap v4: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:32.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:31 smithi033 ceph-mon[113773]: mgrmap e37: smithi033.swohxi(active, since 3s), standbys: smithi082.mjhlse 2024-02-15T22:45:32.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:32.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:33.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:33 smithi033 ceph-mon[113773]: pgmap v5: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:33.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:33 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:33.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:33 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:33.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:33 smithi033 ceph-mon[113773]: mgrmap e38: smithi033.swohxi(active, since 4s), standbys: smithi082.mjhlse 2024-02-15T22:45:33.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:33 smithi082 ceph-mon[37153]: pgmap v5: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:33 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:33 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:33 smithi082 ceph-mon[37153]: mgrmap e38: smithi033.swohxi(active, since 4s), standbys: smithi082.mjhlse 2024-02-15T22:45:34.703 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:34 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:34.704 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:34 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:35.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:34 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:35.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:34 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:36.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:35 smithi033 ceph-mon[113773]: pgmap v6: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:36.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:36.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:36.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:35 smithi082 ceph-mon[37153]: pgmap v6: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-15T22:45:36.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:35 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:36.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:35 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:38.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:37 smithi082 ceph-mon[37153]: pgmap v7: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-15T22:45:38.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:37 smithi082 ceph-mon[37153]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:45:38.224 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:37 smithi033 ceph-mon[113773]: pgmap v7: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-15T22:45:38.224 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:37 smithi033 ceph-mon[113773]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:45:39.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: pgmap v8: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-15T22:45:39.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Detected new or changed devices on smithi033 2024-02-15T22:45:39.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:39.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:39.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:45:39.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:45:39.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:45:39.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:45:39.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:45:39.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:45:39.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:45:39.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:39 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: pgmap v8: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-15T22:45:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Detected new or changed devices on smithi033 2024-02-15T22:45:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Updating smithi033:/etc/ceph/ceph.conf 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Updating smithi082:/etc/ceph/ceph.conf 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: Updating smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:39.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:39 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:40 smithi082 ceph-mon[37153]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:45:40.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:40 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:40.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:40 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:40.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:40 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:45:40.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:40 smithi033 ceph-mon[113773]: Updating smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:45:40.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:40 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:40.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:40 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:40.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:40 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:45:42.101 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:41 smithi082 ceph-mon[37153]: pgmap v9: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:45:42.101 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:41 smithi082 ceph-mon[37153]: Upgrade: Updating mon.smithi082 2024-02-15T22:45:42.101 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:41 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:42.101 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:41 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:45:42.101 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:41 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:45:42.102 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:41 smithi082 ceph-mon[37153]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:42.102 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:41 smithi082 ceph-mon[37153]: Deploying daemon mon.smithi082 on smithi082 2024-02-15T22:45:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:41 smithi033 ceph-mon[113773]: pgmap v9: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:45:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:41 smithi033 ceph-mon[113773]: Upgrade: Updating mon.smithi082 2024-02-15T22:45:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:45:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:45:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:41 smithi033 ceph-mon[113773]: Deploying daemon mon.smithi082 on smithi082 2024-02-15T22:45:42.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:42 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:45:43.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:42 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082[37133]: 2024-02-15T22:45:42.954+0000 7fb1cba3c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:45:43.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:42 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082[37133]: 2024-02-15T22:45:42.954+0000 7fb1cba3c700 -1 mon.smithi082@1(peon) e2 *** Got Signal Terminated *** 2024-02-15T22:45:43.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:43 smithi082 podman[84385]: 2024-02-15 22:45:43.06780031 +0000 UTC m=+0.232296718 container died 6540eb082c8bccfe6b0c546161e065d31f806cc35a024cf947fcbbea33897038 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=quincy-9aa5233, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-15T22:45:43.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:43 smithi082 podman[84385]: 2024-02-15 22:45:43.447051497 +0000 UTC m=+0.611547918 container cleanup 6540eb082c8bccfe6b0c546161e065d31f806cc35a024cf947fcbbea33897038 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=quincy-9aa5233, GIT_CLEAN=True, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240131) 2024-02-15T22:45:43.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:43 smithi082 bash[84385]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082 2024-02-15T22:45:44.001 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:43 smithi082 podman[84399]: 2024-02-15 22:45:43.706827091 +0000 UTC m=+0.638534298 container remove 6540eb082c8bccfe6b0c546161e065d31f806cc35a024cf947fcbbea33897038 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9aa5233) 2024-02-15T22:45:44.001 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:43 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi082.service: Deactivated successfully. 2024-02-15T22:45:44.001 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:43 smithi082 systemd[1]: Stopped Ceph mon.smithi082 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:45:44.001 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:43 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi082.service: Consumed 7.257s CPU time. 2024-02-15T22:45:44.359 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 systemd[1]: Starting Ceph mon.smithi082 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:45:44.359 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 podman[84531]: 2024-02-15 22:45:44.116847718 +0000 UTC m=+0.017981703 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:45:44.359 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 podman[84531]: 2024-02-15 22:45:44.233327621 +0000 UTC m=+0.134461643 container create be308726497538eca46c3d27d82f30b6de18b29251d30b61c43b318cea00738b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:45:44.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 podman[84531]: 2024-02-15 22:45:44.460975222 +0000 UTC m=+0.362109199 container init be308726497538eca46c3d27d82f30b6de18b29251d30b61c43b318cea00738b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:45:44.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 podman[84531]: 2024-02-15 22:45:44.464116114 +0000 UTC m=+0.365250093 container start be308726497538eca46c3d27d82f30b6de18b29251d30b61c43b318cea00738b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-15T22:45:44.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: set uid:gid to 167:167 (ceph:ceph) 2024-02-15T22:45:44.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-15T22:45:44.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: pidfile_write: ignore empty --pid-file 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: load: jerasure load: lrc 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: RocksDB version: 7.9.2 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Git sha 0 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: DB SUMMARY 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: DB Session ID: IHXLN8213X0GJOECVQW5 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: CURRENT file: CURRENT 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: IDENTITY file: IDENTITY 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1096 Bytes 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi082/store.db dir, Total Num: 1, files: 000027.sst 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi082/store.db: 000025.log size: 9690637 ; 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.error_if_exists: 0 2024-02-15T22:45:44.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.create_if_missing: 0 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.paranoid_checks: 1 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.env: 0x55c8586e5ae0 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.fs: PosixFileSystem 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.info_log: 0x55c859d07760 2024-02-15T22:45:44.627 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_file_opening_threads: 16 2024-02-15T22:45:44.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.statistics: (nil) 2024-02-15T22:45:44.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.use_fsync: 0 2024-02-15T22:45:44.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_log_file_size: 0 2024-02-15T22:45:44.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T22:45:44.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T22:45:44.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.keep_log_file_num: 1000 2024-02-15T22:45:44.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.recycle_log_file_num: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.allow_fallocate: 1 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.allow_mmap_reads: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.allow_mmap_writes: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.use_direct_reads: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.create_missing_column_families: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.db_log_dir: 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.wal_dir: 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T22:45:44.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.advise_random_on_open: 1 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.db_write_buffer_size: 0 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.write_buffer_manager: 0x55c859cdb400 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.rate_limiter: (nil) 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.wal_recovery_mode: 2 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.enable_thread_tracking: 0 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.enable_pipelined_write: 0 2024-02-15T22:45:44.630 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.unordered_write: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.row_cache: None 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.wal_filter: None 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.allow_ingest_behind: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.two_write_queues: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.manual_wal_flush: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.wal_compression: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.atomic_flush: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T22:45:44.631 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.log_readahead_size: 0 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.best_efforts_recovery: 0 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.allow_data_in_errors: 0 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.db_host_id: __hostname__ 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_background_jobs: 2 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_background_compactions: -1 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_subcompactions: 1 2024-02-15T22:45:44.632 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_total_wal_size: 0 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_open_files: -1 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bytes_per_sync: 0 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_readahead_size: 0 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_background_flushes: -1 2024-02-15T22:45:44.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Compression algorithms supported: 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kZSTD supported: 0 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kXpressCompression supported: 0 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kLZ4HCCompression supported: 1 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kZlibCompression supported: 1 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kSnappyCompression supported: 1 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kLZ4Compression supported: 1 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: kBZip2Compression supported: 0 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000009 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T22:45:44.634 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.merge_operator: 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_filter: None 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_filter_factory: None 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.sst_partitioner_factory: None 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c859d07880) 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-02-15T22:45:44.635 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_type: 0 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_index_type: 0 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_shortening: 1 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: checksum: 4 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: no_block_cache: 0 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache: 0x55c859d0b090 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_options: 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: capacity : 536870912 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_shard_bits : 4 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: strict_capacity_limit : 0 2024-02-15T22:45:44.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_compressed: (nil) 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: persistent_cache: (nil) 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size: 4096 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size_deviation: 10 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_restart_interval: 16 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_block_restart_interval: 1 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_block_size: 4096 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: partition_filters: 0 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: use_delta_encoding: 1 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: filter_policy: bloomfilter 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: whole_key_filtering: 1 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: verify_compression: 0 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: format_version: 5 2024-02-15T22:45:44.637 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_index_compression: 1 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_align: 0 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_auto_readahead_size: 262144 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: prepopulate_block_cache: 0 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: initial_auto_readahead_size: 8192 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.write_buffer_size: 33554432 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_write_buffer_number: 2 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression: NoCompression 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression: Disabled 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.prefix_extractor: nullptr 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.num_levels: 7 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T22:45:44.638 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.level: 32767 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.strategy: 0 2024-02-15T22:45:44.639 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.enabled: false 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.target_file_size_base: 67108864 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T22:45:44.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T22:45:44.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T22:45:44.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.arena_block_size: 1048576 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T22:45:44.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.disable_auto_compactions: 0 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.table_properties_collectors: 2024-02-15T22:45:44.643 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.inplace_update_support: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.bloom_locality: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.max_successive_merges: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.paranoid_file_checks: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.force_consistency_checks: 1 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.report_bg_io_stats: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.ttl: 2592000 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-15T22:45:44.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.enable_blob_files: false 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.min_blob_size: 0 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.blob_file_size: 268435456 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.blob_file_starting_level: 0 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12096, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-15T22:45:44.645 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b45157d8-910a-4e18-8792-146f50c9d510 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037144493971, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037144518731, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 5769481, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12101, "largest_seqno": 16282, "table_properties": {"data_size": 5754632, "index_size": 9540, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4293, "raw_key_size": 38131, "raw_average_key_size": 22, "raw_value_size": 5720751, "raw_average_value_size": 3339, "num_data_blocks": 428, "num_entries": 1713, "num_filter_entries": 1713, "num_deletions": 260, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708037144, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b45157d8-910a-4e18-8792-146f50c9d510", "db_session_id": "IHXLN8213X0GJOECVQW5", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037144518840, "job": 1, "event": "recovery_finished"} 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi082/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c859dfa000 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: DB pointer 0x55c859de6000 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** DB Stats ** 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:45:44.646 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 1/0 5.50 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.8 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L6 1/0 4.94 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 2/0 10.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.8 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.8 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-15T22:45:44.647 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 578.8 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:45:44.648 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.01 GB write, 184.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.01 GB write, 184.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache BinnedLRUCache@0x55c859d0b090#2 capacity: 512.00 MB usage: 14.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,10.08 KB,0.00192225%) Misc(1,0.00 KB,0%) 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: starting mon.smithi082 rank 1 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi082 fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???) e2 preinit fsid cfc49586-cc51-11ee-95ba-87774f69a715 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???).mds e21 new map 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???).mds e21 print_map 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: e21 2024-02-15T22:45:44.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: legacy client fscid: 1 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Filesystem 'cephfs' (1) 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: fs_name cephfs 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: epoch 21 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: modified 2024-02-15T22:45:36.298981+0000 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: tableserver 0 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: root 0 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: session_timeout 60 2024-02-15T22:45:44.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: session_autoclose 300 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_file_size 1099511627776 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_xattr_size 65536 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: required_client_features {} 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: last_failure 0 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: last_failure_osd_epoch 0 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_mds 2 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: in 0,1 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: up {0=14470,1=24295} 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: failed 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: damaged 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: stopped 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_pools [3] 2024-02-15T22:45:44.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_pool 2 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: inline_data disabled 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: balancer 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: bal_rank_mask -1 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: standby_count_wanted 1 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:45:44.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:45:44.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:45:44.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 ceph-mon[84550]: mon.smithi082@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-15T22:45:44.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 bash[84531]: be308726497538eca46c3d27d82f30b6de18b29251d30b61c43b318cea00738b 2024-02-15T22:45:44.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:44 smithi082 systemd[1]: Started Ceph mon.smithi082 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:45:46.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 -- 172.21.15.33:0/322665891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 msgr2=0x7fca9c0fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 --2- 172.21.15.33:0/322665891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c0fb9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fca90004940 tx=0x7fca90009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 -- 172.21.15.33:0/322665891 shutdown_connections 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 --2- 172.21.15.33:0/322665891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c0fb9c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 --2- 172.21.15.33:0/322665891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 0x7fca9c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 -- 172.21.15.33:0/322665891 >> 172.21.15.33:0/322665891 conn(0x7fca9c071560 msgr2=0x7fca9c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 -- 172.21.15.33:0/322665891 shutdown_connections 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 -- 172.21.15.33:0/322665891 wait complete. 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.045+0000 7fcaa2767700 1 Processor -- start 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fcaa2767700 1 -- start start 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fcaa2767700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fcaa2767700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 0x7fca9c114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fcaa2767700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1146b0 con 0x7fca9c0fb570 2024-02-15T22:45:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fcaa2767700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c10d9e0 con 0x7fca9c103140 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45828/0 (socket says 172.21.15.33:45828) 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9bfff700 1 -- 172.21.15.33:0/2092399084 learned_addr learned my addr 172.21.15.33:0/2092399084 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9b7fe700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 0x7fca9c114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9b7fe700 1 -- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 msgr2=0x7fca9c114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9b7fe700 1 -- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 msgr2=0x7fca9c114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9b7fe700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 0x7fca9c114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9b7fe700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 0x7fca9c114060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9bfff700 1 -- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 msgr2=0x7fca9c114060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9bfff700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 0x7fca9c114060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9bfff700 1 -- 172.21.15.33:0/2092399084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90005040 con 0x7fca9c0fb570 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.046+0000 7fca9bfff700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c113b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca8c002a50 tx=0x7fca8c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.047+0000 7fca98ff9700 1 -- 172.21.15.33:0/2092399084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8c007cc0 con 0x7fca9c0fb570 2024-02-15T22:45:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.047+0000 7fca98ff9700 1 -- 172.21.15.33:0/2092399084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca8c00f040 con 0x7fca9c0fb570 2024-02-15T22:45:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.047+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c10dcc0 con 0x7fca9c0fb570 2024-02-15T22:45:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.047+0000 7fca98ff9700 1 -- 172.21.15.33:0/2092399084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8c009640 con 0x7fca9c0fb570 2024-02-15T22:45:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.047+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c10e200 con 0x7fca9c0fb570 2024-02-15T22:45:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.048+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c1054d0 con 0x7fca9c0fb570 2024-02-15T22:45:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.048+0000 7fca98ff9700 1 -- 172.21.15.33:0/2092399084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fca8c0097a0 con 0x7fca9c0fb570 2024-02-15T22:45:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.048+0000 7fca98ff9700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca8406d900 0x7fca8406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.049+0000 7fca98ff9700 1 -- 172.21.15.33:0/2092399084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fca8c08ce50 con 0x7fca9c0fb570 2024-02-15T22:45:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.049+0000 7fca9b7fe700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca8406d900 0x7fca8406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.049+0000 7fca9b7fe700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca8406d900 0x7fca8406fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca9c10f350 tx=0x7fca90009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.054+0000 7fca98ff9700 1 -- 172.21.15.33:0/2092399084 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fca8c05a030 con 0x7fca9c0fb570 2024-02-15T22:45:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.278+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca9c04bed0 con 0x7fca8406d900 2024-02-15T22:45:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.279+0000 7fca98ff9700 1 -- 172.21.15.33:0/2092399084 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fca9c04bed0 con 0x7fca8406d900 2024-02-15T22:45:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca8406d900 msgr2=0x7fca8406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca8406d900 0x7fca8406fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca9c10f350 tx=0x7fca90009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 msgr2=0x7fca9c113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c113b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca8c002a50 tx=0x7fca8c0046b0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 shutdown_connections 2024-02-15T22:45:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca8406d900 0x7fca8406fdb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0fb570 0x7fca9c113b20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 --2- 172.21.15.33:0/2092399084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca9c103140 0x7fca9c114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.281+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 >> 172.21.15.33:0/2092399084 conn(0x7fca9c071560 msgr2=0x7fca9c0f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.282+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 shutdown_connections 2024-02-15T22:45:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.282+0000 7fcaa2767700 1 -- 172.21.15.33:0/2092399084 wait complete. 2024-02-15T22:45:46.293 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:45:46.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:45:46.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: mon.smithi033 calling monitor election 2024-02-15T22:45:46.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: mon.smithi082 calling monitor election 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: mon.smithi033 is new leader, mons smithi033,smithi082 in quorum (ranks 0,1) 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: monmap e3: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: mgrmap e38: smithi033.swohxi(active, since 17s), standbys: smithi082.mjhlse 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: overall HEALTH_OK 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:46 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/4157361710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 msgr2=0x7f1ae00fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/4157361710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae00fbe70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4004940 tx=0x7f1ad4009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/4157361710 shutdown_connections 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/4157361710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae00fbe70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/4157361710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 0x7f1ae0102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/4157361710 >> 172.21.15.33:0/4157361710 conn(0x7f1ae00f7a10 msgr2=0x7f1ae00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/4157361710 shutdown_connections 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.385+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/4157361710 wait complete. 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ae4f6b700 1 Processor -- start 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ae4f6b700 1 -- start start 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ae4f6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 0x7f1ae0113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ae4f6b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae0114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ae4f6b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0114650 con 0x7f1ae0102800 2024-02-15T22:45:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ae4f6b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae010d980 con 0x7f1ae0101e60 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1addd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae0114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1addd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae0114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45846/0 (socket says 172.21.15.33:45846) 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1addd9b700 1 -- 172.21.15.33:0/116363019 learned_addr learned my addr 172.21.15.33:0/116363019 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ade59c700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 0x7f1ae0113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ade59c700 1 -- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 msgr2=0x7f1ae0113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ade59c700 1 -- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 msgr2=0x7f1ae0113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ade59c700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 0x7f1ae0113ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.386+0000 7f1ade59c700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 0x7f1ae0113ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1addd9b700 1 -- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 msgr2=0x7f1ae0113ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1addd9b700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 0x7f1ae0113ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1addd9b700 1 -- 172.21.15.33:0/116363019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4005040 con 0x7f1ae0102800 2024-02-15T22:45:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1addd9b700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae0114000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009100 tx=0x7f1ad4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1aceffd700 1 -- 172.21.15.33:0/116363019 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad400e040 con 0x7f1ae0102800 2024-02-15T22:45:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1aceffd700 1 -- 172.21.15.33:0/116363019 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ad4004290 con 0x7f1ae0102800 2024-02-15T22:45:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae010dc00 con 0x7f1ae0102800 2024-02-15T22:45:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1aceffd700 1 -- 172.21.15.33:0/116363019 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad401c3f0 con 0x7f1ae0102800 2024-02-15T22:45:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.387+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae010e140 con 0x7f1ae0102800 2024-02-15T22:45:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.388+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae00fb610 con 0x7f1ae0102800 2024-02-15T22:45:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.388+0000 7f1aceffd700 1 -- 172.21.15.33:0/116363019 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f1ad400bbf0 con 0x7f1ae0102800 2024-02-15T22:45:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.389+0000 7f1aceffd700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1ac806d900 0x7f1ac806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.389+0000 7f1aceffd700 1 -- 172.21.15.33:0/116363019 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f1ad408e2f0 con 0x7f1ae0102800 2024-02-15T22:45:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.389+0000 7f1ade59c700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1ac806d900 0x7f1ac806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.389+0000 7f1ade59c700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1ac806d900 0x7f1ac806fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009ce0 tx=0x7f1ad0009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:46.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.393+0000 7f1aceffd700 1 -- 172.21.15.33:0/116363019 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1ad405b610 con 0x7f1ae0102800 2024-02-15T22:45:46.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.613+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae0109000 con 0x7f1ac806d900 2024-02-15T22:45:46.615 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T22:45:46.615 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: mon.smithi033 calling monitor election 2024-02-15T22:45:46.615 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: mon.smithi082 calling monitor election 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: mon.smithi033 is new leader, mons smithi033,smithi082 in quorum (ranks 0,1) 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: monmap e3: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2 up:standby-replay 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: mgrmap e38: smithi033.swohxi(active, since 17s), standbys: smithi082.mjhlse 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: overall HEALTH_OK 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:46.616 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:46 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:46.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.615+0000 7f1aceffd700 1 -- 172.21.15.33:0/116363019 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1ad0004e70 con 0x7f1ac806d900 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.617+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1ac806d900 msgr2=0x7f1ac806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.617+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1ac806d900 0x7f1ac806fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009ce0 tx=0x7f1ad0009f70 comp rx=0 tx=0).stop 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.617+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 msgr2=0x7f1ae0114000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.617+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae0114000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009100 tx=0x7f1ad4009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.618+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 shutdown_connections 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.618+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1ac806d900 0x7f1ac806fdb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.618+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae0101e60 0x7f1ae0113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.618+0000 7f1ae4f6b700 1 --2- 172.21.15.33:0/116363019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0102800 0x7f1ae0114000 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.618+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 >> 172.21.15.33:0/116363019 conn(0x7f1ae00f7a10 msgr2=0x7f1ae0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:46.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.618+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 shutdown_connections 2024-02-15T22:45:46.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.618+0000 7f1ae4f6b700 1 -- 172.21.15.33:0/116363019 wait complete. 2024-02-15T22:45:46.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.719+0000 7fdaa8458700 1 -- 172.21.15.33:0/1218801925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 msgr2=0x7fdaa00fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.719+0000 7fdaa8458700 1 --2- 172.21.15.33:0/1218801925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fbe70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda90004940 tx=0x7fda90009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 -- 172.21.15.33:0/1218801925 shutdown_connections 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 --2- 172.21.15.33:0/1218801925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fbe70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 --2- 172.21.15.33:0/1218801925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 0x7fdaa0102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 -- 172.21.15.33:0/1218801925 >> 172.21.15.33:0/1218801925 conn(0x7fdaa00f7a10 msgr2=0x7fdaa00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 -- 172.21.15.33:0/1218801925 shutdown_connections 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 -- 172.21.15.33:0/1218801925 wait complete. 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 Processor -- start 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 -- start start 2024-02-15T22:45:46.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 0x7fdaa00fdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fe020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00fe620 con 0x7fdaa0102800 2024-02-15T22:45:46.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.720+0000 7fdaa8458700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00fe790 con 0x7fdaa0101e60 2024-02-15T22:45:46.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa59f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa59f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fe020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53916/0 (socket says 172.21.15.33:53916) 2024-02-15T22:45:46.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa59f3700 1 -- 172.21.15.33:0/2071754274 learned_addr learned my addr 172.21.15.33:0/2071754274 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa61f4700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 0x7fdaa00fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa61f4700 1 -- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 msgr2=0x7fdaa00fdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa61f4700 1 -- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 msgr2=0x7fdaa00fdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa61f4700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 0x7fdaa00fdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa61f4700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 0x7fdaa00fdae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa59f3700 1 -- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 msgr2=0x7fdaa00fdae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa59f3700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 0x7fdaa00fdae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa59f3700 1 -- 172.21.15.33:0/2071754274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90005040 con 0x7fdaa0102800 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa59f3700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fe020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda90009100 tx=0x7fda90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fda96ffd700 1 -- 172.21.15.33:0/2071754274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9000e040 con 0x7fdaa0102800 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fda96ffd700 1 -- 172.21.15.33:0/2071754274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda90004290 con 0x7fdaa0102800 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0119d00 con 0x7fdaa0102800 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fda96ffd700 1 -- 172.21.15.33:0/2071754274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9001c3f0 con 0x7fdaa0102800 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.721+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa011a160 con 0x7fdaa0102800 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.722+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa00fb610 con 0x7fdaa0102800 2024-02-15T22:45:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.722+0000 7fda96ffd700 1 -- 172.21.15.33:0/2071754274 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fda9000bbf0 con 0x7fdaa0102800 2024-02-15T22:45:46.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.723+0000 7fda96ffd700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fda8c06d900 0x7fda8c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:46.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.723+0000 7fda96ffd700 1 -- 172.21.15.33:0/2071754274 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fda9008e2d0 con 0x7fdaa0102800 2024-02-15T22:45:46.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.723+0000 7fdaa61f4700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fda8c06d900 0x7fda8c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:46.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.723+0000 7fdaa61f4700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fda8c06d900 0x7fda8c06fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009ce0 tx=0x7fda9c009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:46.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.728+0000 7fda96ffd700 1 -- 172.21.15.33:0/2071754274 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fda90057ac0 con 0x7fdaa0102800 2024-02-15T22:45:46.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.940+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaa00ff330 con 0x7fda8c06d900 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.950+0000 7fda96ffd700 1 -- 172.21.15.33:0/2071754274 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdaa00ff330 con 0x7fda8c06d900 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (117s) 13s ago 13m 17.2M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (13m) 13s ago 13m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (12m) 15s ago 12m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (101s) 13s ago 12m 78.5M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (7m) 13s ago 7m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (7m) 13s ago 7m 75.0M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (7m) 15s ago 7m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (7m) 15s ago 7m 68.0M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:45:46.952 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (3m) 13s ago 14m 471M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (2m) 15s ago 11m 446M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (27s) 13s ago 14m 29.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 starting - - - 2048M 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (2m) 13s ago 13m 16.6M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (2m) 15s ago 11m 16.3M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (11m) 13s ago 11m 213M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (10m) 13s ago 10m 232M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (10m) 13s ago 10m 198M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (9m) 15s ago 9m 263M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (9m) 15s ago 9m 231M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (8m) 15s ago 8m 225M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:45:46.953 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (2m) 13s ago 12m 55.8M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:45:46.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fda8c06d900 msgr2=0x7fda8c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fda8c06d900 0x7fda8c06fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009ce0 tx=0x7fda9c009f70 comp rx=0 tx=0).stop 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 msgr2=0x7fdaa00fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fe020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda90009100 tx=0x7fda90009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 shutdown_connections 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fda8c06d900 0x7fda8c06fdb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaa0101e60 0x7fdaa00fdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 --2- 172.21.15.33:0/2071754274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa0102800 0x7fdaa00fe020 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 >> 172.21.15.33:0/2071754274 conn(0x7fdaa00f7a10 msgr2=0x7fdaa0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 shutdown_connections 2024-02-15T22:45:46.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:46.953+0000 7fdaa8458700 1 -- 172.21.15.33:0/2071754274 wait complete. 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 -- 172.21.15.33:0/3129085990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc102f50 msgr2=0x7f1abc103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3129085990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc102f50 0x7f1abc103320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0004940 tx=0x7f1ab0009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 -- 172.21.15.33:0/3129085990 shutdown_connections 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3129085990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc1038f0 0x7f1abc0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3129085990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc102f50 0x7f1abc103320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 -- 172.21.15.33:0/3129085990 >> 172.21.15.33:0/3129085990 conn(0x7f1abc0f8ae0 msgr2=0x7f1abc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 -- 172.21.15.33:0/3129085990 shutdown_connections 2024-02-15T22:45:47.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.054+0000 7f1ac1905700 1 -- 172.21.15.33:0/3129085990 wait complete. 2024-02-15T22:45:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.055+0000 7f1ac1905700 1 Processor -- start 2024-02-15T22:45:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.055+0000 7f1ac1905700 1 -- start start 2024-02-15T22:45:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.055+0000 7f1ac1905700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 0x7f1abc113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.055+0000 7f1ac1905700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc1038f0 0x7f1abc113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.055+0000 7f1ac1905700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc1145f0 con 0x7f1abc1038f0 2024-02-15T22:45:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.055+0000 7f1ac1905700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc10d920 con 0x7f1abc102f50 2024-02-15T22:45:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.055+0000 7f1aba7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc1038f0 0x7f1abc113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aba7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc1038f0 0x7f1abc113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53942/0 (socket says 172.21.15.33:53942) 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aba7fc700 1 -- 172.21.15.33:0/3558343796 learned_addr learned my addr 172.21.15.33:0/3558343796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1abaffd700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 0x7f1abc113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1abaffd700 1 -- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 msgr2=0x7f1abc113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1abaffd700 1 -- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 msgr2=0x7f1abc113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1abaffd700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 0x7f1abc113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1abaffd700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 0x7f1abc113a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aba7fc700 1 -- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 msgr2=0x7f1abc113a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aba7fc700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 0x7f1abc113a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aba7fc700 1 -- 172.21.15.33:0/3558343796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0005040 con 0x7f1abc1038f0 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aba7fc700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc1038f0 0x7f1abc113fa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00c890 tx=0x7f1aac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aa37fe700 1 -- 172.21.15.33:0/3558343796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac00a7d0 con 0x7f1abc1038f0 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aa37fe700 1 -- 172.21.15.33:0/3558343796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1aac00ae00 con 0x7f1abc1038f0 2024-02-15T22:45:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc10dc00 con 0x7f1abc1038f0 2024-02-15T22:45:47.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1aa37fe700 1 -- 172.21.15.33:0/3558343796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac0113a0 con 0x7f1abc1038f0 2024-02-15T22:45:47.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.056+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc10e140 con 0x7f1abc1038f0 2024-02-15T22:45:47.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.057+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc100260 con 0x7f1abc1038f0 2024-02-15T22:45:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.058+0000 7f1aa37fe700 1 -- 172.21.15.33:0/3558343796 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f1aac012400 con 0x7f1abc1038f0 2024-02-15T22:45:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.058+0000 7f1aa37fe700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1aa406d900 0x7f1aa406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.058+0000 7f1abaffd700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1aa406d900 0x7f1aa406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.058+0000 7f1aa37fe700 1 -- 172.21.15.33:0/3558343796 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f1aac08d060 con 0x7f1abc1038f0 2024-02-15T22:45:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.059+0000 7f1abaffd700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1aa406d900 0x7f1aa406fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0004560 tx=0x7f1ab0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.063+0000 7f1aa37fe700 1 -- 172.21.15.33:0/3558343796 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1aac05a3f0 con 0x7f1abc1038f0 2024-02-15T22:45:47.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.353+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1abc10a050 con 0x7f1abc1038f0 2024-02-15T22:45:47.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.353+0000 7f1aa37fe700 1 -- 172.21.15.33:0/3558343796 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f1aac059f80 con 0x7f1abc1038f0 2024-02-15T22:45:47.354 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 10, 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:45:47.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:45:47.356 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:45:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1aa406d900 msgr2=0x7f1aa406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1aa406d900 0x7f1aa406fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0004560 tx=0x7f1ab0009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc1038f0 msgr2=0x7f1abc113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc1038f0 0x7f1abc113fa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00c890 tx=0x7f1aac0044c0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 shutdown_connections 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1aa406d900 0x7f1aa406fdb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1abc102f50 0x7f1abc113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 --2- 172.21.15.33:0/3558343796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1abc1038f0 0x7f1abc113fa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 >> 172.21.15.33:0/3558343796 conn(0x7f1abc0f8ae0 msgr2=0x7f1abc0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 shutdown_connections 2024-02-15T22:45:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.355+0000 7f1ac1905700 1 -- 172.21.15.33:0/3558343796 wait complete. 2024-02-15T22:45:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 -- 172.21.15.33:0/2552769109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 msgr2=0x7fa190109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 --2- 172.21.15.33:0/2552769109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 0x7fa190109370 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa178004940 tx=0x7fa178009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 -- 172.21.15.33:0/2552769109 shutdown_connections 2024-02-15T22:45:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 --2- 172.21.15.33:0/2552769109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 0x7fa190109370 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 --2- 172.21.15.33:0/2552769109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa1900fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 -- 172.21.15.33:0/2552769109 >> 172.21.15.33:0/2552769109 conn(0x7fa1900f79d0 msgr2=0x7fa1900f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 -- 172.21.15.33:0/2552769109 shutdown_connections 2024-02-15T22:45:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.457+0000 7fa19568d700 1 -- 172.21.15.33:0/2552769109 wait complete. 2024-02-15T22:45:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa19568d700 1 Processor -- start 2024-02-15T22:45:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa19568d700 1 -- start start 2024-02-15T22:45:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa19568d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa190115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa19568d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 0x7fa190116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa19568d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190116760 con 0x7fa1900fc610 2024-02-15T22:45:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa19568d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19010fa90 con 0x7fa1900fbd00 2024-02-15T22:45:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 0x7fa190116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa190115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa190115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:58712/0 (socket says 172.21.15.33:58712) 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18effd700 1 -- 172.21.15.33:0/1731377860 learned_addr learned my addr 172.21.15.33:0/1731377860 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18effd700 1 -- 172.21.15.33:0/1731377860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 msgr2=0x7fa190115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18effd700 1 -- 172.21.15.33:0/1731377860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 msgr2=0x7fa190115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18effd700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa190115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18effd700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa190115bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18e7fc700 1 -- 172.21.15.33:0/1731377860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 msgr2=0x7fa190115bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18e7fc700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa190115bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.458+0000 7fa18e7fc700 1 -- 172.21.15.33:0/1731377860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178005040 con 0x7fa1900fc610 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.459+0000 7fa18e7fc700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 0x7fa190116110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa17800b3b0 tx=0x7fa178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.459+0000 7fa1877fe700 1 -- 172.21.15.33:0/1731377860 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa17800e040 con 0x7fa1900fc610 2024-02-15T22:45:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.459+0000 7fa1877fe700 1 -- 172.21.15.33:0/1731377860 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa178009b10 con 0x7fa1900fc610 2024-02-15T22:45:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.459+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19010fd70 con 0x7fa1900fc610 2024-02-15T22:45:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.459+0000 7fa1877fe700 1 -- 172.21.15.33:0/1731377860 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa178013660 con 0x7fa1900fc610 2024-02-15T22:45:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.459+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1901102b0 con 0x7fa1900fc610 2024-02-15T22:45:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.460+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190106aa0 con 0x7fa1900fc610 2024-02-15T22:45:47.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.460+0000 7fa1877fe700 1 -- 172.21.15.33:0/1731377860 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fa17801ca00 con 0x7fa1900fc610 2024-02-15T22:45:47.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.461+0000 7fa1877fe700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa17c06d900 0x7fa17c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.461+0000 7fa1877fe700 1 -- 172.21.15.33:0/1731377860 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fa17808de50 con 0x7fa1900fc610 2024-02-15T22:45:47.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.461+0000 7fa18effd700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa17c06d900 0x7fa17c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.461+0000 7fa18effd700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa17c06d900 0x7fa17c06fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa1880041d0 tx=0x7fa188007ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:47.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.465+0000 7fa1877fe700 1 -- 172.21.15.33:0/1731377860 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa17805b0d0 con 0x7fa1900fc610 2024-02-15T22:45:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:47 smithi082 ceph-mon[84550]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:45:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:47 smithi082 ceph-mon[84550]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:47 smithi082 ceph-mon[84550]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:47.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:47 smithi082 ceph-mon[84550]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.712+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1901111b0 con 0x7fa1900fc610 2024-02-15T22:45:47.714 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:47 smithi033 ceph-mon[113773]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:45:47.714 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:47 smithi033 ceph-mon[113773]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:47.714 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:47 smithi033 ceph-mon[113773]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:47.714 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:47 smithi033 ceph-mon[113773]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.713+0000 7fa1877fe700 1 -- 172.21.15.33:0/1731377860 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7fa17805ac60 con 0x7fa1900fc610 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:45:47.715 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:45:47.716 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:45:47.717 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:45:47.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa17c06d900 msgr2=0x7fa17c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:47.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa17c06d900 0x7fa17c06fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa1880041d0 tx=0x7fa188007ab0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 msgr2=0x7fa190116110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:47.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 0x7fa190116110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa17800b3b0 tx=0x7fa178009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:47.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 shutdown_connections 2024-02-15T22:45:47.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa17c06d900 0x7fa17c06fdb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1900fbd00 0x7fa190115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 --2- 172.21.15.33:0/1731377860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1900fc610 0x7fa190116110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 >> 172.21.15.33:0/1731377860 conn(0x7fa1900f79d0 msgr2=0x7fa1900f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:47.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 shutdown_connections 2024-02-15T22:45:47.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.715+0000 7fa19568d700 1 -- 172.21.15.33:0/1731377860 wait complete. 2024-02-15T22:45:47.719 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- 172.21.15.33:0/4113625078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa344102f50 msgr2=0x7fa344103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 --2- 172.21.15.33:0/4113625078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa344102f50 0x7fa344103320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa334004940 tx=0x7fa334009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- 172.21.15.33:0/4113625078 shutdown_connections 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 --2- 172.21.15.33:0/4113625078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3441038f0 0x7fa3440fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 --2- 172.21.15.33:0/4113625078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa344102f50 0x7fa344103320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- 172.21.15.33:0/4113625078 >> 172.21.15.33:0/4113625078 conn(0x7fa3440f8ae0 msgr2=0x7fa3440faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- 172.21.15.33:0/4113625078 shutdown_connections 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- 172.21.15.33:0/4113625078 wait complete. 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 Processor -- start 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- start start 2024-02-15T22:45:47.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 0x7fa344113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3441038f0 0x7fa344113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3441145f0 con 0x7fa3441038f0 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.819+0000 7fa348a5d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34410d920 con 0x7fa344102f50 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa341d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3441038f0 0x7fa344113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa341d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3441038f0 0x7fa344113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53976/0 (socket says 172.21.15.33:53976) 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa341d9b700 1 -- 172.21.15.33:0/825696349 learned_addr learned my addr 172.21.15.33:0/825696349 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa34259c700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 0x7fa344113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa34259c700 1 -- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 msgr2=0x7fa344113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa34259c700 1 -- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 msgr2=0x7fa344113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa34259c700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 0x7fa344113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa341d9b700 1 -- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 msgr2=0x7fa344113a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa34259c700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 0x7fa344113a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa341d9b700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 0x7fa344113a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa341d9b700 1 -- 172.21.15.33:0/825696349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334005040 con 0x7fa3441038f0 2024-02-15T22:45:47.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa341d9b700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3441038f0 0x7fa344113fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa338002a50 tx=0x7fa338004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:47.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa332ffd700 1 -- 172.21.15.33:0/825696349 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa338007cc0 con 0x7fa3441038f0 2024-02-15T22:45:47.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa332ffd700 1 -- 172.21.15.33:0/825696349 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa33800f040 con 0x7fa3441038f0 2024-02-15T22:45:47.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34410dc00 con 0x7fa3441038f0 2024-02-15T22:45:47.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa332ffd700 1 -- 172.21.15.33:0/825696349 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33800da40 con 0x7fa3441038f0 2024-02-15T22:45:47.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.820+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34410e140 con 0x7fa3441038f0 2024-02-15T22:45:47.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.821+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa344100260 con 0x7fa3441038f0 2024-02-15T22:45:47.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.822+0000 7fa332ffd700 1 -- 172.21.15.33:0/825696349 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fa3380097c0 con 0x7fa3441038f0 2024-02-15T22:45:47.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.822+0000 7fa332ffd700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa32c06d900 0x7fa32c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:47.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.822+0000 7fa332ffd700 1 -- 172.21.15.33:0/825696349 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fa33808cdf0 con 0x7fa3441038f0 2024-02-15T22:45:47.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.822+0000 7fa34259c700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa32c06d900 0x7fa32c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:47.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.823+0000 7fa34259c700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa32c06d900 0x7fa32c06fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa33400b3b0 tx=0x7fa334009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:47.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:47.827+0000 7fa332ffd700 1 -- 172.21.15.33:0/825696349 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa338059de0 con 0x7fa3441038f0 2024-02-15T22:45:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.050+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa344113730 con 0x7fa32c06d900 2024-02-15T22:45:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.051+0000 7fa332ffd700 1 -- 172.21.15.33:0/825696349 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa344113730 con 0x7fa32c06d900 2024-02-15T22:45:48.052 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:45:48.052 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:45:48.052 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "3/21 daemons upgraded", 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading mon daemons", 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:45:48.053 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:45:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa32c06d900 msgr2=0x7fa32c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa32c06d900 0x7fa32c06fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa33400b3b0 tx=0x7fa334009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3441038f0 msgr2=0x7fa344113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3441038f0 0x7fa344113fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa338002a50 tx=0x7fa338004600 comp rx=0 tx=0).stop 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 shutdown_connections 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa32c06d900 0x7fa32c06fdb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa344102f50 0x7fa344113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 --2- 172.21.15.33:0/825696349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3441038f0 0x7fa344113fa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 >> 172.21.15.33:0/825696349 conn(0x7fa3440f8ae0 msgr2=0x7fa3440fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 shutdown_connections 2024-02-15T22:45:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.053+0000 7fa348a5d700 1 -- 172.21.15.33:0/825696349 wait complete. 2024-02-15T22:45:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 -- 172.21.15.33:0/2846075033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 msgr2=0x7f3630102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 --2- 172.21.15.33:0/2846075033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f3630102210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3618004940 tx=0x7f3618009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 -- 172.21.15.33:0/2846075033 shutdown_connections 2024-02-15T22:45:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 --2- 172.21.15.33:0/2846075033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 0x7f36300fbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 --2- 172.21.15.33:0/2846075033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f3630102210 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 -- 172.21.15.33:0/2846075033 >> 172.21.15.33:0/2846075033 conn(0x7f36300f79d0 msgr2=0x7f36300f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 -- 172.21.15.33:0/2846075033 shutdown_connections 2024-02-15T22:45:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.156+0000 7f3636a06700 1 -- 172.21.15.33:0/2846075033 wait complete. 2024-02-15T22:45:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f3636a06700 1 Processor -- start 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f3636a06700 1 -- start start 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f3636a06700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f363010eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f3636a06700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 0x7f363010f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f3636a06700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363010f600 con 0x7f3630101e40 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f3636a06700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363010f740 con 0x7f36301027e0 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f363010eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f363010eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53986/0 (socket says 172.21.15.33:53986) 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362ffff700 1 -- 172.21.15.33:0/3843983236 learned_addr learned my addr 172.21.15.33:0/3843983236 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362f7fe700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 0x7f363010f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362f7fe700 1 -- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 msgr2=0x7f363010f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362f7fe700 1 -- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 msgr2=0x7f363010f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362f7fe700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 0x7f363010f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T22:45:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362f7fe700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 0x7f363010f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362ffff700 1 -- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 msgr2=0x7f363010f070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362ffff700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 0x7f363010f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.157+0000 7f362ffff700 1 -- 172.21.15.33:0/3843983236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618005040 con 0x7f3630101e40 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.158+0000 7f362ffff700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f363010eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f361800b3b0 tx=0x7f3618009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.158+0000 7f362cff9700 1 -- 172.21.15.33:0/3843983236 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361800e040 con 0x7f3630101e40 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.158+0000 7f362cff9700 1 -- 172.21.15.33:0/3843983236 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f361800bbf0 con 0x7f3630101e40 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.158+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3630117a40 con 0x7f3630101e40 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.158+0000 7f362cff9700 1 -- 172.21.15.33:0/3843983236 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361801c630 con 0x7f3630101e40 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.158+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3630117f50 con 0x7f3630101e40 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.159+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36300ff150 con 0x7f3630101e40 2024-02-15T22:45:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.159+0000 7f362cff9700 1 -- 172.21.15.33:0/3843983236 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f3618013420 con 0x7f3630101e40 2024-02-15T22:45:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.160+0000 7f362cff9700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f361c06d900 0x7f361c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.160+0000 7f362cff9700 1 -- 172.21.15.33:0/3843983236 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f361808e4a0 con 0x7f3630101e40 2024-02-15T22:45:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.160+0000 7f362f7fe700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f361c06d900 0x7f361c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.160+0000 7f362f7fe700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f361c06d900 0x7f361c06fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3620009fd0 tx=0x7f3620009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:48.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.165+0000 7f362cff9700 1 -- 172.21.15.33:0/3843983236 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3618057bf0 con 0x7f3630101e40 2024-02-15T22:45:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.452+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3630066750 con 0x7f3630101e40 2024-02-15T22:45:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.453+0000 7f362cff9700 1 -- 172.21.15.33:0/3843983236 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f361805b2b0 con 0x7f3630101e40 2024-02-15T22:45:48.455 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:45:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f361c06d900 msgr2=0x7f361c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f361c06d900 0x7f361c06fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3620009fd0 tx=0x7f3620009f20 comp rx=0 tx=0).stop 2024-02-15T22:45:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 msgr2=0x7f363010eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f363010eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f361800b3b0 tx=0x7f3618009e30 comp rx=0 tx=0).stop 2024-02-15T22:45:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 shutdown_connections 2024-02-15T22:45:48.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f361c06d900 0x7f361c06fdb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3630101e40 0x7f363010eb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 --2- 172.21.15.33:0/3843983236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36301027e0 0x7f363010f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:48.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 >> 172.21.15.33:0/3843983236 conn(0x7f36300f79d0 msgr2=0x7f36300f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:48.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 shutdown_connections 2024-02-15T22:45:48.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:45:48.455+0000 7f3636a06700 1 -- 172.21.15.33:0/3843983236 wait complete. 2024-02-15T22:45:48.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:48 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3558343796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:48.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:48 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1731377860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:45:48.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:48.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:48.659 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:48 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3558343796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:45:48.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:48 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1731377860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:45:48.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:48.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:49.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:49 smithi082 ceph-mon[84550]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:49.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:49 smithi082 ceph-mon[84550]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:49.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:49 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3843983236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:45:49.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:49.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:49.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:49 smithi033 ceph-mon[113773]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:49.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:49 smithi033 ceph-mon[113773]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:49.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:49 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3843983236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:45:49.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:49.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:51.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:51 smithi082 ceph-mon[84550]: pgmap v14: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:52.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:51 smithi033 ceph-mon[113773]: pgmap v14: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: pgmap v15: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: Detected new or changed devices on smithi082 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: Reconfiguring mon.smithi033 (monmap changed)... 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:45:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:54.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:53 smithi082 ceph-mon[84550]: Reconfiguring daemon mon.smithi033 on smithi033 2024-02-15T22:45:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: pgmap v15: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:45:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: Detected new or changed devices on smithi082 2024-02-15T22:45:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:54.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:54.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:54.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: Reconfiguring mon.smithi033 (monmap changed)... 2024-02-15T22:45:54.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:45:54.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:45:54.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:54.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:53 smithi033 ceph-mon[113773]: Reconfiguring daemon mon.smithi033 on smithi033 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: Reconfiguring mgr.smithi033.swohxi (monmap changed)... 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:55.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:55 smithi033 ceph-mon[113773]: Reconfiguring daemon mgr.smithi033.swohxi on smithi033 2024-02-15T22:45:55.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:55.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:55.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:55.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: Reconfiguring mgr.smithi033.swohxi (monmap changed)... 2024-02-15T22:45:55.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.swohxi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:45:55.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:45:55.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:55.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:55 smithi082 ceph-mon[84550]: Reconfiguring daemon mgr.smithi033.swohxi on smithi033 2024-02-15T22:45:57.504 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:57 smithi033 ceph-mon[113773]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:57.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:57.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:57.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:57 smithi033 ceph-mon[113773]: Reconfiguring crash.smithi033 (monmap changed)... 2024-02-15T22:45:57.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:45:57.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:57.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:57 smithi033 ceph-mon[113773]: Reconfiguring daemon crash.smithi033 on smithi033 2024-02-15T22:45:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:57 smithi082 ceph-mon[84550]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:45:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:57 smithi082 ceph-mon[84550]: Reconfiguring crash.smithi033 (monmap changed)... 2024-02-15T22:45:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:45:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:57 smithi082 ceph-mon[84550]: Reconfiguring daemon crash.smithi033 on smithi033 2024-02-15T22:45:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:58 smithi033 ceph-mon[113773]: Reconfiguring osd.0 (monmap changed)... 2024-02-15T22:45:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:45:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:58 smithi033 ceph-mon[113773]: Reconfiguring daemon osd.0 on smithi033 2024-02-15T22:45:59.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:45:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:58 smithi082 ceph-mon[84550]: Reconfiguring osd.0 (monmap changed)... 2024-02-15T22:45:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:45:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:58 smithi082 ceph-mon[84550]: Reconfiguring daemon osd.0 on smithi033 2024-02-15T22:45:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:59 smithi082 ceph-mon[84550]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:46:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:45:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:00.182 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:59 smithi033 ceph-mon[113773]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:00.182 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:00.182 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:00.182 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:46:00.182 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:45:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:00 smithi082 ceph-mon[84550]: Reconfiguring osd.1 (monmap changed)... 2024-02-15T22:46:01.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:00 smithi082 ceph-mon[84550]: Reconfiguring daemon osd.1 on smithi033 2024-02-15T22:46:01.215 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:00 smithi033 ceph-mon[113773]: Reconfiguring osd.1 (monmap changed)... 2024-02-15T22:46:01.215 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:00 smithi033 ceph-mon[113773]: Reconfiguring daemon osd.1 on smithi033 2024-02-15T22:46:02.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:01 smithi082 ceph-mon[84550]: pgmap v19: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:02.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:02.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:02.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:46:02.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:02.152 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:01 smithi033 ceph-mon[113773]: pgmap v19: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:02.152 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:02.152 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:02.152 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:46:02.152 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:02.898 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:02 smithi033 ceph-mon[113773]: Reconfiguring osd.2 (monmap changed)... 2024-02-15T22:46:02.898 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:02 smithi033 ceph-mon[113773]: Reconfiguring daemon osd.2 on smithi033 2024-02-15T22:46:03.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:02 smithi082 ceph-mon[84550]: Reconfiguring osd.2 (monmap changed)... 2024-02-15T22:46:03.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:02 smithi082 ceph-mon[84550]: Reconfiguring daemon osd.2 on smithi033 2024-02-15T22:46:03.935 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:03 smithi033 ceph-mon[113773]: pgmap v20: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:03.935 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:03 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:03.935 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:03 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:03.935 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:03 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:03.935 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:03 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:04.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:03 smithi082 ceph-mon[84550]: pgmap v20: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:04.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:03 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:04.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:03 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:04.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:03 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:04.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:03 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:05.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:04 smithi082 ceph-mon[84550]: Reconfiguring mds.cephfs.smithi033.ruqork (monmap changed)... 2024-02-15T22:46:05.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:04 smithi082 ceph-mon[84550]: Reconfiguring daemon mds.cephfs.smithi033.ruqork on smithi033 2024-02-15T22:46:05.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:04 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:05.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:04 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:05.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:04 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:05.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:04 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:04 smithi033 ceph-mon[113773]: Reconfiguring mds.cephfs.smithi033.ruqork (monmap changed)... 2024-02-15T22:46:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:04 smithi033 ceph-mon[113773]: Reconfiguring daemon mds.cephfs.smithi033.ruqork on smithi033 2024-02-15T22:46:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:04 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:04 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:04 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:04 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:06.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:05 smithi082 ceph-mon[84550]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:06.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:05 smithi082 ceph-mon[84550]: Reconfiguring mds.cephfs.smithi033.xkdegf (monmap changed)... 2024-02-15T22:46:06.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:05 smithi082 ceph-mon[84550]: Reconfiguring daemon mds.cephfs.smithi033.xkdegf on smithi033 2024-02-15T22:46:06.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:05 smithi033 ceph-mon[113773]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:06.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:05 smithi033 ceph-mon[113773]: Reconfiguring mds.cephfs.smithi033.xkdegf (monmap changed)... 2024-02-15T22:46:06.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:05 smithi033 ceph-mon[113773]: Reconfiguring daemon mds.cephfs.smithi033.xkdegf on smithi033 2024-02-15T22:46:07.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:07 smithi082 ceph-mon[84550]: pgmap v22: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:46:07.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:07 smithi082 ceph-mon[84550]: Reconfiguring crash.smithi082 (monmap changed)... 2024-02-15T22:46:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:46:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:07 smithi082 ceph-mon[84550]: Reconfiguring daemon crash.smithi082 on smithi082 2024-02-15T22:46:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:07 smithi033 ceph-mon[113773]: pgmap v22: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:46:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:07 smithi033 ceph-mon[113773]: Reconfiguring crash.smithi082 (monmap changed)... 2024-02-15T22:46:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:46:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:07 smithi033 ceph-mon[113773]: Reconfiguring daemon crash.smithi082 on smithi082 2024-02-15T22:46:09.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:09.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:09.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:08 smithi033 ceph-mon[113773]: Reconfiguring mgr.smithi082.mjhlse (monmap changed)... 2024-02-15T22:46:09.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:46:09.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:46:09.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:09.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:08 smithi033 ceph-mon[113773]: Reconfiguring daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:46:09.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:09.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:09.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:08 smithi082 ceph-mon[84550]: Reconfiguring mgr.smithi082.mjhlse (monmap changed)... 2024-02-15T22:46:09.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.mjhlse", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:46:09.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:46:09.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:09.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:08 smithi082 ceph-mon[84550]: Reconfiguring daemon mgr.smithi082.mjhlse on smithi082 2024-02-15T22:46:10.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:09 smithi082 ceph-mon[84550]: pgmap v23: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:10.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:10.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:10.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:46:10.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:46:10.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:10.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:09 smithi033 ceph-mon[113773]: pgmap v23: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:10.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:10.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:10.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:46:10.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:46:10.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:11.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:10 smithi082 ceph-mon[84550]: Reconfiguring mon.smithi082 (monmap changed)... 2024-02-15T22:46:11.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:10 smithi082 ceph-mon[84550]: Reconfiguring daemon mon.smithi082 on smithi082 2024-02-15T22:46:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:10 smithi033 ceph-mon[113773]: Reconfiguring mon.smithi082 (monmap changed)... 2024-02-15T22:46:11.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:10 smithi033 ceph-mon[113773]: Reconfiguring daemon mon.smithi082 on smithi082 2024-02-15T22:46:11.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:11 smithi082 ceph-mon[84550]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:11.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:11.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:11.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:46:11.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:12.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:11 smithi033 ceph-mon[113773]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:12.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:12.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:12.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:46:12.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:13.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:12 smithi082 ceph-mon[84550]: Reconfiguring osd.3 (monmap changed)... 2024-02-15T22:46:13.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:12 smithi082 ceph-mon[84550]: Reconfiguring daemon osd.3 on smithi082 2024-02-15T22:46:13.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:12 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:13.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:12 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:13.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:12 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:46:13.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:12 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:13.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:12 smithi033 ceph-mon[113773]: Reconfiguring osd.3 (monmap changed)... 2024-02-15T22:46:13.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:12 smithi033 ceph-mon[113773]: Reconfiguring daemon osd.3 on smithi082 2024-02-15T22:46:13.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:12 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:13.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:12 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:13.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:12 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:46:13.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:12 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:14.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:13 smithi082 ceph-mon[84550]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:13 smithi082 ceph-mon[84550]: Reconfiguring osd.4 (monmap changed)... 2024-02-15T22:46:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:13 smithi082 ceph-mon[84550]: Reconfiguring daemon osd.4 on smithi082 2024-02-15T22:46:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:13 smithi033 ceph-mon[113773]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:13 smithi033 ceph-mon[113773]: Reconfiguring osd.4 (monmap changed)... 2024-02-15T22:46:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:13 smithi033 ceph-mon[113773]: Reconfiguring daemon osd.4 on smithi082 2024-02-15T22:46:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:15.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:15 smithi082 ceph-mon[84550]: pgmap v26: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:15.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:15.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:15 smithi082 ceph-mon[84550]: Reconfiguring osd.5 (monmap changed)... 2024-02-15T22:46:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:46:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:15 smithi082 ceph-mon[84550]: Reconfiguring daemon osd.5 on smithi082 2024-02-15T22:46:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:15 smithi033 ceph-mon[113773]: pgmap v26: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:15 smithi033 ceph-mon[113773]: Reconfiguring osd.5 (monmap changed)... 2024-02-15T22:46:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:46:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:15 smithi033 ceph-mon[113773]: Reconfiguring daemon osd.5 on smithi082 2024-02-15T22:46:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:16 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:16 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:16 smithi033 ceph-mon[113773]: Reconfiguring mds.cephfs.smithi082.lvpzpf (monmap changed)... 2024-02-15T22:46:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:16 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:16 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:16 smithi033 ceph-mon[113773]: Reconfiguring daemon mds.cephfs.smithi082.lvpzpf on smithi082 2024-02-15T22:46:17.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:16 smithi033 ceph-mon[113773]: pgmap v27: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:17.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:16 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:17.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:16 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:17.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:16 smithi082 ceph-mon[84550]: Reconfiguring mds.cephfs.smithi082.lvpzpf (monmap changed)... 2024-02-15T22:46:17.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:16 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:17.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:16 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:17.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:16 smithi082 ceph-mon[84550]: Reconfiguring daemon mds.cephfs.smithi082.lvpzpf on smithi082 2024-02-15T22:46:17.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:16 smithi082 ceph-mon[84550]: pgmap v27: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:18.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 -- 172.21.15.33:0/2175556770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 msgr2=0x7f1a5c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 --2- 172.21.15.33:0/2175556770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c102230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c004940 tx=0x7f1a4c009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 -- 172.21.15.33:0/2175556770 shutdown_connections 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 --2- 172.21.15.33:0/2175556770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a5c102800 0x7f1a5c0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 --2- 172.21.15.33:0/2175556770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c102230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 -- 172.21.15.33:0/2175556770 >> 172.21.15.33:0/2175556770 conn(0x7f1a5c0f7a10 msgr2=0x7f1a5c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 -- 172.21.15.33:0/2175556770 shutdown_connections 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 -- 172.21.15.33:0/2175556770 wait complete. 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.572+0000 7f1a61f88700 1 Processor -- start 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a61f88700 1 -- start start 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a61f88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c10eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a61f88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a5c102800 0x7f1a5c10f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a61f88700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c10f5d0 con 0x7f1a5c101e60 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a61f88700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c10f710 con 0x7f1a5c102800 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c10eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:18.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c10eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56454/0 (socket says 172.21.15.33:56454) 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5b7fe700 1 -- 172.21.15.33:0/4042895309 learned_addr learned my addr 172.21.15.33:0/4042895309 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5affd700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a5c102800 0x7f1a5c10f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5b7fe700 1 -- 172.21.15.33:0/4042895309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a5c102800 msgr2=0x7f1a5c10f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5b7fe700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a5c102800 0x7f1a5c10f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5b7fe700 1 -- 172.21.15.33:0/4042895309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c005040 con 0x7f1a5c101e60 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5affd700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a5c102800 0x7f1a5c10f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.573+0000 7f1a5b7fe700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c10eb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009fd0 tx=0x7f1a4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.574+0000 7f1a43fff700 1 -- 172.21.15.33:0/4042895309 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c00e040 con 0x7f1a5c101e60 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.574+0000 7f1a43fff700 1 -- 172.21.15.33:0/4042895309 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a4c00bbf0 con 0x7f1a5c101e60 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.574+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c117a10 con 0x7f1a5c101e60 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.574+0000 7f1a43fff700 1 -- 172.21.15.33:0/4042895309 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c01c3f0 con 0x7f1a5c101e60 2024-02-15T22:46:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.574+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c117f20 con 0x7f1a5c101e60 2024-02-15T22:46:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.575+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c0fb610 con 0x7f1a5c101e60 2024-02-15T22:46:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.575+0000 7f1a43fff700 1 -- 172.21.15.33:0/4042895309 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f1a4c00bd60 con 0x7f1a5c101e60 2024-02-15T22:46:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.576+0000 7f1a43fff700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a4406d900 0x7f1a4406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.576+0000 7f1a43fff700 1 -- 172.21.15.33:0/4042895309 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f1a4c08e3e0 con 0x7f1a5c101e60 2024-02-15T22:46:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.576+0000 7f1a5affd700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a4406d900 0x7f1a4406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.576+0000 7f1a5affd700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a4406d900 0x7f1a4406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007fd0 tx=0x7f1a50009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:18.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.581+0000 7f1a43fff700 1 -- 172.21.15.33:0/4042895309 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1a4c057b30 con 0x7f1a5c101e60 2024-02-15T22:46:18.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.809+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a5c117ba0 con 0x7f1a4406d900 2024-02-15T22:46:18.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.810+0000 7f1a43fff700 1 -- 172.21.15.33:0/4042895309 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1a5c117ba0 con 0x7f1a4406d900 2024-02-15T22:46:18.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a4406d900 msgr2=0x7f1a4406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:18.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a4406d900 0x7f1a4406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007fd0 tx=0x7f1a50009040 comp rx=0 tx=0).stop 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 msgr2=0x7f1a5c10eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c10eb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009fd0 tx=0x7f1a4c009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 shutdown_connections 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a4406d900 0x7f1a4406fdb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a5c101e60 0x7f1a5c10eb00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 --2- 172.21.15.33:0/4042895309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a5c102800 0x7f1a5c10f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 >> 172.21.15.33:0/4042895309 conn(0x7f1a5c0f7a10 msgr2=0x7f1a5c0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 shutdown_connections 2024-02-15T22:46:18.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.812+0000 7f1a61f88700 1 -- 172.21.15.33:0/4042895309 wait complete. 2024-02-15T22:46:18.825 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:46:18.825 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:18 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:18.825 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:18 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:18.825 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:18 smithi033 ceph-mon[113773]: Reconfiguring mds.cephfs.smithi082.rtwnpu (monmap changed)... 2024-02-15T22:46:18.825 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:18 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:18.825 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:18 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:18.826 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:18 smithi033 ceph-mon[113773]: Reconfiguring daemon mds.cephfs.smithi082.rtwnpu on smithi082 2024-02-15T22:46:18.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:18 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:18 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:18 smithi082 ceph-mon[84550]: Reconfiguring mds.cephfs.smithi082.rtwnpu (monmap changed)... 2024-02-15T22:46:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:18 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:46:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:18 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:18 smithi082 ceph-mon[84550]: Reconfiguring daemon mds.cephfs.smithi082.rtwnpu on smithi082 2024-02-15T22:46:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.915+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1033388084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec0102fe0 msgr2=0x7f9ec01033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1033388084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec0102fe0 0x7f9ec01033b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0004940 tx=0x7f9eb0009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1033388084 shutdown_connections 2024-02-15T22:46:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1033388084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec00fb560 0x7f9ec00fb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1033388084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec0102fe0 0x7f9ec01033b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1033388084 >> 172.21.15.33:0/1033388084 conn(0x7f9ec0071500 msgr2=0x7f9ec0071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:18.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1033388084 shutdown_connections 2024-02-15T22:46:18.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1033388084 wait complete. 2024-02-15T22:46:18.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 Processor -- start 2024-02-15T22:46:18.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 -- start start 2024-02-15T22:46:18.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00fb560 0x7f9ec0113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:18.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec0102fe0 0x7f9ec0113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:18.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0114610 con 0x7f9ec00fb560 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.916+0000 7f9ec4ac7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec010d940 con 0x7f9ec0102fe0 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00fb560 0x7f9ec0113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00fb560 0x7f9ec0113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56478/0 (socket says 172.21.15.33:56478) 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebe59c700 1 -- 172.21.15.33:0/1877095725 learned_addr learned my addr 172.21.15.33:0/1877095725 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebdd9b700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec0102fe0 0x7f9ec0113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebe59c700 1 -- 172.21.15.33:0/1877095725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec0102fe0 msgr2=0x7f9ec0113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebe59c700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec0102fe0 0x7f9ec0113fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebe59c700 1 -- 172.21.15.33:0/1877095725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0005040 con 0x7f9ec00fb560 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ebe59c700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00fb560 0x7f9ec0113a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000c00 tx=0x7f9eb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9eaeffd700 1 -- 172.21.15.33:0/1877095725 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb0021070 con 0x7f9ec00fb560 2024-02-15T22:46:18.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9eaeffd700 1 -- 172.21.15.33:0/1877095725 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9eb0013d00 con 0x7f9ec00fb560 2024-02-15T22:46:18.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9eaeffd700 1 -- 172.21.15.33:0/1877095725 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb000e070 con 0x7f9ec00fb560 2024-02-15T22:46:18.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec010dbc0 con 0x7f9ec00fb560 2024-02-15T22:46:18.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.917+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec010e0a0 con 0x7f9ec00fb560 2024-02-15T22:46:18.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.918+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0100290 con 0x7f9ec00fb560 2024-02-15T22:46:18.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.919+0000 7f9eaeffd700 1 -- 172.21.15.33:0/1877095725 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f9eb001caf0 con 0x7f9ec00fb560 2024-02-15T22:46:18.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.919+0000 7f9eaeffd700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ea806d900 0x7f9ea806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:18.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.919+0000 7f9eaeffd700 1 -- 172.21.15.33:0/1877095725 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9eb008e430 con 0x7f9ec00fb560 2024-02-15T22:46:18.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.919+0000 7f9ebdd9b700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ea806d900 0x7f9ea806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:18.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.920+0000 7f9ebdd9b700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ea806d900 0x7f9ea806fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ec010f2b0 tx=0x7f9eb400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:18.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:18.924+0000 7f9eaeffd700 1 -- 172.21.15.33:0/1877095725 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9eb005b750 con 0x7f9ec00fb560 2024-02-15T22:46:19.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.146+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ec004bed0 con 0x7f9ea806d900 2024-02-15T22:46:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.147+0000 7f9eaeffd700 1 -- 172.21.15.33:0/1877095725 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9ec004bed0 con 0x7f9ea806d900 2024-02-15T22:46:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.149+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ea806d900 msgr2=0x7f9ea806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.149+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ea806d900 0x7f9ea806fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ec010f2b0 tx=0x7f9eb400b040 comp rx=0 tx=0).stop 2024-02-15T22:46:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.149+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00fb560 msgr2=0x7f9ec0113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.149+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00fb560 0x7f9ec0113a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000c00 tx=0x7f9eb0009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.150+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 shutdown_connections 2024-02-15T22:46:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.150+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ea806d900 0x7f9ea806fdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.150+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00fb560 0x7f9ec0113a80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.150+0000 7f9ec4ac7700 1 --2- 172.21.15.33:0/1877095725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec0102fe0 0x7f9ec0113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.150+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 >> 172.21.15.33:0/1877095725 conn(0x7f9ec0071500 msgr2=0x7f9ec00fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.150+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 shutdown_connections 2024-02-15T22:46:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.150+0000 7f9ec4ac7700 1 -- 172.21.15.33:0/1877095725 wait complete. 2024-02-15T22:46:19.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 -- 172.21.15.33:0/3791262117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e01038f0 msgr2=0x7fe0e00fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 --2- 172.21.15.33:0/3791262117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e01038f0 0x7fe0e00fcf60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc004940 tx=0x7fe0dc009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 -- 172.21.15.33:0/3791262117 shutdown_connections 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 --2- 172.21.15.33:0/3791262117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e01038f0 0x7fe0e00fcf60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 --2- 172.21.15.33:0/3791262117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e0102f50 0x7fe0e0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 -- 172.21.15.33:0/3791262117 >> 172.21.15.33:0/3791262117 conn(0x7fe0e00f8ae0 msgr2=0x7fe0e00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 -- 172.21.15.33:0/3791262117 shutdown_connections 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.252+0000 7fe0e771d700 1 -- 172.21.15.33:0/3791262117 wait complete. 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e771d700 1 Processor -- start 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e771d700 1 -- start start 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e771d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0102f50 0x7fe0e0070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e771d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e01038f0 0x7fe0e00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e771d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e0070dd0 con 0x7fe0e0102f50 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e771d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e0070f40 con 0x7fe0e01038f0 2024-02-15T22:46:19.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e54b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0102f50 0x7fe0e0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e54b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0102f50 0x7fe0e0070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56494/0 (socket says 172.21.15.33:56494) 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e54b9700 1 -- 172.21.15.33:0/279065973 learned_addr learned my addr 172.21.15.33:0/279065973 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.253+0000 7fe0e4cb8700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e01038f0 0x7fe0e00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0e54b9700 1 -- 172.21.15.33:0/279065973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e01038f0 msgr2=0x7fe0e00707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0e54b9700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e01038f0 0x7fe0e00707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0e54b9700 1 -- 172.21.15.33:0/279065973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc005040 con 0x7fe0e0102f50 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0e54b9700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0102f50 0x7fe0e0070290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000eb40 tx=0x7fe0d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0d5ffb700 1 -- 172.21.15.33:0/279065973 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d0007cc0 con 0x7fe0e0102f50 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0d5ffb700 1 -- 172.21.15.33:0/279065973 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0d000f040 con 0x7fe0e0102f50 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e0119c40 con 0x7fe0e0102f50 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0d5ffb700 1 -- 172.21.15.33:0/279065973 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d000ca10 con 0x7fe0e0102f50 2024-02-15T22:46:19.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.254+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e011a0a0 con 0x7fe0e0102f50 2024-02-15T22:46:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.255+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e0105420 con 0x7fe0e0102f50 2024-02-15T22:46:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.255+0000 7fe0d5ffb700 1 -- 172.21.15.33:0/279065973 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fe0d000cb70 con 0x7fe0e0102f50 2024-02-15T22:46:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.256+0000 7fe0d5ffb700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fe0cc06d900 0x7fe0cc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.256+0000 7fe0d5ffb700 1 -- 172.21.15.33:0/279065973 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fe0d008cba0 con 0x7fe0e0102f50 2024-02-15T22:46:19.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.256+0000 7fe0e4cb8700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fe0cc06d900 0x7fe0cc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.256+0000 7fe0e4cb8700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fe0cc06d900 0x7fe0cc06fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009b30 tx=0x7fe0dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.261+0000 7fe0d5ffb700 1 -- 172.21.15.33:0/279065973 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe0d00563a0 con 0x7fe0e0102f50 2024-02-15T22:46:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.483+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0e00719d0 con 0x7fe0cc06d900 2024-02-15T22:46:19.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.494+0000 7fe0d5ffb700 1 -- 172.21.15.33:0/279065973 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe0e00719d0 con 0x7fe0cc06d900 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (2m) 45s ago 13m 17.2M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (13m) 45s ago 13m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 539d6e44b633 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (12m) 31s ago 12m 6656k - 17.2.7-509-g9aa52330 61c0ec9cd187 dbabfa813d56 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (2m) 45s ago 13m 78.5M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (7m) 45s ago 7m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (7m) 45s ago 7m 75.0M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (7m) 31s ago 7m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (7m) 31s ago 7m 68.0M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (4m) 45s ago 14m 471M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:46:19.497 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (3m) 31s ago 12m 447M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (60s) 45s ago 15m 29.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (35s) 31s ago 12m 26.4M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (3m) 45s ago 13m 16.6M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (3m) 31s ago 12m 16.6M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (11m) 45s ago 11m 213M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 cdc9e04bf169 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (11m) 45s ago 11m 232M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (10m) 45s ago 10m 198M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (10m) 31s ago 10m 264M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (9m) 31s ago 9m 231M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (9m) 31s ago 9m 225M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:46:19.498 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (2m) 45s ago 12m 55.8M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fe0cc06d900 msgr2=0x7fe0cc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fe0cc06d900 0x7fe0cc06fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009b30 tx=0x7fe0dc009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0102f50 msgr2=0x7fe0e0070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0102f50 0x7fe0e0070290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000eb40 tx=0x7fe0d000b040 comp rx=0 tx=0).stop 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 shutdown_connections 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fe0cc06d900 0x7fe0cc06fdb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0102f50 0x7fe0e0070290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 --2- 172.21.15.33:0/279065973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e01038f0 0x7fe0e00707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 >> 172.21.15.33:0/279065973 conn(0x7fe0e00f8ae0 msgr2=0x7fe0e00fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:19.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 shutdown_connections 2024-02-15T22:46:19.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.496+0000 7fe0e771d700 1 -- 172.21.15.33:0/279065973 wait complete. 2024-02-15T22:46:19.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 -- 172.21.15.33:0/2171598267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd58102f50 msgr2=0x7efd58103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 --2- 172.21.15.33:0/2171598267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd58102f50 0x7efd58103320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd54004940 tx=0x7efd54009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:19.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 -- 172.21.15.33:0/2171598267 shutdown_connections 2024-02-15T22:46:19.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 --2- 172.21.15.33:0/2171598267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd581038f0 0x7efd580fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 --2- 172.21.15.33:0/2171598267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd58102f50 0x7efd58103320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 -- 172.21.15.33:0/2171598267 >> 172.21.15.33:0/2171598267 conn(0x7efd580f8ae0 msgr2=0x7efd580faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 -- 172.21.15.33:0/2171598267 shutdown_connections 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.600+0000 7efd601f5700 1 -- 172.21.15.33:0/2171598267 wait complete. 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd601f5700 1 Processor -- start 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd601f5700 1 -- start start 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd601f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58102f50 0x7efd58070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd601f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd581038f0 0x7efd580707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd601f5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58070dd0 con 0x7efd581038f0 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd601f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58070f40 con 0x7efd58102f50 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5d790700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd581038f0 0x7efd580707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5d790700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd581038f0 0x7efd580707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56516/0 (socket says 172.21.15.33:56516) 2024-02-15T22:46:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5d790700 1 -- 172.21.15.33:0/2035588652 learned_addr learned my addr 172.21.15.33:0/2035588652 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5df91700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58102f50 0x7efd58070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5d790700 1 -- 172.21.15.33:0/2035588652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58102f50 msgr2=0x7efd58070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5d790700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58102f50 0x7efd58070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5d790700 1 -- 172.21.15.33:0/2035588652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54005040 con 0x7efd581038f0 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.601+0000 7efd5d790700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd581038f0 0x7efd580707d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c890 tx=0x7efd480044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.602+0000 7efd4e7fc700 1 -- 172.21.15.33:0/2035588652 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4800a700 con 0x7efd581038f0 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.602+0000 7efd4e7fc700 1 -- 172.21.15.33:0/2035588652 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd4800ad30 con 0x7efd581038f0 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.602+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd58119c90 con 0x7efd581038f0 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.602+0000 7efd4e7fc700 1 -- 172.21.15.33:0/2035588652 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd480113a0 con 0x7efd581038f0 2024-02-15T22:46:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.602+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5811a170 con 0x7efd581038f0 2024-02-15T22:46:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.603+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd580fc6e0 con 0x7efd581038f0 2024-02-15T22:46:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.603+0000 7efd4e7fc700 1 -- 172.21.15.33:0/2035588652 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7efd48012400 con 0x7efd581038f0 2024-02-15T22:46:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.604+0000 7efd4e7fc700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7efd4406d900 0x7efd4406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.604+0000 7efd4e7fc700 1 -- 172.21.15.33:0/2035588652 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7efd4808d010 con 0x7efd581038f0 2024-02-15T22:46:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.604+0000 7efd5df91700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7efd4406d900 0x7efd4406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.604+0000 7efd5df91700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7efd4406d900 0x7efd4406fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd54004f90 tx=0x7efd54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.609+0000 7efd4e7fc700 1 -- 172.21.15.33:0/2035588652 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efd48056870 con 0x7efd581038f0 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: pgmap v28: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]: dispatch 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]': finished 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]: dispatch 2024-02-15T22:46:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]': finished 2024-02-15T22:46:19.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.904+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd5810a050 con 0x7efd581038f0 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.904+0000 7efd4e7fc700 1 -- 172.21.15.33:0/2035588652 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7efd48059f30 con 0x7efd581038f0 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:46:19.907 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 10, 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:46:19.908 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:46:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7efd4406d900 msgr2=0x7efd4406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7efd4406d900 0x7efd4406fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd54004f90 tx=0x7efd54009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd581038f0 msgr2=0x7efd580707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd581038f0 0x7efd580707d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c890 tx=0x7efd480044c0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 shutdown_connections 2024-02-15T22:46:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7efd4406d900 0x7efd4406fdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58102f50 0x7efd58070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 --2- 172.21.15.33:0/2035588652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd581038f0 0x7efd580707d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 >> 172.21.15.33:0/2035588652 conn(0x7efd580f8ae0 msgr2=0x7efd580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 shutdown_connections 2024-02-15T22:46:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:19.906+0000 7efd601f5700 1 -- 172.21.15.33:0/2035588652 wait complete. 2024-02-15T22:46:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 -- 172.21.15.33:0/638580947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fe8f0 msgr2=0x7f9bb8106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 --2- 172.21.15.33:0/638580947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fe8f0 0x7f9bb8106fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0004970 tx=0x7f9ba0009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 -- 172.21.15.33:0/638580947 shutdown_connections 2024-02-15T22:46:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 --2- 172.21.15.33:0/638580947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fe8f0 0x7f9bb8106fc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 --2- 172.21.15.33:0/638580947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb80fdf50 0x7f9bb80fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 -- 172.21.15.33:0/638580947 >> 172.21.15.33:0/638580947 conn(0x7f9bb80f79d0 msgr2=0x7f9bb80f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 -- 172.21.15.33:0/638580947 shutdown_connections 2024-02-15T22:46:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 -- 172.21.15.33:0/638580947 wait complete. 2024-02-15T22:46:20.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 Processor -- start 2024-02-15T22:46:20.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.011+0000 7f9bbd516700 1 -- start start 2024-02-15T22:46:20.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bbd516700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fdf50 0x7f9bb8113a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bbd516700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb80fe8f0 0x7f9bb8113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bbd516700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81145a0 con 0x7f9bb80fdf50 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bbd516700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb810d8d0 con 0x7f9bb80fe8f0 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fdf50 0x7f9bb8113a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fdf50 0x7f9bb8113a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56532/0 (socket says 172.21.15.33:56532) 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb6ffd700 1 -- 172.21.15.33:0/4163387690 learned_addr learned my addr 172.21.15.33:0/4163387690 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb67fc700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb80fe8f0 0x7f9bb8113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb6ffd700 1 -- 172.21.15.33:0/4163387690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb80fe8f0 msgr2=0x7f9bb8113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb6ffd700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb80fe8f0 0x7f9bb8113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb6ffd700 1 -- 172.21.15.33:0/4163387690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0005040 con 0x7f9bb80fdf50 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb67fc700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb80fe8f0 0x7f9bb8113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:46:20.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bb6ffd700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fdf50 0x7f9bb8113a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800ec30 tx=0x7f9ba800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9baf7fe700 1 -- 172.21.15.33:0/4163387690 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ba8007b30 con 0x7f9bb80fdf50 2024-02-15T22:46:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb810dbb0 con 0x7f9bb80fdf50 2024-02-15T22:46:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9baf7fe700 1 -- 172.21.15.33:0/4163387690 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ba800f040 con 0x7f9bb80fdf50 2024-02-15T22:46:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9baf7fe700 1 -- 172.21.15.33:0/4163387690 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ba800cd40 con 0x7f9bb80fdf50 2024-02-15T22:46:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.012+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb810e0c0 con 0x7f9bb80fdf50 2024-02-15T22:46:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.014+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb8104660 con 0x7f9bb80fdf50 2024-02-15T22:46:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.014+0000 7f9baf7fe700 1 -- 172.21.15.33:0/4163387690 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f9ba8007c90 con 0x7f9bb80fdf50 2024-02-15T22:46:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.014+0000 7f9baf7fe700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ba406d900 0x7f9ba406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.015+0000 7f9baf7fe700 1 -- 172.21.15.33:0/4163387690 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9ba808d610 con 0x7f9bb80fdf50 2024-02-15T22:46:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.015+0000 7f9bb67fc700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ba406d900 0x7f9ba406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.015+0000 7f9bb67fc700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ba406d900 0x7f9ba406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0000c00 tx=0x7f9ba0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:20.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.019+0000 7f9baf7fe700 1 -- 172.21.15.33:0/4163387690 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ba805a810 con 0x7f9bb80fdf50 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: pgmap v28: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]: dispatch 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]': finished 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]: dispatch 2024-02-15T22:46:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]': finished 2024-02-15T22:46:20.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.278+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9bb80fb5d0 con 0x7f9bb80fdf50 2024-02-15T22:46:20.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.278+0000 7f9baf7fe700 1 -- 172.21.15.33:0/4163387690 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f9ba805a3a0 con 0x7f9bb80fdf50 2024-02-15T22:46:20.281 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:46:20.282 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:46:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:46:20.284 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:46:20.284 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:20.284 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:20.284 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:20.284 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:20.284 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:46:20.284 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ba406d900 msgr2=0x7f9ba406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ba406d900 0x7f9ba406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0000c00 tx=0x7f9ba0009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fdf50 msgr2=0x7f9bb8113a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fdf50 0x7f9bb8113a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800ec30 tx=0x7f9ba800b040 comp rx=0 tx=0).stop 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 shutdown_connections 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ba406d900 0x7f9ba406fdb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bb80fdf50 0x7f9bb8113a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 --2- 172.21.15.33:0/4163387690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb80fe8f0 0x7f9bb8113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 >> 172.21.15.33:0/4163387690 conn(0x7f9bb80f79d0 msgr2=0x7f9bb81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 shutdown_connections 2024-02-15T22:46:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.281+0000 7f9bbd516700 1 -- 172.21.15.33:0/4163387690 wait complete. 2024-02-15T22:46:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:46:20.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.389+0000 7fc410ba7700 1 -- 172.21.15.33:0/1407979616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c101e60 msgr2=0x7fc40c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.389+0000 7fc410ba7700 1 --2- 172.21.15.33:0/1407979616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c101e60 0x7fc40c102230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc004940 tx=0x7fc3fc009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 -- 172.21.15.33:0/1407979616 shutdown_connections 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 --2- 172.21.15.33:0/1407979616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c102800 0x7fc40c0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 --2- 172.21.15.33:0/1407979616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c101e60 0x7fc40c102230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 -- 172.21.15.33:0/1407979616 >> 172.21.15.33:0/1407979616 conn(0x7fc40c0f7a10 msgr2=0x7fc40c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 -- 172.21.15.33:0/1407979616 shutdown_connections 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 -- 172.21.15.33:0/1407979616 wait complete. 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 Processor -- start 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 -- start start 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c101e60 0x7fc40c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c102800 0x7fc40c114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c114680 con 0x7fc40c102800 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.390+0000 7fc410ba7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c10d9b0 con 0x7fc40c101e60 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc409d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c102800 0x7fc40c114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc409d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c102800 0x7fc40c114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56550/0 (socket says 172.21.15.33:56550) 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc409d9b700 1 -- 172.21.15.33:0/3990211950 learned_addr learned my addr 172.21.15.33:0/3990211950 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc40a59c700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c101e60 0x7fc40c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc409d9b700 1 -- 172.21.15.33:0/3990211950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c101e60 msgr2=0x7fc40c113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc409d9b700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c101e60 0x7fc40c113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc409d9b700 1 -- 172.21.15.33:0/3990211950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc005040 con 0x7fc40c102800 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc409d9b700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c102800 0x7fc40c114030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc400002a50 tx=0x7fc400004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc3faffd700 1 -- 172.21.15.33:0/3990211950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc400007cc0 con 0x7fc40c102800 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc3faffd700 1 -- 172.21.15.33:0/3990211950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc40000f040 con 0x7fc40c102800 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c10dc90 con 0x7fc40c102800 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc3faffd700 1 -- 172.21.15.33:0/3990211950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc40000da40 con 0x7fc40c102800 2024-02-15T22:46:20.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.391+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c10e1d0 con 0x7fc40c102800 2024-02-15T22:46:20.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.392+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c0fb610 con 0x7fc40c102800 2024-02-15T22:46:20.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.393+0000 7fc3faffd700 1 -- 172.21.15.33:0/3990211950 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fc4000097c0 con 0x7fc40c102800 2024-02-15T22:46:20.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.393+0000 7fc3faffd700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc3f406d900 0x7fc3f406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.393+0000 7fc3faffd700 1 -- 172.21.15.33:0/3990211950 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fc40008cdf0 con 0x7fc40c102800 2024-02-15T22:46:20.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.393+0000 7fc40a59c700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc3f406d900 0x7fc3f406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.394+0000 7fc40a59c700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc3f406d900 0x7fc3f406fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00b3b0 tx=0x7fc3fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:20.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.398+0000 7fc3faffd700 1 -- 172.21.15.33:0/3990211950 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc400059de0 con 0x7fc40c102800 2024-02-15T22:46:20.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.620+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc40c04bed0 con 0x7fc3f406d900 2024-02-15T22:46:20.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.621+0000 7fc3faffd700 1 -- 172.21.15.33:0/3990211950 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc40c04bed0 con 0x7fc3f406d900 2024-02-15T22:46:20.624 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:46:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:46:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:46:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:46:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:46:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:46:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T22:46:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:46:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "4/21 daemons upgraded", 2024-02-15T22:46:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading crash daemons", 2024-02-15T22:46:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:46:20.625 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:46:20.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc3f406d900 msgr2=0x7fc3f406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc3f406d900 0x7fc3f406fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00b3b0 tx=0x7fc3fc009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c102800 msgr2=0x7fc40c114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c102800 0x7fc40c114030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc400002a50 tx=0x7fc400004600 comp rx=0 tx=0).stop 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 shutdown_connections 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc3f406d900 0x7fc3f406fdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c101e60 0x7fc40c113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 --2- 172.21.15.33:0/3990211950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc40c102800 0x7fc40c114030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 >> 172.21.15.33:0/3990211950 conn(0x7fc40c0f7a10 msgr2=0x7fc40c105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 shutdown_connections 2024-02-15T22:46:20.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.624+0000 7fc410ba7700 1 -- 172.21.15.33:0/3990211950 wait complete. 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.729+0000 7fccc38bb700 1 -- 172.21.15.33:0/668155010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fdf50 msgr2=0x7fccbc0fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.729+0000 7fccc38bb700 1 --2- 172.21.15.33:0/668155010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fdf50 0x7fccbc0fe320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fccb8004940 tx=0x7fccb8009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 -- 172.21.15.33:0/668155010 shutdown_connections 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 --2- 172.21.15.33:0/668155010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccbc0fe8f0 0x7fccbc106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 --2- 172.21.15.33:0/668155010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fdf50 0x7fccbc0fe320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 -- 172.21.15.33:0/668155010 >> 172.21.15.33:0/668155010 conn(0x7fccbc0f7a10 msgr2=0x7fccbc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 -- 172.21.15.33:0/668155010 shutdown_connections 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 -- 172.21.15.33:0/668155010 wait complete. 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 Processor -- start 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 -- start start 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccbc0fdf50 0x7fccbc113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fe8f0 0x7fccbc113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc114620 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc38bb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc10d950 con 0x7fccbc0fdf50 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc0e56700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fe8f0 0x7fccbc113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.730+0000 7fccc0e56700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fe8f0 0x7fccbc113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56562/0 (socket says 172.21.15.33:56562) 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc0e56700 1 -- 172.21.15.33:0/2257482976 learned_addr learned my addr 172.21.15.33:0/2257482976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc0e56700 1 -- 172.21.15.33:0/2257482976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccbc0fdf50 msgr2=0x7fccbc113a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc1657700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccbc0fdf50 0x7fccbc113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc0e56700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccbc0fdf50 0x7fccbc113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc0e56700 1 -- 172.21.15.33:0/2257482976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8005040 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc0e56700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fe8f0 0x7fccbc113fd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fccac002a50 tx=0x7fccac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccb1ffb700 1 -- 172.21.15.33:0/2257482976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccac007cc0 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccb1ffb700 1 -- 172.21.15.33:0/2257482976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccac00f040 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccb1ffb700 1 -- 172.21.15.33:0/2257482976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccac009640 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc10dc30 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.731+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc10e170 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.732+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc104620 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.733+0000 7fccb1ffb700 1 -- 172.21.15.33:0/2257482976 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fccac0097a0 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.733+0000 7fccb1ffb700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcca806d900 0x7fcca806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:20.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.733+0000 7fccb1ffb700 1 -- 172.21.15.33:0/2257482976 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fccac08ce70 con 0x7fccbc0fe8f0 2024-02-15T22:46:20.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.733+0000 7fccc1657700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcca806d900 0x7fcca806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:20.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.734+0000 7fccc1657700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcca806d900 0x7fcca806fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccb8004f90 tx=0x7fccb8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:20.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:20.738+0000 7fccb1ffb700 1 -- 172.21.15.33:0/2257482976 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fccac05a070 con 0x7fccbc0fe8f0 2024-02-15T22:46:21.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:20 smithi033 ceph-mon[113773]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:21.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:20 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all mon 2024-02-15T22:46:21.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:20 smithi033 ceph-mon[113773]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:21.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:20 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2035588652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:21.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:20 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/4163387690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:46:21.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.026+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fccbc109fe0 con 0x7fccbc0fe8f0 2024-02-15T22:46:21.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.026+0000 7fccb1ffb700 1 -- 172.21.15.33:0/2257482976 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fccac059c00 con 0x7fccbc0fe8f0 2024-02-15T22:46:21.029 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcca806d900 msgr2=0x7fcca806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcca806d900 0x7fcca806fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccb8004f90 tx=0x7fccb8009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fe8f0 msgr2=0x7fccbc113fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fe8f0 0x7fccbc113fd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fccac002a50 tx=0x7fccac0046b0 comp rx=0 tx=0).stop 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 shutdown_connections 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcca806d900 0x7fcca806fdb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccbc0fdf50 0x7fccbc113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 --2- 172.21.15.33:0/2257482976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0fe8f0 0x7fccbc113fd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 >> 172.21.15.33:0/2257482976 conn(0x7fccbc0f7a10 msgr2=0x7fccbc1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 shutdown_connections 2024-02-15T22:46:21.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:21.029+0000 7fccc38bb700 1 -- 172.21.15.33:0/2257482976 wait complete. 2024-02-15T22:46:21.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:20 smithi082 ceph-mon[84550]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:21.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:20 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all mon 2024-02-15T22:46:21.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:20 smithi082 ceph-mon[84550]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:21.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:20 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2035588652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:21.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:20 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/4163387690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:46:21.975 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:21 smithi033 ceph-mon[113773]: pgmap v29: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:21.976 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:21 smithi033 ceph-mon[113773]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:21.976 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:21 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2257482976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:46:21.976 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:21.976 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:46:21.976 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:22.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:21 smithi082 ceph-mon[84550]: pgmap v29: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:22.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:21 smithi082 ceph-mon[84550]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:22.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:21 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2257482976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:46:22.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:22.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:46:22.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:22.909 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:22 smithi033 ceph-mon[113773]: Upgrade: Updating crash.smithi033 (1/2) 2024-02-15T22:46:22.910 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:22 smithi033 ceph-mon[113773]: Deploying daemon crash.smithi033 on smithi033 2024-02-15T22:46:23.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:22 smithi082 ceph-mon[84550]: Upgrade: Updating crash.smithi033 (1/2) 2024-02-15T22:46:23.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:22 smithi082 ceph-mon[84550]: Deploying daemon crash.smithi033 on smithi033 2024-02-15T22:46:24.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:23 smithi033 ceph-mon[113773]: pgmap v30: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:24.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:23 smithi082 ceph-mon[84550]: pgmap v30: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:26.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:25 smithi033 ceph-mon[113773]: pgmap v31: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:26.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:25 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:26.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:25 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:26.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:25 smithi082 ceph-mon[84550]: pgmap v31: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:26.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:25 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:26.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:25 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:27.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:27 smithi082 ceph-mon[84550]: pgmap v32: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:27.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:27 smithi082 ceph-mon[84550]: Upgrade: Updating crash.smithi082 (2/2) 2024-02-15T22:46:27.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:27 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:27.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:27 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:46:27.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:27 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:27.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:27 smithi082 ceph-mon[84550]: Deploying daemon crash.smithi082 on smithi082 2024-02-15T22:46:28.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:27 smithi033 ceph-mon[113773]: pgmap v32: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:27 smithi033 ceph-mon[113773]: Upgrade: Updating crash.smithi082 (2/2) 2024-02-15T22:46:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:27 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:27 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:46:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:27 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:27 smithi033 ceph-mon[113773]: Deploying daemon crash.smithi082 on smithi082 2024-02-15T22:46:28.629 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:29.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:29.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:29 smithi082 ceph-mon[84550]: pgmap v33: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:30.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:29 smithi033 ceph-mon[113773]: pgmap v33: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:31.268 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:31 smithi033 ceph-mon[113773]: pgmap v34: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:31.268 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:31.268 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:31.268 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:31.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:31 smithi082 ceph-mon[84550]: pgmap v34: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:31.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:31.284 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:31.284 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:33.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:33 smithi033 ceph-mon[113773]: pgmap v35: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:33.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:33 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:33.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:33 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:33.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:33 smithi082 ceph-mon[84550]: pgmap v35: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:33.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:33 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:33.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:33 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:35.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:35 smithi082 ceph-mon[84550]: pgmap v36: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:35.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:35.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:35.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:35 smithi033 ceph-mon[113773]: pgmap v36: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:35.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:36.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:36 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:36.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:36 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:36.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:36 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:36.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:36 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:37.680 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:37 smithi033 ceph-mon[113773]: pgmap v37: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:37.680 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:37.681 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:37 smithi082 ceph-mon[84550]: pgmap v37: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:38.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:38 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:38.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:38 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:38.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:38 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:38.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:38 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:39.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:39 smithi033 ceph-mon[113773]: pgmap v38: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:39 smithi082 ceph-mon[84550]: pgmap v38: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: pgmap v39: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:41.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all crash 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]: dispatch 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]': finished 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]: dispatch 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]': finished 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:46:41.223 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:41 smithi033 ceph-mon[113773]: Upgrade: osd.0 is safe to restart 2024-02-15T22:46:41.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: pgmap v39: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all crash 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]: dispatch 2024-02-15T22:46:41.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]': finished 2024-02-15T22:46:41.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]: dispatch 2024-02-15T22:46:41.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]': finished 2024-02-15T22:46:41.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:46:41.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:46:41.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:41 smithi082 ceph-mon[84550]: Upgrade: osd.0 is safe to restart 2024-02-15T22:46:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:42 smithi033 ceph-mon[113773]: Upgrade: Updating osd.0 2024-02-15T22:46:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:42 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:42 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:46:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:42 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:42 smithi033 ceph-mon[113773]: Deploying daemon osd.0 on smithi033 2024-02-15T22:46:43.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:42 smithi082 ceph-mon[84550]: Upgrade: Updating osd.0 2024-02-15T22:46:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:42 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:42 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:46:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:42 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:42 smithi082 ceph-mon[84550]: Deploying daemon osd.0 on smithi033 2024-02-15T22:46:44.177 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:43 smithi033 ceph-mon[113773]: pgmap v40: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:44.177 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:44.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:43 smithi082 ceph-mon[84550]: pgmap v40: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:46:44.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:45.417 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:45 smithi033 systemd[1]: Stopping Ceph osd.0 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:46:45.770 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:45 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[47705]: 2024-02-15T22:46:45.415+0000 7fa305679700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:46:45.771 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:45 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[47705]: 2024-02-15T22:46:45.415+0000 7fa305679700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-15T22:46:45.771 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:45 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[47705]: 2024-02-15T22:46:45.415+0000 7fa305679700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:46:46.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:45 smithi033 ceph-mon[113773]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:46.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:45 smithi033 ceph-mon[113773]: osd.0 marked itself down and dead 2024-02-15T22:46:46.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:45 smithi082 ceph-mon[84550]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:46:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:45 smithi082 ceph-mon[84550]: osd.0 marked itself down and dead 2024-02-15T22:46:46.552 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:46 smithi033 podman[124368]: 2024-02-15 22:46:46.27282517 +0000 UTC m=+0.966492007 container died cdc9e04bf169fc6204a0f3562a9feda8ea6ae522eaf4ad8875ff9c064a279c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9aa5233, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2) 2024-02-15T22:46:46.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:46 smithi033 podman[124368]: 2024-02-15 22:46:46.665614899 +0000 UTC m=+1.359281736 container cleanup cdc9e04bf169fc6204a0f3562a9feda8ea6ae522eaf4ad8875ff9c064a279c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9aa5233, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-15T22:46:46.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:46 smithi033 bash[124368]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0 2024-02-15T22:46:47.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:46 smithi033 ceph-mon[113773]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:46:47.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:46 smithi033 ceph-mon[113773]: failed to encode map e50 with expected crc 2024-02-15T22:46:47.222 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:46 smithi033 ceph-mon[113773]: osdmap e50: 6 total, 5 up, 6 in 2024-02-15T22:46:47.222 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:46 smithi033 podman[124386]: 2024-02-15 22:46:46.924944396 +0000 UTC m=+0.652141740 container remove cdc9e04bf169fc6204a0f3562a9feda8ea6ae522eaf4ad8875ff9c064a279c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, org.label-schema.vendor=CentOS, RELEASE=quincy-9aa5233, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2) 2024-02-15T22:46:47.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:46 smithi082 ceph-mon[84550]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:46:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:46 smithi082 ceph-mon[84550]: failed to encode map e50 with expected crc 2024-02-15T22:46:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:46 smithi082 ceph-mon[84550]: osdmap e50: 6 total, 5 up, 6 in 2024-02-15T22:46:47.474 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:47 smithi033 podman[124479]: 2024-02-15 22:46:47.123913088 +0000 UTC m=+0.018651964 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:46:47.475 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:47 smithi033 podman[124479]: 2024-02-15 22:46:47.242831435 +0000 UTC m=+0.137570293 container create f981ace14bb0b79a210419070e3734dcc5cb7afce76bffa432aabc10a7ff0cfb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-02-15T22:46:47.475 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:47 smithi033 podman[124479]: 2024-02-15 22:46:47.470608957 +0000 UTC m=+0.365347816 container init f981ace14bb0b79a210419070e3734dcc5cb7afce76bffa432aabc10a7ff0cfb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2) 2024-02-15T22:46:47.475 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:47 smithi033 podman[124479]: 2024-02-15 22:46:47.473819961 +0000 UTC m=+0.368558829 container start f981ace14bb0b79a210419070e3734dcc5cb7afce76bffa432aabc10a7ff0cfb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-02-15T22:46:47.767 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:47 smithi033 podman[124479]: 2024-02-15 22:46:47.579010831 +0000 UTC m=+0.473749699 container attach f981ace14bb0b79a210419070e3734dcc5cb7afce76bffa432aabc10a7ff0cfb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0) 2024-02-15T22:46:48.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:47 smithi033 podman[124479]: 2024-02-15 22:46:47.766608416 +0000 UTC m=+0.661347286 container died f981ace14bb0b79a210419070e3734dcc5cb7afce76bffa432aabc10a7ff0cfb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:46:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:46:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: osdmap e51: 6 total, 5 up, 6 in 2024-02-15T22:46:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:47 smithi033 ceph-mon[113773]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: osdmap e51: 6 total, 5 up, 6 in 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:47 smithi082 ceph-mon[84550]: failed to encode map e51 with expected crc 2024-02-15T22:46:48.771 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:48 smithi033 podman[124505]: 2024-02-15 22:46:48.42458574 +0000 UTC m=+0.652372271 container remove f981ace14bb0b79a210419070e3734dcc5cb7afce76bffa432aabc10a7ff0cfb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-15T22:46:48.771 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:48 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-15T22:46:48.771 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:48 smithi033 systemd[1]: Stopped Ceph osd.0 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:46:48.771 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:48 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.0.service: Consumed 56.043s CPU time. 2024-02-15T22:46:48.771 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:48 smithi033 systemd[1]: Starting Ceph osd.0 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:46:49.179 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:48 smithi033 podman[124610]: 2024-02-15 22:46:48.790450555 +0000 UTC m=+0.018141236 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:46:49.180 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:48 smithi033 podman[124610]: 2024-02-15 22:46:48.892239438 +0000 UTC m=+0.119930170 container create 358c0d356cbcb4698d00185a335a341e82b0b966f6dc8f811a7f356483ae7f75 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214) 2024-02-15T22:46:49.180 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 podman[124610]: 2024-02-15 22:46:49.078463967 +0000 UTC m=+0.306154641 container init 358c0d356cbcb4698d00185a335a341e82b0b966f6dc8f811a7f356483ae7f75 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-15T22:46:49.180 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 podman[124610]: 2024-02-15 22:46:49.081641293 +0000 UTC m=+0.309331966 container start 358c0d356cbcb4698d00185a335a341e82b0b966f6dc8f811a7f356483ae7f75 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-02-15T22:46:49.180 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 podman[124610]: 2024-02-15 22:46:49.17836359 +0000 UTC m=+0.406054296 container attach 358c0d356cbcb4698d00185a335a341e82b0b966f6dc8f811a7f356483ae7f75 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-15T22:46:49.896 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate[124624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:46:49.896 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate[124624]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:46:49.896 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 bash[124610]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:46:49.896 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 bash[124610]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:46:49.896 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 bash[124610]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 bash[124610]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 bash[124610]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 bash[124610]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 bash[124610]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate[124624]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate[124624]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate[124624]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate[124624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate[124624]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-15T22:46:49.897 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:49 smithi033 podman[124610]: 2024-02-15 22:46:49.552740337 +0000 UTC m=+0.780431020 container died 358c0d356cbcb4698d00185a335a341e82b0b966f6dc8f811a7f356483ae7f75 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-15T22:46:50.183 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:49 smithi033 ceph-mon[113773]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:46:50.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:49 smithi082 ceph-mon[84550]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:46:50.521 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 podman[124758]: 2024-02-15 22:46:50.182048332 +0000 UTC m=+0.624469957 container remove 358c0d356cbcb4698d00185a335a341e82b0b966f6dc8f811a7f356483ae7f75 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-15T22:46:50.521 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 podman[124817]: 2024-02-15 22:46:50.30452944 +0000 UTC m=+0.018461313 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:46:50.521 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 podman[124817]: 2024-02-15 22:46:50.416385181 +0000 UTC m=+0.130317053 container create d58846c70ee17180534cb82e58643961f3a20bb30c83c59a8752f26f4a9a677d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0) 2024-02-15T22:46:51.020 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 podman[124817]: 2024-02-15 22:46:50.652487796 +0000 UTC m=+0.366419668 container init d58846c70ee17180534cb82e58643961f3a20bb30c83c59a8752f26f4a9a677d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-15T22:46:51.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 podman[124817]: 2024-02-15 22:46:50.655361325 +0000 UTC m=+0.369293206 container start d58846c70ee17180534cb82e58643961f3a20bb30c83c59a8752f26f4a9a677d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-02-15T22:46:51.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 ceph-osd[124835]: -- 172.21.15.33:0/1836366455 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5556fd54d1e0 con 0x5556fd51ec00 2024-02-15T22:46:51.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 bash[124817]: d58846c70ee17180534cb82e58643961f3a20bb30c83c59a8752f26f4a9a677d 2024-02-15T22:46:51.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:50 smithi033 systemd[1]: Started Ceph osd.0 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:46:51.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 -- 172.21.15.33:0/252809072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 msgr2=0x7f8c44106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/252809072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44106f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c40004940 tx=0x7f8c40009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:51.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 -- 172.21.15.33:0/252809072 shutdown_connections 2024-02-15T22:46:51.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/252809072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44106f90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/252809072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c440fdfb0 0x7f8c440fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 -- 172.21.15.33:0/252809072 >> 172.21.15.33:0/252809072 conn(0x7f8c440f79e0 msgr2=0x7f8c440f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 -- 172.21.15.33:0/252809072 shutdown_connections 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.140+0000 7f8c4bb52700 1 -- 172.21.15.33:0/252809072 wait complete. 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c4bb52700 1 Processor -- start 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c4bb52700 1 -- start start 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c4bb52700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c440fdfb0 0x7f8c44113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c4bb52700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c4bb52700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c441145d0 con 0x7f8c440fe950 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c4bb52700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4410d970 con 0x7f8c440fdfb0 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c490ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c490ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44113f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37992/0 (socket says 172.21.15.33:37992) 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c490ed700 1 -- 172.21.15.33:0/1174205481 learned_addr learned my addr 172.21.15.33:0/1174205481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.141+0000 7f8c498ee700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c440fdfb0 0x7f8c44113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c490ed700 1 -- 172.21.15.33:0/1174205481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c440fdfb0 msgr2=0x7f8c44113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c490ed700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c440fdfb0 0x7f8c44113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c490ed700 1 -- 172.21.15.33:0/1174205481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40005040 con 0x7f8c440fe950 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c498ee700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c440fdfb0 0x7f8c44113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c490ed700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44113f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c40004890 tx=0x7f8c40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c3a7fc700 1 -- 172.21.15.33:0/1174205481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c4000e040 con 0x7f8c440fe950 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c3a7fc700 1 -- 172.21.15.33:0/1174205481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c40004290 con 0x7f8c440fe950 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4410dc50 con 0x7f8c440fe950 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c3a7fc700 1 -- 172.21.15.33:0/1174205481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c4001c630 con 0x7f8c440fe950 2024-02-15T22:46:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.142+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4410e190 con 0x7f8c440fe950 2024-02-15T22:46:51.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.143+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c441045a0 con 0x7f8c440fe950 2024-02-15T22:46:51.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.144+0000 7f8c3a7fc700 1 -- 172.21.15.33:0/1174205481 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f8c4000bbf0 con 0x7f8c440fe950 2024-02-15T22:46:51.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.144+0000 7f8c3a7fc700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d900 0x7f8c3006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.145+0000 7f8c3a7fc700 1 -- 172.21.15.33:0/1174205481 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f8c4008efa0 con 0x7f8c440fe950 2024-02-15T22:46:51.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.145+0000 7f8c498ee700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d900 0x7f8c3006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.145+0000 7f8c498ee700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d900 0x7f8c3006fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009fd0 tx=0x7f8c34009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:51.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.148+0000 7f8c3a7fc700 1 -- 172.21.15.33:0/1174205481 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8c4005c2c0 con 0x7f8c440fe950 2024-02-15T22:46:51.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.394+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c44109f70 con 0x7f8c3006d900 2024-02-15T22:46:51.397 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:51 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[124831]: 2024-02-15T22:46:51.201+0000 7fb0227b77c0 -1 Falling back to public interface 2024-02-15T22:46:51.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.396+0000 7f8c3a7fc700 1 -- 172.21.15.33:0/1174205481 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8c44109f70 con 0x7f8c3006d900 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d900 msgr2=0x7f8c3006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d900 0x7f8c3006fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009fd0 tx=0x7f8c34009ee0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 msgr2=0x7f8c44113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44113f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c40004890 tx=0x7f8c40009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 shutdown_connections 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d900 0x7f8c3006fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c440fdfb0 0x7f8c44113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 --2- 172.21.15.33:0/1174205481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c440fe950 0x7f8c44113f80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 >> 172.21.15.33:0/1174205481 conn(0x7f8c440f79e0 msgr2=0x7f8c44101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 shutdown_connections 2024-02-15T22:46:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.399+0000 7f8c4bb52700 1 -- 172.21.15.33:0/1174205481 wait complete. 2024-02-15T22:46:51.413 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 -- 172.21.15.33:0/1434939860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 msgr2=0x7f9eb0102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1434939860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0102230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4004940 tx=0x7f9ea4009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 -- 172.21.15.33:0/1434939860 shutdown_connections 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1434939860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb0102800 0x7f9eb00fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1434939860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0102230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 -- 172.21.15.33:0/1434939860 >> 172.21.15.33:0/1434939860 conn(0x7f9eb00f7a10 msgr2=0x7f9eb00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 -- 172.21.15.33:0/1434939860 shutdown_connections 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 -- 172.21.15.33:0/1434939860 wait complete. 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 Processor -- start 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.508+0000 7f9eb492e700 1 -- start start 2024-02-15T22:46:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eb492e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eb492e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb0102800 0x7f9eb0113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eb492e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01145f0 con 0x7f9eb0101e60 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eb492e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb010d920 con 0x7f9eb0102800 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38008/0 (socket says 172.21.15.33:38008) 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eae59c700 1 -- 172.21.15.33:0/1864448399 learned_addr learned my addr 172.21.15.33:0/1864448399 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eadd9b700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb0102800 0x7f9eb0113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eae59c700 1 -- 172.21.15.33:0/1864448399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb0102800 msgr2=0x7f9eb0113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eae59c700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb0102800 0x7f9eb0113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eae59c700 1 -- 172.21.15.33:0/1864448399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4005040 con 0x7f9eb0101e60 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eae59c700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0113a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009100 tx=0x7f9ea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9e9effd700 1 -- 172.21.15.33:0/1864448399 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea400e040 con 0x7f9eb0101e60 2024-02-15T22:46:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9e9effd700 1 -- 172.21.15.33:0/1864448399 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ea4004290 con 0x7f9eb0101e60 2024-02-15T22:46:51.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb010dba0 con 0x7f9eb0101e60 2024-02-15T22:46:51.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9e9effd700 1 -- 172.21.15.33:0/1864448399 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea401c630 con 0x7f9eb0101e60 2024-02-15T22:46:51.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.509+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb010e0e0 con 0x7f9eb0101e60 2024-02-15T22:46:51.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.510+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb00fb610 con 0x7f9eb0101e60 2024-02-15T22:46:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.511+0000 7f9e9effd700 1 -- 172.21.15.33:0/1864448399 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f9ea400bbf0 con 0x7f9eb0101e60 2024-02-15T22:46:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.511+0000 7f9e9effd700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e9806d900 0x7f9e9806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.512+0000 7f9eadd9b700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e9806d900 0x7f9e9806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.512+0000 7f9e9effd700 1 -- 172.21.15.33:0/1864448399 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9ea408e450 con 0x7f9eb0101e60 2024-02-15T22:46:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.512+0000 7f9eadd9b700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e9806d900 0x7f9e9806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9eb010f290 tx=0x7f9ea0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.516+0000 7f9e9effd700 1 -- 172.21.15.33:0/1864448399 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ea405b6d0 con 0x7f9eb0101e60 2024-02-15T22:46:51.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.744+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eb010f040 con 0x7f9e9806d900 2024-02-15T22:46:51.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.745+0000 7f9e9effd700 1 -- 172.21.15.33:0/1864448399 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9eb010f040 con 0x7f9e9806d900 2024-02-15T22:46:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.747+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e9806d900 msgr2=0x7f9e9806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.747+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e9806d900 0x7f9e9806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9eb010f290 tx=0x7f9ea0009040 comp rx=0 tx=0).stop 2024-02-15T22:46:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 msgr2=0x7f9eb0113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0113a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009100 tx=0x7f9ea4009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 shutdown_connections 2024-02-15T22:46:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e9806d900 0x7f9e9806fdb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101e60 0x7f9eb0113a60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 --2- 172.21.15.33:0/1864448399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb0102800 0x7f9eb0113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 >> 172.21.15.33:0/1864448399 conn(0x7f9eb00f7a10 msgr2=0x7f9eb0105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 shutdown_connections 2024-02-15T22:46:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.748+0000 7f9eb492e700 1 -- 172.21.15.33:0/1864448399 wait complete. 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.852+0000 7f3787363700 1 -- 172.21.15.33:0/727437794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3780102f50 msgr2=0x7f3780103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.852+0000 7f3787363700 1 --2- 172.21.15.33:0/727437794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3780102f50 0x7f3780103320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f377c004940 tx=0x7f377c009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.852+0000 7f3787363700 1 -- 172.21.15.33:0/727437794 shutdown_connections 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.852+0000 7f3787363700 1 --2- 172.21.15.33:0/727437794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37801038f0 0x7f37800fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.852+0000 7f3787363700 1 --2- 172.21.15.33:0/727437794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3780102f50 0x7f3780103320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.852+0000 7f3787363700 1 -- 172.21.15.33:0/727437794 >> 172.21.15.33:0/727437794 conn(0x7f37800f8ae0 msgr2=0x7f37800faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.852+0000 7f3787363700 1 -- 172.21.15.33:0/727437794 shutdown_connections 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f3787363700 1 -- 172.21.15.33:0/727437794 wait complete. 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f3787363700 1 Processor -- start 2024-02-15T22:46:51.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f3787363700 1 -- start start 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f3787363700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3780102f50 0x7f3780070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f3787363700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37801038f0 0x7f37800707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f3787363700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780070dd0 con 0x7f37801038f0 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f3787363700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780070f40 con 0x7f3780102f50 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f37848fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37801038f0 0x7f37800707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f37848fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37801038f0 0x7f37800707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38038/0 (socket says 172.21.15.33:38038) 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f37848fe700 1 -- 172.21.15.33:0/2530986179 learned_addr learned my addr 172.21.15.33:0/2530986179 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.853+0000 7f37850ff700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3780102f50 0x7f3780070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f37848fe700 1 -- 172.21.15.33:0/2530986179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3780102f50 msgr2=0x7f3780070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f37848fe700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3780102f50 0x7f3780070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f37848fe700 1 -- 172.21.15.33:0/2530986179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c005040 con 0x7f37801038f0 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f37848fe700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37801038f0 0x7f37800707d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f377000c890 tx=0x7f37700044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f3775ffb700 1 -- 172.21.15.33:0/2530986179 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f377000a700 con 0x7f37801038f0 2024-02-15T22:46:51.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f3775ffb700 1 -- 172.21.15.33:0/2530986179 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f377000ad30 con 0x7f37801038f0 2024-02-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f3775ffb700 1 -- 172.21.15.33:0/2530986179 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37700113a0 con 0x7f37801038f0 2024-02-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3780119ca0 con 0x7f37801038f0 2024-02-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.854+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378011a180 con 0x7f37801038f0 2024-02-15T22:46:51.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.855+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3780100260 con 0x7f37801038f0 2024-02-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.856+0000 7f3775ffb700 1 -- 172.21.15.33:0/2530986179 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f3770012400 con 0x7f37801038f0 2024-02-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.856+0000 7f3775ffb700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f376c06d900 0x7f376c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.856+0000 7f3775ffb700 1 -- 172.21.15.33:0/2530986179 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f377008cf20 con 0x7f37801038f0 2024-02-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.856+0000 7f37850ff700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f376c06d900 0x7f376c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:51.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.856+0000 7f37850ff700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f376c06d900 0x7f376c06fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f377c004f90 tx=0x7f377c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:51.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:51.861+0000 7f3775ffb700 1 -- 172.21.15.33:0/2530986179 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f37700c0d20 con 0x7f37801038f0 2024-02-15T22:46:52.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:51 smithi033 ceph-mon[113773]: pgmap v46: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:46:52.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:52.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:52.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:52.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:51 smithi033 ceph-mon[113773]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded (PG_DEGRADED) 2024-02-15T22:46:52.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.088+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f378004bf70 con 0x7f376c06d900 2024-02-15T22:46:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.098+0000 7f3775ffb700 1 -- 172.21.15.33:0/2530986179 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f377c00b650 con 0x7f376c06d900 2024-02-15T22:46:52.100 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:46:52.100 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (3m) 16s ago 14m 27.7M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:46:52.100 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (27s) 16s ago 14m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:46:52.100 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (22s) 19s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:46:52.100 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (2m) 16s ago 13m 78.0M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:46:52.100 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (8m) 16s ago 8m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (8m) 16s ago 8m 75.3M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (8m) 19s ago 8m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (8m) 19s ago 8m 67.9M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (4m) 16s ago 15m 495M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (3m) 19s ago 12m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (93s) 16s ago 15m 42.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (67s) 19s ago 12m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (3m) 16s ago 14m 16.6M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (3m) 19s ago 13m 16.3M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 starting - - - 1559M 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (11m) 16s ago 11m 233M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:46:52.101 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (11m) 16s ago 11m 198M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:46:52.102 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (10m) 19s ago 10m 264M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:46:52.102 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (10m) 19s ago 10m 232M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:46:52.102 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (9m) 19s ago 9m 225M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:46:52.102 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (3m) 16s ago 13m 60.1M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:46:52.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f376c06d900 msgr2=0x7f376c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f376c06d900 0x7f376c06fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f377c004f90 tx=0x7f377c009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37801038f0 msgr2=0x7f37800707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37801038f0 0x7f37800707d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f377000c890 tx=0x7f37700044c0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 shutdown_connections 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f376c06d900 0x7f376c06fdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3780102f50 0x7f3780070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 --2- 172.21.15.33:0/2530986179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37801038f0 0x7f37800707d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 >> 172.21.15.33:0/2530986179 conn(0x7f37800f8ae0 msgr2=0x7f37800fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 shutdown_connections 2024-02-15T22:46:52.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.100+0000 7f3787363700 1 -- 172.21.15.33:0/2530986179 wait complete. 2024-02-15T22:46:52.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:51 smithi082 ceph-mon[84550]: pgmap v46: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:46:52.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:51 smithi082 ceph-mon[84550]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded (PG_DEGRADED) 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 -- 172.21.15.33:0/3896397070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 msgr2=0x7f6d0c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/3896397070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c103320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d08004940 tx=0x7f6d08009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 -- 172.21.15.33:0/3896397070 shutdown_connections 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/3896397070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d0c1038f0 0x7f6d0c0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/3896397070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c103320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 -- 172.21.15.33:0/3896397070 >> 172.21.15.33:0/3896397070 conn(0x7f6d0c0f8ae0 msgr2=0x7f6d0c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 -- 172.21.15.33:0/3896397070 shutdown_connections 2024-02-15T22:46:52.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.212+0000 7f6d13fd2700 1 -- 172.21.15.33:0/3896397070 wait complete. 2024-02-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d13fd2700 1 Processor -- start 2024-02-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d13fd2700 1 -- start start 2024-02-15T22:46:52.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d13fd2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d13fd2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d0c1038f0 0x7f6d0c113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d13fd2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c1145e0 con 0x7f6d0c102f50 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d13fd2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c10d910 con 0x7f6d0c1038f0 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d11d6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d11d6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38054/0 (socket says 172.21.15.33:38054) 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d11d6e700 1 -- 172.21.15.33:0/2113834572 learned_addr learned my addr 172.21.15.33:0/2113834572 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.213+0000 7f6d1156d700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d0c1038f0 0x7f6d0c113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d11d6e700 1 -- 172.21.15.33:0/2113834572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d0c1038f0 msgr2=0x7f6d0c113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d11d6e700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d0c1038f0 0x7f6d0c113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d11d6e700 1 -- 172.21.15.33:0/2113834572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08005040 con 0x7f6d0c102f50 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d1156d700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d0c1038f0 0x7f6d0c113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d11d6e700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c113a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009150 tx=0x7f6d08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d027fc700 1 -- 172.21.15.33:0/2113834572 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0800e040 con 0x7f6d0c102f50 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d027fc700 1 -- 172.21.15.33:0/2113834572 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d0800bbf0 con 0x7f6d0c102f50 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c10db90 con 0x7f6d0c102f50 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c10e0d0 con 0x7f6d0c102f50 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.214+0000 7f6d027fc700 1 -- 172.21.15.33:0/2113834572 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0801c3f0 con 0x7f6d0c102f50 2024-02-15T22:46:52.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.215+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c0fc6e0 con 0x7f6d0c102f50 2024-02-15T22:46:52.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.216+0000 7f6d027fc700 1 -- 172.21.15.33:0/2113834572 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f6d0800bd60 con 0x7f6d0c102f50 2024-02-15T22:46:52.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.216+0000 7f6d027fc700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6cf806d900 0x7f6cf806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:52.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.216+0000 7f6d027fc700 1 -- 172.21.15.33:0/2113834572 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6d0808e2a0 con 0x7f6d0c102f50 2024-02-15T22:46:52.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.216+0000 7f6d1156d700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6cf806d900 0x7f6cf806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:52.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.217+0000 7f6d1156d700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6cf806d900 0x7f6cf806fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc004fd0 tx=0x7f6cfc0043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:52.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.221+0000 7f6d027fc700 1 -- 172.21.15.33:0/2113834572 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6d0805b5c0 con 0x7f6d0c102f50 2024-02-15T22:46:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.535+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d0c10dd20 con 0x7f6d0c102f50 2024-02-15T22:46:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.535+0000 7f6d027fc700 1 -- 172.21.15.33:0/2113834572 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f6d0c10dd20 con 0x7f6d0c102f50 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 5 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:46:52.537 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:46:52.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:46:52.538 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:46:52.538 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 9, 2024-02-15T22:46:52.538 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:46:52.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:46:52.538 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6cf806d900 msgr2=0x7f6cf806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6cf806d900 0x7f6cf806fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc004fd0 tx=0x7f6cfc0043c0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 msgr2=0x7f6d0c113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c113a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009150 tx=0x7f6d08009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 shutdown_connections 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6cf806d900 0x7f6cf806fdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d0c102f50 0x7f6d0c113a50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 --2- 172.21.15.33:0/2113834572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d0c1038f0 0x7f6d0c113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 >> 172.21.15.33:0/2113834572 conn(0x7f6d0c0f8ae0 msgr2=0x7f6d0c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 shutdown_connections 2024-02-15T22:46:52.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.537+0000 7f6d13fd2700 1 -- 172.21.15.33:0/2113834572 wait complete. 2024-02-15T22:46:52.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.641+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/69916009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fe8f0 msgr2=0x7ffb68107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.641+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/69916009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fe8f0 0x7ffb68107050 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb58004880 tx=0x7ffb58009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:52.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.641+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/69916009 shutdown_connections 2024-02-15T22:46:52.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.641+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/69916009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fe8f0 0x7ffb68107050 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.641+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/69916009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fdfe0 0x7ffb680fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.642+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/69916009 >> 172.21.15.33:0/69916009 conn(0x7ffb68071d90 msgr2=0x7ffb68072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:52.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.642+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/69916009 shutdown_connections 2024-02-15T22:46:52.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.642+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/69916009 wait complete. 2024-02-15T22:46:52.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.642+0000 7ffb6f7fd700 1 Processor -- start 2024-02-15T22:46:52.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.642+0000 7ffb6f7fd700 1 -- start start 2024-02-15T22:46:52.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6f7fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fdfe0 0x7ffb680fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:52.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6f7fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fe8f0 0x7ffb680fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:52.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6f7fd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680fc9e0 con 0x7ffb680fe8f0 2024-02-15T22:46:52.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6f7fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680fcb50 con 0x7ffb680fdfe0 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6cd98700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fe8f0 0x7ffb680fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6cd98700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fe8f0 0x7ffb680fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38080/0 (socket says 172.21.15.33:38080) 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6cd98700 1 -- 172.21.15.33:0/648493203 learned_addr learned my addr 172.21.15.33:0/648493203 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6d599700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fdfe0 0x7ffb680fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6cd98700 1 -- 172.21.15.33:0/648493203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fdfe0 msgr2=0x7ffb680fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6cd98700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fdfe0 0x7ffb680fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6cd98700 1 -- 172.21.15.33:0/648493203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb58005040 con 0x7ffb680fe8f0 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.643+0000 7ffb6cd98700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fe8f0 0x7ffb680fc3e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009c90 tx=0x7ffb58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.644+0000 7ffb5dffb700 1 -- 172.21.15.33:0/648493203 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb5800e030 con 0x7ffb680fe8f0 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.644+0000 7ffb5dffb700 1 -- 172.21.15.33:0/648493203 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb58013ba0 con 0x7ffb680fe8f0 2024-02-15T22:46:52.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.644+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb68119d10 con 0x7ffb680fe8f0 2024-02-15T22:46:52.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.644+0000 7ffb5dffb700 1 -- 172.21.15.33:0/648493203 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb58012600 con 0x7ffb680fe8f0 2024-02-15T22:46:52.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.644+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6811a170 con 0x7ffb680fe8f0 2024-02-15T22:46:52.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.645+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb681046c0 con 0x7ffb680fe8f0 2024-02-15T22:46:52.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.645+0000 7ffb5dffb700 1 -- 172.21.15.33:0/648493203 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7ffb5801c400 con 0x7ffb680fe8f0 2024-02-15T22:46:52.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.646+0000 7ffb5dffb700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ffb5406d900 0x7ffb5406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:52.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.646+0000 7ffb5dffb700 1 -- 172.21.15.33:0/648493203 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6242+0+0 (secure 0 0 0) 0x7ffb5808eb80 con 0x7ffb680fe8f0 2024-02-15T22:46:52.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.646+0000 7ffb6d599700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ffb5406d900 0x7ffb5406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:52.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.646+0000 7ffb6d599700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ffb5406d900 0x7ffb5406fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009b80 tx=0x7ffb6400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:52.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.650+0000 7ffb5dffb700 1 -- 172.21.15.33:0/648493203 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb580582f0 con 0x7ffb680fe8f0 2024-02-15T22:46:52.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.899+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb680738b0 con 0x7ffb680fe8f0 2024-02-15T22:46:52.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.900+0000 7ffb5dffb700 1 -- 172.21.15.33:0/648493203 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7ffb5805b9b0 con 0x7ffb680fe8f0 2024-02-15T22:46:52.901 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:46:52.902 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:46:52.903 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:46:52.904 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:46:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ffb5406d900 msgr2=0x7ffb5406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ffb5406d900 0x7ffb5406fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009b80 tx=0x7ffb6400b040 comp rx=0 tx=0).stop 2024-02-15T22:46:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fe8f0 msgr2=0x7ffb680fc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fe8f0 0x7ffb680fc3e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009c90 tx=0x7ffb58009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 shutdown_connections 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ffb5406d900 0x7ffb5406fdb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb680fdfe0 0x7ffb680fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 --2- 172.21.15.33:0/648493203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb680fe8f0 0x7ffb680fc3e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 >> 172.21.15.33:0/648493203 conn(0x7ffb68071d90 msgr2=0x7ffb68101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 shutdown_connections 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:52.902+0000 7ffb6f7fd700 1 -- 172.21.15.33:0/648493203 wait complete. 2024-02-15T22:46:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:46:53.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 -- 172.21.15.33:0/2133459439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 msgr2=0x7f0b2c0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2133459439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c0fbea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b14004940 tx=0x7f0b14009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:53.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 -- 172.21.15.33:0/2133459439 shutdown_connections 2024-02-15T22:46:53.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2133459439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c0fbea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2133459439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c101e40 0x7f0b2c102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 -- 172.21.15.33:0/2133459439 >> 172.21.15.33:0/2133459439 conn(0x7f0b2c071d90 msgr2=0x7f0b2c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 -- 172.21.15.33:0/2133459439 shutdown_connections 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.009+0000 7f0b325fd700 1 -- 172.21.15.33:0/2133459439 wait complete. 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b325fd700 1 Processor -- start 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b325fd700 1 -- start start 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b325fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c101e40 0x7f0b2c113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b325fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b325fd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c114600 con 0x7f0b2c1027e0 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b325fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c10d930 con 0x7f0b2c101e40 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38086/0 (socket says 172.21.15.33:38086) 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b2bfff700 1 -- 172.21.15.33:0/2613821174 learned_addr learned my addr 172.21.15.33:0/2613821174 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:53.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b23fff700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c101e40 0x7f0b2c113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b2bfff700 1 -- 172.21.15.33:0/2613821174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c101e40 msgr2=0x7f0b2c113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b2bfff700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c101e40 0x7f0b2c113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.010+0000 7f0b2bfff700 1 -- 172.21.15.33:0/2613821174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b14005040 con 0x7f0b2c1027e0 2024-02-15T22:46:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.011+0000 7f0b2bfff700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c113fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009100 tx=0x7f0b14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.011+0000 7f0b297fa700 1 -- 172.21.15.33:0/2613821174 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b1400e040 con 0x7f0b2c1027e0 2024-02-15T22:46:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.011+0000 7f0b297fa700 1 -- 172.21.15.33:0/2613821174 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b14004290 con 0x7f0b2c1027e0 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.011+0000 7f0b297fa700 1 -- 172.21.15.33:0/2613821174 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b1401c3f0 con 0x7f0b2c1027e0 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.011+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2c10dbb0 con 0x7f0b2c1027e0 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.011+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c10e0f0 con 0x7f0b2c1027e0 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.012+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2c0738b0 con 0x7f0b2c1027e0 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.013+0000 7f0b297fa700 1 -- 172.21.15.33:0/2613821174 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f0b1400bbf0 con 0x7f0b2c1027e0 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.013+0000 7f0b297fa700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d900 0x7f0b1806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.014+0000 7f0b297fa700 1 -- 172.21.15.33:0/2613821174 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f0b1408e3f0 con 0x7f0b2c1027e0 2024-02-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.014+0000 7f0b23fff700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d900 0x7f0b1806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:53.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.014+0000 7f0b23fff700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d900 0x7f0b1806fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c004990 tx=0x7f0b1c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:53.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.018+0000 7f0b297fa700 1 -- 172.21.15.33:0/2613821174 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0b1405b670 con 0x7f0b2c1027e0 2024-02-15T22:46:53.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:52 smithi082 ceph-mon[84550]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:53.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:52 smithi082 ceph-mon[84550]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:53.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:52 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2113834572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:53.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.246+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b2c04bf40 con 0x7f0b1806d900 2024-02-15T22:46:53.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:52 smithi033 ceph-mon[113773]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:53.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:52 smithi033 ceph-mon[113773]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:53.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:52 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2113834572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:46:53.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.248+0000 7f0b297fa700 1 -- 172.21.15.33:0/2613821174 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0b2c04bf40 con 0x7f0b1806d900 2024-02-15T22:46:53.249 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "6/21 daemons upgraded", 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:46:53.250 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:46:53.251 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d900 msgr2=0x7f0b1806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d900 0x7f0b1806fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c004990 tx=0x7f0b1c009ee0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 msgr2=0x7f0b2c113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c113fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009100 tx=0x7f0b14009e30 comp rx=0 tx=0).stop 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 shutdown_connections 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d900 0x7f0b1806fdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c101e40 0x7f0b2c113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 --2- 172.21.15.33:0/2613821174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b2c1027e0 0x7f0b2c113fb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 >> 172.21.15.33:0/2613821174 conn(0x7f0b2c071d90 msgr2=0x7f0b2c065760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:53.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 shutdown_connections 2024-02-15T22:46:53.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.250+0000 7f0b325fd700 1 -- 172.21.15.33:0/2613821174 wait complete. 2024-02-15T22:46:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 -- 172.21.15.33:0/3479102961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700101e40 msgr2=0x7fd700102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 --2- 172.21.15.33:0/3479102961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700101e40 0x7fd700102210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009ce0 tx=0x7fd6f0004d10 comp rx=0 tx=0).stop 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 -- 172.21.15.33:0/3479102961 shutdown_connections 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 --2- 172.21.15.33:0/3479102961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7001027e0 0x7fd7000fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 --2- 172.21.15.33:0/3479102961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700101e40 0x7fd700102210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 -- 172.21.15.33:0/3479102961 >> 172.21.15.33:0/3479102961 conn(0x7fd700071d90 msgr2=0x7fd700072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 -- 172.21.15.33:0/3479102961 shutdown_connections 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 -- 172.21.15.33:0/3479102961 wait complete. 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 Processor -- start 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.361+0000 7fd704e6f700 1 -- start start 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd704e6f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd700101e40 0x7fd700102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd704e6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7001027e0 0x7fd7001031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd704e6f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7001037e0 con 0x7fd7001027e0 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd704e6f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700103950 con 0x7fd700101e40 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7001027e0 0x7fd7001031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7001027e0 0x7fd7001031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38100/0 (socket says 172.21.15.33:38100) 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fdd9b700 1 -- 172.21.15.33:0/1136626923 learned_addr learned my addr 172.21.15.33:0/1136626923 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fe59c700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd700101e40 0x7fd700102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fdd9b700 1 -- 172.21.15.33:0/1136626923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd700101e40 msgr2=0x7fd700102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fdd9b700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd700101e40 0x7fd700102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fdd9b700 1 -- 172.21.15.33:0/1136626923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0009940 con 0x7fd7001027e0 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fe59c700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd700101e40 0x7fd700102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:46:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6fdd9b700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7001027e0 0x7fd7001031e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8002a50 tx=0x7fd6e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:53.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6f6ffd700 1 -- 172.21.15.33:0/1136626923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e8007cc0 con 0x7fd7001027e0 2024-02-15T22:46:53.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6f6ffd700 1 -- 172.21.15.33:0/1136626923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6e800f040 con 0x7fd7001027e0 2024-02-15T22:46:53.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.362+0000 7fd6f6ffd700 1 -- 172.21.15.33:0/1136626923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e800daf0 con 0x7fd7001027e0 2024-02-15T22:46:53.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.363+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd700119e00 con 0x7fd7001027e0 2024-02-15T22:46:53.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.363+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70011a2b0 con 0x7fd7001027e0 2024-02-15T22:46:53.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.363+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7000738b0 con 0x7fd7001027e0 2024-02-15T22:46:53.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.364+0000 7fd6f6ffd700 1 -- 172.21.15.33:0/1136626923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fd6e8009810 con 0x7fd7001027e0 2024-02-15T22:46:53.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.364+0000 7fd6f6ffd700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6ec06d900 0x7fd6ec06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:53.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.365+0000 7fd6f6ffd700 1 -- 172.21.15.33:0/1136626923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fd6e808cd20 con 0x7fd7001027e0 2024-02-15T22:46:53.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.365+0000 7fd6fe59c700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6ec06d900 0x7fd6ec06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:53.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.365+0000 7fd6fe59c700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6ec06d900 0x7fd6ec06fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000b740 tx=0x7fd6f0004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:53.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.369+0000 7fd6f6ffd700 1 -- 172.21.15.33:0/1136626923 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd6e8056470 con 0x7fd7001027e0 2024-02-15T22:46:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.665+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd700108f40 con 0x7fd7001027e0 2024-02-15T22:46:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.666+0000 7fd6f6ffd700 1 -- 172.21.15.33:0/1136626923 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1383 (secure 0 0 0) 0x7fd6e8059b30 con 0x7fd7001027e0 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: osd.0 (root=default,host=smithi033) is down 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-02-15T22:46:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-02-15T22:46:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-02-15T22:46:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6ec06d900 msgr2=0x7fd6ec06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6ec06d900 0x7fd6ec06fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000b740 tx=0x7fd6f0004d10 comp rx=0 tx=0).stop 2024-02-15T22:46:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7001027e0 msgr2=0x7fd7001031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7001027e0 0x7fd7001031e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8002a50 tx=0x7fd6e8004600 comp rx=0 tx=0).stop 2024-02-15T22:46:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 shutdown_connections 2024-02-15T22:46:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6ec06d900 0x7fd6ec06fdb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd700101e40 0x7fd700102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 --2- 172.21.15.33:0/1136626923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7001027e0 0x7fd7001031e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 >> 172.21.15.33:0/1136626923 conn(0x7fd700071d90 msgr2=0x7fd700065700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 shutdown_connections 2024-02-15T22:46:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:46:53.668+0000 7fd704e6f700 1 -- 172.21.15.33:0/1136626923 wait complete. 2024-02-15T22:46:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:53 smithi082 ceph-mon[84550]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-15T22:46:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:53 smithi082 ceph-mon[84550]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:53 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/648493203' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:46:54.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:53 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1136626923' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:46:54.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:53 smithi033 ceph-mon[113773]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-02-15T22:46:54.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:53 smithi033 ceph-mon[113773]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:54.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:53 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/648493203' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:46:54.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:53 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1136626923' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:46:55.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:54 smithi082 ceph-mon[84550]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:55.128 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:54 smithi033 ceph-mon[113773]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:55.770 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:55 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[124831]: 2024-02-15T22:46:55.410+0000 7fb0227b77c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-15T22:46:56.084 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:55 smithi033 ceph-mon[113773]: pgmap v48: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:46:56.085 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:55 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[124831]: 2024-02-15T22:46:55.885+0000 7fb0227b77c0 -1 osd.0 49 log_to_monitors true 2024-02-15T22:46:56.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:55 smithi082 ceph-mon[84550]: pgmap v48: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:46:57.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:56 smithi033 ceph-mon[113773]: from='osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:46:57.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:57.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:57.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:46:56 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[124831]: 2024-02-15T22:46:56.837+0000 7fb013c0f700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:46:57.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:56 smithi082 ceph-mon[84550]: from='osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:46:57.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:57.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: from='osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: osdmap e52: 6 total, 5 up, 6 in 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: from='osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:58.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:58.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: from='osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: osdmap e52: 6 total, 5 up, 6 in 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: from='osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: failed to encode map e52 with expected crc 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:58.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:59.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:46:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: failed to encode map e53 with expected crc 2024-02-15T22:46:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848] boot 2024-02-15T22:46:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: osdmap e53: 6 total, 6 up, 6 in 2024-02-15T22:46:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:46:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:59.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:58 smithi082 ceph-mon[84550]: osdmap e54: 6 total, 6 up, 6 in 2024-02-15T22:46:59.268 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:46:59.268 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: failed to encode map e53 with expected crc 2024-02-15T22:46:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: osd.0 [v2:172.21.15.33:6802/1308222848,v1:172.21.15.33:6803/1308222848] boot 2024-02-15T22:46:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: osdmap e53: 6 total, 6 up, 6 in 2024-02-15T22:46:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:46:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:46:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:59.269 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:58 smithi033 ceph-mon[113773]: osdmap e54: 6 total, 6 up, 6 in 2024-02-15T22:47:00.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: pgmap v52: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:47:00.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:46:59 smithi033 ceph-mon[113773]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: pgmap v52: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 70/357 objects degraded (19.608%) 2024-02-15T22:47:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: failed to encode map e54 with expected crc 2024-02-15T22:47:00.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:46:59 smithi082 ceph-mon[84550]: failed to encode map e54 with expected crc 2024-02-15T22:47:01.143 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:00 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:47:01.144 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:00 smithi033 ceph-mon[113773]: mgrmap e39: smithi033.swohxi(active, since 92s), standbys: smithi082.mjhlse 2024-02-15T22:47:01.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:00 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:47:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:00 smithi082 ceph-mon[84550]: mgrmap e39: smithi033.swohxi(active, since 92s), standbys: smithi082.mjhlse 2024-02-15T22:47:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: pgmap v54: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1023 B/s wr, 3 op/s; 12/357 objects degraded (3.361%) 2024-02-15T22:47:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:02.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:02.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:02.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:02.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:02.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:02.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: pgmap v54: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1023 B/s wr, 3 op/s; 12/357 objects degraded (3.361%) 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:03.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:02 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:03.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:02 smithi033 ceph-mon[113773]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-15T22:47:03.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:02 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:03.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:02 smithi082 ceph-mon[84550]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-15T22:47:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:03 smithi033 ceph-mon[113773]: pgmap v55: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-15T22:47:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:03 smithi033 ceph-mon[113773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded) 2024-02-15T22:47:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:03 smithi033 ceph-mon[113773]: Cluster is now healthy 2024-02-15T22:47:04.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:03 smithi082 ceph-mon[84550]: pgmap v55: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-15T22:47:04.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:03 smithi082 ceph-mon[84550]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded) 2024-02-15T22:47:04.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:03 smithi082 ceph-mon[84550]: Cluster is now healthy 2024-02-15T22:47:06.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:05 smithi033 ceph-mon[113773]: pgmap v56: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 846 B/s wr, 5 op/s 2024-02-15T22:47:06.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:05 smithi082 ceph-mon[84550]: pgmap v56: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 846 B/s wr, 5 op/s 2024-02-15T22:47:08.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:07 smithi033 ceph-mon[113773]: pgmap v57: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 744 B/s wr, 5 op/s 2024-02-15T22:47:08.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:07 smithi082 ceph-mon[84550]: pgmap v57: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 744 B/s wr, 5 op/s 2024-02-15T22:47:09.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:09 smithi033 ceph-mon[113773]: pgmap v58: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 614 B/s wr, 4 op/s 2024-02-15T22:47:09.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:09.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:09 smithi082 ceph-mon[84550]: pgmap v58: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 614 B/s wr, 4 op/s 2024-02-15T22:47:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:11.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:11 smithi033 ceph-mon[113773]: pgmap v59: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 545 B/s wr, 5 op/s 2024-02-15T22:47:11.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:11 smithi082 ceph-mon[84550]: pgmap v59: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 545 B/s wr, 5 op/s 2024-02-15T22:47:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:13 smithi033 ceph-mon[113773]: pgmap v60: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:47:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:13.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:13 smithi082 ceph-mon[84550]: pgmap v60: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:47:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:15 smithi033 ceph-mon[113773]: pgmap v61: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2024-02-15T22:47:15.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:15 smithi082 ceph-mon[84550]: pgmap v61: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2024-02-15T22:47:16.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:16 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:16.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:16 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:17.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:17 smithi033 ceph-mon[113773]: pgmap v62: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:17.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:17 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:17.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:17 smithi033 ceph-mon[113773]: Upgrade: osd.1 is safe to restart 2024-02-15T22:47:17.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:17 smithi082 ceph-mon[84550]: pgmap v62: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:17 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:47:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:17 smithi082 ceph-mon[84550]: Upgrade: osd.1 is safe to restart 2024-02-15T22:47:19.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:19 smithi033 ceph-mon[113773]: Upgrade: Updating osd.1 2024-02-15T22:47:19.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:19.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:47:19.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:19.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:19 smithi033 ceph-mon[113773]: Deploying daemon osd.1 on smithi033 2024-02-15T22:47:19.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:19 smithi033 ceph-mon[113773]: pgmap v63: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:19.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:19 smithi082 ceph-mon[84550]: Upgrade: Updating osd.1 2024-02-15T22:47:19.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:19.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:47:19.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:19.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:19 smithi082 ceph-mon[84550]: Deploying daemon osd.1 on smithi033 2024-02-15T22:47:19.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:19 smithi082 ceph-mon[84550]: pgmap v63: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:21.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:21 smithi033 ceph-mon[113773]: pgmap v64: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:47:21.578 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:21 smithi033 systemd[1]: Stopping Ceph osd.1 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:47:21.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:21 smithi082 ceph-mon[84550]: pgmap v64: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:47:22.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:21 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[55034]: 2024-02-15T22:47:21.576+0000 7f11ee3f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:47:22.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:21 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[55034]: 2024-02-15T22:47:21.576+0000 7f11ee3f3700 -1 osd.1 54 *** Got signal Terminated *** 2024-02-15T22:47:22.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:21 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[55034]: 2024-02-15T22:47:21.576+0000 7f11ee3f3700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:47:22.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:22 smithi033 ceph-mon[113773]: osd.1 marked itself down and dead 2024-02-15T22:47:22.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:22 smithi082 ceph-mon[84550]: osd.1 marked itself down and dead 2024-02-15T22:47:22.880 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:22 smithi033 podman[130179]: 2024-02-15 22:47:22.598467742 +0000 UTC m=+1.139097639 container died d77998bd1a585789f59ed819c62cbdfee877631c17818dea759470def61f10d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, ceph=True, GIT_CLEAN=True, RELEASE=quincy-9aa5233, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:47:23.135 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:22 smithi033 podman[130179]: 2024-02-15 22:47:22.976657634 +0000 UTC m=+1.517287522 container cleanup d77998bd1a585789f59ed819c62cbdfee877631c17818dea759470def61f10d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=quincy-9aa5233, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:47:23.135 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:22 smithi033 bash[130179]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1 2024-02-15T22:47:23.521 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:23 smithi033 podman[130196]: 2024-02-15 22:47:23.253307507 +0000 UTC m=+0.654582860 container remove d77998bd1a585789f59ed819c62cbdfee877631c17818dea759470def61f10d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, RELEASE=quincy-9aa5233, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-02-15T22:47:23.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:23 smithi033 ceph-mon[113773]: pgmap v65: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:23.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:23 smithi033 ceph-mon[113773]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:47:23.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:23 smithi033 ceph-mon[113773]: osdmap e55: 6 total, 5 up, 6 in 2024-02-15T22:47:23.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:23 smithi033 ceph-mon[113773]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:23 smithi033 ceph-mon[113773]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:23 smithi033 ceph-mon[113773]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:23 smithi033 ceph-mon[113773]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:23 smithi082 ceph-mon[84550]: pgmap v65: 65 pgs: 65 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:23.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:23 smithi082 ceph-mon[84550]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:47:23.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:23 smithi082 ceph-mon[84550]: osdmap e55: 6 total, 5 up, 6 in 2024-02-15T22:47:23.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:23 smithi082 ceph-mon[84550]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:23 smithi082 ceph-mon[84550]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:23 smithi082 ceph-mon[84550]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:23 smithi082 ceph-mon[84550]: failed to encode map e55 with expected crc 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 -- 172.21.15.33:0/1913174839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e41038f0 msgr2=0x7f74e40fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/1913174839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e41038f0 0x7f74e40fcf60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74d4004940 tx=0x7f74d4009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 -- 172.21.15.33:0/1913174839 shutdown_connections 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/1913174839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e41038f0 0x7f74e40fcf60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/1913174839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e4102f50 0x7f74e4103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 -- 172.21.15.33:0/1913174839 >> 172.21.15.33:0/1913174839 conn(0x7f74e40f8ae0 msgr2=0x7f74e40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 -- 172.21.15.33:0/1913174839 shutdown_connections 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 -- 172.21.15.33:0/1913174839 wait complete. 2024-02-15T22:47:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 Processor -- start 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.779+0000 7f74ec0ce700 1 -- start start 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74ec0ce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e4102f50 0x7f74e4113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74ec0ce700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e41038f0 0x7f74e4113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74ec0ce700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4114620 con 0x7f74e4102f50 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74ec0ce700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e410d950 con 0x7f74e41038f0 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9e6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e4102f50 0x7f74e4113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9e6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e4102f50 0x7f74e4113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59350/0 (socket says 172.21.15.33:59350) 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9e6a700 1 -- 172.21.15.33:0/2800202700 learned_addr learned my addr 172.21.15.33:0/2800202700 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9669700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e41038f0 0x7f74e4113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9e6a700 1 -- 172.21.15.33:0/2800202700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e41038f0 msgr2=0x7f74e4113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9e6a700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e41038f0 0x7f74e4113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9e6a700 1 -- 172.21.15.33:0/2800202700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4005040 con 0x7f74e4102f50 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9669700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e41038f0 0x7f74e4113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.780+0000 7f74e9e6a700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e4102f50 0x7f74e4113a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74e0002a50 tx=0x7f74e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.781+0000 7f74da7fc700 1 -- 172.21.15.33:0/2800202700 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e0007cc0 con 0x7f74e4102f50 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.781+0000 7f74da7fc700 1 -- 172.21.15.33:0/2800202700 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74e000f040 con 0x7f74e4102f50 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.781+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e410dc30 con 0x7f74e4102f50 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.781+0000 7f74da7fc700 1 -- 172.21.15.33:0/2800202700 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e0009640 con 0x7f74e4102f50 2024-02-15T22:47:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.781+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e410e170 con 0x7f74e4102f50 2024-02-15T22:47:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.782+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e4105420 con 0x7f74e4102f50 2024-02-15T22:47:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.782+0000 7f74da7fc700 1 -- 172.21.15.33:0/2800202700 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f74e00097a0 con 0x7f74e4102f50 2024-02-15T22:47:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.782+0000 7f74da7fc700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f74d006d7e0 0x7f74d006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.783+0000 7f74e9669700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f74d006d7e0 0x7f74d006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.783+0000 7f74da7fc700 1 -- 172.21.15.33:0/2800202700 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f74e008cb30 con 0x7f74e4102f50 2024-02-15T22:47:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.783+0000 7f74e9669700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f74d006d7e0 0x7f74d006fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d400b3b0 tx=0x7f74d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:23.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:23.787+0000 7f74da7fc700 1 -- 172.21.15.33:0/2800202700 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f74e0059fd0 con 0x7f74e4102f50 2024-02-15T22:47:23.899 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:23 smithi033 podman[130288]: 2024-02-15 22:47:23.495462598 +0000 UTC m=+0.018034479 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:47:23.899 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:23 smithi033 podman[130288]: 2024-02-15 22:47:23.612594797 +0000 UTC m=+0.135166669 container create ba228e3dc95bf8196e36be6f2895d2a0f3286d1df433c04a88100ae8e83e2124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-15T22:47:23.899 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:23 smithi033 podman[130288]: 2024-02-15 22:47:23.815140038 +0000 UTC m=+0.337711911 container init ba228e3dc95bf8196e36be6f2895d2a0f3286d1df433c04a88100ae8e83e2124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-15T22:47:23.899 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:23 smithi033 podman[130288]: 2024-02-15 22:47:23.818462667 +0000 UTC m=+0.341034548 container start ba228e3dc95bf8196e36be6f2895d2a0f3286d1df433c04a88100ae8e83e2124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-15T22:47:23.899 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:23 smithi033 podman[130288]: 2024-02-15 22:47:23.898351047 +0000 UTC m=+0.420922925 container attach ba228e3dc95bf8196e36be6f2895d2a0f3286d1df433c04a88100ae8e83e2124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:47:24.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.015+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74e404bf40 con 0x7f74d006d7e0 2024-02-15T22:47:24.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.016+0000 7f74da7fc700 1 -- 172.21.15.33:0/2800202700 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f74e404bf40 con 0x7f74d006d7e0 2024-02-15T22:47:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f74d006d7e0 msgr2=0x7f74d006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f74d006d7e0 0x7f74d006fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d400b3b0 tx=0x7f74d4009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e4102f50 msgr2=0x7f74e4113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e4102f50 0x7f74e4113a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74e0002a50 tx=0x7f74e00046b0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 shutdown_connections 2024-02-15T22:47:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f74d006d7e0 0x7f74d006fc90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74e4102f50 0x7f74e4113a90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 --2- 172.21.15.33:0/2800202700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e41038f0 0x7f74e4113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 >> 172.21.15.33:0/2800202700 conn(0x7f74e40f8ae0 msgr2=0x7f74e40fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 shutdown_connections 2024-02-15T22:47:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.018+0000 7f74ec0ce700 1 -- 172.21.15.33:0/2800202700 wait complete. 2024-02-15T22:47:24.032 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:47:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 -- 172.21.15.33:0/2598309523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 msgr2=0x7f6ea0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/2598309523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0109370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e90004940 tx=0x7f6e90009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 -- 172.21.15.33:0/2598309523 shutdown_connections 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/2598309523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0109370 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/2598309523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea00fbd00 0x7f6ea00fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 -- 172.21.15.33:0/2598309523 >> 172.21.15.33:0/2598309523 conn(0x7f6ea00f79d0 msgr2=0x7f6ea00f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 -- 172.21.15.33:0/2598309523 shutdown_connections 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.128+0000 7f6ea81ee700 1 -- 172.21.15.33:0/2598309523 wait complete. 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea81ee700 1 Processor -- start 2024-02-15T22:47:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea81ee700 1 -- start start 2024-02-15T22:47:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea81ee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea00fbd00 0x7f6ea0115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea81ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea81ee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01166e0 con 0x7f6ea00fc610 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea81ee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea010fa10 con 0x7f6ea00fbd00 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea5789700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea5789700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0116090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59368/0 (socket says 172.21.15.33:59368) 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.129+0000 7f6ea5789700 1 -- 172.21.15.33:0/3672977837 learned_addr learned my addr 172.21.15.33:0/3672977837 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6ea5f8a700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea00fbd00 0x7f6ea0115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6ea5789700 1 -- 172.21.15.33:0/3672977837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea00fbd00 msgr2=0x7f6ea0115b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6ea5789700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea00fbd00 0x7f6ea0115b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6ea5789700 1 -- 172.21.15.33:0/3672977837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90005040 con 0x7f6ea00fc610 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6ea5789700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0116090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e90007f50 tx=0x7f6e90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6e967fc700 1 -- 172.21.15.33:0/3672977837 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e90021070 con 0x7f6ea00fc610 2024-02-15T22:47:24.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea010fc90 con 0x7f6ea00fc610 2024-02-15T22:47:24.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6e967fc700 1 -- 172.21.15.33:0/3672977837 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e90013d00 con 0x7f6ea00fc610 2024-02-15T22:47:24.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6e967fc700 1 -- 172.21.15.33:0/3672977837 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e9000e070 con 0x7f6ea00fc610 2024-02-15T22:47:24.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.130+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea01101d0 con 0x7f6ea00fc610 2024-02-15T22:47:24.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.132+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea0106aa0 con 0x7f6ea00fc610 2024-02-15T22:47:24.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.132+0000 7f6e967fc700 1 -- 172.21.15.33:0/3672977837 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6e9001c400 con 0x7f6ea00fc610 2024-02-15T22:47:24.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.132+0000 7f6e967fc700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e8c06d7e0 0x7f6e8c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.132+0000 7f6e967fc700 1 -- 172.21.15.33:0/3672977837 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6e9008e480 con 0x7f6ea00fc610 2024-02-15T22:47:24.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.132+0000 7f6ea5f8a700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e8c06d7e0 0x7f6e8c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.133+0000 7f6ea5f8a700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e8c06d7e0 0x7f6e8c06fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009b80 tx=0x7f6e9c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:24.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.137+0000 7f6e967fc700 1 -- 172.21.15.33:0/3672977837 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e9005b880 con 0x7f6ea00fc610 2024-02-15T22:47:24.149 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:24 smithi033 podman[130288]: 2024-02-15 22:47:24.118282679 +0000 UTC m=+0.640854561 container died ba228e3dc95bf8196e36be6f2895d2a0f3286d1df433c04a88100ae8e83e2124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-15T22:47:24.149 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:24 smithi033 ceph-mon[113773]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.149 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:24 smithi033 ceph-mon[113773]: osdmap e56: 6 total, 5 up, 6 in 2024-02-15T22:47:24.150 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:24 smithi033 ceph-mon[113773]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.150 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:24 smithi033 ceph-mon[113773]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.150 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:24 smithi033 ceph-mon[113773]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.150 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:24 smithi033 ceph-mon[113773]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.150 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:24 smithi033 ceph-mon[113773]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.363+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ea010c150 con 0x7f6e8c06d7e0 2024-02-15T22:47:24.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.365+0000 7f6e967fc700 1 -- 172.21.15.33:0/3672977837 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ea010c150 con 0x7f6e8c06d7e0 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e8c06d7e0 msgr2=0x7f6e8c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e8c06d7e0 0x7f6e8c06fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009b80 tx=0x7f6e9c00b040 comp rx=0 tx=0).stop 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 msgr2=0x7f6ea0116090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0116090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e90007f50 tx=0x7f6e90009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 shutdown_connections 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e8c06d7e0 0x7f6e8c06fc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea00fbd00 0x7f6ea0115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 --2- 172.21.15.33:0/3672977837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ea00fc610 0x7f6ea0116090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 >> 172.21.15.33:0/3672977837 conn(0x7f6ea00f79d0 msgr2=0x7f6ea00f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 shutdown_connections 2024-02-15T22:47:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.367+0000 7f6ea81ee700 1 -- 172.21.15.33:0/3672977837 wait complete. 2024-02-15T22:47:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.470+0000 7f318a28f700 1 -- 172.21.15.33:0/2929706290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 msgr2=0x7f3184102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.470+0000 7f318a28f700 1 --2- 172.21.15.33:0/2929706290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184102230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3174004940 tx=0x7f3174009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.470+0000 7f318a28f700 1 -- 172.21.15.33:0/2929706290 shutdown_connections 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.470+0000 7f318a28f700 1 --2- 172.21.15.33:0/2929706290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3184102800 0x7f31840fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.470+0000 7f318a28f700 1 --2- 172.21.15.33:0/2929706290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184102230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.470+0000 7f318a28f700 1 -- 172.21.15.33:0/2929706290 >> 172.21.15.33:0/2929706290 conn(0x7f31840f7a10 msgr2=0x7f31840f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 -- 172.21.15.33:0/2929706290 shutdown_connections 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 -- 172.21.15.33:0/2929706290 wait complete. 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 Processor -- start 2024-02-15T22:47:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 -- start start 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3184102800 0x7f3184113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3184114640 con 0x7f3184101e60 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.471+0000 7f318a28f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318410d970 con 0x7f3184102800 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3183fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3183fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59388/0 (socket says 172.21.15.33:59388) 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3183fff700 1 -- 172.21.15.33:0/3990423235 learned_addr learned my addr 172.21.15.33:0/3990423235 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f31837fe700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3184102800 0x7f3184113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3183fff700 1 -- 172.21.15.33:0/3990423235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3184102800 msgr2=0x7f3184113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3183fff700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3184102800 0x7f3184113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3183fff700 1 -- 172.21.15.33:0/3990423235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174005040 con 0x7f3184101e60 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3183fff700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184113ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f317400b3b0 tx=0x7f3174009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3180ff9700 1 -- 172.21.15.33:0/3990423235 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317400e040 con 0x7f3184101e60 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318410dbf0 con 0x7f3184101e60 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3180ff9700 1 -- 172.21.15.33:0/3990423235 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f317400bbf0 con 0x7f3184101e60 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f3180ff9700 1 -- 172.21.15.33:0/3990423235 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317401c3f0 con 0x7f3184101e60 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.472+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318410e130 con 0x7f3184101e60 2024-02-15T22:47:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.473+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31840fb610 con 0x7f3184101e60 2024-02-15T22:47:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.474+0000 7f3180ff9700 1 -- 172.21.15.33:0/3990423235 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f317400bd60 con 0x7f3184101e60 2024-02-15T22:47:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.474+0000 7f3180ff9700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f316c06d7e0 0x7f316c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.474+0000 7f3180ff9700 1 -- 172.21.15.33:0/3990423235 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f317408e180 con 0x7f3184101e60 2024-02-15T22:47:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.474+0000 7f31837fe700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f316c06d7e0 0x7f316c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.475+0000 7f31837fe700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f316c06d7e0 0x7f316c06fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f318410f2e0 tx=0x7f317800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.479+0000 7f3180ff9700 1 -- 172.21.15.33:0/3990423235 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f317405b620 con 0x7f3184101e60 2024-02-15T22:47:24.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:24 smithi082 ceph-mon[84550]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:24 smithi082 ceph-mon[84550]: osdmap e56: 6 total, 5 up, 6 in 2024-02-15T22:47:24.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:24 smithi082 ceph-mon[84550]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:24 smithi082 ceph-mon[84550]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:24 smithi082 ceph-mon[84550]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:24 smithi082 ceph-mon[84550]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:24 smithi082 ceph-mon[84550]: failed to encode map e56 with expected crc 2024-02-15T22:47:24.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.692+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f318410f100 con 0x7f316c06d7e0 2024-02-15T22:47:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.703+0000 7f3180ff9700 1 -- 172.21.15.33:0/3990423235 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f318410f100 con 0x7f316c06d7e0 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (3m) 28s ago 14m 27.7M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (60s) 28s ago 14m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (54s) 51s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (3m) 28s ago 14m 78.0M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (8m) 28s ago 8m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (8m) 28s ago 8m 75.3M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (8m) 51s ago 8m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (8m) 51s ago 8m 67.9M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (5m) 28s ago 15m 497M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (4m) 51s ago 13m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:47:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (2m) 28s ago 16m 44.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (100s) 51s ago 13m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (4m) 28s ago 14m 16.7M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (4m) 51s ago 13m 16.3M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (34s) 28s ago 12m 12.6M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (12m) 28s ago 12m 232M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 d77998bd1a58 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (11m) 28s ago 11m 198M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (11m) 51s ago 11m 264M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (10m) 51s ago 10m 232M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (10m) 51s ago 10m 225M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:47:24.707 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (3m) 28s ago 14m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:47:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f316c06d7e0 msgr2=0x7f316c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f316c06d7e0 0x7f316c06fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f318410f2e0 tx=0x7f317800b040 comp rx=0 tx=0).stop 2024-02-15T22:47:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 msgr2=0x7f3184113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184113ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f317400b3b0 tx=0x7f3174009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 shutdown_connections 2024-02-15T22:47:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f316c06d7e0 0x7f316c06fc90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3184101e60 0x7f3184113ab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 --2- 172.21.15.33:0/3990423235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3184102800 0x7f3184113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 >> 172.21.15.33:0/3990423235 conn(0x7f31840f7a10 msgr2=0x7f3184065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 shutdown_connections 2024-02-15T22:47:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.705+0000 7f318a28f700 1 -- 172.21.15.33:0/3990423235 wait complete. 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 -- 172.21.15.33:0/393563724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18341038f0 msgr2=0x7f18340fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 --2- 172.21.15.33:0/393563724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18341038f0 0x7f18340fcf60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f181c004940 tx=0x7f181c009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 -- 172.21.15.33:0/393563724 shutdown_connections 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 --2- 172.21.15.33:0/393563724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18341038f0 0x7f18340fcf60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 --2- 172.21.15.33:0/393563724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1834102f50 0x7f1834103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 -- 172.21.15.33:0/393563724 >> 172.21.15.33:0/393563724 conn(0x7f18340f8ae0 msgr2=0x7f18340faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 -- 172.21.15.33:0/393563724 shutdown_connections 2024-02-15T22:47:24.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.807+0000 7f1839139700 1 -- 172.21.15.33:0/393563724 wait complete. 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1839139700 1 Processor -- start 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1839139700 1 -- start start 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1839139700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834102f50 0x7f1834113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1839139700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18341038f0 0x7f1834113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1839139700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1834114620 con 0x7f1834102f50 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1839139700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183410d950 con 0x7f18341038f0 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1832d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834102f50 0x7f1834113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1832d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834102f50 0x7f1834113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59398/0 (socket says 172.21.15.33:59398) 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1832d9d700 1 -- 172.21.15.33:0/1978356245 learned_addr learned my addr 172.21.15.33:0/1978356245 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f183259c700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18341038f0 0x7f1834113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1832d9d700 1 -- 172.21.15.33:0/1978356245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18341038f0 msgr2=0x7f1834113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1832d9d700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18341038f0 0x7f1834113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.808+0000 7f1832d9d700 1 -- 172.21.15.33:0/1978356245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c005040 con 0x7f1834102f50 2024-02-15T22:47:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.809+0000 7f1832d9d700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834102f50 0x7f1834113a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f182400cac0 tx=0x7f1824007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.809+0000 7f182b7fe700 1 -- 172.21.15.33:0/1978356245 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182400a980 con 0x7f1834102f50 2024-02-15T22:47:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.809+0000 7f182b7fe700 1 -- 172.21.15.33:0/1978356245 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1824012440 con 0x7f1834102f50 2024-02-15T22:47:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.809+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183410dc30 con 0x7f1834102f50 2024-02-15T22:47:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.809+0000 7f182b7fe700 1 -- 172.21.15.33:0/1978356245 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18240115e0 con 0x7f1834102f50 2024-02-15T22:47:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.809+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183410e140 con 0x7f1834102f50 2024-02-15T22:47:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.810+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1834105420 con 0x7f1834102f50 2024-02-15T22:47:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.810+0000 7f182b7fe700 1 -- 172.21.15.33:0/1978356245 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f18240125b0 con 0x7f1834102f50 2024-02-15T22:47:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.811+0000 7f182b7fe700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f182006d7e0 0x7f182006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.811+0000 7f182b7fe700 1 -- 172.21.15.33:0/1978356245 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f182408d4d0 con 0x7f1834102f50 2024-02-15T22:47:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.811+0000 7f183259c700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f182006d7e0 0x7f182006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.811+0000 7f183259c700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f182006d7e0 0x7f182006fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f183410ec80 tx=0x7f181c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:24.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:24.815+0000 7f182b7fe700 1 -- 172.21.15.33:0/1978356245 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f182405a970 con 0x7f1834102f50 2024-02-15T22:47:25.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:24 smithi033 podman[130343]: 2024-02-15 22:47:24.820195897 +0000 UTC m=+0.696642634 container remove ba228e3dc95bf8196e36be6f2895d2a0f3286d1df433c04a88100ae8e83e2124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:47:25.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:24 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-15T22:47:25.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:24 smithi033 systemd[1]: Stopped Ceph osd.1 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:47:25.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:24 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.1.service: Consumed 1min 2.514s CPU time. 2024-02-15T22:47:25.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.122+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f183404bed0 con 0x7f1834102f50 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.123+0000 7f182b7fe700 1 -- 172.21.15.33:0/1978356245 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f1824012860 con 0x7f1834102f50 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:47:25.127 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4, 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 8, 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:47:25.128 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:47:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.125+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f182006d7e0 msgr2=0x7f182006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.125+0000 7f1839139700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f182006d7e0 0x7f182006fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f183410ec80 tx=0x7f181c009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.125+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834102f50 msgr2=0x7f1834113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.125+0000 7f1839139700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834102f50 0x7f1834113a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f182400cac0 tx=0x7f1824007ee0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.126+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 shutdown_connections 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.126+0000 7f1839139700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f182006d7e0 0x7f182006fc90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.126+0000 7f1839139700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834102f50 0x7f1834113a90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.126+0000 7f1839139700 1 --2- 172.21.15.33:0/1978356245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18341038f0 0x7f1834113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.126+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 >> 172.21.15.33:0/1978356245 conn(0x7f18340f8ae0 msgr2=0x7f18340fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.126+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 shutdown_connections 2024-02-15T22:47:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.126+0000 7f1839139700 1 -- 172.21.15.33:0/1978356245 wait complete. 2024-02-15T22:47:25.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 -- 172.21.15.33:0/3076270939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 msgr2=0x7f882c0fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 --2- 172.21.15.33:0/3076270939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c0fbe50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8820004940 tx=0x7f8820009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 -- 172.21.15.33:0/3076270939 shutdown_connections 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 --2- 172.21.15.33:0/3076270939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c0fbe50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 --2- 172.21.15.33:0/3076270939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882c101e40 0x7f882c102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 -- 172.21.15.33:0/3076270939 >> 172.21.15.33:0/3076270939 conn(0x7f882c0f79d0 msgr2=0x7f882c0f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 -- 172.21.15.33:0/3076270939 shutdown_connections 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.242+0000 7f8833148700 1 -- 172.21.15.33:0/3076270939 wait complete. 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f8833148700 1 Processor -- start 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f8833148700 1 -- start start 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f8833148700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882c101e40 0x7f882c10eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f8833148700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c10f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f8833148700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c10f5b0 con 0x7f882c1027e0 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f8833148700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c10f720 con 0x7f882c101e40 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f882bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c10f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f882bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c10f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59406/0 (socket says 172.21.15.33:59406) 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f882bfff700 1 -- 172.21.15.33:0/2099100485 learned_addr learned my addr 172.21.15.33:0/2099100485 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.243+0000 7f8830ee4700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882c101e40 0x7f882c10eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f882bfff700 1 -- 172.21.15.33:0/2099100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882c101e40 msgr2=0x7f882c10eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f882bfff700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882c101e40 0x7f882c10eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f882bfff700 1 -- 172.21.15.33:0/2099100485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820005040 con 0x7f882c1027e0 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f882bfff700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c10f020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8820009150 tx=0x7f8820009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f88297fa700 1 -- 172.21.15.33:0/2099100485 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882000e040 con 0x7f882c1027e0 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c117a50 con 0x7f882c1027e0 2024-02-15T22:47:25.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f88297fa700 1 -- 172.21.15.33:0/2099100485 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f882000bbf0 con 0x7f882c1027e0 2024-02-15T22:47:25.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f88297fa700 1 -- 172.21.15.33:0/2099100485 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882001c3f0 con 0x7f882c1027e0 2024-02-15T22:47:25.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.244+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c117f40 con 0x7f882c1027e0 2024-02-15T22:47:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.245+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c104310 con 0x7f882c1027e0 2024-02-15T22:47:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.245+0000 7f88297fa700 1 -- 172.21.15.33:0/2099100485 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f882000bd60 con 0x7f882c1027e0 2024-02-15T22:47:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.246+0000 7f88297fa700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f881406d7e0 0x7f881406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.246+0000 7f88297fa700 1 -- 172.21.15.33:0/2099100485 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f882008e1b0 con 0x7f882c1027e0 2024-02-15T22:47:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.246+0000 7f8830ee4700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f881406d7e0 0x7f881406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.246+0000 7f8830ee4700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f881406d7e0 0x7f881406fc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f881c004f40 tx=0x7f881c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:25.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.251+0000 7f88297fa700 1 -- 172.21.15.33:0/2099100485 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8820057b20 con 0x7f882c1027e0 2024-02-15T22:47:25.411 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:25 smithi033 ceph-mon[113773]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:25.412 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:25 smithi033 ceph-mon[113773]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 48/357 objects degraded (13.445%) 2024-02-15T22:47:25.412 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:25 smithi033 ceph-mon[113773]: Health check failed: Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T22:47:25.412 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:25 smithi033 ceph-mon[113773]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:25.412 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:25 smithi033 ceph-mon[113773]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:25.412 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:25 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1978356245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:25.412 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:25 smithi033 systemd[1]: Starting Ceph osd.1 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:47:25.412 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:25 smithi033 podman[130510]: 2024-02-15 22:47:25.186830422 +0000 UTC m=+0.021044932 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:47:25.412 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:25 smithi033 podman[130510]: 2024-02-15 22:47:25.287946216 +0000 UTC m=+0.122160699 container create ce04fdcc3caa41af439f64eadd811988e25f44cf5f52d36dd7f9ab8baa23caf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-02-15T22:47:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.504+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f882c0fb5d0 con 0x7f882c1027e0 2024-02-15T22:47:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.504+0000 7f88297fa700 1 -- 172.21.15.33:0/2099100485 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f882005b1e0 con 0x7f882c1027e0 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:47:25.508 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:47:25.509 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:47:25.510 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:47:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f881406d7e0 msgr2=0x7f881406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f881406d7e0 0x7f881406fc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f881c004f40 tx=0x7f881c00b040 comp rx=0 tx=0).stop 2024-02-15T22:47:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 msgr2=0x7f882c10f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c10f020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8820009150 tx=0x7f8820009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 shutdown_connections 2024-02-15T22:47:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f881406d7e0 0x7f881406fc90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882c101e40 0x7f882c10eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 --2- 172.21.15.33:0/2099100485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c1027e0 0x7f882c10f020 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 >> 172.21.15.33:0/2099100485 conn(0x7f882c0f79d0 msgr2=0x7f882c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 shutdown_connections 2024-02-15T22:47:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.507+0000 7f8833148700 1 -- 172.21.15.33:0/2099100485 wait complete. 2024-02-15T22:47:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:47:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 -- 172.21.15.33:0/3072742909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0081027e0 msgr2=0x7fa0080fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 --2- 172.21.15.33:0/3072742909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0081027e0 0x7fa0080fbea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc004940 tx=0x7f9ffc009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 -- 172.21.15.33:0/3072742909 shutdown_connections 2024-02-15T22:47:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 --2- 172.21.15.33:0/3072742909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0081027e0 0x7fa0080fbea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 --2- 172.21.15.33:0/3072742909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa008101e40 0x7fa008102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 -- 172.21.15.33:0/3072742909 >> 172.21.15.33:0/3072742909 conn(0x7fa008071d90 msgr2=0x7fa008072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 -- 172.21.15.33:0/3072742909 shutdown_connections 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.612+0000 7fa00dafc700 1 -- 172.21.15.33:0/3072742909 wait complete. 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.613+0000 7fa00dafc700 1 Processor -- start 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.613+0000 7fa00dafc700 1 -- start start 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.613+0000 7fa00dafc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa008101e40 0x7fa008113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.613+0000 7fa00dafc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0081027e0 0x7fa008113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.613+0000 7fa00dafc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081146a0 con 0x7fa008101e40 2024-02-15T22:47:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.613+0000 7fa00dafc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00810d940 con 0x7fa0081027e0 2024-02-15T22:47:25.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.613+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa008101e40 0x7fa008113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa008101e40 0x7fa008113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59424/0 (socket says 172.21.15.33:59424) 2024-02-15T22:47:25.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa0077fe700 1 -- 172.21.15.33:0/2671076091 learned_addr learned my addr 172.21.15.33:0/2671076091 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa006ffd700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0081027e0 0x7fa008113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa0077fe700 1 -- 172.21.15.33:0/2671076091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0081027e0 msgr2=0x7fa008113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa0077fe700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0081027e0 0x7fa008113fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa0077fe700 1 -- 172.21.15.33:0/2671076091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc005040 con 0x7fa008101e40 2024-02-15T22:47:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa0077fe700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa008101e40 0x7fa008113a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800b790 tx=0x7f9ff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7f9feffff700 1 -- 172.21.15.33:0/2671076091 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff800f6f0 con 0x7fa008101e40 2024-02-15T22:47:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7f9feffff700 1 -- 172.21.15.33:0/2671076091 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ff800fd20 con 0x7fa008101e40 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00810dc20 con 0x7fa008101e40 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7f9feffff700 1 -- 172.21.15.33:0/2671076091 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff80103a0 con 0x7fa008101e40 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.614+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00810e0e0 con 0x7fa008101e40 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.616+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0080738b0 con 0x7fa008101e40 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.616+0000 7f9feffff700 1 -- 172.21.15.33:0/2671076091 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9ff800f850 con 0x7fa008101e40 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.616+0000 7f9feffff700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ff006d7f0 0x7f9ff006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.616+0000 7f9feffff700 1 -- 172.21.15.33:0/2671076091 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9ff808cbc0 con 0x7fa008101e40 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.616+0000 7fa006ffd700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ff006d7f0 0x7f9ff006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.617+0000 7fa006ffd700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ff006d7f0 0x7f9ff006fca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa00810ec70 tx=0x7f9ffc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.621+0000 7f9feffff700 1 -- 172.21.15.33:0/2671076091 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ff805a060 con 0x7fa008101e40 2024-02-15T22:47:25.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:25 smithi082 ceph-mon[84550]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:25 smithi082 ceph-mon[84550]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 48/357 objects degraded (13.445%) 2024-02-15T22:47:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:25 smithi082 ceph-mon[84550]: Health check failed: Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T22:47:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:25 smithi082 ceph-mon[84550]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:25 smithi082 ceph-mon[84550]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:25 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1978356245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:25.771 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:25 smithi033 podman[130510]: 2024-02-15 22:47:25.575479881 +0000 UTC m=+0.409694366 container init ce04fdcc3caa41af439f64eadd811988e25f44cf5f52d36dd7f9ab8baa23caf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:47:25.771 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:25 smithi033 podman[130510]: 2024-02-15 22:47:25.579820854 +0000 UTC m=+0.414035351 container start ce04fdcc3caa41af439f64eadd811988e25f44cf5f52d36dd7f9ab8baa23caf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-15T22:47:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.862+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa00810f0d0 con 0x7f9ff006d7f0 2024-02-15T22:47:25.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.863+0000 7f9feffff700 1 -- 172.21.15.33:0/2671076091 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa00810f0d0 con 0x7f9ff006d7f0 2024-02-15T22:47:25.866 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:47:25.866 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:47:25.866 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:47:25.866 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:47:25.866 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:47:25.866 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:47:25.867 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:47:25.867 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T22:47:25.867 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:47:25.867 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "7/21 daemons upgraded", 2024-02-15T22:47:25.867 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:47:25.867 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:47:25.867 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ff006d7f0 msgr2=0x7f9ff006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ff006d7f0 0x7f9ff006fca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa00810ec70 tx=0x7f9ffc009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa008101e40 msgr2=0x7fa008113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa008101e40 0x7fa008113a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800b790 tx=0x7f9ff8009250 comp rx=0 tx=0).stop 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 shutdown_connections 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9ff006d7f0 0x7f9ff006fca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa008101e40 0x7fa008113a80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 --2- 172.21.15.33:0/2671076091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0081027e0 0x7fa008113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 >> 172.21.15.33:0/2671076091 conn(0x7fa008071d90 msgr2=0x7fa008065700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:25.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 shutdown_connections 2024-02-15T22:47:25.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.866+0000 7fa00dafc700 1 -- 172.21.15.33:0/2671076091 wait complete. 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3299212793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 msgr2=0x7f7f2c102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3299212793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c102210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7f28004940 tx=0x7f7f28009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3299212793 shutdown_connections 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3299212793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c1027e0 0x7f7f2c0fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3299212793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c102210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3299212793 >> 172.21.15.33:0/3299212793 conn(0x7f7f2c071d90 msgr2=0x7f7f2c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3299212793 shutdown_connections 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.973+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3299212793 wait complete. 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f33f7c700 1 Processor -- start 2024-02-15T22:47:25.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f33f7c700 1 -- start start 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f33f7c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f33f7c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c1027e0 0x7f7f2c103660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f33f7c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c103cb0 con 0x7f7f2c101e40 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f33f7c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c103e20 con 0x7f7f2c1027e0 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f31d18700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f31d18700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c103100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59438/0 (socket says 172.21.15.33:59438) 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f31d18700 1 -- 172.21.15.33:0/3006257822 learned_addr learned my addr 172.21.15.33:0/3006257822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.974+0000 7f7f31517700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c1027e0 0x7f7f2c103660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f31d18700 1 -- 172.21.15.33:0/3006257822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c1027e0 msgr2=0x7f7f2c103660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f31d18700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c1027e0 0x7f7f2c103660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f31d18700 1 -- 172.21.15.33:0/3006257822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f28005040 con 0x7f7f2c101e40 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f31d18700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c103100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800b3b0 tx=0x7f7f28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:25.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f227fc700 1 -- 172.21.15.33:0/3006257822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f2800e040 con 0x7f7f2c101e40 2024-02-15T22:47:25.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f227fc700 1 -- 172.21.15.33:0/3006257822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f2800bbf0 con 0x7f7f2c101e40 2024-02-15T22:47:25.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c119ca0 con 0x7f7f2c101e40 2024-02-15T22:47:25.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f227fc700 1 -- 172.21.15.33:0/3006257822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f2801c3f0 con 0x7f7f2c101e40 2024-02-15T22:47:25.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.975+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c11a180 con 0x7f7f2c101e40 2024-02-15T22:47:25.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.976+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c0738b0 con 0x7f7f2c101e40 2024-02-15T22:47:25.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.977+0000 7f7f227fc700 1 -- 172.21.15.33:0/3006257822 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7f2800bd60 con 0x7f7f2c101e40 2024-02-15T22:47:25.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.977+0000 7f7f227fc700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7f1806d7e0 0x7f7f1806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:25.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.977+0000 7f7f227fc700 1 -- 172.21.15.33:0/3006257822 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f7f2808dff0 con 0x7f7f2c101e40 2024-02-15T22:47:25.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.977+0000 7f7f31517700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7f1806d7e0 0x7f7f1806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:25.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.978+0000 7f7f31517700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7f1806d7e0 0x7f7f1806fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c104b00 tx=0x7f7f1c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:25.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:25.982+0000 7f7f227fc700 1 -- 172.21.15.33:0/3006257822 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7f28057a00 con 0x7f7f2c101e40 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:25 smithi033 podman[130510]: 2024-02-15 22:47:25.846099002 +0000 UTC m=+0.680313497 container attach ce04fdcc3caa41af439f64eadd811988e25f44cf5f52d36dd7f9ab8baa23caf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate[130545]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate[130545]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 bash[130510]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 bash[130510]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 bash[130510]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 bash[130510]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:47:26.157 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 bash[130510]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 bash[130510]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 bash[130510]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate[130545]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate[130545]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate[130545]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate[130545]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate[130545]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-15T22:47:26.158 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 podman[130510]: 2024-02-15 22:47:26.076768765 +0000 UTC m=+0.910983262 container died ce04fdcc3caa41af439f64eadd811988e25f44cf5f52d36dd7f9ab8baa23caf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:47:26.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.282+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f2c1048e0 con 0x7f7f2c101e40 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.282+0000 7f7f227fc700 1 -- 172.21.15.33:0/3006257822 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1049 (secure 0 0 0) 0x7f7f2805b0c0 con 0x7f7f2c101e40 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: osd.1 (root=default,host=smithi033) is down 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 48/357 objects degraded (13.445%), 14 pgs degraded 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-02-15T22:47:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-02-15T22:47:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-02-15T22:47:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-02-15T22:47:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-02-15T22:47:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-02-15T22:47:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-02-15T22:47:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7f1806d7e0 msgr2=0x7f7f1806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7f1806d7e0 0x7f7f1806fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c104b00 tx=0x7f7f1c00b040 comp rx=0 tx=0).stop 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 msgr2=0x7f7f2c103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c103100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800b3b0 tx=0x7f7f28009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 shutdown_connections 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7f1806d7e0 0x7f7f1806fc90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2c101e40 0x7f7f2c103100 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 --2- 172.21.15.33:0/3006257822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c1027e0 0x7f7f2c103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 >> 172.21.15.33:0/3006257822 conn(0x7f7f2c071d90 msgr2=0x7f7f2c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 shutdown_connections 2024-02-15T22:47:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:26.285+0000 7f7f33f7c700 1 -- 172.21.15.33:0/3006257822 wait complete. 2024-02-15T22:47:26.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2099100485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:47:26.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:26 smithi033 ceph-mon[113773]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:26.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:26 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2099100485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:47:26.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:26 smithi082 ceph-mon[84550]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:27.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 podman[130725]: 2024-02-15 22:47:26.704075095 +0000 UTC m=+0.619038583 container remove ce04fdcc3caa41af439f64eadd811988e25f44cf5f52d36dd7f9ab8baa23caf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-activate, org.label-schema.build-date=20240214, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-15T22:47:27.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 podman[130790]: 2024-02-15 22:47:26.819200842 +0000 UTC m=+0.017606669 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:47:27.021 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:26 smithi033 podman[130790]: 2024-02-15 22:47:26.930080104 +0000 UTC m=+0.128485960 container create ac3899b733367fdb10e70546562288e960e2638010297e60320f590b8934c24d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-15T22:47:27.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:27 smithi033 ceph-mon[113773]: pgmap v69: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 48/357 objects degraded (13.445%) 2024-02-15T22:47:27.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:27 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3006257822' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:47:27.521 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:27 smithi033 podman[130790]: 2024-02-15 22:47:27.133134439 +0000 UTC m=+0.331540273 container init ac3899b733367fdb10e70546562288e960e2638010297e60320f590b8934c24d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:47:27.521 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:27 smithi033 podman[130790]: 2024-02-15 22:47:27.136329831 +0000 UTC m=+0.334735650 container start ac3899b733367fdb10e70546562288e960e2638010297e60320f590b8934c24d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-02-15T22:47:27.521 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:27 smithi033 ceph-osd[130808]: -- 172.21.15.33:0/1377456756 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f708d231e0 con 0x55f708cf4c00 2024-02-15T22:47:27.521 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:27 smithi033 bash[130790]: ac3899b733367fdb10e70546562288e960e2638010297e60320f590b8934c24d 2024-02-15T22:47:27.522 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:27 smithi033 systemd[1]: Started Ceph osd.1 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:47:27.526 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:27 smithi082 ceph-mon[84550]: pgmap v69: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 48/357 objects degraded (13.445%) 2024-02-15T22:47:27.526 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:27 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3006257822' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:47:28.020 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:27 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[130804]: 2024-02-15T22:47:27.692+0000 7f21fbeb37c0 -1 Falling back to public interface 2024-02-15T22:47:28.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:28.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:28.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:28.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:28.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:28.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:28.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:28.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:28.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:28.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:29.610 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:29 smithi033 ceph-mon[113773]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T22:47:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:29 smithi082 ceph-mon[84550]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T22:47:30.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:30 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:47:30.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:30 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:47:31.401 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:31 smithi033 ceph-mon[113773]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T22:47:31.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:31 smithi082 ceph-mon[84550]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T22:47:32.521 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:32 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[130804]: 2024-02-15T22:47:32.246+0000 7f21fbeb37c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-15T22:47:33.270 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:32 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[130804]: 2024-02-15T22:47:32.941+0000 7f21fbeb37c0 -1 osd.1 54 log_to_monitors true 2024-02-15T22:47:33.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:33 smithi033 ceph-mon[113773]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T22:47:33.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:33 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:33.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:33 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:33.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:33 smithi033 ceph-mon[113773]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:47:33.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:33 smithi082 ceph-mon[84550]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T22:47:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:33 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:33 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:33 smithi082 ceph-mon[84550]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:47:34.653 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[130804]: 2024-02-15T22:47:34.323+0000 7f21e9303700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:47:34.653 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:47:34.653 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: osdmap e57: 6 total, 5 up, 6 in 2024-02-15T22:47:34.653 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:47:34.653 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:34.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: failed to encode map e57 with expected crc 2024-02-15T22:47:34.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: failed to encode map e57 with expected crc 2024-02-15T22:47:34.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: failed to encode map e57 with expected crc 2024-02-15T22:47:34.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:34.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:34 smithi033 ceph-mon[113773]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' 2024-02-15T22:47:34.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: osdmap e57: 6 total, 5 up, 6 in 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: failed to encode map e57 with expected crc 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: failed to encode map e57 with expected crc 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: failed to encode map e57 with expected crc 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:34.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:34 smithi082 ceph-mon[84550]: from='osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508]' entity='osd.1' 2024-02-15T22:47:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:35 smithi033 ceph-mon[113773]: failed to encode map e57 with expected crc 2024-02-15T22:47:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:35 smithi033 ceph-mon[113773]: pgmap v74: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/357 objects degraded (15.406%) 2024-02-15T22:47:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:35 smithi033 ceph-mon[113773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:47:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:35 smithi033 ceph-mon[113773]: osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508] boot 2024-02-15T22:47:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:35 smithi033 ceph-mon[113773]: osdmap e58: 6 total, 6 up, 6 in 2024-02-15T22:47:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:47:35.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:35 smithi082 ceph-mon[84550]: failed to encode map e57 with expected crc 2024-02-15T22:47:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:35 smithi082 ceph-mon[84550]: pgmap v74: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/357 objects degraded (15.406%) 2024-02-15T22:47:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:35 smithi082 ceph-mon[84550]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:47:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:35 smithi082 ceph-mon[84550]: osd.1 [v2:172.21.15.33:6810/2896162508,v1:172.21.15.33:6811/2896162508] boot 2024-02-15T22:47:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:35 smithi082 ceph-mon[84550]: osdmap e58: 6 total, 6 up, 6 in 2024-02-15T22:47:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:47:36.695 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:36 smithi033 ceph-mon[113773]: failed to encode map e58 with expected crc 2024-02-15T22:47:36.695 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:36 smithi033 ceph-mon[113773]: osdmap e59: 6 total, 6 up, 6 in 2024-02-15T22:47:36.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:36 smithi082 ceph-mon[84550]: failed to encode map e58 with expected crc 2024-02-15T22:47:36.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:36 smithi082 ceph-mon[84550]: osdmap e59: 6 total, 6 up, 6 in 2024-02-15T22:47:37.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: pgmap v76: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 55/357 objects degraded (15.406%) 2024-02-15T22:47:37.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:37.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:37 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: pgmap v76: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 55/357 objects degraded (15.406%) 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: failed to encode map e59 with expected crc 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:37.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:37 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:38.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:38 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:38.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:38 smithi033 ceph-mon[113773]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T22:47:38.781 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:38 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:38.781 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:38 smithi082 ceph-mon[84550]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T22:47:39.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:39 smithi033 ceph-mon[113773]: pgmap v78: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-02-15T22:47:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:39 smithi082 ceph-mon[84550]: pgmap v78: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-02-15T22:47:40.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:40 smithi082 ceph-mon[84550]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded) 2024-02-15T22:47:40.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:40 smithi082 ceph-mon[84550]: Cluster is now healthy 2024-02-15T22:47:41.020 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:40 smithi033 ceph-mon[113773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded) 2024-02-15T22:47:41.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:40 smithi033 ceph-mon[113773]: Cluster is now healthy 2024-02-15T22:47:41.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:41 smithi082 ceph-mon[84550]: pgmap v79: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 3 op/s 2024-02-15T22:47:42.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:41 smithi033 ceph-mon[113773]: pgmap v79: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 3 op/s 2024-02-15T22:47:43.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:43 smithi082 ceph-mon[84550]: pgmap v80: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-02-15T22:47:43.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:43.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:43 smithi033 ceph-mon[113773]: pgmap v80: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-02-15T22:47:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:45.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:45 smithi082 ceph-mon[84550]: pgmap v81: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-02-15T22:47:45.957 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:45 smithi033 ceph-mon[113773]: pgmap v81: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-02-15T22:47:47.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:47 smithi082 ceph-mon[84550]: pgmap v82: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-02-15T22:47:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:47 smithi033 ceph-mon[113773]: pgmap v82: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-02-15T22:47:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:49 smithi033 ceph-mon[113773]: pgmap v83: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-15T22:47:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:49.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:49 smithi082 ceph-mon[84550]: pgmap v83: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-15T22:47:49.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:51.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:51 smithi033 ceph-mon[113773]: pgmap v84: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-02-15T22:47:51.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:51 smithi082 ceph-mon[84550]: pgmap v84: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-02-15T22:47:53.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:53 smithi033 ceph-mon[113773]: pgmap v85: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:53.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:53.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:53 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:53.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:53 smithi033 ceph-mon[113773]: Upgrade: osd.2 is safe to restart 2024-02-15T22:47:53.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:53 smithi082 ceph-mon[84550]: pgmap v85: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:53.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:53.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:53 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:47:53.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:53 smithi082 ceph-mon[84550]: Upgrade: osd.2 is safe to restart 2024-02-15T22:47:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:55 smithi033 ceph-mon[113773]: pgmap v86: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:47:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:55 smithi033 ceph-mon[113773]: Upgrade: Updating osd.2 2024-02-15T22:47:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:47:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:55 smithi033 ceph-mon[113773]: Deploying daemon osd.2 on smithi033 2024-02-15T22:47:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:55 smithi082 ceph-mon[84550]: pgmap v86: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:47:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:55 smithi082 ceph-mon[84550]: Upgrade: Updating osd.2 2024-02-15T22:47:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:47:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:47:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:55 smithi082 ceph-mon[84550]: Deploying daemon osd.2 on smithi033 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 -- 172.21.15.33:0/2804376065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fbdd0 msgr2=0x7fadf80fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 --2- 172.21.15.33:0/2804376065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fbdd0 0x7fadf80fc1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fade8004940 tx=0x7fade8009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 -- 172.21.15.33:0/2804376065 shutdown_connections 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 --2- 172.21.15.33:0/2804376065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf80fc6e0 0x7fadf8109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 --2- 172.21.15.33:0/2804376065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fbdd0 0x7fadf80fc1a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 -- 172.21.15.33:0/2804376065 >> 172.21.15.33:0/2804376065 conn(0x7fadf8071d90 msgr2=0x7fadf8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 -- 172.21.15.33:0/2804376065 shutdown_connections 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.392+0000 7fadfcbec700 1 -- 172.21.15.33:0/2804376065 wait complete. 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadfcbec700 1 Processor -- start 2024-02-15T22:47:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadfcbec700 1 -- start start 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadfcbec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf80fbdd0 0x7fadf8115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadfcbec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fc6e0 0x7fadf8116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadfcbec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf8116860 con 0x7fadf80fc6e0 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadfcbec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf810fb70 con 0x7fadf80fbdd0 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadeffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fc6e0 0x7fadf8116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadeffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fc6e0 0x7fadf8116210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34900/0 (socket says 172.21.15.33:34900) 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadeffff700 1 -- 172.21.15.33:0/3471906639 learned_addr learned my addr 172.21.15.33:0/3471906639 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadf659c700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf80fbdd0 0x7fadf8115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadeffff700 1 -- 172.21.15.33:0/3471906639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf80fbdd0 msgr2=0x7fadf8115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadeffff700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf80fbdd0 0x7fadf8115cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.393+0000 7fadeffff700 1 -- 172.21.15.33:0/3471906639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8005040 con 0x7fadf80fc6e0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.394+0000 7fadeffff700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fc6e0 0x7fadf8116210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fade000c8c0 tx=0x7fade00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.394+0000 7fadeeffd700 1 -- 172.21.15.33:0/3471906639 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade000a980 con 0x7fadf80fc6e0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.394+0000 7fadeeffd700 1 -- 172.21.15.33:0/3471906639 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fade000ce60 con 0x7fadf80fc6e0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.394+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf810fe50 con 0x7fadf80fc6e0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.394+0000 7fadeeffd700 1 -- 172.21.15.33:0/3471906639 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade00115e0 con 0x7fadf80fc6e0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.394+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf8110390 con 0x7fadf80fc6e0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.395+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf8106b70 con 0x7fadf80fc6e0 2024-02-15T22:47:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.395+0000 7fadeeffd700 1 -- 172.21.15.33:0/3471906639 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fade0012400 con 0x7fadf80fc6e0 2024-02-15T22:47:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.396+0000 7fadeeffd700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fade406d7e0 0x7fade406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.396+0000 7fadeeffd700 1 -- 172.21.15.33:0/3471906639 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fade008ced0 con 0x7fadf80fc6e0 2024-02-15T22:47:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.396+0000 7fadf659c700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fade406d7e0 0x7fade406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.396+0000 7fadf659c700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fade406d7e0 0x7fade406fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fade800b3b0 tx=0x7fade8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:56.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.400+0000 7fadeeffd700 1 -- 172.21.15.33:0/3471906639 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fade005a350 con 0x7fadf80fc6e0 2024-02-15T22:47:56.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.625+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadf804bed0 con 0x7fade406d7e0 2024-02-15T22:47:56.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.626+0000 7fadeeffd700 1 -- 172.21.15.33:0/3471906639 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fadf804bed0 con 0x7fade406d7e0 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fade406d7e0 msgr2=0x7fade406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fade406d7e0 0x7fade406fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fade800b3b0 tx=0x7fade8009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fc6e0 msgr2=0x7fadf8116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fc6e0 0x7fadf8116210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fade000c8c0 tx=0x7fade00044c0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 shutdown_connections 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fade406d7e0 0x7fade406fc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf80fbdd0 0x7fadf8115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 --2- 172.21.15.33:0/3471906639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadf80fc6e0 0x7fadf8116210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 >> 172.21.15.33:0/3471906639 conn(0x7fadf8071d90 msgr2=0x7fadf80faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:56.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 shutdown_connections 2024-02-15T22:47:56.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.628+0000 7fadfcbec700 1 -- 172.21.15.33:0/3471906639 wait complete. 2024-02-15T22:47:56.641 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:47:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.734+0000 7f3a0593b700 1 -- 172.21.15.33:0/1989910975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00102800 msgr2=0x7f3a000fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.734+0000 7f3a0593b700 1 --2- 172.21.15.33:0/1989910975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00102800 0x7f3a000fbe70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39f0004940 tx=0x7f39f0009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 -- 172.21.15.33:0/1989910975 shutdown_connections 2024-02-15T22:47:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 --2- 172.21.15.33:0/1989910975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00102800 0x7f3a000fbe70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 --2- 172.21.15.33:0/1989910975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00101e60 0x7f3a00102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 -- 172.21.15.33:0/1989910975 >> 172.21.15.33:0/1989910975 conn(0x7f3a000f7a10 msgr2=0x7f3a000f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 -- 172.21.15.33:0/1989910975 shutdown_connections 2024-02-15T22:47:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 -- 172.21.15.33:0/1989910975 wait complete. 2024-02-15T22:47:56.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 Processor -- start 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.735+0000 7f3a0593b700 1 -- start start 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f3a0593b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00101e60 0x7f3a0010eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f3a0593b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00102800 0x7f3a0010f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f3a0593b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0010f5d0 con 0x7f3a00101e60 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f3a0593b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0010f740 con 0x7f3a00102800 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39feffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00101e60 0x7f3a0010eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39feffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00101e60 0x7f3a0010eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51874/0 (socket says 172.21.15.33:51874) 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39feffd700 1 -- 172.21.15.33:0/3492412080 learned_addr learned my addr 172.21.15.33:0/3492412080 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39fe7fc700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00102800 0x7f3a0010f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39feffd700 1 -- 172.21.15.33:0/3492412080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00102800 msgr2=0x7f3a0010f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39feffd700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00102800 0x7f3a0010f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39feffd700 1 -- 172.21.15.33:0/3492412080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f0005040 con 0x7f3a00101e60 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.736+0000 7f39feffd700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00101e60 0x7f3a0010eb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39f400c830 tx=0x7f39f4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.737+0000 7f39e77fe700 1 -- 172.21.15.33:0/3492412080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f40106f0 con 0x7f3a00101e60 2024-02-15T22:47:56.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.737+0000 7f39e77fe700 1 -- 172.21.15.33:0/3492412080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39f4010d20 con 0x7f3a00101e60 2024-02-15T22:47:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.737+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a00117ad0 con 0x7f3a00101e60 2024-02-15T22:47:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.737+0000 7f39e77fe700 1 -- 172.21.15.33:0/3492412080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f40113a0 con 0x7f3a00101e60 2024-02-15T22:47:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.737+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a00117f90 con 0x7f3a00101e60 2024-02-15T22:47:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.738+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a00104330 con 0x7f3a00101e60 2024-02-15T22:47:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.738+0000 7f39e77fe700 1 -- 172.21.15.33:0/3492412080 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f39f4012400 con 0x7f3a00101e60 2024-02-15T22:47:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.739+0000 7f39e77fe700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f39e806d7e0 0x7f39e806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.739+0000 7f39fe7fc700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f39e806d7e0 0x7f39e806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.739+0000 7f39e77fe700 1 -- 172.21.15.33:0/3492412080 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f39f408cd50 con 0x7f3a00101e60 2024-02-15T22:47:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.739+0000 7f39fe7fc700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f39e806d7e0 0x7f39e806fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39f0004890 tx=0x7f39f0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.743+0000 7f39e77fe700 1 -- 172.21.15.33:0/3492412080 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f39f40566a0 con 0x7f3a00101e60 2024-02-15T22:47:56.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.972+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a000667b0 con 0x7f39e806d7e0 2024-02-15T22:47:56.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.974+0000 7f39e77fe700 1 -- 172.21.15.33:0/3492412080 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3a000667b0 con 0x7f39e806d7e0 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f39e806d7e0 msgr2=0x7f39e806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f39e806d7e0 0x7f39e806fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39f0004890 tx=0x7f39f0009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00101e60 msgr2=0x7f3a0010eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00101e60 0x7f3a0010eb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39f400c830 tx=0x7f39f4004470 comp rx=0 tx=0).stop 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 shutdown_connections 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f39e806d7e0 0x7f39e806fc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a00101e60 0x7f3a0010eb00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 --2- 172.21.15.33:0/3492412080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00102800 0x7f3a0010f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 >> 172.21.15.33:0/3492412080 conn(0x7f3a000f7a10 msgr2=0x7f3a000f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 shutdown_connections 2024-02-15T22:47:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:56.976+0000 7f3a0593b700 1 -- 172.21.15.33:0/3492412080 wait complete. 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3054383902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a881038e0 msgr2=0x7f1a880fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3054383902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a881038e0 0x7f1a880fcf50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c004940 tx=0x7f1a7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3054383902 shutdown_connections 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3054383902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a881038e0 0x7f1a880fcf50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3054383902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a88102f40 0x7f1a88103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3054383902 >> 172.21.15.33:0/3054383902 conn(0x7f1a880f8af0 msgr2=0x7f1a880faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3054383902 shutdown_connections 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3054383902 wait complete. 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 Processor -- start 2024-02-15T22:47:57.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.079+0000 7f1a8e36e700 1 -- start start 2024-02-15T22:47:57.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a8e36e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88102f40 0x7f1a88070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a8e36e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a881038e0 0x7f1a880707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a8e36e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88070dd0 con 0x7f1a88102f40 2024-02-15T22:47:57.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a8e36e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88070f40 con 0x7f1a881038e0 2024-02-15T22:47:57.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a87fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88102f40 0x7f1a88070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a87fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88102f40 0x7f1a88070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51888/0 (socket says 172.21.15.33:51888) 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a87fff700 1 -- 172.21.15.33:0/3960820694 learned_addr learned my addr 172.21.15.33:0/3960820694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a877fe700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a881038e0 0x7f1a880707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a87fff700 1 -- 172.21.15.33:0/3960820694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a881038e0 msgr2=0x7f1a880707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a87fff700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a881038e0 0x7f1a880707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a87fff700 1 -- 172.21.15.33:0/3960820694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c005040 con 0x7f1a88102f40 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a877fe700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a881038e0 0x7f1a880707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a87fff700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88102f40 0x7f1a88070290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c830 tx=0x7f1a78004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a84ff9700 1 -- 172.21.15.33:0/3960820694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7800a760 con 0x7f1a88102f40 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a84ff9700 1 -- 172.21.15.33:0/3960820694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a7800ad90 con 0x7f1a88102f40 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.080+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a88119d20 con 0x7f1a88102f40 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.081+0000 7f1a84ff9700 1 -- 172.21.15.33:0/3960820694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a780113a0 con 0x7f1a88102f40 2024-02-15T22:47:57.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.081+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8811a200 con 0x7f1a88102f40 2024-02-15T22:47:57.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.082+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a88105410 con 0x7f1a88102f40 2024-02-15T22:47:57.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.082+0000 7f1a84ff9700 1 -- 172.21.15.33:0/3960820694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1a78012400 con 0x7f1a88102f40 2024-02-15T22:47:57.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.082+0000 7f1a84ff9700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a7006d7f0 0x7f1a7006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.083+0000 7f1a84ff9700 1 -- 172.21.15.33:0/3960820694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f1a7808cdb0 con 0x7f1a88102f40 2024-02-15T22:47:57.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.083+0000 7f1a877fe700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a7006d7f0 0x7f1a7006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.083+0000 7f1a877fe700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a7006d7f0 0x7f1a7006fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00b3b0 tx=0x7f1a7c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.087+0000 7f1a84ff9700 1 -- 172.21.15.33:0/3960820694 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1a780567c0 con 0x7f1a88102f40 2024-02-15T22:47:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:57 smithi033 ceph-mon[113773]: pgmap v87: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:57 smithi033 ceph-mon[113773]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:57 smithi033 ceph-mon[113773]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.301+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a880719d0 con 0x7f1a7006d7f0 2024-02-15T22:47:57.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.311+0000 7f1a84ff9700 1 -- 172.21.15.33:0/3960820694 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1a880719d0 con 0x7f1a7006d7f0 2024-02-15T22:47:57.313 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:47:57.313 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (4m) 24s ago 15m 27.7M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (92s) 24s ago 15m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (87s) 84s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (3m) 24s ago 14m 81.2M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (9m) 24s ago 9m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (9m) 24s ago 9m 75.2M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (9m) 84s ago 9m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (9m) 84s ago 9m 67.9M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (5m) 24s ago 16m 499M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (5m) 84s ago 14m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (2m) 24s ago 16m 46.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (2m) 84s ago 13m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (4m) 24s ago 15m 16.5M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (4m) 84s ago 14m 16.3M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:47:57.314 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (66s) 24s ago 13m 86.9M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:47:57.315 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (30s) 24s ago 12m 11.6M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:47:57.315 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (12m) 24s ago 12m 197M 1559M 17.2.7-509-g9aa52330 61c0ec9cd187 ecaf20a5356c 2024-02-15T22:47:57.315 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (11m) 84s ago 11m 264M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:47:57.315 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (11m) 84s ago 11m 232M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:47:57.315 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (11m) 84s ago 11m 225M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:47:57.315 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 24s ago 14m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.313+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a7006d7f0 msgr2=0x7f1a7006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.313+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a7006d7f0 0x7f1a7006fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00b3b0 tx=0x7f1a7c009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.313+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88102f40 msgr2=0x7f1a88070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.313+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88102f40 0x7f1a88070290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c830 tx=0x7f1a78004470 comp rx=0 tx=0).stop 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.314+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 shutdown_connections 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.314+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1a7006d7f0 0x7f1a7006fca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.314+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a88102f40 0x7f1a88070290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.314+0000 7f1a8e36e700 1 --2- 172.21.15.33:0/3960820694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a881038e0 0x7f1a880707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.314+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 >> 172.21.15.33:0/3960820694 conn(0x7f1a880f8af0 msgr2=0x7f1a880fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.314+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 shutdown_connections 2024-02-15T22:47:57.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.314+0000 7f1a8e36e700 1 -- 172.21.15.33:0/3960820694 wait complete. 2024-02-15T22:47:57.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.415+0000 7f07f6c67700 1 -- 172.21.15.33:0/3944235132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f0102f50 msgr2=0x7f07f0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.415+0000 7f07f6c67700 1 --2- 172.21.15.33:0/3944235132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f0102f50 0x7f07f0103320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07e4004940 tx=0x7f07e4009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 -- 172.21.15.33:0/3944235132 shutdown_connections 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 --2- 172.21.15.33:0/3944235132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f01038f0 0x7f07f00fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 --2- 172.21.15.33:0/3944235132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f0102f50 0x7f07f0103320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 -- 172.21.15.33:0/3944235132 >> 172.21.15.33:0/3944235132 conn(0x7f07f00f8ae0 msgr2=0x7f07f00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 -- 172.21.15.33:0/3944235132 shutdown_connections 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 -- 172.21.15.33:0/3944235132 wait complete. 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 Processor -- start 2024-02-15T22:47:57.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.416+0000 7f07f6c67700 1 -- start start 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07f6c67700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f0102f50 0x7f07f0070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07f6c67700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f01038f0 0x7f07f00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07f6c67700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0070dd0 con 0x7f07f01038f0 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07f6c67700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0070f40 con 0x7f07f0102f50 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07effff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f01038f0 0x7f07f00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07effff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f01038f0 0x7f07f00707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51904/0 (socket says 172.21.15.33:51904) 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07effff700 1 -- 172.21.15.33:0/1370404360 learned_addr learned my addr 172.21.15.33:0/1370404360 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07effff700 1 -- 172.21.15.33:0/1370404360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f0102f50 msgr2=0x7f07f0070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07f4a03700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f0102f50 0x7f07f0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07effff700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f0102f50 0x7f07f0070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07effff700 1 -- 172.21.15.33:0/1370404360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4005040 con 0x7f07f01038f0 2024-02-15T22:47:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07effff700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f01038f0 0x7f07f00707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f07dc002a50 tx=0x7f07dc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07ed7fa700 1 -- 172.21.15.33:0/1370404360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07dc007cc0 con 0x7f07f01038f0 2024-02-15T22:47:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0119ca0 con 0x7f07f01038f0 2024-02-15T22:47:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07ed7fa700 1 -- 172.21.15.33:0/1370404360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07dc00f040 con 0x7f07f01038f0 2024-02-15T22:47:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07ed7fa700 1 -- 172.21.15.33:0/1370404360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07dc00da40 con 0x7f07f01038f0 2024-02-15T22:47:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.417+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f011a180 con 0x7f07f01038f0 2024-02-15T22:47:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.419+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f0100260 con 0x7f07f01038f0 2024-02-15T22:47:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.419+0000 7f07ed7fa700 1 -- 172.21.15.33:0/1370404360 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f07dc00dcb0 con 0x7f07f01038f0 2024-02-15T22:47:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.419+0000 7f07ed7fa700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f07e006d7e0 0x7f07e006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.419+0000 7f07f4a03700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f07e006d7e0 0x7f07e006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.419+0000 7f07ed7fa700 1 -- 172.21.15.33:0/1370404360 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f07dc08cc50 con 0x7f07f01038f0 2024-02-15T22:47:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.420+0000 7f07f4a03700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f07e006d7e0 0x7f07e006fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07e4004560 tx=0x7f07e4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.424+0000 7f07ed7fa700 1 -- 172.21.15.33:0/1370404360 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f07dc05a070 con 0x7f07f01038f0 2024-02-15T22:47:57.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:57 smithi082 ceph-mon[84550]: pgmap v87: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:57 smithi082 ceph-mon[84550]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:57 smithi082 ceph-mon[84550]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.719+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f07f004bf00 con 0x7f07f01038f0 2024-02-15T22:47:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.719+0000 7f07ed7fa700 1 -- 172.21.15.33:0/1370404360 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f07dc059c00 con 0x7f07f01038f0 2024-02-15T22:47:57.721 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:47:57.721 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:47:57.721 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:47:57.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:57.721 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:47:57.721 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4, 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 8, 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:47:57.722 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f07e006d7e0 msgr2=0x7f07e006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f07e006d7e0 0x7f07e006fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07e4004560 tx=0x7f07e4009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f01038f0 msgr2=0x7f07f00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f01038f0 0x7f07f00707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f07dc002a50 tx=0x7f07dc004600 comp rx=0 tx=0).stop 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 shutdown_connections 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f07e006d7e0 0x7f07e006fc90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f0102f50 0x7f07f0070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 --2- 172.21.15.33:0/1370404360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f01038f0 0x7f07f00707d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 >> 172.21.15.33:0/1370404360 conn(0x7f07f00f8ae0 msgr2=0x7f07f00fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:57.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 shutdown_connections 2024-02-15T22:47:57.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.722+0000 7f07f6c67700 1 -- 172.21.15.33:0/1370404360 wait complete. 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.851+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/2096365860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fe8f0 msgr2=0x7fbb28107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.851+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/2096365860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fe8f0 0x7fbb28107050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbb18004970 tx=0x7fbb18009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/2096365860 shutdown_connections 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/2096365860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fe8f0 0x7fbb28107050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/2096365860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb280fdfe0 0x7fbb280fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/2096365860 >> 172.21.15.33:0/2096365860 conn(0x7fbb28071d90 msgr2=0x7fbb28072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/2096365860 shutdown_connections 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/2096365860 wait complete. 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 Processor -- start 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 -- start start 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fdfe0 0x7fbb281139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb280fe8f0 0x7fbb28113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28114580 con 0x7fbb280fdfe0 2024-02-15T22:47:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2ffe3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2810d8b0 con 0x7fbb280fe8f0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.852+0000 7fbb2dd7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fdfe0 0x7fbb281139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2dd7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fdfe0 0x7fbb281139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51914/0 (socket says 172.21.15.33:51914) 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2dd7f700 1 -- 172.21.15.33:0/3329321189 learned_addr learned my addr 172.21.15.33:0/3329321189 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2dd7f700 1 -- 172.21.15.33:0/3329321189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb280fe8f0 msgr2=0x7fbb28113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2dd7f700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb280fe8f0 0x7fbb28113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2dd7f700 1 -- 172.21.15.33:0/3329321189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18005040 con 0x7fbb280fdfe0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2dd7f700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fdfe0 0x7fbb281139f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb24002a50 tx=0x7fbb240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb1e7fc700 1 -- 172.21.15.33:0/3329321189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb24007cc0 con 0x7fbb280fdfe0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb1e7fc700 1 -- 172.21.15.33:0/3329321189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb2400f040 con 0x7fbb280fdfe0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2810db90 con 0x7fbb280fdfe0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb1e7fc700 1 -- 172.21.15.33:0/3329321189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb24009640 con 0x7fbb280fdfe0 2024-02-15T22:47:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.853+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2810e0d0 con 0x7fbb280fdfe0 2024-02-15T22:47:57.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.854+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb281046c0 con 0x7fbb280fdfe0 2024-02-15T22:47:57.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.855+0000 7fbb1e7fc700 1 -- 172.21.15.33:0/3329321189 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbb240097c0 con 0x7fbb280fdfe0 2024-02-15T22:47:57.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.855+0000 7fbb1e7fc700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbb1406d7f0 0x7fbb1406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.855+0000 7fbb1e7fc700 1 -- 172.21.15.33:0/3329321189 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fbb2408cbb0 con 0x7fbb280fdfe0 2024-02-15T22:47:57.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.855+0000 7fbb2d57e700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbb1406d7f0 0x7fbb1406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.856+0000 7fbb2d57e700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbb1406d7f0 0x7fbb1406fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800b370 tx=0x7fbb18009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:57.860+0000 7fbb1e7fc700 1 -- 172.21.15.33:0/3329321189 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbb24093080 con 0x7fbb280fdfe0 2024-02-15T22:47:58.021 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:47:57 smithi033 systemd[1]: Stopping Ceph osd.2 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:47:58.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.144+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbb2810a030 con 0x7fbb280fdfe0 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.145+0000 7fbb1e7fc700 1 -- 172.21.15.33:0/3329321189 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7fbb24059fd0 con 0x7fbb280fdfe0 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:47:58.147 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:47:58.148 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:47:58.149 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:47:58.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbb1406d7f0 msgr2=0x7fbb1406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbb1406d7f0 0x7fbb1406fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800b370 tx=0x7fbb18009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fdfe0 msgr2=0x7fbb281139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fdfe0 0x7fbb281139f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb24002a50 tx=0x7fbb240046b0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 shutdown_connections 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbb1406d7f0 0x7fbb1406fca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb280fdfe0 0x7fbb281139f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 --2- 172.21.15.33:0/3329321189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb280fe8f0 0x7fbb28113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 >> 172.21.15.33:0/3329321189 conn(0x7fbb28071d90 msgr2=0x7fbb28101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 shutdown_connections 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.147+0000 7fbb2ffe3700 1 -- 172.21.15.33:0/3329321189 wait complete. 2024-02-15T22:47:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 -- 172.21.15.33:0/849300160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fe960 msgr2=0x7f4dfc106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/849300160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fe960 0x7f4dfc106fa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004940 tx=0x7f4de8009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 -- 172.21.15.33:0/849300160 shutdown_connections 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/849300160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fe960 0x7f4dfc106fa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/849300160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dfc0fdfc0 0x7f4dfc0fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 -- 172.21.15.33:0/849300160 >> 172.21.15.33:0/849300160 conn(0x7f4dfc0f7a10 msgr2=0x7f4dfc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 -- 172.21.15.33:0/849300160 shutdown_connections 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 -- 172.21.15.33:0/849300160 wait complete. 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 Processor -- start 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.258+0000 7f4e02a8a700 1 -- start start 2024-02-15T22:47:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e02a8a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fdfc0 0x7f4dfc113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e02a8a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dfc0fe960 0x7f4dfc114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e02a8a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc114670 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e02a8a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc10d9a0 con 0x7f4dfc0fe960 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e00826700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fdfc0 0x7f4dfc113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e00826700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fdfc0 0x7f4dfc113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51938/0 (socket says 172.21.15.33:51938) 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e00826700 1 -- 172.21.15.33:0/2703825070 learned_addr learned my addr 172.21.15.33:0/2703825070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4dfbfff700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dfc0fe960 0x7f4dfc114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e00826700 1 -- 172.21.15.33:0/2703825070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dfc0fe960 msgr2=0x7f4dfc114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e00826700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dfc0fe960 0x7f4dfc114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e00826700 1 -- 172.21.15.33:0/2703825070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8005040 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4dfbfff700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dfc0fe960 0x7f4dfc114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:47:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.259+0000 7f4e00826700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fdfc0 0x7f4dfc113ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4df0002a50 tx=0x7f4df00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.260+0000 7f4df97fa700 1 -- 172.21.15.33:0/2703825070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df0007cc0 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.260+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc10dc80 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.260+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc10e1c0 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.260+0000 7f4df97fa700 1 -- 172.21.15.33:0/2703825070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4df000f040 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.260+0000 7f4df97fa700 1 -- 172.21.15.33:0/2703825070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df0009640 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.261+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc1045b0 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.261+0000 7f4df97fa700 1 -- 172.21.15.33:0/2703825070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4df00097a0 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.261+0000 7f4df97fa700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4dec06d7e0 0x7f4dec06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.262+0000 7f4df97fa700 1 -- 172.21.15.33:0/2703825070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f4df008cb50 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.262+0000 7f4dfbfff700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4dec06d7e0 0x7f4dec06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.262+0000 7f4dfbfff700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4dec06d7e0 0x7f4dec06fc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004560 tx=0x7f4de8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.266+0000 7f4df97fa700 1 -- 172.21.15.33:0/2703825070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4df0059ff0 con 0x7f4dfc0fdfc0 2024-02-15T22:47:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.495+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dfc04bed0 con 0x7f4dec06d7e0 2024-02-15T22:47:58.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:58 smithi033 ceph-mon[113773]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:58.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:58 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1370404360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:58.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:58.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:58 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3329321189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:47:58.498 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:47:58 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[62848]: 2024-02-15T22:47:58.229+0000 7f0a033f4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:47:58.498 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:47:58 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[62848]: 2024-02-15T22:47:58.229+0000 7f0a033f4700 -1 osd.2 59 *** Got signal Terminated *** 2024-02-15T22:47:58.498 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:47:58 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[62848]: 2024-02-15T22:47:58.229+0000 7f0a033f4700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:47:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.497+0000 7f4df97fa700 1 -- 172.21.15.33:0/2703825070 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4dfc04bed0 con 0x7f4dec06d7e0 2024-02-15T22:47:58.498 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "8/21 daemons upgraded", 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:47:58.499 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:47:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4dec06d7e0 msgr2=0x7f4dec06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4dec06d7e0 0x7f4dec06fc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004560 tx=0x7f4de8009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fdfc0 msgr2=0x7f4dfc113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fdfc0 0x7f4dfc113ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4df0002a50 tx=0x7f4df00046b0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 shutdown_connections 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4dec06d7e0 0x7f4dec06fc90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dfc0fdfc0 0x7f4dfc113ae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 --2- 172.21.15.33:0/2703825070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dfc0fe960 0x7f4dfc114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.499+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 >> 172.21.15.33:0/2703825070 conn(0x7f4dfc0f7a10 msgr2=0x7f4dfc101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.500+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 shutdown_connections 2024-02-15T22:47:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.500+0000 7f4e02a8a700 1 -- 172.21.15.33:0/2703825070 wait complete. 2024-02-15T22:47:58.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.604+0000 7f402dab1700 1 -- 172.21.15.33:0/1893805574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4028102f40 msgr2=0x7f4028103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.604+0000 7f402dab1700 1 --2- 172.21.15.33:0/1893805574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4028102f40 0x7f4028103310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4018004940 tx=0x7f4018009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.604+0000 7f402dab1700 1 -- 172.21.15.33:0/1893805574 shutdown_connections 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.604+0000 7f402dab1700 1 --2- 172.21.15.33:0/1893805574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40281038e0 0x7f40280fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.604+0000 7f402dab1700 1 --2- 172.21.15.33:0/1893805574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4028102f40 0x7f4028103310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.604+0000 7f402dab1700 1 -- 172.21.15.33:0/1893805574 >> 172.21.15.33:0/1893805574 conn(0x7f40280f8af0 msgr2=0x7f40280faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.605+0000 7f402dab1700 1 -- 172.21.15.33:0/1893805574 shutdown_connections 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.605+0000 7f402dab1700 1 -- 172.21.15.33:0/1893805574 wait complete. 2024-02-15T22:47:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.605+0000 7f402dab1700 1 Processor -- start 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.605+0000 7f402dab1700 1 -- start start 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.605+0000 7f402dab1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4028102f40 0x7f4028070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.605+0000 7f402dab1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40281038e0 0x7f40280707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f402dab1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028070dd0 con 0x7f40281038e0 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f402dab1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028070f40 con 0x7f4028102f40 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40281038e0 0x7f40280707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40281038e0 0x7f40280707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51950/0 (socket says 172.21.15.33:51950) 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f4026ffd700 1 -- 172.21.15.33:0/1134032504 learned_addr learned my addr 172.21.15.33:0/1134032504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f40277fe700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4028102f40 0x7f4028070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f4026ffd700 1 -- 172.21.15.33:0/1134032504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4028102f40 msgr2=0x7f4028070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f4026ffd700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4028102f40 0x7f4028070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f4026ffd700 1 -- 172.21.15.33:0/1134032504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018005040 con 0x7f40281038e0 2024-02-15T22:47:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f4026ffd700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40281038e0 0x7f40280707d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f401c002a50 tx=0x7f401c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f400ffff700 1 -- 172.21.15.33:0/1134032504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401c007cc0 con 0x7f40281038e0 2024-02-15T22:47:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f400ffff700 1 -- 172.21.15.33:0/1134032504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f401c00f040 con 0x7f40281038e0 2024-02-15T22:47:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.606+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4028119c80 con 0x7f40281038e0 2024-02-15T22:47:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.607+0000 7f400ffff700 1 -- 172.21.15.33:0/1134032504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401c00d9c0 con 0x7f40281038e0 2024-02-15T22:47:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.607+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402811a160 con 0x7f40281038e0 2024-02-15T22:47:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.608+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40280fc6f0 con 0x7f40281038e0 2024-02-15T22:47:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.608+0000 7f400ffff700 1 -- 172.21.15.33:0/1134032504 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f401c009730 con 0x7f40281038e0 2024-02-15T22:47:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.608+0000 7f400ffff700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f401006d7e0 0x7f401006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.609+0000 7f400ffff700 1 -- 172.21.15.33:0/1134032504 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f401c08cb80 con 0x7f40281038e0 2024-02-15T22:47:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.609+0000 7f40277fe700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f401006d7e0 0x7f401006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.609+0000 7f40277fe700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f401006d7e0 0x7f401006fc90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4018004f90 tx=0x7f4018009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:58.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.613+0000 7f400ffff700 1 -- 172.21.15.33:0/1134032504 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f401c056470 con 0x7f40281038e0 2024-02-15T22:47:58.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:58 smithi082 ceph-mon[84550]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:58.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:58 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1370404360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:47:58.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:58.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:58 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3329321189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:47:58.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.904+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4028071a70 con 0x7f40281038e0 2024-02-15T22:47:58.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.904+0000 7f400ffff700 1 -- 172.21.15.33:0/1134032504 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f401c059b30 con 0x7f40281038e0 2024-02-15T22:47:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f401006d7e0 msgr2=0x7f401006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f401006d7e0 0x7f401006fc90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4018004f90 tx=0x7f4018009e30 comp rx=0 tx=0).stop 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40281038e0 msgr2=0x7f40280707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40281038e0 0x7f40280707d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f401c002a50 tx=0x7f401c004600 comp rx=0 tx=0).stop 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 shutdown_connections 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f401006d7e0 0x7f401006fc90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4028102f40 0x7f4028070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 --2- 172.21.15.33:0/1134032504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40281038e0 0x7f40280707d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 >> 172.21.15.33:0/1134032504 conn(0x7f40280f8af0 msgr2=0x7f40280fa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 shutdown_connections 2024-02-15T22:47:58.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:47:58.906+0000 7f402dab1700 1 -- 172.21.15.33:0/1134032504 wait complete. 2024-02-15T22:47:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:59 smithi033 ceph-mon[113773]: pgmap v88: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:59 smithi033 ceph-mon[113773]: osd.2 marked itself down and dead 2024-02-15T22:47:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:59 smithi033 ceph-mon[113773]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:47:59 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1134032504' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:47:59.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:59 smithi082 ceph-mon[84550]: pgmap v88: 65 pgs: 65 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:47:59.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:59 smithi082 ceph-mon[84550]: osd.2 marked itself down and dead 2024-02-15T22:47:59.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:59 smithi082 ceph-mon[84550]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:47:59.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:47:59 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1134032504' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:47:59.948 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:47:59 smithi033 podman[135981]: 2024-02-15 22:47:59.663851551 +0000 UTC m=+1.552227651 container died ecaf20a5356c81febcf7a7d2b1ef181a1977f44f91b807b2555cfec8b476518e (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=quincy-9aa5233, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-15T22:48:00.227 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 podman[135981]: 2024-02-15 22:48:00.029974 +0000 UTC m=+1.918350099 container cleanup ecaf20a5356c81febcf7a7d2b1ef181a1977f44f91b807b2555cfec8b476518e (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, RELEASE=quincy-9aa5233, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:48:00.227 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 bash[135981]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2 2024-02-15T22:48:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:00 smithi033 ceph-mon[113773]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:48:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:00 smithi033 ceph-mon[113773]: osdmap e60: 6 total, 5 up, 6 in 2024-02-15T22:48:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:00 smithi033 ceph-mon[113773]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:00 smithi033 ceph-mon[113773]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:00 smithi033 ceph-mon[113773]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:00 smithi033 ceph-mon[113773]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.521 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 podman[136058]: 2024-02-15 22:48:00.314907254 +0000 UTC m=+0.650419474 container remove ecaf20a5356c81febcf7a7d2b1ef181a1977f44f91b807b2555cfec8b476518e (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, RELEASE=quincy-9aa5233, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD) 2024-02-15T22:48:00.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:00 smithi082 ceph-mon[84550]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:48:00.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:00 smithi082 ceph-mon[84550]: osdmap e60: 6 total, 5 up, 6 in 2024-02-15T22:48:00.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:00 smithi082 ceph-mon[84550]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:00 smithi082 ceph-mon[84550]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:00 smithi082 ceph-mon[84550]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:00 smithi082 ceph-mon[84550]: failed to encode map e60 with expected crc 2024-02-15T22:48:00.969 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 podman[136151]: 2024-02-15 22:48:00.558569202 +0000 UTC m=+0.018246557 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:48:00.970 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 podman[136151]: 2024-02-15 22:48:00.665883572 +0000 UTC m=+0.125560917 container create 0e674404afbc8dea28868d1646fef1b8dede77f0500ac59fe8ee5171ab08dabd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214) 2024-02-15T22:48:00.970 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 podman[136151]: 2024-02-15 22:48:00.876529569 +0000 UTC m=+0.336206911 container init 0e674404afbc8dea28868d1646fef1b8dede77f0500ac59fe8ee5171ab08dabd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-15T22:48:00.970 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 podman[136151]: 2024-02-15 22:48:00.879555652 +0000 UTC m=+0.339232995 container start 0e674404afbc8dea28868d1646fef1b8dede77f0500ac59fe8ee5171ab08dabd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-02-15T22:48:01.236 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:00 smithi033 podman[136151]: 2024-02-15 22:48:00.968242217 +0000 UTC m=+0.427919580 container attach 0e674404afbc8dea28868d1646fef1b8dede77f0500ac59fe8ee5171ab08dabd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:48:01.236 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:01 smithi033 podman[136151]: 2024-02-15 22:48:01.17976212 +0000 UTC m=+0.639439463 container died 0e674404afbc8dea28868d1646fef1b8dede77f0500ac59fe8ee5171ab08dabd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: osdmap e61: 6 total, 5 up, 6 in 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:01 smithi033 ceph-mon[113773]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: osdmap e61: 6 total, 5 up, 6 in 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: failed to encode map e61 with expected crc 2024-02-15T22:48:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:01 smithi082 ceph-mon[84550]: failed to encode map e61 with expected crc 2024-02-15T22:48:02.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:01 smithi033 podman[136177]: 2024-02-15 22:48:01.839099164 +0000 UTC m=+0.654176809 container remove 0e674404afbc8dea28868d1646fef1b8dede77f0500ac59fe8ee5171ab08dabd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:48:02.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:01 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-15T22:48:02.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:01 smithi033 systemd[1]: Stopped Ceph osd.2 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:48:02.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:01 smithi033 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.2.service: Consumed 51.420s CPU time. 2024-02-15T22:48:02.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:02 smithi033 systemd[1]: Starting Ceph osd.2 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:48:02.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:02 smithi033 ceph-mon[113773]: Health check failed: Degraded data redundancy: 13/357 objects degraded (3.641%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:02.586 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:02 smithi033 podman[136280]: 2024-02-15 22:48:02.199349991 +0000 UTC m=+0.018545923 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:48:02.586 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:02 smithi033 podman[136280]: 2024-02-15 22:48:02.332063184 +0000 UTC m=+0.151259109 container create 1712d339408d39dfd661b521ae3b5eb85ed3c4a2c6f2a215faa123e1c6db0cca (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-15T22:48:02.586 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:02 smithi033 podman[136280]: 2024-02-15 22:48:02.584822688 +0000 UTC m=+0.404018623 container init 1712d339408d39dfd661b521ae3b5eb85ed3c4a2c6f2a215faa123e1c6db0cca (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:48:02.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:02 smithi082 ceph-mon[84550]: Health check failed: Degraded data redundancy: 13/357 objects degraded (3.641%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:03.021 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:02 smithi033 podman[136280]: 2024-02-15 22:48:02.588452735 +0000 UTC m=+0.407648660 container start 1712d339408d39dfd661b521ae3b5eb85ed3c4a2c6f2a215faa123e1c6db0cca (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-15T22:48:03.022 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:02 smithi033 podman[136280]: 2024-02-15 22:48:02.659627344 +0000 UTC m=+0.478823285 container attach 1712d339408d39dfd661b521ae3b5eb85ed3c4a2c6f2a215faa123e1c6db0cca (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:48:03.365 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-mon[113773]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 13/357 objects degraded (3.641%) 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate[136295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate[136295]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 bash[136280]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 bash[136280]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 bash[136280]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 bash[136280]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 bash[136280]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 bash[136280]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:48:03.365 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 bash[136280]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-15T22:48:03.366 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate[136295]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T22:48:03.366 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate[136295]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T22:48:03.366 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate[136295]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-15T22:48:03.366 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate[136295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:48:03.366 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate[136295]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-15T22:48:03.366 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 podman[136280]: 2024-02-15 22:48:03.064269862 +0000 UTC m=+0.883465780 container died 1712d339408d39dfd661b521ae3b5eb85ed3c4a2c6f2a215faa123e1c6db0cca (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.build-date=20240214) 2024-02-15T22:48:03.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:03 smithi082 ceph-mon[84550]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 13/357 objects degraded (3.641%) 2024-02-15T22:48:03.994 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 podman[136429]: 2024-02-15 22:48:03.655562006 +0000 UTC m=+0.586305460 container remove 1712d339408d39dfd661b521ae3b5eb85ed3c4a2c6f2a215faa123e1c6db0cca (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-activate, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-15T22:48:03.994 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 podman[136493]: 2024-02-15 22:48:03.864731984 +0000 UTC m=+0.113523483 container create dfdcfe354b41caaaeff2f130c4ea7f49651e600d2198a2179922f6d6886ece01 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux ) 2024-02-15T22:48:03.994 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:03 smithi033 podman[136493]: 2024-02-15 22:48:03.770416855 +0000 UTC m=+0.019208364 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:48:04.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:04 smithi033 podman[136493]: 2024-02-15 22:48:04.083611928 +0000 UTC m=+0.332403428 container init dfdcfe354b41caaaeff2f130c4ea7f49651e600d2198a2179922f6d6886ece01 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=) 2024-02-15T22:48:04.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:04 smithi033 podman[136493]: 2024-02-15 22:48:04.08681259 +0000 UTC m=+0.335604091 container start dfdcfe354b41caaaeff2f130c4ea7f49651e600d2198a2179922f6d6886ece01 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-15T22:48:04.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:04 smithi033 ceph-osd[136512]: -- 172.21.15.33:0/2252387833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ec80d5d1e0 con 0x55ec80d2ec00 2024-02-15T22:48:04.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:04 smithi033 bash[136493]: dfdcfe354b41caaaeff2f130c4ea7f49651e600d2198a2179922f6d6886ece01 2024-02-15T22:48:04.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:04 smithi033 systemd[1]: Started Ceph osd.2 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:48:05.021 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:04 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[136508]: 2024-02-15T22:48:04.628+0000 7fa1091417c0 -1 Falling back to public interface 2024-02-15T22:48:05.363 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:05 smithi033 ceph-mon[113773]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:05.363 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:05.363 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:05.363 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:05 smithi082 ceph-mon[84550]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:07 smithi033 ceph-mon[113773]: pgmap v94: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:07.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:07 smithi082 ceph-mon[84550]: pgmap v94: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:08.899 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:08 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[136508]: 2024-02-15T22:48:08.552+0000 7fa1091417c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-15T22:48:09.149 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:08 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[136508]: 2024-02-15T22:48:08.994+0000 7fa1091417c0 -1 osd.2 59 log_to_monitors true 2024-02-15T22:48:09.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:09 smithi033 ceph-mon[113773]: pgmap v95: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:09.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:09 smithi033 ceph-mon[113773]: from='osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:48:09.521 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:48:09 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[136508]: 2024-02-15T22:48:09.250+0000 7fa0fa599700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:48:09.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:09 smithi082 ceph-mon[84550]: pgmap v95: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:09 smithi082 ceph-mon[84550]: from='osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: from='osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: osdmap e62: 6 total, 5 up, 6 in 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: from='osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: failed to encode map e62 with expected crc 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: failed to encode map e62 with expected crc 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: failed to encode map e62 with expected crc 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:10.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:10 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: from='osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: osdmap e62: 6 total, 5 up, 6 in 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: from='osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: failed to encode map e62 with expected crc 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: failed to encode map e62 with expected crc 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: failed to encode map e62 with expected crc 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:10.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:10 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:11.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: pgmap v97: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:11.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:48:11.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: failed to encode map e63 with expected crc 2024-02-15T22:48:11.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433] boot 2024-02-15T22:48:11.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: osdmap e63: 6 total, 6 up, 6 in 2024-02-15T22:48:11.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:48:11.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: failed to encode map e63 with expected crc 2024-02-15T22:48:11.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: failed to encode map e63 with expected crc 2024-02-15T22:48:11.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:11.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:11.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: pgmap v97: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: failed to encode map e63 with expected crc 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: osd.2 [v2:172.21.15.33:6818/4236771433,v1:172.21.15.33:6819/4236771433] boot 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: osdmap e63: 6 total, 6 up, 6 in 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: failed to encode map e63 with expected crc 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: failed to encode map e63 with expected crc 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:12.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:12 smithi033 ceph-mon[113773]: failed to encode map e64 with expected crc 2024-02-15T22:48:12.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:12 smithi033 ceph-mon[113773]: osdmap e64: 6 total, 6 up, 6 in 2024-02-15T22:48:12.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:12 smithi033 ceph-mon[113773]: failed to encode map e64 with expected crc 2024-02-15T22:48:12.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:12 smithi033 ceph-mon[113773]: failed to encode map e64 with expected crc 2024-02-15T22:48:12.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:12 smithi033 ceph-mon[113773]: failed to encode map e64 with expected crc 2024-02-15T22:48:12.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:12 smithi082 ceph-mon[84550]: failed to encode map e64 with expected crc 2024-02-15T22:48:12.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:12 smithi082 ceph-mon[84550]: osdmap e64: 6 total, 6 up, 6 in 2024-02-15T22:48:12.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:12 smithi082 ceph-mon[84550]: failed to encode map e64 with expected crc 2024-02-15T22:48:12.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:12 smithi082 ceph-mon[84550]: failed to encode map e64 with expected crc 2024-02-15T22:48:12.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:12 smithi082 ceph-mon[84550]: failed to encode map e64 with expected crc 2024-02-15T22:48:13.465 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:13 smithi033 ceph-mon[113773]: pgmap v100: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 35/357 objects degraded (9.804%) 2024-02-15T22:48:13.466 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:13.466 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:13.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:13 smithi082 ceph-mon[84550]: pgmap v100: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 35/357 objects degraded (9.804%) 2024-02-15T22:48:13.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:13.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:15.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: pgmap v101: 65 pgs: 5 active+undersized+degraded, 4 active+undersized, 56 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 4 op/s; 16/357 objects degraded (4.482%) 2024-02-15T22:48:15.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:15.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:15.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:15.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-15T22:48:15.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:15 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 16/357 objects degraded (4.482%), 5 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: pgmap v101: 65 pgs: 5 active+undersized+degraded, 4 active+undersized, 56 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 4 op/s; 16/357 objects degraded (4.482%) 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:15.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:15.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-15T22:48:15.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:15 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 16/357 objects degraded (4.482%), 5 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:16 smithi033 ceph-mon[113773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/357 objects degraded (4.482%), 5 pgs degraded) 2024-02-15T22:48:16.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:16 smithi033 ceph-mon[113773]: Cluster is now healthy 2024-02-15T22:48:16.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:16 smithi082 ceph-mon[84550]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/357 objects degraded (4.482%), 5 pgs degraded) 2024-02-15T22:48:16.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:16 smithi082 ceph-mon[84550]: Cluster is now healthy 2024-02-15T22:48:17.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:17 smithi033 ceph-mon[113773]: pgmap v102: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-02-15T22:48:17.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:17 smithi082 ceph-mon[84550]: pgmap v102: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-02-15T22:48:19.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:19 smithi033 ceph-mon[113773]: pgmap v103: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-02-15T22:48:19.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:19 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:19.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:19 smithi082 ceph-mon[84550]: pgmap v103: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-02-15T22:48:19.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:19 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:21.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:21 smithi033 ceph-mon[113773]: pgmap v104: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:21.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:21 smithi082 ceph-mon[84550]: pgmap v104: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:23.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:23 smithi033 ceph-mon[113773]: pgmap v105: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-15T22:48:23.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:23 smithi082 ceph-mon[84550]: pgmap v105: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-15T22:48:25.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:25 smithi033 ceph-mon[113773]: pgmap v106: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T22:48:25.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:25 smithi082 ceph-mon[84550]: pgmap v106: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T22:48:27.427 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:27 smithi082 ceph-mon[84550]: pgmap v107: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:27.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:27 smithi033 ceph-mon[113773]: pgmap v107: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 -- 172.21.15.33:0/297259988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede8103140 msgr2=0x7fede8103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 --2- 172.21.15.33:0/297259988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede8103140 0x7fede8103510 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fede4004940 tx=0x7fede4009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 -- 172.21.15.33:0/297259988 shutdown_connections 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 --2- 172.21.15.33:0/297259988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fede80fb570 0x7fede80fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 --2- 172.21.15.33:0/297259988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede8103140 0x7fede8103510 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 -- 172.21.15.33:0/297259988 >> 172.21.15.33:0/297259988 conn(0x7fede8071560 msgr2=0x7fede8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 -- 172.21.15.33:0/297259988 shutdown_connections 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 -- 172.21.15.33:0/297259988 wait complete. 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 Processor -- start 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.024+0000 7fedef988700 1 -- start start 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedef988700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80fb570 0x7fede80fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedef988700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fede8103140 0x7fede80fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedef988700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede80fd290 con 0x7fede80fb570 2024-02-15T22:48:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedef988700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede80fd400 con 0x7fede8103140 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7feded724700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80fb570 0x7fede80fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7feded724700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80fb570 0x7fede80fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43110/0 (socket says 172.21.15.33:43110) 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7feded724700 1 -- 172.21.15.33:0/3215257766 learned_addr learned my addr 172.21.15.33:0/3215257766 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedecf23700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fede8103140 0x7fede80fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7feded724700 1 -- 172.21.15.33:0/3215257766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fede8103140 msgr2=0x7fede80fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7feded724700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fede8103140 0x7fede80fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7feded724700 1 -- 172.21.15.33:0/3215257766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4005040 con 0x7fede80fb570 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedecf23700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fede8103140 0x7fede80fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7feded724700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80fb570 0x7fede80fc750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fede4009fd0 tx=0x7fede4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedddffb700 1 -- 172.21.15.33:0/3215257766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede400e040 con 0x7fede80fb570 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedddffb700 1 -- 172.21.15.33:0/3215257766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fede400bbf0 con 0x7fede80fb570 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede8119d50 con 0x7fede80fb570 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.025+0000 7fedddffb700 1 -- 172.21.15.33:0/3215257766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede401c3f0 con 0x7fede80fb570 2024-02-15T22:48:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.026+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede811a1b0 con 0x7fede80fb570 2024-02-15T22:48:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.027+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede8100310 con 0x7fede80fb570 2024-02-15T22:48:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.027+0000 7fedddffb700 1 -- 172.21.15.33:0/3215257766 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fede400bd60 con 0x7fede80fb570 2024-02-15T22:48:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.028+0000 7fedddffb700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fedd406d7f0 0x7fedd406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.028+0000 7fedddffb700 1 -- 172.21.15.33:0/3215257766 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fede408e040 con 0x7fede80fb570 2024-02-15T22:48:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.028+0000 7fedecf23700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fedd406d7f0 0x7fedd406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.028+0000 7fedecf23700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fedd406d7f0 0x7fedd406fca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009fd0 tx=0x7fedd8009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.033+0000 7fedddffb700 1 -- 172.21.15.33:0/3215257766 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fede4057a50 con 0x7fede80fb570 2024-02-15T22:48:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.258+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fede804bed0 con 0x7fedd406d7f0 2024-02-15T22:48:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.259+0000 7fedddffb700 1 -- 172.21.15.33:0/3215257766 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fede804bed0 con 0x7fedd406d7f0 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fedd406d7f0 msgr2=0x7fedd406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fedd406d7f0 0x7fedd406fca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009fd0 tx=0x7fedd8009ee0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80fb570 msgr2=0x7fede80fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80fb570 0x7fede80fc750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fede4009fd0 tx=0x7fede4009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 shutdown_connections 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fedd406d7f0 0x7fedd406fca0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80fb570 0x7fede80fc750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 --2- 172.21.15.33:0/3215257766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fede8103140 0x7fede80fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 >> 172.21.15.33:0/3215257766 conn(0x7fede8071560 msgr2=0x7fede80fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:29.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 shutdown_connections 2024-02-15T22:48:29.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.261+0000 7fedef988700 1 -- 172.21.15.33:0/3215257766 wait complete. 2024-02-15T22:48:29.273 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:48:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 -- 172.21.15.33:0/1563370276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a0101e50 msgr2=0x7f40a0102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 --2- 172.21.15.33:0/1563370276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a0101e50 0x7f40a0102220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4090004940 tx=0x7f4090009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 -- 172.21.15.33:0/1563370276 shutdown_connections 2024-02-15T22:48:29.368 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:29 smithi033 ceph-mon[113773]: pgmap v108: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:29.368 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:29.368 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 --2- 172.21.15.33:0/1563370276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a01027f0 0x7f40a00fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 --2- 172.21.15.33:0/1563370276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a0101e50 0x7f40a0102220 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 -- 172.21.15.33:0/1563370276 >> 172.21.15.33:0/1563370276 conn(0x7f40a00f79e0 msgr2=0x7f40a00f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 -- 172.21.15.33:0/1563370276 shutdown_connections 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.365+0000 7f40a6718700 1 -- 172.21.15.33:0/1563370276 wait complete. 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f40a6718700 1 Processor -- start 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f40a6718700 1 -- start start 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f40a6718700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101e50 0x7f40a0115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f40a6718700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a01027f0 0x7f40a0116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f40a6718700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a01167b0 con 0x7f40a01027f0 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f40a6718700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a010fb50 con 0x7f40a0101e50 2024-02-15T22:48:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f409f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a01027f0 0x7f40a0116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f409f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a01027f0 0x7f40a0116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43126/0 (socket says 172.21.15.33:43126) 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f409f7fe700 1 -- 172.21.15.33:0/855812636 learned_addr learned my addr 172.21.15.33:0/855812636 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.366+0000 7f409ffff700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101e50 0x7f40a0115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f409f7fe700 1 -- 172.21.15.33:0/855812636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101e50 msgr2=0x7f40a0115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f409f7fe700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101e50 0x7f40a0115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f409f7fe700 1 -- 172.21.15.33:0/855812636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090005040 con 0x7f40a01027f0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f409f7fe700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a01027f0 0x7f40a0116160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4094002a50 tx=0x7f4094004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f409cff9700 1 -- 172.21.15.33:0/855812636 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4094007cc0 con 0x7f40a01027f0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f409cff9700 1 -- 172.21.15.33:0/855812636 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f409400f040 con 0x7f40a01027f0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a010fe30 con 0x7f40a01027f0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.367+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a0110370 con 0x7f40a01027f0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.368+0000 7f409cff9700 1 -- 172.21.15.33:0/855812636 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409400d9c0 con 0x7f40a01027f0 2024-02-15T22:48:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.368+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a0064b00 con 0x7f40a01027f0 2024-02-15T22:48:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.369+0000 7f409cff9700 1 -- 172.21.15.33:0/855812636 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4094009730 con 0x7f40a01027f0 2024-02-15T22:48:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.369+0000 7f409cff9700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f408806d7f0 0x7f408806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.369+0000 7f409cff9700 1 -- 172.21.15.33:0/855812636 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f409408cba0 con 0x7f40a01027f0 2024-02-15T22:48:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.369+0000 7f409ffff700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f408806d7f0 0x7f408806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.370+0000 7f409ffff700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f408806d7f0 0x7f408806fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f409000b3b0 tx=0x7f4090009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.374+0000 7f409cff9700 1 -- 172.21.15.33:0/855812636 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4094059fc0 con 0x7f40a01027f0 2024-02-15T22:48:29.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.596+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a004bed0 con 0x7f408806d7f0 2024-02-15T22:48:29.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.597+0000 7f409cff9700 1 -- 172.21.15.33:0/855812636 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f40a004bed0 con 0x7f408806d7f0 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f408806d7f0 msgr2=0x7f408806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f408806d7f0 0x7f408806fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f409000b3b0 tx=0x7f4090009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a01027f0 msgr2=0x7f40a0116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a01027f0 0x7f40a0116160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4094002a50 tx=0x7f4094004600 comp rx=0 tx=0).stop 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 shutdown_connections 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f408806d7f0 0x7f408806fca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101e50 0x7f40a0115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 --2- 172.21.15.33:0/855812636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a01027f0 0x7f40a0116160 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 >> 172.21.15.33:0/855812636 conn(0x7f40a00f79e0 msgr2=0x7f40a0065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 shutdown_connections 2024-02-15T22:48:29.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.599+0000 7f40a6718700 1 -- 172.21.15.33:0/855812636 wait complete. 2024-02-15T22:48:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:29 smithi082 ceph-mon[84550]: pgmap v108: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:29.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 -- 172.21.15.33:0/2347403517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 msgr2=0x7ff3280fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 --2- 172.21.15.33:0/2347403517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff3280fbe70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff324004940 tx=0x7ff324009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 -- 172.21.15.33:0/2347403517 shutdown_connections 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 --2- 172.21.15.33:0/2347403517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff3280fbe70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 --2- 172.21.15.33:0/2347403517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff328101e60 0x7ff328102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 -- 172.21.15.33:0/2347403517 >> 172.21.15.33:0/2347403517 conn(0x7ff3280f7a10 msgr2=0x7ff3280f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 -- 172.21.15.33:0/2347403517 shutdown_connections 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.702+0000 7ff32f390700 1 -- 172.21.15.33:0/2347403517 wait complete. 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32f390700 1 Processor -- start 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32f390700 1 -- start start 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32f390700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff328101e60 0x7ff328113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32f390700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff328113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32f390700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3281145c0 con 0x7ff328102800 2024-02-15T22:48:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32f390700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32810d8f0 con 0x7ff328101e60 2024-02-15T22:48:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32c92b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff328113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32c92b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff328113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43148/0 (socket says 172.21.15.33:43148) 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32c92b700 1 -- 172.21.15.33:0/538819166 learned_addr learned my addr 172.21.15.33:0/538819166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.703+0000 7ff32d12c700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff328101e60 0x7ff328113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff32c92b700 1 -- 172.21.15.33:0/538819166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff328101e60 msgr2=0x7ff328113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff32c92b700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff328101e60 0x7ff328113a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff32c92b700 1 -- 172.21.15.33:0/538819166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324005040 con 0x7ff328102800 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff32c92b700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff328113f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff324000c00 tx=0x7ff324009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff31dffb700 1 -- 172.21.15.33:0/538819166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff324021070 con 0x7ff328102800 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff31dffb700 1 -- 172.21.15.33:0/538819166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff324013d00 con 0x7ff328102800 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32810db70 con 0x7ff328102800 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff31dffb700 1 -- 172.21.15.33:0/538819166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32400e070 con 0x7ff328102800 2024-02-15T22:48:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.704+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32810e050 con 0x7ff328102800 2024-02-15T22:48:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.705+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3280fb610 con 0x7ff328102800 2024-02-15T22:48:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.706+0000 7ff31dffb700 1 -- 172.21.15.33:0/538819166 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff32401c400 con 0x7ff328102800 2024-02-15T22:48:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.706+0000 7ff31dffb700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff31406d7f0 0x7ff31406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.706+0000 7ff31dffb700 1 -- 172.21.15.33:0/538819166 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6242+0+0 (secure 0 0 0) 0x7ff32408e2d0 con 0x7ff328102800 2024-02-15T22:48:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.706+0000 7ff32d12c700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff31406d7f0 0x7ff31406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.707+0000 7ff32d12c700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff31406d7f0 0x7ff31406fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff318009b80 tx=0x7ff31800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.711+0000 7ff31dffb700 1 -- 172.21.15.33:0/538819166 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff32405b770 con 0x7ff328102800 2024-02-15T22:48:29.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.924+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff32804bf40 con 0x7ff31406d7f0 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.934+0000 7ff31dffb700 1 -- 172.21.15.33:0/538819166 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff32804bf40 con 0x7ff31406d7f0 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (4m) 20s ago 15m 26.3M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (2m) 20s ago 15m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (2m) 116s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (4m) 20s ago 15m 87.4M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (10m) 20s ago 10m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (9m) 20s ago 9m 75.3M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:48:29.937 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (10m) 116s ago 10m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (9m) 116s ago 9m 67.9M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (6m) 20s ago 17m 500M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (5m) 116s ago 14m 448M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (3m) 20s ago 17m 48.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (2m) 116s ago 14m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (5m) 20s ago 15m 16.4M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (5m) 116s ago 14m 16.3M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (99s) 20s ago 13m 87.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (63s) 20s ago 13m 97.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (26s) 20s ago 12m 12.6M 1559M 19.0.0-1450-gf78a58c0 f081f847070a dfdcfe354b41 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (12m) 116s ago 12m 264M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 10441bef47c3 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (12m) 116s ago 11m 232M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (11m) 116s ago 11m 225M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:48:29.938 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 20s ago 15m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:48:29.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff31406d7f0 msgr2=0x7ff31406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff31406d7f0 0x7ff31406fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff318009b80 tx=0x7ff31800b040 comp rx=0 tx=0).stop 2024-02-15T22:48:29.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 msgr2=0x7ff328113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:29.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff328113f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff324000c00 tx=0x7ff324009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 shutdown_connections 2024-02-15T22:48:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff31406d7f0 0x7ff31406fca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff328101e60 0x7ff328113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 --2- 172.21.15.33:0/538819166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff328102800 0x7ff328113f70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 >> 172.21.15.33:0/538819166 conn(0x7ff3280f7a10 msgr2=0x7ff3281000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 shutdown_connections 2024-02-15T22:48:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:29.936+0000 7ff32f390700 1 -- 172.21.15.33:0/538819166 wait complete. 2024-02-15T22:48:30.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 -- 172.21.15.33:0/396103288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f50102f50 msgr2=0x7f3f50103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 --2- 172.21.15.33:0/396103288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f50102f50 0x7f3f50103320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009ce0 tx=0x7f3f48004d10 comp rx=0 tx=0).stop 2024-02-15T22:48:30.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 -- 172.21.15.33:0/396103288 shutdown_connections 2024-02-15T22:48:30.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 --2- 172.21.15.33:0/396103288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f501038f0 0x7f3f500fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 --2- 172.21.15.33:0/396103288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f50102f50 0x7f3f50103320 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 -- 172.21.15.33:0/396103288 >> 172.21.15.33:0/396103288 conn(0x7f3f500f8ae0 msgr2=0x7f3f500faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:30.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 -- 172.21.15.33:0/396103288 shutdown_connections 2024-02-15T22:48:30.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.038+0000 7f3f58497700 1 -- 172.21.15.33:0/396103288 wait complete. 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f58497700 1 Processor -- start 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f58497700 1 -- start start 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f58497700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f50102f50 0x7f3f50113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f58497700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f501038f0 0x7f3f50114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f58497700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501146c0 con 0x7f3f501038f0 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f58497700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5010d9f0 con 0x7f3f50102f50 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f55a32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f501038f0 0x7f3f50114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f55a32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f501038f0 0x7f3f50114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43162/0 (socket says 172.21.15.33:43162) 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.039+0000 7f3f55a32700 1 -- 172.21.15.33:0/2138246936 learned_addr learned my addr 172.21.15.33:0/2138246936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f56233700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f50102f50 0x7f3f50113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f55a32700 1 -- 172.21.15.33:0/2138246936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f50102f50 msgr2=0x7f3f50113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f55a32700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f50102f50 0x7f3f50113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f55a32700 1 -- 172.21.15.33:0/2138246936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48009940 con 0x7f3f501038f0 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f56233700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f50102f50 0x7f3f50113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f55a32700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f501038f0 0x7f3f50114070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f44002a50 tx=0x7f3f440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f4effd700 1 -- 172.21.15.33:0/2138246936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f44007cc0 con 0x7f3f501038f0 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f4effd700 1 -- 172.21.15.33:0/2138246936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f4400f040 con 0x7f3f501038f0 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5010dcd0 con 0x7f3f501038f0 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f4effd700 1 -- 172.21.15.33:0/2138246936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f44009630 con 0x7f3f501038f0 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.040+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5010e210 con 0x7f3f501038f0 2024-02-15T22:48:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.041+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500fc6e0 con 0x7f3f501038f0 2024-02-15T22:48:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.041+0000 7f3f4effd700 1 -- 172.21.15.33:0/2138246936 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3f44009790 con 0x7f3f501038f0 2024-02-15T22:48:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.042+0000 7f3f4effd700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3f3806d7e0 0x7f3f3806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.042+0000 7f3f4effd700 1 -- 172.21.15.33:0/2138246936 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f3f4408cc10 con 0x7f3f501038f0 2024-02-15T22:48:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.042+0000 7f3f56233700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3f3806d7e0 0x7f3f3806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.042+0000 7f3f56233700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3f3806d7e0 0x7f3f3806fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800b740 tx=0x7f3f48004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.047+0000 7f3f4effd700 1 -- 172.21.15.33:0/2138246936 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3f4405a0e0 con 0x7f3f501038f0 2024-02-15T22:48:30.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:30 smithi082 ceph-mon[84550]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:30.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:30 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:30.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:30 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:30.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:30 smithi082 ceph-mon[84550]: Upgrade: osd.3 is safe to restart 2024-02-15T22:48:30.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:30 smithi082 ceph-mon[84550]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:30.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:30 smithi082 ceph-mon[84550]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.337+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3f5004bed0 con 0x7f3f501038f0 2024-02-15T22:48:30.341 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:30 smithi033 ceph-mon[113773]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:30.341 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:30 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:30.341 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:30 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:48:30.341 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:30 smithi033 ceph-mon[113773]: Upgrade: osd.3 is safe to restart 2024-02-15T22:48:30.341 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:30 smithi033 ceph-mon[113773]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:30.341 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:30 smithi033 ceph-mon[113773]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:30.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.338+0000 7f3f4effd700 1 -- 172.21.15.33:0/2138246936 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f3f44059c70 con 0x7f3f501038f0 2024-02-15T22:48:30.341 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:48:30.341 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 3, 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 3 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:48:30.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 7, 2024-02-15T22:48:30.343 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 7 2024-02-15T22:48:30.343 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:48:30.343 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:48:30.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3f3806d7e0 msgr2=0x7f3f3806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3f3806d7e0 0x7f3f3806fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800b740 tx=0x7f3f48004d10 comp rx=0 tx=0).stop 2024-02-15T22:48:30.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f501038f0 msgr2=0x7f3f50114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f501038f0 0x7f3f50114070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f44002a50 tx=0x7f3f440046b0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 shutdown_connections 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3f3806d7e0 0x7f3f3806fc90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f50102f50 0x7f3f50113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 --2- 172.21.15.33:0/2138246936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f501038f0 0x7f3f50114070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 >> 172.21.15.33:0/2138246936 conn(0x7f3f500f8ae0 msgr2=0x7f3f500fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 shutdown_connections 2024-02-15T22:48:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.340+0000 7f3f58497700 1 -- 172.21.15.33:0/2138246936 wait complete. 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 -- 172.21.15.33:0/2605788209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 msgr2=0x7f11f8103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 --2- 172.21.15.33:0/2605788209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8103310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009ce0 tx=0x7f11f0004d10 comp rx=0 tx=0).stop 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 -- 172.21.15.33:0/2605788209 shutdown_connections 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 --2- 172.21.15.33:0/2605788209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11f81038e0 0x7f11f80fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 --2- 172.21.15.33:0/2605788209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8103310 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 -- 172.21.15.33:0/2605788209 >> 172.21.15.33:0/2605788209 conn(0x7f11f80f8af0 msgr2=0x7f11f80faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 -- 172.21.15.33:0/2605788209 shutdown_connections 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 -- 172.21.15.33:0/2605788209 wait complete. 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 Processor -- start 2024-02-15T22:48:30.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.443+0000 7f11ff10d700 1 -- start start 2024-02-15T22:48:30.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11ff10d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11ff10d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11f81038e0 0x7f11f80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11ff10d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8070e40 con 0x7f11f8102f40 2024-02-15T22:48:30.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11ff10d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8070fb0 con 0x7f11f81038e0 2024-02-15T22:48:30.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11fcea9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11fcea9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43188/0 (socket says 172.21.15.33:43188) 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11fcea9700 1 -- 172.21.15.33:0/4127044906 learned_addr learned my addr 172.21.15.33:0/4127044906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11f7fff700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11f81038e0 0x7f11f80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11fcea9700 1 -- 172.21.15.33:0/4127044906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11f81038e0 msgr2=0x7f11f80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11fcea9700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11f81038e0 0x7f11f80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11fcea9700 1 -- 172.21.15.33:0/4127044906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0009940 con 0x7f11f8102f40 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11fcea9700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8070290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f11f000ba50 tx=0x7f11f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11f57fa700 1 -- 172.21.15.33:0/4127044906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f000e040 con 0x7f11f8102f40 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.444+0000 7f11f57fa700 1 -- 172.21.15.33:0/4127044906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11f0004610 con 0x7f11f8102f40 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.445+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f8119d60 con 0x7f11f8102f40 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.445+0000 7f11f57fa700 1 -- 172.21.15.33:0/4127044906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f0012b40 con 0x7f11f8102f40 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.445+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f811a240 con 0x7f11f8102f40 2024-02-15T22:48:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.445+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f8100250 con 0x7f11f8102f40 2024-02-15T22:48:30.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.446+0000 7f11f57fa700 1 -- 172.21.15.33:0/4127044906 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f11f001c830 con 0x7f11f8102f40 2024-02-15T22:48:30.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.446+0000 7f11f57fa700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f11e406d7f0 0x7f11e406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.447+0000 7f11f57fa700 1 -- 172.21.15.33:0/4127044906 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f11f008f0f0 con 0x7f11f8102f40 2024-02-15T22:48:30.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.447+0000 7f11f7fff700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f11e406d7f0 0x7f11e406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.447+0000 7f11f7fff700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f11e406d7f0 0x7f11e406fca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11e8004600 tx=0x7f11e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.451+0000 7f11f57fa700 1 -- 172.21.15.33:0/4127044906 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f11f0058940 con 0x7f11f8102f40 2024-02-15T22:48:30.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.700+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11f80719d0 con 0x7f11f8102f40 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.700+0000 7f11f57fa700 1 -- 172.21.15.33:0/4127044906 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f11f005c000 con 0x7f11f8102f40 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:48:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:48:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:30.706 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:48:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:48:30.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f11e406d7f0 msgr2=0x7f11e406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f11e406d7f0 0x7f11e406fca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11e8004600 tx=0x7f11e800b040 comp rx=0 tx=0).stop 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 msgr2=0x7f11f8070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8070290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f11f000ba50 tx=0x7f11f0004d10 comp rx=0 tx=0).stop 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 shutdown_connections 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f11e406d7f0 0x7f11e406fca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f8102f40 0x7f11f8070290 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 --2- 172.21.15.33:0/4127044906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11f81038e0 0x7f11f80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 >> 172.21.15.33:0/4127044906 conn(0x7f11f80f8af0 msgr2=0x7f11f80fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 shutdown_connections 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.702+0000 7f11ff10d700 1 -- 172.21.15.33:0/4127044906 wait complete. 2024-02-15T22:48:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 -- 172.21.15.33:0/3720129730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 msgr2=0x7f067c0fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 --2- 172.21.15.33:0/3720129730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fb9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0664004940 tx=0x7f0664009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 -- 172.21.15.33:0/3720129730 shutdown_connections 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 --2- 172.21.15.33:0/3720129730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fb9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 --2- 172.21.15.33:0/3720129730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f067c103140 0x7f067c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 -- 172.21.15.33:0/3720129730 >> 172.21.15.33:0/3720129730 conn(0x7f067c071560 msgr2=0x7f067c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 -- 172.21.15.33:0/3720129730 shutdown_connections 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 -- 172.21.15.33:0/3720129730 wait complete. 2024-02-15T22:48:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 Processor -- start 2024-02-15T22:48:30.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.807+0000 7f06818fe700 1 -- start start 2024-02-15T22:48:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06818fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06818fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f067c103140 0x7f067c0fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06818fe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0fd290 con 0x7f067c0fb570 2024-02-15T22:48:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06818fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0fd400 con 0x7f067c103140 2024-02-15T22:48:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43220/0 (socket says 172.21.15.33:43220) 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067affd700 1 -- 172.21.15.33:0/427627114 learned_addr learned my addr 172.21.15.33:0/427627114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067a7fc700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f067c103140 0x7f067c0fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067affd700 1 -- 172.21.15.33:0/427627114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f067c103140 msgr2=0x7f067c0fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067affd700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f067c103140 0x7f067c0fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067affd700 1 -- 172.21.15.33:0/427627114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664005040 con 0x7f067c0fb570 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f067affd700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fc750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f066c00ec90 tx=0x7f066c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06737fe700 1 -- 172.21.15.33:0/427627114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f066c007b30 con 0x7f067c0fb570 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c119dd0 con 0x7f067c0fb570 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06737fe700 1 -- 172.21.15.33:0/427627114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f066c00f040 con 0x7f067c0fb570 2024-02-15T22:48:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.808+0000 7f06737fe700 1 -- 172.21.15.33:0/427627114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f066c00cc80 con 0x7f067c0fb570 2024-02-15T22:48:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.809+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c11a2b0 con 0x7f067c0fb570 2024-02-15T22:48:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.809+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c1054d0 con 0x7f067c0fb570 2024-02-15T22:48:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.810+0000 7f06737fe700 1 -- 172.21.15.33:0/427627114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f066c007c90 con 0x7f067c0fb570 2024-02-15T22:48:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.810+0000 7f06737fe700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f066806d7f0 0x7f066806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.810+0000 7f06737fe700 1 -- 172.21.15.33:0/427627114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f066c08d280 con 0x7f067c0fb570 2024-02-15T22:48:30.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.810+0000 7f067a7fc700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f066806d7f0 0x7f066806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.811+0000 7f067a7fc700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f066806d7f0 0x7f066806fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f067c0fe150 tx=0x7f0664009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:30.815+0000 7f06737fe700 1 -- 172.21.15.33:0/427627114 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f066c056b70 con 0x7f067c0fb570 2024-02-15T22:48:31.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.042+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f067c04bed0 con 0x7f066806d7f0 2024-02-15T22:48:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.043+0000 7f06737fe700 1 -- 172.21.15.33:0/427627114 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f067c04bed0 con 0x7f066806d7f0 2024-02-15T22:48:31.045 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "9/21 daemons upgraded", 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:48:31.046 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:48:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f066806d7f0 msgr2=0x7f066806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f066806d7f0 0x7f066806fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f067c0fe150 tx=0x7f0664009e30 comp rx=0 tx=0).stop 2024-02-15T22:48:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 msgr2=0x7f067c0fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fc750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f066c00ec90 tx=0x7f066c00b040 comp rx=0 tx=0).stop 2024-02-15T22:48:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 shutdown_connections 2024-02-15T22:48:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f066806d7f0 0x7f066806fca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f067c0fb570 0x7f067c0fc750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 --2- 172.21.15.33:0/427627114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f067c103140 0x7f067c0fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 >> 172.21.15.33:0/427627114 conn(0x7f067c071560 msgr2=0x7f067c0f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 shutdown_connections 2024-02-15T22:48:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.045+0000 7f06818fe700 1 -- 172.21.15.33:0/427627114 wait complete. 2024-02-15T22:48:31.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 -- 172.21.15.33:0/850859661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 msgr2=0x7f0b3c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 --2- 172.21.15.33:0/850859661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c103320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ce0 tx=0x7f0b34004d10 comp rx=0 tx=0).stop 2024-02-15T22:48:31.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 -- 172.21.15.33:0/850859661 shutdown_connections 2024-02-15T22:48:31.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 --2- 172.21.15.33:0/850859661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3c1038f0 0x7f0b3c0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 --2- 172.21.15.33:0/850859661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c103320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 -- 172.21.15.33:0/850859661 >> 172.21.15.33:0/850859661 conn(0x7f0b3c0f8ae0 msgr2=0x7f0b3c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 -- 172.21.15.33:0/850859661 shutdown_connections 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.148+0000 7f0b44644700 1 -- 172.21.15.33:0/850859661 wait complete. 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b44644700 1 Processor -- start 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b44644700 1 -- start start 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b44644700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b44644700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3c1038f0 0x7f0b3c113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b44644700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c114640 con 0x7f0b3c102f50 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b44644700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c10d970 con 0x7f0b3c1038f0 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b423e0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b423e0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43240/0 (socket says 172.21.15.33:43240) 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b423e0700 1 -- 172.21.15.33:0/1760553052 learned_addr learned my addr 172.21.15.33:0/1760553052 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b41bdf700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3c1038f0 0x7f0b3c113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b423e0700 1 -- 172.21.15.33:0/1760553052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3c1038f0 msgr2=0x7f0b3c113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b423e0700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3c1038f0 0x7f0b3c113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b423e0700 1 -- 172.21.15.33:0/1760553052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34009940 con 0x7f0b3c102f50 2024-02-15T22:48:31.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b423e0700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c113ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400ba50 tx=0x7f0b34004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:31.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.149+0000 7f0b3affd700 1 -- 172.21.15.33:0/1760553052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3400e040 con 0x7f0b3c102f50 2024-02-15T22:48:31.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.150+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c10dbf0 con 0x7f0b3c102f50 2024-02-15T22:48:31.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.150+0000 7f0b3affd700 1 -- 172.21.15.33:0/1760553052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b34004610 con 0x7f0b3c102f50 2024-02-15T22:48:31.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.150+0000 7f0b3affd700 1 -- 172.21.15.33:0/1760553052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b34012a60 con 0x7f0b3c102f50 2024-02-15T22:48:31.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.150+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c10e130 con 0x7f0b3c102f50 2024-02-15T22:48:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.151+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c100260 con 0x7f0b3c102f50 2024-02-15T22:48:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.151+0000 7f0b3affd700 1 -- 172.21.15.33:0/1760553052 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0b3401c650 con 0x7f0b3c102f50 2024-02-15T22:48:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.151+0000 7f0b3affd700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b2406d7f0 0x7f0b2406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.151+0000 7f0b3affd700 1 -- 172.21.15.33:0/1760553052 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f0b3408efc0 con 0x7f0b3c102f50 2024-02-15T22:48:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.151+0000 7f0b41bdf700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b2406d7f0 0x7f0b2406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.152+0000 7f0b41bdf700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b2406d7f0 0x7f0b2406fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c10f2e0 tx=0x7f0b3000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:31.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.156+0000 7f0b3affd700 1 -- 172.21.15.33:0/1760553052 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0b3405c460 con 0x7f0b3c102f50 2024-02-15T22:48:31.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: pgmap v109: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:48:31.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2138246936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:31.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/4127044906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:48:31.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: Upgrade: Updating osd.3 2024-02-15T22:48:31.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:31.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:48:31.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:31.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:31 smithi082 ceph-mon[84550]: Deploying daemon osd.3 on smithi082 2024-02-15T22:48:31.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.441+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0b3c04bf00 con 0x7f0b3c102f50 2024-02-15T22:48:31.444 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: pgmap v109: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:48:31.444 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2138246936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:31.444 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/4127044906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:48:31.444 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: Upgrade: Updating osd.3 2024-02-15T22:48:31.444 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:31.444 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:48:31.445 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:31.445 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:31 smithi033 ceph-mon[113773]: Deploying daemon osd.3 on smithi082 2024-02-15T22:48:31.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.441+0000 7f0b3affd700 1 -- 172.21.15.33:0/1760553052 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0b3405bff0 con 0x7f0b3c102f50 2024-02-15T22:48:31.445 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:48:31.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b2406d7f0 msgr2=0x7f0b2406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b2406d7f0 0x7f0b2406fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c10f2e0 tx=0x7f0b3000b040 comp rx=0 tx=0).stop 2024-02-15T22:48:31.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 msgr2=0x7f0b3c113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c113ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400ba50 tx=0x7f0b34004d10 comp rx=0 tx=0).stop 2024-02-15T22:48:31.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 shutdown_connections 2024-02-15T22:48:31.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b2406d7f0 0x7f0b2406fca0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b3c102f50 0x7f0b3c113ab0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 --2- 172.21.15.33:0/1760553052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3c1038f0 0x7f0b3c113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.444+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 >> 172.21.15.33:0/1760553052 conn(0x7f0b3c0f8ae0 msgr2=0x7f0b3c0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:31.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.445+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 shutdown_connections 2024-02-15T22:48:31.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:48:31.445+0000 7f0b44644700 1 -- 172.21.15.33:0/1760553052 wait complete. 2024-02-15T22:48:32.480 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:32 smithi082 ceph-mon[84550]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:32.480 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:32 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1760553052' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:48:32.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:32 smithi033 ceph-mon[113773]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:32.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:32 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1760553052' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:48:33.389 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:33 smithi082 ceph-mon[84550]: pgmap v110: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:33.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:33 smithi033 ceph-mon[113773]: pgmap v110: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:34.467 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:34 smithi082 systemd[1]: Stopping Ceph osd.3 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:48:34.874 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:34 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[42700]: 2024-02-15T22:48:34.464+0000 7f8462ce5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:48:34.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:34 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[42700]: 2024-02-15T22:48:34.464+0000 7f8462ce5700 -1 osd.3 64 *** Got signal Terminated *** 2024-02-15T22:48:34.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:34 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[42700]: 2024-02-15T22:48:34.464+0000 7f8462ce5700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:48:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:35 smithi033 ceph-mon[113773]: pgmap v111: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:48:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:35 smithi033 ceph-mon[113773]: osd.3 marked itself down and dead 2024-02-15T22:48:35.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:35 smithi082 ceph-mon[84550]: pgmap v111: 65 pgs: 65 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:48:35.549 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:35 smithi082 ceph-mon[84550]: osd.3 marked itself down and dead 2024-02-15T22:48:35.825 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:35 smithi082 podman[93772]: 2024-02-15 22:48:35.547993148 +0000 UTC m=+1.219522972 container died 10441bef47c3a25c3f43107263ec5b64061da21ce1852659aa59b3aaa5907bb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9aa5233, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-15T22:48:36.124 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:35 smithi082 podman[93772]: 2024-02-15 22:48:35.915111704 +0000 UTC m=+1.586641532 container cleanup 10441bef47c3a25c3f43107263ec5b64061da21ce1852659aa59b3aaa5907bb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, ceph=True, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=quincy-9aa5233, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-15T22:48:36.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:35 smithi082 bash[93772]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3 2024-02-15T22:48:36.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:36 smithi033 ceph-mon[113773]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:48:36.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:36 smithi033 ceph-mon[113773]: failed to encode map e65 with expected crc 2024-02-15T22:48:36.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:36 smithi033 ceph-mon[113773]: osdmap e65: 6 total, 5 up, 6 in 2024-02-15T22:48:36.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:36 smithi082 ceph-mon[84550]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:48:36.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:36 smithi082 ceph-mon[84550]: failed to encode map e65 with expected crc 2024-02-15T22:48:36.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:36 smithi082 ceph-mon[84550]: osdmap e65: 6 total, 5 up, 6 in 2024-02-15T22:48:36.472 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:36 smithi082 podman[93790]: 2024-02-15 22:48:36.157680841 +0000 UTC m=+0.612704048 container remove 10441bef47c3a25c3f43107263ec5b64061da21ce1852659aa59b3aaa5907bb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, RELEASE=quincy-9aa5233, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:48:36.771 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:36 smithi082 podman[93880]: 2024-02-15 22:48:36.373472854 +0000 UTC m=+0.017500243 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:48:36.771 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:36 smithi082 podman[93880]: 2024-02-15 22:48:36.475412995 +0000 UTC m=+0.119440432 container create c811a5f18ff6ee86ab13aed14380e3e982ef316b076760bbc90359d744512638 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:48:37.058 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:36 smithi082 podman[93880]: 2024-02-15 22:48:36.770230598 +0000 UTC m=+0.414257988 container init c811a5f18ff6ee86ab13aed14380e3e982ef316b076760bbc90359d744512638 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-15T22:48:37.058 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:36 smithi082 podman[93880]: 2024-02-15 22:48:36.773522922 +0000 UTC m=+0.417550315 container start c811a5f18ff6ee86ab13aed14380e3e982ef316b076760bbc90359d744512638 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-15T22:48:37.058 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:36 smithi082 podman[93880]: 2024-02-15 22:48:36.878086939 +0000 UTC m=+0.522114326 container attach c811a5f18ff6ee86ab13aed14380e3e982ef316b076760bbc90359d744512638 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-15T22:48:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:37 smithi033 ceph-mon[113773]: pgmap v113: 65 pgs: 16 stale+active+clean, 49 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:48:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:37 smithi033 ceph-mon[113773]: osdmap e66: 6 total, 5 up, 6 in 2024-02-15T22:48:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:37 smithi033 ceph-mon[113773]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:37 smithi033 ceph-mon[113773]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:37 smithi033 ceph-mon[113773]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:37 smithi033 ceph-mon[113773]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.375 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:37 smithi082 podman[93880]: 2024-02-15 22:48:37.057119909 +0000 UTC m=+0.701147301 container died c811a5f18ff6ee86ab13aed14380e3e982ef316b076760bbc90359d744512638 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-15T22:48:37.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:37 smithi082 ceph-mon[84550]: pgmap v113: 65 pgs: 16 stale+active+clean, 49 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:48:37.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:37 smithi082 ceph-mon[84550]: osdmap e66: 6 total, 5 up, 6 in 2024-02-15T22:48:37.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:37 smithi082 ceph-mon[84550]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:37 smithi082 ceph-mon[84550]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:37 smithi082 ceph-mon[84550]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:37 smithi082 ceph-mon[84550]: failed to encode map e66 with expected crc 2024-02-15T22:48:37.677 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:37 smithi082 podman[93906]: 2024-02-15 22:48:37.67354224 +0000 UTC m=+0.611124201 container remove c811a5f18ff6ee86ab13aed14380e3e982ef316b076760bbc90359d744512638 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0) 2024-02-15T22:48:38.111 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:37 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-15T22:48:38.111 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:37 smithi082 systemd[1]: Stopped Ceph osd.3 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:48:38.111 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:37 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.3.service: Consumed 1min 6.780s CPU time. 2024-02-15T22:48:38.111 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:37 smithi082 systemd[1]: Starting Ceph osd.3 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:48:38.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-mon[84550]: Health check failed: Degraded data redundancy: 9/357 objects degraded (2.521%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:38.370 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 podman[94006]: 2024-02-15 22:48:38.012857647 +0000 UTC m=+0.017819930 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:48:38.370 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 podman[94006]: 2024-02-15 22:48:38.124301123 +0000 UTC m=+0.129263401 container create 331dbb497b2d758d66c949910d4a2d87ac67ec56748d1dd917c91020f19de875 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-15T22:48:38.370 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 podman[94006]: 2024-02-15 22:48:38.368824226 +0000 UTC m=+0.373786504 container init 331dbb497b2d758d66c949910d4a2d87ac67ec56748d1dd917c91020f19de875 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-15T22:48:38.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:38 smithi033 ceph-mon[113773]: Health check failed: Degraded data redundancy: 9/357 objects degraded (2.521%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:38.624 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 podman[94006]: 2024-02-15 22:48:38.37219216 +0000 UTC m=+0.377154447 container start 331dbb497b2d758d66c949910d4a2d87ac67ec56748d1dd917c91020f19de875 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:48:38.625 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 podman[94006]: 2024-02-15 22:48:38.477284576 +0000 UTC m=+0.482246869 container attach 331dbb497b2d758d66c949910d4a2d87ac67ec56748d1dd917c91020f19de875 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux ) 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate[94021]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate[94021]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 bash[94006]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 bash[94006]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 bash[94006]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 bash[94006]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 bash[94006]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 bash[94006]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 bash[94006]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-15T22:48:39.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate[94021]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:48:39.126 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate[94021]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:48:39.126 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate[94021]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-15T22:48:39.126 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate[94021]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:48:39.126 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate[94021]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-15T22:48:39.126 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:38 smithi082 podman[94006]: 2024-02-15 22:48:38.838217736 +0000 UTC m=+0.843180010 container died 331dbb497b2d758d66c949910d4a2d87ac67ec56748d1dd917c91020f19de875 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0) 2024-02-15T22:48:39.428 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:39 smithi082 ceph-mon[84550]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 13 stale+active+clean, 4 active+undersized, 45 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2024-02-15T22:48:39.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:39 smithi033 ceph-mon[113773]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 13 stale+active+clean, 4 active+undersized, 45 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2024-02-15T22:48:39.737 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 podman[94150]: 2024-02-15 22:48:39.427804513 +0000 UTC m=+0.584759323 container remove 331dbb497b2d758d66c949910d4a2d87ac67ec56748d1dd917c91020f19de875 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-02-15T22:48:39.737 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 podman[94211]: 2024-02-15 22:48:39.631736595 +0000 UTC m=+0.111159613 container create 7778c235281ac76e69c4c30aeb61d4ead899b26ea49b6b31fe6e943cab05bf00 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-02-15T22:48:39.737 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 podman[94211]: 2024-02-15 22:48:39.539114108 +0000 UTC m=+0.018537089 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:48:40.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 podman[94211]: 2024-02-15 22:48:39.858900866 +0000 UTC m=+0.338323842 container init 7778c235281ac76e69c4c30aeb61d4ead899b26ea49b6b31fe6e943cab05bf00 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-15T22:48:40.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 podman[94211]: 2024-02-15 22:48:39.861774531 +0000 UTC m=+0.341197508 container start 7778c235281ac76e69c4c30aeb61d4ead899b26ea49b6b31fe6e943cab05bf00 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-15T22:48:40.125 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 ceph-osd[94229]: -- 172.21.15.82:0/2704616826 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5609f1ca31e0 con 0x5609f1c74c00 2024-02-15T22:48:40.126 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 bash[94211]: 7778c235281ac76e69c4c30aeb61d4ead899b26ea49b6b31fe6e943cab05bf00 2024-02-15T22:48:40.126 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:39 smithi082 systemd[1]: Started Ceph osd.3 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:48:40.832 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:40 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:48:40.402+0000 7f56078997c0 -1 Falling back to public interface 2024-02-15T22:48:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:41 smithi082 ceph-mon[84550]: pgmap v116: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:41.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:41.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:41.524 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:41.524 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:41 smithi033 ceph-mon[113773]: pgmap v116: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:44.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:43 smithi082 ceph-mon[84550]: pgmap v117: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:44.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:44.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:44.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:44.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:44.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:43 smithi033 ceph-mon[113773]: pgmap v117: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:44.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:44.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:44.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:44.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:45.375 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:44 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:48:44.956+0000 7f56078997c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-15T22:48:45.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:45 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:45.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:45 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:45.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:45 smithi082 ceph-mon[84550]: pgmap v118: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:45.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:45 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:45.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:45 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:45.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:45 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:45.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:45 smithi033 ceph-mon[113773]: pgmap v118: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:45.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:45 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:45.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:48:45.524+0000 7f56078997c0 -1 osd.3 64 log_to_monitors true 2024-02-15T22:48:46.248 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:48:46 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:48:46.111+0000 7f55f8cf1700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:48:46.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:46 smithi082 ceph-mon[84550]: from='osd.3 [v2:172.21.15.82:6800/1385907804,v1:172.21.15.82:6801/1385907804]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:48:46.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:46 smithi082 ceph-mon[84550]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:48:46.270 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:46 smithi033 ceph-mon[113773]: from='osd.3 [v2:172.21.15.82:6800/1385907804,v1:172.21.15.82:6801/1385907804]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:48:46.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:46 smithi033 ceph-mon[113773]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:48:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:47 smithi082 ceph-mon[84550]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:48:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:47 smithi082 ceph-mon[84550]: from='osd.3 [v2:172.21.15.82:6800/1385907804,v1:172.21.15.82:6801/1385907804]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:48:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:47 smithi082 ceph-mon[84550]: osdmap e67: 6 total, 5 up, 6 in 2024-02-15T22:48:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:47 smithi082 ceph-mon[84550]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:48:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:47 smithi082 ceph-mon[84550]: pgmap v120: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:47 smithi082 ceph-mon[84550]: failed to encode map e67 with expected crc 2024-02-15T22:48:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:47 smithi033 ceph-mon[113773]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:48:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:47 smithi033 ceph-mon[113773]: from='osd.3 [v2:172.21.15.82:6800/1385907804,v1:172.21.15.82:6801/1385907804]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:48:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:47 smithi033 ceph-mon[113773]: osdmap e67: 6 total, 5 up, 6 in 2024-02-15T22:48:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:47 smithi033 ceph-mon[113773]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:48:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:47 smithi033 ceph-mon[113773]: pgmap v120: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-02-15T22:48:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:47 smithi033 ceph-mon[113773]: failed to encode map e67 with expected crc 2024-02-15T22:48:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: failed to encode map e67 with expected crc 2024-02-15T22:48:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:48:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: failed to encode map e68 with expected crc 2024-02-15T22:48:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: osd.3 [v2:172.21.15.82:6800/1385907804,v1:172.21.15.82:6801/1385907804] boot 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: osdmap e68: 6 total, 6 up, 6 in 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:48:48.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:48 smithi082 ceph-mon[84550]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T22:48:48.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: failed to encode map e67 with expected crc 2024-02-15T22:48:48.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:48:48.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: failed to encode map e68 with expected crc 2024-02-15T22:48:48.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: osd.3 [v2:172.21.15.82:6800/1385907804,v1:172.21.15.82:6801/1385907804] boot 2024-02-15T22:48:48.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: osdmap e68: 6 total, 6 up, 6 in 2024-02-15T22:48:48.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:48:48.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:48 smithi033 ceph-mon[113773]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: pgmap v122: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 75/357 objects degraded (21.008%) 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: osdmap e69: 6 total, 6 up, 6 in 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:49 smithi082 ceph-mon[84550]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: pgmap v122: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 75/357 objects degraded (21.008%) 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: osdmap e69: 6 total, 6 up, 6 in 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: failed to encode map e69 with expected crc 2024-02-15T22:48:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:49 smithi033 ceph-mon[113773]: failed to encode map e69 with expected crc 2024-02-15T22:48:50.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:50 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 48/357 objects degraded (13.445%), 11 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:50.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:50 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 48/357 objects degraded (13.445%), 11 pgs degraded (PG_DEGRADED) 2024-02-15T22:48:51.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:51 smithi033 ceph-mon[113773]: pgmap v124: 65 pgs: 11 active+undersized+degraded, 9 active+undersized, 45 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 2 op/s; 48/357 objects degraded (13.445%) 2024-02-15T22:48:51.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:51 smithi082 ceph-mon[84550]: pgmap v124: 65 pgs: 11 active+undersized+degraded, 9 active+undersized, 45 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 2 op/s; 48/357 objects degraded (13.445%) 2024-02-15T22:48:52.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:52 smithi033 ceph-mon[113773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/357 objects degraded (13.445%), 11 pgs degraded) 2024-02-15T22:48:52.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:52 smithi033 ceph-mon[113773]: Cluster is now healthy 2024-02-15T22:48:52.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:52 smithi082 ceph-mon[84550]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/357 objects degraded (13.445%), 11 pgs degraded) 2024-02-15T22:48:52.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:52 smithi082 ceph-mon[84550]: Cluster is now healthy 2024-02-15T22:48:53.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:53 smithi033 ceph-mon[113773]: pgmap v125: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-15T22:48:53.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:53 smithi082 ceph-mon[84550]: pgmap v125: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-15T22:48:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:55 smithi033 ceph-mon[113773]: pgmap v126: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:55 smithi082 ceph-mon[84550]: pgmap v126: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:48:57.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:57 smithi033 ceph-mon[113773]: pgmap v127: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-15T22:48:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:57 smithi082 ceph-mon[84550]: pgmap v127: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-15T22:48:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:59 smithi033 ceph-mon[113773]: pgmap v128: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-15T22:48:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:59.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:48:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:59.617 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:59 smithi082 ceph-mon[84550]: pgmap v128: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-15T22:48:59.618 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:48:59.618 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:59.618 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:48:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:01 smithi033 ceph-mon[113773]: pgmap v129: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 -- 172.21.15.33:0/3938314128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50101e60 msgr2=0x7fce50102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 --2- 172.21.15.33:0/3938314128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50101e60 0x7fce50102230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fce40004940 tx=0x7fce40009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 -- 172.21.15.33:0/3938314128 shutdown_connections 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 --2- 172.21.15.33:0/3938314128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce50102800 0x7fce500fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 --2- 172.21.15.33:0/3938314128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50101e60 0x7fce50102230 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 -- 172.21.15.33:0/3938314128 >> 172.21.15.33:0/3938314128 conn(0x7fce500f7a10 msgr2=0x7fce500f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 -- 172.21.15.33:0/3938314128 shutdown_connections 2024-02-15T22:49:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 -- 172.21.15.33:0/3938314128 wait complete. 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 Processor -- start 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.564+0000 7fce55917700 1 -- start start 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce55917700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce50101e60 0x7fce50113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce55917700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50102800 0x7fce50113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce55917700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce501145c0 con 0x7fce50102800 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce55917700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5010d960 con 0x7fce50101e60 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50102800 0x7fce50113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50102800 0x7fce50113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37964/0 (socket says 172.21.15.33:37964) 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4e7fc700 1 -- 172.21.15.33:0/307376061 learned_addr learned my addr 172.21.15.33:0/307376061 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4effd700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce50101e60 0x7fce50113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4e7fc700 1 -- 172.21.15.33:0/307376061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce50101e60 msgr2=0x7fce50113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4e7fc700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce50101e60 0x7fce50113a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4e7fc700 1 -- 172.21.15.33:0/307376061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40005040 con 0x7fce50102800 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce4e7fc700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50102800 0x7fce50113f70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c890 tx=0x7fce440044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.565+0000 7fce377fe700 1 -- 172.21.15.33:0/307376061 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4400a7d0 con 0x7fce50102800 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.566+0000 7fce377fe700 1 -- 172.21.15.33:0/307376061 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce4400ae00 con 0x7fce50102800 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.566+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5010dc40 con 0x7fce50102800 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.566+0000 7fce377fe700 1 -- 172.21.15.33:0/307376061 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce440113a0 con 0x7fce50102800 2024-02-15T22:49:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.566+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5010e180 con 0x7fce50102800 2024-02-15T22:49:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.567+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce500fb610 con 0x7fce50102800 2024-02-15T22:49:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.567+0000 7fce377fe700 1 -- 172.21.15.33:0/307376061 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fce44012400 con 0x7fce50102800 2024-02-15T22:49:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.567+0000 7fce377fe700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fce3806d7f0 0x7fce3806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.568+0000 7fce377fe700 1 -- 172.21.15.33:0/307376061 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fce4408ce20 con 0x7fce50102800 2024-02-15T22:49:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.568+0000 7fce4effd700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fce3806d7f0 0x7fce3806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.568+0000 7fce4effd700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fce3806d7f0 0x7fce3806fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b020 tx=0x7fce40009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.572+0000 7fce377fe700 1 -- 172.21.15.33:0/307376061 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fce4405a360 con 0x7fce50102800 2024-02-15T22:49:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:01 smithi082 ceph-mon[84550]: pgmap v129: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-15T22:49:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.795+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce50113700 con 0x7fce3806d7f0 2024-02-15T22:49:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.796+0000 7fce377fe700 1 -- 172.21.15.33:0/307376061 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fce50113700 con 0x7fce3806d7f0 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.798+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fce3806d7f0 msgr2=0x7fce3806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.798+0000 7fce55917700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fce3806d7f0 0x7fce3806fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b020 tx=0x7fce40009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.798+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50102800 msgr2=0x7fce50113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.798+0000 7fce55917700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50102800 0x7fce50113f70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c890 tx=0x7fce440044c0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.799+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 shutdown_connections 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.799+0000 7fce55917700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fce3806d7f0 0x7fce3806fca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.799+0000 7fce55917700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce50101e60 0x7fce50113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.799+0000 7fce55917700 1 --2- 172.21.15.33:0/307376061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce50102800 0x7fce50113f70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.799+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 >> 172.21.15.33:0/307376061 conn(0x7fce500f7a10 msgr2=0x7fce50066070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.799+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 shutdown_connections 2024-02-15T22:49:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.799+0000 7fce55917700 1 -- 172.21.15.33:0/307376061 wait complete. 2024-02-15T22:49:01.811 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:49:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 -- 172.21.15.33:0/3884835252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fe900 msgr2=0x7f8c48106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/3884835252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fe900 0x7f8c48106f40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c004940 tx=0x7f8c3c009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 -- 172.21.15.33:0/3884835252 shutdown_connections 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/3884835252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fe900 0x7f8c48106f40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/3884835252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c480fdf60 0x7f8c480fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 -- 172.21.15.33:0/3884835252 >> 172.21.15.33:0/3884835252 conn(0x7f8c480f7a10 msgr2=0x7f8c480f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 -- 172.21.15.33:0/3884835252 shutdown_connections 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.903+0000 7f8c4f33a700 1 -- 172.21.15.33:0/3884835252 wait complete. 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4f33a700 1 Processor -- start 2024-02-15T22:49:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4f33a700 1 -- start start 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4f33a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fdf60 0x7f8c48113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4f33a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c480fe900 0x7f8c48114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4f33a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481146c0 con 0x7f8c480fdf60 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4f33a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4810d9f0 con 0x7f8c480fe900 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4d0d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fdf60 0x7f8c48113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4d0d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fdf60 0x7f8c48113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37974/0 (socket says 172.21.15.33:37974) 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4d0d6700 1 -- 172.21.15.33:0/2517705426 learned_addr learned my addr 172.21.15.33:0/2517705426 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.904+0000 7f8c4c8d5700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c480fe900 0x7f8c48114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c4d0d6700 1 -- 172.21.15.33:0/2517705426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c480fe900 msgr2=0x7f8c48114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c4d0d6700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c480fe900 0x7f8c48114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c4d0d6700 1 -- 172.21.15.33:0/2517705426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c005040 con 0x7f8c480fdf60 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c4c8d5700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c480fe900 0x7f8c48114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c4d0d6700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fdf60 0x7f8c48113b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000cac0 tx=0x7f8c40007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c45ffb700 1 -- 172.21.15.33:0/2517705426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c4000aa50 con 0x7f8c480fdf60 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4810dcd0 con 0x7f8c480fdf60 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c45ffb700 1 -- 172.21.15.33:0/2517705426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c4000abb0 con 0x7f8c480fdf60 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c45ffb700 1 -- 172.21.15.33:0/2517705426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c400115e0 con 0x7f8c480fdf60 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.905+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4810e210 con 0x7f8c480fdf60 2024-02-15T22:49:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.906+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c48104550 con 0x7f8c480fdf60 2024-02-15T22:49:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.907+0000 7f8c45ffb700 1 -- 172.21.15.33:0/2517705426 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8c4000ad20 con 0x7f8c480fdf60 2024-02-15T22:49:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.907+0000 7f8c45ffb700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d7e0 0x7f8c3006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.907+0000 7f8c45ffb700 1 -- 172.21.15.33:0/2517705426 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f8c4008d4e0 con 0x7f8c480fdf60 2024-02-15T22:49:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.907+0000 7f8c4c8d5700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d7e0 0x7f8c3006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.908+0000 7f8c4c8d5700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d7e0 0x7f8c3006fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c004560 tx=0x7f8c3c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:01.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:01.913+0000 7f8c45ffb700 1 -- 172.21.15.33:0/2517705426 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8c4005a980 con 0x7f8c480fdf60 2024-02-15T22:49:02.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.140+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c4804bed0 con 0x7f8c3006d7e0 2024-02-15T22:49:02.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.141+0000 7f8c45ffb700 1 -- 172.21.15.33:0/2517705426 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8c4804bed0 con 0x7f8c3006d7e0 2024-02-15T22:49:02.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.143+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d7e0 msgr2=0x7f8c3006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.143+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d7e0 0x7f8c3006fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c004560 tx=0x7f8c3c009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:02.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.143+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fdf60 msgr2=0x7f8c48113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.143+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fdf60 0x7f8c48113b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000cac0 tx=0x7f8c40007ee0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.143+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 shutdown_connections 2024-02-15T22:49:02.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.143+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8c3006d7e0 0x7f8c3006fc90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.144+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c480fdf60 0x7f8c48113b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.144+0000 7f8c4f33a700 1 --2- 172.21.15.33:0/2517705426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c480fe900 0x7f8c48114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.144+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 >> 172.21.15.33:0/2517705426 conn(0x7f8c480f7a10 msgr2=0x7f8c481016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:02.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.144+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 shutdown_connections 2024-02-15T22:49:02.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.144+0000 7f8c4f33a700 1 -- 172.21.15.33:0/2517705426 wait complete. 2024-02-15T22:49:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.246+0000 7f6d005f1700 1 -- 172.21.15.33:0/4089640737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf81027f0 msgr2=0x7f6cf80fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.246+0000 7f6d005f1700 1 --2- 172.21.15.33:0/4089640737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf81027f0 0x7f6cf80fbe60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8004940 tx=0x7f6ce8009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:02.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:02 smithi033 ceph-mon[113773]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:02.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 -- 172.21.15.33:0/4089640737 shutdown_connections 2024-02-15T22:49:02.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 --2- 172.21.15.33:0/4089640737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf81027f0 0x7f6cf80fbe60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 --2- 172.21.15.33:0/4089640737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cf8101e50 0x7f6cf8102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 -- 172.21.15.33:0/4089640737 >> 172.21.15.33:0/4089640737 conn(0x7f6cf80f79c0 msgr2=0x7f6cf80f9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:02.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 -- 172.21.15.33:0/4089640737 shutdown_connections 2024-02-15T22:49:02.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 -- 172.21.15.33:0/4089640737 wait complete. 2024-02-15T22:49:02.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 Processor -- start 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 -- start start 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf8101e50 0x7f6cf8113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cf81027f0 0x7f6cf8113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf81146b0 con 0x7f6cf8101e50 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.247+0000 7f6d005f1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf810d950 con 0x7f6cf81027f0 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfe38d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf8101e50 0x7f6cf8113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfe38d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf8101e50 0x7f6cf8113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37992/0 (socket says 172.21.15.33:37992) 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfe38d700 1 -- 172.21.15.33:0/3025242495 learned_addr learned my addr 172.21.15.33:0/3025242495 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfdb8c700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cf81027f0 0x7f6cf8113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfe38d700 1 -- 172.21.15.33:0/3025242495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cf81027f0 msgr2=0x7f6cf8113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfe38d700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cf81027f0 0x7f6cf8113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfe38d700 1 -- 172.21.15.33:0/3025242495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8005040 con 0x7f6cf8101e50 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6cfe38d700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf8101e50 0x7f6cf8113a90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400b790 tx=0x7f6cf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6ceeffd700 1 -- 172.21.15.33:0/3025242495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf400f770 con 0x7f6cf8101e50 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf810dc30 con 0x7f6cf8101e50 2024-02-15T22:49:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6ceeffd700 1 -- 172.21.15.33:0/3025242495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cf400fda0 con 0x7f6cf8101e50 2024-02-15T22:49:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf810e170 con 0x7f6cf8101e50 2024-02-15T22:49:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.248+0000 7f6ceeffd700 1 -- 172.21.15.33:0/3025242495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf400d310 con 0x7f6cf8101e50 2024-02-15T22:49:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.249+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc0052e0 con 0x7f6cf8101e50 2024-02-15T22:49:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.250+0000 7f6ceeffd700 1 -- 172.21.15.33:0/3025242495 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6cf4010420 con 0x7f6cf8101e50 2024-02-15T22:49:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.250+0000 7f6ceeffd700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6ce406d7f0 0x7f6ce406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.250+0000 7f6ceeffd700 1 -- 172.21.15.33:0/3025242495 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6cf408cd20 con 0x7f6cf8101e50 2024-02-15T22:49:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.250+0000 7f6cfdb8c700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6ce406d7f0 0x7f6ce406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.251+0000 7f6cfdb8c700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6ce406d7f0 0x7f6ce406fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6cf810f2c0 tx=0x7f6ce8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:02.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.255+0000 7f6ceeffd700 1 -- 172.21.15.33:0/3025242495 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6cf405a260 con 0x7f6cf8101e50 2024-02-15T22:49:02.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.466+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cdc000bf0 con 0x7f6ce406d7f0 2024-02-15T22:49:02.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.477+0000 7f6ceeffd700 1 -- 172.21.15.33:0/3025242495 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6cdc000bf0 con 0x7f6ce406d7f0 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (5m) 53s ago 16m 26.3M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (2m) 53s ago 16m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (2m) 19s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (4m) 53s ago 15m 87.4M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (10m) 53s ago 10m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (10m) 53s ago 10m 75.3M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (10m) 19s ago 10m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (10m) 19s ago 10m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (6m) 53s ago 17m 500M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:49:02.479 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (6m) 19s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (3m) 53s ago 17m 48.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (3m) 19s ago 15m 37.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (5m) 53s ago 16m 16.4M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (5m) 19s ago 15m 16.8M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (2m) 53s ago 14m 87.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (95s) 53s ago 13m 97.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (58s) 53s ago 13m 12.6M 1559M 19.0.0-1450-gf78a58c0 f081f847070a dfdcfe354b41 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (22s) 19s ago 12m 12.1M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 7778c235281a 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (12m) 19s ago 12m 233M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 c734dc6302af 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (12m) 19s ago 12m 224M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:49:02.480 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 53s ago 15m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6ce406d7f0 msgr2=0x7f6ce406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6ce406d7f0 0x7f6ce406fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6cf810f2c0 tx=0x7f6ce8009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf8101e50 msgr2=0x7f6cf8113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf8101e50 0x7f6cf8113a90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400b790 tx=0x7f6cf4009250 comp rx=0 tx=0).stop 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 shutdown_connections 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6ce406d7f0 0x7f6ce406fca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf8101e50 0x7f6cf8113a90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 --2- 172.21.15.33:0/3025242495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cf81027f0 0x7f6cf8113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 >> 172.21.15.33:0/3025242495 conn(0x7f6cf80f79c0 msgr2=0x7f6cf80f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 shutdown_connections 2024-02-15T22:49:02.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.480+0000 7f6d005f1700 1 -- 172.21.15.33:0/3025242495 wait complete. 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/919533316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 msgr2=0x7ff4c80fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/919533316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fbe70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4004940 tx=0x7ff4b4009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/919533316 shutdown_connections 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/919533316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fbe70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/919533316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c8101e60 0x7ff4c8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/919533316 >> 172.21.15.33:0/919533316 conn(0x7ff4c80f7a10 msgr2=0x7ff4c80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/919533316 shutdown_connections 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.581+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/919533316 wait complete. 2024-02-15T22:49:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4cf0c0700 1 Processor -- start 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4cf0c0700 1 -- start start 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4cf0c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c8101e60 0x7ff4c80fdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4cf0c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fe020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4cf0c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80fe620 con 0x7ff4c8102800 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4cf0c0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80fe790 con 0x7ff4c8101e60 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fe020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38006/0 (socket says 172.21.15.33:38006) 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4c7fff700 1 -- 172.21.15.33:0/3709178192 learned_addr learned my addr 172.21.15.33:0/3709178192 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.582+0000 7ff4cce5c700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c8101e60 0x7ff4c80fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4c7fff700 1 -- 172.21.15.33:0/3709178192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c8101e60 msgr2=0x7ff4c80fdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4c7fff700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c8101e60 0x7ff4c80fdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4c7fff700 1 -- 172.21.15.33:0/3709178192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4005040 con 0x7ff4c8102800 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4c7fff700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fe020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009100 tx=0x7ff4b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4c57fa700 1 -- 172.21.15.33:0/3709178192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b400e040 con 0x7ff4c8102800 2024-02-15T22:49:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4c57fa700 1 -- 172.21.15.33:0/3709178192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4b4004290 con 0x7ff4c8102800 2024-02-15T22:49:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c8119d20 con 0x7ff4c8102800 2024-02-15T22:49:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4c57fa700 1 -- 172.21.15.33:0/3709178192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b401c3f0 con 0x7ff4c8102800 2024-02-15T22:49:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.583+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c811a180 con 0x7ff4c8102800 2024-02-15T22:49:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.584+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c80fb610 con 0x7ff4c8102800 2024-02-15T22:49:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.585+0000 7ff4c57fa700 1 -- 172.21.15.33:0/3709178192 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff4b400bbf0 con 0x7ff4c8102800 2024-02-15T22:49:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.585+0000 7ff4c57fa700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4b806d7f0 0x7ff4b806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.585+0000 7ff4c57fa700 1 -- 172.21.15.33:0/3709178192 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6242+0+0 (secure 0 0 0) 0x7ff4b408e050 con 0x7ff4c8102800 2024-02-15T22:49:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.585+0000 7ff4cce5c700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4b806d7f0 0x7ff4b806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.585+0000 7ff4cce5c700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4b806d7f0 0x7ff4b806fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc004990 tx=0x7ff4bc009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:02.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.590+0000 7ff4c57fa700 1 -- 172.21.15.33:0/3709178192 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff4b4057a60 con 0x7ff4c8102800 2024-02-15T22:49:02.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:02 smithi082 ceph-mon[84550]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:02.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.878+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4c80ff220 con 0x7ff4c8102800 2024-02-15T22:49:02.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.878+0000 7ff4c57fa700 1 -- 172.21.15.33:0/3709178192 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7ff4b405b120 con 0x7ff4c8102800 2024-02-15T22:49:02.880 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:49:02.880 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:49:02.880 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:49:02.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:02.880 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 2, 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 6, 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 8 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:49:02.881 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:49:02.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4b806d7f0 msgr2=0x7ff4b806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4b806d7f0 0x7ff4b806fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc004990 tx=0x7ff4bc009ee0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 msgr2=0x7ff4c80fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fe020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009100 tx=0x7ff4b4009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:02.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 shutdown_connections 2024-02-15T22:49:02.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4b806d7f0 0x7ff4b806fca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c8101e60 0x7ff4c80fdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 --2- 172.21.15.33:0/3709178192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4c8102800 0x7ff4c80fe020 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 >> 172.21.15.33:0/3709178192 conn(0x7ff4c80f7a10 msgr2=0x7ff4c8066050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 shutdown_connections 2024-02-15T22:49:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.880+0000 7ff4cf0c0700 1 -- 172.21.15.33:0/3709178192 wait complete. 2024-02-15T22:49:02.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 -- 172.21.15.33:0/2173846259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 msgr2=0x7f80d8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 --2- 172.21.15.33:0/2173846259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d8102210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80c8004940 tx=0x7f80c8009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:02.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 -- 172.21.15.33:0/2173846259 shutdown_connections 2024-02-15T22:49:02.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 --2- 172.21.15.33:0/2173846259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d81027e0 0x7f80d80fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 --2- 172.21.15.33:0/2173846259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d8102210 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 -- 172.21.15.33:0/2173846259 >> 172.21.15.33:0/2173846259 conn(0x7f80d8071d90 msgr2=0x7f80d8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 -- 172.21.15.33:0/2173846259 shutdown_connections 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 -- 172.21.15.33:0/2173846259 wait complete. 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 Processor -- start 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.983+0000 7f80de470700 1 -- start start 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80de470700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d81139d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80de470700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d81027e0 0x7f80d8113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80de470700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8114560 con 0x7f80d8101e40 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80de470700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d810d890 con 0x7f80d81027e0 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d81139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d81139d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38018/0 (socket says 172.21.15.33:38018) 2024-02-15T22:49:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d7fff700 1 -- 172.21.15.33:0/1089778338 learned_addr learned my addr 172.21.15.33:0/1089778338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80cffff700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d81027e0 0x7f80d8113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d7fff700 1 -- 172.21.15.33:0/1089778338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d81027e0 msgr2=0x7f80d8113f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d7fff700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d81027e0 0x7f80d8113f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d7fff700 1 -- 172.21.15.33:0/1089778338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8005040 con 0x7f80d8101e40 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d7fff700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d81139d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f80c800b3b0 tx=0x7f80c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d57fa700 1 -- 172.21.15.33:0/1089778338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c800e040 con 0x7f80d8101e40 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d57fa700 1 -- 172.21.15.33:0/1089778338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80c800bbf0 con 0x7f80d8101e40 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d810db10 con 0x7f80d8101e40 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.984+0000 7f80d57fa700 1 -- 172.21.15.33:0/1089778338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c801c630 con 0x7f80d8101e40 2024-02-15T22:49:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.985+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d810e050 con 0x7f80d8101e40 2024-02-15T22:49:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.985+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d80738b0 con 0x7f80d8101e40 2024-02-15T22:49:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.986+0000 7f80d57fa700 1 -- 172.21.15.33:0/1089778338 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f80c800bd60 con 0x7f80d8101e40 2024-02-15T22:49:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.986+0000 7f80d57fa700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f80c406d7e0 0x7f80c406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.986+0000 7f80d57fa700 1 -- 172.21.15.33:0/1089778338 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f80c808e250 con 0x7f80d8101e40 2024-02-15T22:49:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.986+0000 7f80cffff700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f80c406d7e0 0x7f80c406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.987+0000 7f80cffff700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f80c406d7e0 0x7f80c406fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009fd0 tx=0x7f80c0009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:02.991+0000 7f80d57fa700 1 -- 172.21.15.33:0/1089778338 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f80c805b6f0 con 0x7f80d8101e40 2024-02-15T22:49:03.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.239+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f80d810efb0 con 0x7f80d8101e40 2024-02-15T22:49:03.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.239+0000 7f80d57fa700 1 -- 172.21.15.33:0/1089778338 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f80c805b280 con 0x7f80d8101e40 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:49:03.242 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:49:03.243 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:49:03.244 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:49:03.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.241+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f80c406d7e0 msgr2=0x7f80c406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.241+0000 7f80de470700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f80c406d7e0 0x7f80c406fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009fd0 tx=0x7f80c0009f60 comp rx=0 tx=0).stop 2024-02-15T22:49:03.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.241+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 msgr2=0x7f80d81139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.241+0000 7f80de470700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d81139d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f80c800b3b0 tx=0x7f80c8009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.242+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 shutdown_connections 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.242+0000 7f80de470700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f80c406d7e0 0x7f80c406fc90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.242+0000 7f80de470700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d8101e40 0x7f80d81139d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.242+0000 7f80de470700 1 --2- 172.21.15.33:0/1089778338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80d81027e0 0x7f80d8113f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.242+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 >> 172.21.15.33:0/1089778338 conn(0x7f80d8071d90 msgr2=0x7f80d80656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.242+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 shutdown_connections 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.242+0000 7f80de470700 1 -- 172.21.15.33:0/1089778338 wait complete. 2024-02-15T22:49:03.246 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.345+0000 7fcc763b6700 1 -- 172.21.15.33:0/1400218228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fe8f0 msgr2=0x7fcc70107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.345+0000 7fcc763b6700 1 --2- 172.21.15.33:0/1400218228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fe8f0 0x7fcc70107050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcc64004970 tx=0x7fcc64009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.345+0000 7fcc763b6700 1 -- 172.21.15.33:0/1400218228 shutdown_connections 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.345+0000 7fcc763b6700 1 --2- 172.21.15.33:0/1400218228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fe8f0 0x7fcc70107050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 --2- 172.21.15.33:0/1400218228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc700fdfe0 0x7fcc700fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 -- 172.21.15.33:0/1400218228 >> 172.21.15.33:0/1400218228 conn(0x7fcc70071d90 msgr2=0x7fcc70072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 -- 172.21.15.33:0/1400218228 shutdown_connections 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 -- 172.21.15.33:0/1400218228 wait complete. 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 Processor -- start 2024-02-15T22:49:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 -- start start 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fdfe0 0x7fcc70113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc700fe8f0 0x7fcc70113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70114690 con 0x7fcc700fdfe0 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.346+0000 7fcc763b6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7010d930 con 0x7fcc700fe8f0 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fdfe0 0x7fcc70113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fdfe0 0x7fcc70113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38046/0 (socket says 172.21.15.33:38046) 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6ffff700 1 -- 172.21.15.33:0/245273416 learned_addr learned my addr 172.21.15.33:0/245273416 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6f7fe700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc700fe8f0 0x7fcc70113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:03.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6ffff700 1 -- 172.21.15.33:0/245273416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc700fe8f0 msgr2=0x7fcc70113fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6ffff700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc700fe8f0 0x7fcc70113fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6ffff700 1 -- 172.21.15.33:0/245273416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64005040 con 0x7fcc700fdfe0 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6ffff700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fdfe0 0x7fcc70113a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000b790 tx=0x7fcc60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6cff9700 1 -- 172.21.15.33:0/245273416 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc6000f6f0 con 0x7fcc700fdfe0 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6cff9700 1 -- 172.21.15.33:0/245273416 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc6000fd20 con 0x7fcc700fdfe0 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7010dc10 con 0x7fcc700fdfe0 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc6cff9700 1 -- 172.21.15.33:0/245273416 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc600103a0 con 0x7fcc700fdfe0 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.347+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7010e120 con 0x7fcc700fdfe0 2024-02-15T22:49:03.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.348+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc701046c0 con 0x7fcc700fdfe0 2024-02-15T22:49:03.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.349+0000 7fcc6cff9700 1 -- 172.21.15.33:0/245273416 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fcc60011400 con 0x7fcc700fdfe0 2024-02-15T22:49:03.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.349+0000 7fcc6cff9700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcc5806d7e0 0x7fcc5806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:03.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.349+0000 7fcc6cff9700 1 -- 172.21.15.33:0/245273416 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fcc6008cbe0 con 0x7fcc700fdfe0 2024-02-15T22:49:03.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.349+0000 7fcc6f7fe700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcc5806d7e0 0x7fcc5806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:03.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.350+0000 7fcc6f7fe700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcc5806d7e0 0x7fcc5806fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcc64000c00 tx=0x7fcc64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:03.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.354+0000 7fcc6cff9700 1 -- 172.21.15.33:0/245273416 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcc6005a060 con 0x7fcc700fdfe0 2024-02-15T22:49:03.391 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:03 smithi082 ceph-mon[84550]: pgmap v130: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:03.391 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:03 smithi082 ceph-mon[84550]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:03.391 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:03 smithi082 ceph-mon[84550]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:03.391 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:03 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:49:03.392 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:03 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:49:03.392 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:03 smithi082 ceph-mon[84550]: Upgrade: osd.4 is safe to restart 2024-02-15T22:49:03.392 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:03 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3709178192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:03 smithi033 ceph-mon[113773]: pgmap v130: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:03 smithi033 ceph-mon[113773]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:03 smithi033 ceph-mon[113773]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:03 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:49:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:03 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:49:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:03 smithi033 ceph-mon[113773]: Upgrade: osd.4 is safe to restart 2024-02-15T22:49:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:03 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3709178192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:03.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.575+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc7004bf40 con 0x7fcc5806d7e0 2024-02-15T22:49:03.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.576+0000 7fcc6cff9700 1 -- 172.21.15.33:0/245273416 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fcc7004bf40 con 0x7fcc5806d7e0 2024-02-15T22:49:03.578 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:49:03.578 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:49:03.578 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:49:03.578 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:49:03.578 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:49:03.578 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:49:03.579 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:49:03.579 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T22:49:03.579 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:49:03.579 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "10/21 daemons upgraded", 2024-02-15T22:49:03.579 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:49:03.579 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:49:03.579 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcc5806d7e0 msgr2=0x7fcc5806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcc5806d7e0 0x7fcc5806fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcc64000c00 tx=0x7fcc64009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fdfe0 msgr2=0x7fcc70113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fdfe0 0x7fcc70113a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000b790 tx=0x7fcc60009250 comp rx=0 tx=0).stop 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 shutdown_connections 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcc5806d7e0 0x7fcc5806fc90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc700fdfe0 0x7fcc70113a70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 --2- 172.21.15.33:0/245273416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc700fe8f0 0x7fcc70113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 >> 172.21.15.33:0/245273416 conn(0x7fcc70071d90 msgr2=0x7fcc70101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:03.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 shutdown_connections 2024-02-15T22:49:03.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.578+0000 7fcc763b6700 1 -- 172.21.15.33:0/245273416 wait complete. 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 -- 172.21.15.33:0/2866318984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 msgr2=0x7f9e500fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2866318984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e500fe3b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9e40004970 tx=0x7f9e40009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 -- 172.21.15.33:0/2866318984 shutdown_connections 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2866318984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e500fe8f0 0x7f9e50107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2866318984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e500fe3b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 -- 172.21.15.33:0/2866318984 >> 172.21.15.33:0/2866318984 conn(0x7f9e50071d90 msgr2=0x7f9e50072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 -- 172.21.15.33:0/2866318984 shutdown_connections 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.681+0000 7f9e55c55700 1 -- 172.21.15.33:0/2866318984 wait complete. 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e55c55700 1 Processor -- start 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e55c55700 1 -- start start 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e55c55700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e50113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e55c55700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e500fe8f0 0x7f9e50113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e55c55700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e501145e0 con 0x7f9e500fdfe0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e55c55700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5010d910 con 0x7f9e500fe8f0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e4f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e50113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e4f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e50113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38058/0 (socket says 172.21.15.33:38058) 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e4f7fe700 1 -- 172.21.15.33:0/2999259419 learned_addr learned my addr 172.21.15.33:0/2999259419 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e46ffd700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e500fe8f0 0x7f9e50113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e4f7fe700 1 -- 172.21.15.33:0/2999259419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e500fe8f0 msgr2=0x7f9e50113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e4f7fe700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e500fe8f0 0x7f9e50113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.682+0000 7f9e4f7fe700 1 -- 172.21.15.33:0/2999259419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40005040 con 0x7f9e500fdfe0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.683+0000 7f9e4f7fe700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e50113a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e40000c00 tx=0x7f9e40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.683+0000 7f9e4cff9700 1 -- 172.21.15.33:0/2999259419 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4000e040 con 0x7f9e500fdfe0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.683+0000 7f9e4cff9700 1 -- 172.21.15.33:0/2999259419 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e40009af0 con 0x7f9e500fdfe0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.683+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5010db90 con 0x7f9e500fdfe0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.683+0000 7f9e4cff9700 1 -- 172.21.15.33:0/2999259419 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4001c3f0 con 0x7f9e500fdfe0 2024-02-15T22:49:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.683+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5010e0d0 con 0x7f9e500fdfe0 2024-02-15T22:49:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.684+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e501046c0 con 0x7f9e500fdfe0 2024-02-15T22:49:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.684+0000 7f9e4cff9700 1 -- 172.21.15.33:0/2999259419 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9e40013420 con 0x7f9e500fdfe0 2024-02-15T22:49:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.685+0000 7f9e4cff9700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e3c06d7e0 0x7f9e3c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.685+0000 7f9e4cff9700 1 -- 172.21.15.33:0/2999259419 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9e4008e010 con 0x7f9e500fdfe0 2024-02-15T22:49:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.685+0000 7f9e46ffd700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e3c06d7e0 0x7f9e3c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.685+0000 7f9e46ffd700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e3c06d7e0 0x7f9e3c06fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e5010f280 tx=0x7f9e3800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.689+0000 7f9e4cff9700 1 -- 172.21.15.33:0/2999259419 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9e4005b4b0 con 0x7f9e500fdfe0 2024-02-15T22:49:03.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.974+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9e5004bed0 con 0x7f9e500fdfe0 2024-02-15T22:49:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.975+0000 7f9e4cff9700 1 -- 172.21.15.33:0/2999259419 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9e4005b040 con 0x7f9e500fdfe0 2024-02-15T22:49:03.977 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:49:03.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e3c06d7e0 msgr2=0x7f9e3c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e3c06d7e0 0x7f9e3c06fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e5010f280 tx=0x7f9e3800b040 comp rx=0 tx=0).stop 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 msgr2=0x7f9e50113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e50113a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e40000c00 tx=0x7f9e40009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 shutdown_connections 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9e3c06d7e0 0x7f9e3c06fc90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e500fdfe0 0x7f9e50113a50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 --2- 172.21.15.33:0/2999259419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e500fe8f0 0x7f9e50113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 >> 172.21.15.33:0/2999259419 conn(0x7f9e50071d90 msgr2=0x7f9e50101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 shutdown_connections 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:03.977+0000 7f9e55c55700 1 -- 172.21.15.33:0/2999259419 wait complete. 2024-02-15T22:49:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:04 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1089778338' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:49:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:04 smithi033 ceph-mon[113773]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:04 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2999259419' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:49:04.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:04 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1089778338' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:49:04.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:04 smithi082 ceph-mon[84550]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:04.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:04 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2999259419' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:49:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:05 smithi082 ceph-mon[84550]: pgmap v131: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:05 smithi082 ceph-mon[84550]: Upgrade: Updating osd.4 2024-02-15T22:49:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:49:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:05 smithi082 ceph-mon[84550]: Deploying daemon osd.4 on smithi082 2024-02-15T22:49:05.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:05 smithi033 ceph-mon[113773]: pgmap v131: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:05.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:05 smithi033 ceph-mon[113773]: Upgrade: Updating osd.4 2024-02-15T22:49:05.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:05.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:49:05.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:05.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:05 smithi033 ceph-mon[113773]: Deploying daemon osd.4 on smithi082 2024-02-15T22:49:07.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:07 smithi082 ceph-mon[84550]: pgmap v132: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:07.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:07 smithi082 systemd[1]: Stopping Ceph osd.4 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:49:07.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:07 smithi033 ceph-mon[113773]: pgmap v132: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:08.125 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:07 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[49426]: 2024-02-15T22:49:07.748+0000 7ff57cbdc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:49:08.125 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:07 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[49426]: 2024-02-15T22:49:07.748+0000 7ff57cbdc700 -1 osd.4 69 *** Got signal Terminated *** 2024-02-15T22:49:08.125 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:07 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[49426]: 2024-02-15T22:49:07.748+0000 7ff57cbdc700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:49:08.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:08 smithi033 ceph-mon[113773]: osd.4 marked itself down and dead 2024-02-15T22:49:08.795 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:08 smithi082 ceph-mon[84550]: osd.4 marked itself down and dead 2024-02-15T22:49:09.084 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:08 smithi082 podman[98914]: 2024-02-15 22:49:08.793866736 +0000 UTC m=+1.148780298 container died c734dc6302af948d5b79d2858ec732f98c6a3037dc7aabfc0102e859e9499175 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, RELEASE=quincy-9aa5233, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-15T22:49:09.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:09 smithi082 podman[98914]: 2024-02-15 22:49:09.182214467 +0000 UTC m=+1.537128023 container cleanup c734dc6302af948d5b79d2858ec732f98c6a3037dc7aabfc0102e859e9499175 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-9aa5233) 2024-02-15T22:49:09.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:09 smithi082 bash[98914]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4 2024-02-15T22:49:09.757 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:09 smithi082 ceph-mon[84550]: pgmap v133: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:09.757 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:09 smithi082 ceph-mon[84550]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:49:09.758 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:09 smithi082 ceph-mon[84550]: failed to encode map e70 with expected crc 2024-02-15T22:49:09.758 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:09 smithi082 ceph-mon[84550]: osdmap e70: 6 total, 5 up, 6 in 2024-02-15T22:49:09.758 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:09 smithi082 podman[98932]: 2024-02-15 22:49:09.458477794 +0000 UTC m=+0.660067576 container remove c734dc6302af948d5b79d2858ec732f98c6a3037dc7aabfc0102e859e9499175 (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9aa5233, org.label-schema.build-date=20240131) 2024-02-15T22:49:09.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:09 smithi033 ceph-mon[113773]: pgmap v133: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:09.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:09 smithi033 ceph-mon[113773]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:49:09.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:09 smithi033 ceph-mon[113773]: failed to encode map e70 with expected crc 2024-02-15T22:49:09.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:09 smithi033 ceph-mon[113773]: osdmap e70: 6 total, 5 up, 6 in 2024-02-15T22:49:10.007 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:09 smithi082 podman[99027]: 2024-02-15 22:49:09.659253736 +0000 UTC m=+0.018070770 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:49:10.008 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:09 smithi082 podman[99027]: 2024-02-15 22:49:09.759467841 +0000 UTC m=+0.118284875 container create 67a9e2d2436d6ac9fc7f7cea25cf28ba23860bfe825e53356b0633cb71a22915 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-15T22:49:10.008 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 podman[99027]: 2024-02-15 22:49:10.003545534 +0000 UTC m=+0.362362560 container init 67a9e2d2436d6ac9fc7f7cea25cf28ba23860bfe825e53356b0633cb71a22915 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-15T22:49:10.008 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 podman[99027]: 2024-02-15 22:49:10.006644121 +0000 UTC m=+0.365461155 container start 67a9e2d2436d6ac9fc7f7cea25cf28ba23860bfe825e53356b0633cb71a22915 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-15T22:49:10.306 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 podman[99027]: 2024-02-15 22:49:10.104023949 +0000 UTC m=+0.462840988 container attach 67a9e2d2436d6ac9fc7f7cea25cf28ba23860bfe825e53356b0633cb71a22915 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:49:10.616 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:10 smithi082 ceph-mon[84550]: failed to encode map e71 with expected crc 2024-02-15T22:49:10.617 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:10 smithi082 ceph-mon[84550]: osdmap e71: 6 total, 5 up, 6 in 2024-02-15T22:49:10.617 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:10 smithi082 ceph-mon[84550]: failed to encode map e71 with expected crc 2024-02-15T22:49:10.617 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 podman[99027]: 2024-02-15 22:49:10.305295317 +0000 UTC m=+0.664112344 container died 67a9e2d2436d6ac9fc7f7cea25cf28ba23860bfe825e53356b0633cb71a22915 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:49:10.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:10 smithi033 ceph-mon[113773]: failed to encode map e71 with expected crc 2024-02-15T22:49:10.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:10 smithi033 ceph-mon[113773]: osdmap e71: 6 total, 5 up, 6 in 2024-02-15T22:49:10.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:10 smithi033 ceph-mon[113773]: failed to encode map e71 with expected crc 2024-02-15T22:49:11.314 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 podman[99053]: 2024-02-15 22:49:10.882367701 +0000 UTC m=+0.572200874 container remove 67a9e2d2436d6ac9fc7f7cea25cf28ba23860bfe825e53356b0633cb71a22915 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-15T22:49:11.314 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-15T22:49:11.315 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 systemd[1]: Stopped Ceph osd.4 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:49:11.315 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:10 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.4.service: Consumed 56.992s CPU time. 2024-02-15T22:49:11.315 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 systemd[1]: Starting Ceph osd.4 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:49:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-mon[84550]: pgmap v136: 65 pgs: 15 peering, 3 stale+active+clean, 47 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-02-15T22:49:11.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-mon[84550]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T22:49:11.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 podman[99155]: 2024-02-15 22:49:11.215976356 +0000 UTC m=+0.018342575 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:49:11.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 podman[99155]: 2024-02-15 22:49:11.316576786 +0000 UTC m=+0.118943006 container create 4017acb938001924499e62b76ef682b9d5e9110f7ef21dcc4c43e0b2f7f8c3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:49:11.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 podman[99155]: 2024-02-15 22:49:11.552633011 +0000 UTC m=+0.354999230 container init 4017acb938001924499e62b76ef682b9d5e9110f7ef21dcc4c43e0b2f7f8c3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:49:11.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 podman[99155]: 2024-02-15 22:49:11.555811157 +0000 UTC m=+0.358177385 container start 4017acb938001924499e62b76ef682b9d5e9110f7ef21dcc4c43e0b2f7f8c3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-15T22:49:11.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:11 smithi033 ceph-mon[113773]: pgmap v136: 65 pgs: 15 peering, 3 stale+active+clean, 47 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-02-15T22:49:11.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:11 smithi033 ceph-mon[113773]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T22:49:11.993 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 podman[99155]: 2024-02-15 22:49:11.644124133 +0000 UTC m=+0.446490362 container attach 4017acb938001924499e62b76ef682b9d5e9110f7ef21dcc4c43e0b2f7f8c3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate[99170]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 bash[99155]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 bash[99155]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 bash[99155]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 bash[99155]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 bash[99155]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 bash[99155]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 bash[99155]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-15T22:49:12.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate[99170]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:49:12.376 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate[99170]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:49:12.376 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate[99170]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:49:12.376 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate[99170]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-15T22:49:12.376 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate[99170]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:49:12.376 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:11 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate[99170]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-15T22:49:12.376 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:12 smithi082 podman[99155]: 2024-02-15 22:49:12.017164521 +0000 UTC m=+0.819530741 container died 4017acb938001924499e62b76ef682b9d5e9110f7ef21dcc4c43e0b2f7f8c3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-15T22:49:12.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:12 smithi082 ceph-mon[84550]: Health check failed: Degraded data redundancy: 41/357 objects degraded (11.485%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:12.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:12 smithi033 ceph-mon[113773]: Health check failed: Degraded data redundancy: 41/357 objects degraded (11.485%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:12.990 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:12 smithi082 podman[99289]: 2024-02-15 22:49:12.681880119 +0000 UTC m=+0.659529723 container remove 4017acb938001924499e62b76ef682b9d5e9110f7ef21dcc4c43e0b2f7f8c3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:49:12.990 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:12 smithi082 podman[99350]: 2024-02-15 22:49:12.891028104 +0000 UTC m=+0.113755939 container create 66b57df413a74c9353a7a5658e9a6fee32eaac710e695080f77d994127eb8cc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=) 2024-02-15T22:49:12.990 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:12 smithi082 podman[99350]: 2024-02-15 22:49:12.795603126 +0000 UTC m=+0.018330910 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:49:13.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:13 smithi082 podman[99350]: 2024-02-15 22:49:13.106138655 +0000 UTC m=+0.328866446 container init 66b57df413a74c9353a7a5658e9a6fee32eaac710e695080f77d994127eb8cc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-15T22:49:13.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:13 smithi082 podman[99350]: 2024-02-15 22:49:13.109303761 +0000 UTC m=+0.332031544 container start 66b57df413a74c9353a7a5658e9a6fee32eaac710e695080f77d994127eb8cc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214) 2024-02-15T22:49:13.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:13 smithi082 bash[99350]: 66b57df413a74c9353a7a5658e9a6fee32eaac710e695080f77d994127eb8cc5 2024-02-15T22:49:13.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:13 smithi082 systemd[1]: Started Ceph osd.4 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:49:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:13 smithi033 ceph-mon[113773]: pgmap v137: 65 pgs: 10 active+undersized+degraded, 15 peering, 9 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 41/357 objects degraded (11.485%) 2024-02-15T22:49:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:13.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:13.874 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:13 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:49:13.650+0000 7fc245cfc7c0 -1 Falling back to public interface 2024-02-15T22:49:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:13 smithi082 ceph-mon[84550]: pgmap v137: 65 pgs: 10 active+undersized+degraded, 15 peering, 9 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 41/357 objects degraded (11.485%) 2024-02-15T22:49:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:15.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:15 smithi033 ceph-mon[113773]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 2 peering, 16 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-02-15T22:49:15.789 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:15 smithi082 ceph-mon[84550]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 2 peering, 16 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-02-15T22:49:17.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:17 smithi033 ceph-mon[113773]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-02-15T22:49:17.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:17 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:17.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:17 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:17.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:17 smithi033 ceph-mon[113773]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-15T22:49:17.525 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:17 smithi082 ceph-mon[84550]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-02-15T22:49:17.525 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:17 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:17.525 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:17 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:17.526 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:17 smithi082 ceph-mon[84550]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-15T22:49:18.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:18 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:18.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:18 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:18.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:18 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:49:18.196+0000 7fc245cfc7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-15T22:49:18.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:18 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:18.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:18 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:18.977 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:18 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:49:18.711+0000 7fc245cfc7c0 -1 osd.4 69 log_to_monitors true 2024-02-15T22:49:19.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:49:19 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:49:19.346+0000 7fc237154700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:49:19.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:19 smithi082 ceph-mon[84550]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-02-15T22:49:19.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:19 smithi082 ceph-mon[84550]: from='osd.4 [v2:172.21.15.82:6808/1062301027,v1:172.21.15.82:6809/1062301027]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:49:19.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:19 smithi082 ceph-mon[84550]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:49:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:19 smithi033 ceph-mon[113773]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-02-15T22:49:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:19 smithi033 ceph-mon[113773]: from='osd.4 [v2:172.21.15.82:6808/1062301027,v1:172.21.15.82:6809/1062301027]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:49:19.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:19 smithi033 ceph-mon[113773]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:49:20.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:20 smithi082 ceph-mon[84550]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:49:20.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:20 smithi082 ceph-mon[84550]: failed to encode map e72 with expected crc 2024-02-15T22:49:20.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:20 smithi082 ceph-mon[84550]: osdmap e72: 6 total, 5 up, 6 in 2024-02-15T22:49:20.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:20 smithi082 ceph-mon[84550]: from='osd.4 [v2:172.21.15.82:6808/1062301027,v1:172.21.15.82:6809/1062301027]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:20.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:20 smithi082 ceph-mon[84550]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:20.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:20 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:20.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:20 smithi033 ceph-mon[113773]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:49:20.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:20 smithi033 ceph-mon[113773]: failed to encode map e72 with expected crc 2024-02-15T22:49:20.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:20 smithi033 ceph-mon[113773]: osdmap e72: 6 total, 5 up, 6 in 2024-02-15T22:49:20.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:20 smithi033 ceph-mon[113773]: from='osd.4 [v2:172.21.15.82:6808/1062301027,v1:172.21.15.82:6809/1062301027]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:20.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:20 smithi033 ceph-mon[113773]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:20.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:20 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: pgmap v142: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 60/357 objects degraded (16.807%) 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: failed to encode map e73 with expected crc 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: osd.4 [v2:172.21.15.82:6808/1062301027,v1:172.21.15.82:6809/1062301027] boot 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: osdmap e73: 6 total, 6 up, 6 in 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:21.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:21.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:21.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:21.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:21.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:21.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:21.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:21.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: pgmap v142: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 60/357 objects degraded (16.807%) 2024-02-15T22:49:21.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:49:21.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: failed to encode map e73 with expected crc 2024-02-15T22:49:21.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: osd.4 [v2:172.21.15.82:6808/1062301027,v1:172.21.15.82:6809/1062301027] boot 2024-02-15T22:49:21.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: osdmap e73: 6 total, 6 up, 6 in 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:21.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:22.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:22 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:22.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:22 smithi082 ceph-mon[84550]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T22:49:22.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:22 smithi082 ceph-mon[84550]: osdmap e74: 6 total, 6 up, 6 in 2024-02-15T22:49:22.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:22 smithi082 ceph-mon[84550]: failed to encode map e74 with expected crc 2024-02-15T22:49:22.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:22 smithi082 ceph-mon[84550]: failed to encode map e74 with expected crc 2024-02-15T22:49:22.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:22 smithi082 ceph-mon[84550]: failed to encode map e74 with expected crc 2024-02-15T22:49:22.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:22 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:22.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:22 smithi033 ceph-mon[113773]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T22:49:22.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:22 smithi033 ceph-mon[113773]: osdmap e74: 6 total, 6 up, 6 in 2024-02-15T22:49:22.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:22 smithi033 ceph-mon[113773]: failed to encode map e74 with expected crc 2024-02-15T22:49:22.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:22 smithi033 ceph-mon[113773]: failed to encode map e74 with expected crc 2024-02-15T22:49:22.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:22 smithi033 ceph-mon[113773]: failed to encode map e74 with expected crc 2024-02-15T22:49:23.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:23 smithi082 ceph-mon[84550]: pgmap v145: 65 pgs: 10 peering, 8 active+undersized+degraded, 10 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 23/357 objects degraded (6.443%) 2024-02-15T22:49:23.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:23 smithi033 ceph-mon[113773]: pgmap v145: 65 pgs: 10 peering, 8 active+undersized+degraded, 10 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 23/357 objects degraded (6.443%) 2024-02-15T22:49:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:25 smithi082 ceph-mon[84550]: pgmap v146: 65 pgs: 10 peering, 3 active+undersized+degraded, 4 active+undersized, 48 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 6/357 objects degraded (1.681%) 2024-02-15T22:49:25.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:25 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 6/357 objects degraded (1.681%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:25.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:25 smithi033 ceph-mon[113773]: pgmap v146: 65 pgs: 10 peering, 3 active+undersized+degraded, 4 active+undersized, 48 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 6/357 objects degraded (1.681%) 2024-02-15T22:49:25.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:25 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 6/357 objects degraded (1.681%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:26.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:26 smithi033 ceph-mon[113773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/357 objects degraded (1.681%), 3 pgs degraded) 2024-02-15T22:49:26.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:26 smithi033 ceph-mon[113773]: Cluster is now healthy 2024-02-15T22:49:26.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:26 smithi082 ceph-mon[84550]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/357 objects degraded (1.681%), 3 pgs degraded) 2024-02-15T22:49:26.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:26 smithi082 ceph-mon[84550]: Cluster is now healthy 2024-02-15T22:49:27.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:27 smithi033 ceph-mon[113773]: pgmap v147: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-02-15T22:49:27.776 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:27 smithi082 ceph-mon[84550]: pgmap v147: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-02-15T22:49:29.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:29 smithi082 ceph-mon[84550]: pgmap v148: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-15T22:49:29.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:29.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:29.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:29 smithi033 ceph-mon[113773]: pgmap v148: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-15T22:49:29.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:29.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:31.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:31 smithi033 ceph-mon[113773]: pgmap v149: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:31.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:31 smithi082 ceph-mon[84550]: pgmap v149: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:33 smithi082 ceph-mon[84550]: pgmap v150: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:49:33.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:33 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:34.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:33 smithi033 ceph-mon[113773]: pgmap v150: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:49:34.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:33 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:34.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 -- 172.21.15.33:0/850678162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fe8f0 msgr2=0x7fd6cc107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 --2- 172.21.15.33:0/850678162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fe8f0 0x7fd6cc107050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc004970 tx=0x7fd6bc009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:34.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 -- 172.21.15.33:0/850678162 shutdown_connections 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 --2- 172.21.15.33:0/850678162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fe8f0 0x7fd6cc107050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 --2- 172.21.15.33:0/850678162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc0fdfe0 0x7fd6cc0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 -- 172.21.15.33:0/850678162 >> 172.21.15.33:0/850678162 conn(0x7fd6cc071d90 msgr2=0x7fd6cc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 -- 172.21.15.33:0/850678162 shutdown_connections 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.096+0000 7fd6d338f700 1 -- 172.21.15.33:0/850678162 wait complete. 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d338f700 1 Processor -- start 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d338f700 1 -- start start 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d338f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fdfe0 0x7fd6cc1139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d338f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc0fe8f0 0x7fd6cc113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d338f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc114580 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d338f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc10d8b0 con 0x7fd6cc0fe8f0 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d112b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fdfe0 0x7fd6cc1139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d112b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fdfe0 0x7fd6cc1139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51618/0 (socket says 172.21.15.33:51618) 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d112b700 1 -- 172.21.15.33:0/2641549371 learned_addr learned my addr 172.21.15.33:0/2641549371 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.097+0000 7fd6d092a700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc0fe8f0 0x7fd6cc113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6d112b700 1 -- 172.21.15.33:0/2641549371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc0fe8f0 msgr2=0x7fd6cc113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6d112b700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc0fe8f0 0x7fd6cc113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6d112b700 1 -- 172.21.15.33:0/2641549371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc005040 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6d112b700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fdfe0 0x7fd6cc1139f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8002a80 tx=0x7fd6c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6c1ffb700 1 -- 172.21.15.33:0/2641549371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c8007cc0 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6c1ffb700 1 -- 172.21.15.33:0/2641549371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6c800f040 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc10db90 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6c1ffb700 1 -- 172.21.15.33:0/2641549371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c800dac0 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.098+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc10e0a0 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.099+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc1046c0 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.100+0000 7fd6c1ffb700 1 -- 172.21.15.33:0/2641549371 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd6c800dc20 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.100+0000 7fd6c1ffb700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6b806d7e0 0x7fd6b806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.100+0000 7fd6c1ffb700 1 -- 172.21.15.33:0/2641549371 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fd6c808cb10 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.100+0000 7fd6d092a700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6b806d7e0 0x7fd6b806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.101+0000 7fd6d092a700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6b806d7e0 0x7fd6b806fc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc000c00 tx=0x7fd6bc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:34.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.105+0000 7fd6c1ffb700 1 -- 172.21.15.33:0/2641549371 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd6c8059e90 con 0x7fd6cc0fdfe0 2024-02-15T22:49:34.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.327+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6cc04bed0 con 0x7fd6b806d7e0 2024-02-15T22:49:34.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.329+0000 7fd6c1ffb700 1 -- 172.21.15.33:0/2641549371 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd6cc04bed0 con 0x7fd6b806d7e0 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6b806d7e0 msgr2=0x7fd6b806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6b806d7e0 0x7fd6b806fc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc000c00 tx=0x7fd6bc009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fdfe0 msgr2=0x7fd6cc1139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fdfe0 0x7fd6cc1139f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8002a80 tx=0x7fd6c80046b0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 shutdown_connections 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd6b806d7e0 0x7fd6b806fc90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6cc0fdfe0 0x7fd6cc1139f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 --2- 172.21.15.33:0/2641549371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc0fe8f0 0x7fd6cc113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 >> 172.21.15.33:0/2641549371 conn(0x7fd6cc071d90 msgr2=0x7fd6cc101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 shutdown_connections 2024-02-15T22:49:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.331+0000 7fd6d338f700 1 -- 172.21.15.33:0/2641549371 wait complete. 2024-02-15T22:49:34.343 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:49:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.434+0000 7fdd78e87700 1 -- 172.21.15.33:0/3580568798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 msgr2=0x7fdd74102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.434+0000 7fdd78e87700 1 --2- 172.21.15.33:0/3580568798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd74102210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd64004940 tx=0x7fdd64009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 -- 172.21.15.33:0/3580568798 shutdown_connections 2024-02-15T22:49:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 --2- 172.21.15.33:0/3580568798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd741027e0 0x7fdd740fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 --2- 172.21.15.33:0/3580568798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd74102210 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 -- 172.21.15.33:0/3580568798 >> 172.21.15.33:0/3580568798 conn(0x7fdd74071d90 msgr2=0x7fdd74072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 -- 172.21.15.33:0/3580568798 shutdown_connections 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 -- 172.21.15.33:0/3580568798 wait complete. 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 Processor -- start 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 -- start start 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd7410ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd741027e0 0x7fdd7410ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7410f520 con 0x7fdd74101e40 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.435+0000 7fdd78e87700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7410f660 con 0x7fdd741027e0 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd7259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd7410ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd7259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd7410ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51634/0 (socket says 172.21.15.33:51634) 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd7259c700 1 -- 172.21.15.33:0/4268031150 learned_addr learned my addr 172.21.15.33:0/4268031150 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd71d9b700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd741027e0 0x7fdd7410ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd7259c700 1 -- 172.21.15.33:0/4268031150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd741027e0 msgr2=0x7fdd7410ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd7259c700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd741027e0 0x7fdd7410ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd7259c700 1 -- 172.21.15.33:0/4268031150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd64005040 con 0x7fdd74101e40 2024-02-15T22:49:34.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd7259c700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd7410ea50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009180 tx=0x7fdd64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:34.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd62ffd700 1 -- 172.21.15.33:0/4268031150 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd64021070 con 0x7fdd74101e40 2024-02-15T22:49:34.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd74117960 con 0x7fdd74101e40 2024-02-15T22:49:34.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd62ffd700 1 -- 172.21.15.33:0/4268031150 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd64013dd0 con 0x7fdd74101e40 2024-02-15T22:49:34.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd62ffd700 1 -- 172.21.15.33:0/4268031150 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd6400e030 con 0x7fdd74101e40 2024-02-15T22:49:34.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.436+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd74117e70 con 0x7fdd74101e40 2024-02-15T22:49:34.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.438+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd740738b0 con 0x7fdd74101e40 2024-02-15T22:49:34.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.438+0000 7fdd62ffd700 1 -- 172.21.15.33:0/4268031150 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdd6401cbf0 con 0x7fdd74101e40 2024-02-15T22:49:34.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.439+0000 7fdd62ffd700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdd5c06d7f0 0x7fdd5c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.439+0000 7fdd62ffd700 1 -- 172.21.15.33:0/4268031150 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fdd6408e3d0 con 0x7fdd74101e40 2024-02-15T22:49:34.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.439+0000 7fdd71d9b700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdd5c06d7f0 0x7fdd5c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.440+0000 7fdd71d9b700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdd5c06d7f0 0x7fdd5c06fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd68004600 tx=0x7fdd6800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:34.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.444+0000 7fdd62ffd700 1 -- 172.21.15.33:0/4268031150 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdd64057d40 con 0x7fdd74101e40 2024-02-15T22:49:34.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.667+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd74065fd0 con 0x7fdd5c06d7f0 2024-02-15T22:49:34.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.668+0000 7fdd62ffd700 1 -- 172.21.15.33:0/4268031150 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdd74065fd0 con 0x7fdd5c06d7f0 2024-02-15T22:49:34.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdd5c06d7f0 msgr2=0x7fdd5c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdd5c06d7f0 0x7fdd5c06fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd68004600 tx=0x7fdd6800b040 comp rx=0 tx=0).stop 2024-02-15T22:49:34.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 msgr2=0x7fdd7410ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd7410ea50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009180 tx=0x7fdd64009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 shutdown_connections 2024-02-15T22:49:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdd5c06d7f0 0x7fdd5c06fca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd74101e40 0x7fdd7410ea50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 --2- 172.21.15.33:0/4268031150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd741027e0 0x7fdd7410ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 >> 172.21.15.33:0/4268031150 conn(0x7fdd74071d90 msgr2=0x7fdd740facb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 shutdown_connections 2024-02-15T22:49:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.670+0000 7fdd78e87700 1 -- 172.21.15.33:0/4268031150 wait complete. 2024-02-15T22:49:34.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 -- 172.21.15.33:0/227984762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fe900 msgr2=0x7fb970106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 --2- 172.21.15.33:0/227984762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fe900 0x7fb970106f40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb964004940 tx=0x7fb964009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 -- 172.21.15.33:0/227984762 shutdown_connections 2024-02-15T22:49:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 --2- 172.21.15.33:0/227984762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fe900 0x7fb970106f40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 --2- 172.21.15.33:0/227984762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9700fdf60 0x7fb9700fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 -- 172.21.15.33:0/227984762 >> 172.21.15.33:0/227984762 conn(0x7fb9700f7a10 msgr2=0x7fb9700f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 -- 172.21.15.33:0/227984762 shutdown_connections 2024-02-15T22:49:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.773+0000 7fb97574b700 1 -- 172.21.15.33:0/227984762 wait complete. 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb97574b700 1 Processor -- start 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb97574b700 1 -- start start 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb97574b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fdf60 0x7fb970113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb97574b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9700fe900 0x7fb970114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb97574b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9701146c0 con 0x7fb9700fdf60 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb97574b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97010d9f0 con 0x7fb9700fe900 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb96effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fdf60 0x7fb970113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb96effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fdf60 0x7fb970113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51646/0 (socket says 172.21.15.33:51646) 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.774+0000 7fb96effd700 1 -- 172.21.15.33:0/3846063002 learned_addr learned my addr 172.21.15.33:0/3846063002 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb96e7fc700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9700fe900 0x7fb970114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb96effd700 1 -- 172.21.15.33:0/3846063002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9700fe900 msgr2=0x7fb970114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb96effd700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9700fe900 0x7fb970114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb96effd700 1 -- 172.21.15.33:0/3846063002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964005040 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb96effd700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fdf60 0x7fb970113b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c8c0 tx=0x7fb9600044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb9577fe700 1 -- 172.21.15.33:0/3846063002 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb96000a760 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb9577fe700 1 -- 172.21.15.33:0/3846063002 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb96000ad90 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97010dcd0 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb9577fe700 1 -- 172.21.15.33:0/3846063002 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9600113a0 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.775+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97010e1e0 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.776+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb970104550 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.777+0000 7fb9577fe700 1 -- 172.21.15.33:0/3846063002 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb960012400 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.777+0000 7fb9577fe700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb95806d7e0 0x7fb95806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.777+0000 7fb9577fe700 1 -- 172.21.15.33:0/3846063002 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fb96008cd90 con 0x7fb9700fdf60 2024-02-15T22:49:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.777+0000 7fb96e7fc700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb95806d7e0 0x7fb95806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.778+0000 7fb96e7fc700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb95806d7e0 0x7fb95806fc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb97010ed20 tx=0x7fb964009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.782+0000 7fb9577fe700 1 -- 172.21.15.33:0/3846063002 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb96005a2d0 con 0x7fb9700fdf60 2024-02-15T22:49:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:34.993+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb97004bed0 con 0x7fb95806d7e0 2024-02-15T22:49:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.003+0000 7fb9577fe700 1 -- 172.21.15.33:0/3846063002 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb97004bed0 con 0x7fb95806d7e0 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (5m) 85s ago 16m 26.3M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (3m) 85s ago 17m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (3m) 18s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (5m) 85s ago 16m 87.4M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (11m) 85s ago 11m 114M - 17.2.7-509-g9aa52330 61c0ec9cd187 09fcadff619c 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (11m) 85s ago 11m 75.3M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (11m) 18s ago 11m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (11m) 18s ago 11m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (7m) 85s ago 18m 500M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:49:35.005 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (6m) 18s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (4m) 85s ago 18m 48.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (3m) 18s ago 15m 38.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (6m) 85s ago 16m 16.4M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 18s ago 15m 16.5M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (2m) 85s ago 14m 87.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 85s ago 14m 97.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (91s) 85s ago 13m 12.6M 1559M 19.0.0-1450-gf78a58c0 f081f847070a dfdcfe354b41 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (55s) 18s ago 13m 97.8M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 7778c235281a 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (22s) 18s ago 13m 11.8M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 66b57df413a7 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (12m) 18s ago 12m 224M 2581M 17.2.7-509-g9aa52330 61c0ec9cd187 0d1a8fd66639 2024-02-15T22:49:35.006 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (6m) 85s ago 16m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:49:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb95806d7e0 msgr2=0x7fb95806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb95806d7e0 0x7fb95806fc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb97010ed20 tx=0x7fb964009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fdf60 msgr2=0x7fb970113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fdf60 0x7fb970113b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c8c0 tx=0x7fb9600044c0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 shutdown_connections 2024-02-15T22:49:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb95806d7e0 0x7fb95806fc90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9700fdf60 0x7fb970113b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 --2- 172.21.15.33:0/3846063002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9700fe900 0x7fb970114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 >> 172.21.15.33:0/3846063002 conn(0x7fb9700f7a10 msgr2=0x7fb9701016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 shutdown_connections 2024-02-15T22:49:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.005+0000 7fb97574b700 1 -- 172.21.15.33:0/3846063002 wait complete. 2024-02-15T22:49:35.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.106+0000 7f14258d1700 1 -- 172.21.15.33:0/3156370956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14201027e0 msgr2=0x7f14200fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.106+0000 7f14258d1700 1 --2- 172.21.15.33:0/3156370956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14201027e0 0x7f14200fbe50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1414004940 tx=0x7f1414009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.106+0000 7f14258d1700 1 -- 172.21.15.33:0/3156370956 shutdown_connections 2024-02-15T22:49:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.106+0000 7f14258d1700 1 --2- 172.21.15.33:0/3156370956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14201027e0 0x7f14200fbe50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.106+0000 7f14258d1700 1 --2- 172.21.15.33:0/3156370956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1420101e40 0x7f1420102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.106+0000 7f14258d1700 1 -- 172.21.15.33:0/3156370956 >> 172.21.15.33:0/3156370956 conn(0x7f14200f79d0 msgr2=0x7f14200f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.107+0000 7f14258d1700 1 -- 172.21.15.33:0/3156370956 shutdown_connections 2024-02-15T22:49:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.107+0000 7f14258d1700 1 -- 172.21.15.33:0/3156370956 wait complete. 2024-02-15T22:49:35.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.107+0000 7f14258d1700 1 Processor -- start 2024-02-15T22:49:35.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.107+0000 7f14258d1700 1 -- start start 2024-02-15T22:49:35.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14258d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1420101e40 0x7f14200fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14258d1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14201027e0 0x7f14200fe000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14258d1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200fe600 con 0x7f1420101e40 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14258d1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200fe770 con 0x7f14201027e0 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1420101e40 0x7f14200fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1420101e40 0x7f14200fdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51676/0 (socket says 172.21.15.33:51676) 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141effd700 1 -- 172.21.15.33:0/1885116588 learned_addr learned my addr 172.21.15.33:0/1885116588 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141e7fc700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14201027e0 0x7f14200fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141effd700 1 -- 172.21.15.33:0/1885116588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14201027e0 msgr2=0x7f14200fe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141effd700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14201027e0 0x7f14200fe000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141effd700 1 -- 172.21.15.33:0/1885116588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414005040 con 0x7f1420101e40 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f141effd700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1420101e40 0x7f14200fdac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f141000eb40 tx=0x7f141000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14077fe700 1 -- 172.21.15.33:0/1885116588 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1410007cc0 con 0x7f1420101e40 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14077fe700 1 -- 172.21.15.33:0/1885116588 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f141000f040 con 0x7f1420101e40 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14077fe700 1 -- 172.21.15.33:0/1885116588 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141000ca10 con 0x7f1420101e40 2024-02-15T22:49:35.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.108+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420119c30 con 0x7f1420101e40 2024-02-15T22:49:35.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.109+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142011a090 con 0x7f1420101e40 2024-02-15T22:49:35.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.109+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14200fb5d0 con 0x7f1420101e40 2024-02-15T22:49:35.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.110+0000 7f14077fe700 1 -- 172.21.15.33:0/1885116588 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f141000cb70 con 0x7f1420101e40 2024-02-15T22:49:35.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.111+0000 7f14077fe700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f140806d7e0 0x7f140806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.111+0000 7f14077fe700 1 -- 172.21.15.33:0/1885116588 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f141008c900 con 0x7f1420101e40 2024-02-15T22:49:35.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.111+0000 7f141e7fc700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f140806d7e0 0x7f140806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.111+0000 7f141e7fc700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f140806d7e0 0x7f140806fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1414009b30 tx=0x7f1414009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:35.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.117+0000 7f14077fe700 1 -- 172.21.15.33:0/1885116588 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1410056320 con 0x7f1420101e40 2024-02-15T22:49:35.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.410+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f14200ff2a0 con 0x7f1420101e40 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.411+0000 7f14077fe700 1 -- 172.21.15.33:0/1885116588 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f14100599e0 con 0x7f1420101e40 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:35.413 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 1, 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 4 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 5, 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 9 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:49:35.414 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:49:35.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f140806d7e0 msgr2=0x7f140806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f140806d7e0 0x7f140806fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1414009b30 tx=0x7f1414009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:35.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1420101e40 msgr2=0x7f14200fdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1420101e40 0x7f14200fdac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f141000eb40 tx=0x7f141000b040 comp rx=0 tx=0).stop 2024-02-15T22:49:35.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 shutdown_connections 2024-02-15T22:49:35.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f140806d7e0 0x7f140806fc90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1420101e40 0x7f14200fdac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 --2- 172.21.15.33:0/1885116588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14201027e0 0x7f14200fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 >> 172.21.15.33:0/1885116588 conn(0x7f14200f79d0 msgr2=0x7f1420066030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:35.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 shutdown_connections 2024-02-15T22:49:35.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.413+0000 7f14258d1700 1 -- 172.21.15.33:0/1885116588 wait complete. 2024-02-15T22:49:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 -- 172.21.15.33:0/2723842127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c1038f0 msgr2=0x7f9b5c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 --2- 172.21.15.33:0/2723842127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c1038f0 0x7f9b5c0fcf60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b50004940 tx=0x7f9b50009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 -- 172.21.15.33:0/2723842127 shutdown_connections 2024-02-15T22:49:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 --2- 172.21.15.33:0/2723842127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c1038f0 0x7f9b5c0fcf60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 --2- 172.21.15.33:0/2723842127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b5c102f50 0x7f9b5c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 -- 172.21.15.33:0/2723842127 >> 172.21.15.33:0/2723842127 conn(0x7f9b5c0f8ae0 msgr2=0x7f9b5c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 -- 172.21.15.33:0/2723842127 shutdown_connections 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.516+0000 7f9b622aa700 1 -- 172.21.15.33:0/2723842127 wait complete. 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b622aa700 1 Processor -- start 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b622aa700 1 -- start start 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b622aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c102f50 0x7f9b5c113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b622aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b5c1038f0 0x7f9b5c113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b622aa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c114620 con 0x7f9b5c102f50 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b622aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c10d950 con 0x7f9b5c1038f0 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b5bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c102f50 0x7f9b5c113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b5bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c102f50 0x7f9b5c113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51690/0 (socket says 172.21.15.33:51690) 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.517+0000 7f9b5bfff700 1 -- 172.21.15.33:0/1960600491 learned_addr learned my addr 172.21.15.33:0/1960600491 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b5b7fe700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b5c1038f0 0x7f9b5c113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b5bfff700 1 -- 172.21.15.33:0/1960600491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b5c1038f0 msgr2=0x7f9b5c113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b5bfff700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b5c1038f0 0x7f9b5c113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b5bfff700 1 -- 172.21.15.33:0/1960600491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50005040 con 0x7f9b5c102f50 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b5b7fe700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b5c1038f0 0x7f9b5c113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b5bfff700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c102f50 0x7f9b5c113a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c830 tx=0x7f9b4c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b58ff9700 1 -- 172.21.15.33:0/1960600491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b4c00a760 con 0x7f9b5c102f50 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b58ff9700 1 -- 172.21.15.33:0/1960600491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b4c00ad90 con 0x7f9b5c102f50 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c10dc30 con 0x7f9b5c102f50 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b58ff9700 1 -- 172.21.15.33:0/1960600491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b4c0113a0 con 0x7f9b5c102f50 2024-02-15T22:49:35.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.518+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c10e170 con 0x7f9b5c102f50 2024-02-15T22:49:35.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.519+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c105420 con 0x7f9b5c102f50 2024-02-15T22:49:35.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.520+0000 7f9b58ff9700 1 -- 172.21.15.33:0/1960600491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9b4c012400 con 0x7f9b5c102f50 2024-02-15T22:49:35.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.520+0000 7f9b58ff9700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9b4406d7e0 0x7f9b4406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.520+0000 7f9b58ff9700 1 -- 172.21.15.33:0/1960600491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9b4c08cdb0 con 0x7f9b5c102f50 2024-02-15T22:49:35.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.520+0000 7f9b5b7fe700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9b4406d7e0 0x7f9b4406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.520+0000 7f9b5b7fe700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9b4406d7e0 0x7f9b4406fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000b3b0 tx=0x7f9b50009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:35.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.525+0000 7f9b58ff9700 1 -- 172.21.15.33:0/1960600491 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9b4c05a2f0 con 0x7f9b5c102f50 2024-02-15T22:49:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:35 smithi033 ceph-mon[113773]: pgmap v151: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:49:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:35 smithi033 ceph-mon[113773]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:35 smithi033 ceph-mon[113773]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:35 smithi033 ceph-mon[113773]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:35.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:35 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1885116588' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.770+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b5c04bed0 con 0x7f9b5c102f50 2024-02-15T22:49:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.771+0000 7f9b58ff9700 1 -- 172.21.15.33:0/1960600491 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f9b4c059e80 con 0x7f9b5c102f50 2024-02-15T22:49:35.772 INFO:teuthology.orchestra.run.smithi033.stdout:e22 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 22 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:45:43.833198+0000 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:49:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14470,1=24295} 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:49:35.774 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.33:6826/3373069689,v1:172.21.15.33:6827/3373069689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/1442215635,v1:172.21.15.33:6829/1442215635] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{1:24295} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6824/998691031,v1:172.21.15.82:6825/998691031] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:24305} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6826/2744053727,v1:172.21.15.82:6827/2744053727] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:49:35.775 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.773+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9b4406d7e0 msgr2=0x7f9b4406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.773+0000 7f9b622aa700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9b4406d7e0 0x7f9b4406fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000b3b0 tx=0x7f9b50009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.773+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c102f50 msgr2=0x7f9b5c113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.773+0000 7f9b622aa700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c102f50 0x7f9b5c113a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c830 tx=0x7f9b4c004470 comp rx=0 tx=0).stop 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.774+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 shutdown_connections 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.774+0000 7f9b622aa700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9b4406d7e0 0x7f9b4406fc90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.774+0000 7f9b622aa700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b5c102f50 0x7f9b5c113a90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.774+0000 7f9b622aa700 1 --2- 172.21.15.33:0/1960600491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b5c1038f0 0x7f9b5c113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.774+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 >> 172.21.15.33:0/1960600491 conn(0x7f9b5c0f8ae0 msgr2=0x7f9b5c0fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:35.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.774+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 shutdown_connections 2024-02-15T22:49:35.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.774+0000 7f9b622aa700 1 -- 172.21.15.33:0/1960600491 wait complete. 2024-02-15T22:49:35.777 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:49:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:35 smithi082 ceph-mon[84550]: pgmap v151: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:49:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:35 smithi082 ceph-mon[84550]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:35 smithi082 ceph-mon[84550]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:35 smithi082 ceph-mon[84550]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:35.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:35 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1885116588' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 -- 172.21.15.33:0/2422195141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 msgr2=0x7ff46c0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 --2- 172.21.15.33:0/2422195141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c0fbe70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff468004940 tx=0x7ff468009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 -- 172.21.15.33:0/2422195141 shutdown_connections 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 --2- 172.21.15.33:0/2422195141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c0fbe70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 --2- 172.21.15.33:0/2422195141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff46c101e60 0x7ff46c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 -- 172.21.15.33:0/2422195141 >> 172.21.15.33:0/2422195141 conn(0x7ff46c0f7a10 msgr2=0x7ff46c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 -- 172.21.15.33:0/2422195141 shutdown_connections 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.878+0000 7ff4740bb700 1 -- 172.21.15.33:0/2422195141 wait complete. 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff4740bb700 1 Processor -- start 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff4740bb700 1 -- start start 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff4740bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff46c101e60 0x7ff46c10eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff4740bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c10f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff4740bb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c10f680 con 0x7ff46c102800 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff4740bb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c10f7f0 con 0x7ff46c101e60 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471656700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c10f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471656700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c10f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51708/0 (socket says 172.21.15.33:51708) 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471656700 1 -- 172.21.15.33:0/2912147670 learned_addr learned my addr 172.21.15.33:0/2912147670 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471e57700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff46c101e60 0x7ff46c10eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471656700 1 -- 172.21.15.33:0/2912147670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff46c101e60 msgr2=0x7ff46c10eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471656700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff46c101e60 0x7ff46c10eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471656700 1 -- 172.21.15.33:0/2912147670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468005040 con 0x7ff46c102800 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.879+0000 7ff471656700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c10f060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff468009100 tx=0x7ff468009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.880+0000 7ff4627fc700 1 -- 172.21.15.33:0/2912147670 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff46800e040 con 0x7ff46c102800 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.880+0000 7ff4627fc700 1 -- 172.21.15.33:0/2912147670 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff46800bbf0 con 0x7ff46c102800 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.880+0000 7ff4740bb700 1 -- 172.21.15.33:0/2912147670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c117ae0 con 0x7ff46c102800 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.880+0000 7ff4627fc700 1 -- 172.21.15.33:0/2912147670 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff46801c3f0 con 0x7ff46c102800 2024-02-15T22:49:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.880+0000 7ff4740bb700 1 -- 172.21.15.33:0/2912147670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c118020 con 0x7ff46c102800 2024-02-15T22:49:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.881+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c0fb610 con 0x7ff46c102800 2024-02-15T22:49:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.881+0000 7ff4627fc700 1 -- 172.21.15.33:0/2912147670 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff46800bd60 con 0x7ff46c102800 2024-02-15T22:49:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.882+0000 7ff4627fc700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff45806d7e0 0x7ff45806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.882+0000 7ff4627fc700 1 -- 172.21.15.33:0/2912147670 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6242+0+0 (secure 0 0 0) 0x7ff46808dff0 con 0x7ff46c102800 2024-02-15T22:49:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.882+0000 7ff471e57700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff45806d7e0 0x7ff45806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.882+0000 7ff471e57700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff45806d7e0 0x7ff45806fc90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009b60 tx=0x7ff45c0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:35.886+0000 7ff4627fc700 1 -- 172.21.15.33:0/2912147670 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff4680579a0 con 0x7ff46c102800 2024-02-15T22:49:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.109+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff46c04bed0 con 0x7ff45806d7e0 2024-02-15T22:49:36.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.110+0000 7ff4627fc700 1 -- 172.21.15.33:0/2912147670 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff46c04bed0 con 0x7ff45806d7e0 2024-02-15T22:49:36.112 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:49:36.112 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:49:36.112 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:49:36.112 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "11/21 daemons upgraded", 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:49:36.113 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff45806d7e0 msgr2=0x7ff45806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff45806d7e0 0x7ff45806fc90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009b60 tx=0x7ff45c0091a0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 msgr2=0x7ff46c10f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c10f060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff468009100 tx=0x7ff468009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 shutdown_connections 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff45806d7e0 0x7ff45806fc90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff46c101e60 0x7ff46c10eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 --2- 172.21.15.33:0/2912147670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff46c102800 0x7ff46c10f060 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 >> 172.21.15.33:0/2912147670 conn(0x7ff46c0f7a10 msgr2=0x7ff46c0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 shutdown_connections 2024-02-15T22:49:36.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.113+0000 7ff457fff700 1 -- 172.21.15.33:0/2912147670 wait complete. 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.217+0000 7f16e201a700 1 -- 172.21.15.33:0/2138046781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 msgr2=0x7f16dc0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.217+0000 7f16e201a700 1 --2- 172.21.15.33:0/2138046781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc0fcf60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f16d0004940 tx=0x7f16d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.217+0000 7f16e201a700 1 -- 172.21.15.33:0/2138046781 shutdown_connections 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.217+0000 7f16e201a700 1 --2- 172.21.15.33:0/2138046781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc0fcf60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.217+0000 7f16e201a700 1 --2- 172.21.15.33:0/2138046781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16dc102f50 0x7f16dc103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.217+0000 7f16e201a700 1 -- 172.21.15.33:0/2138046781 >> 172.21.15.33:0/2138046781 conn(0x7f16dc0f8ae0 msgr2=0x7f16dc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.217+0000 7f16e201a700 1 -- 172.21.15.33:0/2138046781 shutdown_connections 2024-02-15T22:49:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.218+0000 7f16e201a700 1 -- 172.21.15.33:0/2138046781 wait complete. 2024-02-15T22:49:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.218+0000 7f16e201a700 1 Processor -- start 2024-02-15T22:49:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.218+0000 7f16e201a700 1 -- start start 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.218+0000 7f16e201a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16dc102f50 0x7f16dc113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16e201a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16e201a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc114590 con 0x7f16dc1038f0 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16e201a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc10d8c0 con 0x7f16dc102f50 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16daffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16dc102f50 0x7f16dc113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16daffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51716/0 (socket says 172.21.15.33:51716) 2024-02-15T22:49:36.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16daffd700 1 -- 172.21.15.33:0/1151741418 learned_addr learned my addr 172.21.15.33:0/1151741418 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16daffd700 1 -- 172.21.15.33:0/1151741418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16dc102f50 msgr2=0x7f16dc113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16daffd700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16dc102f50 0x7f16dc113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16daffd700 1 -- 172.21.15.33:0/1151741418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0005040 con 0x7f16dc1038f0 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16db7fe700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16dc102f50 0x7f16dc113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16daffd700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc113f40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000c00 tx=0x7f16d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16c3fff700 1 -- 172.21.15.33:0/1151741418 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d0021070 con 0x7f16dc1038f0 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc10db40 con 0x7f16dc1038f0 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16c3fff700 1 -- 172.21.15.33:0/1151741418 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16d0013d00 con 0x7f16dc1038f0 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16c3fff700 1 -- 172.21.15.33:0/1151741418 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d000e070 con 0x7f16dc1038f0 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.219+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc10e020 con 0x7f16dc1038f0 2024-02-15T22:49:36.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.220+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc105420 con 0x7f16dc1038f0 2024-02-15T22:49:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.221+0000 7f16c3fff700 1 -- 172.21.15.33:0/1151741418 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f16d001caf0 con 0x7f16dc1038f0 2024-02-15T22:49:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.221+0000 7f16c3fff700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f16c406d7e0 0x7f16c406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.222+0000 7f16c3fff700 1 -- 172.21.15.33:0/1151741418 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f16d008e2f0 con 0x7f16dc1038f0 2024-02-15T22:49:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.222+0000 7f16db7fe700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f16c406d7e0 0x7f16c406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.222+0000 7f16db7fe700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f16c406d7e0 0x7f16c406fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009b80 tx=0x7f16cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:36.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.226+0000 7f16c3fff700 1 -- 172.21.15.33:0/1151741418 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f16d005b790 con 0x7f16dc1038f0 2024-02-15T22:49:36.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.511+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f16dc10a030 con 0x7f16dc1038f0 2024-02-15T22:49:36.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.511+0000 7f16c3fff700 1 -- 172.21.15.33:0/1151741418 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f16d005b320 con 0x7f16dc1038f0 2024-02-15T22:49:36.513 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f16c406d7e0 msgr2=0x7f16c406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f16c406d7e0 0x7f16c406fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009b80 tx=0x7f16cc00b040 comp rx=0 tx=0).stop 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 msgr2=0x7f16dc113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc113f40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000c00 tx=0x7f16d0009e30 comp rx=0 tx=0).stop 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 shutdown_connections 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f16c406d7e0 0x7f16c406fc90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16dc102f50 0x7f16dc113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 --2- 172.21.15.33:0/1151741418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16dc1038f0 0x7f16dc113f40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:36.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 >> 172.21.15.33:0/1151741418 conn(0x7f16dc0f8ae0 msgr2=0x7f16dc0fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:36.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 shutdown_connections 2024-02-15T22:49:36.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:49:36.514+0000 7f16e201a700 1 -- 172.21.15.33:0/1151741418 wait complete. 2024-02-15T22:49:36.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:36 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1960600491' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:49:36.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:36 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:36.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:36 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1151741418' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:49:36.823 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:36 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1960600491' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:49:36.823 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:36 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:36.823 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:36 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1151741418' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:49:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:37 smithi082 ceph-mon[84550]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:37 smithi082 ceph-mon[84550]: Upgrade: osd.5 is safe to restart 2024-02-15T22:49:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:37 smithi082 ceph-mon[84550]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:37.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:37 smithi082 ceph-mon[84550]: pgmap v152: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:38.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:37 smithi033 ceph-mon[113773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:49:38.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:37 smithi033 ceph-mon[113773]: Upgrade: osd.5 is safe to restart 2024-02-15T22:49:38.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:37 smithi033 ceph-mon[113773]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:38.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:37 smithi033 ceph-mon[113773]: pgmap v152: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:38.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:38 smithi082 ceph-mon[84550]: Upgrade: Updating osd.5 2024-02-15T22:49:38.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:38 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:38.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:38 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:49:38.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:38 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:38.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:38 smithi082 ceph-mon[84550]: Deploying daemon osd.5 on smithi082 2024-02-15T22:49:39.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:38 smithi033 ceph-mon[113773]: Upgrade: Updating osd.5 2024-02-15T22:49:39.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:38 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:39.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:38 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:49:39.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:38 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:39.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:38 smithi033 ceph-mon[113773]: Deploying daemon osd.5 on smithi082 2024-02-15T22:49:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:39 smithi082 ceph-mon[84550]: pgmap v153: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:40.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:39 smithi033 ceph-mon[113773]: pgmap v153: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:41.104 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:40 smithi082 systemd[1]: Stopping Ceph osd.5 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:49:41.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:41 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[55888]: 2024-02-15T22:49:41.102+0000 7f599c701700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:49:41.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:41 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[55888]: 2024-02-15T22:49:41.102+0000 7f599c701700 -1 osd.5 74 *** Got signal Terminated *** 2024-02-15T22:49:41.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:41 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[55888]: 2024-02-15T22:49:41.102+0000 7f599c701700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:49:41.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:41 smithi082 ceph-mon[84550]: pgmap v154: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:41.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:41 smithi082 ceph-mon[84550]: osd.5 marked itself down and dead 2024-02-15T22:49:42.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:41 smithi033 ceph-mon[113773]: pgmap v154: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:42.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:41 smithi033 ceph-mon[113773]: osd.5 marked itself down and dead 2024-02-15T22:49:42.263 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:41 smithi082 podman[103937]: 2024-02-15 22:49:41.978124494 +0000 UTC m=+0.981053226 container died 0d1a8fd66639863e25034326907612231142032422a57eff6161b1e6e95b4f7c (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=quincy-9aa5233, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2) 2024-02-15T22:49:42.607 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:42 smithi082 podman[103937]: 2024-02-15 22:49:42.361212579 +0000 UTC m=+1.364141309 container cleanup 0d1a8fd66639863e25034326907612231142032422a57eff6161b1e6e95b4f7c (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, RELEASE=quincy-9aa5233, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:49:42.607 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:42 smithi082 bash[103937]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5 2024-02-15T22:49:42.875 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:42 smithi082 podman[103964]: 2024-02-15 22:49:42.612475934 +0000 UTC m=+0.634572563 container remove 0d1a8fd66639863e25034326907612231142032422a57eff6161b1e6e95b4f7c (image=quay.ceph.io/ceph-ci/ceph@sha256:06ab0e94e748f3a6c419828123af4401016dfaafdc94f65d99ddd93b48b1dc85, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-9aa5233, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-02-15T22:49:42.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:42 smithi082 ceph-mon[84550]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:49:42.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:42 smithi082 ceph-mon[84550]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-15T22:49:42.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:42 smithi082 ceph-mon[84550]: osdmap e75: 6 total, 5 up, 6 in 2024-02-15T22:49:42.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:42 smithi082 ceph-mon[84550]: osdmap e76: 6 total, 5 up, 6 in 2024-02-15T22:49:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:42 smithi033 ceph-mon[113773]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:49:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:42 smithi033 ceph-mon[113773]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-15T22:49:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:42 smithi033 ceph-mon[113773]: osdmap e75: 6 total, 5 up, 6 in 2024-02-15T22:49:43.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:42 smithi033 ceph-mon[113773]: osdmap e76: 6 total, 5 up, 6 in 2024-02-15T22:49:43.242 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:42 smithi082 podman[104056]: 2024-02-15 22:49:42.871366788 +0000 UTC m=+0.017296739 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:49:43.242 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:42 smithi082 podman[104056]: 2024-02-15 22:49:42.98852531 +0000 UTC m=+0.134455259 container create fa67678ec9bf328357fd38752ef48b0283bb35c5b94d53d60cb899440af2f245 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-15T22:49:43.242 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:43 smithi082 podman[104056]: 2024-02-15 22:49:43.241034423 +0000 UTC m=+0.386964373 container init fa67678ec9bf328357fd38752ef48b0283bb35c5b94d53d60cb899440af2f245 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2) 2024-02-15T22:49:43.537 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:43 smithi082 podman[104056]: 2024-02-15 22:49:43.244269814 +0000 UTC m=+0.390199772 container start fa67678ec9bf328357fd38752ef48b0283bb35c5b94d53d60cb899440af2f245 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-15T22:49:43.537 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:43 smithi082 podman[104056]: 2024-02-15 22:49:43.332671677 +0000 UTC m=+0.478601628 container attach fa67678ec9bf328357fd38752ef48b0283bb35c5b94d53d60cb899440af2f245 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-15T22:49:43.820 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:43 smithi082 podman[104056]: 2024-02-15 22:49:43.536342844 +0000 UTC m=+0.682272795 container died fa67678ec9bf328357fd38752ef48b0283bb35c5b94d53d60cb899440af2f245 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-02-15T22:49:43.820 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:43 smithi082 ceph-mon[84550]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:49:43.820 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:43 smithi082 ceph-mon[84550]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-15T22:49:43.821 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:43.821 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:43 smithi033 ceph-mon[113773]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:49:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:43 smithi033 ceph-mon[113773]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-15T22:49:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:44.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 podman[104082]: 2024-02-15 22:49:44.119980922 +0000 UTC m=+0.578635867 container remove fa67678ec9bf328357fd38752ef48b0283bb35c5b94d53d60cb899440af2f245 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:49:44.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-15T22:49:44.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 systemd[1]: Stopped Ceph osd.5 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:49:44.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 systemd[1]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.5.service: Consumed 59.656s CPU time. 2024-02-15T22:49:44.375 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 systemd[1]: Starting Ceph osd.5 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:49:44.800 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:44 smithi082 ceph-mon[84550]: Health check failed: Degraded data redundancy: 7/357 objects degraded (1.961%), 2 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:44.800 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 podman[104184]: 2024-02-15 22:49:44.451537204 +0000 UTC m=+0.017478973 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:49:44.800 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 podman[104184]: 2024-02-15 22:49:44.654647778 +0000 UTC m=+0.220589580 container create 69859711e6a676e5c91a88657df7f3953dc42d89dba5a7c7344cc0134c234b22 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:49:45.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:44 smithi033 ceph-mon[113773]: Health check failed: Degraded data redundancy: 7/357 objects degraded (1.961%), 2 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:45.376 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 podman[104184]: 2024-02-15 22:49:44.932025408 +0000 UTC m=+0.497967169 container init 69859711e6a676e5c91a88657df7f3953dc42d89dba5a7c7344cc0134c234b22 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:49:45.376 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:44 smithi082 podman[104184]: 2024-02-15 22:49:44.935276125 +0000 UTC m=+0.501217886 container start 69859711e6a676e5c91a88657df7f3953dc42d89dba5a7c7344cc0134c234b22 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214) 2024-02-15T22:49:45.376 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 podman[104184]: 2024-02-15 22:49:45.015402959 +0000 UTC m=+0.581344720 container attach 69859711e6a676e5c91a88657df7f3953dc42d89dba5a7c7344cc0134c234b22 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-15T22:49:45.662 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate[104198]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T22:49:45.662 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate[104198]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T22:49:45.662 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 bash[104184]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T22:49:45.662 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 bash[104184]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 bash[104184]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 bash[104184]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 bash[104184]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 bash[104184]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 bash[104184]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate[104198]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate[104198]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate[104198]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate[104198]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate[104198]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-15T22:49:45.663 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:45 smithi082 podman[104184]: 2024-02-15 22:49:45.403150415 +0000 UTC m=+0.969092176 container died 69859711e6a676e5c91a88657df7f3953dc42d89dba5a7c7344cc0134c234b22 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-02-15T22:49:45.957 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:45 smithi033 ceph-mon[113773]: pgmap v158: 65 pgs: 2 active+undersized+degraded, 3 peering, 10 stale+active+clean, 1 active+undersized, 49 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 7/357 objects degraded (1.961%) 2024-02-15T22:49:46.003 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:45 smithi082 ceph-mon[84550]: pgmap v158: 65 pgs: 2 active+undersized+degraded, 3 peering, 10 stale+active+clean, 1 active+undersized, 49 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 7/357 objects degraded (1.961%) 2024-02-15T22:49:46.299 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 podman[104324]: 2024-02-15 22:49:46.002494202 +0000 UTC m=+0.591090442 container remove 69859711e6a676e5c91a88657df7f3953dc42d89dba5a7c7344cc0134c234b22 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-15T22:49:46.299 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 podman[104387]: 2024-02-15 22:49:46.203459462 +0000 UTC m=+0.104594027 container create 5aebe296615c83eb116df1fa489765dcaeeccd8eb9808fb4fa686246a52b0775 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True) 2024-02-15T22:49:46.299 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 podman[104387]: 2024-02-15 22:49:46.116786132 +0000 UTC m=+0.017920707 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:49:46.625 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 podman[104387]: 2024-02-15 22:49:46.380827277 +0000 UTC m=+0.281961841 container init 5aebe296615c83eb116df1fa489765dcaeeccd8eb9808fb4fa686246a52b0775 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-15T22:49:46.625 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 podman[104387]: 2024-02-15 22:49:46.383863669 +0000 UTC m=+0.284998236 container start 5aebe296615c83eb116df1fa489765dcaeeccd8eb9808fb4fa686246a52b0775 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:49:46.625 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 ceph-osd[104406]: -- 172.21.15.82:0/2017696337 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555f68b591e0 con 0x555f68b2b000 2024-02-15T22:49:46.625 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 bash[104387]: 5aebe296615c83eb116df1fa489765dcaeeccd8eb9808fb4fa686246a52b0775 2024-02-15T22:49:46.625 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 systemd[1]: Started Ceph osd.5 for cfc49586-cc51-11ee-95ba-87774f69a715. 2024-02-15T22:49:47.374 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:46 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:49:46.927+0000 7f60a3cdc7c0 -1 Falling back to public interface 2024-02-15T22:49:47.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:47 smithi082 ceph-mon[84550]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:47.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:47 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:47.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:47 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:47.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:47 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:47 smithi033 ceph-mon[113773]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:47 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:47 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:48.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:47 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:48.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:48 smithi082 ceph-mon[84550]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-15T22:49:49.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:48 smithi033 ceph-mon[113773]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-15T22:49:49.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:49 smithi082 ceph-mon[84550]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:50.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:49 smithi033 ceph-mon[113773]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:51.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:50 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:51.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:50 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:51.124 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:50 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:49:50.864+0000 7f60a3cdc7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-15T22:49:51.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:50 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:51.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:50 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:51.625 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:51 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:49:51.339+0000 7f60a3cdc7c0 -1 osd.5 74 log_to_monitors true 2024-02-15T22:49:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:51 smithi082 ceph-mon[84550]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:51 smithi082 ceph-mon[84550]: from='osd.5 [v2:172.21.15.82:6816/1167817460,v1:172.21.15.82:6817/1167817460]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:49:52.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:51 smithi082 ceph-mon[84550]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:49:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:51 smithi033 ceph-mon[113773]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:52.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:52.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:51 smithi033 ceph-mon[113773]: from='osd.5 [v2:172.21.15.82:6816/1167817460,v1:172.21.15.82:6817/1167817460]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:49:52.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:51 smithi033 ceph-mon[113773]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:49:53.087 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:49:52 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:49:52.801+0000 7f609112c700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:49:53.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:52 smithi082 ceph-mon[84550]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T22:49:53.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:52 smithi082 ceph-mon[84550]: osdmap e77: 6 total, 5 up, 6 in 2024-02-15T22:49:53.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:52 smithi082 ceph-mon[84550]: from='osd.5 [v2:172.21.15.82:6816/1167817460,v1:172.21.15.82:6817/1167817460]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:53.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:52 smithi082 ceph-mon[84550]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:53.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:52 smithi082 ceph-mon[84550]: from='osd.5 ' entity='osd.5' 2024-02-15T22:49:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:52 smithi033 ceph-mon[113773]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T22:49:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:52 smithi033 ceph-mon[113773]: osdmap e77: 6 total, 5 up, 6 in 2024-02-15T22:49:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:52 smithi033 ceph-mon[113773]: from='osd.5 [v2:172.21.15.82:6816/1167817460,v1:172.21.15.82:6817/1167817460]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:52 smithi033 ceph-mon[113773]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-02-15T22:49:53.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:52 smithi033 ceph-mon[113773]: from='osd.5 ' entity='osd.5' 2024-02-15T22:49:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:53 smithi082 ceph-mon[84550]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:53 smithi082 ceph-mon[84550]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:49:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:53 smithi082 ceph-mon[84550]: osd.5 [v2:172.21.15.82:6816/1167817460,v1:172.21.15.82:6817/1167817460] boot 2024-02-15T22:49:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:53 smithi082 ceph-mon[84550]: osdmap e78: 6 total, 6 up, 6 in 2024-02-15T22:49:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:53 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:49:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:53 smithi033 ceph-mon[113773]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T22:49:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:53 smithi033 ceph-mon[113773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:49:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:53 smithi033 ceph-mon[113773]: osd.5 [v2:172.21.15.82:6816/1167817460,v1:172.21.15.82:6817/1167817460] boot 2024-02-15T22:49:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:53 smithi033 ceph-mon[113773]: osdmap e78: 6 total, 6 up, 6 in 2024-02-15T22:49:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:53 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:49:55.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 54/357 objects degraded (15.126%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:55.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T22:49:55.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: osdmap e79: 6 total, 6 up, 6 in 2024-02-15T22:49:55.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.274 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:54 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-15T22:49:55.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 54/357 objects degraded (15.126%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T22:49:55.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:55.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T22:49:55.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: osdmap e79: 6 total, 6 up, 6 in 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:55.377 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:54 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 54/357 objects degraded (15.126%) 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all osd 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: Upgrade: Setting require_osd_release to 19 squid 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: osdmap e80: 6 total, 6 up, 6 in 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:56.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:56.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:56.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:55 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:56.172 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 54/357 objects degraded (15.126%) 2024-02-15T22:49:56.172 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all osd 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: Upgrade: Setting require_osd_release to 19 squid 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: osdmap e80: 6 total, 6 up, 6 in 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi082.lvpzpf=up:active} 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:56.173 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:55 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:55.970+0000 7ff14ce3d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:49:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: osdmap e81: 6 total, 6 up, 6 in 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.82:6826/3515165172,v1:172.21.15.82:6827/3515165172] up:boot 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6828/476484104,v1:172.21.15.33:6829/476484104] up:boot 2024-02-15T22:49:57.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-15T22:49:57.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:49:57.273 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:56 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T22:49:57.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: osdmap e81: 6 total, 6 up, 6 in 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.82:6826/3515165172,v1:172.21.15.82:6827/3515165172] up:boot 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6828/476484104,v1:172.21.15.33:6829/476484104] up:boot 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:49:57.376 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:56 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:49:58.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: pgmap v169: 65 pgs: 5 peering, 6 active+undersized+degraded, 10 active+undersized, 44 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 2 op/s; 21/357 objects degraded (5.882%) 2024-02-15T22:49:58.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.82:6824/1670406671,v1:172.21.15.82:6825/1670406671] up:boot 2024-02-15T22:49:58.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6826/3907861827,v1:172.21.15.33:6827/3907861827] up:boot 2024-02-15T22:49:58.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:49:58.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:49:58.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:49:58.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:58.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:49:58.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:58.300 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: pgmap v169: 65 pgs: 5 peering, 6 active+undersized+degraded, 10 active+undersized, 44 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 2 op/s; 21/357 objects degraded (5.882%) 2024-02-15T22:49:58.300 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.82:6824/1670406671,v1:172.21.15.82:6825/1670406671] up:boot 2024-02-15T22:49:58.300 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6826/3907861827,v1:172.21.15.33:6827/3907861827] up:boot 2024-02-15T22:49:58.300 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:49:58.300 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:49:58.300 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:49:58.301 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:58.301 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.ruqork", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:49:58.301 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:58 smithi033 ceph-mon[113773]: Upgrade: Updating mds.cephfs.smithi033.ruqork 2024-02-15T22:49:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:58 smithi033 ceph-mon[113773]: Deploying daemon mds.cephfs.smithi033.ruqork on smithi033 2024-02-15T22:49:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:58 smithi082 ceph-mon[84550]: Upgrade: Updating mds.cephfs.smithi033.ruqork 2024-02-15T22:49:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:58 smithi082 ceph-mon[84550]: Deploying daemon mds.cephfs.smithi033.ruqork on smithi033 2024-02-15T22:49:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:49:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:59 smithi033 ceph-mon[113773]: pgmap v170: 65 pgs: 5 peering, 1 active+undersized+degraded, 1 active+undersized, 58 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 4/357 objects degraded (1.120%) 2024-02-15T22:50:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:49:59 smithi033 ceph-mon[113773]: Health check update: Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded (PG_DEGRADED) 2024-02-15T22:50:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:59.999+0000 7ff14f642700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded 2024-02-15T22:50:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:59.999+0000 7ff14f642700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T22:50:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:59.999+0000 7ff14f642700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-02-15T22:50:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:59.999+0000 7ff14f642700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T22:50:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:59.999+0000 7ff14f642700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-02-15T22:50:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:59.999+0000 7ff14f642700 -1 log_channel(cluster) log [ERR] : [WRN] PG_DEGRADED: Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded 2024-02-15T22:50:00.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:49:59.999+0000 7ff14f642700 -1 log_channel(cluster) log [ERR] : pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-15T22:50:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:59 smithi082 ceph-mon[84550]: pgmap v170: 65 pgs: 5 peering, 1 active+undersized+degraded, 1 active+undersized, 58 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 4/357 objects degraded (1.120%) 2024-02-15T22:50:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:49:59 smithi082 ceph-mon[84550]: Health check update: Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded (PG_DEGRADED) 2024-02-15T22:50:01.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: osdmap e82: 6 total, 6 up, 6 in 2024-02-15T22:50:01.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded 2024-02-15T22:50:01.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T22:50:01.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: fs cephfs is degraded 2024-02-15T22:50:01.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T22:50:01.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: fs cephfs is offline because no MDS is active for it. 2024-02-15T22:50:01.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: [WRN] PG_DEGRADED: Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded 2024-02-15T22:50:01.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-15T22:50:01.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:00 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: osdmap e82: 6 total, 6 up, 6 in 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: fs cephfs is degraded 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: fs cephfs is offline because no MDS is active for it. 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: [WRN] PG_DEGRADED: Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-15T22:50:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:00 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:01 smithi033 ceph-mon[113773]: pgmap v172: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:01 smithi033 ceph-mon[113773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded) 2024-02-15T22:50:02.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:50:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:01 smithi082 ceph-mon[84550]: pgmap v172: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:01 smithi082 ceph-mon[84550]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/357 objects degraded (1.120%), 1 pg degraded) 2024-02-15T22:50:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:50:04.113 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:03 smithi033 ceph-mon[113773]: pgmap v173: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:04.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:03 smithi082 ceph-mon[84550]: pgmap v173: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:06.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:06 smithi033 ceph-mon[113773]: pgmap v174: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:06.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:06 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:06.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:06 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:06.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:06 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:06 smithi082 ceph-mon[84550]: pgmap v174: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:06 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:06 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:06.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:06 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1316407757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe380fb560 msgr2=0x7fbe380fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1316407757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe380fb560 0x7fbe380fb9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c004940 tx=0x7fbe2c009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1316407757 shutdown_connections 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1316407757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe380fb560 0x7fbe380fb9d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1316407757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38102fe0 0x7fbe381033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1316407757 >> 172.21.15.33:0/1316407757 conn(0x7fbe38071500 msgr2=0x7fbe38071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1316407757 shutdown_connections 2024-02-15T22:50:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1316407757 wait complete. 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.621+0000 7fbe3fe2c700 1 Processor -- start 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3fe2c700 1 -- start start 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3fe2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380fb560 0x7fbe380fc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3fe2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe38102fe0 0x7fbe380fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3fe2c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380fd2a0 con 0x7fbe38102fe0 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3fe2c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380fd410 con 0x7fbe380fb560 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3d3c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe38102fe0 0x7fbe380fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3d3c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe38102fe0 0x7fbe380fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49234/0 (socket says 172.21.15.33:49234) 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3d3c7700 1 -- 172.21.15.33:0/1839996983 learned_addr learned my addr 172.21.15.33:0/1839996983 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3dbc8700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380fb560 0x7fbe380fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3d3c7700 1 -- 172.21.15.33:0/1839996983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380fb560 msgr2=0x7fbe380fc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3d3c7700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380fb560 0x7fbe380fc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3d3c7700 1 -- 172.21.15.33:0/1839996983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c005040 con 0x7fbe38102fe0 2024-02-15T22:50:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3dbc8700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380fb560 0x7fbe380fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:50:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.622+0000 7fbe3d3c7700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe38102fe0 0x7fbe380fcc80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00b3b0 tx=0x7fbe2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.623+0000 7fbe367fc700 1 -- 172.21.15.33:0/1839996983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe2c00e040 con 0x7fbe38102fe0 2024-02-15T22:50:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.623+0000 7fbe367fc700 1 -- 172.21.15.33:0/1839996983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe2c00bbf0 con 0x7fbe38102fe0 2024-02-15T22:50:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.623+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe38119d40 con 0x7fbe38102fe0 2024-02-15T22:50:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.623+0000 7fbe367fc700 1 -- 172.21.15.33:0/1839996983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe2c01c630 con 0x7fbe38102fe0 2024-02-15T22:50:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.623+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3811a180 con 0x7fbe38102fe0 2024-02-15T22:50:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.624+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38100290 con 0x7fbe38102fe0 2024-02-15T22:50:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.624+0000 7fbe367fc700 1 -- 172.21.15.33:0/1839996983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbe2c00bd60 con 0x7fbe38102fe0 2024-02-15T22:50:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.624+0000 7fbe367fc700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbe2006d7e0 0x7fbe2006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.625+0000 7fbe367fc700 1 -- 172.21.15.33:0/1839996983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbe2c08e2e0 con 0x7fbe38102fe0 2024-02-15T22:50:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.625+0000 7fbe3dbc8700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbe2006d7e0 0x7fbe2006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.625+0000 7fbe3dbc8700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbe2006d7e0 0x7fbe2006fc90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe380658f0 tx=0x7fbe280096a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.631+0000 7fbe367fc700 1 -- 172.21.15.33:0/1839996983 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbe2c057bb0 con 0x7fbe38102fe0 2024-02-15T22:50:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.862+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe3810a1d0 con 0x7fbe2006d7e0 2024-02-15T22:50:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.863+0000 7fbe367fc700 1 -- 172.21.15.33:0/1839996983 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbe3810a1d0 con 0x7fbe2006d7e0 2024-02-15T22:50:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbe2006d7e0 msgr2=0x7fbe2006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbe2006d7e0 0x7fbe2006fc90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe380658f0 tx=0x7fbe280096a0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe38102fe0 msgr2=0x7fbe380fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe38102fe0 0x7fbe380fcc80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00b3b0 tx=0x7fbe2c009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 shutdown_connections 2024-02-15T22:50:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbe2006d7e0 0x7fbe2006fc90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380fb560 0x7fbe380fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 --2- 172.21.15.33:0/1839996983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe38102fe0 0x7fbe380fcc80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 >> 172.21.15.33:0/1839996983 conn(0x7fbe38071500 msgr2=0x7fbe380fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 shutdown_connections 2024-02-15T22:50:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.866+0000 7fbe3fe2c700 1 -- 172.21.15.33:0/1839996983 wait complete. 2024-02-15T22:50:06.878 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:50:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/1499812326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 msgr2=0x7fdb84103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/1499812326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84103510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdb74004940 tx=0x7fdb74009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/1499812326 shutdown_connections 2024-02-15T22:50:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/1499812326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb840fb570 0x7fdb840fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/1499812326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84103510 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/1499812326 >> 172.21.15.33:0/1499812326 conn(0x7fdb84071560 msgr2=0x7fdb84071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/1499812326 shutdown_connections 2024-02-15T22:50:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/1499812326 wait complete. 2024-02-15T22:50:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.970+0000 7fdb8a4b7700 1 Processor -- start 2024-02-15T22:50:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb8a4b7700 1 -- start start 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb8a4b7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb840fb570 0x7fdb84115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb8a4b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84116260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb8a4b7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb841168b0 con 0x7fdb84103140 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb8a4b7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8410fbc0 con 0x7fdb840fb570 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84116260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84116260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49240/0 (socket says 172.21.15.33:49240) 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb837fe700 1 -- 172.21.15.33:0/2760977380 learned_addr learned my addr 172.21.15.33:0/2760977380 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb83fff700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb840fb570 0x7fdb84115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb837fe700 1 -- 172.21.15.33:0/2760977380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb840fb570 msgr2=0x7fdb84115d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:06.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb837fe700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb840fb570 0x7fdb84115d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb837fe700 1 -- 172.21.15.33:0/2760977380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74005040 con 0x7fdb84103140 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.971+0000 7fdb837fe700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84116260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c8c0 tx=0x7fdb780044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.972+0000 7fdb80ff9700 1 -- 172.21.15.33:0/2760977380 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb7800a760 con 0x7fdb84103140 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.972+0000 7fdb80ff9700 1 -- 172.21.15.33:0/2760977380 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb7800ad90 con 0x7fdb84103140 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.972+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8410fea0 con 0x7fdb84103140 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.972+0000 7fdb80ff9700 1 -- 172.21.15.33:0/2760977380 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb780113a0 con 0x7fdb84103140 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.972+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb841103e0 con 0x7fdb84103140 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.973+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb84073080 con 0x7fdb84103140 2024-02-15T22:50:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.973+0000 7fdb80ff9700 1 -- 172.21.15.33:0/2760977380 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdb78012400 con 0x7fdb84103140 2024-02-15T22:50:06.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.973+0000 7fdb80ff9700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb6c06d7e0 0x7fdb6c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:06.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.974+0000 7fdb80ff9700 1 -- 172.21.15.33:0/2760977380 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdb7808ce90 con 0x7fdb84103140 2024-02-15T22:50:06.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.974+0000 7fdb83fff700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb6c06d7e0 0x7fdb6c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:06.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.974+0000 7fdb83fff700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb6c06d7e0 0x7fdb6c06fc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb74004f90 tx=0x7fdb74009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:06.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:06.978+0000 7fdb80ff9700 1 -- 172.21.15.33:0/2760977380 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdb7805a290 con 0x7fdb84103140 2024-02-15T22:50:07.155 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:07 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:boot 2024-02-15T22:50:07.155 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:07 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:07.155 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:50:07.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.209+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb84111300 con 0x7fdb6c06d7e0 2024-02-15T22:50:07.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.210+0000 7fdb80ff9700 1 -- 172.21.15.33:0/2760977380 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdb84111300 con 0x7fdb6c06d7e0 2024-02-15T22:50:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb6c06d7e0 msgr2=0x7fdb6c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb6c06d7e0 0x7fdb6c06fc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb74004f90 tx=0x7fdb74009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 msgr2=0x7fdb84116260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84116260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c8c0 tx=0x7fdb780044c0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 shutdown_connections 2024-02-15T22:50:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb6c06d7e0 0x7fdb6c06fc90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb840fb570 0x7fdb84115d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 --2- 172.21.15.33:0/2760977380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb84103140 0x7fdb84116260 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 >> 172.21.15.33:0/2760977380 conn(0x7fdb84071560 msgr2=0x7fdb840fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 shutdown_connections 2024-02-15T22:50:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.212+0000 7fdb8a4b7700 1 -- 172.21.15.33:0/2760977380 wait complete. 2024-02-15T22:50:07.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 -- 172.21.15.33:0/4286751966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 msgr2=0x7fbebc102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/4286751966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc102230 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbea4004940 tx=0x7fbea4009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:07.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 -- 172.21.15.33:0/4286751966 shutdown_connections 2024-02-15T22:50:07.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/4286751966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc102800 0x7fbebc0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/4286751966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc102230 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 -- 172.21.15.33:0/4286751966 >> 172.21.15.33:0/4286751966 conn(0x7fbebc0f7a10 msgr2=0x7fbebc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:07.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 -- 172.21.15.33:0/4286751966 shutdown_connections 2024-02-15T22:50:07.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.315+0000 7fbec0dc0700 1 -- 172.21.15.33:0/4286751966 wait complete. 2024-02-15T22:50:07.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbec0dc0700 1 Processor -- start 2024-02-15T22:50:07.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbec0dc0700 1 -- start start 2024-02-15T22:50:07.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbec0dc0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc10eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:07.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbec0dc0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc102800 0x7fbebc10f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:07.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbec0dc0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc10f5b0 con 0x7fbebc101e60 2024-02-15T22:50:07.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbec0dc0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc10f720 con 0x7fbebc102800 2024-02-15T22:50:07.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc10eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:07.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc10eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49260/0 (socket says 172.21.15.33:49260) 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeba59c700 1 -- 172.21.15.33:0/1715202593 learned_addr learned my addr 172.21.15.33:0/1715202593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeb9d9b700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc102800 0x7fbebc10f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeba59c700 1 -- 172.21.15.33:0/1715202593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc102800 msgr2=0x7fbebc10f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeba59c700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc102800 0x7fbebc10f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeba59c700 1 -- 172.21.15.33:0/1715202593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4005040 con 0x7fbebc101e60 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.316+0000 7fbeba59c700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc10eae0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbea400b3b0 tx=0x7fbea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.317+0000 7fbeb2ffd700 1 -- 172.21.15.33:0/1715202593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea400e040 con 0x7fbebc101e60 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.317+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc117a50 con 0x7fbebc101e60 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.317+0000 7fbeb2ffd700 1 -- 172.21.15.33:0/1715202593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbea400bbf0 con 0x7fbebc101e60 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.317+0000 7fbeb2ffd700 1 -- 172.21.15.33:0/1715202593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea401c3f0 con 0x7fbebc101e60 2024-02-15T22:50:07.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.317+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc117f10 con 0x7fbebc101e60 2024-02-15T22:50:07.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.318+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc0fb610 con 0x7fbebc101e60 2024-02-15T22:50:07.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.318+0000 7fbeb2ffd700 1 -- 172.21.15.33:0/1715202593 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbea400bd60 con 0x7fbebc101e60 2024-02-15T22:50:07.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.319+0000 7fbeb2ffd700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbea806d7e0 0x7fbea806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:07.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.319+0000 7fbeb9d9b700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbea806d7e0 0x7fbea806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:07.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.319+0000 7fbeb2ffd700 1 -- 172.21.15.33:0/1715202593 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbea408e220 con 0x7fbebc101e60 2024-02-15T22:50:07.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.319+0000 7fbeb9d9b700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbea806d7e0 0x7fbea806fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbebc066a30 tx=0x7fbeac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:07.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.323+0000 7fbeb2ffd700 1 -- 172.21.15.33:0/1715202593 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbea4057af0 con 0x7fbebc101e60 2024-02-15T22:50:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:07 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:boot 2024-02-15T22:50:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:07 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:07.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:50:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.549+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbebc0668b0 con 0x7fbea806d7e0 2024-02-15T22:50:07.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.559+0000 7fbeb2ffd700 1 -- 172.21.15.33:0/1715202593 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbeac00f040 con 0x7fbea806d7e0 2024-02-15T22:50:07.561 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 118s ago 17m 26.3M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (3m) 118s ago 17m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (3m) 17s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (6m) 118s ago 17m 87.4M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 starting - - - - 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (11m) 118s ago 11m 75.3M - 17.2.7-509-g9aa52330 61c0ec9cd187 a70fcd19053d 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (11m) 17s ago 11m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (11m) 17s ago 11m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (7m) 118s ago 18m 500M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (7m) 17s ago 16m 451M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (4m) 118s ago 18m 48.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (4m) 17s ago 16m 39.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (6m) 118s ago 17m 16.4M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 17s ago 16m 16.2M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 118s ago 15m 87.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:50:07.562 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 118s ago 14m 97.3M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:50:07.563 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 118s ago 14m 12.6M 1559M 19.0.0-1450-gf78a58c0 f081f847070a dfdcfe354b41 2024-02-15T22:50:07.563 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (88s) 17s ago 14m 100M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 7778c235281a 2024-02-15T22:50:07.563 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (54s) 17s ago 13m 91.3M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 66b57df413a7 2024-02-15T22:50:07.563 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (21s) 17s ago 13m 12.6M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 5aebe296615c 2024-02-15T22:50:07.563 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (6m) 118s ago 16m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.561+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbea806d7e0 msgr2=0x7fbea806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.561+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbea806d7e0 0x7fbea806fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbebc066a30 tx=0x7fbeac00b040 comp rx=0 tx=0).stop 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.561+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 msgr2=0x7fbebc10eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.561+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc10eae0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbea400b3b0 tx=0x7fbea4009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.562+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 shutdown_connections 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.562+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fbea806d7e0 0x7fbea806fc90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.562+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbebc101e60 0x7fbebc10eae0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.562+0000 7fbec0dc0700 1 --2- 172.21.15.33:0/1715202593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc102800 0x7fbebc10f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.562+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 >> 172.21.15.33:0/1715202593 conn(0x7fbebc0f7a10 msgr2=0x7fbebc0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.562+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 shutdown_connections 2024-02-15T22:50:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.562+0000 7fbec0dc0700 1 -- 172.21.15.33:0/1715202593 wait complete. 2024-02-15T22:50:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.668+0000 7ff4fd82d700 1 -- 172.21.15.33:0/3472804048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 msgr2=0x7ff4f80fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.668+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/3472804048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f80fbe70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8004940 tx=0x7ff4e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 -- 172.21.15.33:0/3472804048 shutdown_connections 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/3472804048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f80fbe70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/3472804048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f8101e60 0x7ff4f8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 -- 172.21.15.33:0/3472804048 >> 172.21.15.33:0/3472804048 conn(0x7ff4f80f7a10 msgr2=0x7ff4f80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 -- 172.21.15.33:0/3472804048 shutdown_connections 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 -- 172.21.15.33:0/3472804048 wait complete. 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 Processor -- start 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 -- start start 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.669+0000 7ff4fd82d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f8101e60 0x7ff4f810eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4fd82d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f810f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4fd82d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f810f610 con 0x7ff4f8102800 2024-02-15T22:50:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4fd82d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f810f780 con 0x7ff4f8101e60 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f810f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f810f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49272/0 (socket says 172.21.15.33:49272) 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f67fc700 1 -- 172.21.15.33:0/2738419198 learned_addr learned my addr 172.21.15.33:0/2738419198 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f6ffd700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f8101e60 0x7ff4f810eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f67fc700 1 -- 172.21.15.33:0/2738419198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f8101e60 msgr2=0x7ff4f810eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f67fc700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f8101e60 0x7ff4f810eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f67fc700 1 -- 172.21.15.33:0/2738419198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8005040 con 0x7ff4f8102800 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4f67fc700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f810f080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8000c00 tx=0x7ff4e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4ef7fe700 1 -- 172.21.15.33:0/2738419198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e800e040 con 0x7ff4f8102800 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f8117ab0 con 0x7ff4f8102800 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4ef7fe700 1 -- 172.21.15.33:0/2738419198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4e8004290 con 0x7ff4f8102800 2024-02-15T22:50:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.670+0000 7ff4ef7fe700 1 -- 172.21.15.33:0/2738419198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e801c3f0 con 0x7ff4f8102800 2024-02-15T22:50:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.671+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f8117fa0 con 0x7ff4f8102800 2024-02-15T22:50:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.671+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8104330 con 0x7ff4f8102800 2024-02-15T22:50:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.672+0000 7ff4ef7fe700 1 -- 172.21.15.33:0/2738419198 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff4e800bbf0 con 0x7ff4f8102800 2024-02-15T22:50:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.672+0000 7ff4ef7fe700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4e406d7f0 0x7ff4e406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.672+0000 7ff4ef7fe700 1 -- 172.21.15.33:0/2738419198 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff4e808e190 con 0x7ff4f8102800 2024-02-15T22:50:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.672+0000 7ff4f6ffd700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4e406d7f0 0x7ff4e406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.673+0000 7ff4f6ffd700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4e406d7f0 0x7ff4e406fca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00041d0 tx=0x7ff4e00043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:07.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.677+0000 7ff4ef7fe700 1 -- 172.21.15.33:0/2738419198 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff4e8057a60 con 0x7ff4f8102800 2024-02-15T22:50:07.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.973+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4f80fb610 con 0x7ff4f8102800 2024-02-15T22:50:07.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.974+0000 7ff4ef7fe700 1 -- 172.21.15.33:0/2738419198 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7ff4e805b120 con 0x7ff4f8102800 2024-02-15T22:50:07.976 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:50:07.976 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:50:07.976 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 3, 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:50:07.977 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 3, 2024-02-15T22:50:07.978 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 11 2024-02-15T22:50:07.978 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:50:07.978 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:50:07.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4e406d7f0 msgr2=0x7ff4e406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4e406d7f0 0x7ff4e406fca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00041d0 tx=0x7ff4e00043c0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 msgr2=0x7ff4f810f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f810f080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8000c00 tx=0x7ff4e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 shutdown_connections 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4e406d7f0 0x7ff4e406fca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f8101e60 0x7ff4f810eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 --2- 172.21.15.33:0/2738419198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4f8102800 0x7ff4f810f080 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 >> 172.21.15.33:0/2738419198 conn(0x7ff4f80f7a10 msgr2=0x7ff4f80f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 shutdown_connections 2024-02-15T22:50:07.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:07.976+0000 7ff4fd82d700 1 -- 172.21.15.33:0/2738419198 wait complete. 2024-02-15T22:50:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 -- 172.21.15.33:0/2671504559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 msgr2=0x7f1dd4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 --2- 172.21.15.33:0/2671504559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd4102210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4004940 tx=0x7f1dc4009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 -- 172.21.15.33:0/2671504559 shutdown_connections 2024-02-15T22:50:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 --2- 172.21.15.33:0/2671504559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd41027e0 0x7f1dd40fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 --2- 172.21.15.33:0/2671504559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd4102210 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 -- 172.21.15.33:0/2671504559 >> 172.21.15.33:0/2671504559 conn(0x7f1dd4071d90 msgr2=0x7f1dd4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 -- 172.21.15.33:0/2671504559 shutdown_connections 2024-02-15T22:50:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.081+0000 7f1dda219700 1 -- 172.21.15.33:0/2671504559 wait complete. 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dda219700 1 Processor -- start 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dda219700 1 -- start start 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dda219700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd410eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dda219700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd41027e0 0x7f1dd410f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dda219700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd410f5b0 con 0x7f1dd4101e40 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dda219700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd410f6f0 con 0x7f1dd41027e0 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dd37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd410eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dd37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd410eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49296/0 (socket says 172.21.15.33:49296) 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.082+0000 7f1dd37fe700 1 -- 172.21.15.33:0/3682108366 learned_addr learned my addr 172.21.15.33:0/3682108366 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dd2ffd700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd41027e0 0x7f1dd410f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dd37fe700 1 -- 172.21.15.33:0/3682108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd41027e0 msgr2=0x7f1dd410f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dd37fe700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd41027e0 0x7f1dd410f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dd37fe700 1 -- 172.21.15.33:0/3682108366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4005040 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dd2ffd700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd41027e0 0x7f1dd410f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dd37fe700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd410eae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009100 tx=0x7f1dc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dcbfff700 1 -- 172.21.15.33:0/3682108366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dc400e040 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dcbfff700 1 -- 172.21.15.33:0/3682108366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1dc4004290 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41179f0 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dcbfff700 1 -- 172.21.15.33:0/3682108366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dc401c630 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.083+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd4117f00 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.084+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd40ff150 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.084+0000 7f1dcbfff700 1 -- 172.21.15.33:0/3682108366 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1dc400bbf0 con 0x7f1dd4101e40 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.085+0000 7f1dcbfff700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1dc006d7e0 0x7f1dc006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.085+0000 7f1dcbfff700 1 -- 172.21.15.33:0/3682108366 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1dc408e210 con 0x7f1dd4101e40 2024-02-15T22:50:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.085+0000 7f1dd2ffd700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1dc006d7e0 0x7f1dc006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.085+0000 7f1dd2ffd700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1dc006d7e0 0x7f1dc006fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4066180 tx=0x7f1dbc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.089+0000 7f1dcbfff700 1 -- 172.21.15.33:0/3682108366 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1dc4057ae0 con 0x7f1dd4101e40 2024-02-15T22:50:08.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:08 smithi033 ceph-mon[113773]: pgmap v175: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:08.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:08 smithi033 ceph-mon[113773]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:08.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:08 smithi033 ceph-mon[113773]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:08.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:08 smithi033 ceph-mon[113773]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:08.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:08 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2738419198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:08.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.356+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1dd4065ec0 con 0x7f1dd4101e40 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.357+0000 7f1dcbfff700 1 -- 172.21.15.33:0/3682108366 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f1dc405b1a0 con 0x7f1dd4101e40 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout:e27 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:50:08.359 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 24 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:49:55.970826+0000 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:50:08.360 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 81 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0,1 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:50:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{-1:34376} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6828/476484104,v1:172.21.15.33:6829/476484104] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{-1:34390} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{-1:44267} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/3515165172,v1:172.21.15.82:6827/3515165172] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:50:08.362 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{-1:44271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6824/1670406671,v1:172.21.15.82:6825/1670406671] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:50:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1dc006d7e0 msgr2=0x7f1dc006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1dc006d7e0 0x7f1dc006fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4066180 tx=0x7f1dbc009040 comp rx=0 tx=0).stop 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 msgr2=0x7f1dd410eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd410eae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009100 tx=0x7f1dc4009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 shutdown_connections 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1dc006d7e0 0x7f1dc006fc90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd4101e40 0x7f1dd410eae0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 --2- 172.21.15.33:0/3682108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd41027e0 0x7f1dd410f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 >> 172.21.15.33:0/3682108366 conn(0x7f1dd4071d90 msgr2=0x7f1dd40fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 shutdown_connections 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.359+0000 7f1dda219700 1 -- 172.21.15.33:0/3682108366 wait complete. 2024-02-15T22:50:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-02-15T22:50:08.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:08 smithi082 ceph-mon[84550]: pgmap v175: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:08.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:08 smithi082 ceph-mon[84550]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:08.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:08 smithi082 ceph-mon[84550]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:08.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:08 smithi082 ceph-mon[84550]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:08.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:08 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2738419198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:08.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 -- 172.21.15.33:0/3522735270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 msgr2=0x7fd5f8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/3522735270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8102210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8004940 tx=0x7fd5e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 -- 172.21.15.33:0/3522735270 shutdown_connections 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/3522735270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f81027e0 0x7fd5f80fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/3522735270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8102210 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 -- 172.21.15.33:0/3522735270 >> 172.21.15.33:0/3522735270 conn(0x7fd5f8071d90 msgr2=0x7fd5f8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 -- 172.21.15.33:0/3522735270 shutdown_connections 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 -- 172.21.15.33:0/3522735270 wait complete. 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.462+0000 7fd5fe33c700 1 Processor -- start 2024-02-15T22:50:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5fe33c700 1 -- start start 2024-02-15T22:50:08.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5fe33c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8112940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5fe33c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f81027e0 0x7fd5f8112e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5fe33c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f81134d0 con 0x7fd5f8101e40 2024-02-15T22:50:08.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5fe33c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f810c800 con 0x7fd5f81027e0 2024-02-15T22:50:08.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8112940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8112940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49314/0 (socket says 172.21.15.33:49314) 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f7fff700 1 -- 172.21.15.33:0/2925039237 learned_addr learned my addr 172.21.15.33:0/2925039237 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f77fe700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f81027e0 0x7fd5f8112e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f7fff700 1 -- 172.21.15.33:0/2925039237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f81027e0 msgr2=0x7fd5f8112e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f7fff700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f81027e0 0x7fd5f8112e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f7fff700 1 -- 172.21.15.33:0/2925039237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8005040 con 0x7fd5f8101e40 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.463+0000 7fd5f7fff700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8112940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009fd0 tx=0x7fd5e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.464+0000 7fd5f4ff9700 1 -- 172.21.15.33:0/2925039237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e800e040 con 0x7fd5f8101e40 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.464+0000 7fd5f4ff9700 1 -- 172.21.15.33:0/2925039237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5e800bbf0 con 0x7fd5f8101e40 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.464+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f810ca80 con 0x7fd5f8101e40 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.464+0000 7fd5f4ff9700 1 -- 172.21.15.33:0/2925039237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e801c630 con 0x7fd5f8101e40 2024-02-15T22:50:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.464+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f810cfc0 con 0x7fd5f8101e40 2024-02-15T22:50:08.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.465+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f80ff150 con 0x7fd5f8101e40 2024-02-15T22:50:08.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.465+0000 7fd5f4ff9700 1 -- 172.21.15.33:0/2925039237 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd5e800bd60 con 0x7fd5f8101e40 2024-02-15T22:50:08.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.466+0000 7fd5f4ff9700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd5e006d7f0 0x7fd5e006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.466+0000 7fd5f77fe700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd5e006d7f0 0x7fd5e006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.466+0000 7fd5f4ff9700 1 -- 172.21.15.33:0/2925039237 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd5e808dfd0 con 0x7fd5f8101e40 2024-02-15T22:50:08.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.466+0000 7fd5f77fe700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd5e006d7f0 0x7fd5e006fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd5f810e170 tx=0x7fd5ec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.470+0000 7fd5f4ff9700 1 -- 172.21.15.33:0/2925039237 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd5e805b470 con 0x7fd5f8101e40 2024-02-15T22:50:08.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.702+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5f804bf70 con 0x7fd5e006d7f0 2024-02-15T22:50:08.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.703+0000 7fd5f4ff9700 1 -- 172.21.15.33:0/2925039237 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd5ec00f040 con 0x7fd5e006d7f0 2024-02-15T22:50:08.705 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:50:08.705 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:50:08.705 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:50:08.705 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "osd" 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "12/21 daemons upgraded", 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading mds daemons", 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:50:08.706 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd5e006d7f0 msgr2=0x7fd5e006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd5e006d7f0 0x7fd5e006fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd5f810e170 tx=0x7fd5ec00b040 comp rx=0 tx=0).stop 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 msgr2=0x7fd5f8112940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8112940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009fd0 tx=0x7fd5e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 shutdown_connections 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd5e006d7f0 0x7fd5e006fca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f8101e40 0x7fd5f8112940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 --2- 172.21.15.33:0/2925039237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f81027e0 0x7fd5f8112e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 >> 172.21.15.33:0/2925039237 conn(0x7fd5f8071d90 msgr2=0x7fd5f80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:08.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 shutdown_connections 2024-02-15T22:50:08.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.706+0000 7fd5fe33c700 1 -- 172.21.15.33:0/2925039237 wait complete. 2024-02-15T22:50:08.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 -- 172.21.15.33:0/862480546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 msgr2=0x7f1800109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 --2- 172.21.15.33:0/862480546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f1800109250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17e8004970 tx=0x7f17e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:08.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 -- 172.21.15.33:0/862480546 shutdown_connections 2024-02-15T22:50:08.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 --2- 172.21.15.33:0/862480546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f1800109250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 --2- 172.21.15.33:0/862480546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1800070330 0x7f1800070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 -- 172.21.15.33:0/862480546 >> 172.21.15.33:0/862480546 conn(0x7f18000f8af0 msgr2=0x7f18000faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:08.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 -- 172.21.15.33:0/862480546 shutdown_connections 2024-02-15T22:50:08.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.810+0000 7f18056ae700 1 -- 172.21.15.33:0/862480546 wait complete. 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f18056ae700 1 Processor -- start 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f18056ae700 1 -- start start 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f18056ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1800070330 0x7f1800115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f18056ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f18001161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f18056ae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18001168d0 con 0x7f1800070c40 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f18056ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180010fb50 con 0x7f1800070330 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17fe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f18001161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17fe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f18001161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49340/0 (socket says 172.21.15.33:49340) 2024-02-15T22:50:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17fe7fc700 1 -- 172.21.15.33:0/148716614 learned_addr learned my addr 172.21.15.33:0/148716614 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17feffd700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1800070330 0x7f1800115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17fe7fc700 1 -- 172.21.15.33:0/148716614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1800070330 msgr2=0x7f1800115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17fe7fc700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1800070330 0x7f1800115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17fe7fc700 1 -- 172.21.15.33:0/148716614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8005040 con 0x7f1800070c40 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.811+0000 7f17fe7fc700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f18001161f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17e8004f50 tx=0x7f17e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.812+0000 7f17f77fe700 1 -- 172.21.15.33:0/148716614 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e800e040 con 0x7f1800070c40 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.812+0000 7f17f77fe700 1 -- 172.21.15.33:0/148716614 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17e8004290 con 0x7f1800070c40 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.812+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180010fd70 con 0x7f1800070c40 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.812+0000 7f17f77fe700 1 -- 172.21.15.33:0/148716614 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e801c630 con 0x7f1800070c40 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.812+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18001102b0 con 0x7f1800070c40 2024-02-15T22:50:08.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.813+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1800106910 con 0x7f1800070c40 2024-02-15T22:50:08.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.813+0000 7f17f77fe700 1 -- 172.21.15.33:0/148716614 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f17e800bc10 con 0x7f1800070c40 2024-02-15T22:50:08.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.814+0000 7f17f77fe700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f17ec06d7f0 0x7f17ec06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:08.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.814+0000 7f17feffd700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f17ec06d7f0 0x7f17ec06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:08.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.814+0000 7f17f77fe700 1 -- 172.21.15.33:0/148716614 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f17e808e230 con 0x7f1800070c40 2024-02-15T22:50:08.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.814+0000 7f17feffd700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f17ec06d7f0 0x7f17ec06fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17f0001250 tx=0x7f17f0009620 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:08.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:08.818+0000 7f17f77fe700 1 -- 172.21.15.33:0/148716614 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f17e805b630 con 0x7f1800070c40 2024-02-15T22:50:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.113+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f18000fc6f0 con 0x7f1800070c40 2024-02-15T22:50:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.114+0000 7f17f77fe700 1 -- 172.21.15.33:0/148716614 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f17e8013e60 con 0x7f1800070c40 2024-02-15T22:50:09.116 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-15T22:50:09.116 INFO:teuthology.orchestra.run.smithi033.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T22:50:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: fs cephfs is degraded 2024-02-15T22:50:09.116 INFO:teuthology.orchestra.run.smithi033.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T22:50:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f17ec06d7f0 msgr2=0x7f17ec06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f17ec06d7f0 0x7f17ec06fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17f0001250 tx=0x7f17f0009620 comp rx=0 tx=0).stop 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 msgr2=0x7f18001161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f18001161f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17e8004f50 tx=0x7f17e8009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 shutdown_connections 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f17ec06d7f0 0x7f17ec06fca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1800070330 0x7f1800115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 --2- 172.21.15.33:0/148716614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1800070c40 0x7f18001161f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 >> 172.21.15.33:0/148716614 conn(0x7f18000f8af0 msgr2=0x7f1800103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:09.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.116+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 shutdown_connections 2024-02-15T22:50:09.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:09.117+0000 7f18056ae700 1 -- 172.21.15.33:0/148716614 wait complete. 2024-02-15T22:50:09.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:09 smithi033 ceph-mon[113773]: pgmap v176: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-15T22:50:09.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:09.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:09 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3682108366' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:50:09.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:09 smithi033 ceph-mon[113773]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:09.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:09 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/148716614' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:50:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:09 smithi082 ceph-mon[84550]: pgmap v176: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-15T22:50:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:09 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3682108366' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:50:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:09 smithi082 ceph-mon[84550]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:09 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/148716614' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:50:11.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:11 smithi082 ceph-mon[84550]: pgmap v177: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:11.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:11.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:11 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:12.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:11 smithi033 ceph-mon[113773]: pgmap v177: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:12.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:12.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:11 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:13.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:12 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:13.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:12 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:13.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:12 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:13.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:12 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:13 smithi082 ceph-mon[84550]: pgmap v178: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:13 smithi033 ceph-mon[113773]: pgmap v178: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:16.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: pgmap v179: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:16.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:16.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:16.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:16.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:16.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:16.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:16.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:16.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:16.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:16.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:15 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:16.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: pgmap v179: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:16.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:16.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:16.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:16.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:16.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:16.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:16.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:16.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:16.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:16.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:15 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:18.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:17 smithi033 ceph-mon[113773]: pgmap v180: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:18.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:17 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:18.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:17 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:50:18.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:17 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:18.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:17 smithi082 ceph-mon[84550]: pgmap v180: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:18.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:17 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:18.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:17 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.xkdegf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:50:18.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:17 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:19.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:18 smithi033 ceph-mon[113773]: Upgrade: Updating mds.cephfs.smithi033.xkdegf 2024-02-15T22:50:19.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:18 smithi033 ceph-mon[113773]: Deploying daemon mds.cephfs.smithi033.xkdegf on smithi033 2024-02-15T22:50:19.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:18 smithi082 ceph-mon[84550]: Upgrade: Updating mds.cephfs.smithi033.xkdegf 2024-02-15T22:50:19.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:18 smithi082 ceph-mon[84550]: Deploying daemon mds.cephfs.smithi033.xkdegf on smithi033 2024-02-15T22:50:20.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:19 smithi033 ceph-mon[113773]: pgmap v181: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:19 smithi082 ceph-mon[84550]: pgmap v181: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:21.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:20 smithi082 ceph-mon[84550]: osdmap e83: 6 total, 6 up, 6 in 2024-02-15T22:50:21.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:20 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:21.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:20 smithi033 ceph-mon[113773]: osdmap e83: 6 total, 6 up, 6 in 2024-02-15T22:50:21.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:20 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:22.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:21 smithi082 ceph-mon[84550]: pgmap v183: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:22.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:21 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:50:22.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:21 smithi033 ceph-mon[113773]: pgmap v183: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:22.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:21 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:50:23.857 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:23 smithi033 ceph-mon[113773]: pgmap v184: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:24.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:23 smithi082 ceph-mon[84550]: pgmap v184: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:26.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:25 smithi033 ceph-mon[113773]: pgmap v185: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:26.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:25 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:26.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:25 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:26.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:25 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:26.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:25 smithi082 ceph-mon[84550]: pgmap v185: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:26.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:25 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:26.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:25 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:26.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:25 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:27.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:26 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:boot 2024-02-15T22:50:27.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:26 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:27.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:26 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:50:27.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:26 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:boot 2024-02-15T22:50:27.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:26 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:27.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:26 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:50:28.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:27 smithi033 ceph-mon[113773]: pgmap v186: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:28.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:27 smithi082 ceph-mon[84550]: pgmap v186: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:29.203 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:30.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:29 smithi082 ceph-mon[84550]: pgmap v187: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:30.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:30.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:30.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:29 smithi033 ceph-mon[113773]: pgmap v187: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:30.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:30.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:32.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:31 smithi033 ceph-mon[113773]: pgmap v188: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:32.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:32.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:31 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:32.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:31 smithi082 ceph-mon[84550]: pgmap v188: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:32.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:32.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:31 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:34.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:33 smithi033 ceph-mon[113773]: pgmap v189: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:34.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:33 smithi082 ceph-mon[84550]: pgmap v189: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: pgmap v190: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:35.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:35.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:35.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:35.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:35.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:35.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:35.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:35 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:35.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: pgmap v190: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:35.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:35.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:35.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:35.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:35.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:35.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:35.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:35.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:35.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:35.626 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:35 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:37.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:36 smithi082 ceph-mon[84550]: Upgrade: Updating mds.cephfs.smithi082.lvpzpf 2024-02-15T22:50:37.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:36 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:37.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:36 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:50:37.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:36 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:37.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:36 smithi082 ceph-mon[84550]: Deploying daemon mds.cephfs.smithi082.lvpzpf on smithi082 2024-02-15T22:50:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:36 smithi033 ceph-mon[113773]: Upgrade: Updating mds.cephfs.smithi082.lvpzpf 2024-02-15T22:50:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:36 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:36 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.lvpzpf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:50:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:36 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:37.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:36 smithi033 ceph-mon[113773]: Deploying daemon mds.cephfs.smithi082.lvpzpf on smithi082 2024-02-15T22:50:38.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:37 smithi033 ceph-mon[113773]: pgmap v191: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:38.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:37 smithi082 ceph-mon[84550]: pgmap v191: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 -- 172.21.15.33:0/1887976283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510071f60 msgr2=0x7ff510070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 --2- 172.21.15.33:0/1887976283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510071f60 0x7ff510070330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff500004970 tx=0x7ff500009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 -- 172.21.15.33:0/1887976283 shutdown_connections 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 --2- 172.21.15.33:0/1887976283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510070870 0x7ff510070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 --2- 172.21.15.33:0/1887976283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510071f60 0x7ff510070330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 -- 172.21.15.33:0/1887976283 >> 172.21.15.33:0/1887976283 conn(0x7ff5100f8ae0 msgr2=0x7ff5100faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 -- 172.21.15.33:0/1887976283 shutdown_connections 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.235+0000 7ff515a7f700 1 -- 172.21.15.33:0/1887976283 wait complete. 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff515a7f700 1 Processor -- start 2024-02-15T22:50:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff515a7f700 1 -- start start 2024-02-15T22:50:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff515a7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510070870 0x7ff51011a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff515a7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510071f60 0x7ff51011a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff515a7f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51011ac00 con 0x7ff510070870 2024-02-15T22:50:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff515a7f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510113f10 con 0x7ff510071f60 2024-02-15T22:50:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff50f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510070870 0x7ff51011a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff50f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510070870 0x7ff51011a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45274/0 (socket says 172.21.15.33:45274) 2024-02-15T22:50:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff50f7fe700 1 -- 172.21.15.33:0/218153405 learned_addr learned my addr 172.21.15.33:0/218153405 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.236+0000 7ff50effd700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510071f60 0x7ff51011a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff50f7fe700 1 -- 172.21.15.33:0/218153405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510071f60 msgr2=0x7ff51011a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff50f7fe700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510071f60 0x7ff51011a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff50f7fe700 1 -- 172.21.15.33:0/218153405 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500005040 con 0x7ff510070870 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff50f7fe700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510070870 0x7ff51011a070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff500005010 tx=0x7ff500009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff4f7fff700 1 -- 172.21.15.33:0/218153405 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50000e040 con 0x7ff510070870 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff4f7fff700 1 -- 172.21.15.33:0/218153405 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff500013420 con 0x7ff510070870 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff510114190 con 0x7ff510070870 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff4f7fff700 1 -- 172.21.15.33:0/218153405 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50001c610 con 0x7ff510070870 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.237+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5101146d0 con 0x7ff510070870 2024-02-15T22:50:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.238+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5100fe400 con 0x7ff510070870 2024-02-15T22:50:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.239+0000 7ff4f7fff700 1 -- 172.21.15.33:0/218153405 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff500009550 con 0x7ff510070870 2024-02-15T22:50:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.239+0000 7ff4f7fff700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4f806d7e0 0x7ff4f806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.239+0000 7ff50effd700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4f806d7e0 0x7ff4f806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.239+0000 7ff4f7fff700 1 -- 172.21.15.33:0/218153405 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff50008e210 con 0x7ff510070870 2024-02-15T22:50:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.240+0000 7ff50effd700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4f806d7e0 0x7ff4f806fc90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff510115910 tx=0x7ff50400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:39.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.244+0000 7ff4f7fff700 1 -- 172.21.15.33:0/218153405 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff50005b610 con 0x7ff510070870 2024-02-15T22:50:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.468+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff510115650 con 0x7ff4f806d7e0 2024-02-15T22:50:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.469+0000 7ff4f7fff700 1 -- 172.21.15.33:0/218153405 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff510115650 con 0x7ff4f806d7e0 2024-02-15T22:50:39.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4f806d7e0 msgr2=0x7ff4f806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4f806d7e0 0x7ff4f806fc90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff510115910 tx=0x7ff50400b040 comp rx=0 tx=0).stop 2024-02-15T22:50:39.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510070870 msgr2=0x7ff51011a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510070870 0x7ff51011a070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff500005010 tx=0x7ff500009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 shutdown_connections 2024-02-15T22:50:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7ff4f806d7e0 0x7ff4f806fc90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff510070870 0x7ff51011a070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 --2- 172.21.15.33:0/218153405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510071f60 0x7ff51011a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 >> 172.21.15.33:0/218153405 conn(0x7ff5100f8ae0 msgr2=0x7ff5100fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 shutdown_connections 2024-02-15T22:50:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.471+0000 7ff515a7f700 1 -- 172.21.15.33:0/218153405 wait complete. 2024-02-15T22:50:39.484 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:50:39.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 -- 172.21.15.33:0/1698323303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3490103140 msgr2=0x7f3490103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 --2- 172.21.15.33:0/1698323303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3490103140 0x7f3490103510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3488004940 tx=0x7f3488009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 -- 172.21.15.33:0/1698323303 shutdown_connections 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 --2- 172.21.15.33:0/1698323303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34900fb570 0x7f34900fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 --2- 172.21.15.33:0/1698323303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3490103140 0x7f3490103510 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 -- 172.21.15.33:0/1698323303 >> 172.21.15.33:0/1698323303 conn(0x7f3490071560 msgr2=0x7f3490071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 -- 172.21.15.33:0/1698323303 shutdown_connections 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.575+0000 7f3494b72700 1 -- 172.21.15.33:0/1698323303 wait complete. 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f3494b72700 1 Processor -- start 2024-02-15T22:50:39.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f3494b72700 1 -- start start 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f3494b72700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34900fb570 0x7f34900fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f3494b72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3490103140 0x7f34900fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f3494b72700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900fd290 con 0x7f34900fb570 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f3494b72700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900fd400 con 0x7f3490103140 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f348e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34900fb570 0x7f34900fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f348e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34900fb570 0x7f34900fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45294/0 (socket says 172.21.15.33:45294) 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f348e59c700 1 -- 172.21.15.33:0/2240764748 learned_addr learned my addr 172.21.15.33:0/2240764748 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f348dd9b700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3490103140 0x7f34900fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f348e59c700 1 -- 172.21.15.33:0/2240764748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3490103140 msgr2=0x7f34900fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f348e59c700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3490103140 0x7f34900fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.576+0000 7f348e59c700 1 -- 172.21.15.33:0/2240764748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3488005040 con 0x7f34900fb570 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.577+0000 7f348e59c700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34900fb570 0x7f34900fc750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f348800b3b0 tx=0x7f3488009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.577+0000 7f3486ffd700 1 -- 172.21.15.33:0/2240764748 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348800e040 con 0x7f34900fb570 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.577+0000 7f3486ffd700 1 -- 172.21.15.33:0/2240764748 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f348800bbf0 con 0x7f34900fb570 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.577+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3490119da0 con 0x7f34900fb570 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.577+0000 7f3486ffd700 1 -- 172.21.15.33:0/2240764748 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348801c3f0 con 0x7f34900fb570 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.577+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349011a200 con 0x7f34900fb570 2024-02-15T22:50:39.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.578+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3490100310 con 0x7f34900fb570 2024-02-15T22:50:39.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.578+0000 7f3486ffd700 1 -- 172.21.15.33:0/2240764748 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f348800bd60 con 0x7f34900fb570 2024-02-15T22:50:39.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.579+0000 7f3486ffd700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f347c06d7e0 0x7f347c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.579+0000 7f3486ffd700 1 -- 172.21.15.33:0/2240764748 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f348808e0f0 con 0x7f34900fb570 2024-02-15T22:50:39.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.579+0000 7f348dd9b700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f347c06d7e0 0x7f347c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.579+0000 7f348dd9b700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f347c06d7e0 0x7f347c06fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f34900fe150 tx=0x7f347800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:39.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.583+0000 7f3486ffd700 1 -- 172.21.15.33:0/2240764748 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3488057a60 con 0x7f34900fb570 2024-02-15T22:50:39.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.803+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f349004bf70 con 0x7f347c06d7e0 2024-02-15T22:50:39.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.805+0000 7f3486ffd700 1 -- 172.21.15.33:0/2240764748 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f347800f040 con 0x7f347c06d7e0 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f347c06d7e0 msgr2=0x7f347c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f347c06d7e0 0x7f347c06fc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f34900fe150 tx=0x7f347800b040 comp rx=0 tx=0).stop 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34900fb570 msgr2=0x7f34900fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34900fb570 0x7f34900fc750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f348800b3b0 tx=0x7f3488009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 shutdown_connections 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f347c06d7e0 0x7f347c06fc90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34900fb570 0x7f34900fc750 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 --2- 172.21.15.33:0/2240764748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3490103140 0x7f34900fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 >> 172.21.15.33:0/2240764748 conn(0x7f3490071560 msgr2=0x7f34900fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:39.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 shutdown_connections 2024-02-15T22:50:39.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.807+0000 7f3494b72700 1 -- 172.21.15.33:0/2240764748 wait complete. 2024-02-15T22:50:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 -- 172.21.15.33:0/1137417116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 msgr2=0x7f9360102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 --2- 172.21.15.33:0/1137417116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102210 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9350004940 tx=0x7f9350009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 -- 172.21.15.33:0/1137417116 shutdown_connections 2024-02-15T22:50:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 --2- 172.21.15.33:0/1137417116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93601027e0 0x7f93600fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 --2- 172.21.15.33:0/1137417116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102210 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 -- 172.21.15.33:0/1137417116 >> 172.21.15.33:0/1137417116 conn(0x7f9360071d90 msgr2=0x7f9360072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 -- 172.21.15.33:0/1137417116 shutdown_connections 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.910+0000 7f9367542700 1 -- 172.21.15.33:0/1137417116 wait complete. 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f9367542700 1 Processor -- start 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f9367542700 1 -- start start 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f9367542700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f9367542700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93601027e0 0x7f93601031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f9367542700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93601037e0 con 0x7f9360101e40 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f9367542700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360103950 con 0x7f93601027e0 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f93652de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f93652de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45322/0 (socket says 172.21.15.33:45322) 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f93652de700 1 -- 172.21.15.33:0/1920097001 learned_addr learned my addr 172.21.15.33:0/1920097001 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f9364add700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93601027e0 0x7f93601031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f93652de700 1 -- 172.21.15.33:0/1920097001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93601027e0 msgr2=0x7f93601031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.911+0000 7f93652de700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93601027e0 0x7f93601031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f93652de700 1 -- 172.21.15.33:0/1920097001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350005040 con 0x7f9360101e40 2024-02-15T22:50:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f9364add700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93601027e0 0x7f93601031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:50:39.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f93652de700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f935000b3b0 tx=0x7f9350009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:39.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f9355ffb700 1 -- 172.21.15.33:0/1920097001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f935000e040 con 0x7f9360101e40 2024-02-15T22:50:39.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f9355ffb700 1 -- 172.21.15.33:0/1920097001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f935000bbf0 con 0x7f9360101e40 2024-02-15T22:50:39.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9360119c10 con 0x7f9360101e40 2024-02-15T22:50:39.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f9355ffb700 1 -- 172.21.15.33:0/1920097001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f935001c630 con 0x7f9360101e40 2024-02-15T22:50:39.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.912+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936011a070 con 0x7f9360101e40 2024-02-15T22:50:39.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.913+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93600738b0 con 0x7f9360101e40 2024-02-15T22:50:39.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.914+0000 7f9355ffb700 1 -- 172.21.15.33:0/1920097001 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f935000bd60 con 0x7f9360101e40 2024-02-15T22:50:39.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.914+0000 7f9355ffb700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f934c06d7e0 0x7f934c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:39.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.914+0000 7f9355ffb700 1 -- 172.21.15.33:0/1920097001 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f935008e1c0 con 0x7f9360101e40 2024-02-15T22:50:39.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.914+0000 7f9364add700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f934c06d7e0 0x7f934c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:39.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.915+0000 7f9364add700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f934c06d7e0 0x7f934c06fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f935c009b80 tx=0x7f935c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:39.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:39.920+0000 7f9355ffb700 1 -- 172.21.15.33:0/1920097001 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9350057b30 con 0x7f9360101e40 2024-02-15T22:50:40.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.134+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9360065dd0 con 0x7f934c06d7e0 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.145+0000 7f9355ffb700 1 -- 172.21.15.33:0/1920097001 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9360065dd0 con 0x7f934c06d7e0 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 10s ago 17m 26.3M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 10s ago 18m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (4m) 50s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (6m) 10s ago 17m 86.3M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (35s) 10s ago 12m 14.0M - 19.0.0-1450-gf78a58c0 f081f847070a 51df5be6ea1f 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (15s) 10s ago 12m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a 487af1d647b0 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (12m) 50s ago 12m 125M - 17.2.7-509-g9aa52330 61c0ec9cd187 a2af22565ec1 2024-02-15T22:50:40.147 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (12m) 50s ago 12m 67.8M - 17.2.7-509-g9aa52330 61c0ec9cd187 88bdb435bb87 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (8m) 10s ago 19m 508M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (7m) 50s ago 16m 451M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (5m) 10s ago 19m 53.5M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (4m) 50s ago 16m 39.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (7m) 10s ago 18m 16.3M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 50s ago 16m 16.2M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 10s ago 15m 93.0M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 10s ago 15m 101M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 10s ago 14m 83.5M 1559M 19.0.0-1450-gf78a58c0 f081f847070a dfdcfe354b41 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (2m) 50s ago 14m 100M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 7778c235281a 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (87s) 50s ago 14m 91.3M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 66b57df413a7 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (54s) 50s ago 13m 12.6M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 5aebe296615c 2024-02-15T22:50:40.148 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (7m) 10s ago 17m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:50:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f934c06d7e0 msgr2=0x7f934c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f934c06d7e0 0x7f934c06fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f935c009b80 tx=0x7f935c00b040 comp rx=0 tx=0).stop 2024-02-15T22:50:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 msgr2=0x7f9360102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f935000b3b0 tx=0x7f9350009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 shutdown_connections 2024-02-15T22:50:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f934c06d7e0 0x7f934c06fc90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9360101e40 0x7f9360102ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 --2- 172.21.15.33:0/1920097001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93601027e0 0x7f93601031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 >> 172.21.15.33:0/1920097001 conn(0x7f9360071d90 msgr2=0x7f93600656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 shutdown_connections 2024-02-15T22:50:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.147+0000 7f9367542700 1 -- 172.21.15.33:0/1920097001 wait complete. 2024-02-15T22:50:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 -- 172.21.15.33:0/3865625606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 msgr2=0x7f9dec0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/3865625606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec0fbe70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9de0004940 tx=0x7f9de0009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 -- 172.21.15.33:0/3865625606 shutdown_connections 2024-02-15T22:50:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/3865625606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec0fbe70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/3865625606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec101e60 0x7f9dec102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 -- 172.21.15.33:0/3865625606 >> 172.21.15.33:0/3865625606 conn(0x7f9dec0f7a10 msgr2=0x7f9dec0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:40.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:39 smithi033 ceph-mon[113773]: pgmap v192: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:40.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:39 smithi033 ceph-mon[113773]: osdmap e84: 6 total, 6 up, 6 in 2024-02-15T22:50:40.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:39 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 -- 172.21.15.33:0/3865625606 shutdown_connections 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.249+0000 7f9df3ddb700 1 -- 172.21.15.33:0/3865625606 wait complete. 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df3ddb700 1 Processor -- start 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df3ddb700 1 -- start start 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df3ddb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec101e60 0x7f9dec113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df3ddb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df3ddb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec1146c0 con 0x7f9dec102800 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df3ddb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec10d9f0 con 0x7f9dec101e60 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1376700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1376700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45340/0 (socket says 172.21.15.33:45340) 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1376700 1 -- 172.21.15.33:0/371344454 learned_addr learned my addr 172.21.15.33:0/371344454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1b77700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec101e60 0x7f9dec113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1376700 1 -- 172.21.15.33:0/371344454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec101e60 msgr2=0x7f9dec113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1376700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec101e60 0x7f9dec113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1376700 1 -- 172.21.15.33:0/371344454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0005040 con 0x7f9dec102800 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.250+0000 7f9df1376700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec114070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009030 tx=0x7f9de0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.251+0000 7f9dea7fc700 1 -- 172.21.15.33:0/371344454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de000e040 con 0x7f9dec102800 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.251+0000 7f9dea7fc700 1 -- 172.21.15.33:0/371344454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9de0009400 con 0x7f9dec102800 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.251+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec10dc70 con 0x7f9dec102800 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.251+0000 7f9dea7fc700 1 -- 172.21.15.33:0/371344454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de001c3f0 con 0x7f9dec102800 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.251+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec10e1b0 con 0x7f9dec102800 2024-02-15T22:50:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.252+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec0fb610 con 0x7f9dec102800 2024-02-15T22:50:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.253+0000 7f9dea7fc700 1 -- 172.21.15.33:0/371344454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9de000bbf0 con 0x7f9dec102800 2024-02-15T22:50:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.253+0000 7f9dea7fc700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9dd406d7f0 0x7f9dd406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.253+0000 7f9dea7fc700 1 -- 172.21.15.33:0/371344454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9de008e220 con 0x7f9dec102800 2024-02-15T22:50:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.253+0000 7f9df1b77700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9dd406d7f0 0x7f9dd406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.254+0000 7f9df1b77700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9dd406d7f0 0x7f9dd406fca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc007a40 tx=0x7f9ddc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:40.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.258+0000 7f9dea7fc700 1 -- 172.21.15.33:0/371344454 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9de005b620 con 0x7f9dec102800 2024-02-15T22:50:40.339 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:39 smithi082 ceph-mon[84550]: pgmap v192: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:40.339 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:39 smithi082 ceph-mon[84550]: osdmap e84: 6 total, 6 up, 6 in 2024-02-15T22:50:40.339 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:39 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.545+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9dec10de00 con 0x7f9dec102800 2024-02-15T22:50:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.545+0000 7f9dea7fc700 1 -- 172.21.15.33:0/371344454 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f9dec10de00 con 0x7f9dec102800 2024-02-15T22:50:40.547 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 1, 2024-02-15T22:50:40.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:50:40.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:50:40.549 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:50:40.549 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.2.7-509-g9aa52330 (9aa523302d708a6b7b80d8bdd462ebc306fb50d2) quincy (stable)": 1, 2024-02-15T22:50:40.549 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 12 2024-02-15T22:50:40.549 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:50:40.549 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:50:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9dd406d7f0 msgr2=0x7f9dd406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9dd406d7f0 0x7f9dd406fca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc007a40 tx=0x7f9ddc009da0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 msgr2=0x7f9dec114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec114070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009030 tx=0x7f9de0009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 shutdown_connections 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f9dd406d7f0 0x7f9dd406fca0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dec101e60 0x7f9dec113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 --2- 172.21.15.33:0/371344454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dec102800 0x7f9dec114070 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 >> 172.21.15.33:0/371344454 conn(0x7f9dec0f7a10 msgr2=0x7f9dec100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 shutdown_connections 2024-02-15T22:50:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.547+0000 7f9df3ddb700 1 -- 172.21.15.33:0/371344454 wait complete. 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 -- 172.21.15.33:0/1402904549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fc650 msgr2=0x7f88801093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 --2- 172.21.15.33:0/1402904549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fc650 0x7f88801093b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8874004940 tx=0x7f8874009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 -- 172.21.15.33:0/1402904549 shutdown_connections 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 --2- 172.21.15.33:0/1402904549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fc650 0x7f88801093b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 --2- 172.21.15.33:0/1402904549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800fbd40 0x7f88800fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 -- 172.21.15.33:0/1402904549 >> 172.21.15.33:0/1402904549 conn(0x7f88800f7a10 msgr2=0x7f88800f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 -- 172.21.15.33:0/1402904549 shutdown_connections 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 -- 172.21.15.33:0/1402904549 wait complete. 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 Processor -- start 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.650+0000 7f88881a3700 1 -- start start 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f88881a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fbd40 0x7f8880115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f88881a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800fc650 0x7f8880116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f88881a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8880116910 con 0x7f88800fbd40 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f88881a3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888010fb90 con 0x7f88800fc650 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f8885f3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fbd40 0x7f8880115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f8885f3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fbd40 0x7f8880115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45358/0 (socket says 172.21.15.33:45358) 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f8885f3f700 1 -- 172.21.15.33:0/3149897935 learned_addr learned my addr 172.21.15.33:0/3149897935 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f8885f3f700 1 -- 172.21.15.33:0/3149897935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800fc650 msgr2=0x7f8880116230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f8885f3f700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800fc650 0x7f8880116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f8885f3f700 1 -- 172.21.15.33:0/3149897935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8874005040 con 0x7f88800fbd40 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f8885f3f700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fbd40 0x7f8880115cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f887800bbb0 tx=0x7f8878009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f887e7fc700 1 -- 172.21.15.33:0/3149897935 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88780092e0 con 0x7f88800fbd40 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f887e7fc700 1 -- 172.21.15.33:0/3149897935 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f887800cbd0 con 0x7f88800fbd40 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888010fe10 con 0x7f88800fbd40 2024-02-15T22:50:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f887e7fc700 1 -- 172.21.15.33:0/3149897935 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8878007400 con 0x7f88800fbd40 2024-02-15T22:50:40.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.651+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8880110350 con 0x7f88800fbd40 2024-02-15T22:50:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.652+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880106ae0 con 0x7f88800fbd40 2024-02-15T22:50:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.653+0000 7f887e7fc700 1 -- 172.21.15.33:0/3149897935 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8878012070 con 0x7f88800fbd40 2024-02-15T22:50:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.653+0000 7f887e7fc700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f886806d7e0 0x7f886806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.654+0000 7f887e7fc700 1 -- 172.21.15.33:0/3149897935 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f887808cb70 con 0x7f88800fbd40 2024-02-15T22:50:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.654+0000 7f888573e700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f886806d7e0 0x7f886806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.654+0000 7f888573e700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f886806d7e0 0x7f886806fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8874004f90 tx=0x7f8874009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:40.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.658+0000 7f887e7fc700 1 -- 172.21.15.33:0/3149897935 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8878059ef0 con 0x7f88800fbd40 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.906+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f88801112d0 con 0x7f88800fbd40 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.906+0000 7f887e7fc700 1 -- 172.21.15.33:0/3149897935 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1661 (secure 0 0 0) 0x7f8878059a80 con 0x7f88800fbd40 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout:e30 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:50:40.909 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 24 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:49:55.970826+0000 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 81 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2024-02-15T22:50:40.910 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0,1 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{-1:34390} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T22:50:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{-1:34422} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T22:50:40.912 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{-1:44267} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/3515165172,v1:172.21.15.82:6827/3515165172] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:50:40.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.909+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f886806d7e0 msgr2=0x7f886806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.909+0000 7f88881a3700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f886806d7e0 0x7f886806fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8874004f90 tx=0x7f8874009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fbd40 msgr2=0x7f8880115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fbd40 0x7f8880115cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f887800bbb0 tx=0x7f8878009840 comp rx=0 tx=0).stop 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 shutdown_connections 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f886806d7e0 0x7f886806fc90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88800fbd40 0x7f8880115cf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 --2- 172.21.15.33:0/3149897935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800fc650 0x7f8880116230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 >> 172.21.15.33:0/3149897935 conn(0x7f88800f7a10 msgr2=0x7f88800f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 shutdown_connections 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:40.910+0000 7f88881a3700 1 -- 172.21.15.33:0/3149897935 wait complete. 2024-02-15T22:50:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-02-15T22:50:41.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 -- 172.21.15.33:0/4266909639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 msgr2=0x7f58d00fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/4266909639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d00fcf50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58c4004940 tx=0x7f58c4009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 -- 172.21.15.33:0/4266909639 shutdown_connections 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/4266909639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d00fcf50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/4266909639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d0102f40 0x7f58d0103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 -- 172.21.15.33:0/4266909639 >> 172.21.15.33:0/4266909639 conn(0x7f58d00f8af0 msgr2=0x7f58d00faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 -- 172.21.15.33:0/4266909639 shutdown_connections 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.016+0000 7f58d6ed7700 1 -- 172.21.15.33:0/4266909639 wait complete. 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58d6ed7700 1 Processor -- start 2024-02-15T22:50:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58d6ed7700 1 -- start start 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58d6ed7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d0102f40 0x7f58d01139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58d6ed7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d0113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58d6ed7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0114580 con 0x7f58d01038e0 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58d6ed7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d010d920 con 0x7f58d0102f40 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d0113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d0113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45380/0 (socket says 172.21.15.33:45380) 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58cffff700 1 -- 172.21.15.33:0/3192071340 learned_addr learned my addr 172.21.15.33:0/3192071340 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58d4c73700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d0102f40 0x7f58d01139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.017+0000 7f58cffff700 1 -- 172.21.15.33:0/3192071340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d0102f40 msgr2=0x7f58d01139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58cffff700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d0102f40 0x7f58d01139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58cffff700 1 -- 172.21.15.33:0/3192071340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4005040 con 0x7f58d01038e0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58d4c73700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d0102f40 0x7f58d01139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58cffff700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d0113f30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009100 tx=0x7f58c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58cd7fa700 1 -- 172.21.15.33:0/3192071340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c400e040 con 0x7f58d01038e0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d010dba0 con 0x7f58d01038e0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58cd7fa700 1 -- 172.21.15.33:0/3192071340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58c4004290 con 0x7f58d01038e0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58cd7fa700 1 -- 172.21.15.33:0/3192071340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c401c3f0 con 0x7f58d01038e0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.018+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d010e0e0 con 0x7f58d01038e0 2024-02-15T22:50:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.019+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d0105410 con 0x7f58d01038e0 2024-02-15T22:50:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.019+0000 7f58cd7fa700 1 -- 172.21.15.33:0/3192071340 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f58c400bbf0 con 0x7f58d01038e0 2024-02-15T22:50:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.020+0000 7f58cd7fa700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f58b806d7f0 0x7f58b806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.020+0000 7f58cd7fa700 1 -- 172.21.15.33:0/3192071340 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f58c408e210 con 0x7f58d01038e0 2024-02-15T22:50:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.020+0000 7f58d4c73700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f58b806d7f0 0x7f58b806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.020+0000 7f58d4c73700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f58b806d7f0 0x7f58b806fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58c0001250 tx=0x7f58c000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:41.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.025+0000 7f58cd7fa700 1 -- 172.21.15.33:0/3192071340 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f58c405b610 con 0x7f58d01038e0 2024-02-15T22:50:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:40 smithi082 ceph-mon[84550]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:40 smithi082 ceph-mon[84550]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:40 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/371344454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:41.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:40 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3149897935' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:50:41.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.248+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58d01136c0 con 0x7f58b806d7f0 2024-02-15T22:50:41.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:40 smithi033 ceph-mon[113773]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:41.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:40 smithi033 ceph-mon[113773]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:41.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:40 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/371344454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:41.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:40 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3149897935' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.249+0000 7f58cd7fa700 1 -- 172.21.15.33:0/3192071340 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f58d01136c0 con 0x7f58b806d7f0 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T22:50:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-02-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "osd" 2024-02-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "14/21 daemons upgraded", 2024-02-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading mds daemons", 2024-02-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f58b806d7f0 msgr2=0x7f58b806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f58b806d7f0 0x7f58b806fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58c0001250 tx=0x7f58c000b040 comp rx=0 tx=0).stop 2024-02-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 msgr2=0x7f58d0113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d0113f30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009100 tx=0x7f58c4009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 shutdown_connections 2024-02-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f58b806d7f0 0x7f58b806fca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d0102f40 0x7f58d01139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 --2- 172.21.15.33:0/3192071340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58d01038e0 0x7f58d0113f30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 >> 172.21.15.33:0/3192071340 conn(0x7f58d00f8af0 msgr2=0x7f58d00fa660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 shutdown_connections 2024-02-15T22:50:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.251+0000 7f58d6ed7700 1 -- 172.21.15.33:0/3192071340 wait complete. 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 -- 172.21.15.33:0/1840417136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fb7c0 msgr2=0x7fef2c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 --2- 172.21.15.33:0/1840417136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c0fbb90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef28004940 tx=0x7fef28009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 -- 172.21.15.33:0/1840417136 shutdown_connections 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 --2- 172.21.15.33:0/1840417136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fc0d0 0x7fef2c10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 --2- 172.21.15.33:0/1840417136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c0fbb90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 -- 172.21.15.33:0/1840417136 >> 172.21.15.33:0/1840417136 conn(0x7fef2c071560 msgr2=0x7fef2c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 -- 172.21.15.33:0/1840417136 shutdown_connections 2024-02-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 -- 172.21.15.33:0/1840417136 wait complete. 2024-02-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 Processor -- start 2024-02-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.355+0000 7fef33b5a700 1 -- start start 2024-02-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef33b5a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c11a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef33b5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fc0d0 0x7fef2c11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef33b5a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c11ac70 con 0x7fef2c0fc0d0 2024-02-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef33b5a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c113f80 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef318f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c11a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef310f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fc0d0 0x7fef2c11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef318f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c11a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:36334/0 (socket says 172.21.15.33:36334) 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef318f6700 1 -- 172.21.15.33:0/472644813 learned_addr learned my addr 172.21.15.33:0/472644813 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef318f6700 1 -- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fc0d0 msgr2=0x7fef2c11a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef318f6700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fc0d0 0x7fef2c11a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef318f6700 1 -- 172.21.15.33:0/472644813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28005040 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef310f5700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fc0d0 0x7fef2c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.356+0000 7fef318f6700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c11a0e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fef28009b30 tx=0x7fef28009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.357+0000 7fef227fc700 1 -- 172.21.15.33:0/472644813 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef2800e030 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.357+0000 7fef227fc700 1 -- 172.21.15.33:0/472644813 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef28013d00 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.357+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c114200 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.357+0000 7fef227fc700 1 -- 172.21.15.33:0/472644813 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef2800b840 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.357+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c114740 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.358+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c0fe0e0 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.358+0000 7fef227fc700 1 -- 172.21.15.33:0/472644813 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fef2801cc60 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.359+0000 7fef227fc700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fef1806d7e0 0x7fef1806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.359+0000 7fef227fc700 1 -- 172.21.15.33:0/472644813 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fef2808eb60 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.359+0000 7fef310f5700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fef1806d7e0 0x7fef1806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.359+0000 7fef310f5700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fef1806d7e0 0x7fef1806fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef2c115980 tx=0x7fef1c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.363+0000 7fef227fc700 1 -- 172.21.15.33:0/472644813 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fef2805bf60 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.653+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fef2c04bed0 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.654+0000 7fef227fc700 1 -- 172.21.15.33:0/472644813 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fef28004490 con 0x7fef2c0fb7c0 2024-02-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi033.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: fs cephfs is degraded 2024-02-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi033.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fef1806d7e0 msgr2=0x7fef1806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fef1806d7e0 0x7fef1806fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef2c115980 tx=0x7fef1c00b040 comp rx=0 tx=0).stop 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fb7c0 msgr2=0x7fef2c11a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c11a0e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fef28009b30 tx=0x7fef28009e30 comp rx=0 tx=0).stop 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 shutdown_connections 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fef1806d7e0 0x7fef1806fc90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef2c0fb7c0 0x7fef2c11a0e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 --2- 172.21.15.33:0/472644813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef2c0fc0d0 0x7fef2c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 >> 172.21.15.33:0/472644813 conn(0x7fef2c071560 msgr2=0x7fef2c10bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 shutdown_connections 2024-02-15T22:50:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:50:41.656+0000 7fef33b5a700 1 -- 172.21.15.33:0/472644813 wait complete. 2024-02-15T22:50:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:41 smithi033 ceph-mon[113773]: pgmap v194: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:41 smithi033 ceph-mon[113773]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:41 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/472644813' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:50:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:41 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:41 smithi082 ceph-mon[84550]: pgmap v194: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:41 smithi082 ceph-mon[84550]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:41 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/472644813' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:50:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:41 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:43.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:42 smithi033 ceph-mon[113773]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:43.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:42 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.82:6824/90593148,v1:172.21.15.82:6825/90593148] up:boot 2024-02-15T22:50:43.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:42 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:43.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:42 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:50:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:42 smithi082 ceph-mon[84550]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:42 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.82:6824/90593148,v1:172.21.15.82:6825/90593148] up:boot 2024-02-15T22:50:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:42 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:43.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:42 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:50:44.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:43 smithi082 ceph-mon[84550]: pgmap v195: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:44.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:44.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:43 smithi033 ceph-mon[113773]: pgmap v195: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:44.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:46.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:45 smithi082 ceph-mon[84550]: pgmap v196: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:46.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:45 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:46.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:45 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:46.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:45 smithi033 ceph-mon[113773]: pgmap v196: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:46.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:45 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:46.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:45 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:47.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:46 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:47.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:46 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:47.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:46 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:47.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:46 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:48.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:47 smithi082 ceph-mon[84550]: pgmap v197: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:48.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:47 smithi033 ceph-mon[113773]: pgmap v197: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:50.209 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: pgmap v198: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:50.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:49 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:50.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: pgmap v198: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:50.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:50.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:50.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:50.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:50.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:50.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:50.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:50.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:50.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:50.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:49 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:52.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:51 smithi082 ceph-mon[84550]: pgmap v199: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:52.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:52.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:50:52.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:51 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:51 smithi033 ceph-mon[113773]: pgmap v199: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.rtwnpu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:50:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:51 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:53.175 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:52 smithi082 ceph-mon[84550]: Upgrade: Updating mds.cephfs.smithi082.rtwnpu 2024-02-15T22:50:53.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:52 smithi082 ceph-mon[84550]: Deploying daemon mds.cephfs.smithi082.rtwnpu on smithi082 2024-02-15T22:50:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:52 smithi033 ceph-mon[113773]: Upgrade: Updating mds.cephfs.smithi082.rtwnpu 2024-02-15T22:50:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:52 smithi033 ceph-mon[113773]: Deploying daemon mds.cephfs.smithi082.rtwnpu on smithi082 2024-02-15T22:50:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:53 smithi033 ceph-mon[113773]: pgmap v200: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:54.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:53 smithi082 ceph-mon[84550]: pgmap v200: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:55.207 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:54 smithi082 ceph-mon[84550]: osdmap e85: 6 total, 6 up, 6 in 2024-02-15T22:50:55.207 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:54 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:55.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:54 smithi033 ceph-mon[113773]: osdmap e85: 6 total, 6 up, 6 in 2024-02-15T22:50:55.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:54 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T22:50:56.146 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:55 smithi082 ceph-mon[84550]: pgmap v202: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:56.186 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:55 smithi033 ceph-mon[113773]: pgmap v202: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:58.256 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:57 smithi082 ceph-mon[84550]: pgmap v203: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:58.256 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:58.256 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:58.256 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:57 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:58.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:57 smithi033 ceph-mon[113773]: pgmap v203: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:50:58.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:58.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:50:58.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:57 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:59.099 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:58 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.82:6826/4092453555,v1:172.21.15.82:6827/4092453555] up:boot 2024-02-15T22:50:59.099 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:58 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:59.099 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:50:59.100 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:58 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.82:6826/4092453555,v1:172.21.15.82:6827/4092453555] up:boot 2024-02-15T22:50:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:58 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:50:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:50:59.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:59 smithi082 ceph-mon[84550]: pgmap v204: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:00.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:50:59 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:59 smithi033 ceph-mon[113773]: pgmap v204: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:50:59 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:02.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:01 smithi082 ceph-mon[84550]: pgmap v205: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:02.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:02.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:01 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:01 smithi033 ceph-mon[113773]: pgmap v205: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:01 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:04.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:03 smithi082 ceph-mon[84550]: pgmap v206: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:04.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:03 smithi033 ceph-mon[113773]: pgmap v206: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:05.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: pgmap v207: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:05.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all mds 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:51:05.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.ruqork"}]': finished 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.xkdegf"}]': finished 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.lvpzpf"}]': finished 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.rtwnpu"}]': finished 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: Upgrade: Setting filesystem cephfs Joinable 2024-02-15T22:51:05.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:05 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-15T22:51:05.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: pgmap v207: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:51:05.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all mds 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.ruqork"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.ruqork"}]': finished 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.xkdegf"}]: dispatch 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.xkdegf"}]': finished 2024-02-15T22:51:05.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.lvpzpf"}]: dispatch 2024-02-15T22:51:05.960 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.lvpzpf"}]': finished 2024-02-15T22:51:05.960 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.rtwnpu"}]: dispatch 2024-02-15T22:51:05.960 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.rtwnpu"}]': finished 2024-02-15T22:51:05.960 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: Upgrade: Setting filesystem cephfs Joinable 2024-02-15T22:51:05.960 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:05 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-15T22:51:07.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-15T22:51:07.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: Standby daemon mds.cephfs.smithi033.ruqork assigned to filesystem cephfs as rank 0 2024-02-15T22:51:07.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: Standby daemon mds.cephfs.smithi033.xkdegf assigned to filesystem cephfs as rank 1 2024-02-15T22:51:07.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T22:51:07.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:51:07.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-15T22:51:07.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:replay,1=cephfs.smithi033.xkdegf=up:replay} 2 up:standby 2024-02-15T22:51:07.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:06 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: Standby daemon mds.cephfs.smithi033.ruqork assigned to filesystem cephfs as rank 0 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: Standby daemon mds.cephfs.smithi033.xkdegf assigned to filesystem cephfs as rank 1 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:replay,1=cephfs.smithi033.xkdegf=up:replay} 2 up:standby 2024-02-15T22:51:07.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:06 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-15T22:51:08.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: pgmap v208: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 1 op/s 2024-02-15T22:51:08.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-15T22:51:08.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:replay,1=cephfs.smithi033.xkdegf=up:replay} 2 up:standby 2024-02-15T22:51:08.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all rgw 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all ceph-exporter 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all iscsi 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all nfs 2024-02-15T22:51:08.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Setting container_image for all nvmeof 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Finalizing container_image settings 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.024 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T22:51:08.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.026 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: Upgrade: Complete! 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:08.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: pgmap v208: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 1 op/s 2024-02-15T22:51:08.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:replay,1=cephfs.smithi033.xkdegf=up:replay} 2 up:standby 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all rgw 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all ceph-exporter 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all iscsi 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all nfs 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Setting container_image for all nvmeof 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Finalizing container_image settings 2024-02-15T22:51:08.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T22:51:08.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: Upgrade: Complete! 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:08.130 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:09.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:09 smithi033 ceph-mon[113773]: pgmap v209: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s rd, 2 op/s 2024-02-15T22:51:09.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:09 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:09 smithi082 ceph-mon[84550]: pgmap v209: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s rd, 2 op/s 2024-02-15T22:51:09.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:09 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:11.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 -- 172.21.15.33:0/854365875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 msgr2=0x7fc05c0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 --2- 172.21.15.33:0/854365875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fe3b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc058004970 tx=0x7fc058009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 -- 172.21.15.33:0/854365875 shutdown_connections 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 --2- 172.21.15.33:0/854365875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc05c0fe8f0 0x7fc05c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 --2- 172.21.15.33:0/854365875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fe3b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 -- 172.21.15.33:0/854365875 >> 172.21.15.33:0/854365875 conn(0x7fc05c071d90 msgr2=0x7fc05c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 -- 172.21.15.33:0/854365875 shutdown_connections 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.763+0000 7fc063882700 1 -- 172.21.15.33:0/854365875 wait complete. 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.764+0000 7fc063882700 1 Processor -- start 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.764+0000 7fc063882700 1 -- start start 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.764+0000 7fc063882700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:11.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.764+0000 7fc063882700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc05c0fe8f0 0x7fc05c0fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.764+0000 7fc063882700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0fc9e0 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.764+0000 7fc063882700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0fcb50 con 0x7fc05c0fe8f0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc06161e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc06161e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54200/0 (socket says 172.21.15.33:54200) 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc06161e700 1 -- 172.21.15.33:0/3689773241 learned_addr learned my addr 172.21.15.33:0/3689773241 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc060e1d700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc05c0fe8f0 0x7fc05c0fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc06161e700 1 -- 172.21.15.33:0/3689773241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc05c0fe8f0 msgr2=0x7fc05c0fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc06161e700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc05c0fe8f0 0x7fc05c0fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc06161e700 1 -- 172.21.15.33:0/3689773241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058005040 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc06161e700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fbea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc058000c00 tx=0x7fc058009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc051ffb700 1 -- 172.21.15.33:0/3689773241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05800e040 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc051ffb700 1 -- 172.21.15.33:0/3689773241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc058009af0 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc051ffb700 1 -- 172.21.15.33:0/3689773241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05801c3f0 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.765+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c119c90 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.766+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c11a0a0 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.767+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c1046c0 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.767+0000 7fc051ffb700 1 -- 172.21.15.33:0/3689773241 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc05800bc10 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.768+0000 7fc051ffb700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc04806d7e0 0x7fc04806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.768+0000 7fc051ffb700 1 -- 172.21.15.33:0/3689773241 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc05808e190 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.768+0000 7fc060e1d700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc04806d7e0 0x7fc04806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.768+0000 7fc060e1d700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc04806d7e0 0x7fc04806fc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0fd8a0 tx=0x7fc04c0043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:11.773+0000 7fc051ffb700 1 -- 172.21.15.33:0/3689773241 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc0580579e0 con 0x7fc05c0fdfe0 2024-02-15T22:51:11.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:11 smithi082 ceph-mon[84550]: pgmap v210: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 5 op/s 2024-02-15T22:51:12.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:11 smithi033 ceph-mon[113773]: pgmap v210: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 5 op/s 2024-02-15T22:51:12.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.049+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc05c0fd5e0 con 0x7fc04806d7e0 2024-02-15T22:51:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.050+0000 7fc051ffb700 1 -- 172.21.15.33:0/3689773241 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc05c0fd5e0 con 0x7fc04806d7e0 2024-02-15T22:51:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc04806d7e0 msgr2=0x7fc04806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc04806d7e0 0x7fc04806fc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0fd8a0 tx=0x7fc04c0043c0 comp rx=0 tx=0).stop 2024-02-15T22:51:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 msgr2=0x7fc05c0fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fbea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc058000c00 tx=0x7fc058009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 shutdown_connections 2024-02-15T22:51:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc04806d7e0 0x7fc04806fc90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc05c0fdfe0 0x7fc05c0fbea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 --2- 172.21.15.33:0/3689773241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc05c0fe8f0 0x7fc05c0fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 >> 172.21.15.33:0/3689773241 conn(0x7fc05c071d90 msgr2=0x7fc05c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 shutdown_connections 2024-02-15T22:51:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:12.053+0000 7fc063882700 1 -- 172.21.15.33:0/3689773241 wait complete. 2024-02-15T22:51:12.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:12 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:resolve 2024-02-15T22:51:12.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:12 smithi082 ceph-mon[84550]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:replay,1=cephfs.smithi033.xkdegf=up:resolve} 2 up:standby 2024-02-15T22:51:13.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:12 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:resolve 2024-02-15T22:51:13.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:12 smithi033 ceph-mon[113773]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:replay,1=cephfs.smithi033.xkdegf=up:resolve} 2 up:standby 2024-02-15T22:51:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:13 smithi082 ceph-mon[84550]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:13 smithi082 ceph-mon[84550]: pgmap v211: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-02-15T22:51:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:13.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:14.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:13 smithi033 ceph-mon[113773]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:14.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:13 smithi033 ceph-mon[113773]: pgmap v211: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-02-15T22:51:14.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:14.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:15.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:15 smithi082 ceph-mon[84550]: pgmap v212: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-15T22:51:15.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:15 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:resolve 2024-02-15T22:51:15.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:15 smithi082 ceph-mon[84550]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:resolve,1=cephfs.smithi033.xkdegf=up:resolve} 2 up:standby 2024-02-15T22:51:15.957 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:15 smithi033 ceph-mon[113773]: pgmap v212: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-15T22:51:15.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:15 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:resolve 2024-02-15T22:51:15.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:15 smithi033 ceph-mon[113773]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:resolve,1=cephfs.smithi033.xkdegf=up:resolve} 2 up:standby 2024-02-15T22:51:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:16 smithi082 ceph-mon[84550]: reconnect by client.14530 v1:192.168.0.1:0/1910498570 after 0 2024-02-15T22:51:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:16 smithi082 ceph-mon[84550]: reconnect by client.14530 v1:192.168.0.1:0/1910498570 after 0 2024-02-15T22:51:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:16 smithi082 ceph-mon[84550]: reconnect by client.14536 v1:172.21.15.82:0/2392367035 after 0 2024-02-15T22:51:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:16 smithi082 ceph-mon[84550]: reconnect by client.14536 v1:172.21.15.82:0/2392367035 after 0 2024-02-15T22:51:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:16 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:reconnect 2024-02-15T22:51:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:16 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:reconnect 2024-02-15T22:51:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:16 smithi082 ceph-mon[84550]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:reconnect,1=cephfs.smithi033.xkdegf=up:reconnect} 2 up:standby 2024-02-15T22:51:17.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:16 smithi033 ceph-mon[113773]: reconnect by client.14530 v1:192.168.0.1:0/1910498570 after 0 2024-02-15T22:51:17.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:16 smithi033 ceph-mon[113773]: reconnect by client.14530 v1:192.168.0.1:0/1910498570 after 0 2024-02-15T22:51:17.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:16 smithi033 ceph-mon[113773]: reconnect by client.14536 v1:172.21.15.82:0/2392367035 after 0 2024-02-15T22:51:17.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:16 smithi033 ceph-mon[113773]: reconnect by client.14536 v1:172.21.15.82:0/2392367035 after 0 2024-02-15T22:51:17.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:16 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:reconnect 2024-02-15T22:51:17.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:16 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:reconnect 2024-02-15T22:51:17.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:16 smithi033 ceph-mon[113773]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:reconnect,1=cephfs.smithi033.xkdegf=up:reconnect} 2 up:standby 2024-02-15T22:51:17.288 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-15T22:51:17.608 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:51:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:17 smithi082 ceph-mon[84550]: pgmap v213: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T22:51:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:17 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:rejoin 2024-02-15T22:51:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:17 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:rejoin 2024-02-15T22:51:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:17 smithi082 ceph-mon[84550]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:rejoin,1=cephfs.smithi033.xkdegf=up:rejoin} 2 up:standby 2024-02-15T22:51:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:17 smithi082 ceph-mon[84550]: daemon mds.cephfs.smithi033.xkdegf is now active in filesystem cephfs as rank 1 2024-02-15T22:51:17.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:17 smithi082 ceph-mon[84550]: daemon mds.cephfs.smithi033.ruqork is now active in filesystem cephfs as rank 0 2024-02-15T22:51:17.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:17 smithi033 ceph-mon[113773]: pgmap v213: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T22:51:17.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:17 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:rejoin 2024-02-15T22:51:17.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:17 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:rejoin 2024-02-15T22:51:17.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:17 smithi033 ceph-mon[113773]: fsmap cephfs:2/2 {0=cephfs.smithi033.ruqork=up:rejoin,1=cephfs.smithi033.xkdegf=up:rejoin} 2 up:standby 2024-02-15T22:51:17.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:17 smithi033 ceph-mon[113773]: daemon mds.cephfs.smithi033.xkdegf is now active in filesystem cephfs as rank 1 2024-02-15T22:51:17.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:17 smithi033 ceph-mon[113773]: daemon mds.cephfs.smithi033.ruqork is now active in filesystem cephfs as rank 0 2024-02-15T22:51:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:18 smithi082 ceph-mon[84550]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T22:51:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:18 smithi082 ceph-mon[84550]: Cluster is now healthy 2024-02-15T22:51:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:18 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:active 2024-02-15T22:51:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:18 smithi082 ceph-mon[84550]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:active 2024-02-15T22:51:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:18 smithi082 ceph-mon[84550]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi033.xkdegf=up:active} 2 up:standby 2024-02-15T22:51:18.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:18 smithi082 ceph-mon[84550]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi033.xkdegf=up:active} 2 up:standby-replay 2024-02-15T22:51:18.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:18 smithi033 ceph-mon[113773]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T22:51:18.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:18 smithi033 ceph-mon[113773]: Cluster is now healthy 2024-02-15T22:51:18.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:18 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] up:active 2024-02-15T22:51:18.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:18 smithi033 ceph-mon[113773]: mds.? [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] up:active 2024-02-15T22:51:18.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:18 smithi033 ceph-mon[113773]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi033.xkdegf=up:active} 2 up:standby 2024-02-15T22:51:18.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:18 smithi033 ceph-mon[113773]: fsmap cephfs:2 {0=cephfs.smithi033.ruqork=up:active,1=cephfs.smithi033.xkdegf=up:active} 2 up:standby-replay 2024-02-15T22:51:19.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 -- 172.21.15.33:0/3768515834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 msgr2=0x7fc384103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:19.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 --2- 172.21.15.33:0/3768515834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384103320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc374009ce0 tx=0x7fc374004d10 comp rx=0 tx=0).stop 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 -- 172.21.15.33:0/3768515834 shutdown_connections 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 --2- 172.21.15.33:0/3768515834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3841038f0 0x7fc3840fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 --2- 172.21.15.33:0/3768515834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384103320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 -- 172.21.15.33:0/3768515834 >> 172.21.15.33:0/3768515834 conn(0x7fc3840f8ae0 msgr2=0x7fc3840faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 -- 172.21.15.33:0/3768515834 shutdown_connections 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.377+0000 7fc388d55700 1 -- 172.21.15.33:0/3768515834 wait complete. 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc388d55700 1 Processor -- start 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc388d55700 1 -- start start 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc388d55700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc388d55700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3841038f0 0x7fc384114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc388d55700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc384114680 con 0x7fc384102f50 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc388d55700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38410d9b0 con 0x7fc3841038f0 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc38259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc38259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52442/0 (socket says 172.21.15.33:52442) 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc38259c700 1 -- 172.21.15.33:0/3987811001 learned_addr learned my addr 172.21.15.33:0/3987811001 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc381d9b700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3841038f0 0x7fc384114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc38259c700 1 -- 172.21.15.33:0/3987811001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3841038f0 msgr2=0x7fc384114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc38259c700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3841038f0 0x7fc384114030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc38259c700 1 -- 172.21.15.33:0/3987811001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009940 con 0x7fc384102f50 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.378+0000 7fc38259c700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384113af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc37400ba50 tx=0x7fc374004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.379+0000 7fc37affd700 1 -- 172.21.15.33:0/3987811001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37400e040 con 0x7fc384102f50 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.379+0000 7fc37affd700 1 -- 172.21.15.33:0/3987811001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc374004610 con 0x7fc384102f50 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.379+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38410dc30 con 0x7fc384102f50 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.379+0000 7fc37affd700 1 -- 172.21.15.33:0/3987811001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc374012b10 con 0x7fc384102f50 2024-02-15T22:51:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.379+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38410e170 con 0x7fc384102f50 2024-02-15T22:51:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.380+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3840fc6e0 con 0x7fc384102f50 2024-02-15T22:51:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.380+0000 7fc37affd700 1 -- 172.21.15.33:0/3987811001 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc37401c830 con 0x7fc384102f50 2024-02-15T22:51:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.381+0000 7fc37affd700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc37006d7e0 0x7fc37006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.381+0000 7fc37affd700 1 -- 172.21.15.33:0/3987811001 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc37408f1b0 con 0x7fc384102f50 2024-02-15T22:51:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.381+0000 7fc381d9b700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc37006d7e0 0x7fc37006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.381+0000 7fc381d9b700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc37006d7e0 0x7fc37006fc90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc38410f320 tx=0x7fc36c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.385+0000 7fc37affd700 1 -- 172.21.15.33:0/3987811001 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc37405c5b0 con 0x7fc384102f50 2024-02-15T22:51:19.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.600+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc38410f0d0 con 0x7fc37006d7e0 2024-02-15T22:51:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.610+0000 7fc37affd700 1 -- 172.21.15.33:0/3987811001 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc38410f0d0 con 0x7fc37006d7e0 2024-02-15T22:51:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:51:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (7m) 49s ago 18m 26.3M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:51:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 49s ago 18m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:51:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (4m) 19s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:51:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (7m) 49s ago 18m 86.3M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:51:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (74s) 49s ago 12m 14.0M - 19.0.0-1450-gf78a58c0 f081f847070a 51df5be6ea1f 2024-02-15T22:51:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (54s) 49s ago 12m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a 487af1d647b0 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (38s) 19s ago 12m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a 6961c2e97286 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (22s) 19s ago 12m 13.9M - 19.0.0-1450-gf78a58c0 f081f847070a 13f617e33845 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (9m) 49s ago 19m 508M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (8m) 19s ago 17m 451M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 49s ago 20m 53.5M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (5m) 19s ago 17m 44.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (8m) 49s ago 18m 16.3M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (8m) 19s ago 17m 16.3M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 49s ago 16m 93.0M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 49s ago 16m 101M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (3m) 49s ago 15m 83.5M 1559M 19.0.0-1450-gf78a58c0 f081f847070a dfdcfe354b41 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (2m) 19s ago 15m 101M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 7778c235281a 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (2m) 19s ago 14m 91.1M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 66b57df413a7 2024-02-15T22:51:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (93s) 19s ago 14m 99.3M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 5aebe296615c 2024-02-15T22:51:19.615 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (7m) 49s ago 17m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:51:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc37006d7e0 msgr2=0x7fc37006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc37006d7e0 0x7fc37006fc90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc38410f320 tx=0x7fc36c00b040 comp rx=0 tx=0).stop 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 msgr2=0x7fc384113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384113af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc37400ba50 tx=0x7fc374004d10 comp rx=0 tx=0).stop 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 shutdown_connections 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc37006d7e0 0x7fc37006fc90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc384102f50 0x7fc384113af0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 --2- 172.21.15.33:0/3987811001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3841038f0 0x7fc384114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.612+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 >> 172.21.15.33:0/3987811001 conn(0x7fc3840f8ae0 msgr2=0x7fc3840fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.613+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 shutdown_connections 2024-02-15T22:51:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:19.613+0000 7fc388d55700 1 -- 172.21.15.33:0/3987811001 wait complete. 2024-02-15T22:51:19.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:19 smithi082 ceph-mon[84550]: pgmap v214: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 7 op/s 2024-02-15T22:51:19.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:19 smithi033 ceph-mon[113773]: pgmap v214: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 7 op/s 2024-02-15T22:51:20.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade status' 2024-02-15T22:51:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:51:20.842 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:20 smithi033 ceph-mon[113773]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:20.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:20 smithi082 ceph-mon[84550]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:21.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:21 smithi082 ceph-mon[84550]: pgmap v215: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 255 B/s wr, 9 op/s 2024-02-15T22:51:21.974 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:21 smithi033 ceph-mon[113773]: pgmap v215: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 255 B/s wr, 9 op/s 2024-02-15T22:51:23.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:23 smithi082 ceph-mon[84550]: pgmap v216: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29 MiB/s rd, 341 B/s wr, 15 op/s 2024-02-15T22:51:24.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:23 smithi033 ceph-mon[113773]: pgmap v216: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29 MiB/s rd, 341 B/s wr, 15 op/s 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.565+0000 7f4d2e986700 1 -- 172.21.15.33:0/522149573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28101e60 msgr2=0x7f4d28102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.565+0000 7f4d2e986700 1 --2- 172.21.15.33:0/522149573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28101e60 0x7f4d28102230 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4d18004940 tx=0x7f4d18009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.565+0000 7f4d2e986700 1 -- 172.21.15.33:0/522149573 shutdown_connections 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.565+0000 7f4d2e986700 1 --2- 172.21.15.33:0/522149573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d28102800 0x7f4d280fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.565+0000 7f4d2e986700 1 --2- 172.21.15.33:0/522149573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28101e60 0x7f4d28102230 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.565+0000 7f4d2e986700 1 -- 172.21.15.33:0/522149573 >> 172.21.15.33:0/522149573 conn(0x7f4d280f7a10 msgr2=0x7f4d280f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.566+0000 7f4d2e986700 1 -- 172.21.15.33:0/522149573 shutdown_connections 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.566+0000 7f4d2e986700 1 -- 172.21.15.33:0/522149573 wait complete. 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.566+0000 7f4d2e986700 1 Processor -- start 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.566+0000 7f4d2e986700 1 -- start start 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.566+0000 7f4d2e986700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d28101e60 0x7f4d28102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d2e986700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28102800 0x7f4d28103200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d2e986700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28103800 con 0x7f4d28102800 2024-02-15T22:51:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d2e986700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28103970 con 0x7f4d28101e60 2024-02-15T22:51:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28102800 0x7f4d28103200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d27fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d28101e60 0x7f4d28102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d27fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d28101e60 0x7f4d28102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:54692/0 (socket says 172.21.15.33:54692) 2024-02-15T22:51:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28102800 0x7f4d28103200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52466/0 (socket says 172.21.15.33:52466) 2024-02-15T22:51:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d27fff700 1 -- 172.21.15.33:0/1636789519 learned_addr learned my addr 172.21.15.33:0/1636789519 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:51:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d277fe700 1 -- 172.21.15.33:0/1636789519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d28101e60 msgr2=0x7f4d28102cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d277fe700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d28101e60 0x7f4d28102cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d277fe700 1 -- 172.21.15.33:0/1636789519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18005040 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d277fe700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28102800 0x7f4d28103200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c002840 tx=0x7f4d1c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d24ff9700 1 -- 172.21.15.33:0/1636789519 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1c007cc0 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d28119d10 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d24ff9700 1 -- 172.21.15.33:0/1636789519 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d1c00f040 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d24ff9700 1 -- 172.21.15.33:0/1636789519 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1c013a10 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.567+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2811a1f0 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.568+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d280fb610 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.569+0000 7f4d24ff9700 1 -- 172.21.15.33:0/1636789519 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4d1c01c400 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.569+0000 7f4d24ff9700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4d1006d7f0 0x7f4d1006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.570+0000 7f4d24ff9700 1 -- 172.21.15.33:0/1636789519 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4d1c08c4d0 con 0x7f4d28102800 2024-02-15T22:51:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.570+0000 7f4d27fff700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4d1006d7f0 0x7f4d1006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:24.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.570+0000 7f4d27fff700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4d1006d7f0 0x7f4d1006fca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:24.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.574+0000 7f4d24ff9700 1 -- 172.21.15.33:0/1636789519 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4d1c055d20 con 0x7f4d28102800 2024-02-15T22:51:24.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.797+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d28066660 con 0x7f4d1006d7f0 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.798+0000 7f4d24ff9700 1 -- 172.21.15.33:0/1636789519 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f4d28066660 con 0x7f4d1006d7f0 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": null, 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": false, 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "", 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": null, 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T22:51:24.800 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T22:51:24.801 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:51:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4d1006d7f0 msgr2=0x7f4d1006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:24.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4d1006d7f0 0x7f4d1006fca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:24.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28102800 msgr2=0x7f4d28103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:24.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28102800 0x7f4d28103200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c002840 tx=0x7f4d1c004570 comp rx=0 tx=0).stop 2024-02-15T22:51:24.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 shutdown_connections 2024-02-15T22:51:24.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f4d1006d7f0 0x7f4d1006fca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:24.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d28101e60 0x7f4d28102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:24.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 --2- 172.21.15.33:0/1636789519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d28102800 0x7f4d28103200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:24.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 >> 172.21.15.33:0/1636789519 conn(0x7f4d280f7a10 msgr2=0x7f4d28065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:24.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 shutdown_connections 2024-02-15T22:51:24.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:24.800+0000 7f4d2e986700 1 -- 172.21.15.33:0/1636789519 wait complete. 2024-02-15T22:51:25.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph health detail' 2024-02-15T22:51:25.697 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:51:25.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:25 smithi033 ceph-mon[113773]: pgmap v217: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 4.3 KiB/s wr, 15 op/s 2024-02-15T22:51:25.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:25 smithi033 ceph-mon[113773]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:25.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:25 smithi082 ceph-mon[84550]: pgmap v217: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 4.3 KiB/s wr, 15 op/s 2024-02-15T22:51:25.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:25 smithi082 ceph-mon[84550]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 -- 172.21.15.33:0/2986776241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa600fb6c0 msgr2=0x7faa600fbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 --2- 172.21.15.33:0/2986776241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa600fb6c0 0x7faa600fbb30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa54004940 tx=0x7faa54009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 -- 172.21.15.33:0/2986776241 shutdown_connections 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 --2- 172.21.15.33:0/2986776241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa600fb6c0 0x7faa600fbb30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 --2- 172.21.15.33:0/2986776241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa601016b0 0x7faa60101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 -- 172.21.15.33:0/2986776241 >> 172.21.15.33:0/2986776241 conn(0x7faa60071560 msgr2=0x7faa60071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 -- 172.21.15.33:0/2986776241 shutdown_connections 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.300+0000 7faa66276700 1 -- 172.21.15.33:0/2986776241 wait complete. 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa66276700 1 Processor -- start 2024-02-15T22:51:27.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa66276700 1 -- start start 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa66276700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa600fb6c0 0x7faa60111810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa66276700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa601016b0 0x7faa60111d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa66276700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa601123a0 con 0x7faa601016b0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa66276700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6010b6d0 con 0x7faa600fb6c0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa601016b0 0x7faa60111d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa601016b0 0x7faa60111d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49732/0 (socket says 172.21.15.33:49732) 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa5f7fe700 1 -- 172.21.15.33:0/1799615665 learned_addr learned my addr 172.21.15.33:0/1799615665 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa5ffff700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa600fb6c0 0x7faa60111810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa5f7fe700 1 -- 172.21.15.33:0/1799615665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa600fb6c0 msgr2=0x7faa60111810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa5f7fe700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa600fb6c0 0x7faa60111810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.301+0000 7faa5f7fe700 1 -- 172.21.15.33:0/1799615665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54005040 con 0x7faa601016b0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.302+0000 7faa5f7fe700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa601016b0 0x7faa60111d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa54009100 tx=0x7faa54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.302+0000 7faa5cff9700 1 -- 172.21.15.33:0/1799615665 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5400e040 con 0x7faa601016b0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.302+0000 7faa5cff9700 1 -- 172.21.15.33:0/1799615665 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa54004290 con 0x7faa601016b0 2024-02-15T22:51:27.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.302+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6010b950 con 0x7faa601016b0 2024-02-15T22:51:27.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.302+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6010be90 con 0x7faa601016b0 2024-02-15T22:51:27.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.302+0000 7faa5cff9700 1 -- 172.21.15.33:0/1799615665 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5401c630 con 0x7faa601016b0 2024-02-15T22:51:27.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.303+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c0052e0 con 0x7faa601016b0 2024-02-15T22:51:27.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.303+0000 7faa5cff9700 1 -- 172.21.15.33:0/1799615665 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7faa5400bbf0 con 0x7faa601016b0 2024-02-15T22:51:27.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.304+0000 7faa5cff9700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7faa4806e8e0 0x7faa48070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.304+0000 7faa5cff9700 1 -- 172.21.15.33:0/1799615665 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faa5408e1a0 con 0x7faa601016b0 2024-02-15T22:51:27.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.304+0000 7faa5ffff700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7faa4806e8e0 0x7faa48070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.304+0000 7faa5ffff700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7faa4806e8e0 0x7faa48070d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa50004c40 tx=0x7faa50009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:27.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.309+0000 7faa5cff9700 1 -- 172.21.15.33:0/1799615665 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faa5405b5a0 con 0x7faa601016b0 2024-02-15T22:51:27.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.595+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7faa4c005590 con 0x7faa601016b0 2024-02-15T22:51:27.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.595+0000 7faa5cff9700 1 -- 172.21.15.33:0/1799615665 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7faa5400bea0 con 0x7faa601016b0 2024-02-15T22:51:27.597 INFO:teuthology.orchestra.run.smithi033.stdout:HEALTH_OK 2024-02-15T22:51:27.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7faa4806e8e0 msgr2=0x7faa48070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7faa4806e8e0 0x7faa48070d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa50004c40 tx=0x7faa50009040 comp rx=0 tx=0).stop 2024-02-15T22:51:27.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa601016b0 msgr2=0x7faa60111d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa601016b0 0x7faa60111d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa54009100 tx=0x7faa54009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:27.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 shutdown_connections 2024-02-15T22:51:27.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7faa4806e8e0 0x7faa48070d90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa600fb6c0 0x7faa60111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 --2- 172.21.15.33:0/1799615665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa601016b0 0x7faa60111d50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 >> 172.21.15.33:0/1799615665 conn(0x7faa60071560 msgr2=0x7faa600fa640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:27.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 shutdown_connections 2024-02-15T22:51:27.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:27.597+0000 7faa66276700 1 -- 172.21.15.33:0/1799615665 wait complete. 2024-02-15T22:51:27.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:27 smithi082 ceph-mon[84550]: pgmap v218: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 8.3 KiB/s wr, 18 op/s 2024-02-15T22:51:27.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:27 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1799615665' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:51:27.904 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:27 smithi033 ceph-mon[113773]: pgmap v218: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 8.3 KiB/s wr, 18 op/s 2024-02-15T22:51:27.904 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:27 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1799615665' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:51:28.221 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-15T22:51:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:51:29.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:29.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:29 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:29.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:29 smithi033 ceph-mon[113773]: pgmap v219: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.3 KiB/s wr, 18 op/s 2024-02-15T22:51:29.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:51:29.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:29 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:29.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:29 smithi082 ceph-mon[84550]: pgmap v219: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.3 KiB/s wr, 18 op/s 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 -- 172.21.15.33:0/3380528846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 msgr2=0x7fedb4106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 --2- 172.21.15.33:0/3380528846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4106f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feda8004940 tx=0x7feda8009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 -- 172.21.15.33:0/3380528846 shutdown_connections 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 --2- 172.21.15.33:0/3380528846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4106f40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 --2- 172.21.15.33:0/3380528846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedb40fdf60 0x7fedb40fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 -- 172.21.15.33:0/3380528846 >> 172.21.15.33:0/3380528846 conn(0x7fedb40f7a10 msgr2=0x7fedb40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 -- 172.21.15.33:0/3380528846 shutdown_connections 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 -- 172.21.15.33:0/3380528846 wait complete. 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.089+0000 7fedb9a45700 1 Processor -- start 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb9a45700 1 -- start start 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb9a45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedb40fdf60 0x7fedb4113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb9a45700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb9a45700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb4114640 con 0x7fedb40fe900 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb9a45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb410d970 con 0x7fedb40fdf60 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49748/0 (socket says 172.21.15.33:49748) 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb27fc700 1 -- 172.21.15.33:0/1172950809 learned_addr learned my addr 172.21.15.33:0/1172950809 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb2ffd700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedb40fdf60 0x7fedb4113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb27fc700 1 -- 172.21.15.33:0/1172950809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedb40fdf60 msgr2=0x7fedb4113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb27fc700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedb40fdf60 0x7fedb4113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb27fc700 1 -- 172.21.15.33:0/1172950809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8005040 con 0x7fedb40fe900 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.090+0000 7fedb27fc700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4113ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feda8004890 tx=0x7feda8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.091+0000 7fed9b7fe700 1 -- 172.21.15.33:0/1172950809 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda800e040 con 0x7fedb40fe900 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.091+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb410dbf0 con 0x7fedb40fe900 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.091+0000 7fed9b7fe700 1 -- 172.21.15.33:0/1172950809 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feda8004290 con 0x7fedb40fe900 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.091+0000 7fed9b7fe700 1 -- 172.21.15.33:0/1172950809 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda801c630 con 0x7fedb40fe900 2024-02-15T22:51:30.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.091+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb410e130 con 0x7fedb40fe900 2024-02-15T22:51:30.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.092+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb4104550 con 0x7fedb40fe900 2024-02-15T22:51:30.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.092+0000 7fed9b7fe700 1 -- 172.21.15.33:0/1172950809 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7feda800bbf0 con 0x7fedb40fe900 2024-02-15T22:51:30.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.092+0000 7fed9b7fe700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fed9c06d7e0 0x7fed9c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:30.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.092+0000 7fed9b7fe700 1 -- 172.21.15.33:0/1172950809 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7feda808e260 con 0x7fedb40fe900 2024-02-15T22:51:30.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.092+0000 7fedb2ffd700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fed9c06d7e0 0x7fed9c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:30.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.093+0000 7fedb2ffd700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fed9c06d7e0 0x7fed9c06fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feda4009fd0 tx=0x7feda4009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:30.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.097+0000 7fed9b7fe700 1 -- 172.21.15.33:0/1172950809 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feda805b700 con 0x7fedb40fe900 2024-02-15T22:51:30.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.392+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fedb4109ff0 con 0x7fedb40fe900 2024-02-15T22:51:30.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.393+0000 7fed9b7fe700 1 -- 172.21.15.33:0/1172950809 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7feda805b290 con 0x7fedb40fe900 2024-02-15T22:51:30.395 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:51:30.395 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:51:30.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:51:30.397 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:51:30.397 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-15T22:51:30.397 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:51:30.397 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:51:30.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fed9c06d7e0 msgr2=0x7fed9c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fed9c06d7e0 0x7fed9c06fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feda4009fd0 tx=0x7feda4009f60 comp rx=0 tx=0).stop 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 msgr2=0x7fedb4113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4113ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feda8004890 tx=0x7feda8009e30 comp rx=0 tx=0).stop 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 shutdown_connections 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fed9c06d7e0 0x7fed9c06fc90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedb40fdf60 0x7fedb4113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 --2- 172.21.15.33:0/1172950809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedb40fe900 0x7fedb4113ff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.395+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 >> 172.21.15.33:0/1172950809 conn(0x7fedb40f7a10 msgr2=0x7fedb41016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.396+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 shutdown_connections 2024-02-15T22:51:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:51:30.396+0000 7fedb9a45700 1 -- 172.21.15.33:0/1172950809 wait complete. 2024-02-15T22:51:31.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-15T22:51:31.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:31 smithi033 ceph-mon[113773]: pgmap v220: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.2 KiB/s wr, 18 op/s 2024-02-15T22:51:31.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:31 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1172950809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:31.288 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:51:31.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:31 smithi082 ceph-mon[84550]: pgmap v220: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.2 KiB/s wr, 18 op/s 2024-02-15T22:51:31.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:31 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1172950809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:32.931 INFO:teuthology.orchestra.run.smithi033.stdout:wait for servicemap items w/ changing names to refresh 2024-02-15T22:51:33.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:33 smithi033 ceph-mon[113773]: pgmap v221: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-02-15T22:51:33.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:33 smithi082 ceph-mon[84550]: pgmap v221: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-02-15T22:51:33.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'sleep 60' 2024-02-15T22:51:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:51:35.265 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:35 smithi033 ceph-mon[113773]: pgmap v222: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 8.0 KiB/s wr, 7 op/s 2024-02-15T22:51:35.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:35 smithi082 ceph-mon[84550]: pgmap v222: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 8.0 KiB/s wr, 7 op/s 2024-02-15T22:51:37.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:37 smithi033 ceph-mon[113773]: pgmap v223: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-02-15T22:51:37.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:37 smithi082 ceph-mon[84550]: pgmap v223: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-02-15T22:51:39.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:39 smithi033 ceph-mon[113773]: pgmap v224: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 3 op/s 2024-02-15T22:51:39.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:39 smithi082 ceph-mon[84550]: pgmap v224: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 3 op/s 2024-02-15T22:51:41.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:41 smithi033 ceph-mon[113773]: pgmap v225: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 3 op/s 2024-02-15T22:51:41.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:41 smithi082 ceph-mon[84550]: pgmap v225: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 3 op/s 2024-02-15T22:51:43.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:43 smithi033 ceph-mon[113773]: pgmap v226: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:51:43.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:43.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:43 smithi082 ceph-mon[84550]: pgmap v226: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:51:43.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:45.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:45 smithi033 ceph-mon[113773]: pgmap v227: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:51:45.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:45 smithi082 ceph-mon[84550]: pgmap v227: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:51:47.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:47 smithi033 ceph-mon[113773]: pgmap v228: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:51:47.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:47 smithi082 ceph-mon[84550]: pgmap v228: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:51:49.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:49 smithi033 ceph-mon[113773]: pgmap v229: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:51:49.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:49 smithi082 ceph-mon[84550]: pgmap v229: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:51:51.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:51 smithi033 ceph-mon[113773]: pgmap v230: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:51:51.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:51 smithi082 ceph-mon[84550]: pgmap v230: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:51:53.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:53 smithi033 ceph-mon[113773]: pgmap v231: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:51:53.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:53 smithi082 ceph-mon[84550]: pgmap v231: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:51:55.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:55 smithi033 ceph-mon[113773]: pgmap v232: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:51:55.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:55 smithi082 ceph-mon[84550]: pgmap v232: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:51:57.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:57 smithi033 ceph-mon[113773]: pgmap v233: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:51:57.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:57 smithi082 ceph-mon[84550]: pgmap v233: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:51:58.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:58.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:59.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:51:59 smithi033 ceph-mon[113773]: pgmap v234: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:51:59.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:51:59 smithi082 ceph-mon[84550]: pgmap v234: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:01.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:01 smithi033 ceph-mon[113773]: pgmap v235: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:01.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:01 smithi082 ceph-mon[84550]: pgmap v235: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:03.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:03 smithi033 ceph-mon[113773]: pgmap v236: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:03.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:03 smithi082 ceph-mon[84550]: pgmap v236: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:05.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:05 smithi033 ceph-mon[113773]: pgmap v237: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:05.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:05 smithi082 ceph-mon[84550]: pgmap v237: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:07 smithi033 ceph-mon[113773]: pgmap v238: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:07.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:07 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:07.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:07 smithi082 ceph-mon[84550]: pgmap v238: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:07.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:07 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:08.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:08.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:52:08.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:08 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:52:08.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:08.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:52:08.625 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:08 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' 2024-02-15T22:52:10.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:09 smithi082 ceph-mon[84550]: pgmap v239: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:10.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:09 smithi033 ceph-mon[113773]: pgmap v239: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:12.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:11 smithi082 ceph-mon[84550]: pgmap v240: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:12.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:11 smithi033 ceph-mon[113773]: pgmap v240: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:13 smithi082 ceph-mon[84550]: pgmap v241: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:14.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:13 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:13 smithi033 ceph-mon[113773]: pgmap v241: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:14.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:13 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:16.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:15 smithi082 ceph-mon[84550]: pgmap v242: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:16.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:15 smithi033 ceph-mon[113773]: pgmap v242: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:18.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:17 smithi082 ceph-mon[84550]: pgmap v243: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:18.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:17 smithi033 ceph-mon[113773]: pgmap v243: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:20.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:19 smithi082 ceph-mon[84550]: pgmap v244: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:20.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:19 smithi033 ceph-mon[113773]: pgmap v244: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:22.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:21 smithi082 ceph-mon[84550]: pgmap v245: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:22.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:21 smithi033 ceph-mon[113773]: pgmap v245: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:24.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:23 smithi082 ceph-mon[84550]: pgmap v246: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:24.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:23 smithi033 ceph-mon[113773]: pgmap v246: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:26.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:25 smithi082 ceph-mon[84550]: pgmap v247: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:26.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:25 smithi033 ceph-mon[113773]: pgmap v247: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:28.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:27 smithi082 ceph-mon[84550]: pgmap v248: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:28.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:27 smithi033 ceph-mon[113773]: pgmap v248: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:29.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:28 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:29.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:28 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:30.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:29 smithi082 ceph-mon[84550]: pgmap v249: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:30.272 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:29 smithi033 ceph-mon[113773]: pgmap v249: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:32.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:31 smithi082 ceph-mon[84550]: pgmap v250: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:32.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:31 smithi033 ceph-mon[113773]: pgmap v250: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:34.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:33 smithi082 ceph-mon[84550]: pgmap v251: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:34.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:33 smithi033 ceph-mon[113773]: pgmap v251: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:36.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:35 smithi082 ceph-mon[84550]: pgmap v252: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:36.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:35 smithi033 ceph-mon[113773]: pgmap v252: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:36.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-15T22:52:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:52:37.924 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:37 smithi033 ceph-mon[113773]: pgmap v253: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:38.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:37 smithi082 ceph-mon[84550]: pgmap v253: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 -- 172.21.15.33:0/2575007799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a4102fe0 msgr2=0x7f47a41033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/2575007799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a4102fe0 0x7f47a41033b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4794004940 tx=0x7f4794009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 -- 172.21.15.33:0/2575007799 shutdown_connections 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/2575007799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a40fb560 0x7f47a40fb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/2575007799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a4102fe0 0x7f47a41033b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 -- 172.21.15.33:0/2575007799 >> 172.21.15.33:0/2575007799 conn(0x7f47a4071500 msgr2=0x7f47a4071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 -- 172.21.15.33:0/2575007799 shutdown_connections 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 -- 172.21.15.33:0/2575007799 wait complete. 2024-02-15T22:52:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 Processor -- start 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.260+0000 7f47a8ae5700 1 -- start start 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a8ae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a40fb560 0x7f47a4113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a8ae5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a4102fe0 0x7f47a4113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a8ae5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4114620 con 0x7f47a40fb560 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a8ae5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a410d950 con 0x7f47a4102fe0 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a40fb560 0x7f47a4113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a40fb560 0x7f47a4113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32948/0 (socket says 172.21.15.33:32948) 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a259c700 1 -- 172.21.15.33:0/3282285314 learned_addr learned my addr 172.21.15.33:0/3282285314 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a1d9b700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a4102fe0 0x7f47a4113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a259c700 1 -- 172.21.15.33:0/3282285314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a4102fe0 msgr2=0x7f47a4113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a259c700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a4102fe0 0x7f47a4113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a259c700 1 -- 172.21.15.33:0/3282285314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794005040 con 0x7f47a40fb560 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a1d9b700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a4102fe0 0x7f47a4113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a259c700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a40fb560 0x7f47a4113a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4794000c00 tx=0x7f4794009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f4792ffd700 1 -- 172.21.15.33:0/3282285314 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4794021070 con 0x7f47a40fb560 2024-02-15T22:52:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f4792ffd700 1 -- 172.21.15.33:0/3282285314 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4794013dd0 con 0x7f47a40fb560 2024-02-15T22:52:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f4792ffd700 1 -- 172.21.15.33:0/3282285314 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f479400e070 con 0x7f47a40fb560 2024-02-15T22:52:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.261+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a410dbd0 con 0x7f47a40fb560 2024-02-15T22:52:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.262+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a410e0b0 con 0x7f47a40fb560 2024-02-15T22:52:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.263+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a4100290 con 0x7f47a40fb560 2024-02-15T22:52:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.263+0000 7f4792ffd700 1 -- 172.21.15.33:0/3282285314 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f479401cbf0 con 0x7f47a40fb560 2024-02-15T22:52:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.263+0000 7f4792ffd700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f478c06d7e0 0x7f478c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.263+0000 7f4792ffd700 1 -- 172.21.15.33:0/3282285314 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f479408e310 con 0x7f47a40fb560 2024-02-15T22:52:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.263+0000 7f47a1d9b700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f478c06d7e0 0x7f478c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.264+0000 7f47a1d9b700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f478c06d7e0 0x7f478c06fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4798004600 tx=0x7f479800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:38.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.268+0000 7f4792ffd700 1 -- 172.21.15.33:0/3282285314 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f479405b7b0 con 0x7f47a40fb560 2024-02-15T22:52:38.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.482+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 --> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f47a404bed0 con 0x7f478c06d7e0 2024-02-15T22:52:38.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.492+0000 7f4792ffd700 1 -- 172.21.15.33:0/3282285314 <== mgr.34104 v2:172.21.15.33:6800/1318935367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f47a404bed0 con 0x7f478c06d7e0 2024-02-15T22:52:38.494 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:52:38.494 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (8m) 2m ago 19m 26.3M - 0.25.0 c8568f914cd2 114189cedfa0 2024-02-15T22:52:38.494 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (6m) 2m ago 20m 6656k - 19.0.0-1450-gf78a58c0 f081f847070a e26ed28556e3 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi082 smithi082 running (6m) 98s ago 18m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 6e187242248c 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (8m) 2m ago 19m 86.3M - 9.4.12 a0ea5e3c46d9 984110a586c0 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.ruqork smithi033 running (2m) 2m ago 14m 14.0M - 19.0.0-1450-gf78a58c0 f081f847070a 51df5be6ea1f 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.xkdegf smithi033 running (2m) 2m ago 14m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a 487af1d647b0 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.lvpzpf smithi082 running (117s) 98s ago 14m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a 6961c2e97286 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi082.rtwnpu smithi082 running (101s) 98s ago 14m 13.9M - 19.0.0-1450-gf78a58c0 f081f847070a 13f617e33845 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.swohxi smithi033 *:8443,9283,8765 running (10m) 2m ago 21m 508M - 19.0.0-1450-gf78a58c0 f081f847070a d4c6455ed0e5 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi082.mjhlse smithi082 *:8443,9283,8765 running (9m) 98s ago 18m 451M - 19.0.0-1450-gf78a58c0 f081f847070a f3eedc3835d3 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (7m) 2m ago 21m 53.5M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d82c29a70480 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi082 smithi082 running (6m) 98s ago 18m 44.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a be3087264975 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (9m) 2m ago 20m 16.3M - 1.5.0 0da6a335fe13 70ea6363b024 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi082 smithi082 *:9100 running (9m) 98s ago 18m 16.3M - 1.5.0 0da6a335fe13 9758b5fde59e 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 2m ago 17m 93.0M 1559M 19.0.0-1450-gf78a58c0 f081f847070a d58846c70ee1 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (5m) 2m ago 17m 101M 1559M 19.0.0-1450-gf78a58c0 f081f847070a ac3899b73336 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 2m ago 16m 83.5M 1559M 19.0.0-1450-gf78a58c0 f081f847070a dfdcfe354b41 2024-02-15T22:52:38.495 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi082 running (3m) 98s ago 16m 101M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 7778c235281a 2024-02-15T22:52:38.496 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (3m) 98s ago 16m 91.1M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 66b57df413a7 2024-02-15T22:52:38.496 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi082 running (2m) 98s ago 15m 99.3M 2581M 19.0.0-1450-gf78a58c0 f081f847070a 5aebe296615c 2024-02-15T22:52:38.496 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (9m) 2m ago 19m 60.2M - 2.43.0 a07b618ecd1d c537b420a8d8 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f478c06d7e0 msgr2=0x7f478c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f478c06d7e0 0x7f478c06fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4798004600 tx=0x7f479800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a40fb560 msgr2=0x7f47a4113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a40fb560 0x7f47a4113a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4794000c00 tx=0x7f4794009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 shutdown_connections 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f478c06d7e0 0x7f478c06fc90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47a40fb560 0x7f47a4113a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 --2- 172.21.15.33:0/3282285314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47a4102fe0 0x7f47a4113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 >> 172.21.15.33:0/3282285314 conn(0x7f47a4071500 msgr2=0x7f47a40fa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 shutdown_connections 2024-02-15T22:52:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:38.495+0000 7f47a8ae5700 1 -- 172.21.15.33:0/3282285314 wait complete. 2024-02-15T22:52:39.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-15T22:52:39.347 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:52:40.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:39 smithi033 ceph-mon[113773]: pgmap v254: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:40.022 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:39 smithi033 ceph-mon[113773]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:40.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:39 smithi082 ceph-mon[84550]: pgmap v254: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:40.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:39 smithi082 ceph-mon[84550]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.006+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2569823522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 msgr2=0x7f0d68106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.006+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2569823522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68106f80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0d64004940 tx=0x7f0d64009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.006+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2569823522 shutdown_connections 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.006+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2569823522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68106f80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.006+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2569823522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680fdfa0 0x7f0d680fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.006+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2569823522 >> 172.21.15.33:0/2569823522 conn(0x7f0d680f79d0 msgr2=0x7f0d680f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2569823522 shutdown_connections 2024-02-15T22:52:41.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2569823522 wait complete. 2024-02-15T22:52:41.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 Processor -- start 2024-02-15T22:52:41.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 -- start start 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680fdfa0 0x7f0d68113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d681145f0 con 0x7f0d680fe940 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.007+0000 7f0d6f26f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6810d920 con 0x7f0d680fdfa0 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6c80a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6c80a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32968/0 (socket says 172.21.15.33:32968) 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6c80a700 1 -- 172.21.15.33:0/2979024543 learned_addr learned my addr 172.21.15.33:0/2979024543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6c80a700 1 -- 172.21.15.33:0/2979024543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680fdfa0 msgr2=0x7f0d68113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6d00b700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680fdfa0 0x7f0d68113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:41.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6c80a700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680fdfa0 0x7f0d68113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6c80a700 1 -- 172.21.15.33:0/2979024543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64005040 con 0x7f0d680fe940 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6d00b700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680fdfa0 0x7f0d68113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6c80a700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68113fa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000c00 tx=0x7f0d64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d5dffb700 1 -- 172.21.15.33:0/2979024543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d64021070 con 0x7f0d680fe940 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d5dffb700 1 -- 172.21.15.33:0/2979024543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d64013d00 con 0x7f0d680fe940 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6810dba0 con 0x7f0d680fe940 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d5dffb700 1 -- 172.21.15.33:0/2979024543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d6400e070 con 0x7f0d680fe940 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.008+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6810e0e0 con 0x7f0d680fe940 2024-02-15T22:52:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.010+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d68104590 con 0x7f0d680fe940 2024-02-15T22:52:41.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.010+0000 7f0d5dffb700 1 -- 172.21.15.33:0/2979024543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0d6401cb60 con 0x7f0d680fe940 2024-02-15T22:52:41.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.010+0000 7f0d5dffb700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0d5406d7f0 0x7f0d5406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.011+0000 7f0d5dffb700 1 -- 172.21.15.33:0/2979024543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0d6408e4f0 con 0x7f0d680fe940 2024-02-15T22:52:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.011+0000 7f0d6d00b700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0d5406d7f0 0x7f0d5406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.011+0000 7f0d6d00b700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0d5406d7f0 0x7f0d5406fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d58004600 tx=0x7f0d5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.015+0000 7f0d5dffb700 1 -- 172.21.15.33:0/2979024543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0d6405b850 con 0x7f0d680fe940 2024-02-15T22:52:41.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.301+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d68109f60 con 0x7f0d680fe940 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.301+0000 7f0d5dffb700 1 -- 172.21.15.33:0/2979024543 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f0d6405b3e0 con 0x7f0d680fe940 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:52:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T22:52:41.305 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T22:52:41.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0d5406d7f0 msgr2=0x7f0d5406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:41.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0d5406d7f0 0x7f0d5406fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d58004600 tx=0x7f0d5800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:41.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 msgr2=0x7f0d68113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:41.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68113fa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000c00 tx=0x7f0d64009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:41.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 shutdown_connections 2024-02-15T22:52:41.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0d5406d7f0 0x7f0d5406fca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:41.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680fdfa0 0x7f0d68113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:41.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 --2- 172.21.15.33:0/2979024543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d680fe940 0x7f0d68113fa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:41.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 >> 172.21.15.33:0/2979024543 conn(0x7f0d680f79d0 msgr2=0x7f0d68101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:41.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 shutdown_connections 2024-02-15T22:52:41.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:41.304+0000 7f0d6f26f700 1 -- 172.21.15.33:0/2979024543 wait complete. 2024-02-15T22:52:41.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-15T22:52:42.200 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:52:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:41 smithi033 ceph-mon[113773]: pgmap v255: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:42.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:41 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2979024543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:41 smithi082 ceph-mon[84550]: pgmap v255: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:42.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:41 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2979024543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.892+0000 7fa109c7e700 1 -- 172.21.15.33:0/376253259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 msgr2=0x7fa104106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.892+0000 7fa109c7e700 1 --2- 172.21.15.33:0/376253259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104106f40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8004940 tx=0x7fa0f8009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 -- 172.21.15.33:0/376253259 shutdown_connections 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 --2- 172.21.15.33:0/376253259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104106f40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 --2- 172.21.15.33:0/376253259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040fdf60 0x7fa1040fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 -- 172.21.15.33:0/376253259 >> 172.21.15.33:0/376253259 conn(0x7fa1040f7a10 msgr2=0x7fa1040f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 -- 172.21.15.33:0/376253259 shutdown_connections 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 -- 172.21.15.33:0/376253259 wait complete. 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 Processor -- start 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.893+0000 7fa109c7e700 1 -- start start 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa109c7e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040fdf60 0x7fa104113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa109c7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa109c7e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041146c0 con 0x7fa1040fe900 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa109c7e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10410d9f0 con 0x7fa1040fdf60 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa102ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa102ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32990/0 (socket says 172.21.15.33:32990) 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa102ffd700 1 -- 172.21.15.33:0/3039015305 learned_addr learned my addr 172.21.15.33:0/3039015305 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa1037fe700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040fdf60 0x7fa104113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa102ffd700 1 -- 172.21.15.33:0/3039015305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040fdf60 msgr2=0x7fa104113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa102ffd700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040fdf60 0x7fa104113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa102ffd700 1 -- 172.21.15.33:0/3039015305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8005040 con 0x7fa1040fe900 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa1037fe700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040fdf60 0x7fa104113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa102ffd700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104114070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8004890 tx=0x7fa0f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa0ebfff700 1 -- 172.21.15.33:0/3039015305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0f800e040 con 0x7fa1040fe900 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa0ebfff700 1 -- 172.21.15.33:0/3039015305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0f8004290 con 0x7fa1040fe900 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.894+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10410dc70 con 0x7fa1040fe900 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.895+0000 7fa0ebfff700 1 -- 172.21.15.33:0/3039015305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0f801c630 con 0x7fa1040fe900 2024-02-15T22:52:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.895+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10410e1b0 con 0x7fa1040fe900 2024-02-15T22:52:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.896+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104104550 con 0x7fa1040fe900 2024-02-15T22:52:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.896+0000 7fa0ebfff700 1 -- 172.21.15.33:0/3039015305 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa0f800bbf0 con 0x7fa1040fe900 2024-02-15T22:52:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.896+0000 7fa0ebfff700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa0ec06d7e0 0x7fa0ec06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.896+0000 7fa0ebfff700 1 -- 172.21.15.33:0/3039015305 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa0f808e260 con 0x7fa1040fe900 2024-02-15T22:52:43.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.897+0000 7fa1037fe700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa0ec06d7e0 0x7fa0ec06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:43.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.897+0000 7fa1037fe700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa0ec06d7e0 0x7fa0ec06fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009fd0 tx=0x7fa0f4009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:43.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:43.901+0000 7fa0ebfff700 1 -- 172.21.15.33:0/3039015305 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa0f805b700 con 0x7fa1040fe900 2024-02-15T22:52:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:43 smithi033 ceph-mon[113773]: pgmap v256: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:44.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:43 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:44.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.189+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa104109ff0 con 0x7fa1040fe900 2024-02-15T22:52:44.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.190+0000 7fa0ebfff700 1 -- 172.21.15.33:0/3039015305 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa0f805b290 con 0x7fa1040fe900 2024-02-15T22:52:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa0ec06d7e0 msgr2=0x7fa0ec06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa0ec06d7e0 0x7fa0ec06fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009fd0 tx=0x7fa0f4009ee0 comp rx=0 tx=0).stop 2024-02-15T22:52:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 msgr2=0x7fa104114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104114070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8004890 tx=0x7fa0f8009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 shutdown_connections 2024-02-15T22:52:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa0ec06d7e0 0x7fa0ec06fc90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040fdf60 0x7fa104113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 --2- 172.21.15.33:0/3039015305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040fe900 0x7fa104114070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 >> 172.21.15.33:0/3039015305 conn(0x7fa1040f7a10 msgr2=0x7fa1041016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 shutdown_connections 2024-02-15T22:52:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:44.192+0000 7fa109c7e700 1 -- 172.21.15.33:0/3039015305 wait complete. 2024-02-15T22:52:44.204 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T22:52:44.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:43 smithi082 ceph-mon[84550]: pgmap v256: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:44.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:43 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:44.803 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-15T22:52:45.067 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:52:45.180 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:44 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3039015305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:45.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:44 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3039015305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:46.183 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:45 smithi033 ceph-mon[113773]: pgmap v257: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:46.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:45 smithi082 ceph-mon[84550]: pgmap v257: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.574+0000 7fcd03b86700 1 -- 172.21.15.33:0/2200411250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc101e60 msgr2=0x7fccfc102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.574+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2200411250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc101e60 0x7fccfc102230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fccec004940 tx=0x7fccec009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.574+0000 7fcd03b86700 1 -- 172.21.15.33:0/2200411250 shutdown_connections 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.574+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2200411250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccfc102800 0x7fccfc0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.574+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2200411250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc101e60 0x7fccfc102230 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.574+0000 7fcd03b86700 1 -- 172.21.15.33:0/2200411250 >> 172.21.15.33:0/2200411250 conn(0x7fccfc0f7a10 msgr2=0x7fccfc0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 -- 172.21.15.33:0/2200411250 shutdown_connections 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 -- 172.21.15.33:0/2200411250 wait complete. 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 Processor -- start 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 -- start start 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccfc101e60 0x7fccfc1129b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc102800 0x7fccfc112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc113540 con 0x7fccfc102800 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.575+0000 7fcd03b86700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc10c870 con 0x7fccfc101e60 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01121700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc102800 0x7fccfc112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01121700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc102800 0x7fccfc112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52632/0 (socket says 172.21.15.33:52632) 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01121700 1 -- 172.21.15.33:0/2088896928 learned_addr learned my addr 172.21.15.33:0/2088896928 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01922700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccfc101e60 0x7fccfc1129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01121700 1 -- 172.21.15.33:0/2088896928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccfc101e60 msgr2=0x7fccfc1129b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01121700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccfc101e60 0x7fccfc1129b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01121700 1 -- 172.21.15.33:0/2088896928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec005040 con 0x7fccfc102800 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01922700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccfc101e60 0x7fccfc1129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd01121700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc102800 0x7fccfc112ef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fccf8002a80 tx=0x7fccf8004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fccf27fc700 1 -- 172.21.15.33:0/2088896928 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccf8007cc0 con 0x7fccfc102800 2024-02-15T22:52:46.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc10cb50 con 0x7fccfc102800 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fccf27fc700 1 -- 172.21.15.33:0/2088896928 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccf800f040 con 0x7fccfc102800 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fccf27fc700 1 -- 172.21.15.33:0/2088896928 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccf800daf0 con 0x7fccfc102800 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.576+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc10d090 con 0x7fccfc102800 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.577+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc0ff170 con 0x7fccfc102800 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.578+0000 7fccf27fc700 1 -- 172.21.15.33:0/2088896928 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fccf800dc90 con 0x7fccfc102800 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.578+0000 7fccf27fc700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcce806d7f0 0x7fcce806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.578+0000 7fccf27fc700 1 -- 172.21.15.33:0/2088896928 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fccf808c5d0 con 0x7fccfc102800 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.578+0000 7fcd01922700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcce806d7f0 0x7fcce806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.579+0000 7fcd01922700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcce806d7f0 0x7fcce806fca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fccec009fd0 tx=0x7fccec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:46.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.583+0000 7fccf27fc700 1 -- 172.21.15.33:0/2088896928 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fccf8059950 con 0x7fccfc102800 2024-02-15T22:52:46.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.874+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fccfc108f80 con 0x7fccfc102800 2024-02-15T22:52:46.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.875+0000 7fccf27fc700 1 -- 172.21.15.33:0/2088896928 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fccf80594e0 con 0x7fccfc102800 2024-02-15T22:52:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.876+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcce806d7f0 msgr2=0x7fcce806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.876+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcce806d7f0 0x7fcce806fca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fccec009fd0 tx=0x7fccec009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc102800 msgr2=0x7fccfc112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc102800 0x7fccfc112ef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fccf8002a80 tx=0x7fccf8004630 comp rx=0 tx=0).stop 2024-02-15T22:52:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 shutdown_connections 2024-02-15T22:52:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcce806d7f0 0x7fcce806fca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccfc101e60 0x7fccfc1129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:46.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 --2- 172.21.15.33:0/2088896928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccfc102800 0x7fccfc112ef0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:46.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 >> 172.21.15.33:0/2088896928 conn(0x7fccfc0f7a10 msgr2=0x7fccfc0f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:46.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 shutdown_connections 2024-02-15T22:52:46.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:46.877+0000 7fcd03b86700 1 -- 172.21.15.33:0/2088896928 wait complete. 2024-02-15T22:52:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-15T22:52:47.183 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:46 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2088896928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:47.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:46 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2088896928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:47.496 DEBUG:teuthology.parallel:result is None 2024-02-15T22:52:47.497 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:52:47.508 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:52:47.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfc49586-cc51-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T22:52:47.772 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T22:52:48.215 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:47 smithi033 ceph-mon[113773]: pgmap v258: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:47 smithi082 ceph-mon[84550]: pgmap v258: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 -- 172.21.15.33:0/3578153082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec541027f0 msgr2=0x7fec540fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 --2- 172.21.15.33:0/3578153082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec541027f0 0x7fec540fbe60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec40004940 tx=0x7fec40009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 -- 172.21.15.33:0/3578153082 shutdown_connections 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 --2- 172.21.15.33:0/3578153082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec541027f0 0x7fec540fbe60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 --2- 172.21.15.33:0/3578153082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec54101e50 0x7fec54102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 -- 172.21.15.33:0/3578153082 >> 172.21.15.33:0/3578153082 conn(0x7fec540f79e0 msgr2=0x7fec540f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 -- 172.21.15.33:0/3578153082 shutdown_connections 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 -- 172.21.15.33:0/3578153082 wait complete. 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 Processor -- start 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.397+0000 7fec5b07e700 1 -- start start 2024-02-15T22:52:49.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec5b07e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec54101e50 0x7fec54113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec5b07e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec541027f0 0x7fec54113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec5b07e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec54114620 con 0x7fec54101e50 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec5b07e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5410d950 con 0x7fec541027f0 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec58e1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec54101e50 0x7fec54113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec58e1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec54101e50 0x7fec54113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52638/0 (socket says 172.21.15.33:52638) 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec58e1a700 1 -- 172.21.15.33:0/2883895674 learned_addr learned my addr 172.21.15.33:0/2883895674 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec53fff700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec541027f0 0x7fec54113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec58e1a700 1 -- 172.21.15.33:0/2883895674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec541027f0 msgr2=0x7fec54113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec58e1a700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec541027f0 0x7fec54113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec58e1a700 1 -- 172.21.15.33:0/2883895674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40005040 con 0x7fec54101e50 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.398+0000 7fec58e1a700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec54101e50 0x7fec54113a90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fec48002a50 tx=0x7fec480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.399+0000 7fec517fa700 1 -- 172.21.15.33:0/2883895674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec48007cc0 con 0x7fec54101e50 2024-02-15T22:52:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.399+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5410dc30 con 0x7fec54101e50 2024-02-15T22:52:49.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.399+0000 7fec517fa700 1 -- 172.21.15.33:0/2883895674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec4800f040 con 0x7fec54101e50 2024-02-15T22:52:49.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.399+0000 7fec517fa700 1 -- 172.21.15.33:0/2883895674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec4800da30 con 0x7fec54101e50 2024-02-15T22:52:49.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.399+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5410e140 con 0x7fec54101e50 2024-02-15T22:52:49.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.399+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec54064b00 con 0x7fec54101e50 2024-02-15T22:52:49.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.400+0000 7fec517fa700 1 -- 172.21.15.33:0/2883895674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fec4800db90 con 0x7fec54101e50 2024-02-15T22:52:49.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.400+0000 7fec517fa700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fec4406d7e0 0x7fec4406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:49.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.400+0000 7fec517fa700 1 -- 172.21.15.33:0/2883895674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fec4808cc70 con 0x7fec54101e50 2024-02-15T22:52:49.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.401+0000 7fec53fff700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fec4406d7e0 0x7fec4406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:49.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.401+0000 7fec53fff700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fec4406d7e0 0x7fec4406fc90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b3b0 tx=0x7fec40009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:49.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.405+0000 7fec517fa700 1 -- 172.21.15.33:0/2883895674 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fec48059ff0 con 0x7fec54101e50 2024-02-15T22:52:49.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.658+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fec5410f070 con 0x7fec54101e50 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.658+0000 7fec517fa700 1 -- 172.21.15.33:0/2883895674 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+1888 (secure 0 0 0) 0x7fec48059b80 con 0x7fec54101e50 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stdout:e42 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:52:49.661 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 42 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T22:38:21.981781+0000 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T22:51:17.581814+0000 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T22:52:49.662 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 81 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=34390,1=34422} 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T22:52:49.663 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.ruqork{0:34390} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.33:6826/1667938552,v1:172.21.15.33:6827/1667938552] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T22:52:49.664 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.lvpzpf{0:44323} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6824/90593148,v1:172.21.15.82:6825/90593148] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T22:52:49.664 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.xkdegf{1:34422} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.33:6828/3755702590,v1:172.21.15.33:6829/3755702590] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T22:52:49.664 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi082.rtwnpu{1:44327} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/4092453555,v1:172.21.15.82:6827/4092453555] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T22:52:49.664 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:49.664 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.660+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fec4406d7e0 msgr2=0x7fec4406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.660+0000 7fec5b07e700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fec4406d7e0 0x7fec4406fc90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b3b0 tx=0x7fec40009e30 comp rx=0 tx=0).stop 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.660+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec54101e50 msgr2=0x7fec54113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.660+0000 7fec5b07e700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec54101e50 0x7fec54113a90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fec48002a50 tx=0x7fec480046b0 comp rx=0 tx=0).stop 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.661+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 shutdown_connections 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.661+0000 7fec5b07e700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fec4406d7e0 0x7fec4406fc90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.661+0000 7fec5b07e700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec54101e50 0x7fec54113a90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.661+0000 7fec5b07e700 1 --2- 172.21.15.33:0/2883895674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec541027f0 0x7fec54113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.661+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 >> 172.21.15.33:0/2883895674 conn(0x7fec540f79e0 msgr2=0x7fec54066030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.661+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 shutdown_connections 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:49.661+0000 7fec5b07e700 1 -- 172.21.15.33:0/2883895674 wait complete. 2024-02-15T22:52:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 42 2024-02-15T22:52:50.010 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:49 smithi033 ceph-mon[113773]: pgmap v259: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:50.010 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:49 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2883895674' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:52:50.361 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-15T22:52:50.372 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:52:50.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:49 smithi082 ceph-mon[84550]: pgmap v259: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:52:50.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:49 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2883895674' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:52:50.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 -- 172.21.15.33:0/4143268642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 msgr2=0x7f6d8c101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 --2- 172.21.15.33:0/4143268642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c101590 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d880048d0 tx=0x7f6d88009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 -- 172.21.15.33:0/4143268642 shutdown_connections 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 --2- 172.21.15.33:0/4143268642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c101b60 0x7f6d8c0fb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 --2- 172.21.15.33:0/4143268642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c101590 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 -- 172.21.15.33:0/4143268642 >> 172.21.15.33:0/4143268642 conn(0x7f6d8c0f6db0 msgr2=0x7f6d8c0f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 -- 172.21.15.33:0/4143268642 shutdown_connections 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 -- 172.21.15.33:0/4143268642 wait complete. 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.473+0000 7f6d9479d640 1 Processor -- start 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d9479d640 1 -- start start 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d9479d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c10dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d9479d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c101b60 0x7f6d8c10e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d9479d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c10e6c0 con 0x7f6d8c1011c0 2024-02-15T22:52:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d9479d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c10e830 con 0x7f6d8c101b60 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d92539640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c10dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d92539640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c10dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52656/0 (socket says 172.21.15.33:52656) 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d92539640 1 -- 172.21.15.33:0/3716293822 learned_addr learned my addr 172.21.15.33:0/3716293822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d91d38640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c101b60 0x7f6d8c10e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d92539640 1 -- 172.21.15.33:0/3716293822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c101b60 msgr2=0x7f6d8c10e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d92539640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c101b60 0x7f6d8c10e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d92539640 1 -- 172.21.15.33:0/3716293822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88005040 con 0x7f6d8c1011c0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d92539640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c10dc40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6d8802bda0 tx=0x7f6d88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d82ffd640 1 -- 172.21.15.33:0/3716293822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d880092b0 con 0x7f6d8c1011c0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c10eab0 con 0x7f6d8c1011c0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d82ffd640 1 -- 172.21.15.33:0/3716293822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d8803b400 con 0x7f6d8c1011c0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d82ffd640 1 -- 172.21.15.33:0/3716293822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d880435d0 con 0x7f6d8c1011c0 2024-02-15T22:52:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.474+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c116f60 con 0x7f6d8c1011c0 2024-02-15T22:52:50.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.475+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c064480 con 0x7f6d8c1011c0 2024-02-15T22:52:50.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.476+0000 7f6d82ffd640 1 -- 172.21.15.33:0/3716293822 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6d8802f070 con 0x7f6d8c1011c0 2024-02-15T22:52:50.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.476+0000 7f6d82ffd640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6d7806d760 0x7f6d7806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:50.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.476+0000 7f6d91d38640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6d7806d760 0x7f6d7806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:50.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.476+0000 7f6d82ffd640 1 -- 172.21.15.33:0/3716293822 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6d880aec40 con 0x7f6d8c1011c0 2024-02-15T22:52:50.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.477+0000 7f6d91d38640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6d7806d760 0x7f6d7806fc10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c065fc0 tx=0x7f6d7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:50.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.481+0000 7f6d82ffd640 1 -- 172.21.15.33:0/3716293822 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6d880783f0 con 0x7f6d8c1011c0 2024-02-15T22:52:50.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.662+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d8c10eab0 con 0x7f6d8c1011c0 2024-02-15T22:52:50.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.663+0000 7f6d82ffd640 1 -- 172.21.15.33:0/3716293822 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16497 (secure 0 0 0) 0x7f6d8c10eab0 con 0x7f6d8c1011c0 2024-02-15T22:52:50.666 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:50.666 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","created":"2024-02-15T22:31:07.591719+0000","modified":"2024-02-15T22:50:53.437585+0000","last_up_change":"2024-02-15T22:49:53.791562+0000","last_in_change":"2024-02-15T22:36:43.765254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:35:50.180713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:38:20.412479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:38:21.217027+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"630ee5c8-c8e3-4190-878c-82aa86eb7366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6803","nonce":1308222848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6805","nonce":1308222848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6809","nonce":1308222848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6807","nonce":1308222848}]},"public_addr":"172.21.15.33:6803/1308222848","cluster_addr":"172.21.15.33:6805/1308222848","heartbeat_back_addr":"172.21.15.33:6809/1308222848","heartbeat_front_addr":"172.21.15.33:6807/1308222848","state":["exists","up"]},{"osd":1,"uuid":"9edc1e24-0b17-4e9a-ac42-18decf1d9c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6811","nonce":2896162508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6813","nonce":2896162508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6817","nonce":2896162508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6815","nonce":2896162508}]},"public_addr":"172.21.15.33:6811/2896162508","cluster_addr":"172.21.15.33:6813/2896162508","heartbeat_back_addr":"172.21.15.33:6817/2896162508","heartbeat_front_addr":"172.21.15.33:6815/2896162508","state":["exists","up"]},{"osd":2,"uuid":"eaa0a666-819e-4268-a788-e2ab2b12dd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6819","nonce":4236771433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6821","nonce":4236771433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6825","nonce":4236771433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6823","nonce":4236771433}]},"public_addr":"172.21.15.33:6819/4236771433","cluster_addr":"172.21.15.33:6821/4236771433","heartbeat_back_addr":"172.21.15.33:6825/4236771433","heartbeat_front_addr":"172.21.15.33:6823/4236771433","state":["exists","up"]},{"osd":3,"uuid":"111d4225-5978-43c6-8276-87091559a25b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6801","nonce":1385907804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6803","nonce":1385907804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6807","nonce":1385907804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6805","nonce":1385907804}]},"public_addr":"172.21.15.82:6801/1385907804","cluster_addr":"172.21.15.82:6803/1385907804","heartbeat_back_addr":"172.21.15.82:6807/1385907804","heartbeat_front_addr":"172.21.15.82:6805/1385907804","state":["exists","up"]},{"osd":4,"uuid":"6625f0e7-013e-4fab-897d-06ed130d9878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6809","nonce":1062301027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6811","nonce":1062301027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6815","nonce":1062301027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6813","nonce":1062301027}]},"public_addr":"172.21.15.82:6809/1062301027","cluster_addr":"172.21.15.82:6811/1062301027","heartbeat_back_addr":"172.21.15.82:6815/1062301027","heartbeat_front_addr":"172.21.15.82:6813/1062301027","state":["exists","up"]},{"osd":5,"uuid":"6b74c887-f24b-4da2-85fd-5d351fe44045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6817","nonce":1167817460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6819","nonce":1167817460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6823","nonce":1167817460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6821","nonce":1167817460}]},"public_addr":"172.21.15.82:6817/1167817460","cluster_addr":"172.21.15.82:6819/1167817460","heartbeat_back_addr":"172.21.15.82:6823/1167817460","heartbeat_front_addr":"172.21.15.82:6821/1167817460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:34:48.066478+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:16.174578+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:46.001693+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:09.278760+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:34.947739+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:37:01.519872+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6825/998691031":"2024-02-16T22:49:55.970822+0000","172.21.15.82:0/3806231562":"2024-02-16T22:42:30.895464+0000","172.21.15.33:0/4132586080":"2024-02-16T22:40:40.259719+0000","172.21.15.82:0/1010955817":"2024-02-16T22:42:30.895464+0000","172.21.15.33:0/3237183308":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/3583368704":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/547235877":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/1195013908":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6800/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/3460051332":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6827/3373069689":"2024-02-16T22:49:55.970807+0000","172.21.15.33:0/4080754497":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/2241336882":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6800/1523928063":"2024-02-16T22:40:40.259719+0000","172.21.15.33:6801/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.82:6829/144917264":"2024-02-16T22:42:30.895464+0000","172.21.15.82:6824/998691031":"2024-02-16T22:49:55.970822+0000","172.21.15.33:6801/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/735416243":"2024-02-16T22:31:43.072803+0000","172.21.15.82:6828/144917264":"2024-02-16T22:42:30.895464+0000","172.21.15.33:6800/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/771735499":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/275440289":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6800/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/3612339404":"2024-02-16T22:40:40.259719+0000","172.21.15.82:0/1539304932":"2024-02-16T22:42:30.895464+0000","172.21.15.82:0/1026628738":"2024-02-16T22:42:30.895464+0000","172.21.15.33:6801/1523928063":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/245484360":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6800/1221640653":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6801/1221640653":"2024-02-16T22:45:28.041723+0000","172.21.15.33:0/1408628693":"2024-02-16T22:45:28.041723+0000","172.21.15.33:0/4049300209":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6801/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/3396978947":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/1038575526":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6826/3373069689":"2024-02-16T22:49:55.970807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6d7806d760 msgr2=0x7f6d7806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6d7806d760 0x7f6d7806fc10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c065fc0 tx=0x7f6d7c00b040 comp rx=0 tx=0).stop 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 msgr2=0x7f6d8c10dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c10dc40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6d8802bda0 tx=0x7f6d88009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 shutdown_connections 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c101b60 0x7f6d8c10e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6d7806d760 0x7f6d7806fc10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 --2- 172.21.15.33:0/3716293822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d8c1011c0 0x7f6d8c10dc40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 >> 172.21.15.33:0/3716293822 conn(0x7f6d8c0f6db0 msgr2=0x7f6d8c0f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:50.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 shutdown_connections 2024-02-15T22:52:50.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.665+0000 7f6d9479d640 1 -- 172.21.15.33:0/3716293822 wait complete. 2024-02-15T22:52:50.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:35:50.180713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:38:20.412479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:38:21.217027+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T22:52:50.679 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.777+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2270133643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 msgr2=0x7fd8a8101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2270133643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a8101640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0048d0 tx=0x7fd89c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2270133643 shutdown_connections 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2270133643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a8101c10 0x7fd8a80fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2270133643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a8101640 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2270133643 >> 172.21.15.33:0/2270133643 conn(0x7fd8a80f6de0 msgr2=0x7fd8a80f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2270133643 shutdown_connections 2024-02-15T22:52:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2270133643 wait complete. 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 Processor -- start 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.778+0000 7fd8aee2e640 1 -- start start 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8aee2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a81025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8aee2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a8101c10 0x7fd8a8102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8aee2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8104540 con 0x7fd8a8101270 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8aee2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8103020 con 0x7fd8a8101c10 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8acbca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a81025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8acbca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a81025a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52676/0 (socket says 172.21.15.33:52676) 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8acbca640 1 -- 172.21.15.33:0/2504663930 learned_addr learned my addr 172.21.15.33:0/2504663930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8a7fff640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a8101c10 0x7fd8a8102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8acbca640 1 -- 172.21.15.33:0/2504663930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a8101c10 msgr2=0x7fd8a8102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8acbca640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a8101c10 0x7fd8a8102ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8acbca640 1 -- 172.21.15.33:0/2504663930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c005040 con 0x7fd8a8101270 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8a7fff640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a8101c10 0x7fd8a8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8acbca640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a81025a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd89c031720 tx=0x7fd89c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8a57fa640 1 -- 172.21.15.33:0/2504663930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd89c0094c0 con 0x7fd8a8101270 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8a57fa640 1 -- 172.21.15.33:0/2504663930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd89c009620 con 0x7fd8a8101270 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a8103270 con 0x7fd8a8101270 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8a57fa640 1 -- 172.21.15.33:0/2504663930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd89c03b640 con 0x7fd8a8101270 2024-02-15T22:52:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.779+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a8119290 con 0x7fd8a8101270 2024-02-15T22:52:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.780+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a8064480 con 0x7fd8a8101270 2024-02-15T22:52:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.781+0000 7fd8a57fa640 1 -- 172.21.15.33:0/2504663930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd89c02f070 con 0x7fd8a8101270 2024-02-15T22:52:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.781+0000 7fd8a57fa640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd89806d750 0x7fd89806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.781+0000 7fd8a57fa640 1 -- 172.21.15.33:0/2504663930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd89c0af4d0 con 0x7fd8a8101270 2024-02-15T22:52:50.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.781+0000 7fd8a7fff640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd89806d750 0x7fd89806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:50.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.782+0000 7fd8a7fff640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd89806d750 0x7fd89806fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8103d90 tx=0x7fd894009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:50.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.786+0000 7fd8a57fa640 1 -- 172.21.15.33:0/2504663930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd89c078d20 con 0x7fd8a8101270 2024-02-15T22:52:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.968+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8a8103b80 con 0x7fd8a8101270 2024-02-15T22:52:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.968+0000 7fd8a57fa640 1 -- 172.21.15.33:0/2504663930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd89c07c3e0 con 0x7fd8a8101270 2024-02-15T22:52:50.970 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T22:52:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd89806d750 msgr2=0x7fd89806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd89806d750 0x7fd89806fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8103d90 tx=0x7fd894009040 comp rx=0 tx=0).stop 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 msgr2=0x7fd8a81025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a81025a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd89c031720 tx=0x7fd89c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 shutdown_connections 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a8101c10 0x7fd8a8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd89806d750 0x7fd89806fc00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 --2- 172.21.15.33:0/2504663930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a8101270 0x7fd8a81025a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 >> 172.21.15.33:0/2504663930 conn(0x7fd8a80f6de0 msgr2=0x7fd8a81046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 shutdown_connections 2024-02-15T22:52:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:50.970+0000 7fd8aee2e640 1 -- 172.21.15.33:0/2504663930 wait complete. 2024-02-15T22:52:50.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:50 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3716293822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:52:50.983 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T22:52:51.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 -- 172.21.15.33:0/847615650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 msgr2=0x7f924c0fd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 --2- 172.21.15.33:0/847615650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fd730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9248004900 tx=0x7f9248009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 -- 172.21.15.33:0/847615650 shutdown_connections 2024-02-15T22:52:51.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 --2- 172.21.15.33:0/847615650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f924c0fdd00 0x7f924c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 --2- 172.21.15.33:0/847615650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fd730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 -- 172.21.15.33:0/847615650 >> 172.21.15.33:0/847615650 conn(0x7f924c0f6e40 msgr2=0x7f924c0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 -- 172.21.15.33:0/847615650 shutdown_connections 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 -- 172.21.15.33:0/847615650 wait complete. 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.082+0000 7f925375d640 1 Processor -- start 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f925375d640 1 -- start start 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f925375d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f925375d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f924c0fdd00 0x7f924c0fb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f925375d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0fd1c0 con 0x7f924c0fd360 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f925375d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0fbca0 con 0x7f924c0fdd00 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f92514f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f92514f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52690/0 (socket says 172.21.15.33:52690) 2024-02-15T22:52:51.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f92514f9640 1 -- 172.21.15.33:0/3730883482 learned_addr learned my addr 172.21.15.33:0/3730883482 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f9250cf8640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f924c0fdd00 0x7f924c0fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f92514f9640 1 -- 172.21.15.33:0/3730883482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f924c0fdd00 msgr2=0x7f924c0fb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f92514f9640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f924c0fdd00 0x7f924c0fb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f92514f9640 1 -- 172.21.15.33:0/3730883482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248005040 con 0x7f924c0fd360 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f9250cf8640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f924c0fdd00 0x7f924c0fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f92514f9640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fb220 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9248000c00 tx=0x7f9248009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f9241ffb640 1 -- 172.21.15.33:0/3730883482 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92480094c0 con 0x7f924c0fd360 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f9241ffb640 1 -- 172.21.15.33:0/3730883482 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f924803d920 con 0x7f924c0fd360 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c0fbef0 con 0x7f924c0fd360 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.083+0000 7f9241ffb640 1 -- 172.21.15.33:0/3730883482 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f924803b8b0 con 0x7f924c0fd360 2024-02-15T22:52:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.084+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c119380 con 0x7f924c0fd360 2024-02-15T22:52:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.085+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c064480 con 0x7f924c0fd360 2024-02-15T22:52:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.085+0000 7f9241ffb640 1 -- 172.21.15.33:0/3730883482 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f924803da90 con 0x7f924c0fd360 2024-02-15T22:52:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.085+0000 7f9241ffb640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f923806d820 0x7f923806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.086+0000 7f9241ffb640 1 -- 172.21.15.33:0/3730883482 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f92480afc40 con 0x7f924c0fd360 2024-02-15T22:52:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.086+0000 7f9250cf8640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f923806d820 0x7f923806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.086+0000 7f9250cf8640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f923806d820 0x7f923806fcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f924c0fca10 tx=0x7f923c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:51.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.090+0000 7f9241ffb640 1 -- 172.21.15.33:0/3730883482 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9248079470 con 0x7f924c0fd360 2024-02-15T22:52:51.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.272+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f924c1094f0 con 0x7f924c0fd360 2024-02-15T22:52:51.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.273+0000 7f9241ffb640 1 -- 172.21.15.33:0/3730883482 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f924c1094f0 con 0x7f924c0fd360 2024-02-15T22:52:51.275 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:52:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f923806d820 msgr2=0x7f923806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f923806d820 0x7f923806fcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f924c0fca10 tx=0x7f923c00b040 comp rx=0 tx=0).stop 2024-02-15T22:52:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 msgr2=0x7f924c0fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fb220 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9248000c00 tx=0x7f9248009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 shutdown_connections 2024-02-15T22:52:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f924c0fdd00 0x7f924c0fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f923806d820 0x7f923806fcd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 --2- 172.21.15.33:0/3730883482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f924c0fd360 0x7f924c0fb220 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 >> 172.21.15.33:0/3730883482 conn(0x7f924c0f6e40 msgr2=0x7f924c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 shutdown_connections 2024-02-15T22:52:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.275+0000 7f925375d640 1 -- 172.21.15.33:0/3730883482 wait complete. 2024-02-15T22:52:51.288 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T22:52:51.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:50 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3716293822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:52:51.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 -- 172.21.15.33:0/3932192633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0700f0 msgr2=0x7fd82c1086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 --2- 172.21.15.33:0/3932192633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0700f0 0x7fd82c1086f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd8180048d0 tx=0x7fd818009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 -- 172.21.15.33:0/3932192633 shutdown_connections 2024-02-15T22:52:51.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 --2- 172.21.15.33:0/3932192633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0700f0 0x7fd82c1086f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 --2- 172.21.15.33:0/3932192633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd82c06f7e0 0x7fd82c06fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 -- 172.21.15.33:0/3932192633 >> 172.21.15.33:0/3932192633 conn(0x7fd82c0f7ef0 msgr2=0x7fd82c0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:51.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 -- 172.21.15.33:0/3932192633 shutdown_connections 2024-02-15T22:52:51.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 -- 172.21.15.33:0/3932192633 wait complete. 2024-02-15T22:52:51.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 Processor -- start 2024-02-15T22:52:51.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.387+0000 7fd83322e640 1 -- start start 2024-02-15T22:52:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd83322e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c06f7e0 0x7fd82c114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd83322e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd82c0700f0 0x7fd82c115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd83322e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c115940 con 0x7fd82c06f7e0 2024-02-15T22:52:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd83322e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c10eed0 con 0x7fd82c0700f0 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd830fca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c06f7e0 0x7fd82c114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd830fca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c06f7e0 0x7fd82c114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52716/0 (socket says 172.21.15.33:52716) 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd830fca640 1 -- 172.21.15.33:0/695005560 learned_addr learned my addr 172.21.15.33:0/695005560 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd82bfff640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd82c0700f0 0x7fd82c115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd830fca640 1 -- 172.21.15.33:0/695005560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd82c0700f0 msgr2=0x7fd82c115340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd830fca640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd82c0700f0 0x7fd82c115340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd830fca640 1 -- 172.21.15.33:0/695005560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818005040 con 0x7fd82c06f7e0 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd82bfff640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd82c0700f0 0x7fd82c115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd830fca640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c06f7e0 0x7fd82c114e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c810 tx=0x7fd8200043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd8297fa640 1 -- 172.21.15.33:0/695005560 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd82000a820 con 0x7fd82c06f7e0 2024-02-15T22:52:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd8297fa640 1 -- 172.21.15.33:0/695005560 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd82000ae50 con 0x7fd82c06f7e0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c10f1b0 con 0x7fd82c06f7e0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.388+0000 7fd8297fa640 1 -- 172.21.15.33:0/695005560 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8200115c0 con 0x7fd82c06f7e0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.389+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c10f6d0 con 0x7fd82c06f7e0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.389+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c064480 con 0x7fd82c06f7e0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.390+0000 7fd8297fa640 1 -- 172.21.15.33:0/695005560 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd82000a980 con 0x7fd82c06f7e0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.390+0000 7fd8297fa640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd81c06d750 0x7fd81c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.390+0000 7fd8297fa640 1 -- 172.21.15.33:0/695005560 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd82008d450 con 0x7fd82c06f7e0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.390+0000 7fd82bfff640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd81c06d750 0x7fd81c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.391+0000 7fd82bfff640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd81c06d750 0x7fd81c06fc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd81802bda0 tx=0x7fd818009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:51.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.395+0000 7fd8297fa640 1 -- 172.21.15.33:0/695005560 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd820056ca0 con 0x7fd82c06f7e0 2024-02-15T22:52:51.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.574+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd82c110400 con 0x7fd82c06f7e0 2024-02-15T22:52:51.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.574+0000 7fd8297fa640 1 -- 172.21.15.33:0/695005560 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd82005a360 con 0x7fd82c06f7e0 2024-02-15T22:52:51.577 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:52:51.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd81c06d750 msgr2=0x7fd81c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd81c06d750 0x7fd81c06fc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd81802bda0 tx=0x7fd818009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c06f7e0 msgr2=0x7fd82c114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c06f7e0 0x7fd82c114e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c810 tx=0x7fd8200043c0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 shutdown_connections 2024-02-15T22:52:51.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd82c0700f0 0x7fd82c115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd81c06d750 0x7fd81c06fc00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 --2- 172.21.15.33:0/695005560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c06f7e0 0x7fd82c114e00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 >> 172.21.15.33:0/695005560 conn(0x7fd82c0f7ef0 msgr2=0x7fd82c102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:51.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 shutdown_connections 2024-02-15T22:52:51.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.576+0000 7fd83322e640 1 -- 172.21.15.33:0/695005560 wait complete. 2024-02-15T22:52:51.589 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T22:52:51.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 -- 172.21.15.33:0/3054329275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 msgr2=0x7f66500fbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 --2- 172.21.15.33:0/3054329275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66500fbac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66440048d0 tx=0x7f6644009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 -- 172.21.15.33:0/3054329275 shutdown_connections 2024-02-15T22:52:51.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 --2- 172.21.15.33:0/3054329275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66500fbac0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 --2- 172.21.15.33:0/3054329275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6650101220 0x7f66501015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 -- 172.21.15.33:0/3054329275 >> 172.21.15.33:0/3054329275 conn(0x7f6650070a10 msgr2=0x7f6650070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 -- 172.21.15.33:0/3054329275 shutdown_connections 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.685+0000 7f6657f5d640 1 -- 172.21.15.33:0/3054329275 wait complete. 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f6657f5d640 1 Processor -- start 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f6657f5d640 1 -- start start 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f6657f5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6650101220 0x7f6650114d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f6657f5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66501152a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f6657f5d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66501158a0 con 0x7f6650101b30 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f6657f5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665010ee30 con 0x7f6650101220 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f66554f8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66501152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f66554f8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66501152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52740/0 (socket says 172.21.15.33:52740) 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f66554f8640 1 -- 172.21.15.33:0/1419897547 learned_addr learned my addr 172.21.15.33:0/1419897547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f6655cf9640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6650101220 0x7f6650114d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f66554f8640 1 -- 172.21.15.33:0/1419897547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6650101220 msgr2=0x7f6650114d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f66554f8640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6650101220 0x7f6650114d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.686+0000 7f66554f8640 1 -- 172.21.15.33:0/1419897547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644005040 con 0x7f6650101b30 2024-02-15T22:52:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.687+0000 7f66554f8640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66501152a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6644000c00 tx=0x7f6644009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.687+0000 7f664e7fc640 1 -- 172.21.15.33:0/1419897547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66440092e0 con 0x7f6650101b30 2024-02-15T22:52:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.687+0000 7f664e7fc640 1 -- 172.21.15.33:0/1419897547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6644009440 con 0x7f6650101b30 2024-02-15T22:52:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.687+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665010f0b0 con 0x7f6650101b30 2024-02-15T22:52:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.687+0000 7f664e7fc640 1 -- 172.21.15.33:0/1419897547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6644043640 con 0x7f6650101b30 2024-02-15T22:52:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.687+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665010f5d0 con 0x7f6650101b30 2024-02-15T22:52:51.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.688+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6650064480 con 0x7f6650101b30 2024-02-15T22:52:51.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.688+0000 7f664e7fc640 1 -- 172.21.15.33:0/1419897547 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f664403b420 con 0x7f6650101b30 2024-02-15T22:52:51.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.689+0000 7f664e7fc640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f663806d750 0x7f663806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:51.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.689+0000 7f664e7fc640 1 -- 172.21.15.33:0/1419897547 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f66440afcd0 con 0x7f6650101b30 2024-02-15T22:52:51.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.689+0000 7f6655cf9640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f663806d750 0x7f663806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:51.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.689+0000 7f6655cf9640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f663806d750 0x7f663806fc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66480041d0 tx=0x7f6648004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:51.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.693+0000 7f664e7fc640 1 -- 172.21.15.33:0/1419897547 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f66440795a0 con 0x7f6650101b30 2024-02-15T22:52:51.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.923+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6650108330 con 0x7f6650101b30 2024-02-15T22:52:51.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.923+0000 7f664e7fc640 1 -- 172.21.15.33:0/1419897547 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5023 (secure 0 0 0) 0x7f664407cc60 con 0x7f6650101b30 2024-02-15T22:52:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:51.926 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:17.581814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:active","state_seq":22,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:active","state_seq":16,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44323":{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44327":{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:51.926 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 42 2024-02-15T22:52:51.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f663806d750 msgr2=0x7f663806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f663806d750 0x7f663806fc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66480041d0 tx=0x7f6648004330 comp rx=0 tx=0).stop 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 msgr2=0x7f66501152a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66501152a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6644000c00 tx=0x7f6644009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 shutdown_connections 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f663806d750 0x7f663806fc00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6650101b30 0x7f66501152a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 --2- 172.21.15.33:0/1419897547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6650101220 0x7f6650114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 >> 172.21.15.33:0/1419897547 conn(0x7f6650070a10 msgr2=0x7f66500fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 shutdown_connections 2024-02-15T22:52:51.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:51.926+0000 7f6657f5d640 1 -- 172.21.15.33:0/1419897547 wait complete. 2024-02-15T22:52:51.939 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 50} 2024-02-15T22:52:51.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-15T22:52:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 -- 172.21.15.33:0/51136529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 msgr2=0x7fa14c102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 --2- 172.21.15.33:0/51136529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c102730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009c50 tx=0x7fa13c004d10 comp rx=0 tx=0).stop 2024-02-15T22:52:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 -- 172.21.15.33:0/51136529 shutdown_connections 2024-02-15T22:52:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 --2- 172.21.15.33:0/51136529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa14c102d00 0x7fa14c0fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 --2- 172.21.15.33:0/51136529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c102730 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 -- 172.21.15.33:0/51136529 >> 172.21.15.33:0/51136529 conn(0x7fa14c0f7ef0 msgr2=0x7fa14c0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 -- 172.21.15.33:0/51136529 shutdown_connections 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 -- 172.21.15.33:0/51136529 wait complete. 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 Processor -- start 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.043+0000 7fa150b5d640 1 -- start start 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa150b5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa150b5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa14c102d00 0x7fa14c06fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa150b5d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c071740 con 0x7fa14c102360 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa150b5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c070220 con 0x7fa14c102d00 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa14a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa14a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c06f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52758/0 (socket says 172.21.15.33:52758) 2024-02-15T22:52:52.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa14a59c640 1 -- 172.21.15.33:0/2621310459 learned_addr learned my addr 172.21.15.33:0/2621310459 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa14a59c640 1 -- 172.21.15.33:0/2621310459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa14c102d00 msgr2=0x7fa14c06fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa14a59c640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa14c102d00 0x7fa14c06fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa14a59c640 1 -- 172.21.15.33:0/2621310459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0098b0 con 0x7fa14c102360 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa14a59c640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c06f7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa13c003400 tx=0x7fa13c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa13affd640 1 -- 172.21.15.33:0/2621310459 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13c03a070 con 0x7fa14c102360 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c070470 con 0x7fa14c102360 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa13affd640 1 -- 172.21.15.33:0/2621310459 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa13c035b20 con 0x7fa14c102360 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa13affd640 1 -- 172.21.15.33:0/2621310459 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13c03eb60 con 0x7fa14c102360 2024-02-15T22:52:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.044+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c1192f0 con 0x7fa14c102360 2024-02-15T22:52:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.045+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c064480 con 0x7fa14c102360 2024-02-15T22:52:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.046+0000 7fa13affd640 1 -- 172.21.15.33:0/2621310459 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa13c032070 con 0x7fa14c102360 2024-02-15T22:52:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.046+0000 7fa13affd640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa13406d750 0x7fa13406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.046+0000 7fa13affd640 1 -- 172.21.15.33:0/2621310459 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa13c0af240 con 0x7fa14c102360 2024-02-15T22:52:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.046+0000 7fa149d9b640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa13406d750 0x7fa13406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.047+0000 7fa149d9b640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa13406d750 0x7fa13406fc00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa14c070f90 tx=0x7fa140007cb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.051+0000 7fa13affd640 1 -- 172.21.15.33:0/2621310459 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa13c078a90 con 0x7fa14c102360 2024-02-15T22:52:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:51 smithi033 ceph-mon[113773]: pgmap v260: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:51 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2504663930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:52:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:51 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3730883482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:52:52.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:51 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/695005560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:52:52.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.269+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fa14c119570 con 0x7fa14c102360 2024-02-15T22:52:52.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.270+0000 7fa13affd640 1 -- 172.21.15.33:0/2621310459 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v42) v1 ==== 107+0+4852 (secure 0 0 0) 0x7fa13c07c150 con 0x7fa14c102360 2024-02-15T22:52:52.272 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:52.272 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:40:27.018775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6827/3373069689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3373069689},{"type":"v1","addr":"172.21.15.33:6827","nonce":3373069689}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi033.xkdegf","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.33:6829/1442215635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1442215635},{"type":"v1","addr":"172.21.15.33:6829","nonce":1442215635}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24295":{"gid":24295,"name":"cephfs.smithi082.lvpzpf","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6825/998691031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":998691031},{"type":"v1","addr":"172.21.15.82:6825","nonce":998691031}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24305":{"gid":24305,"name":"cephfs.smithi082.rtwnpu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6827/2744053727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2744053727},{"type":"v1","addr":"172.21.15.82:6827","nonce":2744053727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:52.273 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T22:52:52.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa13406d750 msgr2=0x7fa13406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa13406d750 0x7fa13406fc00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa14c070f90 tx=0x7fa140007cb0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 msgr2=0x7fa14c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c06f7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa13c003400 tx=0x7fa13c004d10 comp rx=0 tx=0).stop 2024-02-15T22:52:52.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 shutdown_connections 2024-02-15T22:52:52.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa14c102d00 0x7fa14c06fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fa13406d750 0x7fa13406fc00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 --2- 172.21.15.33:0/2621310459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c102360 0x7fa14c06f7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 >> 172.21.15.33:0/2621310459 conn(0x7fa14c0f7ef0 msgr2=0x7fa14c0f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:52.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 shutdown_connections 2024-02-15T22:52:52.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.272+0000 7fa150b5d640 1 -- 172.21.15.33:0/2621310459 wait complete. 2024-02-15T22:52:52.285 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-15T22:52:52.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:51 smithi082 ceph-mon[84550]: pgmap v260: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:52:52.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:51 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2504663930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:52:52.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:51 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3730883482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:52:52.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:51 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/695005560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 -- 172.21.15.33:0/3150725253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 msgr2=0x7f83780faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 --2- 172.21.15.33:0/3150725253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f83780faed0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f83680048d0 tx=0x7f8368009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 -- 172.21.15.33:0/3150725253 shutdown_connections 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 --2- 172.21.15.33:0/3150725253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f83780faed0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 --2- 172.21.15.33:0/3150725253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378100a90 0x7f8378100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 -- 172.21.15.33:0/3150725253 >> 172.21.15.33:0/3150725253 conn(0x7f83780718c0 msgr2=0x7f8378071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 -- 172.21.15.33:0/3150725253 shutdown_connections 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 -- 172.21.15.33:0/3150725253 wait complete. 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.382+0000 7f837f99d640 1 Processor -- start 2024-02-15T22:52:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837f99d640 1 -- start start 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837f99d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f8378112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837f99d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378100a90 0x7f83781130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837f99d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83781136f0 con 0x7f83780faa80 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837f99d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837810cc80 con 0x7f8378100a90 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837d739640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f8378112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837d739640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f8378112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52786/0 (socket says 172.21.15.33:52786) 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837d739640 1 -- 172.21.15.33:0/3767757885 learned_addr learned my addr 172.21.15.33:0/3767757885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837cf38640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378100a90 0x7f83781130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837d739640 1 -- 172.21.15.33:0/3767757885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378100a90 msgr2=0x7f83781130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837d739640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378100a90 0x7f83781130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837d739640 1 -- 172.21.15.33:0/3767757885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368005040 con 0x7f83780faa80 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837d739640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f8378112bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8370002a50 tx=0x7f8370004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f836dffb640 1 -- 172.21.15.33:0/3767757885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8370007c30 con 0x7f83780faa80 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f836dffb640 1 -- 172.21.15.33:0/3767757885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f837000f040 con 0x7f83780faa80 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837810cf60 con 0x7f83780faa80 2024-02-15T22:52:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.383+0000 7f836dffb640 1 -- 172.21.15.33:0/3767757885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837000dbe0 con 0x7f83780faa80 2024-02-15T22:52:52.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.384+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837810d450 con 0x7f83780faa80 2024-02-15T22:52:52.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.385+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8378064480 con 0x7f83780faa80 2024-02-15T22:52:52.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.385+0000 7f836dffb640 1 -- 172.21.15.33:0/3767757885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f837000dd40 con 0x7f83780faa80 2024-02-15T22:52:52.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.385+0000 7f836dffb640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f836406d750 0x7f836406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.385+0000 7f836dffb640 1 -- 172.21.15.33:0/3767757885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f837008cdf0 con 0x7f83780faa80 2024-02-15T22:52:52.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.385+0000 7f837cf38640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f836406d750 0x7f836406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.386+0000 7f837cf38640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f836406d750 0x7f836406fc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f837810ddc0 tx=0x7f8368009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:52.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.390+0000 7f836dffb640 1 -- 172.21.15.33:0/3767757885 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8370056640 con 0x7f83780faa80 2024-02-15T22:52:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.607+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f8378107b70 con 0x7f83780faa80 2024-02-15T22:52:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.607+0000 7f836dffb640 1 -- 172.21.15.33:0/3767757885 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v42) v1 ==== 107+0+4853 (secure 0 0 0) 0x7f8370059d00 con 0x7f83780faa80 2024-02-15T22:52:52.610 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:52.610 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:41:18.912549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6827/3373069689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3373069689},{"type":"v1","addr":"172.21.15.33:6827","nonce":3373069689}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi033.xkdegf","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.33:6829/1442215635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1442215635},{"type":"v1","addr":"172.21.15.33:6829","nonce":1442215635}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24295":{"gid":24295,"name":"cephfs.smithi082.lvpzpf","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6825/998691031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":998691031},{"type":"v1","addr":"172.21.15.82:6825","nonce":998691031}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24305":{"gid":24305,"name":"cephfs.smithi082.rtwnpu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6827/2744053727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2744053727},{"type":"v1","addr":"172.21.15.82:6827","nonce":2744053727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 20 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f836406d750 msgr2=0x7f836406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f836406d750 0x7f836406fc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f837810ddc0 tx=0x7f8368009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 msgr2=0x7f8378112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f8378112bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8370002a50 tx=0x7f8370004600 comp rx=0 tx=0).stop 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 shutdown_connections 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378100a90 0x7f83781130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f836406d750 0x7f836406fc00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 --2- 172.21.15.33:0/3767757885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83780faa80 0x7f8378112bb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 >> 172.21.15.33:0/3767757885 conn(0x7f83780718c0 msgr2=0x7f83780f97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 shutdown_connections 2024-02-15T22:52:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.609+0000 7f837f99d640 1 -- 172.21.15.33:0/3767757885 wait complete. 2024-02-15T22:52:52.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-15T22:52:52.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.719+0000 7f1b4f99d640 1 -- 172.21.15.33:0/802897051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48071470 msgr2=0x7f1b4806f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.719+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/802897051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48071470 0x7f1b4806f840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b440048d0 tx=0x7f1b44009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.719+0000 7f1b4f99d640 1 -- 172.21.15.33:0/802897051 shutdown_connections 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.719+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/802897051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b4806fd80 0x7f1b480701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.719+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/802897051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48071470 0x7f1b4806f840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.719+0000 7f1b4f99d640 1 -- 172.21.15.33:0/802897051 >> 172.21.15.33:0/802897051 conn(0x7f1b480f7ef0 msgr2=0x7f1b480fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 -- 172.21.15.33:0/802897051 shutdown_connections 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 -- 172.21.15.33:0/802897051 wait complete. 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 Processor -- start 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 -- start start 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b4806fd80 0x7f1b481191f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b48071470 0x7f1b48119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48119d30 con 0x7f1b4806fd80 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4f99d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b481132c0 con 0x7f1b48071470 2024-02-15T22:52:52.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4d739640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b4806fd80 0x7f1b481191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4d739640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b4806fd80 0x7f1b481191f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52814/0 (socket says 172.21.15.33:52814) 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4d739640 1 -- 172.21.15.33:0/712583433 learned_addr learned my addr 172.21.15.33:0/712583433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.720+0000 7f1b4cf38640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b48071470 0x7f1b48119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b4d739640 1 -- 172.21.15.33:0/712583433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b48071470 msgr2=0x7f1b48119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b4d739640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b48071470 0x7f1b48119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b4d739640 1 -- 172.21.15.33:0/712583433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44005040 con 0x7f1b4806fd80 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b4d739640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b4806fd80 0x7f1b481191f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1b44030640 tx=0x7f1b44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b3dffb640 1 -- 172.21.15.33:0/712583433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b440092e0 con 0x7f1b4806fd80 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b48113540 con 0x7f1b4806fd80 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b3dffb640 1 -- 172.21.15.33:0/712583433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b44009440 con 0x7f1b4806fd80 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b3dffb640 1 -- 172.21.15.33:0/712583433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b44043640 con 0x7f1b4806fd80 2024-02-15T22:52:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.721+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b48113a60 con 0x7f1b4806fd80 2024-02-15T22:52:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.722+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b48064480 con 0x7f1b4806fd80 2024-02-15T22:52:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.723+0000 7f1b3dffb640 1 -- 172.21.15.33:0/712583433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1b4403b420 con 0x7f1b4806fd80 2024-02-15T22:52:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.723+0000 7f1b3dffb640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1b3406d750 0x7f1b3406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.723+0000 7f1b3dffb640 1 -- 172.21.15.33:0/712583433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1b440af940 con 0x7f1b4806fd80 2024-02-15T22:52:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.723+0000 7f1b4cf38640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1b3406d750 0x7f1b3406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.724+0000 7f1b4cf38640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1b3406d750 0x7f1b3406fc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b48114ab0 tx=0x7f1b3800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.728+0000 7f1b3dffb640 1 -- 172.21.15.33:0/712583433 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1b440792d0 con 0x7f1b4806fd80 2024-02-15T22:52:52.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.947+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f1b481147f0 con 0x7f1b4806fd80 2024-02-15T22:52:52.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.947+0000 7f1b3dffb640 1 -- 172.21.15.33:0/712583433 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v42) v1 ==== 107+0+4852 (secure 0 0 0) 0x7f1b4407c990 con 0x7f1b4806fd80 2024-02-15T22:52:52.950 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:52.950 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:45:36.298981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6827/3373069689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3373069689},{"type":"v1","addr":"172.21.15.33:6827","nonce":3373069689}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi033.xkdegf","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.33:6829/1442215635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1442215635},{"type":"v1","addr":"172.21.15.33:6829","nonce":1442215635}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24295":{"gid":24295,"name":"cephfs.smithi082.lvpzpf","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6825/998691031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":998691031},{"type":"v1","addr":"172.21.15.82:6825","nonce":998691031}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24305":{"gid":24305,"name":"cephfs.smithi082.rtwnpu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6827/2744053727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2744053727},{"type":"v1","addr":"172.21.15.82:6827","nonce":2744053727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:52.950 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 21 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.949+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1b3406d750 msgr2=0x7f1b3406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1b3406d750 0x7f1b3406fc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b48114ab0 tx=0x7f1b3800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b4806fd80 msgr2=0x7f1b481191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b4806fd80 0x7f1b481191f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1b44030640 tx=0x7f1b44009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 shutdown_connections 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b48071470 0x7f1b48119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1b3406d750 0x7f1b3406fc00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 --2- 172.21.15.33:0/712583433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b4806fd80 0x7f1b481191f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:52.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 >> 172.21.15.33:0/712583433 conn(0x7f1b480f7ef0 msgr2=0x7f1b4810b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:52.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 shutdown_connections 2024-02-15T22:52:52.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:52.950+0000 7f1b4f99d640 1 -- 172.21.15.33:0/712583433 wait complete. 2024-02-15T22:52:52.963 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 -- 172.21.15.33:0/2827824825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 msgr2=0x7fd9240fb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/2827824825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd9240fb2a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9180048d0 tx=0x7fd918009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 -- 172.21.15.33:0/2827824825 shutdown_connections 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/2827824825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd9240fb2a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/2827824825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd924101270 0x7fd924101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 -- 172.21.15.33:0/2827824825 >> 172.21.15.33:0/2827824825 conn(0x7fd9240f6de0 msgr2=0x7fd9240f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 -- 172.21.15.33:0/2827824825 shutdown_connections 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 -- 172.21.15.33:0/2827824825 wait complete. 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 Processor -- start 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.061+0000 7fd92bc6e640 1 -- start start 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd92bc6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd924101270 0x7fd924111af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd92bc6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd924112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd92bc6e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd924112630 con 0x7fd924101c10 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd92bc6e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92410bbc0 con 0x7fd924101270 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929209640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd924112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929209640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd924112030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52834/0 (socket says 172.21.15.33:52834) 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929209640 1 -- 172.21.15.33:0/1489451523 learned_addr learned my addr 172.21.15.33:0/1489451523 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929a0a640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd924101270 0x7fd924111af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929209640 1 -- 172.21.15.33:0/1489451523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd924101270 msgr2=0x7fd924111af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929209640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd924101270 0x7fd924111af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929209640 1 -- 172.21.15.33:0/1489451523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918005040 con 0x7fd924101c10 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd929209640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd924112030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd91802bda0 tx=0x7fd918009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd9227fc640 1 -- 172.21.15.33:0/1489451523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9180094c0 con 0x7fd924101c10 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd9227fc640 1 -- 172.21.15.33:0/1489451523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd918032e50 con 0x7fd924101c10 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92410be40 con 0x7fd924101c10 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd9227fc640 1 -- 172.21.15.33:0/1489451523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9180435f0 con 0x7fd924101c10 2024-02-15T22:52:53.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.062+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92410c300 con 0x7fd924101c10 2024-02-15T22:52:53.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.063+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd924064480 con 0x7fd924101c10 2024-02-15T22:52:53.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.064+0000 7fd9227fc640 1 -- 172.21.15.33:0/1489451523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd91802f070 con 0x7fd924101c10 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.064+0000 7fd9227fc640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd90c06d760 0x7fd90c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.064+0000 7fd9227fc640 1 -- 172.21.15.33:0/1489451523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd9180aee40 con 0x7fd924101c10 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.064+0000 7fd929a0a640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd90c06d760 0x7fd90c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.065+0000 7fd929a0a640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd90c06d760 0x7fd90c06fc10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd91c004ed0 tx=0x7fd91c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.069+0000 7fd9227fc640 1 -- 172.21.15.33:0/1489451523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd9180786a0 con 0x7fd924101c10 2024-02-15T22:52:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:52 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1419897547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:52:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:52 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2621310459' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-15T22:52:53.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:52 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3767757885' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T22:52:53.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.288+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fd92410c520 con 0x7fd924101c10 2024-02-15T22:52:53.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.288+0000 7fd9227fc640 1 -- 172.21.15.33:0/1489451523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v42) v1 ==== 107+0+4851 (secure 0 0 0) 0x7fd91807bd60 con 0x7fd924101c10 2024-02-15T22:52:53.290 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:53.291 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:45:43.833198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6827/3373069689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3373069689},{"type":"v1","addr":"172.21.15.33:6827","nonce":3373069689}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi033.xkdegf","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.33:6829/1442215635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1442215635},{"type":"v1","addr":"172.21.15.33:6829","nonce":1442215635}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24295":{"gid":24295,"name":"cephfs.smithi082.lvpzpf","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6825/998691031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":998691031},{"type":"v1","addr":"172.21.15.82:6825","nonce":998691031}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24305":{"gid":24305,"name":"cephfs.smithi082.rtwnpu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6827/2744053727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2744053727},{"type":"v1","addr":"172.21.15.82:6827","nonce":2744053727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:53.291 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.290+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd90c06d760 msgr2=0x7fd90c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.290+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd90c06d760 0x7fd90c06fc10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd91c004ed0 tx=0x7fd91c00b040 comp rx=0 tx=0).stop 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.290+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 msgr2=0x7fd924112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.290+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd924112030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd91802bda0 tx=0x7fd918009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.291+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 shutdown_connections 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.291+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd90c06d760 0x7fd90c06fc10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.291+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd924101c10 0x7fd924112030 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.291+0000 7fd92bc6e640 1 --2- 172.21.15.33:0/1489451523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd924101270 0x7fd924111af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.291+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 >> 172.21.15.33:0/1489451523 conn(0x7fd9240f6de0 msgr2=0x7fd9240f88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.291+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 shutdown_connections 2024-02-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.291+0000 7fd92bc6e640 1 -- 172.21.15.33:0/1489451523 wait complete. 2024-02-15T22:52:53.304 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-15T22:52:53.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:52 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1419897547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:52:53.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:52 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2621310459' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-15T22:52:53.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:52 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3767757885' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T22:52:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 -- 172.21.15.33:0/272750837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 msgr2=0x7fb1e40fb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/272750837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e40fb280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40048d0 tx=0x7fb1d4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 -- 172.21.15.33:0/272750837 shutdown_connections 2024-02-15T22:52:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/272750837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e40fb280 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/272750837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e4101250 0x7fb1e4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 -- 172.21.15.33:0/272750837 >> 172.21.15.33:0/272750837 conn(0x7fb1e40f6e00 msgr2=0x7fb1e40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 -- 172.21.15.33:0/272750837 shutdown_connections 2024-02-15T22:52:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 -- 172.21.15.33:0/272750837 wait complete. 2024-02-15T22:52:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 Processor -- start 2024-02-15T22:52:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.401+0000 7fb1eb79d640 1 -- start start 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1eb79d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e4101250 0x7fb1e4112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1eb79d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e41130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1eb79d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e41136c0 con 0x7fb1e4101bf0 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1eb79d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e410cc50 con 0x7fb1e4101250 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e8d38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e41130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e8d38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e41130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52852/0 (socket says 172.21.15.33:52852) 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e8d38640 1 -- 172.21.15.33:0/1152593256 learned_addr learned my addr 172.21.15.33:0/1152593256 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e9539640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e4101250 0x7fb1e4112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e8d38640 1 -- 172.21.15.33:0/1152593256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e4101250 msgr2=0x7fb1e4112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e8d38640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e4101250 0x7fb1e4112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e8d38640 1 -- 172.21.15.33:0/1152593256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4005040 con 0x7fb1e4101bf0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e9539640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e4101250 0x7fb1e4112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1e8d38640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e41130c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4031720 tx=0x7fb1d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1d9ffb640 1 -- 172.21.15.33:0/1152593256 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d40094c0 con 0x7fb1e4101bf0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1d9ffb640 1 -- 172.21.15.33:0/1152593256 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1d4009620 con 0x7fb1e4101bf0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e410ced0 con 0x7fb1e4101bf0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.402+0000 7fb1d9ffb640 1 -- 172.21.15.33:0/1152593256 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d403b640 con 0x7fb1e4101bf0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.403+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e410d3f0 con 0x7fb1e4101bf0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.404+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e4064480 con 0x7fb1e4101bf0 2024-02-15T22:52:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.404+0000 7fb1d9ffb640 1 -- 172.21.15.33:0/1152593256 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb1d402f070 con 0x7fb1e4101bf0 2024-02-15T22:52:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.405+0000 7fb1d9ffb640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb1d006d750 0x7fb1d006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.405+0000 7fb1e9539640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb1d006d750 0x7fb1d006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.405+0000 7fb1d9ffb640 1 -- 172.21.15.33:0/1152593256 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb1d40af470 con 0x7fb1e4101bf0 2024-02-15T22:52:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.405+0000 7fb1e9539640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb1d006d750 0x7fb1d006fc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0004d60 tx=0x7fb1e000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:53.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.409+0000 7fb1d9ffb640 1 -- 172.21.15.33:0/1152593256 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb1d4078cc0 con 0x7fb1e4101bf0 2024-02-15T22:52:53.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.632+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fb1e4108390 con 0x7fb1e4101bf0 2024-02-15T22:52:53.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.632+0000 7fb1d9ffb640 1 -- 172.21.15.33:0/1152593256 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v42) v1 ==== 107+0+3280 (secure 0 0 0) 0x7fb1d4036ce0 con 0x7fb1e4101bf0 2024-02-15T22:52:53.635 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:53.635 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:54.807909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6827/3373069689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3373069689},{"type":"v1","addr":"172.21.15.33:6827","nonce":3373069689}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24295":{"gid":24295,"name":"cephfs.smithi082.lvpzpf","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6825/998691031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":998691031},{"type":"v1","addr":"172.21.15.82:6825","nonce":998691031}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb1d006d750 msgr2=0x7fb1d006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb1d006d750 0x7fb1d006fc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0004d60 tx=0x7fb1e000b040 comp rx=0 tx=0).stop 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 msgr2=0x7fb1e41130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e41130c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4031720 tx=0x7fb1d4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 shutdown_connections 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb1d006d750 0x7fb1d006fc00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e4101bf0 0x7fb1e41130c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 --2- 172.21.15.33:0/1152593256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e4101250 0x7fb1e4112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 >> 172.21.15.33:0/1152593256 conn(0x7fb1e40f6e00 msgr2=0x7fb1e40656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 shutdown_connections 2024-02-15T22:52:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.634+0000 7fb1eb79d640 1 -- 172.21.15.33:0/1152593256 wait complete. 2024-02-15T22:52:53.647 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-02-15T22:52:53.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 -- 172.21.15.33:0/459291518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 msgr2=0x7fb4f00faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/459291518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00faee0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40048d0 tx=0x7fb4e4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 -- 172.21.15.33:0/459291518 shutdown_connections 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/459291518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00faee0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/459291518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f00fe2f0 0x7fb4f00fe6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 -- 172.21.15.33:0/459291518 >> 172.21.15.33:0/459291518 conn(0x7fb4f0071950 msgr2=0x7fb4f0071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 -- 172.21.15.33:0/459291518 shutdown_connections 2024-02-15T22:52:53.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 -- 172.21.15.33:0/459291518 wait complete. 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.745+0000 7fb4f5cae640 1 Processor -- start 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4f5cae640 1 -- start start 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4f5cae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00fbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4f5cae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f00fe2f0 0x7fb4f00fc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4f5cae640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00fdbf0 con 0x7fb4f00faa70 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4f5cae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00fc6d0 con 0x7fb4f00fe2f0 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00fbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00fbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52864/0 (socket says 172.21.15.33:52864) 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4ef7fe640 1 -- 172.21.15.33:0/1324925933 learned_addr learned my addr 172.21.15.33:0/1324925933 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4eeffd640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f00fe2f0 0x7fb4f00fc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4ef7fe640 1 -- 172.21.15.33:0/1324925933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f00fe2f0 msgr2=0x7fb4f00fc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4ef7fe640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f00fe2f0 0x7fb4f00fc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4ef7fe640 1 -- 172.21.15.33:0/1324925933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4005040 con 0x7fb4f00faa70 2024-02-15T22:52:53.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.746+0000 7fb4ef7fe640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00fbc50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0002a50 tx=0x7fb4e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:53.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.747+0000 7fb4d7fff640 1 -- 172.21.15.33:0/1324925933 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e0007c30 con 0x7fb4f00faa70 2024-02-15T22:52:53.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.747+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f00fc980 con 0x7fb4f00faa70 2024-02-15T22:52:53.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.747+0000 7fb4d7fff640 1 -- 172.21.15.33:0/1324925933 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4e000f040 con 0x7fb4f00faa70 2024-02-15T22:52:53.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.747+0000 7fb4d7fff640 1 -- 172.21.15.33:0/1324925933 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e000db50 con 0x7fb4f00faa70 2024-02-15T22:52:53.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.747+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f01192c0 con 0x7fb4f00faa70 2024-02-15T22:52:53.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.748+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f0064480 con 0x7fb4f00faa70 2024-02-15T22:52:53.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.748+0000 7fb4d7fff640 1 -- 172.21.15.33:0/1324925933 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb4e001c400 con 0x7fb4f00faa70 2024-02-15T22:52:53.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.748+0000 7fb4d7fff640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4d806d750 0x7fb4d806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:53.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.748+0000 7fb4d7fff640 1 -- 172.21.15.33:0/1324925933 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb4e008c700 con 0x7fb4f00faa70 2024-02-15T22:52:53.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.748+0000 7fb4eeffd640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4d806d750 0x7fb4d806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:53.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.749+0000 7fb4eeffd640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4d806d750 0x7fb4d806fc00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00fd440 tx=0x7fb4e4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:53.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.753+0000 7fb4d7fff640 1 -- 172.21.15.33:0/1324925933 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb4e0056000 con 0x7fb4f00faa70 2024-02-15T22:52:53.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.973+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fb4f0100880 con 0x7fb4f00faa70 2024-02-15T22:52:53.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.974+0000 7fb4d7fff640 1 -- 172.21.15.33:0/1324925933 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v42) v1 ==== 107+0+3260 (secure 0 0 0) 0x7fb4e0017cd0 con 0x7fb4f00faa70 2024-02-15T22:52:53.976 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:53.976 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/476484104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":476484104},{"type":"v1","addr":"172.21.15.33:6829","nonce":476484104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:53.976 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-02-15T22:52:53.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4d806d750 msgr2=0x7fb4d806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4d806d750 0x7fb4d806fc00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00fd440 tx=0x7fb4e4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 msgr2=0x7fb4f00fbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:53.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00fbc50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0002a50 tx=0x7fb4e0004600 comp rx=0 tx=0).stop 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 shutdown_connections 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f00fe2f0 0x7fb4f00fc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4d806d750 0x7fb4d806fc00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 --2- 172.21.15.33:0/1324925933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4f00faa70 0x7fb4f00fbc50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 >> 172.21.15.33:0/1324925933 conn(0x7fb4f0071950 msgr2=0x7fb4f00f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 shutdown_connections 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:53.976+0000 7fb4f5cae640 1 -- 172.21.15.33:0/1324925933 wait complete. 2024-02-15T22:52:53.989 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:53.989 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-02-15T22:52:53.989 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 -- 172.21.15.33:0/1548916077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 msgr2=0x7fca18102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 --2- 172.21.15.33:0/1548916077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca18102730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fca080048d0 tx=0x7fca08009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 -- 172.21.15.33:0/1548916077 shutdown_connections 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 --2- 172.21.15.33:0/1548916077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca18102d00 0x7fca180fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 --2- 172.21.15.33:0/1548916077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca18102730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 -- 172.21.15.33:0/1548916077 >> 172.21.15.33:0/1548916077 conn(0x7fca180f7ef0 msgr2=0x7fca180fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 -- 172.21.15.33:0/1548916077 shutdown_connections 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 -- 172.21.15.33:0/1548916077 wait complete. 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.086+0000 7fca1e31d640 1 Processor -- start 2024-02-15T22:52:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca1e31d640 1 -- start start 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca1e31d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca1806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca1e31d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca18102d00 0x7fca1806fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca1e31d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18071740 con 0x7fca18102360 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca1e31d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18070220 con 0x7fca18102d00 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca17fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca1806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca17fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca1806f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52870/0 (socket says 172.21.15.33:52870) 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca17fff640 1 -- 172.21.15.33:0/3418327335 learned_addr learned my addr 172.21.15.33:0/3418327335 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca177fe640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca18102d00 0x7fca1806fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca17fff640 1 -- 172.21.15.33:0/3418327335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca18102d00 msgr2=0x7fca1806fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca17fff640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca18102d00 0x7fca1806fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca17fff640 1 -- 172.21.15.33:0/3418327335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08005040 con 0x7fca18102360 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca17fff640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca1806f7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca08031720 tx=0x7fca08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca14ff9640 1 -- 172.21.15.33:0/3418327335 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca080094c0 con 0x7fca18102360 2024-02-15T22:52:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca14ff9640 1 -- 172.21.15.33:0/3418327335 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca08009620 con 0x7fca18102360 2024-02-15T22:52:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.087+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca18070470 con 0x7fca18102360 2024-02-15T22:52:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.088+0000 7fca14ff9640 1 -- 172.21.15.33:0/3418327335 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0803b640 con 0x7fca18102360 2024-02-15T22:52:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.088+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca18119270 con 0x7fca18102360 2024-02-15T22:52:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.088+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca18064480 con 0x7fca18102360 2024-02-15T22:52:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.089+0000 7fca14ff9640 1 -- 172.21.15.33:0/3418327335 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fca0802f070 con 0x7fca18102360 2024-02-15T22:52:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.089+0000 7fca14ff9640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca0006d750 0x7fca0006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.089+0000 7fca14ff9640 1 -- 172.21.15.33:0/3418327335 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fca080af440 con 0x7fca18102360 2024-02-15T22:52:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.089+0000 7fca177fe640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca0006d750 0x7fca0006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.090+0000 7fca177fe640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca0006d750 0x7fca0006fc00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca18070f90 tx=0x7fca0c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.094+0000 7fca14ff9640 1 -- 172.21.15.33:0/3418327335 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fca08078d10 con 0x7fca18102360 2024-02-15T22:52:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:53 smithi033 ceph-mon[113773]: pgmap v261: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:53 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/712583433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T22:52:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:53 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1489451523' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T22:52:54.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:53 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1152593256' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T22:52:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.315+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fca18119450 con 0x7fca18102360 2024-02-15T22:52:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.316+0000 7fca14ff9640 1 -- 172.21.15.33:0/3418327335 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v42) v1 ==== 107+0+4818 (secure 0 0 0) 0x7fca0807c3d0 con 0x7fca18102360 2024-02-15T22:52:54.318 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:54.318 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/476484104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":476484104},{"type":"v1","addr":"172.21.15.33:6829","nonce":476484104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":34386,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/3907861827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3907861827},{"type":"v1","addr":"172.21.15.33:6827","nonce":3907861827}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44271,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/1670406671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1670406671},{"type":"v1","addr":"172.21.15.82:6825","nonce":1670406671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca0006d750 msgr2=0x7fca0006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca0006d750 0x7fca0006fc00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca18070f90 tx=0x7fca0c009040 comp rx=0 tx=0).stop 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 msgr2=0x7fca1806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca1806f7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca08031720 tx=0x7fca08009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 shutdown_connections 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca18102d00 0x7fca1806fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fca0006d750 0x7fca0006fc00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 --2- 172.21.15.33:0/3418327335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca18102360 0x7fca1806f7a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 >> 172.21.15.33:0/3418327335 conn(0x7fca180f7ef0 msgr2=0x7fca180f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 shutdown_connections 2024-02-15T22:52:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.318+0000 7fca1e31d640 1 -- 172.21.15.33:0/3418327335 wait complete. 2024-02-15T22:52:54.331 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:54.332 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-02-15T22:52:54.332 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-15T22:52:54.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:53 smithi082 ceph-mon[84550]: pgmap v261: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:52:54.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:53 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/712583433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T22:52:54.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:53 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1489451523' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T22:52:54.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:53 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1152593256' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 -- 172.21.15.33:0/360043932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 msgr2=0x7f8a400fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/360043932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a400fb270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8a300048d0 tx=0x7f8a30009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 -- 172.21.15.33:0/360043932 shutdown_connections 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/360043932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a400fb270 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/360043932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a40101240 0x7f8a40101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 -- 172.21.15.33:0/360043932 >> 172.21.15.33:0/360043932 conn(0x7f8a400f6e10 msgr2=0x7f8a400f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 -- 172.21.15.33:0/360043932 shutdown_connections 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 -- 172.21.15.33:0/360043932 wait complete. 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 Processor -- start 2024-02-15T22:52:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.429+0000 7f8a47f5d640 1 -- start start 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a47f5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a40101240 0x7f8a40111b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a47f5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a40112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a47f5d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40112680 con 0x7f8a40101be0 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a47f5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4010bc10 con 0x7f8a40101240 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a454f8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a40112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a454f8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a40112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52890/0 (socket says 172.21.15.33:52890) 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a454f8640 1 -- 172.21.15.33:0/3146493096 learned_addr learned my addr 172.21.15.33:0/3146493096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a45cf9640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a40101240 0x7f8a40111b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a454f8640 1 -- 172.21.15.33:0/3146493096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a40101240 msgr2=0x7f8a40111b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a454f8640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a40101240 0x7f8a40111b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a454f8640 1 -- 172.21.15.33:0/3146493096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30005040 con 0x7f8a40101be0 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a454f8640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a40112080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8a3002bda0 tx=0x7f8a30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a367fc640 1 -- 172.21.15.33:0/3146493096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a300094c0 con 0x7f8a40101be0 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4010be90 con 0x7f8a40101be0 2024-02-15T22:52:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a367fc640 1 -- 172.21.15.33:0/3146493096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a30032e50 con 0x7f8a40101be0 2024-02-15T22:52:54.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a367fc640 1 -- 172.21.15.33:0/3146493096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a300435f0 con 0x7f8a40101be0 2024-02-15T22:52:54.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.430+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4010c350 con 0x7f8a40101be0 2024-02-15T22:52:54.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.431+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a40064480 con 0x7f8a40101be0 2024-02-15T22:52:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.432+0000 7f8a367fc640 1 -- 172.21.15.33:0/3146493096 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8a3002f070 con 0x7f8a40101be0 2024-02-15T22:52:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.432+0000 7f8a367fc640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8a2c06d760 0x7f8a2c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.432+0000 7f8a367fc640 1 -- 172.21.15.33:0/3146493096 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8a300aedc0 con 0x7f8a40101be0 2024-02-15T22:52:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.432+0000 7f8a45cf9640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8a2c06d760 0x7f8a2c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.433+0000 7f8a45cf9640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8a2c06d760 0x7f8a2c06fc10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8a38007fd0 tx=0x7f8a38009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:54.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.437+0000 7f8a367fc640 1 -- 172.21.15.33:0/3146493096 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8a30078610 con 0x7f8a40101be0 2024-02-15T22:52:54.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.656+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f8a40103710 con 0x7f8a40101be0 2024-02-15T22:52:54.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.656+0000 7f8a367fc640 1 -- 172.21.15.33:0/3146493096 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v42) v1 ==== 107+0+4039 (secure 0 0 0) 0x7f8a3007bcd0 con 0x7f8a40101be0 2024-02-15T22:52:54.659 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:54.659 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/476484104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":476484104},{"type":"v1","addr":"172.21.15.33:6829","nonce":476484104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44271,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/1670406671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1670406671},{"type":"v1","addr":"172.21.15.82:6825","nonce":1670406671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:54.659 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8a2c06d760 msgr2=0x7f8a2c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8a2c06d760 0x7f8a2c06fc10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8a38007fd0 tx=0x7f8a38009e90 comp rx=0 tx=0).stop 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 msgr2=0x7f8a40112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a40112080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8a3002bda0 tx=0x7f8a30009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 shutdown_connections 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f8a2c06d760 0x7f8a2c06fc10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a40101be0 0x7f8a40112080 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 --2- 172.21.15.33:0/3146493096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a40101240 0x7f8a40111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 >> 172.21.15.33:0/3146493096 conn(0x7f8a400f6e10 msgr2=0x7f8a400f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 shutdown_connections 2024-02-15T22:52:54.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.658+0000 7f8a47f5d640 1 -- 172.21.15.33:0/3146493096 wait complete. 2024-02-15T22:52:54.671 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:54.671 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-02-15T22:52:54.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.768+0000 7fc6fc62e640 1 -- 172.21.15.33:0/1210148753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 msgr2=0x7fc6f41016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.768+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/1210148753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41016a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00048d0 tx=0x7fc6f0009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 -- 172.21.15.33:0/1210148753 shutdown_connections 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/1210148753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f40fb2b0 0x7fc6f40fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/1210148753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41016a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 -- 172.21.15.33:0/1210148753 >> 172.21.15.33:0/1210148753 conn(0x7fc6f4071230 msgr2=0x7fc6f4071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 -- 172.21.15.33:0/1210148753 shutdown_connections 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 -- 172.21.15.33:0/1210148753 wait complete. 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 Processor -- start 2024-02-15T22:52:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 -- start start 2024-02-15T22:52:54.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f40fb2b0 0x7fc6f4112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f41136f0 con 0x7fc6f41012d0 2024-02-15T22:52:54.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6fc62e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f410cc80 con 0x7fc6f40fb2b0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6f9bc9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6f9bc9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52900/0 (socket says 172.21.15.33:52900) 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.769+0000 7fc6f9bc9640 1 -- 172.21.15.33:0/3562412015 learned_addr learned my addr 172.21.15.33:0/3562412015 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6fa3ca640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f40fb2b0 0x7fc6f4112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6f9bc9640 1 -- 172.21.15.33:0/3562412015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f40fb2b0 msgr2=0x7fc6f4112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6f9bc9640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f40fb2b0 0x7fc6f4112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6f9bc9640 1 -- 172.21.15.33:0/3562412015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0005040 con 0x7fc6f41012d0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6f9bc9640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41130f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4002a50 tx=0x7fc6e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6eaffd640 1 -- 172.21.15.33:0/3562412015 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e4007c30 con 0x7fc6f41012d0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6eaffd640 1 -- 172.21.15.33:0/3562412015 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6e400f040 con 0x7fc6f41012d0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f410cf60 con 0x7fc6f41012d0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6eaffd640 1 -- 172.21.15.33:0/3562412015 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e400dbe0 con 0x7fc6f41012d0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.770+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f410d480 con 0x7fc6f41012d0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.771+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f4064030 con 0x7fc6f41012d0 2024-02-15T22:52:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.771+0000 7fc6eaffd640 1 -- 172.21.15.33:0/3562412015 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc6e400dd40 con 0x7fc6f41012d0 2024-02-15T22:52:54.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.772+0000 7fc6eaffd640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc6e006d750 0x7fc6e006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:54.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.772+0000 7fc6eaffd640 1 -- 172.21.15.33:0/3562412015 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc6e408ce90 con 0x7fc6f41012d0 2024-02-15T22:52:54.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.772+0000 7fc6fa3ca640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc6e006d750 0x7fc6e006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:54.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.772+0000 7fc6fa3ca640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc6e006d750 0x7fc6e006fc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000c00 tx=0x7fc6f0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:54.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.777+0000 7fc6eaffd640 1 -- 172.21.15.33:0/3562412015 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc6e4056640 con 0x7fc6f41012d0 2024-02-15T22:52:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:54.999+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fc6f410d6a0 con 0x7fc6f41012d0 2024-02-15T22:52:55.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.000+0000 7fc6eaffd640 1 -- 172.21.15.33:0/3562412015 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v42) v1 ==== 107+0+4852 (secure 0 0 0) 0x7fc6e4059d00 con 0x7fc6f41012d0 2024-02-15T22:52:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:55.002 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/476484104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":476484104},{"type":"v1","addr":"172.21.15.33:6829","nonce":476484104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44271,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/1670406671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1670406671},{"type":"v1","addr":"172.21.15.82:6825","nonce":1670406671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc6e006d750 msgr2=0x7fc6e006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc6e006d750 0x7fc6e006fc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000c00 tx=0x7fc6f0009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 msgr2=0x7fc6f41130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41130f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4002a50 tx=0x7fc6e4004600 comp rx=0 tx=0).stop 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 shutdown_connections 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc6e006d750 0x7fc6e006fc00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f41012d0 0x7fc6f41130f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 --2- 172.21.15.33:0/3562412015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f40fb2b0 0x7fc6f4112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 >> 172.21.15.33:0/3562412015 conn(0x7fc6f4071230 msgr2=0x7fc6f41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 shutdown_connections 2024-02-15T22:52:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.002+0000 7fc6fc62e640 1 -- 172.21.15.33:0/3562412015 wait complete. 2024-02-15T22:52:55.014 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:54 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1324925933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T22:52:55.014 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:54 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3418327335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T22:52:55.014 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:54 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3146493096' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T22:52:55.015 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:55.016 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-02-15T22:52:55.016 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 -- 172.21.15.33:0/1278867346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 msgr2=0x7fb83c0fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 --2- 172.21.15.33:0/1278867346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c0fc380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0048d0 tx=0x7fb82c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 -- 172.21.15.33:0/1278867346 shutdown_connections 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 --2- 172.21.15.33:0/1278867346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c0fc380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 --2- 172.21.15.33:0/1278867346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb83c102350 0x7fb83c102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 -- 172.21.15.33:0/1278867346 >> 172.21.15.33:0/1278867346 conn(0x7fb83c0f7ee0 msgr2=0x7fb83c0fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 -- 172.21.15.33:0/1278867346 shutdown_connections 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.113+0000 7fb844258640 1 -- 172.21.15.33:0/1278867346 wait complete. 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb844258640 1 Processor -- start 2024-02-15T22:52:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb844258640 1 -- start start 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb844258640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb83c102350 0x7fb83c112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb844258640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb844258640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c113740 con 0x7fb83c102cf0 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb844258640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c10ccd0 con 0x7fb83c102350 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8417f3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8417f3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c113140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52904/0 (socket says 172.21.15.33:52904) 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8417f3640 1 -- 172.21.15.33:0/2568750901 learned_addr learned my addr 172.21.15.33:0/2568750901 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb841ff4640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb83c102350 0x7fb83c112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8417f3640 1 -- 172.21.15.33:0/2568750901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb83c102350 msgr2=0x7fb83c112c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8417f3640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb83c102350 0x7fb83c112c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8417f3640 1 -- 172.21.15.33:0/2568750901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c005040 con 0x7fb83c102cf0 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8417f3640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c113140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb82c031720 tx=0x7fb82c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.114+0000 7fb8327fc640 1 -- 172.21.15.33:0/2568750901 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c0094c0 con 0x7fb83c102cf0 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.115+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c10cf50 con 0x7fb83c102cf0 2024-02-15T22:52:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.115+0000 7fb8327fc640 1 -- 172.21.15.33:0/2568750901 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb82c009620 con 0x7fb83c102cf0 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.115+0000 7fb8327fc640 1 -- 172.21.15.33:0/2568750901 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c03b640 con 0x7fb83c102cf0 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.115+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c10d470 con 0x7fb83c102cf0 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.115+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c064480 con 0x7fb83c102cf0 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.116+0000 7fb8327fc640 1 -- 172.21.15.33:0/2568750901 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb82c02f070 con 0x7fb83c102cf0 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.116+0000 7fb8327fc640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb82806d750 0x7fb82806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.116+0000 7fb8327fc640 1 -- 172.21.15.33:0/2568750901 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb82c0af350 con 0x7fb83c102cf0 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.116+0000 7fb841ff4640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb82806d750 0x7fb82806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.117+0000 7fb841ff4640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb82806d750 0x7fb82806fc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb838004ed0 tx=0x7fb83800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:55.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.121+0000 7fb8327fc640 1 -- 172.21.15.33:0/2568750901 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb82c078ba0 con 0x7fb83c102cf0 2024-02-15T22:52:55.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.339+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fb83c10e200 con 0x7fb83c102cf0 2024-02-15T22:52:55.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.339+0000 7fb8327fc640 1 -- 172.21.15.33:0/2568750901 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v42) v1 ==== 107+0+4076 (secure 0 0 0) 0x7fb82c07c260 con 0x7fb83c102cf0 2024-02-15T22:52:55.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:55.342 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44271,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/1670406671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1670406671},{"type":"v1","addr":"172.21.15.82:6825","nonce":1670406671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-02-15T22:52:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb82806d750 msgr2=0x7fb82806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb82806d750 0x7fb82806fc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb838004ed0 tx=0x7fb83800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 msgr2=0x7fb83c113140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c113140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb82c031720 tx=0x7fb82c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 shutdown_connections 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb82806d750 0x7fb82806fc00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb83c102cf0 0x7fb83c113140 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 --2- 172.21.15.33:0/2568750901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb83c102350 0x7fb83c112c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 >> 172.21.15.33:0/2568750901 conn(0x7fb83c0f7ee0 msgr2=0x7fb83c0f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 shutdown_connections 2024-02-15T22:52:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.341+0000 7fb844258640 1 -- 172.21.15.33:0/2568750901 wait complete. 2024-02-15T22:52:55.354 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:55.354 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-02-15T22:52:55.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-15T22:52:55.374 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:54 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1324925933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T22:52:55.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:54 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3418327335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T22:52:55.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:54 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3146493096' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.451+0000 7f0b356ae640 1 -- 172.21.15.33:0/4199501880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 msgr2=0x7f0b300fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.451+0000 7f0b356ae640 1 --2- 172.21.15.33:0/4199501880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b300fc390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b240048d0 tx=0x7f0b24009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.451+0000 7f0b356ae640 1 -- 172.21.15.33:0/4199501880 shutdown_connections 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.451+0000 7f0b356ae640 1 --2- 172.21.15.33:0/4199501880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b300fc390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.451+0000 7f0b356ae640 1 --2- 172.21.15.33:0/4199501880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b30102360 0x7f0b30102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.451+0000 7f0b356ae640 1 -- 172.21.15.33:0/4199501880 >> 172.21.15.33:0/4199501880 conn(0x7f0b300f7ef0 msgr2=0x7f0b300fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 -- 172.21.15.33:0/4199501880 shutdown_connections 2024-02-15T22:52:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 -- 172.21.15.33:0/4199501880 wait complete. 2024-02-15T22:52:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 Processor -- start 2024-02-15T22:52:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 -- start start 2024-02-15T22:52:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b30102360 0x7f0b30112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b30113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30113730 con 0x7f0b30102d00 2024-02-15T22:52:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b356ae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3010ccc0 con 0x7f0b30102360 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b2e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b30113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b2e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b30113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52918/0 (socket says 172.21.15.33:52918) 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.452+0000 7f0b2e7fc640 1 -- 172.21.15.33:0/2209296604 learned_addr learned my addr 172.21.15.33:0/2209296604 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b2effd640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b30102360 0x7f0b30112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b2e7fc640 1 -- 172.21.15.33:0/2209296604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b30102360 msgr2=0x7f0b30112bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b2e7fc640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b30102360 0x7f0b30112bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b2e7fc640 1 -- 172.21.15.33:0/2209296604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24005040 con 0x7f0b30102d00 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b2e7fc640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b30113130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0b24031720 tx=0x7f0b24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b177fe640 1 -- 172.21.15.33:0/2209296604 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b240094c0 con 0x7f0b30102d00 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b177fe640 1 -- 172.21.15.33:0/2209296604 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b24009620 con 0x7f0b30102d00 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3010cf40 con 0x7f0b30102d00 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b177fe640 1 -- 172.21.15.33:0/2209296604 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b2403b640 con 0x7f0b30102d00 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.453+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3010d460 con 0x7f0b30102d00 2024-02-15T22:52:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.454+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b30064480 con 0x7f0b30102d00 2024-02-15T22:52:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.454+0000 7f0b177fe640 1 -- 172.21.15.33:0/2209296604 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0b2402f070 con 0x7f0b30102d00 2024-02-15T22:52:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.455+0000 7f0b177fe640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d750 0x7f0b1806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.455+0000 7f0b177fe640 1 -- 172.21.15.33:0/2209296604 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0b240af470 con 0x7f0b30102d00 2024-02-15T22:52:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.455+0000 7f0b2effd640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d750 0x7f0b1806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.455+0000 7f0b2effd640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d750 0x7f0b1806fc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b20007fd0 tx=0x7f0b20009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.460+0000 7f0b177fe640 1 -- 172.21.15.33:0/2209296604 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0b24078cc0 con 0x7f0b30102d00 2024-02-15T22:52:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.678+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f0b3010d5f0 con 0x7f0b30102d00 2024-02-15T22:52:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.678+0000 7f0b177fe640 1 -- 172.21.15.33:0/2209296604 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v42) v1 ==== 107+0+4889 (secure 0 0 0) 0x7f0b2407c380 con 0x7f0b30102d00 2024-02-15T22:52:55.681 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:55.681 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44271,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/1670406671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1670406671},{"type":"v1","addr":"172.21.15.82:6825","nonce":1670406671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 29 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d750 msgr2=0x7f0b1806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d750 0x7f0b1806fc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b20007fd0 tx=0x7f0b20009e90 comp rx=0 tx=0).stop 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 msgr2=0x7f0b30113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b30113130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0b24031720 tx=0x7f0b24009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 shutdown_connections 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f0b1806d750 0x7f0b1806fc00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b30102d00 0x7f0b30113130 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 --2- 172.21.15.33:0/2209296604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b30102360 0x7f0b30112bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 >> 172.21.15.33:0/2209296604 conn(0x7f0b300f7ef0 msgr2=0x7f0b300f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:55.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 shutdown_connections 2024-02-15T22:52:55.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.680+0000 7f0b356ae640 1 -- 172.21.15.33:0/2209296604 wait complete. 2024-02-15T22:52:55.694 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:55.694 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-02-15T22:52:55.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-15T22:52:55.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 -- 172.21.15.33:0/3915216981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 msgr2=0x7fc4e80fc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/3915216981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e80fc3b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00048d0 tx=0x7fc4d0009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 -- 172.21.15.33:0/3915216981 shutdown_connections 2024-02-15T22:52:55.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/3915216981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e80fc3b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/3915216981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8102380 0x7fc4e8102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 -- 172.21.15.33:0/3915216981 >> 172.21.15.33:0/3915216981 conn(0x7fc4e80f7fb0 msgr2=0x7fc4e80fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 -- 172.21.15.33:0/3915216981 shutdown_connections 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.791+0000 7fc4ec86e640 1 -- 172.21.15.33:0/3915216981 wait complete. 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4ec86e640 1 Processor -- start 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4ec86e640 1 -- start start 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4ec86e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8102380 0x7fc4e8112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4ec86e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e81130e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4ec86e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e81136e0 con 0x7fc4e8102d20 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4ec86e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8113850 con 0x7fc4e8102380 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e81130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e81130e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52942/0 (socket says 172.21.15.33:52942) 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4e5d9b640 1 -- 172.21.15.33:0/2796636024 learned_addr learned my addr 172.21.15.33:0/2796636024 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4e5d9b640 1 -- 172.21.15.33:0/2796636024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8102380 msgr2=0x7fc4e8112ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:55.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4e5d9b640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8102380 0x7fc4e8112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.792+0000 7fc4e5d9b640 1 -- 172.21.15.33:0/2796636024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d0005040 con 0x7fc4e8102d20 2024-02-15T22:52:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.793+0000 7fc4e5d9b640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e81130e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0031720 tx=0x7fc4d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.793+0000 7fc4deffd640 1 -- 172.21.15.33:0/2796636024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4d00094c0 con 0x7fc4e8102d20 2024-02-15T22:52:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.793+0000 7fc4deffd640 1 -- 172.21.15.33:0/2796636024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4d0009620 con 0x7fc4e8102d20 2024-02-15T22:52:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.793+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e810cdc0 con 0x7fc4e8102d20 2024-02-15T22:52:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.793+0000 7fc4deffd640 1 -- 172.21.15.33:0/2796636024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4d003b640 con 0x7fc4e8102d20 2024-02-15T22:52:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.793+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e810d2e0 con 0x7fc4e8102d20 2024-02-15T22:52:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.794+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e8064030 con 0x7fc4e8102d20 2024-02-15T22:52:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.794+0000 7fc4deffd640 1 -- 172.21.15.33:0/2796636024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc4d002f070 con 0x7fc4e8102d20 2024-02-15T22:52:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.795+0000 7fc4deffd640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc4d406d750 0x7fc4d406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.795+0000 7fc4deffd640 1 -- 172.21.15.33:0/2796636024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc4d00af470 con 0x7fc4e8102d20 2024-02-15T22:52:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.795+0000 7fc4e659c640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc4d406d750 0x7fc4d406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.795+0000 7fc4e659c640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc4d406d750 0x7fc4d406fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0004c80 tx=0x7fc4e0009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:55.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:55.799+0000 7fc4deffd640 1 -- 172.21.15.33:0/2796636024 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc4d0078cc0 con 0x7fc4e8102d20 2024-02-15T22:52:55.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:55 smithi033 ceph-mon[113773]: pgmap v262: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:55.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:55 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3562412015' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T22:52:55.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:55 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2568750901' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T22:52:55.958 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:55 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2209296604' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.022+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fc4e81094e0 con 0x7fc4e8102d20 2024-02-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.023+0000 7fc4deffd640 1 -- 172.21.15.33:0/2796636024 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v42) v1 ==== 107+0+4110 (secure 0 0 0) 0x7fc4d007c380 con 0x7fc4e8102d20 2024-02-15T22:52:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:56.025 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc4d406d750 msgr2=0x7fc4d406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc4d406d750 0x7fc4d406fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0004c80 tx=0x7fc4e0009c50 comp rx=0 tx=0).stop 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 msgr2=0x7fc4e81130e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e81130e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0031720 tx=0x7fc4d0009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 shutdown_connections 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fc4d406d750 0x7fc4d406fc00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4e8102d20 0x7fc4e81130e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 --2- 172.21.15.33:0/2796636024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8102380 0x7fc4e8112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 >> 172.21.15.33:0/2796636024 conn(0x7fc4e80f7fb0 msgr2=0x7fc4e80f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 shutdown_connections 2024-02-15T22:52:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.025+0000 7fc4ec86e640 1 -- 172.21.15.33:0/2796636024 wait complete. 2024-02-15T22:52:56.038 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:56.038 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-02-15T22:52:56.038 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-15T22:52:56.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 -- 172.21.15.33:0/1256875588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101270 msgr2=0x7f06d8101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/1256875588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101270 0x7f06d8101640 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f06d40048d0 tx=0x7f06d4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 -- 172.21.15.33:0/1256875588 shutdown_connections 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/1256875588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06d8101c10 0x7f06d80fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/1256875588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101270 0x7f06d8101640 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 -- 172.21.15.33:0/1256875588 >> 172.21.15.33:0/1256875588 conn(0x7f06d80f6e40 msgr2=0x7f06d80f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 -- 172.21.15.33:0/1256875588 shutdown_connections 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.135+0000 7f06dfa6e640 1 -- 172.21.15.33:0/1256875588 wait complete. 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dfa6e640 1 Processor -- start 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dfa6e640 1 -- start start 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dfa6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06d8101270 0x7f06d810dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dfa6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101c10 0x7f06d810e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dfa6e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d810e750 con 0x7f06d8101c10 2024-02-15T22:52:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dfa6e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d810e8c0 con 0x7f06d8101270 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dd009640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101c10 0x7f06d810e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dd009640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101c10 0x7f06d810e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52956/0 (socket says 172.21.15.33:52956) 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dd009640 1 -- 172.21.15.33:0/3420839166 learned_addr learned my addr 172.21.15.33:0/3420839166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dd80a640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06d8101270 0x7f06d810dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dd009640 1 -- 172.21.15.33:0/3420839166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06d8101270 msgr2=0x7f06d810dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dd009640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06d8101270 0x7f06d810dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.136+0000 7f06dd009640 1 -- 172.21.15.33:0/3420839166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4005040 con 0x7f06d8101c10 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.137+0000 7f06dd009640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101c10 0x7f06d810e210 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06c800eb70 tx=0x7f06c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.137+0000 7f06ce7fc640 1 -- 172.21.15.33:0/3420839166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c8007c30 con 0x7f06d8101c10 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.137+0000 7f06ce7fc640 1 -- 172.21.15.33:0/3420839166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06c800f040 con 0x7f06d8101c10 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.137+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d810eb40 con 0x7f06d8101c10 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.137+0000 7f06ce7fc640 1 -- 172.21.15.33:0/3420839166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c80095b0 con 0x7f06d8101c10 2024-02-15T22:52:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.137+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d8117040 con 0x7f06d8101c10 2024-02-15T22:52:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.138+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d8064480 con 0x7f06d8101c10 2024-02-15T22:52:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.138+0000 7f06ce7fc640 1 -- 172.21.15.33:0/3420839166 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f06c8009730 con 0x7f06d8101c10 2024-02-15T22:52:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.138+0000 7f06ce7fc640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f06c406d750 0x7f06c406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.139+0000 7f06ce7fc640 1 -- 172.21.15.33:0/3420839166 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f06c808ca10 con 0x7f06d8101c10 2024-02-15T22:52:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.139+0000 7f06dd80a640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f06c406d750 0x7f06c406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.139+0000 7f06dd80a640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f06c406d750 0x7f06c406fc00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06d4000c00 tx=0x7f06d4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.143+0000 7f06ce7fc640 1 -- 172.21.15.33:0/3420839166 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f06c8056310 con 0x7f06d8101c10 2024-02-15T22:52:56.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.365+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f06d81083d0 con 0x7f06d8101c10 2024-02-15T22:52:56.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.365+0000 7f06ce7fc640 1 -- 172.21.15.33:0/3420839166 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v42) v1 ==== 107+0+4917 (secure 0 0 0) 0x7f06c80599d0 con 0x7f06d8101c10 2024-02-15T22:52:56.368 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:56.368 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3515165172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3515165172},{"type":"v1","addr":"172.21.15.82:6827","nonce":3515165172}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:56.368 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 31 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f06c406d750 msgr2=0x7f06c406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f06c406d750 0x7f06c406fc00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06d4000c00 tx=0x7f06d4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101c10 msgr2=0x7f06d810e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101c10 0x7f06d810e210 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06c800eb70 tx=0x7f06c800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 shutdown_connections 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f06c406d750 0x7f06c406fc00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d8101c10 0x7f06d810e210 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 --2- 172.21.15.33:0/3420839166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06d8101270 0x7f06d810dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 >> 172.21.15.33:0/3420839166 conn(0x7f06d80f6e40 msgr2=0x7f06d80f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:56.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 shutdown_connections 2024-02-15T22:52:56.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.368+0000 7f06dfa6e640 1 -- 172.21.15.33:0/3420839166 wait complete. 2024-02-15T22:52:56.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:55 smithi082 ceph-mon[84550]: pgmap v262: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:52:56.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:55 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3562412015' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T22:52:56.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:55 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2568750901' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T22:52:56.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:55 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2209296604' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T22:52:56.381 DEBUG:tasks.fs:max_mds not reduced in epoch 31 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:56.381 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-02-15T22:52:56.381 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 -- 172.21.15.33:0/3555774911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 msgr2=0x7fb508102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/3555774911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508102740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb5040048d0 tx=0x7fb504009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 -- 172.21.15.33:0/3555774911 shutdown_connections 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/3555774911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508102d10 0x7fb5080644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/3555774911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508102740 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 -- 172.21.15.33:0/3555774911 >> 172.21.15.33:0/3555774911 conn(0x7fb508071230 msgr2=0x7fb508071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 -- 172.21.15.33:0/3555774911 shutdown_connections 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.480+0000 7fb50fe2e640 1 -- 172.21.15.33:0/3555774911 wait complete. 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50fe2e640 1 Processor -- start 2024-02-15T22:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50fe2e640 1 -- start start 2024-02-15T22:52:56.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50fe2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50fe2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508102d10 0x7fb5081131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50fe2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081137e0 con 0x7fb508102370 2024-02-15T22:52:56.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50fe2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50810cd70 con 0x7fb508102d10 2024-02-15T22:52:56.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50dbca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50dbca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508112ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39754/0 (socket says 172.21.15.33:39754) 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.481+0000 7fb50dbca640 1 -- 172.21.15.33:0/2280419194 learned_addr learned my addr 172.21.15.33:0/2280419194 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50d3c9640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508102d10 0x7fb5081131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50dbca640 1 -- 172.21.15.33:0/2280419194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508102d10 msgr2=0x7fb5081131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50dbca640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508102d10 0x7fb5081131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50dbca640 1 -- 172.21.15.33:0/2280419194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504005040 con 0x7fb508102370 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50d3c9640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508102d10 0x7fb5081131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50dbca640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508112ca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb504031720 tx=0x7fb504009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb4fe7fc640 1 -- 172.21.15.33:0/2280419194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5040094c0 con 0x7fb508102370 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb4fe7fc640 1 -- 172.21.15.33:0/2280419194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb504009620 con 0x7fb508102370 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50810cff0 con 0x7fb508102370 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb4fe7fc640 1 -- 172.21.15.33:0/2280419194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50403b640 con 0x7fb508102370 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.482+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50810d510 con 0x7fb508102370 2024-02-15T22:52:56.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.483+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb508064030 con 0x7fb508102370 2024-02-15T22:52:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.484+0000 7fb4fe7fc640 1 -- 172.21.15.33:0/2280419194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb50402f070 con 0x7fb508102370 2024-02-15T22:52:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.484+0000 7fb4fe7fc640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4f406d750 0x7fb4f406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.484+0000 7fb4fe7fc640 1 -- 172.21.15.33:0/2280419194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb5040af3c0 con 0x7fb508102370 2024-02-15T22:52:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.484+0000 7fb50d3c9640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4f406d750 0x7fb4f406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.485+0000 7fb50d3c9640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4f406d750 0x7fb4f406fc00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb50810e560 tx=0x7fb4f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:56.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.489+0000 7fb4fe7fc640 1 -- 172.21.15.33:0/2280419194 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb504078c10 con 0x7fb508102370 2024-02-15T22:52:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.709+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fb50810e2a0 con 0x7fb508102370 2024-02-15T22:52:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.709+0000 7fb4fe7fc640 1 -- 172.21.15.33:0/2280419194 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v42) v1 ==== 107+0+4138 (secure 0 0 0) 0x7fb50407c2d0 con 0x7fb508102370 2024-02-15T22:52:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:56.711 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:56.712 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4f406d750 msgr2=0x7fb4f406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4f406d750 0x7fb4f406fc00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb50810e560 tx=0x7fb4f800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 msgr2=0x7fb508112ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508112ca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb504031720 tx=0x7fb504009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 shutdown_connections 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508102d10 0x7fb5081131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb4f406d750 0x7fb4f406fc00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 --2- 172.21.15.33:0/2280419194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb508102370 0x7fb508112ca0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.711+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 >> 172.21.15.33:0/2280419194 conn(0x7fb508071230 msgr2=0x7fb5080fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.712+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 shutdown_connections 2024-02-15T22:52:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.712+0000 7fb50fe2e640 1 -- 172.21.15.33:0/2280419194 wait complete. 2024-02-15T22:52:56.724 DEBUG:tasks.fs:max_mds not reduced in epoch 32 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:56.725 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-02-15T22:52:56.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-15T22:52:56.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 -- 172.21.15.33:0/3572756996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fdd30 msgr2=0x7f6e44106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/3572756996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fdd30 0x7f6e44106370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e340048d0 tx=0x7f6e34009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 -- 172.21.15.33:0/3572756996 shutdown_connections 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/3572756996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fdd30 0x7f6e44106370 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/3572756996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e440fd390 0x7f6e440fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 -- 172.21.15.33:0/3572756996 >> 172.21.15.33:0/3572756996 conn(0x7f6e440f6ec0 msgr2=0x7f6e440f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 -- 172.21.15.33:0/3572756996 shutdown_connections 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.836+0000 7f6e49d9d640 1 -- 172.21.15.33:0/3572756996 wait complete. 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e49d9d640 1 Processor -- start 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e49d9d640 1 -- start start 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e49d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fd390 0x7f6e44112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e49d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e440fdd30 0x7f6e44113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e49d9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44113770 con 0x7f6e440fd390 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e49d9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4410cd00 con 0x7f6e440fdd30 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e437fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fd390 0x7f6e44112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e437fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fd390 0x7f6e44112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39774/0 (socket says 172.21.15.33:39774) 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e42ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e440fdd30 0x7f6e44113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e437fe640 1 -- 172.21.15.33:0/2238314609 learned_addr learned my addr 172.21.15.33:0/2238314609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e42ffd640 1 -- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fd390 msgr2=0x7f6e44112c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.837+0000 7f6e42ffd640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fd390 0x7f6e44112c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e42ffd640 1 -- 172.21.15.33:0/2238314609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34005040 con 0x7f6e440fdd30 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e437fe640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fd390 0x7f6e44112c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e42ffd640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e440fdd30 0x7f6e44113170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6e3402bda0 tx=0x7f6e34009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e2bfff640 1 -- 172.21.15.33:0/2238314609 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e340092b0 con 0x7f6e440fdd30 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4410cf80 con 0x7f6e440fdd30 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4410d4a0 con 0x7f6e440fdd30 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e2bfff640 1 -- 172.21.15.33:0/2238314609 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e3403d450 con 0x7f6e440fdd30 2024-02-15T22:52:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.838+0000 7f6e2bfff640 1 -- 172.21.15.33:0/2238314609 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3403b640 con 0x7f6e440fdd30 2024-02-15T22:52:56.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.839+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e30005240 con 0x7f6e440fdd30 2024-02-15T22:52:56.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.840+0000 7f6e2bfff640 1 -- 172.21.15.33:0/2238314609 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6e3402f070 con 0x7f6e440fdd30 2024-02-15T22:52:56.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.840+0000 7f6e2bfff640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e2c06d750 0x7f6e2c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:56.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.840+0000 7f6e2bfff640 1 -- 172.21.15.33:0/2238314609 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6e340ae9e0 con 0x7f6e440fdd30 2024-02-15T22:52:56.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.840+0000 7f6e437fe640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e2c06d750 0x7f6e2c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:56.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.841+0000 7f6e437fe640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e2c06d750 0x7f6e2c06fc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e38007e60 tx=0x7f6e3800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:56.846+0000 7f6e2bfff640 1 -- 172.21.15.33:0/2238314609 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e340782f0 con 0x7f6e440fdd30 2024-02-15T22:52:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.067+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f6e300054f0 con 0x7f6e440fdd30 2024-02-15T22:52:57.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.068+0000 7f6e2bfff640 1 -- 172.21.15.33:0/2238314609 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v42) v1 ==== 107+0+4951 (secure 0 0 0) 0x7f6e3407b9b0 con 0x7f6e440fdd30 2024-02-15T22:52:57.136 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:57.136 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:49:55.970826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 33 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e2c06d750 msgr2=0x7f6e2c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e2c06d750 0x7f6e2c06fc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e38007e60 tx=0x7f6e3800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e440fdd30 msgr2=0x7f6e44113170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e440fdd30 0x7f6e44113170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6e3402bda0 tx=0x7f6e34009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 shutdown_connections 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e440fdd30 0x7f6e44113170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f6e2c06d750 0x7f6e2c06fc00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 --2- 172.21.15.33:0/2238314609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e440fd390 0x7f6e44112c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 >> 172.21.15.33:0/2238314609 conn(0x7f6e440f6ec0 msgr2=0x7f6e44100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 shutdown_connections 2024-02-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.070+0000 7f6e49d9d640 1 -- 172.21.15.33:0/2238314609 wait complete. 2024-02-15T22:52:57.139 DEBUG:tasks.fs:max_mds not reduced in epoch 33 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T22:52:57.139 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-02-15T22:52:57.139 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2399022149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 msgr2=0x7fdb640fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2399022149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb640fb700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb600048d0 tx=0x7fdb60009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2399022149 shutdown_connections 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2399022149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb640fb700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2399022149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb641012d0 0x7fdb641016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2399022149 >> 172.21.15.33:0/2399022149 conn(0x7fdb64071230 msgr2=0x7fdb64071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2399022149 shutdown_connections 2024-02-15T22:52:57.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.238+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2399022149 wait complete. 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb6be6e640 1 Processor -- start 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb6be6e640 1 -- start start 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb6be6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb64112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb6be6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb641012d0 0x7fdb641131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb6be6e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641137b0 con 0x7fdb640fb2b0 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb6be6e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6410cd40 con 0x7fdb641012d0 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69c0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb64112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69c0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb64112c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39780/0 (socket says 172.21.15.33:39780) 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69c0a640 1 -- 172.21.15.33:0/2046328143 learned_addr learned my addr 172.21.15.33:0/2046328143 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69409640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb641012d0 0x7fdb641131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69c0a640 1 -- 172.21.15.33:0/2046328143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb641012d0 msgr2=0x7fdb641131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69c0a640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb641012d0 0x7fdb641131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69c0a640 1 -- 172.21.15.33:0/2046328143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60005040 con 0x7fdb640fb2b0 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.239+0000 7fdb69c0a640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb64112c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800eb70 tx=0x7fdb5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:57.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.240+0000 7fdb567fc640 1 -- 172.21.15.33:0/2046328143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb58007c30 con 0x7fdb640fb2b0 2024-02-15T22:52:57.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.240+0000 7fdb567fc640 1 -- 172.21.15.33:0/2046328143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb5800f040 con 0x7fdb640fb2b0 2024-02-15T22:52:57.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.240+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6410cfc0 con 0x7fdb640fb2b0 2024-02-15T22:52:57.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.240+0000 7fdb567fc640 1 -- 172.21.15.33:0/2046328143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb580095b0 con 0x7fdb640fb2b0 2024-02-15T22:52:57.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.240+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6410d4b0 con 0x7fdb640fb2b0 2024-02-15T22:52:57.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.241+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb64064030 con 0x7fdb640fb2b0 2024-02-15T22:52:57.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.241+0000 7fdb567fc640 1 -- 172.21.15.33:0/2046328143 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdb58009730 con 0x7fdb640fb2b0 2024-02-15T22:52:57.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.242+0000 7fdb567fc640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb5006d750 0x7fdb5006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.242+0000 7fdb567fc640 1 -- 172.21.15.33:0/2046328143 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdb5808cbb0 con 0x7fdb640fb2b0 2024-02-15T22:52:57.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.242+0000 7fdb69409640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb5006d750 0x7fdb5006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.242+0000 7fdb69409640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb5006d750 0x7fdb5006fc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb6410de80 tx=0x7fdb60009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:57.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.246+0000 7fdb567fc640 1 -- 172.21.15.33:0/2046328143 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdb58093080 con 0x7fdb640fb2b0 2024-02-15T22:52:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:56 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2796636024' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T22:52:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:56 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3420839166' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T22:52:57.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:56 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2280419194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T22:52:57.276 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:56 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2796636024' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T22:52:57.276 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:56 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3420839166' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T22:52:57.276 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:56 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2280419194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T22:52:57.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.467+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fdb6410d6d0 con 0x7fdb640fb2b0 2024-02-15T22:52:57.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.468+0000 7fdb567fc640 1 -- 172.21.15.33:0/2046328143 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v42) v1 ==== 107+0+4950 (secure 0 0 0) 0x7fdb580564b0 con 0x7fdb640fb2b0 2024-02-15T22:52:57.470 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:57.470 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:04.734647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:57.470 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 34 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb5006d750 msgr2=0x7fdb5006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb5006d750 0x7fdb5006fc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb6410de80 tx=0x7fdb60009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 msgr2=0x7fdb64112c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb64112c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800eb70 tx=0x7fdb5800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 shutdown_connections 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb641012d0 0x7fdb641131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdb5006d750 0x7fdb5006fc00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 --2- 172.21.15.33:0/2046328143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb640fb2b0 0x7fdb64112c70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 >> 172.21.15.33:0/2046328143 conn(0x7fdb64071230 msgr2=0x7fdb64064560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 shutdown_connections 2024-02-15T22:52:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.470+0000 7fdb6be6e640 1 -- 172.21.15.33:0/2046328143 wait complete. 2024-02-15T22:52:57.482 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-02-15T22:52:57.483 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-15T22:52:57.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.580+0000 7fcc09f9d640 1 -- 172.21.15.33:0/2542196428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 msgr2=0x7fcc040fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.580+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/2542196428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc040fb700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40048d0 tx=0x7fcbf4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.580+0000 7fcc09f9d640 1 -- 172.21.15.33:0/2542196428 shutdown_connections 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.580+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/2542196428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc040fb700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.580+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/2542196428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041012d0 0x7fcc041016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.580+0000 7fcc09f9d640 1 -- 172.21.15.33:0/2542196428 >> 172.21.15.33:0/2542196428 conn(0x7fcc04071230 msgr2=0x7fcc04071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 -- 172.21.15.33:0/2542196428 shutdown_connections 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 -- 172.21.15.33:0/2542196428 wait complete. 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 Processor -- start 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 -- start start 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc0410dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041012d0 0x7fcc0410e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0410e790 con 0x7fcc040fb2b0 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc09f9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0410e900 con 0x7fcc041012d0 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc0410dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc0410dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39802/0 (socket says 172.21.15.33:39802) 2024-02-15T22:52:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.581+0000 7fcc037fe640 1 -- 172.21.15.33:0/1960944632 learned_addr learned my addr 172.21.15.33:0/1960944632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc02ffd640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041012d0 0x7fcc0410e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc037fe640 1 -- 172.21.15.33:0/1960944632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041012d0 msgr2=0x7fcc0410e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc037fe640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041012d0 0x7fcc0410e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc037fe640 1 -- 172.21.15.33:0/1960944632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf4005040 con 0x7fcc040fb2b0 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc02ffd640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041012d0 0x7fcc0410e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc037fe640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc0410dcc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00eb70 tx=0x7fcbec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcbfbfff640 1 -- 172.21.15.33:0/1960944632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbec007c30 con 0x7fcc040fb2b0 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcbfbfff640 1 -- 172.21.15.33:0/1960944632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbec00f040 con 0x7fcc040fb2b0 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc04116d30 con 0x7fcc040fb2b0 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcbfbfff640 1 -- 172.21.15.33:0/1960944632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbec0095b0 con 0x7fcc040fb2b0 2024-02-15T22:52:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.582+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc04117110 con 0x7fcc040fb2b0 2024-02-15T22:52:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.583+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc04064030 con 0x7fcc040fb2b0 2024-02-15T22:52:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.584+0000 7fcbfbfff640 1 -- 172.21.15.33:0/1960944632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fcbec009730 con 0x7fcc040fb2b0 2024-02-15T22:52:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.584+0000 7fcbfbfff640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcbf006d750 0x7fcbf006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.584+0000 7fcbfbfff640 1 -- 172.21.15.33:0/1960944632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcbec08cc30 con 0x7fcc040fb2b0 2024-02-15T22:52:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.584+0000 7fcc02ffd640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcbf006d750 0x7fcbf006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.585+0000 7fcc02ffd640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcbf006d750 0x7fcbf006fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcbf402bda0 tx=0x7fcbf4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:57.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.589+0000 7fcbfbfff640 1 -- 172.21.15.33:0/1960944632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcbec056480 con 0x7fcc040fb2b0 2024-02-15T22:52:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.808+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fcc041173a0 con 0x7fcc040fb2b0 2024-02-15T22:52:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.808+0000 7fcbfbfff640 1 -- 172.21.15.33:0/1960944632 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v42) v1 ==== 107+0+5007 (secure 0 0 0) 0x7fcbec059b40 con 0x7fcc040fb2b0 2024-02-15T22:52:57.810 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:57.811 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:05.735468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:57.811 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 35 2024-02-15T22:52:57.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcbf006d750 msgr2=0x7fcbf006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcbf006d750 0x7fcbf006fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcbf402bda0 tx=0x7fcbf4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 msgr2=0x7fcc0410dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc0410dcc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00eb70 tx=0x7fcbec00b040 comp rx=0 tx=0).stop 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 shutdown_connections 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041012d0 0x7fcc0410e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcbf006d750 0x7fcbf006fc00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 --2- 172.21.15.33:0/1960944632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc040fb2b0 0x7fcc0410dcc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 >> 172.21.15.33:0/1960944632 conn(0x7fcc04071230 msgr2=0x7fcc040fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 shutdown_connections 2024-02-15T22:52:57.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.810+0000 7fcc09f9d640 1 -- 172.21.15.33:0/1960944632 wait complete. 2024-02-15T22:52:57.823 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-02-15T22:52:57.824 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-15T22:52:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.922+0000 7feb3de2e640 1 -- 172.21.15.33:0/3016163267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 msgr2=0x7feb380fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.922+0000 7feb3de2e640 1 --2- 172.21.15.33:0/3016163267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb380fb700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0048d0 tx=0x7feb2c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 -- 172.21.15.33:0/3016163267 shutdown_connections 2024-02-15T22:52:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 --2- 172.21.15.33:0/3016163267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb380fb700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 --2- 172.21.15.33:0/3016163267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb381012d0 0x7feb381016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 -- 172.21.15.33:0/3016163267 >> 172.21.15.33:0/3016163267 conn(0x7feb38071230 msgr2=0x7feb38071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:57.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 -- 172.21.15.33:0/3016163267 shutdown_connections 2024-02-15T22:52:57.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 -- 172.21.15.33:0/3016163267 wait complete. 2024-02-15T22:52:57.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 Processor -- start 2024-02-15T22:52:57.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.923+0000 7feb3de2e640 1 -- start start 2024-02-15T22:52:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb3de2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb3810dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb3de2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb381012d0 0x7feb3810e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb3de2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3810e780 con 0x7feb380fb2b0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb3de2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3810e8c0 con 0x7feb381012d0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb377fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb3810dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb377fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb3810dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39822/0 (socket says 172.21.15.33:39822) 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb377fe640 1 -- 172.21.15.33:0/1319161165 learned_addr learned my addr 172.21.15.33:0/1319161165 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb36ffd640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb381012d0 0x7feb3810e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb377fe640 1 -- 172.21.15.33:0/1319161165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb381012d0 msgr2=0x7feb3810e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb377fe640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb381012d0 0x7feb3810e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb377fe640 1 -- 172.21.15.33:0/1319161165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c005040 con 0x7feb380fb2b0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb377fe640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb3810dd00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb28002a80 tx=0x7feb28004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb1ffff640 1 -- 172.21.15.33:0/1319161165 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb28007c30 con 0x7feb380fb2b0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb38116d70 con 0x7feb380fb2b0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb1ffff640 1 -- 172.21.15.33:0/1319161165 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb2800f040 con 0x7feb380fb2b0 2024-02-15T22:52:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb1ffff640 1 -- 172.21.15.33:0/1319161165 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb280096b0 con 0x7feb380fb2b0 2024-02-15T22:52:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.924+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb38117150 con 0x7feb380fb2b0 2024-02-15T22:52:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.925+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb38064030 con 0x7feb380fb2b0 2024-02-15T22:52:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.926+0000 7feb1ffff640 1 -- 172.21.15.33:0/1319161165 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7feb2800d6b0 con 0x7feb380fb2b0 2024-02-15T22:52:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.926+0000 7feb1ffff640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7feb2006d750 0x7feb2006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.926+0000 7feb1ffff640 1 -- 172.21.15.33:0/1319161165 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7feb2808c850 con 0x7feb380fb2b0 2024-02-15T22:52:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.926+0000 7feb36ffd640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7feb2006d750 0x7feb2006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.927+0000 7feb36ffd640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7feb2006d750 0x7feb2006fc00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb38064d30 tx=0x7feb2c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:57.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:57.931+0000 7feb1ffff640 1 -- 172.21.15.33:0/1319161165 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feb28056150 con 0x7feb380fb2b0 2024-02-15T22:52:58.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.151+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7feb381083a0 con 0x7feb380fb2b0 2024-02-15T22:52:58.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.152+0000 7feb1ffff640 1 -- 172.21.15.33:0/1319161165 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v42) v1 ==== 107+0+5006 (secure 0 0 0) 0x7feb28059810 con 0x7feb380fb2b0 2024-02-15T22:52:58.154 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:58.154 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:05.739686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:58.154 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 36 2024-02-15T22:52:58.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7feb2006d750 msgr2=0x7feb2006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7feb2006d750 0x7feb2006fc00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb38064d30 tx=0x7feb2c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 msgr2=0x7feb3810dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb3810dd00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb28002a80 tx=0x7feb28004600 comp rx=0 tx=0).stop 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 shutdown_connections 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb381012d0 0x7feb3810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7feb2006d750 0x7feb2006fc00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 --2- 172.21.15.33:0/1319161165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380fb2b0 0x7feb3810dd00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 >> 172.21.15.33:0/1319161165 conn(0x7feb38071230 msgr2=0x7feb380fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 shutdown_connections 2024-02-15T22:52:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.154+0000 7feb3de2e640 1 -- 172.21.15.33:0/1319161165 wait complete. 2024-02-15T22:52:58.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:57 smithi033 ceph-mon[113773]: pgmap v263: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:58.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:57 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2238314609' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T22:52:58.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:57 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2046328143' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T22:52:58.166 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:57 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1960944632' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T22:52:58.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-02-15T22:52:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 -- 172.21.15.33:0/1401995843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 msgr2=0x7fcf4c101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/1401995843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c101640 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0048d0 tx=0x7fcf3c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 -- 172.21.15.33:0/1401995843 shutdown_connections 2024-02-15T22:52:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/1401995843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c101c10 0x7fcf4c0fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/1401995843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c101640 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 -- 172.21.15.33:0/1401995843 >> 172.21.15.33:0/1401995843 conn(0x7fcf4c0f6de0 msgr2=0x7fcf4c0f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 -- 172.21.15.33:0/1401995843 shutdown_connections 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 -- 172.21.15.33:0/1401995843 wait complete. 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.264+0000 7fcf53b5d640 1 Processor -- start 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf53b5d640 1 -- start start 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf53b5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c10dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf53b5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c101c10 0x7fcf4c10e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf53b5d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c10e7b0 con 0x7fcf4c101270 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf53b5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c10e920 con 0x7fcf4c101c10 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf518f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c10dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf518f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c10dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39838/0 (socket says 172.21.15.33:39838) 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf518f9640 1 -- 172.21.15.33:0/188200548 learned_addr learned my addr 172.21.15.33:0/188200548 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf510f8640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c101c10 0x7fcf4c10e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf518f9640 1 -- 172.21.15.33:0/188200548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c101c10 msgr2=0x7fcf4c10e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf518f9640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c101c10 0x7fcf4c10e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf518f9640 1 -- 172.21.15.33:0/188200548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c005040 con 0x7fcf4c101270 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf510f8640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c101c10 0x7fcf4c10e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf518f9640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c10dd30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c031720 tx=0x7fcf3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf4a7fc640 1 -- 172.21.15.33:0/188200548 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3c0094c0 con 0x7fcf4c101270 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf4a7fc640 1 -- 172.21.15.33:0/188200548 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf3c009620 con 0x7fcf4c101270 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c10eba0 con 0x7fcf4c101270 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.265+0000 7fcf4a7fc640 1 -- 172.21.15.33:0/188200548 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3c03b640 con 0x7fcf4c101270 2024-02-15T22:52:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.266+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c117080 con 0x7fcf4c101270 2024-02-15T22:52:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.266+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c064480 con 0x7fcf4c101270 2024-02-15T22:52:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.267+0000 7fcf4a7fc640 1 -- 172.21.15.33:0/188200548 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fcf3c02f070 con 0x7fcf4c101270 2024-02-15T22:52:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.267+0000 7fcf4a7fc640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcf3406d750 0x7fcf3406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.267+0000 7fcf4a7fc640 1 -- 172.21.15.33:0/188200548 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcf3c0af180 con 0x7fcf4c101270 2024-02-15T22:52:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.267+0000 7fcf510f8640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcf3406d750 0x7fcf3406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.268+0000 7fcf510f8640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcf3406d750 0x7fcf3406fc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007fd0 tx=0x7fcf40009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:58.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.272+0000 7fcf4a7fc640 1 -- 172.21.15.33:0/188200548 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcf3c078a50 con 0x7fcf4c101270 2024-02-15T22:52:58.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:57 smithi082 ceph-mon[84550]: pgmap v263: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:52:58.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:57 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2238314609' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T22:52:58.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:57 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2046328143' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T22:52:58.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:57 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1960944632' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T22:52:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.491+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fcf4c1083d0 con 0x7fcf4c101270 2024-02-15T22:52:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.492+0000 7fcf4a7fc640 1 -- 172.21.15.33:0/188200548 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v42) v1 ==== 107+0+5008 (secure 0 0 0) 0x7fcf3c07c110 con 0x7fcf4c101270 2024-02-15T22:52:58.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:58.494 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:11.327544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:resolve","state_seq":13,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcf3406d750 msgr2=0x7fcf3406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcf3406d750 0x7fcf3406fc00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007fd0 tx=0x7fcf40009e90 comp rx=0 tx=0).stop 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 msgr2=0x7fcf4c10dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c10dd30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c031720 tx=0x7fcf3c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 shutdown_connections 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c101c10 0x7fcf4c10e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fcf3406d750 0x7fcf3406fc00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 --2- 172.21.15.33:0/188200548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf4c101270 0x7fcf4c10dd30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 >> 172.21.15.33:0/188200548 conn(0x7fcf4c0f6de0 msgr2=0x7fcf4c0f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 shutdown_connections 2024-02-15T22:52:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.494+0000 7fcf53b5d640 1 -- 172.21.15.33:0/188200548 wait complete. 2024-02-15T22:52:58.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-02-15T22:52:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 -- 172.21.15.33:0/2689038660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 msgr2=0x7f583c101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 --2- 172.21.15.33:0/2689038660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c101640 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f582c0048d0 tx=0x7f582c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 -- 172.21.15.33:0/2689038660 shutdown_connections 2024-02-15T22:52:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 --2- 172.21.15.33:0/2689038660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f583c101c10 0x7f583c0fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 --2- 172.21.15.33:0/2689038660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c101640 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 -- 172.21.15.33:0/2689038660 >> 172.21.15.33:0/2689038660 conn(0x7f583c0f6de0 msgr2=0x7f583c0f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 -- 172.21.15.33:0/2689038660 shutdown_connections 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.604+0000 7f584175d640 1 -- 172.21.15.33:0/2689038660 wait complete. 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f584175d640 1 Processor -- start 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f584175d640 1 -- start start 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f584175d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c1020f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f584175d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f583c101c10 0x7f583c102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f584175d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c104090 con 0x7f583c101270 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f584175d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c102b70 con 0x7f583c101c10 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f583affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c1020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f583affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c1020f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39848/0 (socket says 172.21.15.33:39848) 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f583affd640 1 -- 172.21.15.33:0/1182336797 learned_addr learned my addr 172.21.15.33:0/1182336797 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f583affd640 1 -- 172.21.15.33:0/1182336797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f583c101c10 msgr2=0x7f583c102630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f583affd640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f583c101c10 0x7f583c102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f583affd640 1 -- 172.21.15.33:0/1182336797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c005040 con 0x7f583c101270 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.605+0000 7f583affd640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c1020f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f582c031720 tx=0x7f582c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.606+0000 7f58337fe640 1 -- 172.21.15.33:0/1182336797 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c0094c0 con 0x7f583c101270 2024-02-15T22:52:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.606+0000 7f58337fe640 1 -- 172.21.15.33:0/1182336797 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f582c009620 con 0x7f583c101270 2024-02-15T22:52:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.606+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c102dc0 con 0x7f583c101270 2024-02-15T22:52:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.606+0000 7f58337fe640 1 -- 172.21.15.33:0/1182336797 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c03b640 con 0x7f583c101270 2024-02-15T22:52:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.606+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c119290 con 0x7f583c101270 2024-02-15T22:52:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.607+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c064480 con 0x7f583c101270 2024-02-15T22:52:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.607+0000 7f58337fe640 1 -- 172.21.15.33:0/1182336797 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f582c02f070 con 0x7f583c101270 2024-02-15T22:52:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.607+0000 7f58337fe640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f582806d750 0x7f582806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.607+0000 7f58337fe640 1 -- 172.21.15.33:0/1182336797 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f582c0af330 con 0x7f583c101270 2024-02-15T22:52:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.607+0000 7f5833fff640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f582806d750 0x7f582806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.608+0000 7f5833fff640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f582806d750 0x7f582806fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f583c1038e0 tx=0x7f5824009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:58.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.612+0000 7f58337fe640 1 -- 172.21.15.33:0/1182336797 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f582c078c00 con 0x7f583c101270 2024-02-15T22:52:58.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.833+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f583c119500 con 0x7f583c101270 2024-02-15T22:52:58.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.834+0000 7f58337fe640 1 -- 172.21.15.33:0/1182336797 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v42) v1 ==== 107+0+5010 (secure 0 0 0) 0x7f582c07c2c0 con 0x7f583c101270 2024-02-15T22:52:58.837 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:58.837 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:14.212562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:resolve","state_seq":19,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:resolve","state_seq":13,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:58.837 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 38 2024-02-15T22:52:58.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f582806d750 msgr2=0x7f582806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f582806d750 0x7f582806fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f583c1038e0 tx=0x7f5824009c50 comp rx=0 tx=0).stop 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 msgr2=0x7f583c1020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c1020f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f582c031720 tx=0x7f582c009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 shutdown_connections 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f583c101c10 0x7f583c102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f582806d750 0x7f582806fc00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 --2- 172.21.15.33:0/1182336797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f583c101270 0x7f583c1020f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 >> 172.21.15.33:0/1182336797 conn(0x7f583c0f6de0 msgr2=0x7f583c065690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 shutdown_connections 2024-02-15T22:52:58.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.836+0000 7f584175d640 1 -- 172.21.15.33:0/1182336797 wait complete. 2024-02-15T22:52:58.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 -- 172.21.15.33:0/3046390370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 msgr2=0x7fb768102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3046390370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768102740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb764009c50 tx=0x7fb764004d10 comp rx=0 tx=0).stop 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 -- 172.21.15.33:0/3046390370 shutdown_connections 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3046390370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb768102d10 0x7fb7680644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3046390370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768102740 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 -- 172.21.15.33:0/3046390370 >> 172.21.15.33:0/3046390370 conn(0x7fb768071230 msgr2=0x7fb768071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 -- 172.21.15.33:0/3046390370 shutdown_connections 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.949+0000 7fb76f82e640 1 -- 172.21.15.33:0/3046390370 wait complete. 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76f82e640 1 Processor -- start 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76f82e640 1 -- start start 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76f82e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76f82e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb768102d10 0x7fb7681131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76f82e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7681137e0 con 0x7fb768102370 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76f82e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76810cd70 con 0x7fb768102d10 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76d5ca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76d5ca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768112ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39856/0 (socket says 172.21.15.33:39856) 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.950+0000 7fb76d5ca640 1 -- 172.21.15.33:0/3220459386 learned_addr learned my addr 172.21.15.33:0/3220459386 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76cdc9640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb768102d10 0x7fb7681131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76d5ca640 1 -- 172.21.15.33:0/3220459386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb768102d10 msgr2=0x7fb7681131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76d5ca640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb768102d10 0x7fb7681131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76d5ca640 1 -- 172.21.15.33:0/3220459386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640098b0 con 0x7fb768102370 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76cdc9640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb768102d10 0x7fb7681131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76d5ca640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768112ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb764004a30 tx=0x7fb764004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb75dffb640 1 -- 172.21.15.33:0/3220459386 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb76403a070 con 0x7fb768102370 2024-02-15T22:52:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb75dffb640 1 -- 172.21.15.33:0/3220459386 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb764035b20 con 0x7fb768102370 2024-02-15T22:52:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76810cff0 con 0x7fb768102370 2024-02-15T22:52:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb75dffb640 1 -- 172.21.15.33:0/3220459386 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb76403ea70 con 0x7fb768102370 2024-02-15T22:52:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.951+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76810d4b0 con 0x7fb768102370 2024-02-15T22:52:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.952+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb768064030 con 0x7fb768102370 2024-02-15T22:52:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.953+0000 7fb75dffb640 1 -- 172.21.15.33:0/3220459386 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb764032070 con 0x7fb768102370 2024-02-15T22:52:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.953+0000 7fb75dffb640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb75406d750 0x7fb75406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.953+0000 7fb75dffb640 1 -- 172.21.15.33:0/3220459386 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb7640af0f0 con 0x7fb768102370 2024-02-15T22:52:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.953+0000 7fb76cdc9640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb75406d750 0x7fb75406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.953+0000 7fb76cdc9640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb75406d750 0x7fb75406fc00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb76810e560 tx=0x7fb75800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:58.958+0000 7fb75dffb640 1 -- 172.21.15.33:0/3220459386 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb7640789c0 con 0x7fb768102370 2024-02-15T22:52:59.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.181+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fb76810e2a0 con 0x7fb768102370 2024-02-15T22:52:59.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.182+0000 7fb75dffb640 1 -- 172.21.15.33:0/3220459386 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v42) v1 ==== 107+0+5014 (secure 0 0 0) 0x7fb76407c080 con 0x7fb768102370 2024-02-15T22:52:59.184 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:59.184 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:14.587778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:59.185 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb75406d750 msgr2=0x7fb75406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb75406d750 0x7fb75406fc00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb76810e560 tx=0x7fb75800b040 comp rx=0 tx=0).stop 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 msgr2=0x7fb768112ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768112ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb764004a30 tx=0x7fb764004d10 comp rx=0 tx=0).stop 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 shutdown_connections 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb768102d10 0x7fb7681131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fb75406d750 0x7fb75406fc00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 --2- 172.21.15.33:0/3220459386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb768102370 0x7fb768112ca0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 >> 172.21.15.33:0/3220459386 conn(0x7fb768071230 msgr2=0x7fb7680fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 shutdown_connections 2024-02-15T22:52:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.184+0000 7fb76f82e640 1 -- 172.21.15.33:0/3220459386 wait complete. 2024-02-15T22:52:59.196 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:58 smithi033 ceph-mon[113773]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:59.196 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:58 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1319161165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T22:52:59.196 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:58 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/188200548' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T22:52:59.196 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:58 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1182336797' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-15T22:52:59.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-02-15T22:52:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 -- 172.21.15.33:0/995981356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e80fb2b0 msgr2=0x7f73e80fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 --2- 172.21.15.33:0/995981356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e80fb2b0 0x7f73e80fb700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73d40048d0 tx=0x7f73d4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 -- 172.21.15.33:0/995981356 shutdown_connections 2024-02-15T22:52:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 --2- 172.21.15.33:0/995981356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e80fb2b0 0x7f73e80fb700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 --2- 172.21.15.33:0/995981356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e81012d0 0x7f73e81016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 -- 172.21.15.33:0/995981356 >> 172.21.15.33:0/995981356 conn(0x7f73e8071230 msgr2=0x7f73e8071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 -- 172.21.15.33:0/995981356 shutdown_connections 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.295+0000 7f73ef06e640 1 -- 172.21.15.33:0/995981356 wait complete. 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73ef06e640 1 Processor -- start 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73ef06e640 1 -- start start 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73ef06e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e80fb2b0 0x7f73e8114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73ef06e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e81012d0 0x7f73e8115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73ef06e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8115900 con 0x7f73e81012d0 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73ef06e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8115a70 con 0x7f73e80fb2b0 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e81012d0 0x7f73e8115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e81012d0 0x7f73e8115300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39876/0 (socket says 172.21.15.33:39876) 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.296+0000 7f73e7fff640 1 -- 172.21.15.33:0/1813706430 learned_addr learned my addr 172.21.15.33:0/1813706430 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73ece0a640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e80fb2b0 0x7f73e8114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73e7fff640 1 -- 172.21.15.33:0/1813706430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e80fb2b0 msgr2=0x7f73e8114dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73e7fff640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e80fb2b0 0x7f73e8114dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73e7fff640 1 -- 172.21.15.33:0/1813706430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4005040 con 0x7f73e81012d0 2024-02-15T22:52:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73e7fff640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e81012d0 0x7f73e8115300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f73d4031720 tx=0x7f73d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73e57fa640 1 -- 172.21.15.33:0/1813706430 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d40094c0 con 0x7f73e81012d0 2024-02-15T22:52:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e810efe0 con 0x7f73e81012d0 2024-02-15T22:52:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73e57fa640 1 -- 172.21.15.33:0/1813706430 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73d4009620 con 0x7f73e81012d0 2024-02-15T22:52:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73e57fa640 1 -- 172.21.15.33:0/1813706430 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d403b640 con 0x7f73e81012d0 2024-02-15T22:52:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.297+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e810f500 con 0x7f73e81012d0 2024-02-15T22:52:59.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.298+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8064030 con 0x7f73e81012d0 2024-02-15T22:52:59.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.298+0000 7f73e57fa640 1 -- 172.21.15.33:0/1813706430 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f73d402f070 con 0x7f73e81012d0 2024-02-15T22:52:59.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.299+0000 7f73e57fa640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f73d806d750 0x7f73d806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:59.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.299+0000 7f73e57fa640 1 -- 172.21.15.33:0/1813706430 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f73d40af470 con 0x7f73e81012d0 2024-02-15T22:52:59.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.299+0000 7f73ece0a640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f73d806d750 0x7f73d806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:59.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.299+0000 7f73ece0a640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f73d806d750 0x7f73d806fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73dc007fd0 tx=0x7f73dc009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:59.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.303+0000 7f73e57fa640 1 -- 172.21.15.33:0/1813706430 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f73d4078cc0 con 0x7f73e81012d0 2024-02-15T22:52:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:58 smithi082 ceph-mon[84550]: from='mgr.34104 172.21.15.33:0/1597667778' entity='mgr.smithi033.swohxi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:58 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1319161165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T22:52:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:58 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/188200548' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T22:52:59.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:58 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1182336797' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-15T22:52:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.525+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f73e810f690 con 0x7f73e81012d0 2024-02-15T22:52:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.525+0000 7f73e57fa640 1 -- 172.21.15.33:0/1813706430 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v42) v1 ==== 107+0+5008 (secure 0 0 0) 0x7f73d407c380 con 0x7f73e81012d0 2024-02-15T22:52:59.528 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:59.528 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:15.571198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:59.528 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 40 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f73d806d750 msgr2=0x7f73d806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f73d806d750 0x7f73d806fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73dc007fd0 tx=0x7f73dc009e90 comp rx=0 tx=0).stop 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e81012d0 msgr2=0x7f73e8115300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e81012d0 0x7f73e8115300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f73d4031720 tx=0x7f73d4009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 shutdown_connections 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f73d806d750 0x7f73d806fc00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e81012d0 0x7f73e8115300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 --2- 172.21.15.33:0/1813706430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e80fb2b0 0x7f73e8114dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.527+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 >> 172.21.15.33:0/1813706430 conn(0x7f73e8071230 msgr2=0x7f73e80fa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.528+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 shutdown_connections 2024-02-15T22:52:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.528+0000 7f73ef06e640 1 -- 172.21.15.33:0/1813706430 wait complete. 2024-02-15T22:52:59.541 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-02-15T22:52:59.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 -- 172.21.15.33:0/1390338801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 msgr2=0x7f23b8101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/1390338801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b8101640 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f23a80048d0 tx=0x7f23a8009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 -- 172.21.15.33:0/1390338801 shutdown_connections 2024-02-15T22:52:59.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/1390338801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b8101c10 0x7f23b80fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/1390338801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b8101640 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 -- 172.21.15.33:0/1390338801 >> 172.21.15.33:0/1390338801 conn(0x7f23b80f6de0 msgr2=0x7f23b80f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 -- 172.21.15.33:0/1390338801 shutdown_connections 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 -- 172.21.15.33:0/1390338801 wait complete. 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.638+0000 7f23bdb1d640 1 Processor -- start 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23bdb1d640 1 -- start start 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23bdb1d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b810dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23bdb1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b8101c10 0x7f23b810e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23bdb1d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b810e790 con 0x7f23b8101270 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23bdb1d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b810e900 con 0x7f23b8101c10 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b810dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b810dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39894/0 (socket says 172.21.15.33:39894) 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b77fe640 1 -- 172.21.15.33:0/2531132765 learned_addr learned my addr 172.21.15.33:0/2531132765 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:52:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b6ffd640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b8101c10 0x7f23b810e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b77fe640 1 -- 172.21.15.33:0/2531132765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b8101c10 msgr2=0x7f23b810e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b77fe640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b8101c10 0x7f23b810e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b77fe640 1 -- 172.21.15.33:0/2531132765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8005040 con 0x7f23b8101270 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23b77fe640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b810dd10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23a802bda0 tx=0x7f23a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f239ffff640 1 -- 172.21.15.33:0/2531132765 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a80092e0 con 0x7f23b8101270 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b810eb80 con 0x7f23b8101270 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f239ffff640 1 -- 172.21.15.33:0/2531132765 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23a803d450 con 0x7f23b8101270 2024-02-15T22:52:59.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.639+0000 7f239ffff640 1 -- 172.21.15.33:0/2531132765 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a803b640 con 0x7f23b8101270 2024-02-15T22:52:59.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.640+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b8117080 con 0x7f23b8101270 2024-02-15T22:52:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.641+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8064480 con 0x7f23b8101270 2024-02-15T22:52:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.641+0000 7f239ffff640 1 -- 172.21.15.33:0/2531132765 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f23a802f070 con 0x7f23b8101270 2024-02-15T22:52:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.641+0000 7f239ffff640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f23a006d750 0x7f23a006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.641+0000 7f239ffff640 1 -- 172.21.15.33:0/2531132765 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f23a80af160 con 0x7f23b8101270 2024-02-15T22:52:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.641+0000 7f23b6ffd640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f23a006d750 0x7f23a006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.642+0000 7f23b6ffd640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f23a006d750 0x7f23a006fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23b8065f60 tx=0x7f23ac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:59.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.646+0000 7f239ffff640 1 -- 172.21.15.33:0/2531132765 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f23a80789b0 con 0x7f23b8101270 2024-02-15T22:52:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.863+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f23b81083d0 con 0x7f23b8101270 2024-02-15T22:52:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.864+0000 7f239ffff640 1 -- 172.21.15.33:0/2531132765 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v42) v1 ==== 107+0+5008 (secure 0 0 0) 0x7f23a807c070 con 0x7f23b8101270 2024-02-15T22:52:59.867 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:52:59.867 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi082.lvpzpf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6825/90593148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90593148},{"type":"v1","addr":"172.21.15.82:6825","nonce":90593148}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":44327,"name":"cephfs.smithi082.rtwnpu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/4092453555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":4092453555},{"type":"v1","addr":"172.21.15.82:6827","nonce":4092453555}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:38:21.981781+0000","modified":"2024-02-15T22:51:16.735806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34390,"mds_1":34422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34390":{"gid":34390,"name":"cephfs.smithi033.ruqork","rank":0,"incarnation":35,"state":"up:active","state_seq":22,"addr":"172.21.15.33:6827/1667938552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1667938552},{"type":"v1","addr":"172.21.15.33:6827","nonce":1667938552}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34422":{"gid":34422,"name":"cephfs.smithi033.xkdegf","rank":1,"incarnation":35,"state":"up:active","state_seq":16,"addr":"172.21.15.33:6829/3755702590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3755702590},{"type":"v1","addr":"172.21.15.33:6829","nonce":3755702590}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:52:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2024-02-15T22:52:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f23a006d750 msgr2=0x7f23a006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f23a006d750 0x7f23a006fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23b8065f60 tx=0x7f23ac00b040 comp rx=0 tx=0).stop 2024-02-15T22:52:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 msgr2=0x7f23b810dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b810dd10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23a802bda0 tx=0x7f23a8009da0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 shutdown_connections 2024-02-15T22:52:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b8101c10 0x7f23b810e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f23a006d750 0x7f23a006fc00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 --2- 172.21.15.33:0/2531132765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23b8101270 0x7f23b810dd10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 >> 172.21.15.33:0/2531132765 conn(0x7f23b80f6de0 msgr2=0x7f23b80f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 shutdown_connections 2024-02-15T22:52:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:52:59.866+0000 7f23bdb1d640 1 -- 172.21.15.33:0/2531132765 wait complete. 2024-02-15T22:52:59.880 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-15T22:52:59.893 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-15T22:52:59.893 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:52:59.893 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:52:59.910 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T22:52:59.910 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:52:59.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:53:00.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.100+0000 7f3d1e55d640 1 -- 172.21.15.33:0/66638786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 msgr2=0x7f3d18102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.100+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/66638786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d18102660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0048d0 tx=0x7f3d0c009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.100+0000 7f3d1e55d640 1 -- 172.21.15.33:0/66638786 shutdown_connections 2024-02-15T22:53:00.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.100+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/66638786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d18102c30 0x7f3d18064480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.100+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/66638786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d18102660 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.100+0000 7f3d1e55d640 1 -- 172.21.15.33:0/66638786 >> 172.21.15.33:0/66638786 conn(0x7f3d18071290 msgr2=0x7f3d18071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:00.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 -- 172.21.15.33:0/66638786 shutdown_connections 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 -- 172.21.15.33:0/66638786 wait complete. 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 Processor -- start 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 -- start start 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d180fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d18102c30 0x7f3d180fb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180fd2a0 con 0x7f3d18102290 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d1e55d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180fbd80 con 0x7f3d18102c30 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d180fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d180fb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39920/0 (socket says 172.21.15.33:39920) 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.101+0000 7f3d17fff640 1 -- 172.21.15.33:0/835271296 learned_addr learned my addr 172.21.15.33:0/835271296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d177fe640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d18102c30 0x7f3d180fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d17fff640 1 -- 172.21.15.33:0/835271296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d18102c30 msgr2=0x7f3d180fb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d17fff640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d18102c30 0x7f3d180fb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d17fff640 1 -- 172.21.15.33:0/835271296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c005040 con 0x7f3d18102290 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d177fe640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d18102c30 0x7f3d180fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d17fff640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d180fb300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c031720 tx=0x7f3d0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d14ff9640 1 -- 172.21.15.33:0/835271296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0c0094c0 con 0x7f3d18102290 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d14ff9640 1 -- 172.21.15.33:0/835271296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d0c009620 con 0x7f3d18102290 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d180fbfd0 con 0x7f3d18102290 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d14ff9640 1 -- 172.21.15.33:0/835271296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0c03b640 con 0x7f3d18102290 2024-02-15T22:53:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.102+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d181192c0 con 0x7f3d18102290 2024-02-15T22:53:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.103+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d18064030 con 0x7f3d18102290 2024-02-15T22:53:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.104+0000 7f3d14ff9640 1 -- 172.21.15.33:0/835271296 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3d0c02f070 con 0x7f3d18102290 2024-02-15T22:53:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.104+0000 7f3d14ff9640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3d0006d750 0x7f3d0006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.104+0000 7f3d177fe640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3d0006d750 0x7f3d0006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.104+0000 7f3d14ff9640 1 -- 172.21.15.33:0/835271296 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3d0c0af470 con 0x7f3d18102290 2024-02-15T22:53:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.105+0000 7f3d177fe640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3d0006d750 0x7f3d0006fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d180fcaf0 tx=0x7f3d08009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:00.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.109+0000 7f3d14ff9640 1 -- 172.21.15.33:0/835271296 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3d0c078cc0 con 0x7f3d18102290 2024-02-15T22:53:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:59 smithi033 ceph-mon[113773]: pgmap v264: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:53:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:59 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3220459386' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-15T22:53:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:59 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1813706430' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-15T22:53:00.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:52:59 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/2531132765' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-02-15T22:53:00.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.289+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d18109430 con 0x7f3d18102290 2024-02-15T22:53:00.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.290+0000 7f3d14ff9640 1 -- 172.21.15.33:0/835271296 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16497 (secure 0 0 0) 0x7f3d0c07c380 con 0x7f3d18102290 2024-02-15T22:53:00.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:53:00.294 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","created":"2024-02-15T22:31:07.591719+0000","modified":"2024-02-15T22:50:53.437585+0000","last_up_change":"2024-02-15T22:49:53.791562+0000","last_in_change":"2024-02-15T22:36:43.765254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:35:50.180713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:38:20.412479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:38:21.217027+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"630ee5c8-c8e3-4190-878c-82aa86eb7366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6803","nonce":1308222848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6805","nonce":1308222848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6809","nonce":1308222848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6807","nonce":1308222848}]},"public_addr":"172.21.15.33:6803/1308222848","cluster_addr":"172.21.15.33:6805/1308222848","heartbeat_back_addr":"172.21.15.33:6809/1308222848","heartbeat_front_addr":"172.21.15.33:6807/1308222848","state":["exists","up"]},{"osd":1,"uuid":"9edc1e24-0b17-4e9a-ac42-18decf1d9c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6811","nonce":2896162508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6813","nonce":2896162508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6817","nonce":2896162508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6815","nonce":2896162508}]},"public_addr":"172.21.15.33:6811/2896162508","cluster_addr":"172.21.15.33:6813/2896162508","heartbeat_back_addr":"172.21.15.33:6817/2896162508","heartbeat_front_addr":"172.21.15.33:6815/2896162508","state":["exists","up"]},{"osd":2,"uuid":"eaa0a666-819e-4268-a788-e2ab2b12dd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6819","nonce":4236771433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6821","nonce":4236771433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6825","nonce":4236771433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6823","nonce":4236771433}]},"public_addr":"172.21.15.33:6819/4236771433","cluster_addr":"172.21.15.33:6821/4236771433","heartbeat_back_addr":"172.21.15.33:6825/4236771433","heartbeat_front_addr":"172.21.15.33:6823/4236771433","state":["exists","up"]},{"osd":3,"uuid":"111d4225-5978-43c6-8276-87091559a25b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6801","nonce":1385907804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6803","nonce":1385907804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6807","nonce":1385907804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6805","nonce":1385907804}]},"public_addr":"172.21.15.82:6801/1385907804","cluster_addr":"172.21.15.82:6803/1385907804","heartbeat_back_addr":"172.21.15.82:6807/1385907804","heartbeat_front_addr":"172.21.15.82:6805/1385907804","state":["exists","up"]},{"osd":4,"uuid":"6625f0e7-013e-4fab-897d-06ed130d9878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6809","nonce":1062301027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6811","nonce":1062301027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6815","nonce":1062301027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6813","nonce":1062301027}]},"public_addr":"172.21.15.82:6809/1062301027","cluster_addr":"172.21.15.82:6811/1062301027","heartbeat_back_addr":"172.21.15.82:6815/1062301027","heartbeat_front_addr":"172.21.15.82:6813/1062301027","state":["exists","up"]},{"osd":5,"uuid":"6b74c887-f24b-4da2-85fd-5d351fe44045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6817","nonce":1167817460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6819","nonce":1167817460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6823","nonce":1167817460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6821","nonce":1167817460}]},"public_addr":"172.21.15.82:6817/1167817460","cluster_addr":"172.21.15.82:6819/1167817460","heartbeat_back_addr":"172.21.15.82:6823/1167817460","heartbeat_front_addr":"172.21.15.82:6821/1167817460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:34:48.066478+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:16.174578+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:46.001693+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:09.278760+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:34.947739+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:37:01.519872+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6825/998691031":"2024-02-16T22:49:55.970822+0000","172.21.15.82:0/3806231562":"2024-02-16T22:42:30.895464+0000","172.21.15.33:0/4132586080":"2024-02-16T22:40:40.259719+0000","172.21.15.82:0/1010955817":"2024-02-16T22:42:30.895464+0000","172.21.15.33:0/3237183308":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/3583368704":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/547235877":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/1195013908":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6800/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/3460051332":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6827/3373069689":"2024-02-16T22:49:55.970807+0000","172.21.15.33:0/4080754497":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/2241336882":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6800/1523928063":"2024-02-16T22:40:40.259719+0000","172.21.15.33:6801/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.82:6829/144917264":"2024-02-16T22:42:30.895464+0000","172.21.15.82:6824/998691031":"2024-02-16T22:49:55.970822+0000","172.21.15.33:6801/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/735416243":"2024-02-16T22:31:43.072803+0000","172.21.15.82:6828/144917264":"2024-02-16T22:42:30.895464+0000","172.21.15.33:6800/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/771735499":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/275440289":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6800/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/3612339404":"2024-02-16T22:40:40.259719+0000","172.21.15.82:0/1539304932":"2024-02-16T22:42:30.895464+0000","172.21.15.82:0/1026628738":"2024-02-16T22:42:30.895464+0000","172.21.15.33:6801/1523928063":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/245484360":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6800/1221640653":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6801/1221640653":"2024-02-16T22:45:28.041723+0000","172.21.15.33:0/1408628693":"2024-02-16T22:45:28.041723+0000","172.21.15.33:0/4049300209":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6801/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/3396978947":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/1038575526":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6826/3373069689":"2024-02-16T22:49:55.970807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:53:00.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3d0006d750 msgr2=0x7f3d0006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3d0006d750 0x7f3d0006fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d180fcaf0 tx=0x7f3d08009040 comp rx=0 tx=0).stop 2024-02-15T22:53:00.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 msgr2=0x7f3d180fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d180fb300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c031720 tx=0x7f3d0c009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 shutdown_connections 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d18102c30 0x7f3d180fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f3d0006d750 0x7f3d0006fc00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 --2- 172.21.15.33:0/835271296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d18102290 0x7f3d180fb300 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 >> 172.21.15.33:0/835271296 conn(0x7f3d18071290 msgr2=0x7f3d180fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 shutdown_connections 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.292+0000 7f3d1e55d640 1 -- 172.21.15.33:0/835271296 wait complete. 2024-02-15T22:53:00.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:35:50.180713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:38:20.412479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:38:21.217027+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T22:53:00.307 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T22:53:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:59 smithi082 ceph-mon[84550]: pgmap v264: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:53:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:59 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3220459386' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-15T22:53:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:59 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1813706430' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-15T22:53:00.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:52:59 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/2531132765' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-02-15T22:53:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.405+0000 7f7aa8f14640 1 -- 172.21.15.33:0/2913389980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa41023a0 msgr2=0x7f7aa4102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.405+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/2913389980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa41023a0 0x7f7aa4102770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0048d0 tx=0x7f7a9c009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 -- 172.21.15.33:0/2913389980 shutdown_connections 2024-02-15T22:53:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/2913389980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aa4102d40 0x7f7aa40fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/2913389980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa41023a0 0x7f7aa4102770 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 -- 172.21.15.33:0/2913389980 >> 172.21.15.33:0/2913389980 conn(0x7f7aa40f7f90 msgr2=0x7f7aa40fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 -- 172.21.15.33:0/2913389980 shutdown_connections 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 -- 172.21.15.33:0/2913389980 wait complete. 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 Processor -- start 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 -- start start 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aa41023a0 0x7f7aa4112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa4102d40 0x7f7aa4113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4113a50 con 0x7f7aa4102d40 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa8f14640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa410cfe0 con 0x7f7aa41023a0 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.406+0000 7f7aa1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa4102d40 0x7f7aa4113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa4102d40 0x7f7aa4113450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39942/0 (socket says 172.21.15.33:39942) 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa1d9b640 1 -- 172.21.15.33:0/490580092 learned_addr learned my addr 172.21.15.33:0/490580092 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa259c640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aa41023a0 0x7f7aa4112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa1d9b640 1 -- 172.21.15.33:0/490580092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aa41023a0 msgr2=0x7f7aa4112f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa1d9b640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aa41023a0 0x7f7aa4112f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa1d9b640 1 -- 172.21.15.33:0/490580092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c005040 con 0x7f7aa4102d40 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa1d9b640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa4102d40 0x7f7aa4113450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c002a50 tx=0x7f7a8c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7a9affd640 1 -- 172.21.15.33:0/490580092 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c007c30 con 0x7f7aa4102d40 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa410d2c0 con 0x7f7aa4102d40 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7a9affd640 1 -- 172.21.15.33:0/490580092 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a8c00f040 con 0x7f7aa4102d40 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7a9affd640 1 -- 172.21.15.33:0/490580092 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c00db50 con 0x7f7aa4102d40 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.407+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa410d7e0 con 0x7f7aa4102d40 2024-02-15T22:53:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.408+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa4064030 con 0x7f7aa4102d40 2024-02-15T22:53:00.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.409+0000 7f7a9affd640 1 -- 172.21.15.33:0/490580092 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7a8c01c400 con 0x7f7aa4102d40 2024-02-15T22:53:00.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.409+0000 7f7a9affd640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7a9006d750 0x7f7a9006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.409+0000 7f7a9affd640 1 -- 172.21.15.33:0/490580092 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7a8c08c700 con 0x7f7aa4102d40 2024-02-15T22:53:00.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.409+0000 7f7aa259c640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7a9006d750 0x7f7a9006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.409+0000 7f7aa259c640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7a9006d750 0x7f7a9006fc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c000c00 tx=0x7f7a9c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.414+0000 7f7a9affd640 1 -- 172.21.15.33:0/490580092 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7a8c056000 con 0x7f7aa4102d40 2024-02-15T22:53:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.595+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7aa410e510 con 0x7f7aa4102d40 2024-02-15T22:53:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.596+0000 7f7a9affd640 1 -- 172.21.15.33:0/490580092 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a8c0596c0 con 0x7f7aa4102d40 2024-02-15T22:53:00.599 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T22:53:00.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7a9006d750 msgr2=0x7f7a9006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7a9006d750 0x7f7a9006fc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c000c00 tx=0x7f7a9c009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa4102d40 msgr2=0x7f7aa4113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa4102d40 0x7f7aa4113450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c002a50 tx=0x7f7a8c004600 comp rx=0 tx=0).stop 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 shutdown_connections 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f7a9006d750 0x7f7a9006fc00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa4102d40 0x7f7aa4113450 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 --2- 172.21.15.33:0/490580092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aa41023a0 0x7f7aa4112f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 >> 172.21.15.33:0/490580092 conn(0x7f7aa40f7f90 msgr2=0x7f7aa40f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 shutdown_connections 2024-02-15T22:53:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.598+0000 7f7aa8f14640 1 -- 172.21.15.33:0/490580092 wait complete. 2024-02-15T22:53:00.612 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T22:53:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 -- 172.21.15.33:0/2446751892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40fe2f0 msgr2=0x7fdbe40fe6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/2446751892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40fe2f0 0x7fdbe40fe6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40048d0 tx=0x7fdbd4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 -- 172.21.15.33:0/2446751892 shutdown_connections 2024-02-15T22:53:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/2446751892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe40faa70 0x7fdbe40faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/2446751892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40fe2f0 0x7fdbe40fe6c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 -- 172.21.15.33:0/2446751892 >> 172.21.15.33:0/2446751892 conn(0x7fdbe4071950 msgr2=0x7fdbe4071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 -- 172.21.15.33:0/2446751892 shutdown_connections 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 -- 172.21.15.33:0/2446751892 wait complete. 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.710+0000 7fdbea4ae640 1 Processor -- start 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbea4ae640 1 -- start start 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbea4ae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40faa70 0x7fdbe4112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbea4ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe40fe2f0 0x7fdbe4113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbea4ae640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4113780 con 0x7fdbe40faa70 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbea4ae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe410cd10 con 0x7fdbe40fe2f0 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40faa70 0x7fdbe4112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40faa70 0x7fdbe4112c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39960/0 (socket says 172.21.15.33:39960) 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe3fff640 1 -- 172.21.15.33:0/327137383 learned_addr learned my addr 172.21.15.33:0/327137383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe37fe640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe40fe2f0 0x7fdbe4113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe3fff640 1 -- 172.21.15.33:0/327137383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe40fe2f0 msgr2=0x7fdbe4113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe3fff640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe40fe2f0 0x7fdbe4113180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe3fff640 1 -- 172.21.15.33:0/327137383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4005040 con 0x7fdbe40faa70 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe37fe640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe40fe2f0 0x7fdbe4113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.711+0000 7fdbe3fff640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40faa70 0x7fdbe4112c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4031720 tx=0x7fdbd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.712+0000 7fdbe0ff9640 1 -- 172.21.15.33:0/327137383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd40094c0 con 0x7fdbe40faa70 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.712+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe410cf90 con 0x7fdbe40faa70 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.712+0000 7fdbe0ff9640 1 -- 172.21.15.33:0/327137383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbd4009620 con 0x7fdbe40faa70 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.712+0000 7fdbe0ff9640 1 -- 172.21.15.33:0/327137383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd403b640 con 0x7fdbe40faa70 2024-02-15T22:53:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.712+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe410d4b0 con 0x7fdbe40faa70 2024-02-15T22:53:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.713+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe4064480 con 0x7fdbe40faa70 2024-02-15T22:53:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.713+0000 7fdbe0ff9640 1 -- 172.21.15.33:0/327137383 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdbd402f070 con 0x7fdbe40faa70 2024-02-15T22:53:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.713+0000 7fdbe0ff9640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdbcc06d750 0x7fdbcc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.713+0000 7fdbe0ff9640 1 -- 172.21.15.33:0/327137383 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdbd40af320 con 0x7fdbe40faa70 2024-02-15T22:53:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.714+0000 7fdbe37fe640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdbcc06d750 0x7fdbcc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:00.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.714+0000 7fdbe37fe640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdbcc06d750 0x7fdbcc06fc00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009af0 tx=0x7fdbd800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:00.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.718+0000 7fdbe0ff9640 1 -- 172.21.15.33:0/327137383 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdbd4078b70 con 0x7fdbe40faa70 2024-02-15T22:53:00.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.896+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fdbe410d640 con 0x7fdbe40faa70 2024-02-15T22:53:00.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.897+0000 7fdbe0ff9640 1 -- 172.21.15.33:0/327137383 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fdbd407c230 con 0x7fdbe40faa70 2024-02-15T22:53:00.900 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:53:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdbcc06d750 msgr2=0x7fdbcc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdbcc06d750 0x7fdbcc06fc00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009af0 tx=0x7fdbd800b040 comp rx=0 tx=0).stop 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40faa70 msgr2=0x7fdbe4112c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40faa70 0x7fdbe4112c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4031720 tx=0x7fdbd4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 shutdown_connections 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe40fe2f0 0x7fdbe4113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fdbcc06d750 0x7fdbcc06fc00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 --2- 172.21.15.33:0/327137383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe40faa70 0x7fdbe4112c40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 >> 172.21.15.33:0/327137383 conn(0x7fdbe4071950 msgr2=0x7fdbe40f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 shutdown_connections 2024-02-15T22:53:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:00.899+0000 7fdbea4ae640 1 -- 172.21.15.33:0/327137383 wait complete. 2024-02-15T22:53:00.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 -- 172.21.15.33:0/3596729105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac040644b0 msgr2=0x7fac040648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 --2- 172.21.15.33:0/3596729105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac040644b0 0x7fac040648e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fabf40048d0 tx=0x7fabf4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 -- 172.21.15.33:0/3596729105 shutdown_connections 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 --2- 172.21.15.33:0/3596729105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac040644b0 0x7fac040648e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 --2- 172.21.15.33:0/3596729105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac041023e0 0x7fac041027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 -- 172.21.15.33:0/3596729105 >> 172.21.15.33:0/3596729105 conn(0x7fac04071230 msgr2=0x7fac04071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 -- 172.21.15.33:0/3596729105 shutdown_connections 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.011+0000 7fac0a06e640 1 -- 172.21.15.33:0/3596729105 wait complete. 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac0a06e640 1 Processor -- start 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac0a06e640 1 -- start start 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac0a06e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040644b0 0x7fac04112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac0a06e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac041023e0 0x7fac041130e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac0a06e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac041136e0 con 0x7fac041023e0 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac0a06e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0410cc70 con 0x7fac040644b0 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac02ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac041023e0 0x7fac041130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac02ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac041023e0 0x7fac041130e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39978/0 (socket says 172.21.15.33:39978) 2024-02-15T22:53:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac02ffd640 1 -- 172.21.15.33:0/4171575556 learned_addr learned my addr 172.21.15.33:0/4171575556 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:01.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.012+0000 7fac037fe640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040644b0 0x7fac04112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.013+0000 7fac02ffd640 1 -- 172.21.15.33:0/4171575556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040644b0 msgr2=0x7fac04112ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.013+0000 7fac02ffd640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040644b0 0x7fac04112ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.013+0000 7fac02ffd640 1 -- 172.21.15.33:0/4171575556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4005040 con 0x7fac041023e0 2024-02-15T22:53:01.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.013+0000 7fac037fe640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040644b0 0x7fac04112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:53:01.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.013+0000 7fac02ffd640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac041023e0 0x7fac041130e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fabf4031720 tx=0x7fabf4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:01.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.014+0000 7fabfbfff640 1 -- 172.21.15.33:0/4171575556 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabf40094c0 con 0x7fac041023e0 2024-02-15T22:53:01.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.014+0000 7fabfbfff640 1 -- 172.21.15.33:0/4171575556 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabf4009620 con 0x7fac041023e0 2024-02-15T22:53:01.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.014+0000 7fabfbfff640 1 -- 172.21.15.33:0/4171575556 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabf40094c0 con 0x7fac041023e0 2024-02-15T22:53:01.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.016+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0410cef0 con 0x7fac041023e0 2024-02-15T22:53:01.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.017+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0410d3c0 con 0x7fac041023e0 2024-02-15T22:53:01.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.018+0000 7fabfbfff640 1 -- 172.21.15.33:0/4171575556 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fabf402f070 con 0x7fac041023e0 2024-02-15T22:53:01.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.019+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04064030 con 0x7fac041023e0 2024-02-15T22:53:01.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.019+0000 7fabfbfff640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fabf006d810 0x7fabf006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.019+0000 7fabfbfff640 1 -- 172.21.15.33:0/4171575556 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fabf40ae3e0 con 0x7fac041023e0 2024-02-15T22:53:01.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.019+0000 7fac037fe640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fabf006d810 0x7fabf006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.019+0000 7fac037fe640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fabf006d810 0x7fabf006fcc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fabec007fd0 tx=0x7fabec009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:01.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.024+0000 7fabfbfff640 1 -- 172.21.15.33:0/4171575556 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fabf40b3060 con 0x7fac041023e0 2024-02-15T22:53:01.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.202+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fac041094b0 con 0x7fac041023e0 2024-02-15T22:53:01.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.203+0000 7fabfbfff640 1 -- 172.21.15.33:0/4171575556 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fabf4077ba0 con 0x7fac041023e0 2024-02-15T22:53:01.206 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fabf006d810 msgr2=0x7fabf006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fabf006d810 0x7fabf006fcc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fabec007fd0 tx=0x7fabec009e90 comp rx=0 tx=0).stop 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac041023e0 msgr2=0x7fac041130e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac041023e0 0x7fac041130e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fabf4031720 tx=0x7fabf4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 shutdown_connections 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fabf006d810 0x7fabf006fcc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac041023e0 0x7fac041130e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 --2- 172.21.15.33:0/4171575556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040644b0 0x7fac04112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 >> 172.21.15.33:0/4171575556 conn(0x7fac04071230 msgr2=0x7fac040fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 shutdown_connections 2024-02-15T22:53:01.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.205+0000 7fac0a06e640 1 -- 172.21.15.33:0/4171575556 wait complete. 2024-02-15T22:53:01.218 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:00 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/835271296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:53:01.218 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:00 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/490580092' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:53:01.218 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:00 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/327137383' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:53:01.219 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 -- 172.21.15.33:0/2106107327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fdcd0 msgr2=0x7fedfc1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 --2- 172.21.15.33:0/2106107327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fdcd0 0x7fedfc1063a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fedec004900 tx=0x7fedec009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 -- 172.21.15.33:0/2106107327 shutdown_connections 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 --2- 172.21.15.33:0/2106107327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fdcd0 0x7fedfc1063a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 --2- 172.21.15.33:0/2106107327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedfc0fd330 0x7fedfc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 -- 172.21.15.33:0/2106107327 >> 172.21.15.33:0/2106107327 conn(0x7fedfc0f6e10 msgr2=0x7fedfc0f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 -- 172.21.15.33:0/2106107327 shutdown_connections 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.315+0000 7fee0402e640 1 -- 172.21.15.33:0/2106107327 wait complete. 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee0402e640 1 Processor -- start 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee0402e640 1 -- start start 2024-02-15T22:53:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee0402e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fd330 0x7fedfc112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee0402e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedfc0fdcd0 0x7fedfc113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee0402e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc113770 con 0x7fedfc0fd330 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee0402e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc10cd00 con 0x7fedfc0fdcd0 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee01dca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fd330 0x7fedfc112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee01dca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fd330 0x7fedfc112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39996/0 (socket says 172.21.15.33:39996) 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee01dca640 1 -- 172.21.15.33:0/179307722 learned_addr learned my addr 172.21.15.33:0/179307722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee015c9640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedfc0fdcd0 0x7fedfc113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee01dca640 1 -- 172.21.15.33:0/179307722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedfc0fdcd0 msgr2=0x7fedfc113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee01dca640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedfc0fdcd0 0x7fedfc113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee01dca640 1 -- 172.21.15.33:0/179307722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec005040 con 0x7fedfc0fd330 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.316+0000 7fee015c9640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedfc0fdcd0 0x7fedfc113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.317+0000 7fee01dca640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fd330 0x7fedfc112c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fedf8002a50 tx=0x7fedf8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.317+0000 7fedf27fc640 1 -- 172.21.15.33:0/179307722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf8007c30 con 0x7fedfc0fd330 2024-02-15T22:53:01.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.317+0000 7fedf27fc640 1 -- 172.21.15.33:0/179307722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedf800f040 con 0x7fedfc0fd330 2024-02-15T22:53:01.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.317+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc10cfe0 con 0x7fedfc0fd330 2024-02-15T22:53:01.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.317+0000 7fedf27fc640 1 -- 172.21.15.33:0/179307722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf800dbe0 con 0x7fedfc0fd330 2024-02-15T22:53:01.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.317+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc10d500 con 0x7fedfc0fd330 2024-02-15T22:53:01.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.318+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc064480 con 0x7fedfc0fd330 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.318+0000 7fedf27fc640 1 -- 172.21.15.33:0/179307722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fedf800dd40 con 0x7fedfc0fd330 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.319+0000 7fedf27fc640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fede806d750 0x7fede806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.319+0000 7fee015c9640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fede806d750 0x7fede806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.319+0000 7fedf27fc640 1 -- 172.21.15.33:0/179307722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fedf808ced0 con 0x7fedfc0fd330 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.319+0000 7fee015c9640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fede806d750 0x7fede806fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fedec000c00 tx=0x7fedec009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.324+0000 7fedf27fc640 1 -- 172.21.15.33:0/179307722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fedf8056720 con 0x7fedfc0fd330 2024-02-15T22:53:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:00 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/835271296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:53:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:00 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/490580092' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:53:01.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:00 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/327137383' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:53:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.515+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fedfc1094a0 con 0x7fedfc0fd330 2024-02-15T22:53:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.515+0000 7fedf27fc640 1 -- 172.21.15.33:0/179307722 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v85) v1 ==== 81+0+2185 (secure 0 0 0) 0x7fedf8059de0 con 0x7fedfc0fd330 2024-02-15T22:53:01.519 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6825/998691031 2024-02-16T22:49:55.970822+0000 2024-02-15T22:53:01.519 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/3806231562 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:01.519 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4132586080 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:01.519 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/1010955817 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:01.519 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3237183308 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3583368704 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/547235877 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1195013908 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/2250238044 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3460051332 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6827/3373069689 2024-02-16T22:49:55.970807+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4080754497 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2241336882 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1523928063 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/2250238044 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:01.520 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6829/144917264 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6824/998691031 2024-02-16T22:49:55.970822+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/3209613080 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/735416243 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6828/144917264 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/3209613080 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/771735499 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/275440289 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/2457159302 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3612339404 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/1539304932 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/1026628738 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1523928063 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/245484360 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1221640653 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1221640653 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1408628693 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4049300209 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/2457159302 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3396978947 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1038575526 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6826/3373069689 2024-02-16T22:49:55.970807+0000 2024-02-15T22:53:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:listed 37 entries 2024-02-15T22:53:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fede806d750 msgr2=0x7fede806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fede806d750 0x7fede806fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fedec000c00 tx=0x7fedec009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fd330 msgr2=0x7fedfc112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fd330 0x7fedfc112c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fedf8002a50 tx=0x7fedf8004600 comp rx=0 tx=0).stop 2024-02-15T22:53:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 shutdown_connections 2024-02-15T22:53:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedfc0fdcd0 0x7fedfc113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fede806d750 0x7fede806fc00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 --2- 172.21.15.33:0/179307722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedfc0fd330 0x7fedfc112c30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 >> 172.21.15.33:0/179307722 conn(0x7fedfc0f6e10 msgr2=0x7fedfc100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 shutdown_connections 2024-02-15T22:53:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.518+0000 7fee0402e640 1 -- 172.21.15.33:0/179307722 wait complete. 2024-02-15T22:53:01.532 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-15T22:53:01.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:01.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-15T22:53:01.560 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:53:01.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:01.560 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-15T22:53:01.636 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:53:01.636 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:53:01.656 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-02-15T22:53:01.656 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:53:01.715 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:53:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 -- 172.21.15.33:0/1170314016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 msgr2=0x7f816c0fd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1170314016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c0fd890 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8164004900 tx=0x7f8164009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 -- 172.21.15.33:0/1170314016 shutdown_connections 2024-02-15T22:53:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1170314016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f816c0fde60 0x7f816c106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1170314016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c0fd890 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 -- 172.21.15.33:0/1170314016 >> 172.21.15.33:0/1170314016 conn(0x7f816c0f6f40 msgr2=0x7f816c0f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 -- 172.21.15.33:0/1170314016 shutdown_connections 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.811+0000 7f8172e2e640 1 -- 172.21.15.33:0/1170314016 wait complete. 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8172e2e640 1 Processor -- start 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8172e2e640 1 -- start start 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8172e2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c112e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8172e2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f816c0fde60 0x7f816c113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8172e2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c113950 con 0x7f816c0fd4c0 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8172e2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c10cee0 con 0x7f816c0fde60 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8170bca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c112e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8170bca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c112e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40020/0 (socket says 172.21.15.33:40020) 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.812+0000 7f8170bca640 1 -- 172.21.15.33:0/1230486764 learned_addr learned my addr 172.21.15.33:0/1230486764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f816bfff640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f816c0fde60 0x7f816c113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f8170bca640 1 -- 172.21.15.33:0/1230486764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f816c0fde60 msgr2=0x7f816c113350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f8170bca640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f816c0fde60 0x7f816c113350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f8170bca640 1 -- 172.21.15.33:0/1230486764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8164005040 con 0x7f816c0fd4c0 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f8170bca640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c112e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8164000c00 tx=0x7f8164009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f81697fa640 1 -- 172.21.15.33:0/1230486764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81640094c0 con 0x7f816c0fd4c0 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f81697fa640 1 -- 172.21.15.33:0/1230486764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f816403d920 con 0x7f816c0fd4c0 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816c10d160 con 0x7f816c0fd4c0 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f81697fa640 1 -- 172.21.15.33:0/1230486764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816403b940 con 0x7f816c0fd4c0 2024-02-15T22:53:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.813+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c10d680 con 0x7f816c0fd4c0 2024-02-15T22:53:01.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.814+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816c064480 con 0x7f816c0fd4c0 2024-02-15T22:53:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.815+0000 7f81697fa640 1 -- 172.21.15.33:0/1230486764 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f816403da90 con 0x7f816c0fd4c0 2024-02-15T22:53:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.815+0000 7f81697fa640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f815806d750 0x7f815806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.815+0000 7f81697fa640 1 -- 172.21.15.33:0/1230486764 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f81640afb70 con 0x7f816c0fd4c0 2024-02-15T22:53:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.815+0000 7f816bfff640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f815806d750 0x7f815806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.815+0000 7f816bfff640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f815806d750 0x7f815806fc00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f816c10e6d0 tx=0x7f815c004c70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:01.819+0000 7f81697fa640 1 -- 172.21.15.33:0/1230486764 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8164079440 con 0x7f816c0fd4c0 2024-02-15T22:53:02.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.003+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f816c103b60 con 0x7f816c0fd4c0 2024-02-15T22:53:02.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.004+0000 7f81697fa640 1 -- 172.21.15.33:0/1230486764 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16497 (secure 0 0 0) 0x7f816407cb00 con 0x7f816c0fd4c0 2024-02-15T22:53:02.007 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T22:53:02.007 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"cfc49586-cc51-11ee-95ba-87774f69a715","created":"2024-02-15T22:31:07.591719+0000","modified":"2024-02-15T22:50:53.437585+0000","last_up_change":"2024-02-15T22:49:53.791562+0000","last_in_change":"2024-02-15T22:36:43.765254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:35:50.180713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:38:20.412479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:38:21.217027+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"630ee5c8-c8e3-4190-878c-82aa86eb7366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6803","nonce":1308222848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6805","nonce":1308222848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6809","nonce":1308222848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1308222848},{"type":"v1","addr":"172.21.15.33:6807","nonce":1308222848}]},"public_addr":"172.21.15.33:6803/1308222848","cluster_addr":"172.21.15.33:6805/1308222848","heartbeat_back_addr":"172.21.15.33:6809/1308222848","heartbeat_front_addr":"172.21.15.33:6807/1308222848","state":["exists","up"]},{"osd":1,"uuid":"9edc1e24-0b17-4e9a-ac42-18decf1d9c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6811","nonce":2896162508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6813","nonce":2896162508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6817","nonce":2896162508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2896162508},{"type":"v1","addr":"172.21.15.33:6815","nonce":2896162508}]},"public_addr":"172.21.15.33:6811/2896162508","cluster_addr":"172.21.15.33:6813/2896162508","heartbeat_back_addr":"172.21.15.33:6817/2896162508","heartbeat_front_addr":"172.21.15.33:6815/2896162508","state":["exists","up"]},{"osd":2,"uuid":"eaa0a666-819e-4268-a788-e2ab2b12dd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6819","nonce":4236771433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6821","nonce":4236771433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6825","nonce":4236771433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":4236771433},{"type":"v1","addr":"172.21.15.33:6823","nonce":4236771433}]},"public_addr":"172.21.15.33:6819/4236771433","cluster_addr":"172.21.15.33:6821/4236771433","heartbeat_back_addr":"172.21.15.33:6825/4236771433","heartbeat_front_addr":"172.21.15.33:6823/4236771433","state":["exists","up"]},{"osd":3,"uuid":"111d4225-5978-43c6-8276-87091559a25b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6801","nonce":1385907804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6803","nonce":1385907804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6807","nonce":1385907804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1385907804},{"type":"v1","addr":"172.21.15.82:6805","nonce":1385907804}]},"public_addr":"172.21.15.82:6801/1385907804","cluster_addr":"172.21.15.82:6803/1385907804","heartbeat_back_addr":"172.21.15.82:6807/1385907804","heartbeat_front_addr":"172.21.15.82:6805/1385907804","state":["exists","up"]},{"osd":4,"uuid":"6625f0e7-013e-4fab-897d-06ed130d9878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6809","nonce":1062301027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6811","nonce":1062301027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6815","nonce":1062301027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1062301027},{"type":"v1","addr":"172.21.15.82:6813","nonce":1062301027}]},"public_addr":"172.21.15.82:6809/1062301027","cluster_addr":"172.21.15.82:6811/1062301027","heartbeat_back_addr":"172.21.15.82:6815/1062301027","heartbeat_front_addr":"172.21.15.82:6813/1062301027","state":["exists","up"]},{"osd":5,"uuid":"6b74c887-f24b-4da2-85fd-5d351fe44045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6817","nonce":1167817460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6819","nonce":1167817460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6823","nonce":1167817460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1167817460},{"type":"v1","addr":"172.21.15.82:6821","nonce":1167817460}]},"public_addr":"172.21.15.82:6817/1167817460","cluster_addr":"172.21.15.82:6819/1167817460","heartbeat_back_addr":"172.21.15.82:6823/1167817460","heartbeat_front_addr":"172.21.15.82:6821/1167817460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:34:48.066478+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:16.174578+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:35:46.001693+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:09.278760+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:36:34.947739+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:37:01.519872+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6825/998691031":"2024-02-16T22:49:55.970822+0000","172.21.15.82:0/3806231562":"2024-02-16T22:42:30.895464+0000","172.21.15.33:0/4132586080":"2024-02-16T22:40:40.259719+0000","172.21.15.82:0/1010955817":"2024-02-16T22:42:30.895464+0000","172.21.15.33:0/3237183308":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/3583368704":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/547235877":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/1195013908":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6800/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.33:0/3460051332":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6827/3373069689":"2024-02-16T22:49:55.970807+0000","172.21.15.33:0/4080754497":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/2241336882":"2024-02-16T22:32:14.163690+0000","172.21.15.33:6800/1523928063":"2024-02-16T22:40:40.259719+0000","172.21.15.33:6801/2250238044":"2024-02-16T22:31:43.072803+0000","172.21.15.82:6829/144917264":"2024-02-16T22:42:30.895464+0000","172.21.15.82:6824/998691031":"2024-02-16T22:49:55.970822+0000","172.21.15.33:6801/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/735416243":"2024-02-16T22:31:43.072803+0000","172.21.15.82:6828/144917264":"2024-02-16T22:42:30.895464+0000","172.21.15.33:6800/3209613080":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/771735499":"2024-02-16T22:33:31.850820+0000","172.21.15.33:0/275440289":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6800/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/3612339404":"2024-02-16T22:40:40.259719+0000","172.21.15.82:0/1539304932":"2024-02-16T22:42:30.895464+0000","172.21.15.82:0/1026628738":"2024-02-16T22:42:30.895464+0000","172.21.15.33:6801/1523928063":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/245484360":"2024-02-16T22:31:43.072803+0000","172.21.15.33:6800/1221640653":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6801/1221640653":"2024-02-16T22:45:28.041723+0000","172.21.15.33:0/1408628693":"2024-02-16T22:45:28.041723+0000","172.21.15.33:0/4049300209":"2024-02-16T22:45:28.041723+0000","172.21.15.33:6801/2457159302":"2024-02-16T22:32:14.163690+0000","172.21.15.33:0/3396978947":"2024-02-16T22:40:40.259719+0000","172.21.15.33:0/1038575526":"2024-02-16T22:33:31.850820+0000","172.21.15.33:6826/3373069689":"2024-02-16T22:49:55.970807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:53:02.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f815806d750 msgr2=0x7f815806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f815806d750 0x7f815806fc00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f816c10e6d0 tx=0x7f815c004c70 comp rx=0 tx=0).stop 2024-02-15T22:53:02.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 msgr2=0x7f816c112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c112e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8164000c00 tx=0x7f8164009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 shutdown_connections 2024-02-15T22:53:02.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f816c0fde60 0x7f816c113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f815806d750 0x7f815806fc00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 --2- 172.21.15.33:0/1230486764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f816c0fd4c0 0x7f816c112e10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 >> 172.21.15.33:0/1230486764 conn(0x7f816c0f6f40 msgr2=0x7f816c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:02.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 shutdown_connections 2024-02-15T22:53:02.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.006+0000 7f8172e2e640 1 -- 172.21.15.33:0/1230486764 wait complete. 2024-02-15T22:53:02.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:35:50.180713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:38:20.412479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:38:21.217027+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T22:53:02.021 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T22:53:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 -- 172.21.15.33:0/3273351530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c81023a0 msgr2=0x7f33c8102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 --2- 172.21.15.33:0/3273351530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c81023a0 0x7f33c8102770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f33c00048d0 tx=0x7f33c0009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 -- 172.21.15.33:0/3273351530 shutdown_connections 2024-02-15T22:53:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 --2- 172.21.15.33:0/3273351530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c8102d40 0x7f33c80fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 --2- 172.21.15.33:0/3273351530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c81023a0 0x7f33c8102770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 -- 172.21.15.33:0/3273351530 >> 172.21.15.33:0/3273351530 conn(0x7f33c80f7f90 msgr2=0x7f33c80fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 -- 172.21.15.33:0/3273351530 shutdown_connections 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.119+0000 7f33cda2e640 1 -- 172.21.15.33:0/3273351530 wait complete. 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.120+0000 7f33cda2e640 1 Processor -- start 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.120+0000 7f33cda2e640 1 -- start start 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.120+0000 7f33cda2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c81023a0 0x7f33c8115110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.120+0000 7f33cda2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c8102d40 0x7f33c8115650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.120+0000 7f33cda2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8115c50 con 0x7f33c8102d40 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.120+0000 7f33cda2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c810f1e0 con 0x7f33c81023a0 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.120+0000 7f33c67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c8102d40 0x7f33c8115650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33c67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c8102d40 0x7f33c8115650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40036/0 (socket says 172.21.15.33:40036) 2024-02-15T22:53:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33c67fc640 1 -- 172.21.15.33:0/1557975335 learned_addr learned my addr 172.21.15.33:0/1557975335 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33c6ffd640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c81023a0 0x7f33c8115110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33c67fc640 1 -- 172.21.15.33:0/1557975335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c81023a0 msgr2=0x7f33c8115110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33c67fc640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c81023a0 0x7f33c8115110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33c67fc640 1 -- 172.21.15.33:0/1557975335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c0005040 con 0x7f33c8102d40 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33c67fc640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c8102d40 0x7f33c8115650 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c830 tx=0x7f33bc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33af7fe640 1 -- 172.21.15.33:0/1557975335 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33bc00a850 con 0x7f33c8102d40 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33af7fe640 1 -- 172.21.15.33:0/1557975335 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33bc00ae80 con 0x7f33c8102d40 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c810f4c0 con 0x7f33c8102d40 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33af7fe640 1 -- 172.21.15.33:0/1557975335 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33bc012ea0 con 0x7f33c8102d40 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.121+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c810f9e0 con 0x7f33c8102d40 2024-02-15T22:53:02.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.122+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c8064030 con 0x7f33c8102d40 2024-02-15T22:53:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.123+0000 7f33af7fe640 1 -- 172.21.15.33:0/1557975335 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f33bc012400 con 0x7f33c8102d40 2024-02-15T22:53:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.123+0000 7f33af7fe640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f33b006d750 0x7f33b006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.123+0000 7f33af7fe640 1 -- 172.21.15.33:0/1557975335 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f33bc08d090 con 0x7f33c8102d40 2024-02-15T22:53:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.123+0000 7f33c6ffd640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f33b006d750 0x7f33b006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.123+0000 7f33c6ffd640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f33b006d750 0x7f33b006fc00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f33c0000c00 tx=0x7f33c0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.128+0000 7f33af7fe640 1 -- 172.21.15.33:0/1557975335 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f33bc056960 con 0x7f33c8102d40 2024-02-15T22:53:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:01 smithi033 ceph-mon[113773]: pgmap v265: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:01 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/4171575556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:53:02.271 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:01 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/179307722' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T22:53:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.308+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33c8106900 con 0x7f33c8102d40 2024-02-15T22:53:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.308+0000 7f33af7fe640 1 -- 172.21.15.33:0/1557975335 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33c8106900 con 0x7f33c8102d40 2024-02-15T22:53:02.311 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T22:53:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.310+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f33b006d750 msgr2=0x7f33b006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.310+0000 7f33cda2e640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f33b006d750 0x7f33b006fc00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f33c0000c00 tx=0x7f33c0009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.310+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c8102d40 msgr2=0x7f33c8115650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.310+0000 7f33cda2e640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c8102d40 0x7f33c8115650 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c830 tx=0x7f33bc004430 comp rx=0 tx=0).stop 2024-02-15T22:53:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.311+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 shutdown_connections 2024-02-15T22:53:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.311+0000 7f33cda2e640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f33b006d750 0x7f33b006fc00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.311+0000 7f33cda2e640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c8102d40 0x7f33c8115650 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.311+0000 7f33cda2e640 1 --2- 172.21.15.33:0/1557975335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c81023a0 0x7f33c8115110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.311+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 >> 172.21.15.33:0/1557975335 conn(0x7f33c80f7f90 msgr2=0x7f33c806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.311+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 shutdown_connections 2024-02-15T22:53:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.311+0000 7f33cda2e640 1 -- 172.21.15.33:0/1557975335 wait complete. 2024-02-15T22:53:02.325 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T22:53:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:01 smithi082 ceph-mon[84550]: pgmap v265: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:01 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/4171575556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:53:02.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:01 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/179307722' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 -- 172.21.15.33:0/3771923803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101c10 msgr2=0x7f1dcc0fb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/3771923803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101c10 0x7f1dcc0fb2a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1db40048d0 tx=0x7f1db4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 -- 172.21.15.33:0/3771923803 shutdown_connections 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/3771923803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101c10 0x7f1dcc0fb2a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/3771923803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc101270 0x7f1dcc101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 -- 172.21.15.33:0/3771923803 >> 172.21.15.33:0/3771923803 conn(0x7f1dcc0f6e40 msgr2=0x7f1dcc0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 -- 172.21.15.33:0/3771923803 shutdown_connections 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.423+0000 7f1dd0a18640 1 -- 172.21.15.33:0/3771923803 wait complete. 2024-02-15T22:53:02.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dd0a18640 1 Processor -- start 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dd0a18640 1 -- start start 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dd0a18640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101270 0x7f1dcc111af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dd0a18640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc101c10 0x7f1dcc112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dd0a18640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc112630 con 0x7f1dcc101270 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dd0a18640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1127a0 con 0x7f1dcc101c10 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dca59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101270 0x7f1dcc111af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dca59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101270 0x7f1dcc111af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40064/0 (socket says 172.21.15.33:40064) 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dca59c640 1 -- 172.21.15.33:0/797242316 learned_addr learned my addr 172.21.15.33:0/797242316 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dc3fff640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc101c10 0x7f1dcc112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dca59c640 1 -- 172.21.15.33:0/797242316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc101c10 msgr2=0x7f1dcc112030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dca59c640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc101c10 0x7f1dcc112030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dca59c640 1 -- 172.21.15.33:0/797242316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4005040 con 0x7f1dcc101270 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.424+0000 7f1dca59c640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101270 0x7f1dcc111af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00c830 tx=0x7f1dbc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.425+0000 7f1dc2ffd640 1 -- 172.21.15.33:0/797242316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dbc00a850 con 0x7f1dcc101270 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.425+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc10bd70 con 0x7f1dcc101270 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.425+0000 7f1dc2ffd640 1 -- 172.21.15.33:0/797242316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1dbc00ae80 con 0x7f1dcc101270 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.425+0000 7f1dc2ffd640 1 -- 172.21.15.33:0/797242316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dbc012ea0 con 0x7f1dcc101270 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.425+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc10c290 con 0x7f1dcc101270 2024-02-15T22:53:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.426+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc064480 con 0x7f1dcc101270 2024-02-15T22:53:02.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.426+0000 7f1dc2ffd640 1 -- 172.21.15.33:0/797242316 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1dbc012400 con 0x7f1dcc101270 2024-02-15T22:53:02.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.426+0000 7f1dc2ffd640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1db806d750 0x7f1db806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.427+0000 7f1dc2ffd640 1 -- 172.21.15.33:0/797242316 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1dbc08d140 con 0x7f1dcc101270 2024-02-15T22:53:02.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.427+0000 7f1dc3fff640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1db806d750 0x7f1db806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.427+0000 7f1dc3fff640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1db806d750 0x7f1db806fc00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc10d3f0 tx=0x7f1db4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:02.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.431+0000 7f1dc2ffd640 1 -- 172.21.15.33:0/797242316 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1dbc056a10 con 0x7f1dcc101270 2024-02-15T22:53:02.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.609+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1dcc1083b0 con 0x7f1dcc101270 2024-02-15T22:53:02.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.610+0000 7f1dc2ffd640 1 -- 172.21.15.33:0/797242316 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1dbc0126b0 con 0x7f1dcc101270 2024-02-15T22:53:02.613 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:53:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1db806d750 msgr2=0x7f1db806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1db806d750 0x7f1db806fc00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc10d3f0 tx=0x7f1db4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101270 msgr2=0x7f1dcc111af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101270 0x7f1dcc111af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00c830 tx=0x7f1dbc004430 comp rx=0 tx=0).stop 2024-02-15T22:53:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 shutdown_connections 2024-02-15T22:53:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc101c10 0x7f1dcc112030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7f1db806d750 0x7f1db806fc00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 --2- 172.21.15.33:0/797242316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dcc101270 0x7f1dcc111af0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 >> 172.21.15.33:0/797242316 conn(0x7f1dcc0f6e40 msgr2=0x7f1dcc0f88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 shutdown_connections 2024-02-15T22:53:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.612+0000 7f1dd0a18640 1 -- 172.21.15.33:0/797242316 wait complete. 2024-02-15T22:53:02.626 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T22:53:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 -- 172.21.15.33:0/397265102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 msgr2=0x7faea406fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 --2- 172.21.15.33:0/397265102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea406fb90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae940048d0 tx=0x7fae94009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 -- 172.21.15.33:0/397265102 shutdown_connections 2024-02-15T22:53:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 --2- 172.21.15.33:0/397265102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea40700d0 0x7faea4108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 --2- 172.21.15.33:0/397265102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea406fb90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 -- 172.21.15.33:0/397265102 >> 172.21.15.33:0/397265102 conn(0x7faea40f7ef0 msgr2=0x7faea40fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:02.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 -- 172.21.15.33:0/397265102 shutdown_connections 2024-02-15T22:53:02.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 -- 172.21.15.33:0/397265102 wait complete. 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.724+0000 7faeaa75d640 1 Processor -- start 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faeaa75d640 1 -- start start 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faeaa75d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea4114e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faeaa75d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea40700d0 0x7faea4115370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faeaa75d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea4115970 con 0x7faea406f7c0 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faeaa75d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea410ef00 con 0x7faea40700d0 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea4114e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea4114e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40074/0 (socket says 172.21.15.33:40074) 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea3fff640 1 -- 172.21.15.33:0/3685511869 learned_addr learned my addr 172.21.15.33:0/3685511869 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea37fe640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea40700d0 0x7faea4115370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea3fff640 1 -- 172.21.15.33:0/3685511869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea40700d0 msgr2=0x7faea4115370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea3fff640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea40700d0 0x7faea4115370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea3fff640 1 -- 172.21.15.33:0/3685511869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94005040 con 0x7faea406f7c0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea3fff640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea4114e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae94031720 tx=0x7fae94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea0ff9640 1 -- 172.21.15.33:0/3685511869 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae940094c0 con 0x7faea406f7c0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea410f180 con 0x7faea406f7c0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.725+0000 7faea0ff9640 1 -- 172.21.15.33:0/3685511869 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae94009620 con 0x7faea406f7c0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.726+0000 7faea0ff9640 1 -- 172.21.15.33:0/3685511869 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9403b640 con 0x7faea406f7c0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.726+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea410f6a0 con 0x7faea406f7c0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.727+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea4064480 con 0x7faea406f7c0 2024-02-15T22:53:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.727+0000 7faea0ff9640 1 -- 172.21.15.33:0/3685511869 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fae9402f070 con 0x7faea406f7c0 2024-02-15T22:53:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.727+0000 7faea0ff9640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fae8c06d750 0x7fae8c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.727+0000 7faea0ff9640 1 -- 172.21.15.33:0/3685511869 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fae940af320 con 0x7faea406f7c0 2024-02-15T22:53:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.727+0000 7faea37fe640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fae8c06d750 0x7fae8c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.728+0000 7faea37fe640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fae8c06d750 0x7fae8c06fc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faea41106f0 tx=0x7fae9800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.732+0000 7faea0ff9640 1 -- 172.21.15.33:0/3685511869 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fae94078b70 con 0x7faea406f7c0 2024-02-15T22:53:02.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.911+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7faea4110430 con 0x7faea406f7c0 2024-02-15T22:53:02.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.912+0000 7faea0ff9640 1 -- 172.21.15.33:0/3685511869 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fae9407c230 con 0x7faea406f7c0 2024-02-15T22:53:02.915 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fae8c06d750 msgr2=0x7fae8c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fae8c06d750 0x7fae8c06fc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faea41106f0 tx=0x7fae9800b040 comp rx=0 tx=0).stop 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 msgr2=0x7faea4114e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea4114e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae94031720 tx=0x7fae94009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 shutdown_connections 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea40700d0 0x7faea4115370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fae8c06d750 0x7fae8c06fc00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 --2- 172.21.15.33:0/3685511869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea406f7c0 0x7faea4114e30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:02.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.913+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 >> 172.21.15.33:0/3685511869 conn(0x7faea40f7ef0 msgr2=0x7faea4102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:02.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.914+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 shutdown_connections 2024-02-15T22:53:02.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:02.914+0000 7faeaa75d640 1 -- 172.21.15.33:0/3685511869 wait complete. 2024-02-15T22:53:02.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.023+0000 7fd4c135d640 1 -- 172.21.15.33:0/696957668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101270 msgr2=0x7fd4bc101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.023+0000 7fd4c135d640 1 --2- 172.21.15.33:0/696957668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101270 0x7fd4bc101640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40048d0 tx=0x7fd4b4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 -- 172.21.15.33:0/696957668 shutdown_connections 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 --2- 172.21.15.33:0/696957668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4bc101c10 0x7fd4bc0fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 --2- 172.21.15.33:0/696957668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101270 0x7fd4bc101640 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 -- 172.21.15.33:0/696957668 >> 172.21.15.33:0/696957668 conn(0x7fd4bc0f6e40 msgr2=0x7fd4bc0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 -- 172.21.15.33:0/696957668 shutdown_connections 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 -- 172.21.15.33:0/696957668 wait complete. 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 Processor -- start 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 -- start start 2024-02-15T22:53:03.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4bc101270 0x7fd4bc10dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101c10 0x7fd4bc10e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc10e750 con 0x7fd4bc101c10 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.024+0000 7fd4c135d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc10e8c0 con 0x7fd4bc101270 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4ba7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101c10 0x7fd4bc10e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4ba7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101c10 0x7fd4bc10e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40080/0 (socket says 172.21.15.33:40080) 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4ba7fc640 1 -- 172.21.15.33:0/3665678340 learned_addr learned my addr 172.21.15.33:0/3665678340 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4baffd640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4bc101270 0x7fd4bc10dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4ba7fc640 1 -- 172.21.15.33:0/3665678340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4bc101270 msgr2=0x7fd4bc10dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4ba7fc640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4bc101270 0x7fd4bc10dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4ba7fc640 1 -- 172.21.15.33:0/3665678340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4005040 con 0x7fd4bc101c10 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4ba7fc640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101c10 0x7fd4bc10e210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000eb70 tx=0x7fd4b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4a37fe640 1 -- 172.21.15.33:0/3665678340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b0007c30 con 0x7fd4bc101c10 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4a37fe640 1 -- 172.21.15.33:0/3665678340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4b000f040 con 0x7fd4bc101c10 2024-02-15T22:53:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4a37fe640 1 -- 172.21.15.33:0/3665678340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b00095b0 con 0x7fd4bc101c10 2024-02-15T22:53:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc10eb40 con 0x7fd4bc101c10 2024-02-15T22:53:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.025+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc117020 con 0x7fd4bc101c10 2024-02-15T22:53:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.026+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc064480 con 0x7fd4bc101c10 2024-02-15T22:53:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.027+0000 7fd4a37fe640 1 -- 172.21.15.33:0/3665678340 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd4b0009730 con 0x7fd4bc101c10 2024-02-15T22:53:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.027+0000 7fd4a37fe640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd4a406d750 0x7fd4a406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.027+0000 7fd4a37fe640 1 -- 172.21.15.33:0/3665678340 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd4b008cac0 con 0x7fd4bc101c10 2024-02-15T22:53:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.027+0000 7fd4baffd640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd4a406d750 0x7fd4a406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.028+0000 7fd4baffd640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd4a406d750 0x7fd4a406fc00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4004540 tx=0x7fd4b4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:03.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.032+0000 7fd4a37fe640 1 -- 172.21.15.33:0/3665678340 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd4b0056310 con 0x7fd4bc101c10 2024-02-15T22:53:03.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.225+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd4bc065c80 con 0x7fd4bc101c10 2024-02-15T22:53:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.226+0000 7fd4a37fe640 1 -- 172.21.15.33:0/3665678340 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v85) v1 ==== 81+0+2185 (secure 0 0 0) 0x7fd4b00599d0 con 0x7fd4bc101c10 2024-02-15T22:53:03.229 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6825/998691031 2024-02-16T22:49:55.970822+0000 2024-02-15T22:53:03.229 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/3806231562 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:03.229 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4132586080 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:03.229 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/1010955817 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:03.229 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3237183308 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3583368704 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/547235877 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1195013908 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/2250238044 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3460051332 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6827/3373069689 2024-02-16T22:49:55.970807+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4080754497 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2241336882 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1523928063 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/2250238044 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6829/144917264 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6824/998691031 2024-02-16T22:49:55.970822+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/3209613080 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:03.230 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/735416243 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:6828/144917264 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/3209613080 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/771735499 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/275440289 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/2457159302 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3612339404 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/1539304932 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.82:0/1026628738 2024-02-16T22:42:30.895464+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1523928063 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/245484360 2024-02-16T22:31:43.072803+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1221640653 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1221640653 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1408628693 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4049300209 2024-02-16T22:45:28.041723+0000 2024-02-15T22:53:03.231 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/2457159302 2024-02-16T22:32:14.163690+0000 2024-02-15T22:53:03.232 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3396978947 2024-02-16T22:40:40.259719+0000 2024-02-15T22:53:03.232 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1038575526 2024-02-16T22:33:31.850820+0000 2024-02-15T22:53:03.232 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6826/3373069689 2024-02-16T22:49:55.970807+0000 2024-02-15T22:53:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:listed 37 entries 2024-02-15T22:53:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd4a406d750 msgr2=0x7fd4a406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd4a406d750 0x7fd4a406fc00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4004540 tx=0x7fd4b4009da0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101c10 msgr2=0x7fd4bc10e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101c10 0x7fd4bc10e210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000eb70 tx=0x7fd4b000b040 comp rx=0 tx=0).stop 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 shutdown_connections 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:6800/1318935367,v1:172.21.15.33:6801/1318935367] conn(0x7fd4a406d750 0x7fd4a406fc00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4bc101c10 0x7fd4bc10e210 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 --2- 172.21.15.33:0/3665678340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4bc101270 0x7fd4bc10dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.227+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 >> 172.21.15.33:0/3665678340 conn(0x7fd4bc0f6e40 msgr2=0x7fd4bc0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.228+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 shutdown_connections 2024-02-15T22:53:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T22:53:03.228+0000 7fd4c135d640 1 -- 172.21.15.33:0/3665678340 wait complete. 2024-02-15T22:53:03.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:02 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1230486764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:53:03.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:02 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/1557975335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:53:03.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:02 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/797242316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:53:03.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:02 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3685511869' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:53:03.242 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-15T22:53:03.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-15T22:53:03.272 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:02 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1230486764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:53:03.272 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:02 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/1557975335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:53:03.272 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:02 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/797242316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:53:03.272 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:02 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3685511869' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:53:03.278 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-02-15T22:53:03.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.279 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-15T22:53:03.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.349 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-02-15T22:53:03.364 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-15T22:53:03.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.365 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T22:53:03.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-02-15T22:53:03.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.526 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-02-15T22:53:03.544 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-15T22:53:03.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T22:53:03.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:53:03.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-02-15T22:53:03.718 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-15T22:53:03.734 INFO:tasks.cephadm:Teardown begin 2024-02-15T22:53:03.735 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:53:03.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:53:03.792 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-15T22:53:03.792 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T22:53:03.817 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T22:53:03.847 INFO:tasks.cephadm:Stopping all daemons... 2024-02-15T22:53:03.847 INFO:tasks.cephadm.mon.smithi033:Stopping mon.smithi033... 2024-02-15T22:53:03.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T22:53:04.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:03 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:04.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:03 smithi033 ceph-mon[113773]: pgmap v266: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:53:04.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:03 smithi033 ceph-mon[113773]: from='client.? 172.21.15.33:0/3665678340' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T22:53:04.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:03 smithi082 ceph-mon[84550]: pgmap v266: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:53:04.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:03 smithi082 ceph-mon[84550]: from='client.? 172.21.15.33:0/3665678340' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T22:53:04.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:04 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:53:04.181+0000 7ff152648700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:04.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:04 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033[113769]: 2024-02-15T22:53:04.181+0000 7ff152648700 -1 mon.smithi033@0(leader) e3 *** Got Signal Terminated *** 2024-02-15T22:53:04.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:04 smithi033 podman[154724]: 2024-02-15 22:53:04.32479709 +0000 UTC m=+0.282243246 container died d82c29a70480c4a45083358c69c6eea6c559eb46f4d75600b80e1d0397c81139 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-15T22:53:05.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:04 smithi033 podman[154724]: 2024-02-15 22:53:04.799935988 +0000 UTC m=+0.757382180 container cleanup d82c29a70480c4a45083358c69c6eea6c559eb46f4d75600b80e1d0397c81139 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-15T22:53:05.021 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 22:53:04 smithi033 bash[154724]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi033 2024-02-15T22:53:05.245 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi033.service' 2024-02-15T22:53:05.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:05.305 INFO:tasks.cephadm.mon.smithi033:Stopped mon.smithi033 2024-02-15T22:53:05.305 INFO:tasks.cephadm.mon.smithi082:Stopping mon.smithi082... 2024-02-15T22:53:05.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi082 2024-02-15T22:53:05.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:05 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:05.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:05 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082[84546]: 2024-02-15T22:53:05.617+0000 7f7cbc9b5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:05.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:05 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082[84546]: 2024-02-15T22:53:05.617+0000 7f7cbc9b5700 -1 mon.smithi082@1(peon) e3 *** Got Signal Terminated *** 2024-02-15T22:53:06.186 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:05 smithi082 podman[117139]: 2024-02-15 22:53:05.881917 +0000 UTC m=+0.378171297 container died be308726497538eca46c3d27d82f30b6de18b29251d30b61c43b318cea00738b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-15T22:53:06.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:06 smithi082 podman[117139]: 2024-02-15 22:53:06.392861184 +0000 UTC m=+0.889115493 container cleanup be308726497538eca46c3d27d82f30b6de18b29251d30b61c43b318cea00738b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-15T22:53:06.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Feb 15 22:53:06 smithi082 bash[117139]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-mon-smithi082 2024-02-15T22:53:06.761 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@mon.smithi082.service' 2024-02-15T22:53:06.813 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:06.813 INFO:tasks.cephadm.mon.smithi082:Stopped mon.smithi082 2024-02-15T22:53:06.813 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-15T22:53:06.814 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.0 2024-02-15T22:53:07.132 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:06 smithi033 systemd[1]: Stopping Ceph osd.0 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:07.521 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:07 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[124831]: 2024-02-15T22:53:07.129+0000 7fb01861d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:07.522 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:07 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[124831]: 2024-02-15T22:53:07.129+0000 7fb01861d700 -1 osd.0 85 *** Got signal Terminated *** 2024-02-15T22:53:07.522 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:07 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0[124831]: 2024-02-15T22:53:07.129+0000 7fb01861d700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:53:12.917 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:12 smithi033 podman[154944]: 2024-02-15 22:53:12.61905329 +0000 UTC m=+5.613762631 container died d58846c70ee17180534cb82e58643961f3a20bb30c83c59a8752f26f4a9a677d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-02-15T22:53:13.271 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:13 smithi033 podman[154944]: 2024-02-15 22:53:13.097015977 +0000 UTC m=+6.091725360 container cleanup d58846c70ee17180534cb82e58643961f3a20bb30c83c59a8752f26f4a9a677d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-15T22:53:13.271 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:13 smithi033 bash[154944]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0 2024-02-15T22:53:13.715 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:13 smithi033 podman[154963]: 2024-02-15 22:53:13.373629377 +0000 UTC m=+0.744431545 container remove d58846c70ee17180534cb82e58643961f3a20bb30c83c59a8752f26f4a9a677d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-02-15T22:53:14.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:13 smithi033 podman[155054]: 2024-02-15 22:53:13.617429275 +0000 UTC m=+0.018498058 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:53:14.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:13 smithi033 podman[155054]: 2024-02-15 22:53:13.716263494 +0000 UTC m=+0.117332268 container create 8e4abfb329ecc0e4f78e5ec9308e07441544797386517f67a3ef26243cd1ff65 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-15T22:53:14.021 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:13 smithi033 podman[155054]: 2024-02-15 22:53:13.944170965 +0000 UTC m=+0.345239741 container init 8e4abfb329ecc0e4f78e5ec9308e07441544797386517f67a3ef26243cd1ff65 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:53:14.022 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:13 smithi033 podman[155054]: 2024-02-15 22:53:13.947411135 +0000 UTC m=+0.348479919 container start 8e4abfb329ecc0e4f78e5ec9308e07441544797386517f67a3ef26243cd1ff65 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214) 2024-02-15T22:53:14.278 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:14 smithi033 podman[155054]: 2024-02-15 22:53:14.044057136 +0000 UTC m=+0.445125923 container attach 8e4abfb329ecc0e4f78e5ec9308e07441544797386517f67a3ef26243cd1ff65 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0) 2024-02-15T22:53:14.278 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 22:53:14 smithi033 podman[155054]: 2024-02-15 22:53:14.247094202 +0000 UTC m=+0.648162978 container died 8e4abfb329ecc0e4f78e5ec9308e07441544797386517f67a3ef26243cd1ff65 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-15T22:53:14.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.0.service' 2024-02-15T22:53:14.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:14.977 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-15T22:53:14.977 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-15T22:53:14.977 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.1 2024-02-15T22:53:15.271 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:15 smithi033 systemd[1]: Stopping Ceph osd.1 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:15.771 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:15 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[130804]: 2024-02-15T22:53:15.317+0000 7f21f1d19700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:15.772 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:15 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[130804]: 2024-02-15T22:53:15.317+0000 7f21f1d19700 -1 osd.1 85 *** Got signal Terminated *** 2024-02-15T22:53:15.772 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:15 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1[130804]: 2024-02-15T22:53:15.317+0000 7f21f1d19700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:53:21.147 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:20 smithi033 podman[155169]: 2024-02-15 22:53:20.869985013 +0000 UTC m=+5.660791901 container died ac3899b733367fdb10e70546562288e960e2638010297e60320f590b8934c24d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-15T22:53:21.497 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:21 smithi033 podman[155169]: 2024-02-15 22:53:21.243968795 +0000 UTC m=+6.034775682 container cleanup ac3899b733367fdb10e70546562288e960e2638010297e60320f590b8934c24d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:53:21.497 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:21 smithi033 bash[155169]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1 2024-02-15T22:53:21.771 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:21 smithi033 podman[155188]: 2024-02-15 22:53:21.495359276 +0000 UTC m=+0.622580106 container remove ac3899b733367fdb10e70546562288e960e2638010297e60320f590b8934c24d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:53:22.184 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:21 smithi033 podman[155278]: 2024-02-15 22:53:21.762577072 +0000 UTC m=+0.018304131 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:53:22.184 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:21 smithi033 podman[155278]: 2024-02-15 22:53:21.87967022 +0000 UTC m=+0.135397329 container create 999352b8b256821e91c530af1483871c287f8199b7270c33294551b37bdfc1db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:53:22.184 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:22 smithi033 podman[155278]: 2024-02-15 22:53:22.090661104 +0000 UTC m=+0.346388164 container init 999352b8b256821e91c530af1483871c287f8199b7270c33294551b37bdfc1db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:53:22.184 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:22 smithi033 podman[155278]: 2024-02-15 22:53:22.093837382 +0000 UTC m=+0.349564445 container start 999352b8b256821e91c530af1483871c287f8199b7270c33294551b37bdfc1db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:53:22.184 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:22 smithi033 podman[155278]: 2024-02-15 22:53:22.18225595 +0000 UTC m=+0.437983018 container attach 999352b8b256821e91c530af1483871c287f8199b7270c33294551b37bdfc1db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-15T22:53:22.521 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 22:53:22 smithi033 podman[155278]: 2024-02-15 22:53:22.393930916 +0000 UTC m=+0.649657974 container died 999352b8b256821e91c530af1483871c287f8199b7270c33294551b37bdfc1db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:53:22.957 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.1.service' 2024-02-15T22:53:22.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:22.998 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-15T22:53:22.998 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-15T22:53:22.998 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.2 2024-02-15T22:53:23.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:23 smithi033 systemd[1]: Stopping Ceph osd.2 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:23.771 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:23 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[136508]: 2024-02-15T22:53:23.356+0000 7fa0fefa7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:23.771 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:23 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[136508]: 2024-02-15T22:53:23.356+0000 7fa0fefa7700 -1 osd.2 85 *** Got signal Terminated *** 2024-02-15T22:53:23.772 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:23 smithi033 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2[136508]: 2024-02-15T22:53:23.356+0000 7fa0fefa7700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:53:29.234 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:28 smithi033 podman[155383]: 2024-02-15 22:53:28.835736908 +0000 UTC m=+5.611712137 container died dfdcfe354b41caaaeff2f130c4ea7f49651e600d2198a2179922f6d6886ece01 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5) 2024-02-15T22:53:29.521 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:29 smithi033 podman[155383]: 2024-02-15 22:53:29.331237154 +0000 UTC m=+6.107212369 container cleanup dfdcfe354b41caaaeff2f130c4ea7f49651e600d2198a2179922f6d6886ece01 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-15T22:53:29.521 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:29 smithi033 bash[155383]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2 2024-02-15T22:53:29.956 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:29 smithi033 podman[155413]: 2024-02-15 22:53:29.599644119 +0000 UTC m=+0.762391229 container remove dfdcfe354b41caaaeff2f130c4ea7f49651e600d2198a2179922f6d6886ece01 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-15T22:53:30.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:29 smithi033 podman[155502]: 2024-02-15 22:53:29.857480868 +0000 UTC m=+0.018265167 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:53:30.271 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:29 smithi033 podman[155502]: 2024-02-15 22:53:29.975595468 +0000 UTC m=+0.136379808 container create e4a8326810341f2eebcc58f4a9afbb8df5685444bcc04a0f5430129e3173d909 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-02-15T22:53:30.272 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:30 smithi033 podman[155502]: 2024-02-15 22:53:30.194934322 +0000 UTC m=+0.355718621 container init e4a8326810341f2eebcc58f4a9afbb8df5685444bcc04a0f5430129e3173d909 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-15T22:53:30.272 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:30 smithi033 podman[155502]: 2024-02-15 22:53:30.198097387 +0000 UTC m=+0.358881688 container start e4a8326810341f2eebcc58f4a9afbb8df5685444bcc04a0f5430129e3173d909 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:53:30.272 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:30 smithi033 podman[155502]: 2024-02-15 22:53:30.269806739 +0000 UTC m=+0.430591056 container attach e4a8326810341f2eebcc58f4a9afbb8df5685444bcc04a0f5430129e3173d909 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:53:30.521 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 22:53:30 smithi033 podman[155502]: 2024-02-15 22:53:30.493795547 +0000 UTC m=+0.654579858 container died e4a8326810341f2eebcc58f4a9afbb8df5685444bcc04a0f5430129e3173d909 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-15T22:53:31.245 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.2.service' 2024-02-15T22:53:31.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:31.291 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-15T22:53:31.292 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-15T22:53:31.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.3 2024-02-15T22:53:31.612 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:31 smithi082 systemd[1]: Stopping Ceph osd.3 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:31.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:31 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:53:31.609+0000 7f55fd6ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:31.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:31 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:53:31.609+0000 7f55fd6ff700 -1 osd.3 85 *** Got signal Terminated *** 2024-02-15T22:53:31.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:31 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:53:31.609+0000 7f55fd6ff700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:53:33.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:33 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:33.301+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:34.620 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:34 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:34.344+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:34.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:34 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:53:34.617+0000 7f55fa4f4700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:12.058632+0000 front 2024-02-15T22:53:12.058731+0000 (oldest deadline 2024-02-15T22:53:33.758415+0000) 2024-02-15T22:53:35.588 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:35 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:35.304+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:35.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:35 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:53:35.586+0000 7f55fa4f4700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:12.058632+0000 front 2024-02-15T22:53:12.058731+0000 (oldest deadline 2024-02-15T22:53:33.758415+0000) 2024-02-15T22:53:36.584 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:36 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:36.267+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:36.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:36 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3[94225]: 2024-02-15T22:53:36.582+0000 7f55fa4f4700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:12.058632+0000 front 2024-02-15T22:53:12.058731+0000 (oldest deadline 2024-02-15T22:53:33.758415+0000) 2024-02-15T22:53:36.876 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:36 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:36.644+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:37.226 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:36 smithi082 podman[117273]: 2024-02-15 22:53:36.942064485 +0000 UTC m=+5.462108143 container died 7778c235281ac76e69c4c30aeb61d4ead899b26ea49b6b31fe6e943cab05bf00 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:53:37.625 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:37 smithi082 podman[117273]: 2024-02-15 22:53:37.435493254 +0000 UTC m=+5.955536912 container cleanup 7778c235281ac76e69c4c30aeb61d4ead899b26ea49b6b31fe6e943cab05bf00 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-15T22:53:37.625 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:37 smithi082 bash[117273]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3 2024-02-15T22:53:37.626 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:37 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:37.223+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:38.007 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:37 smithi082 podman[117302]: 2024-02-15 22:53:37.687173134 +0000 UTC m=+0.739430069 container remove 7778c235281ac76e69c4c30aeb61d4ead899b26ea49b6b31fe6e943cab05bf00 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:53:38.007 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:37 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:37.623+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:38.275 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:38.179+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:38.276 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:38 smithi082 podman[117395]: 2024-02-15 22:53:37.909370197 +0000 UTC m=+0.017644699 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:53:38.276 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:38 smithi082 podman[117395]: 2024-02-15 22:53:38.063290441 +0000 UTC m=+0.171564978 container create db55d99bae6f70fa8ccabf679f2a5f1db1c96d4629d20ee8b8c6f390cbbd25a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-15T22:53:38.276 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:38 smithi082 podman[117395]: 2024-02-15 22:53:38.274136008 +0000 UTC m=+0.382410504 container init db55d99bae6f70fa8ccabf679f2a5f1db1c96d4629d20ee8b8c6f390cbbd25a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-15T22:53:38.573 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:38 smithi082 podman[117395]: 2024-02-15 22:53:38.277374097 +0000 UTC m=+0.385648600 container start db55d99bae6f70fa8ccabf679f2a5f1db1c96d4629d20ee8b8c6f390cbbd25a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-15T22:53:38.573 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:38 smithi082 podman[117395]: 2024-02-15 22:53:38.374155211 +0000 UTC m=+0.482429717 container attach db55d99bae6f70fa8ccabf679f2a5f1db1c96d4629d20ee8b8c6f390cbbd25a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True) 2024-02-15T22:53:38.875 INFO:journalctl@ceph.osd.3.smithi082.stdout:Feb 15 22:53:38 smithi082 podman[117395]: 2024-02-15 22:53:38.57176526 +0000 UTC m=+0.680039753 container died db55d99bae6f70fa8ccabf679f2a5f1db1c96d4629d20ee8b8c6f390cbbd25a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-15T22:53:38.875 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:38 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:38.612+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:39.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.3.service' 2024-02-15T22:53:39.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:39.375 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-15T22:53:39.375 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-15T22:53:39.375 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.4 2024-02-15T22:53:39.572 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:39 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:39.568+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:39.572 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:39 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:39.206+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:39.572 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:39 smithi082 systemd[1]: Stopping Ceph osd.4 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:39.875 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:39 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:39.697+0000 7fc23bb62700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:39.875 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:39 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:39.697+0000 7fc23bb62700 -1 osd.4 85 *** Got signal Terminated *** 2024-02-15T22:53:39.875 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:39 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:39.697+0000 7fc23bb62700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:53:40.584 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:40 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:40.197+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:40.875 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:40 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:40.581+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:41.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:41 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:41.242+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:42.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:41 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:41.630+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:42.613 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:42 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:42.261+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:42.613 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:42 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:42.261+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:15.643581+0000 front 2024-02-15T22:53:15.643505+0000 (oldest deadline 2024-02-15T22:53:41.543357+0000) 2024-02-15T22:53:42.875 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:42 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:42.611+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:42.875 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:42 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:42.611+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:43.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:43 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:43.292+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:43.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:43 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:43.292+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:15.643581+0000 front 2024-02-15T22:53:15.643505+0000 (oldest deadline 2024-02-15T22:53:41.543357+0000) 2024-02-15T22:53:44.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:43 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:43.646+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:44.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:43 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:43.646+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:44.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:44 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:44.310+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:09.242653+0000 front 2024-02-15T22:53:09.242636+0000 (oldest deadline 2024-02-15T22:53:32.742531+0000) 2024-02-15T22:53:44.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:44 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4[99364]: 2024-02-15T22:53:44.310+0000 7fc238957700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:15.643581+0000 front 2024-02-15T22:53:15.643505+0000 (oldest deadline 2024-02-15T22:53:41.543357+0000) 2024-02-15T22:53:45.097 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:44 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:44.686+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:45.097 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:44 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:44.686+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:45.375 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:45 smithi082 podman[117499]: 2024-02-15 22:53:45.094713877 +0000 UTC m=+5.503132234 container died 66b57df413a74c9353a7a5658e9a6fee32eaac710e695080f77d994127eb8cc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux ) 2024-02-15T22:53:45.759 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:45.717+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:45.759 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:45 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:45.717+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:45.759 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:45 smithi082 podman[117499]: 2024-02-15 22:53:45.472859916 +0000 UTC m=+5.881278270 container cleanup 66b57df413a74c9353a7a5658e9a6fee32eaac710e695080f77d994127eb8cc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:53:45.760 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:45 smithi082 bash[117499]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4 2024-02-15T22:53:46.091 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:45 smithi082 podman[117515]: 2024-02-15 22:53:45.75787601 +0000 UTC m=+0.662739004 container remove 66b57df413a74c9353a7a5658e9a6fee32eaac710e695080f77d994127eb8cc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:53:46.363 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:46 smithi082 podman[117607]: 2024-02-15 22:53:45.992305779 +0000 UTC m=+0.017897181 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:53:46.363 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:46 smithi082 podman[117607]: 2024-02-15 22:53:46.100265827 +0000 UTC m=+0.125857220 container create 9f465694f7fce7619d270d938277da44c8c7bbdde9e67ae9d9d93348aac5f2db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-15T22:53:46.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:46 smithi082 podman[117607]: 2024-02-15 22:53:46.361854351 +0000 UTC m=+0.387445752 container init 9f465694f7fce7619d270d938277da44c8c7bbdde9e67ae9d9d93348aac5f2db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-15T22:53:46.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:46 smithi082 podman[117607]: 2024-02-15 22:53:46.365239107 +0000 UTC m=+0.390830511 container start 9f465694f7fce7619d270d938277da44c8c7bbdde9e67ae9d9d93348aac5f2db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:53:46.625 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:46 smithi082 podman[117607]: 2024-02-15 22:53:46.444674133 +0000 UTC m=+0.470265532 container attach 9f465694f7fce7619d270d938277da44c8c7bbdde9e67ae9d9d93348aac5f2db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-15T22:53:47.032 INFO:journalctl@ceph.osd.4.smithi082.stdout:Feb 15 22:53:46 smithi082 podman[117607]: 2024-02-15 22:53:46.663371508 +0000 UTC m=+0.688962912 container died 9f465694f7fce7619d270d938277da44c8c7bbdde9e67ae9d9d93348aac5f2db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214) 2024-02-15T22:53:47.032 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:46 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:46.684+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:47.032 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:46 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:46.684+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:47.411 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.4.service' 2024-02-15T22:53:47.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:47.451 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-15T22:53:47.451 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-15T22:53:47.451 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.5 2024-02-15T22:53:47.676 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:47 smithi082 systemd[1]: Stopping Ceph osd.5 for cfc49586-cc51-11ee-95ba-87774f69a715... 2024-02-15T22:53:48.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:47 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:47.673+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:48.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:47 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:47.673+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:48.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:47 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:47.767+0000 7f6099b42700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:53:48.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:47 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:47.767+0000 7f6099b42700 -1 osd.5 85 *** Got signal Terminated *** 2024-02-15T22:53:48.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:47 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:47.767+0000 7f6099b42700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:53:49.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:48 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:48.670+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:49.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:48 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:48.670+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:50.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:49 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:49.699+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:50.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:49 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:49.699+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:51.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:50 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:50.665+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:51.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:50 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:50.665+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:52.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:51 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:51.685+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:52.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:51 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:51.685+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:53.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:52 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:52.658+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T22:53:10.868440+0000 front 2024-02-15T22:53:10.868493+0000 (oldest deadline 2024-02-15T22:53:36.168391+0000) 2024-02-15T22:53:53.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:52 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:52.658+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T22:53:16.168975+0000 front 2024-02-15T22:53:16.168918+0000 (oldest deadline 2024-02-15T22:53:42.068769+0000) 2024-02-15T22:53:53.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:52 smithi082 ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5[104402]: 2024-02-15T22:53:52.658+0000 7f609292f700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.33:6822 osd.2 since back 2024-02-15T22:53:25.470154+0000 front 2024-02-15T22:53:25.470206+0000 (oldest deadline 2024-02-15T22:53:52.470480+0000) 2024-02-15T22:53:53.486 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:53 smithi082 podman[117712]: 2024-02-15 22:53:53.196709448 +0000 UTC m=+5.528259952 container died 5aebe296615c83eb116df1fa489765dcaeeccd8eb9808fb4fa686246a52b0775 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:53:53.845 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:53 smithi082 podman[117712]: 2024-02-15 22:53:53.575585211 +0000 UTC m=+5.907135703 container cleanup 5aebe296615c83eb116df1fa489765dcaeeccd8eb9808fb4fa686246a52b0775 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True) 2024-02-15T22:53:53.845 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:53 smithi082 bash[117712]: ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5 2024-02-15T22:53:54.125 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:53 smithi082 podman[117730]: 2024-02-15 22:53:53.843644923 +0000 UTC m=+0.647437550 container remove 5aebe296615c83eb116df1fa489765dcaeeccd8eb9808fb4fa686246a52b0775 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-15T22:53:54.459 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:54 smithi082 podman[117821]: 2024-02-15 22:53:54.100417196 +0000 UTC m=+0.017741770 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:53:54.459 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:54 smithi082 podman[117821]: 2024-02-15 22:53:54.211298789 +0000 UTC m=+0.128623408 container create 1b6b9ca2f5210fac20d6fc89cf8accf9d7852bdec97e1516ee0e5c5d920b69f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-02-15T22:53:54.459 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:54 smithi082 podman[117821]: 2024-02-15 22:53:54.456222648 +0000 UTC m=+0.373547208 container init 1b6b9ca2f5210fac20d6fc89cf8accf9d7852bdec97e1516ee0e5c5d920b69f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-15T22:53:54.753 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:54 smithi082 podman[117821]: 2024-02-15 22:53:54.460645902 +0000 UTC m=+0.377970469 container start 1b6b9ca2f5210fac20d6fc89cf8accf9d7852bdec97e1516ee0e5c5d920b69f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-15T22:53:54.753 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:54 smithi082 podman[117821]: 2024-02-15 22:53:54.538454653 +0000 UTC m=+0.455779227 container attach 1b6b9ca2f5210fac20d6fc89cf8accf9d7852bdec97e1516ee0e5c5d920b69f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:53:55.042 INFO:journalctl@ceph.osd.5.smithi082.stdout:Feb 15 22:53:54 smithi082 podman[117821]: 2024-02-15 22:53:54.751649163 +0000 UTC m=+0.668973727 container died 1b6b9ca2f5210fac20d6fc89cf8accf9d7852bdec97e1516ee0e5c5d920b69f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-cfc49586-cc51-11ee-95ba-87774f69a715-osd-5-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-15T22:53:55.341 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cfc49586-cc51-11ee-95ba-87774f69a715@osd.5.service' 2024-02-15T22:53:55.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T22:53:55.380 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-15T22:53:55.380 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cfc49586-cc51-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T22:54:19.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cfc49586-cc51-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T22:54:30.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:54:30.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:54:30.978 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-15T22:54:30.980 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769/remote/smithi033/crash 2024-02-15T22:54:30.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/crash -- . 2024-02-15T22:54:31.018 INFO:teuthology.orchestra.run.smithi033.stderr:tar: /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T22:54:31.018 INFO:teuthology.orchestra.run.smithi033.stderr:tar: Error is not recoverable: exiting now 2024-02-15T22:54:31.020 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769/remote/smithi082/crash 2024-02-15T22:54:31.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/crash -- . 2024-02-15T22:54:31.047 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T22:54:31.047 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-02-15T22:54:31.049 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-15T22:54:31.049 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T22:54:31.093 INFO:teuthology.orchestra.run.smithi033.stdout:1708036710.0275278 mon.smithi033 (mon.0) 691 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T22:54:31.094 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-15T22:54:31.094 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[SEC\]' /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T22:54:31.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]' /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T22:54:31.244 INFO:teuthology.orchestra.run.smithi033.stdout:2024-02-15T22:50:00.000263+0000 mon.smithi033 (mon.0) 558 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T22:54:31.245 INFO:tasks.cephadm:Compressing logs... 2024-02-15T22:54:31.245 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T22:54:31.287 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T22:54:31.315 INFO:teuthology.orchestra.run.smithi033.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-15T22:54:31.316 INFO:teuthology.orchestra.run.smithi033.stderr:: No such file or directory 2024-02-15T22:54:31.316 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mon.smithi033.log 2024-02-15T22:54:31.316 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.xkdegf.log 2024-02-15T22:54:31.316 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T22:54:31.316 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mon.smithi033.log: /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.xkdegf.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.1.log 2024-02-15T22:54:31.316 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.0.log 2024-02-15T22:54:31.317 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.audit.log: /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T22:54:31.317 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log 2024-02-15T22:54:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-15T22:54:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:: No such file or directory 2024-02-15T22:54:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mgr.smithi082.mjhlse.log 2024-02-15T22:54:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi082.rtwnpu.log 2024-02-15T22:54:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T22:54:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mgr.smithi082.mjhlse.log: /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi082.rtwnpu.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.4.log 2024-02-15T22:54:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.5.log 2024-02-15T22:54:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.audit.log: /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.3.log 2024-02-15T22:54:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi082.lvpzpf.log 2024-02-15T22:54:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.3.log: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T22:54:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T22:54:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi082.lvpzpf.log: 91.1% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T22:54:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.cephadm.log: /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.0.log: 85.3% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T22:54:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.2.log 2024-02-15T22:54:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log: 90.9% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T22:54:31.324 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T22:54:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T22:54:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.ruqork.log 2024-02-15T22:54:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log 2024-02-15T22:54:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T22:54:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log: 85.2% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T22:54:31.330 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-volume.log: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T22:54:31.330 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mgr.smithi033.swohxi.log 2024-02-15T22:54:31.331 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T22:54:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mon.smithi082.log 2024-02-15T22:54:31.347 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.ruqork.log: 91.1% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T22:54:31.353 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-volume.log: /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mon.smithi082.log: 91.0% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T22:54:31.367 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mgr.smithi082.mjhlse.log.gz 2024-02-15T22:54:31.612 INFO:teuthology.orchestra.run.smithi082.stderr: 92.5% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mon.smithi082.log.gz 2024-02-15T22:54:31.710 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mgr.smithi033.swohxi.log: 88.3% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mgr.smithi033.swohxi.log.gz 2024-02-15T22:54:32.427 INFO:teuthology.orchestra.run.smithi033.stderr: 90.7% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mon.smithi033.log.gz 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi082.stderr: 93.3% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.4.log.gz 2024-02-15T22:54:35.627 INFO:teuthology.orchestra.run.smithi033.stderr: 93.4% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.2.log.gz 2024-02-15T22:54:36.705 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.5.log.gz 2024-02-15T22:54:37.014 INFO:teuthology.orchestra.run.smithi082.stderr: 93.3% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.3.log.gz 2024-02-15T22:54:37.467 INFO:teuthology.orchestra.run.smithi033.stderr: 93.3% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.0.log.gz 2024-02-15T22:54:37.849 INFO:teuthology.orchestra.run.smithi033.stderr: 93.4% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-osd.1.log.gz 2024-02-15T22:54:39.309 INFO:teuthology.orchestra.run.smithi082.stderr: 95.1% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi082.rtwnpu.log.gz 2024-02-15T22:54:40.218 INFO:teuthology.orchestra.run.smithi033.stderr: 95.0% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.xkdegf.log.gz 2024-02-15T22:55:12.169 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi082.lvpzpf.log.gz 2024-02-15T22:55:12.170 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-02-15T22:55:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m40.869s 2024-02-15T22:55:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:user 1m2.133s 2024-02-15T22:55:12.171 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m2.081s 2024-02-15T22:55:34.504 INFO:teuthology.orchestra.run.smithi033.stderr: 93.2% -- replaced with /var/log/ceph/cfc49586-cc51-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.ruqork.log.gz 2024-02-15T22:55:34.506 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T22:55:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:real 1m3.206s 2024-02-15T22:55:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:user 1m27.943s 2024-02-15T22:55:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m2.509s 2024-02-15T22:55:34.507 INFO:tasks.cephadm:Archiving logs... 2024-02-15T22:55:34.507 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769/remote/smithi033/log 2024-02-15T22:55:34.511 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T22:55:47.298 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769/remote/smithi082/log 2024-02-15T22:55:47.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T22:55:56.273 INFO:tasks.cephadm:Removing cluster... 2024-02-15T22:55:56.273 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cfc49586-cc51-11ee-95ba-87774f69a715 --force 2024-02-15T22:55:56.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cfc49586-cc51-11ee-95ba-87774f69a715 --force 2024-02-15T22:55:57.401 INFO:tasks.cephadm:Removing cephadm ... 2024-02-15T22:55:57.401 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T22:55:57.418 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T22:55:57.433 INFO:tasks.cephadm:Teardown complete 2024-02-15T22:55:57.433 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-15T22:55:57.444 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-15T22:55:57.445 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T22:55:57.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T22:55:57.549 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-15T22:55:57.560 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-15T22:55:57.560 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:55:57.563 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:55:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:55:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:55:57.578 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:55:57.579 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-02-15T22:55:57.579 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +1471us[+1460us] +/- 103ms 2024-02-15T22:55:57.579 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -1068us[-1079us] +/- 53ms 2024-02-15T22:55:57.579 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 47 +495us[ +495us] +/- 97ms 2024-02-15T22:55:57.579 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:55:57.580 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:55:57.580 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-02-15T22:55:57.581 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 45 +1515us[+1536us] +/- 103ms 2024-02-15T22:55:57.581 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 -1013us[ -992us] +/- 53ms 2024-02-15T22:55:57.581 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +505us[ +526us] +/- 97ms 2024-02-15T22:55:57.581 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:55:57.582 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-15T22:55:57.593 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-15T22:55:57.593 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-15T22:55:57.604 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T22:55:57.705 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T22:55:57.783 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:55:57.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:55:57.813 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:55:57.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:55:57.844 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-15T22:55:57.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-15T22:55:57.867 INFO:teuthology.task.internal:Duration was 1921.204074 seconds 2024-02-15T22:55:57.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-15T22:55:57.879 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-15T22:55:57.880 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T22:55:57.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T22:55:57.922 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:55:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:55:58.309 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-15T22:55:58.310 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T22:55:58.310 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T22:55:58.370 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-02-15T22:55:58.370 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T22:55:58.394 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-15T22:55:58.394 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T22:55:58.413 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T22:55:58.462 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-15T22:55:58.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T22:55:58.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T22:55:59.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-15T22:55:59.131 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-15T22:55:59.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T22:55:59.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T22:55:59.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-15T22:55:59.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:55:59.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:55:59.224 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-02-15T22:55:59.251 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-02-15T22:55:59.267 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:55:59.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:55:59.293 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:55:59.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:55:59.323 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-15T22:55:59.336 INFO:teuthology.task.internal:Transferring archived files... 2024-02-15T22:55:59.337 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769/remote/smithi033 2024-02-15T22:55:59.337 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T22:55:59.389 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769/remote/smithi082 2024-02-15T22:55:59.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T22:55:59.429 INFO:teuthology.task.internal:Removing archive directory... 2024-02-15T22:55:59.429 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T22:55:59.431 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T22:55:59.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-15T22:55:59.492 INFO:teuthology.task.internal:Not uploading archives. 2024-02-15T22:55:59.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-15T22:55:59.504 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-15T22:55:59.504 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T22:55:59.507 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T22:55:59.518 INFO:teuthology.orchestra.run.smithi033.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 22:55 /home/ubuntu/cephtest 2024-02-15T22:55:59.530 INFO:teuthology.orchestra.run.smithi082.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 22:55 /home/ubuntu/cephtest 2024-02-15T22:55:59.531 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-15T22:55:59.544 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-15T22:55:59.570 INFO:teuthology.nuke:Checking targets against current locks 2024-02-15T22:55:59.593 DEBUG:teuthology.nuke:shortname: smithi033 2024-02-15T22:55:59.594 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T22:55:59.615 DEBUG:teuthology.nuke:shortname: smithi082 2024-02-15T22:55:59.615 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T22:55:59.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:15:55.520213', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZvemMzOsX48Newb3UwATb2/jHFjFwknbtdZimpUHyZr9KLbv/6vEsX9gXjiGA/aoTnQ3DQrB/IZweXX2Kc8ck='} 2024-02-15T22:55:59.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:15:55.521827', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPoZPPqXbBoINHdvuMRBlSWQndJ+f0c64JZ/5fc6/PbosatwPRrtWOGVI+CV19fJB2jMVSXvi74Dpt+BPPNso4s='} 2024-02-15T22:55:59.663 INFO:teuthology.orchestra.console.smithi033:Power off 2024-02-15T22:55:59.664 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T22:55:59.688 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-02-15T22:55:59.688 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:55:59.704 INFO:teuthology.orchestra.console.smithi082:Power off 2024-02-15T22:55:59.704 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T22:55:59.714 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-15T22:55:59.727 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-02-15T22:55:59.727 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:55:59.750 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-15T22:56:03.715 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:56:03.751 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:56:03.826 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-15T22:56:03.861 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-15T22:56:07.831 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:56:07.862 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:56:07.941 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-02-15T22:56:07.972 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-02-15T22:56:08.042 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-02-15T22:56:08.073 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-02-15T22:56:08.177 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1921.2040741443634 failure_reason: '"2024-02-15T22:50:00.000263+0000 mon.smithi033 (mon.0) 558 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2024-02-15T22:56:08.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T22:56:08.251 INFO:teuthology.run:FAIL